2024-02-28T15:48:56.991 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T15:48:56.991 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584 --verbose -- /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584/orig.config.yaml 2024-02-28T15:48:57.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:48:57.128 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7575584' kernel: flavor: default kdb: true sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2226 sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 targets: smithi023.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKpxpgWMgX0oBaBg2HyrkwXrjJQLH9sk9pEpP2LeeYrmyTbUSJOmeTci4UVX+CmuzmJOi5jcgQ+HwlHs5370yA= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPIAzTIrAIc9zanZjYmoGU/DVZzidcfZQj5tbZ1QvpAH6YcrQPZPfnlTVWjULEuVIggv/619Rn+82cKCLi/vIog= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/vshankar/src/git.ceph.com_ceph-c_main/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-28_15:21:56 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-28T15:48:57.129 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa; will attempt to use it 2024-02-28T15:48:57.129 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks 2024-02-28T15:48:57.129 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-28T15:48:57.131 INFO:teuthology.task.internal:Checking packages... 2024-02-28T15:48:57.155 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb5d10608dccee73edd6ef8a2c7b804a097c324' 2024-02-28T15:48:57.155 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:48:57.155 INFO:teuthology.packaging:ref: None 2024-02-28T15:48:57.155 INFO:teuthology.packaging:tag: None 2024-02-28T15:48:57.155 INFO:teuthology.packaging:branch: main 2024-02-28T15:48:57.156 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:48:57.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-02-28T15:48:57.637 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1716.g4a1c26b5 2024-02-28T15:48:57.639 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-28T15:48:57.645 INFO:teuthology.task.internal:no buildpackages task found 2024-02-28T15:48:57.645 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-28T15:48:57.660 INFO:teuthology.task.internal:Saving configuration 2024-02-28T15:48:57.680 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-28T15:48:57.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T15:48:57.708 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:42:38.548639', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKpxpgWMgX0oBaBg2HyrkwXrjJQLH9sk9pEpP2LeeYrmyTbUSJOmeTci4UVX+CmuzmJOi5jcgQ+HwlHs5370yA='} 2024-02-28T15:48:57.733 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:42:38.550400', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPIAzTIrAIc9zanZjYmoGU/DVZzidcfZQj5tbZ1QvpAH6YcrQPZPfnlTVWjULEuVIggv/619Rn+82cKCLi/vIog='} 2024-02-28T15:48:57.733 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-28T15:48:57.738 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-28T15:48:57.739 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-28T15:48:57.739 INFO:teuthology.run_tasks:Running task console_log... 2024-02-28T15:48:57.808 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fab2ccb5160>, signals=[15]) 2024-02-28T15:48:57.808 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-28T15:48:57.814 INFO:teuthology.task.internal:Opening connections... 2024-02-28T15:48:57.814 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T15:48:57.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:57.926 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-02-28T15:48:57.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:58.016 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-28T15:48:58.023 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2024-02-28T15:48:58.041 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2024-02-28T15:48:58.041 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-02-28T15:48:58.098 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-02-28T15:48:58.098 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2024-02-28T15:48:58.098 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-02-28T15:48:58.098 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:48:58.099 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:48:58.100 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-02-28T15:48:58.124 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-02-28T15:48:58.142 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-02-28T15:48:58.142 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:48:58.200 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-02-28T15:48:58.201 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:48:58.201 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:48:58.201 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:48:58.201 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:48:58.201 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:48:58.201 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:48:58.203 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-02-28T15:48:58.224 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-28T15:48:58.234 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-28T15:48:58.239 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-28T15:48:58.239 DEBUG:teuthology.orchestra.run.smithi023:> test '!' -e /home/ubuntu/cephtest 2024-02-28T15:48:58.241 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-02-28T15:48:58.256 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-28T15:48:58.262 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-28T15:48:58.262 DEBUG:teuthology.orchestra.run.smithi023:> test -z $(ls -A /var/lib/ceph) 2024-02-28T15:48:58.298 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-02-28T15:48:58.330 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-28T15:48:58.384 INFO:teuthology.run_tasks:Running task kernel... 2024-02-28T15:48:58.399 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'} 2024-02-28T15:48:58.399 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}}, timeout 300 2024-02-28T15:48:58.400 DEBUG:teuthology.orchestra.run.smithi023:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T15:48:58.400 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T15:48:58.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:48:58.415 DEBUG:teuthology.task.kernel:sha1 for host.b is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:48:58.415 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T15:48:58.415 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-02-28T15:48:58.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:48:58.417 DEBUG:teuthology.task.kernel:sha1 for host.a is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:48:58.417 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T15:48:58.417 DEBUG:teuthology.orchestra.run.smithi023:> uname -r 2024-02-28T15:48:58.470 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-361.el9.x86_64 2024-02-28T15:48:58.470 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:48:58.470 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T15:48:58.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:48:58.474 INFO:teuthology.orchestra.run.smithi023.stdout:5.14.0-361.el9.x86_64 2024-02-28T15:48:58.475 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:48:58.475 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T15:48:58.475 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:48:58.618 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum upgrade -y linux-firmware 2024-02-28T15:48:58.708 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum upgrade -y linux-firmware 2024-02-28T15:49:01.353 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 8.7 MB/s | 8.1 MB 00:00 2024-02-28T15:49:01.554 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - AppStream 5.9 MB/s | 8.1 MB 00:01 2024-02-28T15:49:03.044 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.5 MB 00:00 2024-02-28T15:49:03.245 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - BaseOS 8.1 MB/s | 2.5 MB 00:00 2024-02-28T15:49:04.195 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-02-28T15:49:04.593 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.0 MB 00:01 2024-02-28T15:49:07.754 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 19 MB 00:02 2024-02-28T15:49:13.588 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.1 MB 00:02 2024-02-28T15:49:14.468 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-02-28T15:49:15.305 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-02-28T15:49:19.727 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.1 MB 00:01 2024-02-28T15:49:20.292 INFO:teuthology.orchestra.run.smithi023.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 20 MB 00:04 2024-02-28T15:49:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 15 kB 00:01 2024-02-28T15:49:24.431 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2024-02-28T15:49:25.447 INFO:teuthology.orchestra.run.smithi023.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-02-28T15:49:27.784 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T15:49:27.784 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T15:49:27.784 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T15:49:27.784 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T15:49:27.785 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.786 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.787 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.788 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T15:49:27.789 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.790 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.791 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.792 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:49:27.793 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.794 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.795 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:49:27.795 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:49:28.271 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T15:49:28.286 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T15:49:28.286 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T15:49:28.286 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T15:49:28.286 INFO:teuthology.orchestra.run.smithi023.stdout:Upgrading: 2024-02-28T15:49:28.286 INFO:teuthology.orchestra.run.smithi023.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T15:49:28.286 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T15:49:28.287 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T15:49:28.287 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T15:49:28.287 INFO:teuthology.orchestra.run.smithi023.stdout:Upgrade 1 Package 2024-02-28T15:49:28.287 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T15:49:28.287 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 376 M 2024-02-28T15:49:28.287 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T15:49:29.461 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T15:49:31.678 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.679 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T15:49:31.680 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.681 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T15:49:31.682 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.683 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.684 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:49:31.685 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:49:31.686 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:49:32.198 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T15:49:32.209 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T15:49:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T15:49:32.210 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T15:49:32.210 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-02-28T15:49:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T15:49:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T15:49:32.210 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T15:49:32.210 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T15:49:32.211 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 1 Package 2024-02-28T15:49:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T15:49:32.211 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 376 M 2024-02-28T15:49:32.211 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T15:52:17.087 INFO:teuthology.orchestra.run.smithi023.stdout:linux-firmware-20240219-143.el9.noarch.rpm 2.2 MB/s | 376 MB 02:48 2024-02-28T15:52:17.088 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:52:17.088 INFO:teuthology.orchestra.run.smithi023.stdout:Total 2.2 MB/s | 376 MB 02:48 2024-02-28T15:52:20.269 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T15:52:20.377 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T15:52:20.377 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T15:52:23.704 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T15:52:23.705 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T15:52:30.980 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T15:52:31.411 INFO:teuthology.orchestra.run.smithi023.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:52:31.509 INFO:teuthology.orchestra.run.smithi023.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:52:32.486 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:52:32.487 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:52:32.909 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:52:32.909 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T15:52:32.909 INFO:teuthology.orchestra.run.smithi023.stdout:Upgraded: 2024-02-28T15:52:32.909 INFO:teuthology.orchestra.run.smithi023.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T15:52:32.909 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T15:52:32.909 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T15:52:33.223 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T15:52:33.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:52:33.400 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T15:52:33.400 DEBUG:teuthology.orchestra.run.smithi023:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T15:52:33.403 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi023.front.sepia.ceph.com to complete... 2024-02-28T15:53:08.132 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28 15:53:08 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T15:53:08.133 INFO:teuthology.orchestra.run.smithi023.stderr:FINISHED --2024-02-28 15:53:08-- 2024-02-28T15:53:08.133 INFO:teuthology.orchestra.run.smithi023.stderr:Total wall clock time: 35s 2024-02-28T15:53:08.133 INFO:teuthology.orchestra.run.smithi023.stderr:Downloaded: 1 files, 320M in 34s (9.39 MB/s) 2024-02-28T15:53:08.136 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T15:53:08.137 DEBUG:teuthology.orchestra.run.smithi023:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T15:53:10.172 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying... ######################################## 2024-02-28T15:53:10.252 INFO:teuthology.orchestra.run.smithi023.stdout:Preparing... ######################################## 2024-02-28T15:53:10.336 INFO:teuthology.orchestra.run.smithi023.stdout:Updating / installing... 2024-02-28T15:53:18.233 INFO:teuthology.orchestra.run.smithi023.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T15:53:32.400 INFO:teuthology.orchestra.run.smithi023.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T15:53:55.458 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi023.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T15:53:55.458 DEBUG:teuthology.orchestra.run.smithi023:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T15:53:55.529 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T15:53:55.530 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T15:53:55.531 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T15:53:55.532 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T15:53:55.533 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T15:53:55.534 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T15:53:55.535 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T15:53:55.536 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T15:53:55.537 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T15:53:55.538 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T15:53:55.539 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T15:53:55.540 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T15:53:55.541 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T15:53:55.542 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T15:53:55.543 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T15:53:55.544 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T15:53:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T15:53:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T15:53:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T15:53:55.548 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T15:53:55.549 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T15:53:55.550 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T15:53:55.551 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T15:53:55.552 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T15:53:55.553 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T15:53:55.554 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T15:53:55.555 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T15:53:55.556 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T15:53:55.557 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T15:53:55.558 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T15:53:55.559 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T15:53:55.560 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T15:53:55.561 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T15:53:55.562 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T15:53:55.563 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T15:53:55.564 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T15:53:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T15:53:55.566 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T15:53:55.567 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T15:53:55.568 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T15:53:55.569 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T15:53:55.570 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T15:53:55.571 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T15:53:55.572 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T15:53:55.573 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T15:53:55.574 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T15:53:55.575 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T15:53:55.576 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T15:53:55.577 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T15:53:55.578 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T15:53:55.579 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T15:53:55.580 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T15:53:55.581 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T15:53:55.582 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T15:53:55.583 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T15:53:55.584 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T15:53:55.585 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T15:53:55.586 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T15:53:55.587 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T15:53:55.588 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T15:53:55.589 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T15:53:55.590 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T15:53:55.591 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T15:53:55.592 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T15:53:55.593 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T15:53:55.594 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T15:53:55.595 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T15:53:55.596 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T15:53:55.597 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T15:53:55.598 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T15:53:55.599 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T15:53:55.600 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T15:53:55.601 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T15:53:55.602 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T15:53:55.603 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T15:53:55.604 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T15:53:55.605 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T15:53:55.606 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T15:53:55.607 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T15:53:55.608 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T15:53:55.609 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T15:53:55.610 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T15:53:55.611 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T15:53:55.612 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T15:53:55.613 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T15:53:55.614 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T15:53:55.615 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T15:53:55.616 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T15:53:55.617 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T15:53:55.618 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T15:53:55.619 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T15:53:55.620 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T15:53:55.621 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T15:53:55.622 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T15:53:55.623 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T15:53:55.624 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T15:53:55.625 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T15:53:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T15:53:55.627 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T15:53:55.628 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T15:53:55.629 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T15:53:55.630 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T15:53:55.631 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T15:53:55.632 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T15:53:55.633 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T15:53:55.634 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T15:53:55.635 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T15:53:55.636 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T15:53:55.637 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T15:53:55.638 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T15:53:55.639 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T15:53:55.640 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T15:53:55.641 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T15:53:55.642 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T15:53:55.643 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T15:53:55.644 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T15:53:55.645 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T15:53:55.646 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T15:53:55.647 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T15:53:55.648 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T15:53:55.649 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T15:53:55.650 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T15:53:55.651 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T15:53:55.652 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T15:53:55.653 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T15:53:55.654 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T15:53:55.655 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T15:53:55.656 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T15:53:55.657 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T15:53:55.658 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T15:53:55.659 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T15:53:55.660 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T15:53:55.661 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T15:53:55.662 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T15:53:55.663 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T15:53:55.664 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T15:53:55.665 INFO:teuthology.orchestra.run.smithi023.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:53:55.669 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:53:55.670 DEBUG:teuthology.orchestra.run.smithi023:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout:fi 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout:for file in vmlinuz System.map config; do 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout: fi 2024-02-28T15:53:55.692 INFO:teuthology.orchestra.run.smithi023.stdout:done 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:fi 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:53:55.693 INFO:teuthology.orchestra.run.smithi023.stdout:fi 2024-02-28T15:53:55.694 DEBUG:teuthology.orchestra.run.smithi023:> sudo rpm -qi grub2-tools 2024-02-28T15:53:55.772 INFO:teuthology.orchestra.run.smithi023.stdout:Name : grub2-tools 2024-02-28T15:53:55.772 INFO:teuthology.orchestra.run.smithi023.stdout:Epoch : 1 2024-02-28T15:53:55.772 INFO:teuthology.orchestra.run.smithi023.stdout:Version : 2.06 2024-02-28T15:53:55.772 INFO:teuthology.orchestra.run.smithi023.stdout:Release : 68.el9 2024-02-28T15:53:55.772 INFO:teuthology.orchestra.run.smithi023.stdout:Architecture: x86_64 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Group : Unspecified 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Size : 8264254 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:License : GPLv3+ 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Packager : builder@centos.org 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Vendor : CentOS 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Summary : Support tools for GRUB. 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:Description : 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T15:53:55.773 INFO:teuthology.orchestra.run.smithi023.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T15:53:55.774 INFO:teuthology.orchestra.run.smithi023.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T15:53:55.774 INFO:teuthology.orchestra.run.smithi023.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T15:53:55.774 INFO:teuthology.orchestra.run.smithi023.stdout:hardware devices. 2024-02-28T15:53:55.774 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T15:53:55.774 INFO:teuthology.orchestra.run.smithi023.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T15:53:55.775 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T15:53:55.775 INFO:teuthology.task.kernel:Updating grub on smithi023 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:53:55.775 DEBUG:teuthology.orchestra.run.smithi023:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T15:53:56.357 INFO:teuthology.orchestra.run.smithi023.stderr:Generating grub configuration file ... 2024-02-28T15:53:57.746 INFO:teuthology.orchestra.run.smithi023.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T15:53:57.790 INFO:teuthology.orchestra.run.smithi023.stderr:done 2024-02-28T15:53:57.792 DEBUG:teuthology.orchestra.run.smithi023:> mktemp 2024-02-28T15:53:57.807 INFO:teuthology.orchestra.run.smithi023.stdout:/tmp/tmp.xrhezLnaiL 2024-02-28T15:53:57.808 DEBUG:teuthology.orchestra.run.smithi023:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xrhezLnaiL 2024-02-28T15:53:57.888 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 0666 /tmp/tmp.xrhezLnaiL 2024-02-28T15:53:58.029 DEBUG:teuthology.orchestra.remote:smithi023:/tmp/tmp.xrhezLnaiL is 6KB 2024-02-28T15:53:58.077 DEBUG:teuthology.orchestra.run.smithi023:> rm -fr /tmp/tmp.xrhezLnaiL 2024-02-28T15:53:58.091 DEBUG:teuthology.orchestra.run.smithi023:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T15:53:58.159 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T15:53:58.160 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T15:53:58.160 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T15:53:58.160 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T15:53:58.161 DEBUG:teuthology.orchestra.run.smithi023:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:53:58.308 DEBUG:teuthology.orchestra.run.smithi023:> sudo shutdown -r now 2024-02-28T15:54:28.312 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-28T15:54:28.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T15:54:28.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:54:46.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T15:54:55.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T15:54:55.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:54:58.780 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T15:55:10.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T15:55:10.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:55:13.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T15:55:28.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T15:55:28.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:55:31.932 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T15:55:49.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T15:55:49.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:56:08.380 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T15:56:29.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T15:56:29.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:56:29.683 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-02-28T15:56:30.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T15:56:30.207 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T15:56:30.208 DEBUG:teuthology.orchestra.run.smithi023:> uname -r 2024-02-28T15:56:30.246 INFO:teuthology.orchestra.run.smithi023.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:56:30.246 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:56:30.246 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T15:56:30.246 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T15:56:31.247 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-28T15:56:31.247 DEBUG:teuthology.orchestra.run.smithi023:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T15:56:31.378 INFO:teuthology.orchestra.run.smithi023.stdout:ttyS1 2024-02-28T15:56:31.420 DEBUG:teuthology.parallel:result is None 2024-02-28T15:57:23.645 INFO:teuthology.orchestra.run.smithi153.stdout:linux-firmware-20240219-143.el9.noarch.rpm 817 kB/s | 376 MB 07:51 2024-02-28T15:57:23.645 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:57:23.645 INFO:teuthology.orchestra.run.smithi153.stdout:Total 816 kB/s | 376 MB 07:51 2024-02-28T15:57:26.684 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T15:57:26.845 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T15:57:26.845 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T15:57:30.026 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T15:57:30.027 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T15:57:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T15:57:37.514 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:57:37.596 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:38.672 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:38.672 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:57:39.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:39.108 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T15:57:39.108 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-02-28T15:57:39.108 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T15:57:39.108 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T15:57:39.108 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T15:57:39.397 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T15:57:39.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:39.682 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T15:57:39.683 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T15:57:39.686 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi153.front.sepia.ceph.com to complete... 2024-02-28T15:57:51.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28 15:57:51 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T15:57:51.117 INFO:teuthology.orchestra.run.smithi153.stderr:FINISHED --2024-02-28 15:57:51-- 2024-02-28T15:57:51.118 INFO:teuthology.orchestra.run.smithi153.stderr:Total wall clock time: 11s 2024-02-28T15:57:51.118 INFO:teuthology.orchestra.run.smithi153.stderr:Downloaded: 1 files, 320M in 11s (28.9 MB/s) 2024-02-28T15:57:51.121 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T15:57:51.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T15:57:53.048 INFO:teuthology.orchestra.run.smithi153.stdout:Verifying... ######################################## 2024-02-28T15:57:53.145 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing... ######################################## 2024-02-28T15:57:53.225 INFO:teuthology.orchestra.run.smithi153.stdout:Updating / installing... 2024-02-28T15:58:00.720 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T15:58:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T15:58:39.158 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T15:58:39.158 DEBUG:teuthology.orchestra.run.smithi153:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T15:58:39.231 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T15:58:39.232 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T15:58:39.233 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T15:58:39.234 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T15:58:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T15:58:39.236 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T15:58:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T15:58:39.238 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T15:58:39.239 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T15:58:39.240 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T15:58:39.241 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T15:58:39.242 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T15:58:39.243 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T15:58:39.244 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T15:58:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T15:58:39.246 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T15:58:39.247 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T15:58:39.248 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T15:58:39.249 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T15:58:39.250 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T15:58:39.251 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T15:58:39.252 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T15:58:39.253 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T15:58:39.254 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T15:58:39.255 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T15:58:39.256 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T15:58:39.257 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T15:58:39.258 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T15:58:39.259 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T15:58:39.260 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T15:58:39.261 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T15:58:39.262 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T15:58:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T15:58:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T15:58:39.265 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T15:58:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T15:58:39.267 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T15:58:39.268 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T15:58:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T15:58:39.270 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T15:58:39.273 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T15:58:39.276 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T15:58:39.277 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T15:58:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T15:58:39.279 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T15:58:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T15:58:39.281 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T15:58:39.282 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T15:58:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T15:58:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T15:58:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T15:58:39.286 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T15:58:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T15:58:39.288 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T15:58:39.289 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T15:58:39.290 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T15:58:39.291 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T15:58:39.292 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T15:58:39.293 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T15:58:39.294 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T15:58:39.295 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T15:58:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T15:58:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T15:58:39.298 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T15:58:39.299 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T15:58:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T15:58:39.301 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T15:58:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T15:58:39.303 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T15:58:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T15:58:39.305 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T15:58:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T15:58:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T15:58:39.309 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T15:58:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T15:58:39.311 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T15:58:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T15:58:39.313 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T15:58:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T15:58:39.315 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T15:58:39.316 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T15:58:39.317 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T15:58:39.318 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T15:58:39.319 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T15:58:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T15:58:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T15:58:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T15:58:39.323 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T15:58:39.324 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T15:58:39.325 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T15:58:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T15:58:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T15:58:39.328 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T15:58:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T15:58:39.331 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T15:58:39.332 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T15:58:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T15:58:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T15:58:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T15:58:39.336 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T15:58:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T15:58:39.338 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T15:58:39.339 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T15:58:39.340 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T15:58:39.341 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T15:58:39.342 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T15:58:39.343 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T15:58:39.344 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T15:58:39.345 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T15:58:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T15:58:39.347 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T15:58:39.348 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T15:58:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T15:58:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T15:58:39.351 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T15:58:39.352 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T15:58:39.353 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T15:58:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T15:58:39.355 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T15:58:39.356 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T15:58:39.357 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T15:58:39.358 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T15:58:39.359 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T15:58:39.360 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T15:58:39.361 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T15:58:39.362 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T15:58:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T15:58:39.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:58:39.368 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:58:39.368 DEBUG:teuthology.orchestra.run.smithi153:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout:for file in vmlinuz System.map config; do 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout: fi 2024-02-28T15:58:39.391 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:58:39.392 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-02-28T15:58:39.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 68.el9 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8264254 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T15:58:39.469 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T15:58:39.470 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T15:58:39.471 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T15:58:39.471 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:58:39.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T15:58:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-02-28T15:58:41.538 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T15:58:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-02-28T15:58:41.575 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-02-28T15:58:41.590 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.rBmO0xSmKk 2024-02-28T15:58:41.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rBmO0xSmKk 2024-02-28T15:58:41.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.rBmO0xSmKk 2024-02-28T15:58:41.802 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.rBmO0xSmKk is 6KB 2024-02-28T15:58:41.851 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.rBmO0xSmKk 2024-02-28T15:58:41.866 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T15:58:41.930 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T15:58:41.930 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T15:58:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T15:58:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T15:58:41.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:58:42.091 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-02-28T15:59:12.094 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-28T15:59:12.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-02-28T15:59:12.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:59:30.620 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-02-28T15:59:39.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-02-28T15:59:39.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:59:42.684 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-02-28T15:59:54.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-02-28T15:59:54.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:13.120 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-02-28T16:00:28.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-02-28T16:00:28.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:31.000 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-02-28T16:00:31.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-02-28T16:00:31.670 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T16:00:31.671 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-02-28T16:00:31.709 INFO:teuthology.orchestra.run.smithi153.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T16:00:31.709 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T16:00:31.709 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T16:00:31.709 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T16:00:32.710 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-28T16:00:32.711 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T16:00:32.886 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-02-28T16:00:32.944 DEBUG:teuthology.parallel:result is None 2024-02-28T16:00:32.945 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-28T16:00:32.952 INFO:teuthology.task.internal:Creating test directory... 2024-02-28T16:00:32.952 DEBUG:teuthology.orchestra.run.smithi023:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T16:00:32.960 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T16:00:33.009 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-28T16:00:33.015 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-28T16:00:33.021 INFO:teuthology.task.internal:Creating archive directory... 2024-02-28T16:00:33.021 DEBUG:teuthology.orchestra.run.smithi023:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T16:00:33.026 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T16:00:33.099 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-28T16:00:33.110 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-28T16:00:33.110 DEBUG:teuthology.orchestra.run.smithi023:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T16:00:33.117 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T16:00:33.211 INFO:teuthology.orchestra.run.smithi023.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:00:33.212 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:00:33.249 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:00:33.254 INFO:teuthology.orchestra.run.smithi023.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:00:33.259 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-28T16:00:33.266 INFO:teuthology.task.internal:Configuring sudo... 2024-02-28T16:00:33.266 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T16:00:33.270 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T16:00:33.366 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-28T16:00:33.375 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-28T16:00:33.376 DEBUG:teuthology.orchestra.run.smithi023:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T16:00:33.383 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T16:00:33.433 DEBUG:teuthology.orchestra.run.smithi023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:00:33.524 DEBUG:teuthology.orchestra.run.smithi023:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:00:33.638 DEBUG:teuthology.orchestra.run.smithi023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:00:33.725 DEBUG:teuthology.orchestra.run.smithi023:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:00:33.828 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:00:33.828 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T16:00:33.931 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:00:34.007 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:00:34.102 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:00:34.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:00:34.263 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:00:34.263 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T16:00:34.352 DEBUG:teuthology.orchestra.run.smithi023:> sudo service rsyslog restart 2024-02-28T16:00:34.360 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-02-28T16:00:34.496 INFO:teuthology.orchestra.run.smithi023.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:00:34.506 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:00:35.002 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-28T16:00:35.009 INFO:teuthology.task.internal:Starting timer... 2024-02-28T16:00:35.009 INFO:teuthology.run_tasks:Running task pcp... 2024-02-28T16:00:35.033 INFO:teuthology.run_tasks:Running task selinux... 2024-02-28T16:00:35.040 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-28T16:00:35.041 DEBUG:teuthology.orchestra.run.smithi023:> sudo service auditd rotate 2024-02-28T16:00:35.187 INFO:teuthology.orchestra.run.smithi023.stdout:Rotating logs: 2024-02-28T16:00:35.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-02-28T16:00:35.324 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-02-28T16:00:35.328 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-28T16:00:35.329 DEBUG:teuthology.orchestra.run.smithi023:> /usr/sbin/getenforce 2024-02-28T16:00:35.386 INFO:teuthology.orchestra.run.smithi023.stdout:Permissive 2024-02-28T16:00:35.387 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-02-28T16:00:35.445 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-02-28T16:00:35.445 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi023.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-02-28T16:00:35.445 DEBUG:teuthology.orchestra.run.smithi023:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:00:35.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:00:35.525 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:00:35.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:00:35.603 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-28T16:00:35.603 DEBUG:teuthology.orchestra.run.smithi023:> sudo /usr/sbin/setenforce permissive 2024-02-28T16:00:35.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-02-28T16:00:35.784 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-28T16:00:35.794 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-28T16:00:35.800 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-28T16:00:36.002 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-28T16:00:36.018 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-28T16:00:36.020 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi023.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-28T16:07:10.093 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi023.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-02-28T16:07:10.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T16:07:10.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:07:10.251 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-02-28T16:07:10.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T16:07:10.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-02-28T16:07:10.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:07:10.555 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-02-28T16:07:10.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-02-28T16:07:10.706 INFO:teuthology.run_tasks:Running task clock... 2024-02-28T16:07:10.719 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-28T16:07:10.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T16:07:10.720 DEBUG:teuthology.orchestra.run.smithi023:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:07:10.728 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T16:07:10.728 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:07:10.830 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T16:07:10.831 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T16:07:10.878 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T16:07:10.884 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T16:07:10.974 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-02-28T16:07:10.980 INFO:teuthology.orchestra.run.smithi023.stderr:sudo: ntpd: command not found 2024-02-28T16:07:11.018 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-02-28T16:07:11.028 INFO:teuthology.orchestra.run.smithi023.stdout:506 Cannot talk to daemon 2024-02-28T16:07:11.069 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T16:07:11.084 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T16:07:11.117 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T16:07:11.139 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T16:07:11.250 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:07:11.259 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:07:11.259 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-02-28T16:07:11.259 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.259 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.259 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.259 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.279 INFO:teuthology.orchestra.run.smithi023.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:07:11.287 INFO:teuthology.orchestra.run.smithi023.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:07:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:=============================================================================== 2024-02-28T16:07:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:11.290 INFO:teuthology.run_tasks:Running task install... 2024-02-28T16:07:11.305 DEBUG:teuthology.task.install:project ceph 2024-02-28T16:07:11.305 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}} 2024-02-28T16:07:11.305 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T16:07:11.305 INFO:teuthology.task.install:Using flavor: default 2024-02-28T16:07:11.315 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-28T16:07:11.315 INFO:teuthology.task.install:extra packages: [] 2024-02-28T16:07:11.315 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-02-28T16:07:11.316 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T16:07:11.316 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:11.316 INFO:teuthology.packaging:tag: v18.2.0 2024-02-28T16:07:11.316 INFO:teuthology.packaging:branch: None 2024-02-28T16:07:11.316 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:11.630 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.0^{} -> None 2024-02-28T16:07:11.630 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T16:07:13.508 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-28T16:07:13.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-28T16:07:13.512 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-02-28T16:07:13.512 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T16:07:13.512 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:13.512 INFO:teuthology.packaging:tag: v18.2.0 2024-02-28T16:07:13.512 INFO:teuthology.packaging:branch: None 2024-02-28T16:07:13.513 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:13.513 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T16:07:13.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-28T16:07:13.662 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-02-28T16:07:13.662 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-02-28T16:07:13.675 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-02-28T16:07:13.675 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-02-28T16:07:13.705 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T16:07:13.705 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:07:13.705 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T16:07:13.710 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T16:07:13.711 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:07:13.711 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T16:07:13.808 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T16:07:13.808 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T16:07:13.808 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:13.809 INFO:teuthology.packaging:tag: v18.2.0 2024-02-28T16:07:13.809 INFO:teuthology.packaging:branch: None 2024-02-28T16:07:13.809 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:13.809 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T16:07:13.812 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T16:07:13.812 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T16:07:13.813 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:13.813 INFO:teuthology.packaging:tag: v18.2.0 2024-02-28T16:07:13.813 INFO:teuthology.packaging:branch: None 2024-02-28T16:07:13.813 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:13.813 DEBUG:teuthology.orchestra.run.smithi023:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T16:07:13.945 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T16:07:13.957 DEBUG:teuthology.orchestra.run.smithi023:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T16:07:14.076 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T16:07:14.096 DEBUG:teuthology.orchestra.run.smithi023:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T16:07:14.167 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-02-28T16:07:14.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-02-28T16:07:14.187 INFO:teuthology.orchestra.run.smithi023.stdout:check_obsoletes = 1 2024-02-28T16:07:14.191 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum clean all 2024-02-28T16:07:14.529 INFO:teuthology.orchestra.run.smithi153.stdout:74 files removed 2024-02-28T16:07:14.569 INFO:teuthology.orchestra.run.smithi023.stdout:74 files removed 2024-02-28T16:07:14.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw 2024-02-28T16:07:14.608 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-radosgw 2024-02-28T16:07:15.239 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 461 kB/s | 76 kB 00:00 2024-02-28T16:07:15.296 INFO:teuthology.orchestra.run.smithi023.stdout:ceph packages for x86_64 468 kB/s | 76 kB 00:00 2024-02-28T16:07:15.422 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 67 kB/s | 9.3 kB 00:00 2024-02-28T16:07:15.505 INFO:teuthology.orchestra.run.smithi023.stdout:ceph noarch packages 59 kB/s | 9.3 kB 00:00 2024-02-28T16:07:15.606 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 15 kB/s | 2.2 kB 00:00 2024-02-28T16:07:15.698 INFO:teuthology.orchestra.run.smithi023.stdout:ceph source packages 14 kB/s | 2.2 kB 00:00 2024-02-28T16:07:16.187 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-02-28T16:07:16.254 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - AppStream 16 MB/s | 8.1 MB 00:00 2024-02-28T16:07:18.012 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.5 MB 00:00 2024-02-28T16:07:18.120 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.5 MB 00:00 2024-02-28T16:07:19.025 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-02-28T16:07:19.441 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-02-28T16:07:21.759 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-02-28T16:07:23.092 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 19 MB 00:02 2024-02-28T16:07:26.591 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.1 MB 00:00 2024-02-28T16:07:28.111 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 15 kB 00:00 2024-02-28T16:07:29.468 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2024-02-28T16:07:35.321 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-02-28T16:07:35.583 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - CRB 742 kB/s | 6.1 MB 00:08 2024-02-28T16:07:37.184 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2024-02-28T16:07:37.951 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:07:37.951 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:07:37.951 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:07:37.952 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.953 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.954 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.955 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.956 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.957 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.958 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.959 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.960 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.960 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:07:37.960 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.960 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.960 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:07:37.960 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:07:38.620 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:07:38.635 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:07:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-02-28T16:07:38.635 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-28T16:07:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-02-28T16:07:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout:Install 28 Packages 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 2 Packages 2024-02-28T16:07:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:07:38.639 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 53 M 2024-02-28T16:07:38.639 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:07:39.163 INFO:teuthology.orchestra.run.smithi153.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 17 MB/s | 5.2 MB 00:00 2024-02-28T16:07:39.205 INFO:teuthology.orchestra.run.smithi153.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 585 kB/s | 24 kB 00:00 2024-02-28T16:07:39.264 INFO:teuthology.orchestra.run.smithi153.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 11 MB/s | 653 kB 00:00 2024-02-28T16:07:39.314 INFO:teuthology.orchestra.run.smithi153.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 9.4 MB/s | 474 kB 00:00 2024-02-28T16:07:39.481 INFO:teuthology.orchestra.run.smithi153.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 12 MB/s | 7.6 MB 00:00 2024-02-28T16:07:39.556 INFO:teuthology.orchestra.run.smithi153.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 606 kB/s | 45 kB 00:00 2024-02-28T16:07:39.590 INFO:teuthology.orchestra.run.smithi153.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 3.6 MB/s | 119 kB 00:00 2024-02-28T16:07:39.624 INFO:teuthology.orchestra.run.smithi153.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 4.7 MB/s | 155 kB 00:00 2024-02-28T16:07:39.674 INFO:teuthology.orchestra.run.smithi153.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2024-02-28T16:07:39.717 INFO:teuthology.orchestra.run.smithi153.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 7.1 MB/s | 297 kB 00:00 2024-02-28T16:07:39.750 INFO:teuthology.orchestra.run.smithi153.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 99 kB 00:00 2024-02-28T16:07:39.867 INFO:teuthology.orchestra.run.smithi153.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-02-28T16:07:39.909 INFO:teuthology.orchestra.run.smithi153.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 679 kB/s | 107 kB 00:00 2024-02-28T16:07:39.992 INFO:teuthology.orchestra.run.smithi153.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 549 kB/s | 45 kB 00:00 2024-02-28T16:07:40.043 INFO:teuthology.orchestra.run.smithi153.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 916 kB/s | 160 kB 00:00 2024-02-28T16:07:40.118 INFO:teuthology.orchestra.run.smithi153.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-02-28T16:07:40.152 INFO:teuthology.orchestra.run.smithi153.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 292 kB 00:00 2024-02-28T16:07:40.202 INFO:teuthology.orchestra.run.smithi153.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 510 kB/s | 42 kB 00:00 2024-02-28T16:07:40.469 INFO:teuthology.orchestra.run.smithi153.stdout:(19/30): ceph-common-18.2.0-0.el9.x86_64.rpm 11 MB/s | 18 MB 00:01 2024-02-28T16:07:40.494 INFO:teuthology.orchestra.run.smithi153.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 325 kB/s | 111 kB 00:00 2024-02-28T16:07:40.536 INFO:teuthology.orchestra.run.smithi153.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 630 kB/s | 26 kB 00:00 2024-02-28T16:07:40.569 INFO:teuthology.orchestra.run.smithi153.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 843 kB/s | 309 kB 00:00 2024-02-28T16:07:40.587 INFO:teuthology.orchestra.run.smithi153.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 980 kB/s | 49 kB 00:00 2024-02-28T16:07:40.612 INFO:teuthology.orchestra.run.smithi153.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-02-28T16:07:40.687 INFO:teuthology.orchestra.run.smithi153.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-02-28T16:07:40.746 INFO:teuthology.orchestra.run.smithi153.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-02-28T16:07:40.896 INFO:teuthology.orchestra.run.smithi153.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 22 MB/s | 3.3 MB 00:00 2024-02-28T16:07:40.955 INFO:teuthology.orchestra.run.smithi153.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 6.0 MB/s | 1.6 MB 00:00 2024-02-28T16:07:41.063 INFO:teuthology.orchestra.run.smithi153.stdout:(29/30): libarrow-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-02-28T16:07:41.155 INFO:teuthology.orchestra.run.smithi153.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-02-28T16:07:41.160 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:07:41.161 INFO:teuthology.orchestra.run.smithi153.stdout:Total 21 MB/s | 53 MB 00:02 2024-02-28T16:07:41.390 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:07:41.470 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:07:41.470 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:07:42.000 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:07:42.001 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:07:43.502 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:07:43.640 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-28T16:07:43.681 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-28T16:07:43.790 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-28T16:07:44.177 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-28T16:07:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-28T16:07:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-28T16:07:44.429 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-02-28T16:07:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-28T16:07:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-28T16:07:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-28T16:07:44.647 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-02-28T16:07:44.791 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-28T16:07:44.813 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-28T16:07:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-28T16:07:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-28T16:07:45.132 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-28T16:07:45.186 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-28T16:07:45.223 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-28T16:07:45.264 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-28T16:07:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-28T16:07:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-28T16:07:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-28T16:07:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-28T16:07:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-28T16:07:45.952 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-02-28T16:07:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-28T16:07:46.493 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-28T16:07:46.530 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-28T16:07:46.622 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-28T16:07:46.721 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-02-28T16:07:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-02-28T16:07:49.172 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-28T16:07:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-28T16:07:49.855 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-28T16:07:49.923 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-28T16:07:50.093 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-28T16:07:50.093 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T16:07:50.093 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T16:07:50.093 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:07:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-28T16:07:57.890 INFO:teuthology.orchestra.run.smithi023.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 20 MB 00:20 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-02-28T16:08:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:02.138 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-28T16:08:02.209 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-28T16:08:02.210 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:02.210 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T16:08:02.210 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:02.210 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:02.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:02.215 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T16:08:02.367 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T16:08:02.367 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T16:08:03.875 INFO:teuthology.orchestra.run.smithi023.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-02-28T16:08:03.931 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-28T16:08:03.932 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-28T16:08:03.933 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-02-28T16:08:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T16:08:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:04.809 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-02-28T16:08:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.809 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:08:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-28T16:08:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T16:08:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-3.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:04.811 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:05.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-test 2024-02-28T16:08:06.100 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:31 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:06.419 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:06.419 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:06.419 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.420 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.421 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:06.422 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.423 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.424 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.425 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.425 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:06.425 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.425 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.426 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:06.427 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.427 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.427 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.427 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.427 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:06.427 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.429 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.498 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:06.499 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:06.499 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:08:06.499 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:06.499 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:08:06.499 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2024-02-28T16:08:06.500 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:06.501 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 40 M 2024-02-28T16:08:06.501 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 167 M 2024-02-28T16:08:06.501 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:08:06.618 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:08:06.619 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:08:06.620 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:08:06.621 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.622 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:08:06.623 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.624 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.625 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.625 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.625 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:06.625 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.625 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:06.626 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.627 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.628 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.628 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.628 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:06.628 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.628 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.628 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:06.628 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:07.292 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:08:07.302 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 988 kB/s | 161 kB 00:00 2024-02-28T16:08:07.303 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:07.303 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout:Upgrading: 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T16:08:07.304 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-02-28T16:08:07.305 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout:Install 28 Packages 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout:Upgrade 2 Packages 2024-02-28T16:08:07.306 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:07.307 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 53 M 2024-02-28T16:08:07.307 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:08:07.468 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): jq-1.6-16.el9.x86_64.rpm 568 kB/s | 187 kB 00:00 2024-02-28T16:08:07.569 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 819 kB/s | 218 kB 00:00 2024-02-28T16:08:07.594 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.4 MB/s | 305 kB 00:00 2024-02-28T16:08:07.627 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-02-28T16:08:08.018 INFO:teuthology.orchestra.run.smithi023.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 16 MB/s | 5.2 MB 00:00 2024-02-28T16:08:08.035 INFO:teuthology.orchestra.run.smithi023.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 1.5 MB/s | 24 kB 00:00 2024-02-28T16:08:08.078 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): ceph-test-18.2.0-0.el9.x86_64.rpm 42 MB/s | 40 MB 00:00 2024-02-28T16:08:08.082 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:08.083 INFO:teuthology.orchestra.run.smithi153.stdout:Total 26 MB/s | 40 MB 00:01 2024-02-28T16:08:08.094 INFO:teuthology.orchestra.run.smithi023.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 11 MB/s | 653 kB 00:00 2024-02-28T16:08:08.136 INFO:teuthology.orchestra.run.smithi023.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 11 MB/s | 474 kB 00:00 2024-02-28T16:08:08.232 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:08:08.285 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:08:08.286 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:08:08.303 INFO:teuthology.orchestra.run.smithi023.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 13 MB/s | 7.6 MB 00:00 2024-02-28T16:08:08.361 INFO:teuthology.orchestra.run.smithi023.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 786 kB/s | 45 kB 00:00 2024-02-28T16:08:08.395 INFO:teuthology.orchestra.run.smithi023.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 3.6 MB/s | 119 kB 00:00 2024-02-28T16:08:08.428 INFO:teuthology.orchestra.run.smithi023.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 4.7 MB/s | 155 kB 00:00 2024-02-28T16:08:08.470 INFO:teuthology.orchestra.run.smithi023.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-02-28T16:08:08.512 INFO:teuthology.orchestra.run.smithi023.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 7.2 MB/s | 297 kB 00:00 2024-02-28T16:08:08.546 INFO:teuthology.orchestra.run.smithi023.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 99 kB 00:00 2024-02-28T16:08:08.672 INFO:teuthology.orchestra.run.smithi023.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-02-28T16:08:08.712 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:08:08.713 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:08:08.972 INFO:teuthology.orchestra.run.smithi023.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 14 MB/s | 18 MB 00:01 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi023.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 194 kB/s | 107 kB 00:00 2024-02-28T16:08:09.317 INFO:teuthology.orchestra.run.smithi023.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 249 kB/s | 160 kB 00:00 2024-02-28T16:08:09.339 INFO:teuthology.orchestra.run.smithi023.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 124 kB/s | 45 kB 00:00 2024-02-28T16:08:09.418 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:08:09.465 INFO:teuthology.orchestra.run.smithi023.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 340 kB/s | 42 kB 00:00 2024-02-28T16:08:09.506 INFO:teuthology.orchestra.run.smithi023.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 1.6 MB/s | 662 kB 00:00 2024-02-28T16:08:09.508 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T16:08:09.571 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T16:08:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T16:08:09.665 INFO:teuthology.orchestra.run.smithi023.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 842 kB/s | 292 kB 00:00 2024-02-28T16:08:09.700 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T16:08:09.740 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-28T16:08:09.873 INFO:teuthology.orchestra.run.smithi023.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 271 kB/s | 111 kB 00:00 2024-02-28T16:08:09.958 INFO:teuthology.orchestra.run.smithi023.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 313 kB/s | 26 kB 00:00 2024-02-28T16:08:09.991 INFO:teuthology.orchestra.run.smithi023.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 638 kB/s | 309 kB 00:00 2024-02-28T16:08:10.049 INFO:teuthology.orchestra.run.smithi023.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 534 kB/s | 49 kB 00:00 2024-02-28T16:08:10.075 INFO:teuthology.orchestra.run.smithi023.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 813 kB/s | 67 kB 00:00 2024-02-28T16:08:10.176 INFO:teuthology.orchestra.run.smithi023.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-02-28T16:08:10.519 INFO:teuthology.orchestra.run.smithi023.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.7 MB/s | 838 kB 00:00 2024-02-28T16:08:10.609 INFO:teuthology.orchestra.run.smithi023.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-02-28T16:08:10.735 INFO:teuthology.orchestra.run.smithi023.stdout:(28/30): libarrow-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-02-28T16:08:10.835 INFO:teuthology.orchestra.run.smithi023.stdout:(29/30): librados2-18.2.0-0.el9.x86_64.rpm 10 MB/s | 3.3 MB 00:00 2024-02-28T16:08:10.910 INFO:teuthology.orchestra.run.smithi023.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-02-28T16:08:10.920 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:10.921 INFO:teuthology.orchestra.run.smithi023.stdout:Total 15 MB/s | 53 MB 00:03 2024-02-28T16:08:11.160 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:08:11.244 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:08:11.244 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:08:11.768 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:08:11.768 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:08:13.295 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:08:13.402 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-28T16:08:13.460 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-28T16:08:13.567 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-28T16:08:13.882 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-28T16:08:13.969 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-28T16:08:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-28T16:08:14.014 INFO:teuthology.orchestra.run.smithi023.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-28T16:08:14.123 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-28T16:08:14.256 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-02-28T16:08:14.282 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-28T16:08:14.366 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-28T16:08:14.411 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-28T16:08:14.489 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-02-28T16:08:14.597 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-28T16:08:14.626 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-28T16:08:14.729 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-28T16:08:14.918 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-28T16:08:14.954 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-28T16:08:15.021 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-28T16:08:15.069 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-28T16:08:15.111 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-28T16:08:15.162 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-28T16:08:15.233 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-28T16:08:15.633 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-28T16:08:15.665 INFO:teuthology.orchestra.run.smithi023.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-28T16:08:15.788 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-28T16:08:15.822 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-02-28T16:08:15.886 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-28T16:08:16.158 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-28T16:08:16.158 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-02-28T16:08:16.158 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-02-28T16:08:16.158 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T16:08:16.158 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T16:08:16.158 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T16:08:16.367 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-28T16:08:16.401 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-28T16:08:16.495 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-28T16:08:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T16:08:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:16.523 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:08:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-28T16:08:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T16:08:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T16:08:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:16.524 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:16.597 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-02-28T16:08:16.628 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-02-28T16:08:16.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph 2024-02-28T16:08:17.798 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:42 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:18.122 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:18.123 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:18.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:18.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:18.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:18.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.130 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:18.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:18.198 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T16:08:18.201 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T16:08:18.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:18.203 INFO:teuthology.orchestra.run.smithi153.stdout:Install 33 Packages 2024-02-28T16:08:18.204 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:18.204 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 30 M 2024-02-28T16:08:18.204 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 109 M 2024-02-28T16:08:18.204 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:08:19.048 INFO:teuthology.orchestra.run.smithi153.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 36 kB/s | 6.4 kB 00:00 2024-02-28T16:08:19.096 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-28T16:08:19.115 INFO:teuthology.orchestra.run.smithi153.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-02-28T16:08:19.142 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-28T16:08:19.173 INFO:teuthology.orchestra.run.smithi153.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 6.8 MB/s | 2.1 MB 00:00 2024-02-28T16:08:19.207 INFO:teuthology.orchestra.run.smithi153.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.1 MB/s | 240 kB 00:00 2024-02-28T16:08:19.324 INFO:teuthology.orchestra.run.smithi153.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-02-28T16:08:19.424 INFO:teuthology.orchestra.run.smithi153.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-02-28T16:08:19.475 INFO:teuthology.orchestra.run.smithi153.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-02-28T16:08:19.533 INFO:teuthology.orchestra.run.smithi153.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-02-28T16:08:19.725 INFO:teuthology.orchestra.run.smithi153.stdout:(9/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 29 MB/s | 18 MB 00:00 2024-02-28T16:08:19.759 INFO:teuthology.orchestra.run.smithi153.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 555 kB/s | 125 kB 00:00 2024-02-28T16:08:19.809 INFO:teuthology.orchestra.run.smithi153.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-02-28T16:08:19.813 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-28T16:08:19.861 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-28T16:08:20.039 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-28T16:08:20.039 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T16:08:20.040 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T16:08:20.040 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:20.087 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-28T16:08:20.201 INFO:teuthology.orchestra.run.smithi153.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 89 kB/s | 35 kB 00:00 2024-02-28T16:08:20.226 INFO:teuthology.orchestra.run.smithi153.stdout:(13/33): python3-urllib3-1.26.5-5.el9.noarch.rp 429 kB/s | 215 kB 00:00 2024-02-28T16:08:20.285 INFO:teuthology.orchestra.run.smithi153.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 328 kB/s | 172 kB 00:00 2024-02-28T16:08:20.385 INFO:teuthology.orchestra.run.smithi153.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 279 kB/s | 51 kB 00:00 2024-02-28T16:08:20.469 INFO:teuthology.orchestra.run.smithi153.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 172 kB/s | 42 kB 00:00 2024-02-28T16:08:20.494 INFO:teuthology.orchestra.run.smithi153.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 208 kB/s | 43 kB 00:00 2024-02-28T16:08:20.586 INFO:teuthology.orchestra.run.smithi153.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 117 kB/s | 11 kB 00:00 2024-02-28T16:08:20.620 INFO:teuthology.orchestra.run.smithi153.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 742 kB/s | 172 kB 00:00 2024-02-28T16:08:20.670 INFO:teuthology.orchestra.run.smithi153.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.8 MB/s | 358 kB 00:00 2024-02-28T16:08:20.687 INFO:teuthology.orchestra.run.smithi153.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 178 kB/s | 18 kB 00:00 2024-02-28T16:08:20.712 INFO:teuthology.orchestra.run.smithi153.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 253 kB/s | 23 kB 00:00 2024-02-28T16:08:20.738 INFO:teuthology.orchestra.run.smithi153.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 293 kB/s | 19 kB 00:00 2024-02-28T16:08:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 263 kB/s | 20 kB 00:00 2024-02-28T16:08:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-02-28T16:08:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:(26/33): python3-logutils-0.3.5-21.el9.noarch.r 396 kB/s | 46 kB 00:00 2024-02-28T16:08:20.864 INFO:teuthology.orchestra.run.smithi153.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 283 kB/s | 16 kB 00:00 2024-02-28T16:08:20.889 INFO:teuthology.orchestra.run.smithi153.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-02-28T16:08:20.931 INFO:teuthology.orchestra.run.smithi153.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 540 kB/s | 36 kB 00:00 2024-02-28T16:08:20.973 INFO:teuthology.orchestra.run.smithi153.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 634 kB/s | 90 kB 00:00 2024-02-28T16:08:20.998 INFO:teuthology.orchestra.run.smithi153.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-02-28T16:08:21.057 INFO:teuthology.orchestra.run.smithi153.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 241 kB/s | 20 kB 00:00 2024-02-28T16:08:21.098 INFO:teuthology.orchestra.run.smithi153.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.5 MB/s | 427 kB 00:00 2024-02-28T16:08:21.106 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:21.106 INFO:teuthology.orchestra.run.smithi153.stdout:Total 10 MB/s | 30 MB 00:02 2024-02-28T16:08:21.471 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:08:21.558 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:08:21.558 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:08:22.021 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:08:22.021 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:08:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:08:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T16:08:23.549 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T16:08:23.593 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T16:08:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T16:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T16:08:23.892 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T16:08:23.933 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T16:08:23.970 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T16:08:24.032 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T16:08:24.076 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T16:08:24.151 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T16:08:24.225 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T16:08:24.271 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T16:08:24.330 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T16:08:24.468 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T16:08:24.676 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T16:08:24.775 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T16:08:24.844 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T16:08:24.896 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T16:08:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T16:08:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T16:08:25.296 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T16:08:25.366 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T16:08:25.456 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T16:08:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T16:08:25.613 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T16:08:25.762 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T16:08:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-02-28T16:08:25.971 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-28T16:08:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-28T16:08:26.051 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:26.051 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T16:08:26.051 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:08:26.051 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:08:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-28T16:08:27.748 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-28T16:08:27.748 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:27.748 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T16:08:27.748 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:08:27.748 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:08:27.748 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:28.240 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-28T16:08:28.310 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-28T16:08:28.311 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:28.311 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T16:08:28.311 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:08:28.311 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:08:28.311 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:28.540 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-28T16:08:28.613 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-28T16:08:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T16:08:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:08:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:08:28.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:28.703 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-28T16:08:28.819 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-28T16:08:28.819 INFO:teuthology.orchestra.run.smithi153.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T16:08:28.819 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-02-28T16:08:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-02-28T16:08:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-02-28T16:08:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-02-28T16:08:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-02-28T16:08:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-02-28T16:08:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T16:08:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T16:08:30.650 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T16:08:31.558 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-28T16:08:31.558 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /sys 2024-02-28T16:08:31.558 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /proc 2024-02-28T16:08:31.558 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /mnt 2024-02-28T16:08:31.558 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /var/tmp 2024-02-28T16:08:31.558 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /home 2024-02-28T16:08:31.559 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /root 2024-02-28T16:08:31.559 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /tmp 2024-02-28T16:08:31.559 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:31.705 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:31.706 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T16:08:31.707 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T16:08:31.708 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:31.709 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:32.142 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-base 2024-02-28T16:08:32.391 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-28T16:08:32.465 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-28T16:08:32.465 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:32.465 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T16:08:32.465 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:32.465 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:32.465 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:32.470 INFO:teuthology.orchestra.run.smithi023.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T16:08:32.596 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T16:08:32.596 INFO:teuthology.orchestra.run.smithi023.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T16:08:32.997 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:58 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:33.305 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:33.305 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:33.305 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:33.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:33.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:33.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:33.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:33.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:33.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.311 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:33.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.311 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:33.312 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.313 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.313 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.313 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.313 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:33.313 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.313 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.313 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.314 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:33.315 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:33.316 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.317 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.317 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.317 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:33.317 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:08:33.373 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:33.375 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:08:33.375 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:33.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install cephadm 2024-02-28T16:08:34.169 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T16:08:34.169 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-02-28T16:08:34.170 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-02-28T16:08:34.170 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-02-28T16:08:34.170 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-02-28T16:08:34.170 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-02-28T16:08:34.170 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-28T16:08:34.171 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-28T16:08:34.172 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-28T16:08:34.173 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-28T16:08:34.173 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-02-28T16:08:34.173 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-28T16:08:34.173 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-02-28T16:08:34.306 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:59 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:34.613 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:34.613 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:34.614 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:34.614 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.614 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:34.614 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.614 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:34.614 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.615 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:34.615 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.615 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:34.615 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.615 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:34.615 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.616 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:34.616 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.616 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:34.616 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.616 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:34.616 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.616 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:34.617 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.618 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:34.618 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.619 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:34.619 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.619 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:34.619 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.619 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:34.619 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.619 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:34.620 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.621 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:34.622 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:34.623 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.624 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.625 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.626 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.627 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.628 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.629 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.629 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:34.683 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:34.683 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:34.684 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:08:34.684 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:34.684 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:08:34.684 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 209 k 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 200 k 2024-02-28T16:08:34.685 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:08:34.774 INFO:teuthology.orchestra.run.smithi153.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.3 MB/s | 209 kB 00:00 2024-02-28T16:08:34.775 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:34.775 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.2 MB/s | 209 kB 00:00 2024-02-28T16:08:34.775 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:08:34.781 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:08:34.781 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:08:34.785 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:08:34.785 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:08:34.877 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout:Upgraded: 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.220 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T16:08:35.221 INFO:teuthology.orchestra.run.smithi023.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: re2-1:20211101-3.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:35.222 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:08:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:08:35.608 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-test 2024-02-28T16:08:35.670 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:08:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:08:36.532 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:08:36.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:36.532 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:08:36.532 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-02-28T16:08:36.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:36.532 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:36.548 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:00:33 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:08:36.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T16:08:36.875 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.876 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.877 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:08:36.878 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:08:36.879 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.880 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:08:36.880 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.880 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:08:36.880 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.880 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:08:36.880 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.881 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:08:36.881 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.881 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:08:36.882 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.882 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:08:36.882 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.882 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:08:36.882 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.882 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:08:36.882 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.883 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.884 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.885 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.886 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:36.886 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.886 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.886 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.886 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.886 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:36.886 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.887 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:36.955 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:08:36.956 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:36.956 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:08:36.956 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:36.956 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:08:36.956 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-02-28T16:08:36.956 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:08:36.956 INFO:teuthology.orchestra.run.smithi023.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:36.957 INFO:teuthology.orchestra.run.smithi023.stdout:Install 6 Packages 2024-02-28T16:08:36.958 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:36.959 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 40 M 2024-02-28T16:08:36.959 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 167 M 2024-02-28T16:08:36.959 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:08:37.280 INFO:teuthology.orchestra.run.smithi023.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 161 kB 00:00 2024-02-28T16:08:37.348 INFO:teuthology.orchestra.run.smithi023.stdout:(2/6): jq-1.6-16.el9.x86_64.rpm 973 kB/s | 187 kB 00:00 2024-02-28T16:08:37.448 INFO:teuthology.orchestra.run.smithi023.stdout:(3/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 218 kB 00:00 2024-02-28T16:08:37.606 INFO:teuthology.orchestra.run.smithi023.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 404 kB/s | 64 kB 00:00 2024-02-28T16:08:37.639 INFO:teuthology.orchestra.run.smithi023.stdout:(5/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-02-28T16:08:37.700 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:02 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:38.010 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.011 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.012 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.013 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:38.014 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.015 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:38.016 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.017 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.018 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.019 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:38.019 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.019 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.019 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.019 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:38.032 INFO:teuthology.orchestra.run.smithi023.stdout:(6/6): ceph-test-18.2.0-0.el9.x86_64.rpm 45 MB/s | 40 MB 00:00 2024-02-28T16:08:38.035 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:38.036 INFO:teuthology.orchestra.run.smithi023.stdout:Total 38 MB/s | 40 MB 00:01 2024-02-28T16:08:38.079 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-02-28T16:08:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:38.081 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 142 k 2024-02-28T16:08:38.081 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 399 k 2024-02-28T16:08:38.081 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:08:38.147 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.1 MB/s | 142 kB 00:00 2024-02-28T16:08:38.153 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:38.153 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.1 MB/s | 142 kB 00:00 2024-02-28T16:08:38.153 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:08:38.157 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:08:38.157 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:08:38.178 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:08:38.216 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:08:38.217 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:08:38.235 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:08:38.236 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:08:38.379 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:08:38.456 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:08:38.528 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:08:38.528 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:38.529 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T16:08:38.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:38.669 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:08:38.669 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:08:39.447 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:08:39.516 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T16:08:39.571 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T16:08:39.619 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T16:08:39.716 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T16:08:39.745 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-28T16:08:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:08:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:39.803 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:08:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-02-28T16:08:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:39.803 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:40.132 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr 2024-02-28T16:08:40.996 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:06 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:41.303 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:41.303 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:41.303 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:41.303 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.303 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.304 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:41.305 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.306 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:41.307 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.308 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.309 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.310 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.311 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:41.312 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:08:41.373 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:41.374 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:08:41.374 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:41.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T16:08:42.273 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:07 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:42.593 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.594 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.595 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:42.596 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.597 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.598 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.599 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.600 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.601 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.602 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:42.602 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.602 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.602 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.602 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.665 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-02-28T16:08:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout:Install 7 Packages 2024-02-28T16:08:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:42.668 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.0 M 2024-02-28T16:08:42.668 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 8.1 M 2024-02-28T16:08:42.668 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:08:43.242 INFO:teuthology.orchestra.run.smithi153.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 114 kB/s | 23 kB 00:00 2024-02-28T16:08:43.267 INFO:teuthology.orchestra.run.smithi153.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 64 kB/s | 15 kB 00:00 2024-02-28T16:08:43.326 INFO:teuthology.orchestra.run.smithi153.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 5.9 MB/s | 1.7 MB 00:00 2024-02-28T16:08:43.418 INFO:teuthology.orchestra.run.smithi153.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 52 kB/s | 9.0 kB 00:00 2024-02-28T16:08:43.510 INFO:teuthology.orchestra.run.smithi153.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 168 kB/s | 31 kB 00:00 2024-02-28T16:08:43.535 INFO:teuthology.orchestra.run.smithi153.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 153 kB/s | 41 kB 00:00 2024-02-28T16:08:43.685 INFO:teuthology.orchestra.run.smithi153.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 708 kB/s | 188 kB 00:00 2024-02-28T16:08:43.689 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:43.690 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-02-28T16:08:43.691 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:08:43.718 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:08:43.718 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:08:43.865 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:08:43.866 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:08:44.186 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-28T16:08:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:08:44.289 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-28T16:08:44.337 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T16:08:44.388 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T16:08:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T16:08:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T16:08:44.600 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-02-28T16:08:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-02-28T16:08:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-28T16:08:45.570 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-28T16:08:45.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-02-28T16:08:45.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-02-28T16:08:45.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-02-28T16:08:45.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T16:08:45.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T16:08:45.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T16:08:45.973 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T16:08:45.973 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:45.973 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:08:45.973 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:45.974 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:08:46.257 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T16:08:46.460 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-28T16:08:46.460 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-02-28T16:08:46.460 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-02-28T16:08:46.461 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T16:08:46.461 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T16:08:46.461 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T16:08:46.863 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T16:08:46.864 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:46.864 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:08:46.864 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-28T16:08:46.864 INFO:teuthology.orchestra.run.smithi023.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T16:08:46.864 INFO:teuthology.orchestra.run.smithi023.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T16:08:46.864 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:46.864 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:08:47.137 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:12 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:08:47.241 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:08:47.449 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.450 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:08:47.451 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.452 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:08:47.452 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.452 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:08:47.452 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.452 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:08:47.452 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.452 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.453 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:08:47.454 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.455 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.456 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.457 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:47.524 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:08:47.525 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:47.525 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-02-28T16:08:47.525 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:47.525 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:08:47.525 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-02-28T16:08:47.525 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:08:47.525 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout:Install 12 Packages 2024-02-28T16:08:47.526 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:08:47.527 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 38 M 2024-02-28T16:08:47.527 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 209 M 2024-02-28T16:08:47.527 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:08:48.142 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:00:45 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:08:48.250 INFO:teuthology.orchestra.run.smithi153.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 23 MB/s | 7.4 MB 00:00 2024-02-28T16:08:48.334 INFO:teuthology.orchestra.run.smithi153.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 489 kB/s | 195 kB 00:00 2024-02-28T16:08:48.359 INFO:teuthology.orchestra.run.smithi153.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-02-28T16:08:48.409 INFO:teuthology.orchestra.run.smithi153.stdout:(4/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-02-28T16:08:48.434 INFO:teuthology.orchestra.run.smithi153.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 244 kB/s | 18 kB 00:00 2024-02-28T16:08:48.469 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:08:48.469 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:08:48.469 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:08:48.469 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:08:48.470 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:48.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:48.518 INFO:teuthology.orchestra.run.smithi153.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 327 kB/s | 35 kB 00:00 2024-02-28T16:08:48.547 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:08:48.550 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:48.550 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-02-28T16:08:48.550 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:48.550 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:08:48.550 INFO:teuthology.orchestra.run.smithi023.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-02-28T16:08:48.550 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T16:08:48.551 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T16:08:48.552 INFO:teuthology.orchestra.run.smithi023.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T16:08:48.553 INFO:teuthology.orchestra.run.smithi023.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T16:08:48.553 INFO:teuthology.orchestra.run.smithi023.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T16:08:48.553 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:48.553 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:08:48.553 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:08:48.553 INFO:teuthology.orchestra.run.smithi023.stdout:Install 33 Packages 2024-02-28T16:08:48.553 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:48.554 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 30 M 2024-02-28T16:08:48.554 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 109 M 2024-02-28T16:08:48.554 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:08:48.643 INFO:teuthology.orchestra.run.smithi153.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-02-28T16:08:48.952 INFO:teuthology.orchestra.run.smithi153.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.8 MB/s | 3.0 MB 00:00 2024-02-28T16:08:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.5 MB/s | 250 kB 00:00 2024-02-28T16:08:49.178 INFO:teuthology.orchestra.run.smithi023.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 32 kB/s | 6.4 kB 00:00 2024-02-28T16:08:49.253 INFO:teuthology.orchestra.run.smithi023.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 5.3 MB/s | 1.4 MB 00:00 2024-02-28T16:08:49.320 INFO:teuthology.orchestra.run.smithi023.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 2.1 MB 00:00 2024-02-28T16:08:49.354 INFO:teuthology.orchestra.run.smithi023.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.2 MB/s | 240 kB 00:00 2024-02-28T16:08:49.411 INFO:teuthology.orchestra.run.smithi153.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.9 MB/s | 4.7 MB 00:00 2024-02-28T16:08:49.479 INFO:teuthology.orchestra.run.smithi023.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-02-28T16:08:49.580 INFO:teuthology.orchestra.run.smithi023.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-02-28T16:08:49.630 INFO:teuthology.orchestra.run.smithi023.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-02-28T16:08:49.680 INFO:teuthology.orchestra.run.smithi023.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.7 MB/s | 135 kB 00:00 2024-02-28T16:08:49.730 INFO:teuthology.orchestra.run.smithi023.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 4.9 MB/s | 1.2 MB 00:00 2024-02-28T16:08:49.755 INFO:teuthology.orchestra.run.smithi023.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-02-28T16:08:49.789 INFO:teuthology.orchestra.run.smithi023.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-02-28T16:08:49.820 INFO:teuthology.orchestra.run.smithi153.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-02-28T16:08:49.881 INFO:teuthology.orchestra.run.smithi023.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 383 kB/s | 35 kB 00:00 2024-02-28T16:08:50.115 INFO:teuthology.orchestra.run.smithi023.stdout:(13/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 20 MB/s | 18 MB 00:00 2024-02-28T16:08:50.140 INFO:teuthology.orchestra.run.smithi023.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 449 kB/s | 172 kB 00:00 2024-02-28T16:08:50.165 INFO:teuthology.orchestra.run.smithi023.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 180 kB/s | 51 kB 00:00 2024-02-28T16:08:50.232 INFO:teuthology.orchestra.run.smithi023.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 359 kB/s | 42 kB 00:00 2024-02-28T16:08:50.474 INFO:teuthology.orchestra.run.smithi023.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 130 kB/s | 43 kB 00:00 2024-02-28T16:08:50.549 INFO:teuthology.orchestra.run.smithi023.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 448 kB/s | 172 kB 00:00 2024-02-28T16:08:50.575 INFO:teuthology.orchestra.run.smithi023.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2024-02-28T16:08:50.650 INFO:teuthology.orchestra.run.smithi023.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 178 kB/s | 18 kB 00:00 2024-02-28T16:08:50.709 INFO:teuthology.orchestra.run.smithi023.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 174 kB/s | 23 kB 00:00 2024-02-28T16:08:50.742 INFO:teuthology.orchestra.run.smithi023.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 704 kB/s | 358 kB 00:00 2024-02-28T16:08:50.768 INFO:teuthology.orchestra.run.smithi023.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 167 kB/s | 19 kB 00:00 2024-02-28T16:08:50.810 INFO:teuthology.orchestra.run.smithi023.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 197 kB/s | 20 kB 00:00 2024-02-28T16:08:50.835 INFO:teuthology.orchestra.run.smithi023.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 506 kB/s | 46 kB 00:00 2024-02-28T16:08:50.927 INFO:teuthology.orchestra.run.smithi023.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 180 kB/s | 16 kB 00:00 2024-02-28T16:08:50.952 INFO:teuthology.orchestra.run.smithi023.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 429 kB/s | 79 kB 00:00 2024-02-28T16:08:50.986 INFO:teuthology.orchestra.run.smithi023.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-02-28T16:08:51.019 INFO:teuthology.orchestra.run.smithi023.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 983 kB/s | 90 kB 00:00 2024-02-28T16:08:51.053 INFO:teuthology.orchestra.run.smithi023.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 358 kB/s | 36 kB 00:00 2024-02-28T16:08:51.086 INFO:teuthology.orchestra.run.smithi023.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-02-28T16:08:51.153 INFO:teuthology.orchestra.run.smithi023.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2024-02-28T16:08:51.186 INFO:teuthology.orchestra.run.smithi023.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.5 MB/s | 427 kB 00:00 2024-02-28T16:08:51.189 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:51.190 INFO:teuthology.orchestra.run.smithi023.stdout:Total 11 MB/s | 30 MB 00:02 2024-02-28T16:08:51.566 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:08:51.656 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:08:51.657 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:08:51.728 INFO:teuthology.orchestra.run.smithi153.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.1 MB/s | 16 MB 00:02 2024-02-28T16:08:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:Total 9.0 MB/s | 38 MB 00:04 2024-02-28T16:08:52.130 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:08:52.131 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:08:52.391 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:08:52.470 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:08:52.470 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:08:53.067 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:08:53.067 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:08:53.684 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:08:53.757 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T16:08:53.796 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T16:08:53.848 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T16:08:53.980 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:08:53.994 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T16:08:54.053 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T16:08:54.100 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T16:08:54.107 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:08:54.157 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T16:08:54.198 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T16:08:54.235 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T16:08:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:08:54.272 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T16:08:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T16:08:54.323 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T16:08:54.386 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T16:08:54.454 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T16:08:54.501 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T16:08:54.559 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T16:08:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T16:08:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T16:08:54.701 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T16:08:54.716 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T16:08:54.904 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T16:08:55.009 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T16:08:55.085 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T16:08:55.126 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T16:08:55.194 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T16:08:55.282 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T16:08:55.545 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T16:08:55.614 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T16:08:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T16:08:55.708 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T16:08:55.827 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T16:08:55.878 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T16:08:56.036 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T16:08:56.215 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-02-28T16:08:56.243 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-28T16:08:56.347 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-28T16:08:56.347 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:56.347 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T16:08:56.347 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:08:56.348 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:08:56.348 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:57.213 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:08:58.086 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-28T16:08:58.194 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-28T16:08:58.195 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:58.195 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T16:08:58.195 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:08:58.195 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:08:58.195 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T16:08:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-28T16:08:58.712 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-28T16:08:58.791 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-28T16:08:58.791 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:58.791 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T16:08:58.792 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:08:58.792 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:08:58.792 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:59.029 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-28T16:08:59.107 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-28T16:08:59.107 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:59.107 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T16:08:59.107 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:08:59.108 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:08:59.108 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:08:59.200 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-28T16:08:59.327 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-28T16:08:59.327 INFO:teuthology.orchestra.run.smithi023.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T16:08:59.327 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T16:09:01.177 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T16:09:01.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T16:09:01.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T16:09:01.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T16:09:01.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T16:09:01.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T16:09:01.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T16:09:01.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T16:09:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T16:09:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T16:09:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:01.527 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:01.929 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-rook 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:02.194 INFO:teuthology.orchestra.run.smithi023.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T16:09:02.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T16:09:02.196 INFO:teuthology.orchestra.run.smithi023.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T16:09:02.197 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:02.197 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:02.596 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-base 2024-02-28T16:09:02.814 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:27 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:03.124 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:03.124 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:03.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:03.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.124 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:03.124 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:03.125 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:03.126 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.127 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:03.128 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:03.129 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.130 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.131 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.132 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.133 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.133 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.133 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:03.133 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.133 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.133 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.133 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.200 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:03.201 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:03.201 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-02-28T16:09:03.201 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:03.201 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:03.201 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-02-28T16:09:03.201 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:03.202 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:03.203 INFO:teuthology.orchestra.run.smithi153.stdout:Install 13 Packages 2024-02-28T16:09:03.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:03.203 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.2 M 2024-02-28T16:09:03.203 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 26 M 2024-02-28T16:09:03.203 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:03.493 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:00 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:03.777 INFO:teuthology.orchestra.run.smithi153.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 442 kB/s | 47 kB 00:00 2024-02-28T16:09:03.815 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:03.815 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:03.815 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:03.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:03.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:03.819 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:03.820 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.821 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.822 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.823 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.824 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.824 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:03.824 INFO:teuthology.orchestra.run.smithi023.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:03.889 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:03.890 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:09:03.890 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:03.975 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install cephadm 2024-02-28T16:09:04.010 INFO:teuthology.orchestra.run.smithi153.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 75 kB/s | 26 kB 00:00 2024-02-28T16:09:04.036 INFO:teuthology.orchestra.run.smithi153.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 52 kB/s | 19 kB 00:00 2024-02-28T16:09:04.144 INFO:teuthology.orchestra.run.smithi153.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 607 kB/s | 222 kB 00:00 2024-02-28T16:09:04.206 INFO:teuthology.orchestra.run.smithi153.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 815 kB/s | 159 kB 00:00 2024-02-28T16:09:04.278 INFO:teuthology.orchestra.run.smithi153.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-02-28T16:09:04.370 INFO:teuthology.orchestra.run.smithi153.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 238 kB/s | 54 kB 00:00 2024-02-28T16:09:04.570 INFO:teuthology.orchestra.run.smithi153.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 68 kB/s | 15 kB 00:00 2024-02-28T16:09:04.612 INFO:teuthology.orchestra.run.smithi153.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 79 kB/s | 32 kB 00:00 2024-02-28T16:09:04.713 INFO:teuthology.orchestra.run.smithi153.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 595 kB/s | 59 kB 00:00 2024-02-28T16:09:04.767 INFO:teuthology.orchestra.run.smithi153.stdout:(11/13): python3-google-auth-2.28.0-1.el9.noarc 511 kB/s | 203 kB 00:00 2024-02-28T16:09:04.813 INFO:teuthology.orchestra.run.smithi153.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 903 kB/s | 90 kB 00:00 2024-02-28T16:09:04.874 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:01 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:04.888 INFO:teuthology.orchestra.run.smithi153.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.2 MB/s | 1.0 MB 00:00 2024-02-28T16:09:04.900 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:04.901 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-02-28T16:09:05.123 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:05.170 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:05.171 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:05.196 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.197 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.198 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.199 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:05.200 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.201 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:05.202 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:05.203 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.204 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:05.270 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:05.271 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:05.271 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:05.271 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:05.271 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:05.271 INFO:teuthology.orchestra.run.smithi023.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-02-28T16:09:05.271 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:05.271 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:05.272 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:05.272 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-02-28T16:09:05.272 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:05.272 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 209 k 2024-02-28T16:09:05.272 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 200 k 2024-02-28T16:09:05.272 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:05.330 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:05.330 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:05.352 INFO:teuthology.orchestra.run.smithi023.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.6 MB/s | 209 kB 00:00 2024-02-28T16:09:05.353 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:05.353 INFO:teuthology.orchestra.run.smithi023.stdout:Total 2.5 MB/s | 209 kB 00:00 2024-02-28T16:09:05.353 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:05.359 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:05.360 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:05.363 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:05.363 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:05.460 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:05.978 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:09:06.112 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:09:06.158 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T16:09:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T16:09:06.298 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T16:09:06.343 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T16:09:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T16:09:06.531 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T16:09:06.668 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T16:09:06.735 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T16:09:06.757 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:09:07.083 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-28T16:09:07.084 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:07.084 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:07.084 INFO:teuthology.orchestra.run.smithi023.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-02-28T16:09:07.084 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:07.084 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:07.395 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T16:09:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T16:09:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T16:09:07.759 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T16:09:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T16:09:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-28T16:09:08.308 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:05 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:08.634 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:08.634 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:08.634 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:08.634 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:08.635 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:08.636 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.637 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.638 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.639 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:08.640 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.641 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.642 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:08.707 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:08.708 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:08.708 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repo Size 2024-02-28T16:09:08.708 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:08.708 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 142 k 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 399 k 2024-02-28T16:09:08.709 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T16:09:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T16:09:08.783 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 1.9 MB/s | 142 kB 00:00 2024-02-28T16:09:08.784 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:08.785 INFO:teuthology.orchestra.run.smithi023.stdout:Total 1.8 MB/s | 142 kB 00:00 2024-02-28T16:09:08.785 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:08.794 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:08.794 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:08.855 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:08.856 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:09.024 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:09.101 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:09.190 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:09.236 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:09.236 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T16:09:09.236 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:09.269 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T16:09:09.270 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T16:09:09.271 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T16:09:09.271 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T16:09:09.271 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:09.271 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:09.603 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T16:09:10.485 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:35 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:10.519 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:10.519 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:10.519 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:10.519 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:10.519 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:10.519 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:10.795 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:10.795 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:10.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:10.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.799 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.800 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:10.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.802 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:10.803 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.803 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:10.804 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.805 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.806 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:10.807 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.808 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:10.854 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr 2024-02-28T16:09:10.868 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2024-02-28T16:09:10.870 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:10.870 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 7.0 M 2024-02-28T16:09:10.870 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 33 M 2024-02-28T16:09:10.870 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:11.492 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.1 MB/s | 127 kB 00:00 2024-02-28T16:09:11.634 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 958 kB/s | 248 kB 00:00 2024-02-28T16:09:11.758 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:08 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:11.835 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-02-28T16:09:11.859 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 259 kB/s | 58 kB 00:00 2024-02-28T16:09:12.043 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 997 kB/s | 548 kB 00:00 2024-02-28T16:09:12.068 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 219 kB/s | 51 kB 00:00 2024-02-28T16:09:12.074 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:12.075 INFO:teuthology.orchestra.run.smithi153.stdout:Total 5.8 MB/s | 7.0 MB 00:01 2024-02-28T16:09:12.085 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:12.085 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:12.085 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:12.085 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.085 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:12.086 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.086 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:12.086 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.086 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:12.086 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.086 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:12.087 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.087 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:12.088 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.088 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:12.088 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.088 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:12.089 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.089 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:12.089 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.089 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:12.089 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.090 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:12.090 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.090 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:12.090 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.090 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:12.090 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.091 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:12.091 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.091 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:12.091 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.091 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:12.091 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.092 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:12.092 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.095 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:12.096 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.096 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:12.096 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.096 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:12.096 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.097 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:12.097 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.097 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:12.097 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.097 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:12.097 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.097 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:12.098 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.098 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:12.098 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.098 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:12.098 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.098 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:12.099 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.099 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:12.099 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.099 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:12.099 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.099 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:12.100 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.100 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:12.100 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.100 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:12.100 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.100 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:12.101 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.101 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:12.101 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.101 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:12.101 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.101 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:12.102 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.102 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.102 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.102 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:12.102 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.102 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.102 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.103 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.103 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:12.103 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.103 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.103 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.103 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.104 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.104 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.104 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:12.104 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.104 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.104 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.105 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.105 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:12.105 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.105 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.105 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.105 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.106 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:12.106 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.106 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.106 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.106 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:12.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:12.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.108 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:12.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:12.109 INFO:teuthology.orchestra.run.smithi023.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:12.159 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:12.160 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:09:12.160 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:12.206 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:12.239 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T16:09:12.244 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:12.245 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:12.402 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:12.402 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:13.076 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T16:09:13.109 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:10 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:13.134 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T16:09:13.434 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:13.434 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:13.434 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:13.434 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.435 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:13.435 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.435 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:13.435 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.435 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:13.435 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.435 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.436 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.437 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.438 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.439 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.440 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.441 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:13.442 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.443 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.444 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.444 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.444 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:13.444 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.444 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.444 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.444 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.445 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:13.445 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.445 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.445 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.445 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:13.512 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:13.513 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:13.513 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout:Installing weak dependencies: 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:13.514 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:13.515 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:13.515 INFO:teuthology.orchestra.run.smithi023.stdout:Install 7 Packages 2024-02-28T16:09:13.515 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:13.515 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 2.0 M 2024-02-28T16:09:13.516 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 8.1 M 2024-02-28T16:09:13.516 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:13.828 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T16:09:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T16:09:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T16:09:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-28T16:09:14.097 INFO:teuthology.orchestra.run.smithi023.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 112 kB/s | 23 kB 00:00 2024-02-28T16:09:14.122 INFO:teuthology.orchestra.run.smithi023.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 63 kB/s | 15 kB 00:00 2024-02-28T16:09:14.189 INFO:teuthology.orchestra.run.smithi023.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 5.7 MB/s | 1.7 MB 00:00 2024-02-28T16:09:14.639 INFO:teuthology.orchestra.run.smithi023.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 17 kB/s | 9.0 kB 00:00 2024-02-28T16:09:14.673 INFO:teuthology.orchestra.run.smithi023.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 64 kB/s | 31 kB 00:00 2024-02-28T16:09:14.723 INFO:teuthology.orchestra.run.smithi023.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 68 kB/s | 41 kB 00:00 2024-02-28T16:09:14.941 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-28T16:09:14.942 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-02-28T16:09:14.942 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T16:09:14.942 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T16:09:14.942 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T16:09:14.942 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T16:09:15.139 INFO:teuthology.orchestra.run.smithi023.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 377 kB/s | 188 kB 00:00 2024-02-28T16:09:15.150 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:15.150 INFO:teuthology.orchestra.run.smithi023.stdout:Total 1.2 MB/s | 2.0 MB 00:01 2024-02-28T16:09:15.151 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:15.179 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:15.180 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:15.320 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:15.320 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T16:09:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:15.325 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-02-28T16:09:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T16:09:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T16:09:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T16:09:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T16:09:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T16:09:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:15.326 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:15.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-fuse 2024-02-28T16:09:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:15.791 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T16:09:15.846 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T16:09:15.940 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T16:09:15.974 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T16:09:16.021 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-02-28T16:09:16.342 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-02-28T16:09:16.377 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-28T16:09:16.527 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:41 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.836 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:16.837 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:16.838 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.839 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.840 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.841 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.842 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.843 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.844 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.844 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:16.906 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:16.907 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:16.908 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:16.908 INFO:teuthology.orchestra.run.smithi153.stdout:Install 2 Packages 2024-02-28T16:09:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:16.908 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 915 k 2024-02-28T16:09:16.908 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.7 M 2024-02-28T16:09:16.909 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:17.123 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-28T16:09:17.123 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-02-28T16:09:17.123 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-02-28T16:09:17.123 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-02-28T16:09:17.123 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T16:09:17.123 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T16:09:17.124 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T16:09:17.337 INFO:teuthology.orchestra.run.smithi153.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 835 kB 00:00 2024-02-28T16:09:17.545 INFO:teuthology.orchestra.run.smithi153.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 230 kB/s | 80 kB 00:00 2024-02-28T16:09:17.547 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:17.548 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.4 MB/s | 915 kB 00:00 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T16:09:17.577 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:17.578 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:17.587 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:17.659 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:17.659 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:17.770 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:17.770 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:17.870 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T16:09:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T16:09:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-28T16:09:18.778 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:15 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:19.106 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.107 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:19.108 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.109 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:19.110 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.111 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.112 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:19.113 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:19.114 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.115 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.115 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.115 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:19.186 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T16:09:19.188 INFO:teuthology.orchestra.run.smithi023.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout:Install 12 Packages 2024-02-28T16:09:19.189 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:19.190 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 38 M 2024-02-28T16:09:19.190 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 209 M 2024-02-28T16:09:19.190 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:19.212 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-28T16:09:19.212 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-02-28T16:09:19.547 INFO:teuthology.orchestra.run.smithi023.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 31 MB/s | 7.4 MB 00:00 2024-02-28T16:09:19.607 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T16:09:19.607 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:19.607 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:19.607 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T16:09:19.607 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:19.607 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:19.722 INFO:teuthology.orchestra.run.smithi023.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 188 kB/s | 33 kB 00:00 2024-02-28T16:09:19.944 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados-devel 2024-02-28T16:09:20.305 INFO:teuthology.orchestra.run.smithi023.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 196 kB/s | 195 kB 00:00 2024-02-28T16:09:20.414 INFO:teuthology.orchestra.run.smithi023.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.7 MB/s | 3.0 MB 00:00 2024-02-28T16:09:20.439 INFO:teuthology.orchestra.run.smithi023.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 138 kB/s | 18 kB 00:00 2024-02-28T16:09:20.473 INFO:teuthology.orchestra.run.smithi023.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 607 kB/s | 35 kB 00:00 2024-02-28T16:09:20.565 INFO:teuthology.orchestra.run.smithi023.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-02-28T16:09:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:45 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:21.137 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:21.137 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:21.137 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.138 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:21.139 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:21.140 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.141 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.142 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.143 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.144 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.145 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:21.156 INFO:teuthology.orchestra.run.smithi023.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 435 kB/s | 803 kB 00:01 2024-02-28T16:09:21.211 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:21.212 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:21.212 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:21.212 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 126 k 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 456 k 2024-02-28T16:09:21.213 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:21.308 INFO:teuthology.orchestra.run.smithi153.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 126 kB 00:00 2024-02-28T16:09:21.308 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:21.308 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.3 MB/s | 126 kB 00:00 2024-02-28T16:09:21.309 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:21.315 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:21.316 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:21.383 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:21.383 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:21.390 INFO:teuthology.orchestra.run.smithi023.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 5.0 MB/s | 4.7 MB 00:00 2024-02-28T16:09:21.424 INFO:teuthology.orchestra.run.smithi023.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 945 kB/s | 250 kB 00:00 2024-02-28T16:09:21.544 INFO:teuthology.orchestra.run.smithi023.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.2 MB/s | 5.1 MB 00:00 2024-02-28T16:09:21.581 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:22.658 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:22.658 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:22.658 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:22.658 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:22.658 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:22.658 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:22.997 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs2 2024-02-28T16:09:23.574 INFO:teuthology.orchestra.run.smithi023.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-02-28T16:09:23.576 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:23.577 INFO:teuthology.orchestra.run.smithi023.stdout:Total 8.7 MB/s | 38 MB 00:04 2024-02-28T16:09:23.895 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:48 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:24.203 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:24.204 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:24.205 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:24.206 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.207 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:24.208 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.209 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.210 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.211 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.212 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.213 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:24.214 INFO:teuthology.orchestra.run.smithi153.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:24.234 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:24.276 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:24.277 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:09:24.277 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:24.317 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:24.317 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:24.367 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs-devel 2024-02-28T16:09:24.906 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:24.906 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:25.243 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:50 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:25.552 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:25.552 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:25.552 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:25.552 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:25.553 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.554 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.555 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.556 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.557 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.558 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.559 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.626 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:25.627 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:25.627 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:25.627 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:25.627 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 30 k 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 137 k 2024-02-28T16:09:25.628 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:25.704 INFO:teuthology.orchestra.run.smithi153.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 411 kB/s | 30 kB 00:00 2024-02-28T16:09:25.704 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:25.704 INFO:teuthology.orchestra.run.smithi153.stdout:Total 402 kB/s | 30 kB 00:00 2024-02-28T16:09:25.704 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:25.708 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:25.708 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:25.751 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:25.751 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:25.818 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:25.915 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T16:09:25.974 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:09:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:26.129 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:09:26.175 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T16:09:26.432 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T16:09:26.457 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:26.465 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T16:09:26.572 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T16:09:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:26.777 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:26.777 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:27.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados2 2024-02-28T16:09:27.465 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T16:09:27.604 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T16:09:27.881 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:52 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:28.188 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:28.191 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.192 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.193 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:28.194 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.194 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:28.194 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.194 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:28.194 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.194 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:28.195 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.196 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:28.260 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:28.261 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:09:28.261 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:28.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librbd1 2024-02-28T16:09:29.197 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:54 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:29.222 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:09:29.504 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:29.504 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:29.504 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:29.505 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:29.506 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.507 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.508 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.509 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.510 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.511 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.512 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.513 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:29.575 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:29.576 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:09:29.576 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:29.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rados 2024-02-28T16:09:30.440 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T16:09:30.472 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-28T16:09:30.530 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:55 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:30.853 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:30.854 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:30.854 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.854 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:30.854 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.854 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:30.854 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.854 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:30.855 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:30.856 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.857 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:30.858 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:30.859 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.860 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.861 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.862 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:30.863 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:30.929 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:30.930 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:09:30.930 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:31.005 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rgw 2024-02-28T16:09:31.840 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:56 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:32.148 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.149 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:32.150 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.151 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.152 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:32.153 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.154 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.155 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.156 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.157 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:32.222 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:32.223 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:09:32.223 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:32.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-cephfs 2024-02-28T16:09:33.043 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-28T16:09:33.043 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-02-28T16:09:33.043 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:09:33.043 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:09:33.043 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T16:09:33.043 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T16:09:33.044 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T16:09:33.044 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T16:09:33.044 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T16:09:33.044 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T16:09:33.044 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:09:33.044 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T16:09:33.156 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:58 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:33.469 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:33.470 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.471 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:33.472 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:33.473 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:33.474 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:33.475 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.476 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.477 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.478 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:33.478 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.478 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.478 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.478 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:33.478 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:33.489 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T16:09:33.489 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:33.489 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:33.489 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-02-28T16:09:33.489 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T16:09:33.489 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T16:09:33.489 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:33.490 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:33.543 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:33.544 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:09:33.544 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:33.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rbd 2024-02-28T16:09:33.911 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-rook 2024-02-28T16:09:34.484 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:59 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:34.793 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:34.793 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:34.793 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:34.793 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.794 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.795 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:34.796 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:34.797 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:34.798 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:34.799 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:34.800 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.801 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:34.802 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:34.823 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:31 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:34.867 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:34.868 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-02-28T16:09:34.869 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:34.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-fuse 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.152 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.153 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:35.154 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:35.155 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:35.156 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.157 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.158 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.159 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:35.160 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.160 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.160 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.160 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:35.231 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T16:09:35.233 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout:Install 13 Packages 2024-02-28T16:09:35.234 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:35.235 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 2.2 M 2024-02-28T16:09:35.235 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 26 M 2024-02-28T16:09:35.235 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:35.495 INFO:teuthology.orchestra.run.smithi023.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 555 kB/s | 47 kB 00:00 2024-02-28T16:09:35.554 INFO:teuthology.orchestra.run.smithi023.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 133 kB/s | 19 kB 00:00 2024-02-28T16:09:35.579 INFO:teuthology.orchestra.run.smithi023.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 151 kB/s | 26 kB 00:00 2024-02-28T16:09:35.704 INFO:teuthology.orchestra.run.smithi023.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-02-28T16:09:35.788 INFO:teuthology.orchestra.run.smithi023.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 649 kB/s | 54 kB 00:00 2024-02-28T16:09:35.789 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:00 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:35.813 INFO:teuthology.orchestra.run.smithi023.stdout:(6/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 701 kB/s | 222 kB 00:00 2024-02-28T16:09:35.880 INFO:teuthology.orchestra.run.smithi023.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 928 kB/s | 279 kB 00:00 2024-02-28T16:09:36.056 INFO:teuthology.orchestra.run.smithi023.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 121 kB/s | 32 kB 00:00 2024-02-28T16:09:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:36.097 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:36.097 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.098 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:36.099 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:36.100 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:36.101 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.102 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.103 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.104 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.105 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:36.106 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.106 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.106 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.106 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.106 INFO:teuthology.orchestra.run.smithi023.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 51 kB/s | 15 kB 00:00 2024-02-28T16:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 86 k 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 230 k 2024-02-28T16:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:36.281 INFO:teuthology.orchestra.run.smithi023.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 339 kB/s | 59 kB 00:00 2024-02-28T16:09:36.290 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 724 kB/s | 86 kB 00:00 2024-02-28T16:09:36.290 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:36.291 INFO:teuthology.orchestra.run.smithi153.stdout:Total 714 kB/s | 86 kB 00:00 2024-02-28T16:09:36.291 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:36.299 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:36.299 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:36.324 INFO:teuthology.orchestra.run.smithi023.stdout:(11/13): python3-google-auth-2.28.0-1.el9.noarc 459 kB/s | 203 kB 00:00 2024-02-28T16:09:36.365 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:36.365 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:36.473 INFO:teuthology.orchestra.run.smithi023.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 2.4 MB/s | 1.0 MB 00:00 2024-02-28T16:09:36.499 INFO:teuthology.orchestra.run.smithi023.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 414 kB/s | 90 kB 00:00 2024-02-28T16:09:36.500 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:36.500 INFO:teuthology.orchestra.run.smithi023.stdout:Total 1.7 MB/s | 2.2 MB 00:01 2024-02-28T16:09:36.540 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:36.725 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:36.774 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:36.774 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:36.940 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:36.940 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:37.550 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:37.550 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:37.550 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:37.551 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:37.551 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:37.551 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:37.746 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:37.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-mirror 2024-02-28T16:09:37.945 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T16:09:38.009 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T16:09:38.075 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T16:09:38.142 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T16:09:38.202 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T16:09:38.338 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T16:09:38.551 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T16:09:38.619 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T16:09:38.771 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:03 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.085 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.086 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:39.087 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:39.088 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.089 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.090 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.091 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:39.092 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.093 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:39.158 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:39.159 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:39.159 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:39.159 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:39.159 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 3.0 M 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 12 M 2024-02-28T16:09:39.160 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:39.284 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2024-02-28T16:09:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:Total 24 MB/s | 3.0 MB 00:00 2024-02-28T16:09:39.285 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:39.384 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:39.384 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:39.593 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T16:09:39.643 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T16:09:39.676 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T16:09:39.729 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T16:09:39.752 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-28T16:09:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:39.962 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:39.962 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T16:09:39.962 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:09:39.962 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:09:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:40.721 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-28T16:09:40.721 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-02-28T16:09:40.721 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T16:09:40.721 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T16:09:40.721 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T16:09:40.721 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T16:09:40.722 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T16:09:40.722 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T16:09:40.722 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T16:09:40.722 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T16:09:40.722 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T16:09:40.722 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T16:09:40.722 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T16:09:41.228 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T16:09:41.228 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:41.228 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:41.229 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:41.397 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:41.397 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:41.610 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T16:09:41.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-nbd 2024-02-28T16:09:42.483 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:39 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:42.617 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:07 ago on Wed 28 Feb 2024 04:07:35 PM UTC. 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:42.810 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.811 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.812 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:42.813 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.814 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:42.815 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.816 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.817 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.818 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.887 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:42.887 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:42.887 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:42.888 INFO:teuthology.orchestra.run.smithi023.stdout:Install 6 Packages 2024-02-28T16:09:42.889 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:42.889 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 7.0 M 2024-02-28T16:09:42.889 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 33 M 2024-02-28T16:09:42.889 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:Modular dependency problems: 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 1: conflicting requests 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 2: conflicting requests 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 3: conflicting requests 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.927 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 4: conflicting requests 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 5: conflicting requests 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 6: conflicting requests 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 7: conflicting requests 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 8: conflicting requests 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 9: conflicting requests 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 10: conflicting requests 2024-02-28T16:09:42.928 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 11: conflicting requests 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 12: conflicting requests 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 13: conflicting requests 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 14: conflicting requests 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 15: conflicting requests 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 16: conflicting requests 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 17: conflicting requests 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 18: conflicting requests 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 19: conflicting requests 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 20: conflicting requests 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 21: conflicting requests 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 22: conflicting requests 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 23: conflicting requests 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 24: conflicting requests 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.930 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 25: conflicting requests 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 26: conflicting requests 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 27: conflicting requests 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 28: conflicting requests 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 29: conflicting requests 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 30: conflicting requests 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 31: conflicting requests 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 32: conflicting requests 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 33: conflicting requests 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 34: conflicting requests 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 35: conflicting requests 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 36: conflicting requests 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.932 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 38: conflicting requests 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.934 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:42.999 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-02-28T16:09:42.999 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:42.999 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:42.999 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:42.999 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-02-28T16:09:43.000 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-02-28T16:09:43.000 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:43.000 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-02-28T16:09:43.000 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-02-28T16:09:43.000 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-02-28T16:09:43.000 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:43.000 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 169 k 2024-02-28T16:09:43.001 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 490 k 2024-02-28T16:09:43.001 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-02-28T16:09:43.076 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.4 MB/s | 169 kB 00:00 2024-02-28T16:09:43.077 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:43.077 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.3 MB/s | 169 kB 00:00 2024-02-28T16:09:43.077 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-02-28T16:09:43.081 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-02-28T16:09:43.081 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-02-28T16:09:43.148 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-02-28T16:09:43.148 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-02-28T16:09:43.354 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-02-28T16:09:43.468 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:43.542 INFO:teuthology.orchestra.run.smithi023.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.1 MB/s | 127 kB 00:00 2024-02-28T16:09:43.651 INFO:teuthology.orchestra.run.smithi023.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-02-28T16:09:43.726 INFO:teuthology.orchestra.run.smithi023.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 779 kB/s | 58 kB 00:00 2024-02-28T16:09:43.760 INFO:teuthology.orchestra.run.smithi023.stdout:(4/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 2.5 MB/s | 548 kB 00:00 2024-02-28T16:09:43.777 INFO:teuthology.orchestra.run.smithi023.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 1.0 MB/s | 51 kB 00:00 2024-02-28T16:09:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:44.341 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:44.342 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:44.342 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-02-28T16:09:44.342 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:44.342 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:09:44.342 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-02-28T16:09:44.653 DEBUG:teuthology.parallel:result is None 2024-02-28T16:09:45.168 INFO:teuthology.orchestra.run.smithi023.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-02-28T16:09:45.169 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:45.170 INFO:teuthology.orchestra.run.smithi023.stdout:Total 3.1 MB/s | 7.0 MB 00:02 2024-02-28T16:09:45.298 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:45.338 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:45.338 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:45.501 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:45.501 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:45.924 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:46.132 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T16:09:46.194 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T16:09:46.913 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T16:09:47.023 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T16:09:47.099 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T16:09:47.132 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-28T16:09:48.034 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-28T16:09:48.034 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-02-28T16:09:48.034 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T16:09:48.034 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T16:09:48.034 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T16:09:48.034 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T16:09:48.411 INFO:teuthology.orchestra.run.smithi023.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T16:09:48.412 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:48.412 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:48.735 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-fuse 2024-02-28T16:09:49.632 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:46 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:49.954 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:49.954 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.955 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:49.956 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:49.957 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:49.958 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.959 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.960 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.961 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.962 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:49.963 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:50.031 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:50.031 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:50.031 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:50.031 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:50.031 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout:Install 2 Packages 2024-02-28T16:09:50.032 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:50.033 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 915 k 2024-02-28T16:09:50.033 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 2.7 M 2024-02-28T16:09:50.033 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:50.170 INFO:teuthology.orchestra.run.smithi023.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 9.6 MB/s | 835 kB 00:00 2024-02-28T16:09:50.228 INFO:teuthology.orchestra.run.smithi023.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 559 kB/s | 80 kB 00:00 2024-02-28T16:09:50.230 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:50.230 INFO:teuthology.orchestra.run.smithi023.stdout:Total 4.5 MB/s | 915 kB 00:00 2024-02-28T16:09:50.266 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:50.336 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:50.336 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:50.447 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:50.448 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:50.731 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:50.910 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T16:09:51.000 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-28T16:09:51.956 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-28T16:09:51.957 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-02-28T16:09:52.329 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T16:09:52.329 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:52.329 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:52.329 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T16:09:52.329 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:52.329 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:52.661 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install librados-devel 2024-02-28T16:09:53.596 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:50 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.926 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.927 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:53.928 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:54.000 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:54.001 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:54.001 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:54.001 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:54.002 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:54.002 INFO:teuthology.orchestra.run.smithi023.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-02-28T16:09:54.002 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:54.003 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:54.003 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:54.003 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-02-28T16:09:54.003 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:54.003 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 126 k 2024-02-28T16:09:54.003 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 456 k 2024-02-28T16:09:54.003 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:54.066 INFO:teuthology.orchestra.run.smithi023.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2024-02-28T16:09:54.067 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:54.067 INFO:teuthology.orchestra.run.smithi023.stdout:Total 1.9 MB/s | 126 kB 00:00 2024-02-28T16:09:54.067 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:54.074 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:54.074 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:54.144 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:54.144 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:54.321 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:54.432 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:55.015 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:55.331 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:55.331 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:55.331 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:55.331 INFO:teuthology.orchestra.run.smithi023.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:55.331 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:55.331 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:55.679 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install libcephfs2 2024-02-28T16:09:56.592 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:53 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:56.917 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:56.918 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:56.919 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:56.920 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:56.921 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.922 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.923 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.924 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.925 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:56.926 INFO:teuthology.orchestra.run.smithi023.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:09:56.995 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:56.996 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:09:56.996 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:57.067 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install libcephfs-devel 2024-02-28T16:09:57.968 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:54 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:09:58.291 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:09:58.291 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:09:58.291 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:09:58.291 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.291 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:09:58.291 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.291 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.292 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.293 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:09:58.294 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:09:58.295 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:09:58.296 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:58.297 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.298 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.299 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.300 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:58.369 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-02-28T16:09:58.370 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:58.371 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 30 k 2024-02-28T16:09:58.371 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 137 k 2024-02-28T16:09:58.371 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:09:58.447 INFO:teuthology.orchestra.run.smithi023.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 405 kB/s | 30 kB 00:00 2024-02-28T16:09:58.447 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:58.447 INFO:teuthology.orchestra.run.smithi023.stdout:Total 395 kB/s | 30 kB 00:00 2024-02-28T16:09:58.448 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:09:58.452 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:09:58.452 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:09:58.484 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:09:58.485 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:09:58.606 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:09:58.747 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:59.184 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:59.509 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:09:59.509 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:59.509 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:09:59.509 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-02-28T16:09:59.509 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:09:59.509 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:09:59.781 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install librados2 2024-02-28T16:10:00.678 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:57 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:01.002 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:01.003 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.004 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.005 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.006 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:01.007 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.008 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.009 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:01.011 INFO:teuthology.orchestra.run.smithi023.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:10:01.078 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:01.079 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:10:01.079 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:01.158 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install librbd1 2024-02-28T16:10:02.041 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:59 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:02.369 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:02.369 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.370 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:02.371 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.372 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.373 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:02.374 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.375 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:02.376 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:02.377 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.378 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:02.379 INFO:teuthology.orchestra.run.smithi023.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:10:02.445 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:02.447 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:10:02.447 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:02.524 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-rados 2024-02-28T16:10:03.425 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:02:00 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:03.751 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:03.751 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:03.751 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:03.752 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.753 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:03.754 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.757 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.758 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.759 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:03.760 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.761 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.761 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.761 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:03.761 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:10:03.829 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:03.830 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:10:03.830 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:03.908 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-rgw 2024-02-28T16:10:04.795 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:02:01 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:05.120 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:05.120 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:05.120 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:05.120 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.120 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:05.120 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.121 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:05.122 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.123 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.124 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:05.125 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.126 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:05.126 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.126 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:05.126 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.126 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:05.127 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.128 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.129 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.130 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:10:05.197 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:05.199 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:10:05.199 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:05.274 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-cephfs 2024-02-28T16:10:06.136 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:02:03 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:06.471 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:06.471 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:06.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:06.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.471 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:06.471 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:06.472 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.473 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.474 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:06.475 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.476 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.477 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.478 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.479 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.480 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:06.481 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:10:06.549 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:06.551 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:10:06.551 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:06.628 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-rbd 2024-02-28T16:10:07.501 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:02:04 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:07.824 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:07.824 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:07.824 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:07.824 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.824 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:07.824 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.825 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:07.826 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:07.827 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:07.828 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.829 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.830 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:07.831 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.832 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:07.833 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-28T16:10:07.903 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:07.904 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-02-28T16:10:07.904 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:07.984 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install rbd-fuse 2024-02-28T16:10:08.844 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:02:05 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:09.172 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:09.172 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:09.173 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.174 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:09.175 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.176 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:09.177 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.178 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.179 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.180 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:09.248 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 86 k 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 230 k 2024-02-28T16:10:09.249 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:10:09.325 INFO:teuthology.orchestra.run.smithi023.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-02-28T16:10:09.326 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:09.326 INFO:teuthology.orchestra.run.smithi023.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-02-28T16:10:09.326 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:10:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:10:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:10:09.405 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:10:09.405 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:10:09.567 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:10:09.673 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:10.159 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:10.507 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:10.507 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:10.507 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:10:10.507 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-02-28T16:10:10.507 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:10.508 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:10.816 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install rbd-mirror 2024-02-28T16:10:11.745 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:02:08 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:12.071 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:12.072 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.073 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:12.074 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:12.075 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:12.076 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.077 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:12.078 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:12.079 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.080 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.080 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.080 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:12.150 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:12.150 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:12.150 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:10:12.150 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:12.151 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 3.0 M 2024-02-28T16:10:12.152 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 12 M 2024-02-28T16:10:12.152 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:10:12.263 INFO:teuthology.orchestra.run.smithi023.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 27 MB/s | 3.0 MB 00:00 2024-02-28T16:10:12.263 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:12.264 INFO:teuthology.orchestra.run.smithi023.stdout:Total 27 MB/s | 3.0 MB 00:00 2024-02-28T16:10:12.264 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:10:12.275 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:10:12.275 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:10:12.362 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:10:12.362 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:10:12.839 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:10:12.939 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:13.016 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:13.016 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:10:13.016 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T16:10:13.016 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:10:13.016 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:10:13.017 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:14.639 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:14.640 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:14.640 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:10:14.640 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-02-28T16:10:14.640 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:14.640 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:14.957 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install rbd-nbd 2024-02-28T16:10:15.853 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:02:12 ago on Wed 28 Feb 2024 04:08:03 PM UTC. 2024-02-28T16:10:16.181 INFO:teuthology.orchestra.run.smithi023.stderr:Modular dependency problems: 2024-02-28T16:10:16.181 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:10:16.181 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 1: conflicting requests 2024-02-28T16:10:16.181 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 2: conflicting requests 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 3: conflicting requests 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 4: conflicting requests 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 5: conflicting requests 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 6: conflicting requests 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 7: conflicting requests 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 8: conflicting requests 2024-02-28T16:10:16.182 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 9: conflicting requests 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 10: conflicting requests 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 11: conflicting requests 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 12: conflicting requests 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 13: conflicting requests 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 14: conflicting requests 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 15: conflicting requests 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.183 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 16: conflicting requests 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 17: conflicting requests 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 18: conflicting requests 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 19: conflicting requests 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 20: conflicting requests 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 21: conflicting requests 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 22: conflicting requests 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.184 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 23: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 24: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 25: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 26: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 27: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 28: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 29: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 30: conflicting requests 2024-02-28T16:10:16.185 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 31: conflicting requests 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 32: conflicting requests 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 33: conflicting requests 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 34: conflicting requests 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 35: conflicting requests 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 36: conflicting requests 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.186 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 38: conflicting requests 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.187 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.188 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.189 INFO:teuthology.orchestra.run.smithi023.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:16.257 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 169 k 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 490 k 2024-02-28T16:10:16.258 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-02-28T16:10:16.359 INFO:teuthology.orchestra.run.smithi023.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 1.7 MB/s | 169 kB 00:00 2024-02-28T16:10:16.359 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:16.359 INFO:teuthology.orchestra.run.smithi023.stdout:Total 1.6 MB/s | 169 kB 00:00 2024-02-28T16:10:16.360 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-02-28T16:10:16.370 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-02-28T16:10:16.370 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-02-28T16:10:16.442 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-02-28T16:10:16.442 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-02-28T16:10:16.642 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-02-28T16:10:16.753 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:17.292 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:17.591 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-28T16:10:17.591 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:17.591 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-02-28T16:10:17.591 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-02-28T16:10:17.591 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:10:17.591 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-02-28T16:10:17.911 DEBUG:teuthology.parallel:result is None 2024-02-28T16:10:17.912 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T16:10:17.912 INFO:teuthology.packaging:ref: None 2024-02-28T16:10:17.912 INFO:teuthology.packaging:tag: v18.2.0 2024-02-28T16:10:17.912 INFO:teuthology.packaging:branch: None 2024-02-28T16:10:17.912 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:10:17.913 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T16:10:17.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-28T16:10:18.135 DEBUG:teuthology.orchestra.run.smithi023:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi023.stdout:18.2.0-0.el9 2024-02-28T16:10:18.206 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-02-28T16:10:18.206 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-02-28T16:10:18.208 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T16:10:18.208 INFO:teuthology.packaging:ref: None 2024-02-28T16:10:18.208 INFO:teuthology.packaging:tag: v18.2.0 2024-02-28T16:10:18.208 INFO:teuthology.packaging:branch: None 2024-02-28T16:10:18.208 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:10:18.208 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T16:10:18.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-28T16:10:18.346 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T16:10:18.412 INFO:teuthology.orchestra.run.smithi153.stdout:18.2.0-0.el9 2024-02-28T16:10:18.413 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-02-28T16:10:18.413 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-02-28T16:10:18.415 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-28T16:10:18.415 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:10:18.415 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T16:10:18.521 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:10:18.522 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T16:10:18.614 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-28T16:10:18.615 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:10:18.615 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T16:10:18.762 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T16:10:18.851 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:10:18.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T16:10:18.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T16:10:19.093 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-28T16:10:19.093 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:10:19.093 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T16:10:19.190 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T16:10:19.334 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:10:19.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T16:10:19.432 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T16:10:19.575 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-28T16:10:19.575 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:10:19.575 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T16:10:19.677 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T16:10:19.775 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:10:19.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T16:10:19.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T16:10:19.960 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:10:19.970 INFO:teuthology.task.print:**** done install task... 2024-02-28T16:10:19.970 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-28T16:10:20.073 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T16:10:20.073 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-02-28T16:10:20.074 INFO:tasks.cephadm:Cluster fsid is dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:10:20.074 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-28T16:10:20.074 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-28T16:10:20.075 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi023': '172.21.15.23', 'mon.smithi153': '172.21.15.153'} 2024-02-28T16:10:20.075 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-28T16:10:20.075 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname $(hostname -s) 2024-02-28T16:10:20.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname $(hostname -s) 2024-02-28T16:10:20.276 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-02-28T16:10:20.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:10:20.496 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77042/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1670-g1fb5d106', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1670.g1fb5d106'}, 'url': 'https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-23 17:21:14.966217', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'main', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-02-28T16:10:20.834 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 1d3308060ccdfb6de4fe7eae2050b723500ec20d from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-02-28T16:10:20.835 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/1d3308060ccdfb6de4fe7eae2050b723500ec20d/centos/9/x86_64/flavors/default/cephadm 2024-02-28T16:10:20.835 DEBUG:teuthology.orchestra.run.smithi023:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/1d3308060ccdfb6de4fe7eae2050b723500ec20d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T16:10:21.925 INFO:teuthology.orchestra.run.smithi023.stdout:-rw-r--r--. 1 ubuntu ubuntu 214737 Feb 28 16:10 /home/ubuntu/cephtest/cephadm 2024-02-28T16:10:21.925 DEBUG:teuthology.orchestra.run.smithi153:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/1d3308060ccdfb6de4fe7eae2050b723500ec20d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T16:10:23.053 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r--. 1 ubuntu ubuntu 214737 Feb 28 16:10 /home/ubuntu/cephtest/cephadm 2024-02-28T16:10:23.054 DEBUG:teuthology.orchestra.run.smithi023:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T16:10:23.116 DEBUG:teuthology.orchestra.run.smithi153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T16:10:23.187 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-02-28T16:10:23.187 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-02-28T16:10:23.194 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-02-28T16:10:24.271 INFO:teuthology.orchestra.run.smithi153.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-28T16:10:24.293 INFO:teuthology.orchestra.run.smithi023.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-28T16:10:50.915 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:10:50.916 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-28T16:10:50.916 INFO:teuthology.orchestra.run.smithi023.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-02-28T16:10:50.916 INFO:teuthology.orchestra.run.smithi023.stdout: "repo_digests": [ 2024-02-28T16:10:50.916 INFO:teuthology.orchestra.run.smithi023.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-02-28T16:10:50.916 INFO:teuthology.orchestra.run.smithi023.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-02-28T16:10:50.916 INFO:teuthology.orchestra.run.smithi023.stdout: ] 2024-02-28T16:10:50.916 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:10:51.194 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-02-28T16:10:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-28T16:10:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-02-28T16:10:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "repo_digests": [ 2024-02-28T16:10:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-02-28T16:10:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-02-28T16:10:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-02-28T16:10:51.195 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-02-28T16:10:51.249 DEBUG:teuthology.orchestra.run.smithi023:> sudo mkdir -p /etc/ceph 2024-02-28T16:10:51.345 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph 2024-02-28T16:10:51.443 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 777 /etc/ceph 2024-02-28T16:10:51.546 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /etc/ceph 2024-02-28T16:10:51.644 INFO:tasks.cephadm:Writing seed config... 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-28T16:10:51.646 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-28T16:10:51.647 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-28T16:10:51.648 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-28T16:10:51.649 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:10:51.649 DEBUG:teuthology.orchestra.run.smithi023:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-28T16:10:51.708 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = dea052fa-d653-11ee-95c3-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-28T16:10:51.708 DEBUG:teuthology.orchestra.run.smithi023:mon.smithi023> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service 2024-02-28T16:10:51.754 INFO:tasks.cephadm:Bootstrapping... 2024-02-28T16:10:51.754 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid dea052fa-d653-11ee-95c3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.23 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:10:52.000 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:52.000 INFO:teuthology.orchestra.run.smithi023.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', 'dea052fa-d653-11ee-95c3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.23', '--skip-admin-label'] 2024-02-28T16:10:52.057 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T16:10:52.057 INFO:teuthology.orchestra.run.smithi023.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-28T16:10:52.057 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying podman|docker is present... 2024-02-28T16:10:52.103 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T16:10:52.103 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying lvm2 is present... 2024-02-28T16:10:52.103 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying time synchronization is in place... 2024-02-28T16:10:52.117 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T16:10:52.118 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T16:10:52.130 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T16:10:52.130 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout inactive 2024-02-28T16:10:52.144 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout enabled 2024-02-28T16:10:52.156 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout active 2024-02-28T16:10:52.156 INFO:teuthology.orchestra.run.smithi023.stdout:Unit chronyd.service is enabled and running 2024-02-28T16:10:52.156 INFO:teuthology.orchestra.run.smithi023.stdout:Repeating the final host check... 2024-02-28T16:10:52.202 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T16:10:52.202 INFO:teuthology.orchestra.run.smithi023.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-28T16:10:52.202 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl is present 2024-02-28T16:10:52.202 INFO:teuthology.orchestra.run.smithi023.stdout:lvcreate is present 2024-02-28T16:10:52.216 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T16:10:52.216 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T16:10:52.229 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T16:10:52.229 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout inactive 2024-02-28T16:10:52.249 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout enabled 2024-02-28T16:10:52.267 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout active 2024-02-28T16:10:52.267 INFO:teuthology.orchestra.run.smithi023.stdout:Unit chronyd.service is enabled and running 2024-02-28T16:10:52.268 INFO:teuthology.orchestra.run.smithi023.stdout:Host looks OK 2024-02-28T16:10:52.268 INFO:teuthology.orchestra.run.smithi023.stdout:Cluster fsid: dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:10:52.268 INFO:teuthology.orchestra.run.smithi023.stdout:Acquiring lock 140343608742672 on /run/cephadm/dea052fa-d653-11ee-95c3-87774f69a715.lock 2024-02-28T16:10:52.269 INFO:teuthology.orchestra.run.smithi023.stdout:Lock 140343608742672 acquired on /run/cephadm/dea052fa-d653-11ee-95c3-87774f69a715.lock 2024-02-28T16:10:52.270 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying IP 172.21.15.23 port 3300 ... 2024-02-28T16:10:52.271 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying IP 172.21.15.23 port 6789 ... 2024-02-28T16:10:52.271 INFO:teuthology.orchestra.run.smithi023.stdout:Base mon IP(s) is [172.21.15.23:3300, 172.21.15.23:6789], mon addrv is [v2:172.21.15.23:3300,v1:172.21.15.23:6789] 2024-02-28T16:10:52.286 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.23 metric 100 2024-02-28T16:10:52.286 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.23 metric 100 2024-02-28T16:10:52.298 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-28T16:10:52.298 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-02-28T16:10:52.298 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-02-28T16:10:52.310 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-28T16:10:52.310 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-28T16:10:52.310 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T16:10:52.310 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-28T16:10:52.310 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:ce42/64 scope link noprefixroute 2024-02-28T16:10:52.310 INFO:teuthology.orchestra.run.smithi023.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T16:10:52.313 INFO:teuthology.orchestra.run.smithi023.stdout:Mon IP `172.21.15.23` is in CIDR network `172.21.0.0/20` 2024-02-28T16:10:52.313 INFO:teuthology.orchestra.run.smithi023.stdout:Mon IP `172.21.15.23` is in CIDR network `172.21.0.0/20` 2024-02-28T16:10:52.313 INFO:teuthology.orchestra.run.smithi023.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-28T16:10:52.315 INFO:teuthology.orchestra.run.smithi023.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-28T16:10:52.317 INFO:teuthology.orchestra.run.smithi023.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-28T16:10:53.506 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-02-28T16:10:53.506 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-02-28T16:10:53.506 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stderr Getting image source signatures 2024-02-28T16:10:53.507 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-02-28T16:10:53.507 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-02-28T16:10:53.507 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-02-28T16:10:53.507 INFO:teuthology.orchestra.run.smithi023.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-28T16:10:54.711 INFO:teuthology.orchestra.run.smithi023.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-02-28T16:10:54.711 INFO:teuthology.orchestra.run.smithi023.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-02-28T16:10:54.711 INFO:teuthology.orchestra.run.smithi023.stdout:Extracting ceph user uid/gid from container image... 2024-02-28T16:10:55.964 INFO:teuthology.orchestra.run.smithi023.stdout:stat: stdout 167 167 2024-02-28T16:10:55.965 INFO:teuthology.orchestra.run.smithi023.stdout:Creating initial keys... 2024-02-28T16:10:57.065 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph-authtool: stdout AQAQW99l41G3GBAA4CBBxr1S9cxKrmVSZGVTnA== 2024-02-28T16:10:58.341 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph-authtool: stdout AQARW99lQb8XIRAA2bZM8eulbXjpS66g+gqy0w== 2024-02-28T16:10:59.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph-authtool: stdout AQASW99lYaA2MRAANUgFxh9nLuOqkvjMP9Jidg== 2024-02-28T16:10:59.381 INFO:teuthology.orchestra.run.smithi023.stdout:Creating initial monmap... 2024-02-28T16:11:00.425 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout:monmaptool for smithi023 [v2:172.21.15.23:3300,v1:172.21.15.23:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout:setting min_mon_release = pacific 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/monmaptool: set fsid to dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T16:11:00.426 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:11:00.427 INFO:teuthology.orchestra.run.smithi023.stdout:Creating mon... 2024-02-28T16:11:01.554 INFO:teuthology.orchestra.run.smithi023.stdout:create mon.smithi023 on 2024-02-28T16:11:01.950 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-28T16:11:02.190 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-28T16:11:02.491 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-dea052fa-d653-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-dea052fa-d653-11ee-95c3-87774f69a715.target. 2024-02-28T16:11:02.491 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-dea052fa-d653-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-dea052fa-d653-11ee-95c3-87774f69a715.target. 2024-02-28T16:11:02.876 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023 2024-02-28T16:11:02.876 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service: Unit ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service not loaded. 2024-02-28T16:11:03.207 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dea052fa-d653-11ee-95c3-87774f69a715.target.wants/ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service → /etc/systemd/system/ceph-dea052fa-d653-11ee-95c3-87774f69a715@.service. 2024-02-28T16:11:03.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:03 smithi023 podman[28752]: 2024-02-28 16:11:03.528635085 +0000 UTC m=+0.035566316 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-02-28T16:11:07.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:07 smithi023 podman[28752]: 2024-02-28 16:11:07.43127773 +0000 UTC m=+3.938209053 container create d4bf5c755e1830e0f4a98b33e614936e45541823148bcecfd38fb190363635aa (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1) 2024-02-28T16:11:12.000 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:11:12.001 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout disabled 2024-02-28T16:11:12.019 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:11:12.019 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout inactive 2024-02-28T16:11:12.019 INFO:teuthology.orchestra.run.smithi023.stdout:firewalld.service is not enabled 2024-02-28T16:11:12.019 INFO:teuthology.orchestra.run.smithi023.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T16:11:12.020 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for mon to start... 2024-02-28T16:11:12.020 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for mon... 2024-02-28T16:11:12.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:11 smithi023 podman[28752]: 2024-02-28 16:11:11.879993455 +0000 UTC m=+8.386924761 container init d4bf5c755e1830e0f4a98b33e614936e45541823148bcecfd38fb190363635aa (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1) 2024-02-28T16:11:12.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:11 smithi023 podman[28752]: 2024-02-28 16:11:11.890913093 +0000 UTC m=+8.397844359 container start d4bf5c755e1830e0f4a98b33e614936e45541823148bcecfd38fb190363635aa (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, org.label-schema.build-date=20231212, ceph=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-28T16:11:12.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:11 smithi023 ceph-mon[28771]: mkfs dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:12.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:11 smithi023 ceph-mon[28771]: mon.smithi023 is new leader, mons smithi023 in quorum (ranks 0) 2024-02-28T16:11:12.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:11 smithi023 bash[28752]: d4bf5c755e1830e0f4a98b33e614936e45541823148bcecfd38fb190363635aa 2024-02-28T16:11:12.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:11 smithi023 systemd[1]: Started Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:11:13.045 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:12 smithi023 ceph-mon[28771]: mon.smithi023 is new leader, mons smithi023 in quorum (ranks 0) 2024-02-28T16:11:13.046 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:12 smithi023 ceph-mon[28771]: monmap e1: 1 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0]} removed_ranks: {} 2024-02-28T16:11:13.046 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:12 smithi023 ceph-mon[28771]: fsmap 2024-02-28T16:11:13.046 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:12 smithi023 ceph-mon[28771]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T16:11:13.046 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:12 smithi023 ceph-mon[28771]: mgrmap e1: no daemons active 2024-02-28T16:11:13.046 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:12 smithi023 ceph-mon[28771]: from='client.? 172.21.15.23:0/2059689115' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-28T16:11:13.369 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout cluster: 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout id: dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout services: 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi023 (age 0.792237s) 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout data: 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout pgs: 2024-02-28T16:11:13.370 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.668+0000 7f1a36a00700 1 Processor -- start 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.668+0000 7f1a36a00700 1 -- start start 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.668+0000 7f1a36a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3010ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.668+0000 7f1a36a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3010f1f0 con 0x7f1a30080210 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.670+0000 7f1a2fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3010ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.670+0000 7f1a2fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3010ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33192/0 (socket says 172.21.15.23:33192) 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.670+0000 7f1a2fe00700 1 -- 172.21.15.23:0/3529581545 learned_addr learned my addr 172.21.15.23:0/3529581545 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.671+0000 7f1a2fe00700 1 -- 172.21.15.23:0/3529581545 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3010f330 con 0x7f1a30080210 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.671+0000 7f1a2fe00700 1 --2- 172.21.15.23:0/3529581545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3010ecb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009e80 tx=0x7f1a2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c14b15094b8c768 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.671+0000 7f1a2f400700 1 -- 172.21.15.23:0/3529581545 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a2000e070 con 0x7f1a30080210 2024-02-28T16:11:13.376 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.671+0000 7f1a2f400700 1 -- 172.21.15.23:0/3529581545 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a20003a20 con 0x7f1a30080210 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.671+0000 7f1a2f400700 1 -- 172.21.15.23:0/3529581545 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a20003bd0 con 0x7f1a30080210 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.672+0000 7f1a36a00700 1 -- 172.21.15.23:0/3529581545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 msgr2=0x7f1a3010ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.672+0000 7f1a36a00700 1 --2- 172.21.15.23:0/3529581545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3010ecb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009e80 tx=0x7f1a2000b330 comp rx=0 tx=0).stop 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.672+0000 7f1a36a00700 1 -- 172.21.15.23:0/3529581545 shutdown_connections 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.672+0000 7f1a36a00700 1 --2- 172.21.15.23:0/3529581545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3010ecb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.672+0000 7f1a36a00700 1 -- 172.21.15.23:0/3529581545 >> 172.21.15.23:0/3529581545 conn(0x7f1a3007b200 msgr2=0x7f1a3007d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.672+0000 7f1a36a00700 1 -- 172.21.15.23:0/3529581545 shutdown_connections 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.672+0000 7f1a36a00700 1 -- 172.21.15.23:0/3529581545 wait complete. 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.673+0000 7f1a36a00700 1 Processor -- start 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.673+0000 7f1a36a00700 1 -- start start 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.674+0000 7f1a36a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.674+0000 7f1a36a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3019fa30 con 0x7f1a30080210 2024-02-28T16:11:13.377 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.674+0000 7f1a2fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.674+0000 7f1a2fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3019f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33204/0 (socket says 172.21.15.23:33204) 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.674+0000 7f1a2fe00700 1 -- 172.21.15.23:0/2059689115 learned_addr learned my addr 172.21.15.23:0/2059689115 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.674+0000 7f1a2fe00700 1 -- 172.21.15.23:0/2059689115 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20009b30 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.675+0000 7f1a2fe00700 1 --2- 172.21.15.23:0/2059689115 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3019f4f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1a20004000 tx=0x7f1a20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.675+0000 7f1a2d600700 1 -- 172.21.15.23:0/2059689115 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a20004240 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.675+0000 7f1a2d600700 1 -- 172.21.15.23:0/2059689115 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a200043e0 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.675+0000 7f1a2d600700 1 -- 172.21.15.23:0/2059689115 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a200046e0 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.675+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3019fc30 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.675+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a301a00d0 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.675+0000 7f1a2d600700 1 -- 172.21.15.23:0/2059689115 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a20019050 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.676+0000 7f1a2d600700 1 -- 172.21.15.23:0/2059689115 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1a20025790 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.676+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a301992a0 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.679+0000 7f1a2d600700 1 -- 172.21.15.23:0/2059689115 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1a2002a060 con 0x7f1a30080210 2024-02-28T16:11:13.378 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.760+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f1a3002d0b0 con 0x7f1a30080210 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.761+0000 7f1a2d600700 1 -- 172.21.15.23:0/2059689115 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f1a3002d0b0 con 0x7f1a30080210 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.762+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 msgr2=0x7f1a3019f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.762+0000 7f1a36a00700 1 --2- 172.21.15.23:0/2059689115 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3019f4f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1a20004000 tx=0x7f1a20004ad0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.762+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 shutdown_connections 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.762+0000 7f1a36a00700 1 --2- 172.21.15.23:0/2059689115 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a30080210 0x7f1a3019f4f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.762+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 >> 172.21.15.23:0/2059689115 conn(0x7f1a3007b200 msgr2=0x7f1a3007dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.763+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 shutdown_connections 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:12.763+0000 7f1a36a00700 1 -- 172.21.15.23:0/2059689115 wait complete. 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:mon is available 2024-02-28T16:11:13.379 INFO:teuthology.orchestra.run.smithi023.stdout:Assimilating anything we can from ceph.conf... 2024-02-28T16:11:14.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:14 smithi023 ceph-mon[28771]: from='client.? 172.21.15.23:0/2629724400' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T16:11:14.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:14 smithi023 ceph-mon[28771]: from='client.? 172.21.15.23:0/2629724400' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-28T16:11:14.674 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:14.675 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T16:11:14.675 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout fsid = dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:14.675 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.23:3300,v1:172.21.15.23:6789] 2024-02-28T16:11:14.675 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:14.676 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T16:11:14.681 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.973+0000 7f3fa1200700 1 Processor -- start 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.973+0000 7f3fa1200700 1 -- start start 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.974+0000 7f3fa1200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.974+0000 7f3fa1200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c108510 con 0x7f3f9c107bc0 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.974+0000 7f3f99e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.974+0000 7f3f99e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c107fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33206/0 (socket says 172.21.15.23:33206) 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.974+0000 7f3f99e00700 1 -- 172.21.15.23:0/4050674301 learned_addr learned my addr 172.21.15.23:0/4050674301 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.975+0000 7f3f99e00700 1 -- 172.21.15.23:0/4050674301 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c108650 con 0x7f3f9c107bc0 2024-02-28T16:11:14.682 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.975+0000 7f3f99e00700 1 --2- 172.21.15.23:0/4050674301 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c107fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0098a0 tx=0x7f3f8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c99534d3a25a0b server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.975+0000 7f3f98a00700 1 -- 172.21.15.23:0/4050674301 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8c004180 con 0x7f3f9c107bc0 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.975+0000 7f3f98a00700 1 -- 172.21.15.23:0/4050674301 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c0042e0 con 0x7f3f9c107bc0 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.975+0000 7f3f98a00700 1 -- 172.21.15.23:0/4050674301 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8c0036a0 con 0x7f3f9c107bc0 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.976+0000 7f3fa1200700 1 -- 172.21.15.23:0/4050674301 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 msgr2=0x7f3f9c107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.976+0000 7f3fa1200700 1 --2- 172.21.15.23:0/4050674301 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c107fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0098a0 tx=0x7f3f8c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.976+0000 7f3fa1200700 1 -- 172.21.15.23:0/4050674301 shutdown_connections 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.976+0000 7f3fa1200700 1 --2- 172.21.15.23:0/4050674301 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c107fd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.976+0000 7f3fa1200700 1 -- 172.21.15.23:0/4050674301 >> 172.21.15.23:0/4050674301 conn(0x7f3f9c103550 msgr2=0x7f3f9c105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.977+0000 7f3fa1200700 1 -- 172.21.15.23:0/4050674301 shutdown_connections 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.977+0000 7f3fa1200700 1 -- 172.21.15.23:0/4050674301 wait complete. 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.978+0000 7f3fa1200700 1 Processor -- start 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.978+0000 7f3fa1200700 1 -- start start 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.979+0000 7f3fa1200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.683 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.979+0000 7f3fa1200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c19b590 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.979+0000 7f3f99e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.979+0000 7f3f99e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c19b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33216/0 (socket says 172.21.15.23:33216) 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.979+0000 7f3f99e00700 1 -- 172.21.15.23:0/2629724400 learned_addr learned my addr 172.21.15.23:0/2629724400 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.979+0000 7f3f99e00700 1 -- 172.21.15.23:0/2629724400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c009550 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.980+0000 7f3f99e00700 1 --2- 172.21.15.23:0/2629724400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c19b050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c1088f0 tx=0x7f3f8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.980+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8c003ce0 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.980+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c020070 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.980+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8c011630 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.980+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c19b790 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.980+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c19bc30 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.980+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3f8c022030 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.981+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3f8c025d40 con 0x7f3f9c107bc0 2024-02-28T16:11:14.684 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.982+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c194890 con 0x7f3f9c107bc0 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:13.984+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3f8c025480 con 0x7f3f9c107bc0 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.063+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3f9c02cee0 con 0x7f3f9c107bc0 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.074+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3f8c011bd0 con 0x7f3f9c107bc0 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.074+0000 7f3f92a00700 1 -- 172.21.15.23:0/2629724400 <== mon.0 v2:172.21.15.23:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f3f8c036020 con 0x7f3f9c107bc0 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.075+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 msgr2=0x7f3f9c19b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.075+0000 7f3fa1200700 1 --2- 172.21.15.23:0/2629724400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c19b050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c1088f0 tx=0x7f3f8c004750 comp rx=0 tx=0).stop 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.075+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 shutdown_connections 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.075+0000 7f3fa1200700 1 --2- 172.21.15.23:0/2629724400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f9c107bc0 0x7f3f9c19b050 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.075+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 >> 172.21.15.23:0/2629724400 conn(0x7f3f9c103550 msgr2=0x7f3f9c18f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.075+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 shutdown_connections 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:14.076+0000 7f3fa1200700 1 -- 172.21.15.23:0/2629724400 wait complete. 2024-02-28T16:11:14.685 INFO:teuthology.orchestra.run.smithi023.stdout:Generating new minimal ceph.conf... 2024-02-28T16:11:15.716 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:15 smithi023 ceph-mon[28771]: from='client.? 172.21.15.23:0/2062835704' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:16.698 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.347+0000 7fbd6a400700 1 Processor -- start 2024-02-28T16:11:16.698 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.347+0000 7fbd6a400700 1 -- start start 2024-02-28T16:11:16.698 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.347+0000 7fbd6a400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6410ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:16.698 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.347+0000 7fbd6a400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6410f1f0 con 0x7fbd64080210 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.348+0000 7fbd63400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6410ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.348+0000 7fbd63400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6410ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33230/0 (socket says 172.21.15.23:33230) 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.348+0000 7fbd63400700 1 -- 172.21.15.23:0/1266437061 learned_addr learned my addr 172.21.15.23:0/1266437061 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.348+0000 7fbd63400700 1 -- 172.21.15.23:0/1266437061 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6410f330 con 0x7fbd64080210 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.348+0000 7fbd63400700 1 --2- 172.21.15.23:0/1266437061 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6410ecb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbd540098a0 tx=0x7fbd54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1274bb23141e63 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.349+0000 7fbd62a00700 1 -- 172.21.15.23:0/1266437061 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd54004180 con 0x7fbd64080210 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.349+0000 7fbd62a00700 1 -- 172.21.15.23:0/1266437061 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbd540042e0 con 0x7fbd64080210 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.349+0000 7fbd62a00700 1 -- 172.21.15.23:0/1266437061 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd54011a50 con 0x7fbd64080210 2024-02-28T16:11:16.699 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.349+0000 7fbd6a400700 1 -- 172.21.15.23:0/1266437061 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 msgr2=0x7fbd6410ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.349+0000 7fbd6a400700 1 --2- 172.21.15.23:0/1266437061 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6410ecb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbd540098a0 tx=0x7fbd54009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.350+0000 7fbd6a400700 1 -- 172.21.15.23:0/1266437061 shutdown_connections 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.350+0000 7fbd6a400700 1 --2- 172.21.15.23:0/1266437061 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6410ecb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.350+0000 7fbd6a400700 1 -- 172.21.15.23:0/1266437061 >> 172.21.15.23:0/1266437061 conn(0x7fbd6407b200 msgr2=0x7fbd6407d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.350+0000 7fbd6a400700 1 -- 172.21.15.23:0/1266437061 shutdown_connections 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.350+0000 7fbd6a400700 1 -- 172.21.15.23:0/1266437061 wait complete. 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.351+0000 7fbd6a400700 1 Processor -- start 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.351+0000 7fbd6a400700 1 -- start start 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.351+0000 7fbd6a400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.351+0000 7fbd6a400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd641a02f0 con 0x7fbd64080210 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.352+0000 7fbd63400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.352+0000 7fbd63400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33236/0 (socket says 172.21.15.23:33236) 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.352+0000 7fbd63400700 1 -- 172.21.15.23:0/2062835704 learned_addr learned my addr 172.21.15.23:0/2062835704 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:16.700 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.352+0000 7fbd63400700 1 -- 172.21.15.23:0/2062835704 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009550 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.352+0000 7fbd63400700 1 --2- 172.21.15.23:0/2062835704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6419fdb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbd54003de0 tx=0x7fbd54011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.353+0000 7fbd60c00700 1 -- 172.21.15.23:0/2062835704 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd54003930 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.353+0000 7fbd60c00700 1 -- 172.21.15.23:0/2062835704 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbd54003a90 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.353+0000 7fbd60c00700 1 -- 172.21.15.23:0/2062835704 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd540196c0 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.353+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd641a04f0 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.353+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd641a0990 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.354+0000 7fbd60c00700 1 -- 172.21.15.23:0/2062835704 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbd540198f0 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.354+0000 7fbd60c00700 1 -- 172.21.15.23:0/2062835704 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbd54024b70 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.354+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd641100b0 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.357+0000 7fbd60c00700 1 -- 172.21.15.23:0/2062835704 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fbd54042b00 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.436+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fbd641102a0 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.437+0000 7fbd60c00700 1 -- 172.21.15.23:0/2062835704 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fbd54031030 con 0x7fbd64080210 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.438+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 msgr2=0x7fbd6419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:16.701 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.438+0000 7fbd6a400700 1 --2- 172.21.15.23:0/2062835704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6419fdb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbd54003de0 tx=0x7fbd54011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:16.702 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.438+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 shutdown_connections 2024-02-28T16:11:16.702 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.438+0000 7fbd6a400700 1 --2- 172.21.15.23:0/2062835704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbd64080210 0x7fbd6419fdb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:16.702 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.438+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 >> 172.21.15.23:0/2062835704 conn(0x7fbd6407b200 msgr2=0x7fbd6407d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:16.702 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.439+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 shutdown_connections 2024-02-28T16:11:16.702 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:15.439+0000 7fbd6a400700 1 -- 172.21.15.23:0/2062835704 wait complete. 2024-02-28T16:11:16.702 INFO:teuthology.orchestra.run.smithi023.stdout:Restarting the monitor... 2024-02-28T16:11:17.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:16 smithi023 systemd[1]: Stopping Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:11:17.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:17 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[28767]: 2024-02-28T16:11:17.186+0000 7f3e44600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi023 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:11:17.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:17 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[28767]: 2024-02-28T16:11:17.186+0000 7f3e44600700 -1 mon.smithi023@0(leader) e1 *** Got Signal Terminated *** 2024-02-28T16:11:17.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:17 smithi023 podman[29016]: 2024-02-28 16:11:17.444757368 +0000 UTC m=+0.393063207 container died d4bf5c755e1830e0f4a98b33e614936e45541823148bcecfd38fb190363635aa (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:11:17.987 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:17 smithi023 podman[29016]: 2024-02-28 16:11:17.795281504 +0000 UTC m=+0.743587345 container cleanup d4bf5c755e1830e0f4a98b33e614936e45541823148bcecfd38fb190363635aa (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2) 2024-02-28T16:11:17.987 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:17 smithi023 bash[29016]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023 2024-02-28T16:11:18.254 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:17 smithi023 podman[29030]: 2024-02-28 16:11:17.996121615 +0000 UTC m=+0.531668973 container remove d4bf5c755e1830e0f4a98b33e614936e45541823148bcecfd38fb190363635aa (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212) 2024-02-28T16:11:18.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:18 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service: Deactivated successfully. 2024-02-28T16:11:18.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:18 smithi023 systemd[1]: Stopped Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:11:18.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:18 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service: Consumed 1.976s CPU time. 2024-02-28T16:11:18.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:18 smithi023 systemd[1]: Starting Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:11:19.159 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:18 smithi023 podman[29119]: 2024-02-28 16:11:18.793753547 +0000 UTC m=+0.035513033 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-02-28T16:11:19.159 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:18 smithi023 podman[29119]: 2024-02-28 16:11:18.896762248 +0000 UTC m=+0.138521771 container create f10b6843c8c22a8f758fa799c3540326e21ed6691b2ad773d4b04dd66757e533 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, org.label-schema.build-date=20231212, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0) 2024-02-28T16:11:19.159 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 podman[29119]: 2024-02-28 16:11:19.108817721 +0000 UTC m=+0.350577294 container init f10b6843c8c22a8f758fa799c3540326e21ed6691b2ad773d4b04dd66757e533 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0) 2024-02-28T16:11:19.160 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 podman[29119]: 2024-02-28 16:11:19.119707093 +0000 UTC m=+0.361466603 container start f10b6843c8c22a8f758fa799c3540326e21ed6691b2ad773d4b04dd66757e533 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-28T16:11:19.218 INFO:teuthology.orchestra.run.smithi023.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-28T16:11:19.428 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:11:19.428 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-02-28T16:11:19.428 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: pidfile_write: ignore empty --pid-file 2024-02-28T16:11:19.428 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: load: jerasure load: lrc 2024-02-28T16:11:19.428 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Git sha 0 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Compile date 2023-08-03 19:21:13 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: DB SUMMARY 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: DB Session ID: 0KBOB35SLCSFAHVM3FNT 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi023/store.db dir, Total Num: 1, files: 000008.sst 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi023/store.db: 000009.log size: 97901 ; 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:11:19.429 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.env: 0x558105b97720 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.info_log: 0x55810784d2c0 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.statistics: (nil) 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.use_fsync: 0 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:11:19.430 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:11:19.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:11:19.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:11:19.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:11:19.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:11:19.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.db_log_dir: 2024-02-28T16:11:19.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.wal_dir: 2024-02-28T16:11:19.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:11:19.432 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:11:19.432 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:11:19.432 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:11:19.432 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:11:19.432 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:11:19.432 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:11:19.432 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.write_buffer_manager: 0x558106abe3c0 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.unordered_write: 0 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:11:19.433 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.row_cache: None 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.wal_filter: None 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.wal_compression: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:11:19.434 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:11:19.435 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:11:19.435 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:11:19.435 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:11:19.435 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:11:19.435 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:11:19.435 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:11:19.435 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:11:19.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_open_files: -1 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Compression algorithms supported: 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kZSTD supported: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:11:19.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi023/store.db/MANIFEST-000010 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.merge_operator: 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_filter: None 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:11:19.438 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55810784d3c0) 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: index_type: 0 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: data_block_index_type: 0 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: index_shortening: 1 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: checksum: 4 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: no_block_cache: 0 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache: 0x558106b5f350 2024-02-28T16:11:19.439 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache_options: 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: capacity : 536870912 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: num_shard_bits : 4 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: strict_capacity_limit : 0 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache_compressed: (nil) 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: persistent_cache: (nil) 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_size: 4096 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_size_deviation: 10 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_restart_interval: 16 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: index_block_restart_interval: 1 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: metadata_block_size: 4096 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: partition_filters: 0 2024-02-28T16:11:19.440 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: use_delta_encoding: 1 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: filter_policy: bloomfilter 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: whole_key_filtering: 1 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: verify_compression: 0 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: format_version: 5 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: enable_index_compression: 1 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_align: 0 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: max_auto_readahead_size: 262144 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: prepopulate_block_cache: 0 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:11:19.441 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression: NoCompression 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.num_levels: 7 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:11:19.442 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:11:19.443 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:11:19.443 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:11:19.444 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:11:19.445 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:11:19.446 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:11:19.447 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:11:19.447 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:11:19.447 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:11:19.447 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:11:19.447 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:11:19.448 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.ttl: 2592000 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:11:19.449 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi023/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3e23db10-4916-43d5-9148-5c0b796b1952 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136679179928, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-28T16:11:19.450 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136679182032, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93008, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 319, "table_properties": {"data_size": 91025, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13372, "raw_average_key_size": 49, "raw_value_size": 83726, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 270, "num_filter_entries": 270, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709136679, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3e23db10-4916-43d5-9148-5c0b796b1952", "db_session_id": "0KBOB35SLCSFAHVM3FNT", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136679182464, "job": 1, "event": "recovery_finished"} 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi023/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558106bfc000 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: DB pointer 0x558106be8000 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** DB Stats ** 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:11:19.451 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** Compaction Stats [default] ** 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: L0 2/0 92.70 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Sum 2/0 92.70 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** Compaction Stats [default] ** 2024-02-28T16:11:19.452 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 60.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative compaction: 0.00 GB write, 9.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:11:19.453 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval compaction: 0.00 GB write, 9.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Block cache BinnedLRUCache@0x558106b5f350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: starting mon.smithi023 rank 0 at public addrs [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] at bind addrs [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi023 fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???) e1 preinit fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???).mds e1 new map 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???).mds e1 print_map 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: e1 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: legacy client fscid: -1 2024-02-28T16:11:19.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: No filesystems configured 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 bash[29119]: f10b6843c8c22a8f758fa799c3540326e21ed6691b2ad773d4b04dd66757e533 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 systemd[1]: Started Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mon.smithi023 is new leader, mons smithi023 in quorum (ranks 0) 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: monmap e1: 1 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0]} removed_ranks: {} 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: fsmap 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T16:11:19.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:19 smithi023 ceph-mon[29137]: mgrmap e1: no daemons active 2024-02-28T16:11:20.691 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.942+0000 7fad72400700 1 Processor -- start 2024-02-28T16:11:20.691 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.942+0000 7fad72400700 1 -- start start 2024-02-28T16:11:20.691 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.943+0000 7fad72400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c079200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:20.691 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.943+0000 7fad72400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c079740 con 0x7fad6c07ad00 2024-02-28T16:11:20.691 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.944+0000 7fad6b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:20.691 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.944+0000 7fad6b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c079200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:38364/0 (socket says 172.21.15.23:38364) 2024-02-28T16:11:20.691 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.944+0000 7fad6b400700 1 -- 172.21.15.23:0/3631722927 learned_addr learned my addr 172.21.15.23:0/3631722927 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.944+0000 7fad6b400700 1 -- 172.21.15.23:0/3631722927 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c079880 con 0x7fad6c07ad00 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.944+0000 7fad6b400700 1 --2- 172.21.15.23:0/3631722927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c079200 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0098a0 tx=0x7fad5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f7572b3f888 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.945+0000 7fad6a000700 1 -- 172.21.15.23:0/3631722927 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad5c004180 con 0x7fad6c07ad00 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.945+0000 7fad6a000700 1 -- 172.21.15.23:0/3631722927 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fad5c0042e0 con 0x7fad6c07ad00 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.945+0000 7fad6a000700 1 -- 172.21.15.23:0/3631722927 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad5c011a50 con 0x7fad6c07ad00 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.946+0000 7fad72400700 1 -- 172.21.15.23:0/3631722927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 msgr2=0x7fad6c079200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.946+0000 7fad72400700 1 --2- 172.21.15.23:0/3631722927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c079200 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0098a0 tx=0x7fad5c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.946+0000 7fad72400700 1 -- 172.21.15.23:0/3631722927 shutdown_connections 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.946+0000 7fad72400700 1 --2- 172.21.15.23:0/3631722927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c079200 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.946+0000 7fad72400700 1 -- 172.21.15.23:0/3631722927 >> 172.21.15.23:0/3631722927 conn(0x7fad6c100fd0 msgr2=0x7fad6c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.946+0000 7fad72400700 1 -- 172.21.15.23:0/3631722927 shutdown_connections 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.946+0000 7fad72400700 1 -- 172.21.15.23:0/3631722927 wait complete. 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.947+0000 7fad72400700 1 Processor -- start 2024-02-28T16:11:20.692 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.947+0000 7fad72400700 1 -- start start 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.947+0000 7fad72400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.947+0000 7fad72400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1a0280 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.947+0000 7fad6b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.948+0000 7fad6b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:38370/0 (socket says 172.21.15.23:38370) 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.948+0000 7fad6b400700 1 -- 172.21.15.23:0/3924782028 learned_addr learned my addr 172.21.15.23:0/3924782028 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.948+0000 7fad6b400700 1 -- 172.21.15.23:0/3924782028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c009550 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.948+0000 7fad6b400700 1 --2- 172.21.15.23:0/3924782028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c19fd40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fad5c003de0 tx=0x7fad5c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.949+0000 7fad63e00700 1 -- 172.21.15.23:0/3924782028 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad5c003930 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.949+0000 7fad63e00700 1 -- 172.21.15.23:0/3924782028 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fad5c003a90 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.949+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c1a0480 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.949+0000 7fad63e00700 1 -- 172.21.15.23:0/3924782028 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad5c0196c0 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.949+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c1a0920 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.949+0000 7fad63e00700 1 -- 172.21.15.23:0/3924782028 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fad5c019ca0 con 0x7fad6c07ad00 2024-02-28T16:11:20.693 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.951+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c199500 con 0x7fad6c07ad00 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.951+0000 7fad63e00700 1 -- 172.21.15.23:0/3924782028 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fad5c01a430 con 0x7fad6c07ad00 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:19.956+0000 7fad63e00700 1 -- 172.21.15.23:0/3924782028 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fad5c042b00 con 0x7fad6c07ad00 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.033+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fad6c02cc80 con 0x7fad6c07ad00 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.037+0000 7fad63e00700 1 -- 172.21.15.23:0/3924782028 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fad5c031070 con 0x7fad6c07ad00 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.038+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 msgr2=0x7fad6c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.039+0000 7fad72400700 1 --2- 172.21.15.23:0/3924782028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c19fd40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fad5c003de0 tx=0x7fad5c011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.039+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 shutdown_connections 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.039+0000 7fad72400700 1 --2- 172.21.15.23:0/3924782028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fad6c07ad00 0x7fad6c19fd40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.039+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 >> 172.21.15.23:0/3924782028 conn(0x7fad6c100fd0 msgr2=0x7fad6c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.039+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 shutdown_connections 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:20.039+0000 7fad72400700 1 -- 172.21.15.23:0/3924782028 wait complete. 2024-02-28T16:11:20.694 INFO:teuthology.orchestra.run.smithi023.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-28T16:11:20.704 INFO:teuthology.orchestra.run.smithi023.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:11:20.704 INFO:teuthology.orchestra.run.smithi023.stdout:Creating mgr... 2024-02-28T16:11:20.704 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-28T16:11:20.705 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-28T16:11:20.705 INFO:teuthology.orchestra.run.smithi023.stdout:Verifying port 0.0.0.0:8443 ... 2024-02-28T16:11:21.071 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dea052fa-d653-11ee-95c3-87774f69a715@mgr.smithi023.bbebnt 2024-02-28T16:11:21.071 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dea052fa-d653-11ee-95c3-87774f69a715@mgr.smithi023.bbebnt.service: Unit ceph-dea052fa-d653-11ee-95c3-87774f69a715@mgr.smithi023.bbebnt.service not loaded. 2024-02-28T16:11:21.333 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dea052fa-d653-11ee-95c3-87774f69a715.target.wants/ceph-dea052fa-d653-11ee-95c3-87774f69a715@mgr.smithi023.bbebnt.service → /etc/systemd/system/ceph-dea052fa-d653-11ee-95c3-87774f69a715@.service. 2024-02-28T16:11:21.362 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:21 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3924782028' entity='client.admin' 2024-02-28T16:11:22.056 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:11:22.056 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout disabled 2024-02-28T16:11:22.072 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:11:22.072 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout inactive 2024-02-28T16:11:22.072 INFO:teuthology.orchestra.run.smithi023.stdout:firewalld.service is not enabled 2024-02-28T16:11:22.072 INFO:teuthology.orchestra.run.smithi023.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T16:11:22.091 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:11:22.091 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout disabled 2024-02-28T16:11:22.107 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:11:22.107 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout inactive 2024-02-28T16:11:22.107 INFO:teuthology.orchestra.run.smithi023.stdout:firewalld.service is not enabled 2024-02-28T16:11:22.107 INFO:teuthology.orchestra.run.smithi023.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-02-28T16:11:22.108 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for mgr to start... 2024-02-28T16:11:22.108 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for mgr... 2024-02-28T16:11:23.159 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:22 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1779152098' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:11:23.497 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:23.498 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:11:23.498 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsid": "dea052fa-d653-11ee-95c3-87774f69a715", 2024-02-28T16:11:23.498 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:11:23.499 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:11:23.499 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:11:23.500 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "smithi023" 2024-02-28T16:11:23.501 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:11:23.502 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:11:23.504 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:11:23.504 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:11:23.504 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:11:23.504 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:23.504 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:11:23.504 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:11:23.504 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:23.505 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:11:23.508 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:23.509 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:11:11.971768+0000", 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.726+0000 7f725c600700 1 Processor -- start 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.726+0000 7f725c600700 1 -- start start 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.726+0000 7f725c600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f7254105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.726+0000 7f725c600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254106310 con 0x7f72541059c0 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.727+0000 7f7259c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f7254105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.727+0000 7f7259c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f7254105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:38396/0 (socket says 172.21.15.23:38396) 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.727+0000 7f7259c00700 1 -- 172.21.15.23:0/1291261838 learned_addr learned my addr 172.21.15.23:0/1291261838 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.727+0000 7f7259c00700 1 -- 172.21.15.23:0/1291261838 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254106450 con 0x7f72541059c0 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.727+0000 7f7259c00700 1 --2- 172.21.15.23:0/1291261838 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f7254105dd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f72480098a0 tx=0x7f7248009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e894b787568f31 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:23.510 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f7253e00700 1 -- 172.21.15.23:0/1291261838 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7248004180 con 0x7f72541059c0 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f7253e00700 1 -- 172.21.15.23:0/1291261838 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f72480042e0 con 0x7f72541059c0 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f7253e00700 1 -- 172.21.15.23:0/1291261838 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7248011a50 con 0x7f72541059c0 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f725c600700 1 -- 172.21.15.23:0/1291261838 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 msgr2=0x7f7254105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f725c600700 1 --2- 172.21.15.23:0/1291261838 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f7254105dd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f72480098a0 tx=0x7f7248009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f725c600700 1 -- 172.21.15.23:0/1291261838 shutdown_connections 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f725c600700 1 --2- 172.21.15.23:0/1291261838 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f7254105dd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.728+0000 7f725c600700 1 -- 172.21.15.23:0/1291261838 >> 172.21.15.23:0/1291261838 conn(0x7f7254100fd0 msgr2=0x7f7254103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.729+0000 7f725c600700 1 -- 172.21.15.23:0/1291261838 shutdown_connections 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.729+0000 7f725c600700 1 -- 172.21.15.23:0/1291261838 wait complete. 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.730+0000 7f725c600700 1 Processor -- start 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.730+0000 7f725c600700 1 -- start start 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.730+0000 7f725c600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f725407ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:23.515 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.730+0000 7f725c600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725407b050 con 0x7f72541059c0 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.730+0000 7f7259c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f725407ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.731+0000 7f7259c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f725407ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:38412/0 (socket says 172.21.15.23:38412) 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.731+0000 7f7259c00700 1 -- 172.21.15.23:0/1779152098 learned_addr learned my addr 172.21.15.23:0/1779152098 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.731+0000 7f7259c00700 1 -- 172.21.15.23:0/1779152098 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248009550 con 0x7f72541059c0 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.731+0000 7f7259c00700 1 --2- 172.21.15.23:0/1779152098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f725407ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7248003de0 tx=0x7f7248011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.732+0000 7f7252000700 1 -- 172.21.15.23:0/1779152098 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7248003930 con 0x7f72541059c0 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.732+0000 7f7252000700 1 -- 172.21.15.23:0/1779152098 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7248003a90 con 0x7f72541059c0 2024-02-28T16:11:23.516 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.732+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7254079160 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.732+0000 7f7252000700 1 -- 172.21.15.23:0/1779152098 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7248019730 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.732+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7254079600 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.732+0000 7f7252000700 1 -- 172.21.15.23:0/1779152098 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7248019c80 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.732+0000 7f7252000700 1 -- 172.21.15.23:0/1779152098 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f724802c3a0 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.733+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7254062380 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.736+0000 7f7252000700 1 -- 172.21.15.23:0/1779152098 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f724801abc0 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.816+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7254079c60 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.817+0000 7f7252000700 1 -- 172.21.15.23:0/1779152098 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f724801a430 con 0x7f72541059c0 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.819+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 msgr2=0x7f725407ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.819+0000 7f725c600700 1 --2- 172.21.15.23:0/1779152098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f725407ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7248003de0 tx=0x7f7248011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.819+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 shutdown_connections 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.819+0000 7f725c600700 1 --2- 172.21.15.23:0/1779152098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f72541059c0 0x7f725407ab10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.819+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 >> 172.21.15.23:0/1779152098 conn(0x7f7254100fd0 msgr2=0x7f7254102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.819+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 shutdown_connections 2024-02-28T16:11:23.517 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:22.819+0000 7f725c600700 1 -- 172.21.15.23:0/1779152098 wait complete. 2024-02-28T16:11:23.518 INFO:teuthology.orchestra.run.smithi023.stdout:mgr not available, waiting (1/15)... 2024-02-28T16:11:26.531 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:26 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3646938587' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsid": "dea052fa-d653-11ee-95c3-87774f69a715", 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:26.838 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "smithi023" 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:26.839 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:11:26.840 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:11:26.842 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:11:26.842 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:11:26.842 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:11:26.842 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:11:26.842 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:26.843 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:11:26.844 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T16:11:26.844 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:11:26.844 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:11:26.844 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:11:11.971768+0000", 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:26.850 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.094+0000 7f8ba0800700 1 Processor -- start 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.094+0000 7f8ba0800700 1 -- start start 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.095+0000 7f8ba0800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b980791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.095+0000 7f8ba0800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980796e0 con 0x7f8b9807aca0 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.095+0000 7f8b9de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b980791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.095+0000 7f8b9de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b980791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:38416/0 (socket says 172.21.15.23:38416) 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.095+0000 7f8b9de00700 1 -- 172.21.15.23:0/4107012048 learned_addr learned my addr 172.21.15.23:0/4107012048 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.096+0000 7f8b9de00700 1 -- 172.21.15.23:0/4107012048 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98079820 con 0x7f8b9807aca0 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.096+0000 7f8b9de00700 1 --2- 172.21.15.23:0/4107012048 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b980791a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098a0 tx=0x7f8b8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e2dfba4e12d980 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.096+0000 7f8b9ca00700 1 -- 172.21.15.23:0/4107012048 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8c004180 con 0x7f8b9807aca0 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.096+0000 7f8b9ca00700 1 -- 172.21.15.23:0/4107012048 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8b8c0042e0 con 0x7f8b9807aca0 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.096+0000 7f8b9ca00700 1 -- 172.21.15.23:0/4107012048 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8c011a50 con 0x7f8b9807aca0 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.097+0000 7f8ba0800700 1 -- 172.21.15.23:0/4107012048 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 msgr2=0x7f8b980791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.097+0000 7f8ba0800700 1 --2- 172.21.15.23:0/4107012048 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b980791a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098a0 tx=0x7f8b8c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.097+0000 7f8ba0800700 1 -- 172.21.15.23:0/4107012048 shutdown_connections 2024-02-28T16:11:26.851 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.097+0000 7f8ba0800700 1 --2- 172.21.15.23:0/4107012048 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b980791a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.097+0000 7f8ba0800700 1 -- 172.21.15.23:0/4107012048 >> 172.21.15.23:0/4107012048 conn(0x7f8b98100fd0 msgr2=0x7f8b98103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.098+0000 7f8ba0800700 1 -- 172.21.15.23:0/4107012048 shutdown_connections 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.098+0000 7f8ba0800700 1 -- 172.21.15.23:0/4107012048 wait complete. 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.099+0000 7f8ba0800700 1 Processor -- start 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.099+0000 7f8ba0800700 1 -- start start 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.100+0000 7f8ba0800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b9819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.100+0000 7f8ba0800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9819bec0 con 0x7f8b9807aca0 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.100+0000 7f8b9de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b9819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.100+0000 7f8b9de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b9819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:38424/0 (socket says 172.21.15.23:38424) 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.100+0000 7f8b9de00700 1 -- 172.21.15.23:0/3646938587 learned_addr learned my addr 172.21.15.23:0/3646938587 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.100+0000 7f8b9de00700 1 -- 172.21.15.23:0/3646938587 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c009550 con 0x7f8b9807aca0 2024-02-28T16:11:26.852 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8b9de00700 1 --2- 172.21.15.23:0/3646938587 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b9819b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c003de0 tx=0x7f8b8c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8b92a00700 1 -- 172.21.15.23:0/3646938587 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8c0038b0 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8b92a00700 1 -- 172.21.15.23:0/3646938587 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8b8c003a10 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8b92a00700 1 -- 172.21.15.23:0/3646938587 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8c019600 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9819c0c0 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9819c560 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8b92a00700 1 -- 172.21.15.23:0/3646938587 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8b8c019a80 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.101+0000 7f8b92a00700 1 -- 172.21.15.23:0/3646938587 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8b8c024da0 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.102+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98062380 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.105+0000 7f8b92a00700 1 -- 172.21.15.23:0/3646938587 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f8b8c042b00 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.184+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8b9819ef20 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.185+0000 7f8b92a00700 1 -- 172.21.15.23:0/3646938587 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f8b8c031030 con 0x7f8b9807aca0 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.186+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 msgr2=0x7f8b9819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.186+0000 7f8ba0800700 1 --2- 172.21.15.23:0/3646938587 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b9819b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c003de0 tx=0x7f8b8c0047c0 comp rx=0 tx=0).stop 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.186+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 shutdown_connections 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.187+0000 7f8ba0800700 1 --2- 172.21.15.23:0/3646938587 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8b9807aca0 0x7f8b9819b980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:26.853 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.187+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 >> 172.21.15.23:0/3646938587 conn(0x7f8b98100fd0 msgr2=0x7f8b981026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:26.854 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.187+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 shutdown_connections 2024-02-28T16:11:26.854 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:26.187+0000 7f8ba0800700 1 -- 172.21.15.23:0/3646938587 wait complete. 2024-02-28T16:11:26.854 INFO:teuthology.orchestra.run.smithi023.stdout:mgr not available, waiting (2/15)... 2024-02-28T16:11:30.295 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:30.295 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:11:30.295 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsid": "dea052fa-d653-11ee-95c3-87774f69a715", 2024-02-28T16:11:30.295 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:11:30.295 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:11:30.295 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "smithi023" 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:11:30.296 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:30.297 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:11:30.297 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:30.297 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:11:30.297 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:11:30.297 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:11:30.305 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:11:30.305 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:11:30.305 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:11:30.305 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:30.305 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:11:30.305 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:30.306 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:11:11.971768+0000", 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:11:30.307 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.464+0000 7f3784c00700 1 Processor -- start 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.464+0000 7f3784c00700 1 -- start start 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.465+0000 7f3784c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f3780104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.465+0000 7f3784c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780105230 con 0x7f37801048e0 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.465+0000 7f377de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f3780104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.465+0000 7f377de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f3780104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42548/0 (socket says 172.21.15.23:42548) 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.465+0000 7f377de00700 1 -- 172.21.15.23:0/873263955 learned_addr learned my addr 172.21.15.23:0/873263955 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.466+0000 7f377de00700 1 -- 172.21.15.23:0/873263955 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780105370 con 0x7f37801048e0 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.466+0000 7f377de00700 1 --2- 172.21.15.23:0/873263955 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f3780104cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37700098a0 tx=0x7f3770009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73b1683d39d295c server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.466+0000 7f377ca00700 1 -- 172.21.15.23:0/873263955 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3770004180 con 0x7f37801048e0 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.466+0000 7f377ca00700 1 -- 172.21.15.23:0/873263955 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f37700042e0 con 0x7f37801048e0 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.466+0000 7f377ca00700 1 -- 172.21.15.23:0/873263955 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3770011a50 con 0x7f37801048e0 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.467+0000 7f3784c00700 1 -- 172.21.15.23:0/873263955 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 msgr2=0x7f3780104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:30.308 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.467+0000 7f3784c00700 1 --2- 172.21.15.23:0/873263955 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f3780104cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37700098a0 tx=0x7f3770009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.467+0000 7f3784c00700 1 -- 172.21.15.23:0/873263955 shutdown_connections 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.467+0000 7f3784c00700 1 --2- 172.21.15.23:0/873263955 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f3780104cf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.467+0000 7f3784c00700 1 -- 172.21.15.23:0/873263955 >> 172.21.15.23:0/873263955 conn(0x7f37800fff10 msgr2=0x7f3780102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.467+0000 7f3784c00700 1 -- 172.21.15.23:0/873263955 shutdown_connections 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.467+0000 7f3784c00700 1 -- 172.21.15.23:0/873263955 wait complete. 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.468+0000 7f3784c00700 1 Processor -- start 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.468+0000 7f3784c00700 1 -- start start 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.469+0000 7f3784c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f37801996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.469+0000 7f3784c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780199c10 con 0x7f37801048e0 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.469+0000 7f377de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f37801996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.469+0000 7f377de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f37801996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42562/0 (socket says 172.21.15.23:42562) 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.469+0000 7f377de00700 1 -- 172.21.15.23:0/3222534348 learned_addr learned my addr 172.21.15.23:0/3222534348 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.469+0000 7f377de00700 1 -- 172.21.15.23:0/3222534348 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770009550 con 0x7f37801048e0 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.470+0000 7f377de00700 1 --2- 172.21.15.23:0/3222534348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f37801996d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3770003de0 tx=0x7f3770011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:30.309 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.470+0000 7f3776a00700 1 -- 172.21.15.23:0/3222534348 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3770003930 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.470+0000 7f3776a00700 1 -- 172.21.15.23:0/3222534348 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3770003a90 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.470+0000 7f3784c00700 1 -- 172.21.15.23:0/3222534348 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3780199e10 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.470+0000 7f3776a00700 1 -- 172.21.15.23:0/3222534348 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3770019730 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.470+0000 7f3784c00700 1 -- 172.21.15.23:0/3222534348 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378019a2b0 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.470+0000 7f3776a00700 1 -- 172.21.15.23:0/3222534348 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3770019cd0 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.471+0000 7f3776a00700 1 -- 172.21.15.23:0/3222534348 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f377002c430 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.471+0000 7f376be00700 1 -- 172.21.15.23:0/3222534348 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37580052f0 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.474+0000 7f3776a00700 1 -- 172.21.15.23:0/3222534348 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3770042b00 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.555+0000 7f376be00700 1 -- 172.21.15.23:0/3222534348 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3758005c90 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.556+0000 7f3776a00700 1 -- 172.21.15.23:0/3222534348 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f3770031030 con 0x7f37801048e0 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.557+0000 7f376be00700 1 -- 172.21.15.23:0/3222534348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 msgr2=0x7f37801996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.557+0000 7f376be00700 1 --2- 172.21.15.23:0/3222534348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f37801996d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3770003de0 tx=0x7f3770011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.557+0000 7f376be00700 1 -- 172.21.15.23:0/3222534348 shutdown_connections 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.557+0000 7f376be00700 1 --2- 172.21.15.23:0/3222534348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37801048e0 0x7f37801996d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:30.310 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.557+0000 7f376be00700 1 -- 172.21.15.23:0/3222534348 >> 172.21.15.23:0/3222534348 conn(0x7f37800fff10 msgr2=0x7f37800740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:30.311 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.557+0000 7f376be00700 1 -- 172.21.15.23:0/3222534348 shutdown_connections 2024-02-28T16:11:30.311 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:29.557+0000 7f376be00700 1 -- 172.21.15.23:0/3222534348 wait complete. 2024-02-28T16:11:30.311 INFO:teuthology.orchestra.run.smithi023.stdout:mgr not available, waiting (3/15)... 2024-02-28T16:11:30.458 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:30 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3222534348' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:11:31.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: Activating manager daemon smithi023.bbebnt 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: mgrmap e2: smithi023.bbebnt(active, starting, since 0.0105893s) 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:31 smithi023 ceph-mon[29137]: from='mgr.14100 172.21.15.23:0/3751513740' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:33.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:32 smithi023 ceph-mon[29137]: mgrmap e3: smithi023.bbebnt(active, since 1.02115s) 2024-02-28T16:11:33.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:33.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:11:33.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsid": "dea052fa-d653-11ee-95c3-87774f69a715", 2024-02-28T16:11:33.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:11:33.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:33.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:11:33.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "smithi023" 2024-02-28T16:11:33.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:33.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-02-28T16:11:33.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:11:33.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:33.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T16:11:33.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:11:33.881 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:33.881 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:11:33.881 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:33.881 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:11:33.883 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:11:33.884 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:11:33.884 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:11:33.884 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:11:33.884 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:33.884 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:11:33.888 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:11:11.971768+0000", 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.884+0000 7f8c77400700 1 Processor -- start 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.884+0000 7f8c77400700 1 -- start start 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.885+0000 7f8c77400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70074490 0x7f8c70108580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.885+0000 7f8c77400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70108ac0 con 0x7f8c70074490 2024-02-28T16:11:33.889 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.885+0000 7f8c74a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70074490 0x7f8c70108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.885+0000 7f8c74a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70074490 0x7f8c70108580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42648/0 (socket says 172.21.15.23:42648) 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.885+0000 7f8c74a00700 1 -- 172.21.15.23:0/114322730 learned_addr learned my addr 172.21.15.23:0/114322730 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.886+0000 7f8c74a00700 1 -- 172.21.15.23:0/114322730 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70108c00 con 0x7f8c70074490 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.886+0000 7f8c74a00700 1 --2- 172.21.15.23:0/114322730 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70074490 0x7f8c70108580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8c640098a0 tx=0x7f8c64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5e0f5a6b0f20c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.886+0000 7f8c6f400700 1 -- 172.21.15.23:0/114322730 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c64004180 con 0x7f8c70074490 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.886+0000 7f8c6f400700 1 -- 172.21.15.23:0/114322730 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8c640042e0 con 0x7f8c70074490 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.886+0000 7f8c6f400700 1 -- 172.21.15.23:0/114322730 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c64011a50 con 0x7f8c70074490 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.887+0000 7f8c77400700 1 -- 172.21.15.23:0/114322730 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70074490 msgr2=0x7f8c70108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:33.890 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.887+0000 7f8c77400700 1 --2- 172.21.15.23:0/114322730 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70074490 0x7f8c70108580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8c640098a0 tx=0x7f8c64009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:33.894 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.887+0000 7f8c77400700 1 -- 172.21.15.23:0/114322730 shutdown_connections 2024-02-28T16:11:33.894 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.887+0000 7f8c77400700 1 --2- 172.21.15.23:0/114322730 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70074490 0x7f8c70108580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.887+0000 7f8c77400700 1 -- 172.21.15.23:0/114322730 >> 172.21.15.23:0/114322730 conn(0x7f8c700fff10 msgr2=0x7f8c70102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.887+0000 7f8c77400700 1 -- 172.21.15.23:0/114322730 shutdown_connections 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.887+0000 7f8c77400700 1 -- 172.21.15.23:0/114322730 wait complete. 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.888+0000 7f8c77400700 1 Processor -- start 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.888+0000 7f8c77400700 1 -- start start 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.889+0000 7f8c77400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70105e90 0x7f8c70104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.889+0000 7f8c77400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c701062a0 con 0x7f8c70105e90 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.889+0000 7f8c74a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70105e90 0x7f8c70104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.889+0000 7f8c74a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70105e90 0x7f8c70104520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42652/0 (socket says 172.21.15.23:42652) 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.889+0000 7f8c74a00700 1 -- 172.21.15.23:0/1556185088 learned_addr learned my addr 172.21.15.23:0/1556185088 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.889+0000 7f8c74a00700 1 -- 172.21.15.23:0/1556185088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64009550 con 0x7f8c70105e90 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.890+0000 7f8c74a00700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70105e90 0x7f8c70104520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c64003de0 tx=0x7f8c64011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.890+0000 7f8c6d600700 1 -- 172.21.15.23:0/1556185088 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c64003930 con 0x7f8c70105e90 2024-02-28T16:11:33.895 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.890+0000 7f8c6d600700 1 -- 172.21.15.23:0/1556185088 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8c64003a90 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.890+0000 7f8c6d600700 1 -- 172.21.15.23:0/1556185088 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c640196c0 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.890+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c70104a60 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.890+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c70104f00 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.891+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c70062380 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.891+0000 7f8c6d600700 1 -- 172.21.15.23:0/1556185088 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f8c6401abc0 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.892+0000 7f8c6d600700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f8c580383a0 0x7f8c5803a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.892+0000 7f8c6d600700 1 -- 172.21.15.23:0/1556185088 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8c6404c0a0 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.892+0000 7f8c6fe00700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f8c580383a0 0x7f8c5803a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.893+0000 7f8c6fe00700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f8c580383a0 0x7f8c5803a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c006fd0 tx=0x7f8c5c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:32.898+0000 7f8c6d600700 1 -- 172.21.15.23:0/1556185088 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8c64010790 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.203+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8c700744e0 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.204+0000 7f8c6d600700 1 -- 172.21.15.23:0/1556185088 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f8c64010380 con 0x7f8c70105e90 2024-02-28T16:11:33.896 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f8c580383a0 msgr2=0x7f8c5803a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f8c580383a0 0x7f8c5803a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c006fd0 tx=0x7f8c5c006e40 comp rx=0 tx=0).stop 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70105e90 msgr2=0x7f8c70104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70105e90 0x7f8c70104520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c64003de0 tx=0x7f8c64011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 shutdown_connections 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f8c580383a0 0x7f8c5803a850 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 --2- 172.21.15.23:0/1556185088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8c70105e90 0x7f8c70104520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 >> 172.21.15.23:0/1556185088 conn(0x7f8c700fff10 msgr2=0x7f8c701015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 shutdown_connections 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:33.208+0000 7f8c77400700 1 -- 172.21.15.23:0/1556185088 wait complete. 2024-02-28T16:11:33.897 INFO:teuthology.orchestra.run.smithi023.stdout:mgr is available 2024-02-28T16:11:34.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:33 smithi023 ceph-mon[29137]: mgrmap e4: smithi023.bbebnt(active, since 2s) 2024-02-28T16:11:34.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:33 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1556185088' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:11:35.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:35 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/4144473760' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T16:11:35.437 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:35.437 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T16:11:35.437 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout fsid = dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T16:11:35.438 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.487+0000 7f941f400700 1 Processor -- start 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.487+0000 7f941f400700 1 -- start start 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.488+0000 7f941f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f94181088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.488+0000 7f941f400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9418074510 con 0x7f94181064f0 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.488+0000 7f941ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f94181088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.488+0000 7f941ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f94181088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42666/0 (socket says 172.21.15.23:42666) 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.488+0000 7f941ca00700 1 -- 172.21.15.23:0/2595574922 learned_addr learned my addr 172.21.15.23:0/2595574922 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.489+0000 7f941ca00700 1 -- 172.21.15.23:0/2595574922 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418074650 con 0x7f94181064f0 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.489+0000 7f941ca00700 1 --2- 172.21.15.23:0/2595574922 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f94181088d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f940c0098a0 tx=0x7f940c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d909e834d099e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.489+0000 7f9417400700 1 -- 172.21.15.23:0/2595574922 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f940c004180 con 0x7f94181064f0 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.489+0000 7f9417400700 1 -- 172.21.15.23:0/2595574922 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f940c0042e0 con 0x7f94181064f0 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.489+0000 7f9417400700 1 -- 172.21.15.23:0/2595574922 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f940c011a50 con 0x7f94181064f0 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.490+0000 7f941f400700 1 -- 172.21.15.23:0/2595574922 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 msgr2=0x7f94181088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.490+0000 7f941f400700 1 --2- 172.21.15.23:0/2595574922 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f94181088d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f940c0098a0 tx=0x7f940c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:35.439 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.490+0000 7f941f400700 1 -- 172.21.15.23:0/2595574922 shutdown_connections 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.490+0000 7f941f400700 1 --2- 172.21.15.23:0/2595574922 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f94181088d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.490+0000 7f941f400700 1 -- 172.21.15.23:0/2595574922 >> 172.21.15.23:0/2595574922 conn(0x7f94180fff10 msgr2=0x7f9418102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.490+0000 7f941f400700 1 -- 172.21.15.23:0/2595574922 shutdown_connections 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.490+0000 7f941f400700 1 -- 172.21.15.23:0/2595574922 wait complete. 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.492+0000 7f941f400700 1 Processor -- start 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.492+0000 7f941f400700 1 -- start start 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.492+0000 7f941f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f941819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.492+0000 7f941f400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941819be40 con 0x7f94181064f0 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.493+0000 7f941ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f941819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.493+0000 7f941ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f941819b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42678/0 (socket says 172.21.15.23:42678) 2024-02-28T16:11:35.440 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.493+0000 7f941ca00700 1 -- 172.21.15.23:0/4144473760 learned_addr learned my addr 172.21.15.23:0/4144473760 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.493+0000 7f941ca00700 1 -- 172.21.15.23:0/4144473760 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c009550 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.493+0000 7f941ca00700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f941819b900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f940c003de0 tx=0x7f940c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.494+0000 7f9415600700 1 -- 172.21.15.23:0/4144473760 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f940c003930 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.494+0000 7f9415600700 1 -- 172.21.15.23:0/4144473760 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f940c003a90 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.494+0000 7f9415600700 1 -- 172.21.15.23:0/4144473760 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f940c0196c0 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.494+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941819c040 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.494+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941819c4e0 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.495+0000 7f9415600700 1 -- 172.21.15.23:0/4144473760 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f940c01abc0 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.495+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9418109a60 con 0x7f94181064f0 2024-02-28T16:11:35.441 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.496+0000 7f9415600700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f9400038440 0x7f940003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.496+0000 7f9415600700 1 -- 172.21.15.23:0/4144473760 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f940c04c000 con 0x7f94181064f0 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.496+0000 7f9417e00700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f9400038440 0x7f940003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.497+0000 7f9417e00700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f9400038440 0x7f940003a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9404006fd0 tx=0x7f9404006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.501+0000 7f9415600700 1 -- 172.21.15.23:0/4144473760 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f940c019930 con 0x7f94181064f0 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.719+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9418109c80 con 0x7f94181064f0 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.721+0000 7f9415600700 1 -- 172.21.15.23:0/4144473760 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f940c010380 con 0x7f94181064f0 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.723+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f9400038440 msgr2=0x7f940003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.723+0000 7f941f400700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f9400038440 0x7f940003a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9404006fd0 tx=0x7f9404006e40 comp rx=0 tx=0).stop 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.723+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 msgr2=0x7f941819b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.723+0000 7f941f400700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f941819b900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f940c003de0 tx=0x7f940c011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.724+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 shutdown_connections 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.724+0000 7f941f400700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f9400038440 0x7f940003a8f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.724+0000 7f941f400700 1 --2- 172.21.15.23:0/4144473760 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94181064f0 0x7f941819b900 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.724+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 >> 172.21.15.23:0/4144473760 conn(0x7f94180fff10 msgr2=0x7f9418100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:35.442 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.724+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 shutdown_connections 2024-02-28T16:11:35.443 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:34.724+0000 7f941f400700 1 -- 172.21.15.23:0/4144473760 wait complete. 2024-02-28T16:11:35.443 INFO:teuthology.orchestra.run.smithi023.stdout:Enabling cephadm module... 2024-02-28T16:11:36.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:36 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/361339980' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-28T16:11:37.023 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.029+0000 7f018b600700 1 Processor -- start 2024-02-28T16:11:37.023 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.029+0000 7f018b600700 1 -- start start 2024-02-28T16:11:37.023 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.030+0000 7f018b600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f0184105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:37.023 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.030+0000 7f018b600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0184106310 con 0x7f01841059c0 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.030+0000 7f0188c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f0184105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.030+0000 7f0188c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f0184105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42690/0 (socket says 172.21.15.23:42690) 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.030+0000 7f0188c00700 1 -- 172.21.15.23:0/1950265226 learned_addr learned my addr 172.21.15.23:0/1950265226 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.031+0000 7f0188c00700 1 -- 172.21.15.23:0/1950265226 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184106450 con 0x7f01841059c0 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.031+0000 7f0188c00700 1 --2- 172.21.15.23:0/1950265226 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f0184105dd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f01780098a0 tx=0x7f0178009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f8487392dbd846 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.031+0000 7f0183400700 1 -- 172.21.15.23:0/1950265226 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0178004180 con 0x7f01841059c0 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.031+0000 7f0183400700 1 -- 172.21.15.23:0/1950265226 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f01780042e0 con 0x7f01841059c0 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.031+0000 7f0183400700 1 -- 172.21.15.23:0/1950265226 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0178011a50 con 0x7f01841059c0 2024-02-28T16:11:37.024 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.032+0000 7f018b600700 1 -- 172.21.15.23:0/1950265226 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 msgr2=0x7f0184105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.032+0000 7f018b600700 1 --2- 172.21.15.23:0/1950265226 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f0184105dd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f01780098a0 tx=0x7f0178009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.032+0000 7f018b600700 1 -- 172.21.15.23:0/1950265226 shutdown_connections 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.032+0000 7f018b600700 1 --2- 172.21.15.23:0/1950265226 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f0184105dd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.032+0000 7f018b600700 1 -- 172.21.15.23:0/1950265226 >> 172.21.15.23:0/1950265226 conn(0x7f0184100fd0 msgr2=0x7f0184103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.032+0000 7f018b600700 1 -- 172.21.15.23:0/1950265226 shutdown_connections 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.032+0000 7f018b600700 1 -- 172.21.15.23:0/1950265226 wait complete. 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.033+0000 7f018b600700 1 Processor -- start 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.034+0000 7f018b600700 1 -- start start 2024-02-28T16:11:37.025 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.034+0000 7f018b600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f018419b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.034+0000 7f018b600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018419be70 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.034+0000 7f0188c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f018419b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.034+0000 7f0188c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f018419b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42692/0 (socket says 172.21.15.23:42692) 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.034+0000 7f0188c00700 1 -- 172.21.15.23:0/361339980 learned_addr learned my addr 172.21.15.23:0/361339980 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.034+0000 7f0188c00700 1 -- 172.21.15.23:0/361339980 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178009550 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.035+0000 7f0188c00700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f018419b930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0178003de0 tx=0x7f0178011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.035+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0178003930 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.035+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0178003a90 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.035+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018419c070 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.035+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0178019730 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.035+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018419c510 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.036+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f01780199b0 con 0x7f01841059c0 2024-02-28T16:11:37.026 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.036+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0184062380 con 0x7f01841059c0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.037+0000 7f0181600700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f016c0383a0 0x7f016c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.037+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f017804c0c0 con 0x7f01841059c0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.037+0000 7f0183e00700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f016c0383a0 0x7f016c03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.038+0000 7f0183e00700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f016c0383a0 0x7f016c03a850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0170006fd0 tx=0x7f0170006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.042+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0178010380 con 0x7f01841059c0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.323+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f018419f6a0 con 0x7f01841059c0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.383+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f017801a430 con 0x7f01841059c0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.386+0000 7f0181600700 1 -- 172.21.15.23:0/361339980 <== mon.0 v2:172.21.15.23:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f017804be20 con 0x7f01841059c0 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.389+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f016c0383a0 msgr2=0x7f016c03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.389+0000 7f018b600700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f016c0383a0 0x7f016c03a850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0170006fd0 tx=0x7f0170006e40 comp rx=0 tx=0).stop 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.389+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 msgr2=0x7f018419b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.389+0000 7f018b600700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f018419b930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0178003de0 tx=0x7f0178011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:37.027 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.390+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 shutdown_connections 2024-02-28T16:11:37.028 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.390+0000 7f018b600700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f016c0383a0 0x7f016c03a850 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:37.028 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.390+0000 7f018b600700 1 --2- 172.21.15.23:0/361339980 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f01841059c0 0x7f018419b930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:37.028 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.390+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 >> 172.21.15.23:0/361339980 conn(0x7f0184100fd0 msgr2=0x7f0184102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:37.028 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.390+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 shutdown_connections 2024-02-28T16:11:37.028 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:36.390+0000 7f018b600700 1 -- 172.21.15.23:0/361339980 wait complete. 2024-02-28T16:11:37.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:37 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/361339980' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-28T16:11:37.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:37 smithi023 ceph-mon[29137]: mgrmap e5: smithi023.bbebnt(active, since 5s) 2024-02-28T16:11:38.631 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "active_name": "smithi023.bbebnt", 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.625+0000 7f395f800700 1 Processor -- start 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.625+0000 7f395f800700 1 -- start start 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.626+0000 7f395f800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f39581088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.626+0000 7f395f800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958074510 con 0x7f39581064f0 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.626+0000 7f395ce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f39581088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.626+0000 7f395ce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f39581088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42720/0 (socket says 172.21.15.23:42720) 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.626+0000 7f395ce00700 1 -- 172.21.15.23:0/1767942477 learned_addr learned my addr 172.21.15.23:0/1767942477 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.627+0000 7f395ce00700 1 -- 172.21.15.23:0/1767942477 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958074650 con 0x7f39581064f0 2024-02-28T16:11:38.632 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.627+0000 7f395ce00700 1 --2- 172.21.15.23:0/1767942477 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f39581088d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f394c0098a0 tx=0x7f394c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940b50759573c5dd server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.627+0000 7f3957400700 1 -- 172.21.15.23:0/1767942477 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f394c004180 con 0x7f39581064f0 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.627+0000 7f3957400700 1 -- 172.21.15.23:0/1767942477 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f394c0042e0 con 0x7f39581064f0 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.627+0000 7f3957400700 1 -- 172.21.15.23:0/1767942477 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f394c011a50 con 0x7f39581064f0 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.628+0000 7f395f800700 1 -- 172.21.15.23:0/1767942477 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 msgr2=0x7f39581088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.628+0000 7f395f800700 1 --2- 172.21.15.23:0/1767942477 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f39581088d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f394c0098a0 tx=0x7f394c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.628+0000 7f395f800700 1 -- 172.21.15.23:0/1767942477 shutdown_connections 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.628+0000 7f395f800700 1 --2- 172.21.15.23:0/1767942477 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f39581088d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.628+0000 7f395f800700 1 -- 172.21.15.23:0/1767942477 >> 172.21.15.23:0/1767942477 conn(0x7f39580fff10 msgr2=0x7f3958102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.628+0000 7f395f800700 1 -- 172.21.15.23:0/1767942477 shutdown_connections 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.628+0000 7f395f800700 1 -- 172.21.15.23:0/1767942477 wait complete. 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.630+0000 7f395f800700 1 Processor -- start 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.630+0000 7f395f800700 1 -- start start 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.630+0000 7f395f800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f3958105e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.630+0000 7f395f800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958106390 con 0x7f39581064f0 2024-02-28T16:11:38.633 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.631+0000 7f395ce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f3958105e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.631+0000 7f395ce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f3958105e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42734/0 (socket says 172.21.15.23:42734) 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.631+0000 7f395ce00700 1 -- 172.21.15.23:0/430065385 learned_addr learned my addr 172.21.15.23:0/430065385 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.631+0000 7f395ce00700 1 -- 172.21.15.23:0/430065385 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c009550 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.631+0000 7f395ce00700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f3958105e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f394c003de0 tx=0x7f394c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.632+0000 7f3955600700 1 -- 172.21.15.23:0/430065385 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f394c003930 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.632+0000 7f3955600700 1 -- 172.21.15.23:0/430065385 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f394c003a90 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.632+0000 7f3955600700 1 -- 172.21.15.23:0/430065385 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f394c0196c0 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.632+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39581044a0 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.632+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3958104940 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.633+0000 7f3955600700 1 -- 172.21.15.23:0/430065385 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f394c01a430 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.633+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3958109a60 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.633+0000 7f3955600700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 0x7f394003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.634+0000 7f3955600700 1 -- 172.21.15.23:0/430065385 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f394c04c060 con 0x7f39581064f0 2024-02-28T16:11:38.634 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.634+0000 7f3957e00700 1 -- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 msgr2=0x7f394003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/285090680 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.634+0000 7f3957e00700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 0x7f394003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.639+0000 7f3955600700 1 -- 172.21.15.23:0/430065385 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f394c010380 con 0x7f39581064f0 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.835+0000 7f3957e00700 1 -- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 msgr2=0x7f394003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/285090680 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.835+0000 7f3957e00700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 0x7f394003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.914+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f3958104fa0 con 0x7f39581064f0 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.915+0000 7f3955600700 1 -- 172.21.15.23:0/430065385 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f394c010380 con 0x7f39581064f0 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.917+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 msgr2=0x7f394003a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.917+0000 7f395f800700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 0x7f394003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.917+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 msgr2=0x7f3958105e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.917+0000 7f395f800700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f3958105e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f394c003de0 tx=0x7f394c011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.918+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 shutdown_connections 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.918+0000 7f395f800700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f3940038440 0x7f394003a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.918+0000 7f395f800700 1 --2- 172.21.15.23:0/430065385 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f39581064f0 0x7f3958105e50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.918+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 >> 172.21.15.23:0/430065385 conn(0x7f39580fff10 msgr2=0x7f3958101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:38.635 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.918+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 shutdown_connections 2024-02-28T16:11:38.636 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:37.918+0000 7f395f800700 1 -- 172.21.15.23:0/430065385 wait complete. 2024-02-28T16:11:38.636 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for the mgr to restart... 2024-02-28T16:11:38.636 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for mgr epoch 5... 2024-02-28T16:11:38.667 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:38 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/430065385' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T16:11:45.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: Active manager daemon smithi023.bbebnt restarted 2024-02-28T16:11:45.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: Activating manager daemon smithi023.bbebnt 2024-02-28T16:11:45.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: osdmap e2: 0 total, 0 up, 0 in 2024-02-28T16:11:45.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: mgrmap e6: smithi023.bbebnt(active, starting, since 0.0140732s) 2024-02-28T16:11:45.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:11:45.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:11:45.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:11:45.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:11:45.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:11:45.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:11:45.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:45 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:46.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: Found migration_current of "None". Setting to last migration. 2024-02-28T16:11:46.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:46.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:46 smithi023 ceph-mon[29137]: mgrmap e7: smithi023.bbebnt(active, since 1.02025s) 2024-02-28T16:11:46.999 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.213+0000 7f0530c00700 1 Processor -- start 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.213+0000 7f0530c00700 1 -- start start 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.214+0000 7f0530c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.214+0000 7f0530c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c106310 con 0x7f052c1059c0 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.214+0000 7f0529e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.000 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.214+0000 7f0529e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42744/0 (socket says 172.21.15.23:42744) 2024-02-28T16:11:47.001 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.214+0000 7f0529e00700 1 -- 172.21.15.23:0/492672337 learned_addr learned my addr 172.21.15.23:0/492672337 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:47.001 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.215+0000 7f0529e00700 1 -- 172.21.15.23:0/492672337 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c106450 con 0x7f052c1059c0 2024-02-28T16:11:47.001 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.215+0000 7f0529e00700 1 --2- 172.21.15.23:0/492672337 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c105dd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f051c0098a0 tx=0x7f051c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b34098bfdefd136 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:47.001 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.215+0000 7f0528a00700 1 -- 172.21.15.23:0/492672337 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f051c004180 con 0x7f052c1059c0 2024-02-28T16:11:47.001 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.216+0000 7f0528a00700 1 -- 172.21.15.23:0/492672337 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f051c0042e0 con 0x7f052c1059c0 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.216+0000 7f0528a00700 1 -- 172.21.15.23:0/492672337 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f051c011a50 con 0x7f052c1059c0 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.216+0000 7f0530c00700 1 -- 172.21.15.23:0/492672337 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 msgr2=0x7f052c105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.216+0000 7f0530c00700 1 --2- 172.21.15.23:0/492672337 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c105dd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f051c0098a0 tx=0x7f051c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.216+0000 7f0530c00700 1 -- 172.21.15.23:0/492672337 shutdown_connections 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.216+0000 7f0530c00700 1 --2- 172.21.15.23:0/492672337 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c105dd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.217+0000 7f0530c00700 1 -- 172.21.15.23:0/492672337 >> 172.21.15.23:0/492672337 conn(0x7f052c100fd0 msgr2=0x7f052c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.217+0000 7f0530c00700 1 -- 172.21.15.23:0/492672337 shutdown_connections 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.217+0000 7f0530c00700 1 -- 172.21.15.23:0/492672337 wait complete. 2024-02-28T16:11:47.009 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.218+0000 7f0530c00700 1 Processor -- start 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.218+0000 7f0530c00700 1 -- start start 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.219+0000 7f0530c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c07ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.219+0000 7f0530c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c07b050 con 0x7f052c1059c0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.219+0000 7f0529e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c07ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.219+0000 7f0529e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c07ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42752/0 (socket says 172.21.15.23:42752) 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.219+0000 7f0529e00700 1 -- 172.21.15.23:0/289946995 learned_addr learned my addr 172.21.15.23:0/289946995 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.219+0000 7f0529e00700 1 -- 172.21.15.23:0/289946995 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c009550 con 0x7f052c1059c0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.220+0000 7f0529e00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c07ab10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f051c003de0 tx=0x7f051c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.220+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f051c003930 con 0x7f052c1059c0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.220+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f051c003a90 con 0x7f052c1059c0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.220+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c079160 con 0x7f052c1059c0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.220+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f051c019730 con 0x7f052c1059c0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.220+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c079600 con 0x7f052c1059c0 2024-02-28T16:11:47.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.221+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f051c0199b0 con 0x7f052c1059c0 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.222+0000 7f0522a00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.222+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 --> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f051003afb0 con 0x7f05100383f0 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.222+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f051c04c3d0 con 0x7f052c1059c0 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.222+0000 7f0529400700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 msgr2=0x7f051003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/285090680 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.222+0000 7f0529400700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.423+0000 7f0529400700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 msgr2=0x7f051003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/285090680 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.423+0000 7f0529400700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.824+0000 7f0529400700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 msgr2=0x7f051003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/285090680 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:39.824+0000 7f0529400700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:40.625+0000 7f0529400700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 msgr2=0x7f051003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/285090680 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:40.625+0000 7f0529400700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:42.227+0000 7f0529400700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 msgr2=0x7f051003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/285090680 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:42.227+0000 7f0529400700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T16:11:47.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:45.278+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7f051c02c9b0 con 0x7f052c1059c0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:45.278+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 msgr2=0x7f051003a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:45.278+0000 7f0522a00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.282+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f051c04de10 con 0x7f052c1059c0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.282+0000 7f0522a00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f051003bcc0 0x7f051003e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.282+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f051003afb0 con 0x7f051003bcc0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.284+0000 7f0529400700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f051003bcc0 0x7f051003e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.286+0000 7f0529400700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f051003bcc0 0x7f051003e0a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0518003a10 tx=0x7f0518009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.287+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f051003afb0 con 0x7f051003bcc0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.295+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f052c07a6b0 con 0x7f051003bcc0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.295+0000 7f0522a00700 1 -- 172.21.15.23:0/289946995 <== mgr.14120 v2:172.21.15.23:6800/2571222747 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f052c07a6b0 con 0x7f051003bcc0 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f051003bcc0 msgr2=0x7f051003e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f051003bcc0 0x7f051003e0a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0518003a10 tx=0x7f0518009290 comp rx=0 tx=0).stop 2024-02-28T16:11:47.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 msgr2=0x7f052c07ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c07ab10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f051c003de0 tx=0x7f051c011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 shutdown_connections 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f051003bcc0 0x7f051003e0a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f052c1059c0 0x7f052c07ab10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 --2- 172.21.15.23:0/289946995 >> [v2:172.21.15.23:6800/285090680,v1:172.21.15.23:6801/285090680] conn(0x7f05100383f0 0x7f051003a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 >> 172.21.15.23:0/289946995 conn(0x7f052c100fd0 msgr2=0x7f052c102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.296+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 shutdown_connections 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:46.297+0000 7f0530c00700 1 -- 172.21.15.23:0/289946995 wait complete. 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:mgr epoch 5 is available 2024-02-28T16:11:47.013 INFO:teuthology.orchestra.run.smithi023.stdout:Setting orchestrator backend to cephadm... 2024-02-28T16:11:47.576 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:47 smithi023 ceph-mon[29137]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T16:11:47.576 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:47 smithi023 ceph-mon[29137]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T16:11:47.576 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:47 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:48.546 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:48 smithi023 ceph-mon[29137]: [28/Feb/2024:16:11:46] ENGINE Bus STARTING 2024-02-28T16:11:48.546 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:48 smithi023 ceph-mon[29137]: [28/Feb/2024:16:11:46] ENGINE Serving on http://172.21.15.23:8765 2024-02-28T16:11:48.546 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:48 smithi023 ceph-mon[29137]: [28/Feb/2024:16:11:46] ENGINE Serving on https://172.21.15.23:7150 2024-02-28T16:11:48.546 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:48 smithi023 ceph-mon[29137]: [28/Feb/2024:16:11:46] ENGINE Bus STARTED 2024-02-28T16:11:48.546 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:48 smithi023 ceph-mon[29137]: mgrmap e8: smithi023.bbebnt(active, since 2s) 2024-02-28T16:11:48.546 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:48 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:48.546 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:48 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:48.557 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.584+0000 7fcc87600700 1 Processor -- start 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.584+0000 7fcc87600700 1 -- start start 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.585+0000 7fcc87600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc80107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.585+0000 7fcc87600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80108530 con 0x7fcc80107be0 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.585+0000 7fcc84c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc80107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.585+0000 7fcc84c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc80107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35016/0 (socket says 172.21.15.23:35016) 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.585+0000 7fcc84c00700 1 -- 172.21.15.23:0/144776599 learned_addr learned my addr 172.21.15.23:0/144776599 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.586+0000 7fcc84c00700 1 -- 172.21.15.23:0/144776599 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80108670 con 0x7fcc80107be0 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.586+0000 7fcc84c00700 1 --2- 172.21.15.23:0/144776599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc80107ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc740098a0 tx=0x7fcc74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a105110623549d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.586+0000 7fcc7f400700 1 -- 172.21.15.23:0/144776599 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc74004180 con 0x7fcc80107be0 2024-02-28T16:11:48.558 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.586+0000 7fcc7f400700 1 -- 172.21.15.23:0/144776599 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcc740042e0 con 0x7fcc80107be0 2024-02-28T16:11:48.562 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.586+0000 7fcc7f400700 1 -- 172.21.15.23:0/144776599 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc74011a50 con 0x7fcc80107be0 2024-02-28T16:11:48.562 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.587+0000 7fcc87600700 1 -- 172.21.15.23:0/144776599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 msgr2=0x7fcc80107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.587+0000 7fcc87600700 1 --2- 172.21.15.23:0/144776599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc80107ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc740098a0 tx=0x7fcc74009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.587+0000 7fcc87600700 1 -- 172.21.15.23:0/144776599 shutdown_connections 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.587+0000 7fcc87600700 1 --2- 172.21.15.23:0/144776599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc80107ff0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.587+0000 7fcc87600700 1 -- 172.21.15.23:0/144776599 >> 172.21.15.23:0/144776599 conn(0x7fcc8007b200 msgr2=0x7fcc8007b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.587+0000 7fcc87600700 1 -- 172.21.15.23:0/144776599 shutdown_connections 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.587+0000 7fcc87600700 1 -- 172.21.15.23:0/144776599 wait complete. 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.589+0000 7fcc87600700 1 Processor -- start 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.589+0000 7fcc87600700 1 -- start start 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.589+0000 7fcc87600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc8019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.589+0000 7fcc87600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8019be60 con 0x7fcc80107be0 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.590+0000 7fcc84c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc8019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.590+0000 7fcc84c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc8019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35030/0 (socket says 172.21.15.23:35030) 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.590+0000 7fcc84c00700 1 -- 172.21.15.23:0/477783937 learned_addr learned my addr 172.21.15.23:0/477783937 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:48.563 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.590+0000 7fcc84c00700 1 -- 172.21.15.23:0/477783937 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74009550 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.590+0000 7fcc84c00700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc8019b920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc74003de0 tx=0x7fcc74011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.591+0000 7fcc7d600700 1 -- 172.21.15.23:0/477783937 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc74003930 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.591+0000 7fcc7d600700 1 -- 172.21.15.23:0/477783937 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcc74003a90 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.591+0000 7fcc7d600700 1 -- 172.21.15.23:0/477783937 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc74019730 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.591+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8019c060 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.591+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8019c500 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.592+0000 7fcc7d600700 1 -- 172.21.15.23:0/477783937 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fcc74019960 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.592+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80062380 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.593+0000 7fcc7d600700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fcc68038440 0x7fcc6803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.593+0000 7fcc7d600700 1 -- 172.21.15.23:0/477783937 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcc7404c520 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.593+0000 7fcc7fe00700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fcc68038440 0x7fcc6803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.594+0000 7fcc7fe00700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fcc68038440 0x7fcc6803a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c006fd0 tx=0x7fcc6c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.598+0000 7fcc7d600700 1 -- 172.21.15.23:0/477783937 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcc74010770 con 0x7fcc80107be0 2024-02-28T16:11:48.564 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.833+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc80106c80 con 0x7fcc68038440 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.851+0000 7fcc7d600700 1 -- 172.21.15.23:0/477783937 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcc80106c80 con 0x7fcc68038440 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.854+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fcc68038440 msgr2=0x7fcc6803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.854+0000 7fcc87600700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fcc68038440 0x7fcc6803a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c006fd0 tx=0x7fcc6c006e40 comp rx=0 tx=0).stop 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.854+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 msgr2=0x7fcc8019b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.854+0000 7fcc87600700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc8019b920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc74003de0 tx=0x7fcc74011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.855+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 shutdown_connections 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.855+0000 7fcc87600700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fcc68038440 0x7fcc6803a8f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.855+0000 7fcc87600700 1 --2- 172.21.15.23:0/477783937 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc80107be0 0x7fcc8019b920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.855+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 >> 172.21.15.23:0/477783937 conn(0x7fcc8007b200 msgr2=0x7fcc80106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.855+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 shutdown_connections 2024-02-28T16:11:48.565 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:47.855+0000 7fcc87600700 1 -- 172.21.15.23:0/477783937 wait complete. 2024-02-28T16:11:49.419 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:49 smithi023 ceph-mon[29137]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:50.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-28T16:11:50.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.167+0000 7f681d800700 1 Processor -- start 2024-02-28T16:11:50.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.167+0000 7f681d800700 1 -- start start 2024-02-28T16:11:50.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.168+0000 7f681d800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:50.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.168+0000 7f681d800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681807a850 con 0x7f681807be10 2024-02-28T16:11:50.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.169+0000 7f6816a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:50.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.169+0000 7f6816a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35042/0 (socket says 172.21.15.23:35042) 2024-02-28T16:11:50.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.169+0000 7f6816a00700 1 -- 172.21.15.23:0/4050343656 learned_addr learned my addr 172.21.15.23:0/4050343656 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:50.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.169+0000 7f6816a00700 1 -- 172.21.15.23:0/4050343656 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681807a990 con 0x7f681807be10 2024-02-28T16:11:50.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.170+0000 7f6816a00700 1 --2- 172.21.15.23:0/4050343656 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681807a310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f68080098a0 tx=0x7f6808009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c35562fd28a242 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:50.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.170+0000 7f6815600700 1 -- 172.21.15.23:0/4050343656 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6808004180 con 0x7f681807be10 2024-02-28T16:11:50.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.170+0000 7f6815600700 1 -- 172.21.15.23:0/4050343656 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f68080042e0 con 0x7f681807be10 2024-02-28T16:11:50.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.170+0000 7f6815600700 1 -- 172.21.15.23:0/4050343656 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6808011a50 con 0x7f681807be10 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.171+0000 7f681d800700 1 -- 172.21.15.23:0/4050343656 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 msgr2=0x7f681807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.171+0000 7f681d800700 1 --2- 172.21.15.23:0/4050343656 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681807a310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f68080098a0 tx=0x7f6808009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.171+0000 7f681d800700 1 -- 172.21.15.23:0/4050343656 shutdown_connections 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.171+0000 7f681d800700 1 --2- 172.21.15.23:0/4050343656 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681807a310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.171+0000 7f681d800700 1 -- 172.21.15.23:0/4050343656 >> 172.21.15.23:0/4050343656 conn(0x7f6818101020 msgr2=0x7f6818103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.171+0000 7f681d800700 1 -- 172.21.15.23:0/4050343656 shutdown_connections 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.171+0000 7f681d800700 1 -- 172.21.15.23:0/4050343656 wait complete. 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.172+0000 7f681d800700 1 Processor -- start 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.172+0000 7f681d800700 1 -- start start 2024-02-28T16:11:50.042 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.173+0000 7f681d800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:50.044 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.173+0000 7f681d800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681819be70 con 0x7f681807be10 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.173+0000 7f6816a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.173+0000 7f6816a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35046/0 (socket says 172.21.15.23:35046) 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.173+0000 7f6816a00700 1 -- 172.21.15.23:0/274081999 learned_addr learned my addr 172.21.15.23:0/274081999 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.173+0000 7f6816a00700 1 -- 172.21.15.23:0/274081999 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808009550 con 0x7f681807be10 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.174+0000 7f6816a00700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681819b930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6808003de0 tx=0x7f6808011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.174+0000 7f680f400700 1 -- 172.21.15.23:0/274081999 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6808003930 con 0x7f681807be10 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.174+0000 7f680f400700 1 -- 172.21.15.23:0/274081999 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6808003a90 con 0x7f681807be10 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.174+0000 7f680f400700 1 -- 172.21.15.23:0/274081999 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68080196c0 con 0x7f681807be10 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.174+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681819c070 con 0x7f681807be10 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.174+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681819c510 con 0x7f681807be10 2024-02-28T16:11:50.045 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.175+0000 7f680f400700 1 -- 172.21.15.23:0/274081999 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f680801abc0 con 0x7f681807be10 2024-02-28T16:11:50.046 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.175+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681810bc70 con 0x7f681807be10 2024-02-28T16:11:50.046 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.176+0000 7f680f400700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f67fc038440 0x7f67fc03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:50.046 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.176+0000 7f680f400700 1 -- 172.21.15.23:0/274081999 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f680804c4b0 con 0x7f681807be10 2024-02-28T16:11:50.046 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.176+0000 7f6816000700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f67fc038440 0x7f67fc03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:50.046 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.177+0000 7f6816000700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f67fc038440 0x7f67fc03a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6804006fd0 tx=0x7f6804006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.181+0000 7f680f400700 1 -- 172.21.15.23:0/274081999 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6808010770 con 0x7f681807be10 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.405+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f6818103300 con 0x7f67fc038440 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.406+0000 7f680f400700 1 -- 172.21.15.23:0/274081999 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f6818103300 con 0x7f67fc038440 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f67fc038440 msgr2=0x7f67fc03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f67fc038440 0x7f67fc03a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6804006fd0 tx=0x7f6804006e40 comp rx=0 tx=0).stop 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 msgr2=0x7f681819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681819b930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6808003de0 tx=0x7f6808011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 shutdown_connections 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f67fc038440 0x7f67fc03a8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 --2- 172.21.15.23:0/274081999 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f681807be10 0x7f681819b930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.409+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 >> 172.21.15.23:0/274081999 conn(0x7f6818101020 msgr2=0x7f68181026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.410+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 shutdown_connections 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:49.410+0000 7f681d800700 1 -- 172.21.15.23:0/274081999 wait complete. 2024-02-28T16:11:50.048 INFO:teuthology.orchestra.run.smithi023.stdout:Generating ssh key... 2024-02-28T16:11:50.612 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:50 smithi023 ceph-mon[29137]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:52.097 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.683+0000 7f6f29800700 1 Processor -- start 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.683+0000 7f6f29800700 1 -- start start 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.684+0000 7f6f29800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2407fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.684+0000 7f6f29800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f24080220 con 0x7f6f2407f8d0 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.684+0000 7f6f23e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2407fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.684+0000 7f6f23e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2407fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37928/0 (socket says 172.21.15.23:37928) 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.684+0000 7f6f23e00700 1 -- 172.21.15.23:0/3496786952 learned_addr learned my addr 172.21.15.23:0/3496786952 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.684+0000 7f6f23e00700 1 -- 172.21.15.23:0/3496786952 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24080360 con 0x7f6f2407f8d0 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.685+0000 7f6f23e00700 1 --2- 172.21.15.23:0/3496786952 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2407fce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f140098a0 tx=0x7f6f14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5b1918662f2512 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.685+0000 7f6f22a00700 1 -- 172.21.15.23:0/3496786952 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f14004180 con 0x7f6f2407f8d0 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.685+0000 7f6f22a00700 1 -- 172.21.15.23:0/3496786952 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6f140042e0 con 0x7f6f2407f8d0 2024-02-28T16:11:52.098 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.685+0000 7f6f22a00700 1 -- 172.21.15.23:0/3496786952 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f14011a50 con 0x7f6f2407f8d0 2024-02-28T16:11:52.099 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.686+0000 7f6f29800700 1 -- 172.21.15.23:0/3496786952 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 msgr2=0x7f6f2407fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:52.099 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.686+0000 7f6f29800700 1 --2- 172.21.15.23:0/3496786952 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2407fce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f140098a0 tx=0x7f6f14009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:52.099 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.686+0000 7f6f29800700 1 -- 172.21.15.23:0/3496786952 shutdown_connections 2024-02-28T16:11:52.099 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.686+0000 7f6f29800700 1 --2- 172.21.15.23:0/3496786952 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2407fce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:52.103 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.686+0000 7f6f29800700 1 -- 172.21.15.23:0/3496786952 >> 172.21.15.23:0/3496786952 conn(0x7f6f2407ae80 msgr2=0x7f6f2407d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:52.103 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.686+0000 7f6f29800700 1 -- 172.21.15.23:0/3496786952 shutdown_connections 2024-02-28T16:11:52.103 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.686+0000 7f6f29800700 1 -- 172.21.15.23:0/3496786952 wait complete. 2024-02-28T16:11:52.103 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.687+0000 7f6f29800700 1 Processor -- start 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.687+0000 7f6f29800700 1 -- start start 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.688+0000 7f6f29800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.688+0000 7f6f29800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f241a00b0 con 0x7f6f2407f8d0 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.688+0000 7f6f23e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.688+0000 7f6f23e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2419fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37944/0 (socket says 172.21.15.23:37944) 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.688+0000 7f6f23e00700 1 -- 172.21.15.23:0/481274564 learned_addr learned my addr 172.21.15.23:0/481274564 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.688+0000 7f6f23e00700 1 -- 172.21.15.23:0/481274564 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f14009550 con 0x7f6f2407f8d0 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.688+0000 7f6f23e00700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2419fb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f14000c00 tx=0x7f6f14011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.689+0000 7f6f20c00700 1 -- 172.21.15.23:0/481274564 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f14003970 con 0x7f6f2407f8d0 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.689+0000 7f6f20c00700 1 -- 172.21.15.23:0/481274564 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6f14003ad0 con 0x7f6f2407f8d0 2024-02-28T16:11:52.104 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.689+0000 7f6f20c00700 1 -- 172.21.15.23:0/481274564 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f14024750 con 0x7f6f2407f8d0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.689+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f241a02b0 con 0x7f6f2407f8d0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.689+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f241a0750 con 0x7f6f2407f8d0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.690+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2410dc80 con 0x7f6f2407f8d0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.690+0000 7f6f20c00700 1 -- 172.21.15.23:0/481274564 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6f1401a430 con 0x7f6f2407f8d0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.691+0000 7f6f20c00700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f6f08038440 0x7f6f0803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.691+0000 7f6f20c00700 1 -- 172.21.15.23:0/481274564 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6f1404c0e0 con 0x7f6f2407f8d0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.691+0000 7f6f23400700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f6f08038440 0x7f6f0803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.692+0000 7f6f23400700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f6f08038440 0x7f6f0803a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f10006fd0 tx=0x7f6f10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.697+0000 7f6f20c00700 1 -- 172.21.15.23:0/481274564 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6f1407e720 con 0x7f6f2407f8d0 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:50.917+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f24080360 con 0x7f6f08038440 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.352+0000 7f6f20c00700 1 -- 172.21.15.23:0/481274564 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6f24080360 con 0x7f6f08038440 2024-02-28T16:11:52.105 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f6f08038440 msgr2=0x7f6f0803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f6f08038440 0x7f6f0803a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f10006fd0 tx=0x7f6f10006e40 comp rx=0 tx=0).stop 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 msgr2=0x7f6f2419fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2419fb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f14000c00 tx=0x7f6f14011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 shutdown_connections 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f6f08038440 0x7f6f0803a8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 --2- 172.21.15.23:0/481274564 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f2407f8d0 0x7f6f2419fb70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.355+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 >> 172.21.15.23:0/481274564 conn(0x7f6f2407ae80 msgr2=0x7f6f2407c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.356+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 shutdown_connections 2024-02-28T16:11:52.106 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:51.356+0000 7f6f29800700 1 -- 172.21.15.23:0/481274564 wait complete. 2024-02-28T16:11:52.376 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:52 smithi023 ceph-mon[29137]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:52.376 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:52 smithi023 ceph-mon[29137]: Generating ssh key... 2024-02-28T16:11:52.376 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:52 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:52.376 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:52 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:11:53.647 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:53 smithi023 ceph-mon[29137]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:53.664 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn+mc6SNsVTQQgmJtPGFEMTad8GqbUp44EWQkFgC71JxsH2BhE+ERKtUKfJPFs1+5ZmzoXkKf2or7u2WYbOvW8/WfQpIR/M16gpBFcBJE3D1cGMwFHZADR1S/Zs+i2PJIXbg8g0ZRVWmQmjafwY+xENrJIHvXGbodnacNm4kh0rFkKoPN3FzKn8VdtJeZhIGYKQuE7g5P9e82Gfkn1gk4R9cF3BKUGvYJAl7PGdzJzCNmjUYkjw58PAtUqX/o0XMpTYO3MIJXvvYMQ4Cp6VPatZ3Q81N1owagWYFhAAcBLSvhvfK1n9U2A41kKdxr46V6V98ZDYCRuywDgYP+gZi2X1faiwLbqng0OhIPStG4k3wdMwIBb91PbpCWxbxGiYpAK8pUOZRpls34edtj0kw9kETbzb1VVaCE6UnNoLRU2qSN4jteMCnl39+PNH+EfoXLRBxVXbMJ+P5yjlvCCOWcy9t0HbMd39OSDu+DwxLRCGmtVn9bB3F6tXlyH9WYHIpc= ceph-dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:11:53.664 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.727+0000 7ff62fa00700 1 Processor -- start 2024-02-28T16:11:53.664 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.727+0000 7ff62fa00700 1 -- start start 2024-02-28T16:11:53.664 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.727+0000 7ff62fa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff628079cd0 0x7ff62810a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:53.664 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.727+0000 7ff62fa00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628106360 con 0x7ff628079cd0 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.728+0000 7ff62d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff628079cd0 0x7ff62810a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.728+0000 7ff62d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff628079cd0 0x7ff62810a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37950/0 (socket says 172.21.15.23:37950) 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.728+0000 7ff62d000700 1 -- 172.21.15.23:0/3594896695 learned_addr learned my addr 172.21.15.23:0/3594896695 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.728+0000 7ff62d000700 1 -- 172.21.15.23:0/3594896695 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62810aeb0 con 0x7ff628079cd0 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.729+0000 7ff62d000700 1 --2- 172.21.15.23:0/3594896695 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff628079cd0 0x7ff62810a970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff6100098a0 tx=0x7ff610009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc28d23f4778cb7 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.729+0000 7ff627e00700 1 -- 172.21.15.23:0/3594896695 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff610004180 con 0x7ff628079cd0 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.729+0000 7ff627e00700 1 -- 172.21.15.23:0/3594896695 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff6100042e0 con 0x7ff628079cd0 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.729+0000 7ff627e00700 1 -- 172.21.15.23:0/3594896695 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff610011a50 con 0x7ff628079cd0 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.730+0000 7ff62fa00700 1 -- 172.21.15.23:0/3594896695 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff628079cd0 msgr2=0x7ff62810a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.730+0000 7ff62fa00700 1 --2- 172.21.15.23:0/3594896695 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff628079cd0 0x7ff62810a970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff6100098a0 tx=0x7ff610009bb0 comp rx=0 tx=0).stop 2024-02-28T16:11:53.665 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.730+0000 7ff62fa00700 1 -- 172.21.15.23:0/3594896695 shutdown_connections 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.730+0000 7ff62fa00700 1 --2- 172.21.15.23:0/3594896695 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff628079cd0 0x7ff62810a970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.730+0000 7ff62fa00700 1 -- 172.21.15.23:0/3594896695 >> 172.21.15.23:0/3594896695 conn(0x7ff6280fff00 msgr2=0x7ff628102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.730+0000 7ff62fa00700 1 -- 172.21.15.23:0/3594896695 shutdown_connections 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.730+0000 7ff62fa00700 1 -- 172.21.15.23:0/3594896695 wait complete. 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.731+0000 7ff62fa00700 1 Processor -- start 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.731+0000 7ff62fa00700 1 -- start start 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.732+0000 7ff62fa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff62819b8e0 0x7ff62819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.732+0000 7ff62fa00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62819c230 con 0x7ff62819b8e0 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.732+0000 7ff62d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff62819b8e0 0x7ff62819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.732+0000 7ff62d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff62819b8e0 0x7ff62819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37964/0 (socket says 172.21.15.23:37964) 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.732+0000 7ff62d000700 1 -- 172.21.15.23:0/442093308 learned_addr learned my addr 172.21.15.23:0/442093308 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:11:53.666 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.732+0000 7ff62d000700 1 -- 172.21.15.23:0/442093308 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610009550 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.733+0000 7ff62d000700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff62819b8e0 0x7ff62819bcf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff610003de0 tx=0x7ff610011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.733+0000 7ff626000700 1 -- 172.21.15.23:0/442093308 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff610003930 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.733+0000 7ff626000700 1 -- 172.21.15.23:0/442093308 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff610003a90 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.733+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62819c430 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.733+0000 7ff626000700 1 -- 172.21.15.23:0/442093308 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6100196c0 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.733+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62819f090 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.734+0000 7ff626000700 1 -- 172.21.15.23:0/442093308 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff61001abc0 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.734+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff628079cd0 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.735+0000 7ff626000700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7ff608038440 0x7ff60803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.735+0000 7ff626000700 1 -- 172.21.15.23:0/442093308 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff61004c4b0 con 0x7ff62819b8e0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.735+0000 7ff61fe00700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7ff608038440 0x7ff60803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.736+0000 7ff61fe00700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7ff608038440 0x7ff60803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff618006fd0 tx=0x7ff618006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:53.667 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.740+0000 7ff626000700 1 -- 172.21.15.23:0/442093308 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff610010790 con 0x7ff62819b8e0 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.965+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6281021e0 con 0x7ff608038440 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.967+0000 7ff626000700 1 -- 172.21.15.23:0/442093308 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ff6281021e0 con 0x7ff608038440 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7ff608038440 msgr2=0x7ff60803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7ff608038440 0x7ff60803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff618006fd0 tx=0x7ff618006e40 comp rx=0 tx=0).stop 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff62819b8e0 msgr2=0x7ff62819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff62819b8e0 0x7ff62819bcf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff610003de0 tx=0x7ff610011ab0 comp rx=0 tx=0).stop 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 shutdown_connections 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7ff608038440 0x7ff60803a8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 --2- 172.21.15.23:0/442093308 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff62819b8e0 0x7ff62819bcf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 >> 172.21.15.23:0/442093308 conn(0x7ff6280fff00 msgr2=0x7ff6281015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 shutdown_connections 2024-02-28T16:11:53.668 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:52.970+0000 7ff62fa00700 1 -- 172.21.15.23:0/442093308 wait complete. 2024-02-28T16:11:53.669 INFO:teuthology.orchestra.run.smithi023.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:11:53.669 INFO:teuthology.orchestra.run.smithi023.stdout:Adding key to root@localhost authorized_keys... 2024-02-28T16:11:53.669 INFO:teuthology.orchestra.run.smithi023.stdout:Adding host smithi023... 2024-02-28T16:11:55.614 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:55 smithi023 ceph-mon[29137]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi023", "addr": "172.21.15.23", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:56.646 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:11:56 smithi023 ceph-mon[29137]: Deploying cephadm binary to smithi023 2024-02-28T16:12:00.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Added host 'smithi023' with addr '172.21.15.23' 2024-02-28T16:12:00.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.240+0000 7f56ef200700 1 Processor -- start 2024-02-28T16:12:00.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.240+0000 7f56ef200700 1 -- start start 2024-02-28T16:12:00.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.240+0000 7f56ef200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:00.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.240+0000 7f56ef200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e807d0e0 con 0x7f56e807c790 2024-02-28T16:12:00.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.241+0000 7f56e7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:00.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.241+0000 7f56e7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e807cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37966/0 (socket says 172.21.15.23:37966) 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.241+0000 7f56e7e00700 1 -- 172.21.15.23:0/1969219452 learned_addr learned my addr 172.21.15.23:0/1969219452 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.242+0000 7f56e7e00700 1 -- 172.21.15.23:0/1969219452 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e807d220 con 0x7f56e807c790 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.242+0000 7f56e7e00700 1 --2- 172.21.15.23:0/1969219452 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e807cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56d80098a0 tx=0x7f56d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ee52b2d539502b server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.242+0000 7f56e6a00700 1 -- 172.21.15.23:0/1969219452 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d8004180 con 0x7f56e807c790 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.242+0000 7f56e6a00700 1 -- 172.21.15.23:0/1969219452 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f56d80042e0 con 0x7f56e807c790 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.242+0000 7f56e6a00700 1 -- 172.21.15.23:0/1969219452 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d8011a50 con 0x7f56e807c790 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.243+0000 7f56ef200700 1 -- 172.21.15.23:0/1969219452 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 msgr2=0x7f56e807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.243+0000 7f56ef200700 1 --2- 172.21.15.23:0/1969219452 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e807cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56d80098a0 tx=0x7f56d8009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.243+0000 7f56ef200700 1 -- 172.21.15.23:0/1969219452 shutdown_connections 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.243+0000 7f56ef200700 1 --2- 172.21.15.23:0/1969219452 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e807cba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.243+0000 7f56ef200700 1 -- 172.21.15.23:0/1969219452 >> 172.21.15.23:0/1969219452 conn(0x7f56e807b200 msgr2=0x7f56e807b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.243+0000 7f56ef200700 1 -- 172.21.15.23:0/1969219452 shutdown_connections 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.243+0000 7f56ef200700 1 -- 172.21.15.23:0/1969219452 wait complete. 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.244+0000 7f56ef200700 1 Processor -- start 2024-02-28T16:12:00.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.245+0000 7f56ef200700 1 -- start start 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.245+0000 7f56ef200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.245+0000 7f56ef200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e81a0290 con 0x7f56e807c790 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.245+0000 7f56e7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.245+0000 7f56e7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37974/0 (socket says 172.21.15.23:37974) 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.245+0000 7f56e7e00700 1 -- 172.21.15.23:0/358859418 learned_addr learned my addr 172.21.15.23:0/358859418 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.246+0000 7f56e7e00700 1 -- 172.21.15.23:0/358859418 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8009550 con 0x7f56e807c790 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.246+0000 7f56e7e00700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e819fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f56d8003de0 tx=0x7f56d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.246+0000 7f56e4c00700 1 -- 172.21.15.23:0/358859418 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d80038b0 con 0x7f56e807c790 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.246+0000 7f56e4c00700 1 -- 172.21.15.23:0/358859418 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f56d8003a10 con 0x7f56e807c790 2024-02-28T16:12:00.039 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.246+0000 7f56e4c00700 1 -- 172.21.15.23:0/358859418 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d8019600 con 0x7f56e807c790 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.246+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e81a0490 con 0x7f56e807c790 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.246+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e81a0930 con 0x7f56e807c790 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.248+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e8199600 con 0x7f56e807c790 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.248+0000 7f56e4c00700 1 -- 172.21.15.23:0/358859418 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f56d801aac0 con 0x7f56e807c790 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.248+0000 7f56e4c00700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f56cc038440 0x7f56cc03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.248+0000 7f56e4c00700 1 -- 172.21.15.23:0/358859418 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f56d804c280 con 0x7f56e807c790 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.249+0000 7f56e7400700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f56cc038440 0x7f56cc03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.249+0000 7f56e7400700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f56cc038440 0x7f56cc03a8f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.254+0000 7f56e4c00700 1 -- 172.21.15.23:0/358859418 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f56d8003b80 con 0x7f56e807c790 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:54.481+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi023", "addr": "172.21.15.23", "target": ["mon-mgr", ""]}) v1 -- 0x7f56e8061190 con 0x7f56cc038440 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.284+0000 7f56e4c00700 1 -- 172.21.15.23:0/358859418 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f56e8061190 con 0x7f56cc038440 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.288+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f56cc038440 msgr2=0x7f56cc03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:00.040 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.288+0000 7f56ef200700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f56cc038440 0x7f56cc03a8f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.288+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 msgr2=0x7f56e819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.288+0000 7f56ef200700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e819fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f56d8003de0 tx=0x7f56d80047c0 comp rx=0 tx=0).stop 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.289+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 shutdown_connections 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.289+0000 7f56ef200700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f56cc038440 0x7f56cc03a8f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.289+0000 7f56ef200700 1 --2- 172.21.15.23:0/358859418 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56e807c790 0x7f56e819fd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.289+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 >> 172.21.15.23:0/358859418 conn(0x7f56e807b200 msgr2=0x7f56e8106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.289+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 shutdown_connections 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:11:59.289+0000 7f56ef200700 1 -- 172.21.15.23:0/358859418 wait complete. 2024-02-28T16:12:00.041 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying mon service with default placement... 2024-02-28T16:12:00.517 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:00 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:00.517 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:00 smithi023 ceph-mon[29137]: Added host smithi023 2024-02-28T16:12:00.517 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:00 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:02.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:01 smithi023 ceph-mon[29137]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:02.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:01 smithi023 ceph-mon[29137]: Saving service mon spec with placement count:5 2024-02-28T16:12:02.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:01 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:02.081 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-28T16:12:02.086 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.689+0000 7f55ba600700 1 Processor -- start 2024-02-28T16:12:02.086 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.689+0000 7f55ba600700 1 -- start start 2024-02-28T16:12:02.086 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.689+0000 7f55ba600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b407a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.689+0000 7f55ba600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b407a850 con 0x7f55b407be10 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.689+0000 7f55b3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b407a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.689+0000 7f55b3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b407a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36072/0 (socket says 172.21.15.23:36072) 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.689+0000 7f55b3400700 1 -- 172.21.15.23:0/2914151545 learned_addr learned my addr 172.21.15.23:0/2914151545 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.690+0000 7f55b3400700 1 -- 172.21.15.23:0/2914151545 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b407a990 con 0x7f55b407be10 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.690+0000 7f55b3400700 1 --2- 172.21.15.23:0/2914151545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b407a310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95ef8210e705e0e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.690+0000 7f55b2000700 1 -- 172.21.15.23:0/2914151545 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a4005c30 con 0x7f55b407be10 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.690+0000 7f55b2000700 1 -- 172.21.15.23:0/2914151545 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f55a4005d90 con 0x7f55b407be10 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.690+0000 7f55b2000700 1 -- 172.21.15.23:0/2914151545 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a4006030 con 0x7f55b407be10 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.691+0000 7f55ba600700 1 -- 172.21.15.23:0/2914151545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 msgr2=0x7f55b407a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.691+0000 7f55ba600700 1 --2- 172.21.15.23:0/2914151545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b407a310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a4009b80 comp rx=0 tx=0).stop 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.691+0000 7f55ba600700 1 -- 172.21.15.23:0/2914151545 shutdown_connections 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.691+0000 7f55ba600700 1 --2- 172.21.15.23:0/2914151545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b407a310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.691+0000 7f55ba600700 1 -- 172.21.15.23:0/2914151545 >> 172.21.15.23:0/2914151545 conn(0x7f55b4101020 msgr2=0x7f55b4103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:02.087 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.691+0000 7f55ba600700 1 -- 172.21.15.23:0/2914151545 shutdown_connections 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.691+0000 7f55ba600700 1 -- 172.21.15.23:0/2914151545 wait complete. 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.692+0000 7f55ba600700 1 Processor -- start 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.692+0000 7f55ba600700 1 -- start start 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.693+0000 7f55ba600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.693+0000 7f55ba600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b419be50 con 0x7f55b407be10 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.693+0000 7f55b3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.693+0000 7f55b3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36088/0 (socket says 172.21.15.23:36088) 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.693+0000 7f55b3400700 1 -- 172.21.15.23:0/1660478016 learned_addr learned my addr 172.21.15.23:0/1660478016 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.693+0000 7f55b3400700 1 -- 172.21.15.23:0/1660478016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4009500 con 0x7f55b407be10 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.693+0000 7f55b3400700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b419b910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55a40038f0 tx=0x7f55a40061e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.694+0000 7f55abe00700 1 -- 172.21.15.23:0/1660478016 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a4004310 con 0x7f55b407be10 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.694+0000 7f55abe00700 1 -- 172.21.15.23:0/1660478016 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f55a4004470 con 0x7f55b407be10 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.694+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b419c050 con 0x7f55b407be10 2024-02-28T16:12:02.088 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.694+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b419c4f0 con 0x7f55b407be10 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.694+0000 7f55abe00700 1 -- 172.21.15.23:0/1660478016 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a4011c90 con 0x7f55b407be10 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.695+0000 7f55abe00700 1 -- 172.21.15.23:0/1660478016 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f55a4018070 con 0x7f55b407be10 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.695+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5594005320 con 0x7f55b407be10 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.695+0000 7f55abe00700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5598038400 0x7f559803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.695+0000 7f55abe00700 1 -- 172.21.15.23:0/1660478016 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f55a404b870 con 0x7f55b407be10 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.696+0000 7f55b2a00700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5598038400 0x7f559803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.696+0000 7f55b2a00700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5598038400 0x7f559803a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55a0006fd0 tx=0x7f55a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.701+0000 7f55abe00700 1 -- 172.21.15.23:0/1660478016 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f55a4006670 con 0x7f55b407be10 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.940+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f5594000bf0 con 0x7f5598038400 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.950+0000 7f55abe00700 1 -- 172.21.15.23:0/1660478016 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5594000bf0 con 0x7f5598038400 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5598038400 msgr2=0x7f559803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5598038400 0x7f559803a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55a0006fd0 tx=0x7f55a0006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 msgr2=0x7f55b419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b419b910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55a40038f0 tx=0x7f55a40061e0 comp rx=0 tx=0).stop 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 shutdown_connections 2024-02-28T16:12:02.089 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5598038400 0x7f559803a8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:02.090 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 --2- 172.21.15.23:0/1660478016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f55b407be10 0x7f55b419b910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:02.090 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.953+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 >> 172.21.15.23:0/1660478016 conn(0x7f55b4101020 msgr2=0x7f55b41026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:02.090 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.954+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 shutdown_connections 2024-02-28T16:12:02.090 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:00.954+0000 7f55ba600700 1 -- 172.21.15.23:0/1660478016 wait complete. 2024-02-28T16:12:02.090 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying mgr service with default placement... 2024-02-28T16:12:03.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:03 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:03.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:03 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:03.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:03 smithi023 ceph-mon[29137]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:03.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:03 smithi023 ceph-mon[29137]: Saving service mgr spec with placement count:2 2024-02-28T16:12:03.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:03 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:03.967 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.080+0000 7f1516a00700 1 Processor -- start 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.080+0000 7f1516a00700 1 -- start start 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.080+0000 7f1516a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f15101085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.080+0000 7f1516a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510108b20 con 0x7f1510074430 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.081+0000 7f150fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f15101085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.081+0000 7f150fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f15101085e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36102/0 (socket says 172.21.15.23:36102) 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.081+0000 7f150fe00700 1 -- 172.21.15.23:0/2038473878 learned_addr learned my addr 172.21.15.23:0/2038473878 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.081+0000 7f150fe00700 1 -- 172.21.15.23:0/2038473878 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510108c60 con 0x7f1510074430 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.081+0000 7f150fe00700 1 --2- 172.21.15.23:0/2038473878 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f15101085e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1500009e80 tx=0x7f150000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc26570a01ca164 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.082+0000 7f150f400700 1 -- 172.21.15.23:0/2038473878 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150000e070 con 0x7f1510074430 2024-02-28T16:12:03.968 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.082+0000 7f150f400700 1 -- 172.21.15.23:0/2038473878 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f150000b8c0 con 0x7f1510074430 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.082+0000 7f150f400700 1 -- 172.21.15.23:0/2038473878 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15000044d0 con 0x7f1510074430 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.083+0000 7f1516a00700 1 -- 172.21.15.23:0/2038473878 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 msgr2=0x7f15101085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.083+0000 7f1516a00700 1 --2- 172.21.15.23:0/2038473878 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f15101085e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1500009e80 tx=0x7f150000b330 comp rx=0 tx=0).stop 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.083+0000 7f1516a00700 1 -- 172.21.15.23:0/2038473878 shutdown_connections 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.083+0000 7f1516a00700 1 --2- 172.21.15.23:0/2038473878 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f15101085e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.083+0000 7f1516a00700 1 -- 172.21.15.23:0/2038473878 >> 172.21.15.23:0/2038473878 conn(0x7f15100fff10 msgr2=0x7f1510102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.083+0000 7f1516a00700 1 -- 172.21.15.23:0/2038473878 shutdown_connections 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.083+0000 7f1516a00700 1 -- 172.21.15.23:0/2038473878 wait complete. 2024-02-28T16:12:03.969 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.084+0000 7f1516a00700 1 Processor -- start 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.084+0000 7f1516a00700 1 -- start start 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.084+0000 7f1516a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f1510199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.084+0000 7f1516a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510199ca0 con 0x7f1510074430 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.085+0000 7f150fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f1510199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.085+0000 7f150fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f1510199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36104/0 (socket says 172.21.15.23:36104) 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.085+0000 7f150fe00700 1 -- 172.21.15.23:0/3900465182 learned_addr learned my addr 172.21.15.23:0/3900465182 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.085+0000 7f150fe00700 1 -- 172.21.15.23:0/3900465182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009b30 con 0x7f1510074430 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.086+0000 7f150fe00700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f1510199760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1500004940 tx=0x7f1500004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.086+0000 7f150d600700 1 -- 172.21.15.23:0/3900465182 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150000e040 con 0x7f1510074430 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.086+0000 7f150d600700 1 -- 172.21.15.23:0/3900465182 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f150000bc40 con 0x7f1510074430 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.086+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1510199ea0 con 0x7f1510074430 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.086+0000 7f150d600700 1 -- 172.21.15.23:0/3900465182 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1500012670 con 0x7f1510074430 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.086+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151019a3a0 con 0x7f1510074430 2024-02-28T16:12:03.970 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.087+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510062380 con 0x7f1510074430 2024-02-28T16:12:03.971 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.087+0000 7f150d600700 1 -- 172.21.15.23:0/3900465182 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1500019040 con 0x7f1510074430 2024-02-28T16:12:03.972 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.088+0000 7f150d600700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f14f40383f0 0x7f14f403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.088+0000 7f150d600700 1 -- 172.21.15.23:0/3900465182 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f150004bbc0 con 0x7f1510074430 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.088+0000 7f1507400700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f14f40383f0 0x7f14f403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.089+0000 7f1507400700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f14f40383f0 0x7f14f403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f14f8006fd0 tx=0x7f14f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.097+0000 7f150d600700 1 -- 172.21.15.23:0/3900465182 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f150000bdb0 con 0x7f1510074430 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.329+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f1510101430 con 0x7f14f40383f0 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.335+0000 7f150d600700 1 -- 172.21.15.23:0/3900465182 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1510101430 con 0x7f14f40383f0 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f14f40383f0 msgr2=0x7f14f403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f14f40383f0 0x7f14f403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f14f8006fd0 tx=0x7f14f8006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 msgr2=0x7f1510199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f1510199760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1500004940 tx=0x7f1500004a20 comp rx=0 tx=0).stop 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 shutdown_connections 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f14f40383f0 0x7f14f403a8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 --2- 172.21.15.23:0/3900465182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1510074430 0x7f1510199760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:03.973 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.338+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 >> 172.21.15.23:0/3900465182 conn(0x7f15100fff10 msgr2=0x7f1510100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:03.974 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.339+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 shutdown_connections 2024-02-28T16:12:03.974 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:03.339+0000 7f1516a00700 1 -- 172.21.15.23:0/3900465182 wait complete. 2024-02-28T16:12:03.974 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying crash service with default placement... 2024-02-28T16:12:05.857 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:05 smithi023 ceph-mon[29137]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:05.857 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:05 smithi023 ceph-mon[29137]: Saving service crash spec with placement * 2024-02-28T16:12:05.857 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:05 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:05.857 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:05 smithi023 ceph-mon[29137]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:05.858 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:05 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:05.871 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-28T16:12:05.871 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.539+0000 7fc01b200700 1 Processor -- start 2024-02-28T16:12:05.871 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.539+0000 7fc01b200700 1 -- start start 2024-02-28T16:12:05.871 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.540+0000 7fc01b200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:05.871 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.540+0000 7fc01b200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc014105230 con 0x7fc0141048e0 2024-02-28T16:12:05.871 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.541+0000 7fc013e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:05.871 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.541+0000 7fc013e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36110/0 (socket says 172.21.15.23:36110) 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.541+0000 7fc013e00700 1 -- 172.21.15.23:0/1218653321 learned_addr learned my addr 172.21.15.23:0/1218653321 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.541+0000 7fc013e00700 1 -- 172.21.15.23:0/1218653321 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014105370 con 0x7fc0141048e0 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.542+0000 7fc013e00700 1 --2- 172.21.15.23:0/1218653321 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014104cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0040098a0 tx=0x7fc004009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d959836522205b47 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.542+0000 7fc012a00700 1 -- 172.21.15.23:0/1218653321 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc004004180 con 0x7fc0141048e0 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.542+0000 7fc012a00700 1 -- 172.21.15.23:0/1218653321 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0040042e0 con 0x7fc0141048e0 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.542+0000 7fc012a00700 1 -- 172.21.15.23:0/1218653321 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc004011af0 con 0x7fc0141048e0 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.543+0000 7fc01b200700 1 -- 172.21.15.23:0/1218653321 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 msgr2=0x7fc014104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.543+0000 7fc01b200700 1 --2- 172.21.15.23:0/1218653321 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014104cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0040098a0 tx=0x7fc004009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.543+0000 7fc01b200700 1 -- 172.21.15.23:0/1218653321 shutdown_connections 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.543+0000 7fc01b200700 1 --2- 172.21.15.23:0/1218653321 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014104cf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.543+0000 7fc01b200700 1 -- 172.21.15.23:0/1218653321 >> 172.21.15.23:0/1218653321 conn(0x7fc0140fff10 msgr2=0x7fc014102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.543+0000 7fc01b200700 1 -- 172.21.15.23:0/1218653321 shutdown_connections 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.543+0000 7fc01b200700 1 -- 172.21.15.23:0/1218653321 wait complete. 2024-02-28T16:12:05.872 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.544+0000 7fc01b200700 1 Processor -- start 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.544+0000 7fc01b200700 1 -- start start 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.545+0000 7fc01b200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.545+0000 7fc01b200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc014199cc0 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.545+0000 7fc013e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.545+0000 7fc013e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36112/0 (socket says 172.21.15.23:36112) 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.545+0000 7fc013e00700 1 -- 172.21.15.23:0/983127361 learned_addr learned my addr 172.21.15.23:0/983127361 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.545+0000 7fc013e00700 1 -- 172.21.15.23:0/983127361 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004009550 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.546+0000 7fc013e00700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014199780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc004011670 tx=0x7fc004011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.546+0000 7fc010c00700 1 -- 172.21.15.23:0/983127361 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc004003a40 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.546+0000 7fc010c00700 1 -- 172.21.15.23:0/983127361 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc004003ba0 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.546+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc014199ec0 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.546+0000 7fc010c00700 1 -- 172.21.15.23:0/983127361 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc004024790 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.546+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01419a360 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.548+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc014062380 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.548+0000 7fc010c00700 1 -- 172.21.15.23:0/983127361 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc00401a430 con 0x7fc0141048e0 2024-02-28T16:12:05.873 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.548+0000 7fc010c00700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fbff80383f0 0x7fbff803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.548+0000 7fc010c00700 1 -- 172.21.15.23:0/983127361 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc00404c560 con 0x7fc0141048e0 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.549+0000 7fc013400700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fbff80383f0 0x7fbff803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.549+0000 7fc013400700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fbff80383f0 0x7fbff803a8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc000006fd0 tx=0x7fc000006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.554+0000 7fc010c00700 1 -- 172.21.15.23:0/983127361 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc004010380 con 0x7fc0141048e0 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.802+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fc014102100 con 0x7fbff80383f0 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.811+0000 7fc010c00700 1 -- 172.21.15.23:0/983127361 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fc014102100 con 0x7fbff80383f0 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fbff80383f0 msgr2=0x7fbff803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fbff80383f0 0x7fbff803a8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc000006fd0 tx=0x7fc000006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 msgr2=0x7fc014199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014199780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc004011670 tx=0x7fc004011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 shutdown_connections 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fbff80383f0 0x7fbff803a8a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 --2- 172.21.15.23:0/983127361 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0141048e0 0x7fc014199780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:05.874 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 >> 172.21.15.23:0/983127361 conn(0x7fc0140fff10 msgr2=0x7fc0140740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:05.875 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 shutdown_connections 2024-02-28T16:12:05.875 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:04.814+0000 7fc01b200700 1 -- 172.21.15.23:0/983127361 wait complete. 2024-02-28T16:12:05.875 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying ceph-exporter service with default placement... 2024-02-28T16:12:07.397 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-02-28T16:12:07.398 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.467+0000 7fc927c00700 1 Processor -- start 2024-02-28T16:12:07.398 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.468+0000 7fc927c00700 1 -- start start 2024-02-28T16:12:07.399 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.468+0000 7fc927c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc920104ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:07.399 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.468+0000 7fc927c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920105220 con 0x7fc9201048d0 2024-02-28T16:12:07.399 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.469+0000 7fc925200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc920104ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:07.399 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.469+0000 7fc925200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc920104ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36128/0 (socket says 172.21.15.23:36128) 2024-02-28T16:12:07.399 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.469+0000 7fc925200700 1 -- 172.21.15.23:0/4278912277 learned_addr learned my addr 172.21.15.23:0/4278912277 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:07.399 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.469+0000 7fc925200700 1 -- 172.21.15.23:0/4278912277 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920105360 con 0x7fc9201048d0 2024-02-28T16:12:07.399 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.470+0000 7fc925200700 1 --2- 172.21.15.23:0/4278912277 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc920104ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc91000d180 tx=0x7fc91000d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33fcfeeb7dede8 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.470+0000 7fc91fe00700 1 -- 172.21.15.23:0/4278912277 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc910010070 con 0x7fc9201048d0 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.470+0000 7fc91fe00700 1 -- 172.21.15.23:0/4278912277 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc91000dcf0 con 0x7fc9201048d0 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.470+0000 7fc91fe00700 1 -- 172.21.15.23:0/4278912277 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9100099e0 con 0x7fc9201048d0 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.470+0000 7fc927c00700 1 -- 172.21.15.23:0/4278912277 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 msgr2=0x7fc920104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.470+0000 7fc927c00700 1 --2- 172.21.15.23:0/4278912277 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc920104ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc91000d180 tx=0x7fc91000d490 comp rx=0 tx=0).stop 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.471+0000 7fc927c00700 1 -- 172.21.15.23:0/4278912277 shutdown_connections 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.471+0000 7fc927c00700 1 --2- 172.21.15.23:0/4278912277 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc920104ce0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.471+0000 7fc927c00700 1 -- 172.21.15.23:0/4278912277 >> 172.21.15.23:0/4278912277 conn(0x7fc9200fff00 msgr2=0x7fc920102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:07.404 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.471+0000 7fc927c00700 1 -- 172.21.15.23:0/4278912277 shutdown_connections 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.471+0000 7fc927c00700 1 -- 172.21.15.23:0/4278912277 wait complete. 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.472+0000 7fc927c00700 1 Processor -- start 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.472+0000 7fc927c00700 1 -- start start 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.473+0000 7fc927c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc92019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.473+0000 7fc927c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92019bda0 con 0x7fc9201048d0 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.473+0000 7fc925200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc92019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.473+0000 7fc925200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc92019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36140/0 (socket says 172.21.15.23:36140) 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.473+0000 7fc925200700 1 -- 172.21.15.23:0/2996190068 learned_addr learned my addr 172.21.15.23:0/2996190068 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.473+0000 7fc925200700 1 -- 172.21.15.23:0/2996190068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91000bd40 con 0x7fc9201048d0 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.473+0000 7fc925200700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc92019b860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc910003f50 tx=0x7fc91000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.474+0000 7fc91e000700 1 -- 172.21.15.23:0/2996190068 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc910010050 con 0x7fc9201048d0 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.474+0000 7fc91e000700 1 -- 172.21.15.23:0/2996190068 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc9100046c0 con 0x7fc9201048d0 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.474+0000 7fc91e000700 1 -- 172.21.15.23:0/2996190068 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc91001f970 con 0x7fc9201048d0 2024-02-28T16:12:07.405 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.474+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92019bfa0 con 0x7fc9201048d0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.474+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92019c4a0 con 0x7fc9201048d0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.475+0000 7fc91e000700 1 -- 172.21.15.23:0/2996190068 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc910004210 con 0x7fc9201048d0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.475+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920195610 con 0x7fc9201048d0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.476+0000 7fc91e000700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fc904038440 0x7fc90403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.476+0000 7fc91e000700 1 -- 172.21.15.23:0/2996190068 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc91004c1a0 con 0x7fc9201048d0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.476+0000 7fc917e00700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fc904038440 0x7fc90403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.477+0000 7fc917e00700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fc904038440 0x7fc90403a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc908006fd0 tx=0x7fc908006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.481+0000 7fc91e000700 1 -- 172.21.15.23:0/2996190068 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc91001e5a0 con 0x7fc9201048d0 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.712+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fc920061190 con 0x7fc904038440 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.722+0000 7fc91e000700 1 -- 172.21.15.23:0/2996190068 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fc920061190 con 0x7fc904038440 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fc904038440 msgr2=0x7fc90403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fc904038440 0x7fc90403a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc908006fd0 tx=0x7fc908006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 msgr2=0x7fc92019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:07.406 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc92019b860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc910003f50 tx=0x7fc91000b3b0 comp rx=0 tx=0).stop 2024-02-28T16:12:07.407 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 shutdown_connections 2024-02-28T16:12:07.407 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fc904038440 0x7fc90403a8f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:07.407 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 --2- 172.21.15.23:0/2996190068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc9201048d0 0x7fc92019b860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:07.407 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.725+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 >> 172.21.15.23:0/2996190068 conn(0x7fc9200fff00 msgr2=0x7fc920192750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:07.407 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.726+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 shutdown_connections 2024-02-28T16:12:07.407 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:06.726+0000 7fc927c00700 1 -- 172.21.15.23:0/2996190068 wait complete. 2024-02-28T16:12:07.407 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying prometheus service with default placement... 2024-02-28T16:12:07.983 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:07 smithi023 ceph-mon[29137]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:07.983 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:07 smithi023 ceph-mon[29137]: Saving service ceph-exporter spec with placement * 2024-02-28T16:12:07.983 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:07 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:07.983 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:07 smithi023 ceph-mon[29137]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:09.004 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-28T16:12:09.004 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.041+0000 7f7fbae00700 1 Processor -- start 2024-02-28T16:12:09.004 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.041+0000 7f7fbae00700 1 -- start start 2024-02-28T16:12:09.004 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.042+0000 7f7fbae00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb4108900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.042+0000 7f7fbae00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4079d10 con 0x7f7fb4106520 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.042+0000 7f7fb3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb4108900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.042+0000 7f7fb3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb4108900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36156/0 (socket says 172.21.15.23:36156) 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.042+0000 7f7fb3e00700 1 -- 172.21.15.23:0/119162314 learned_addr learned my addr 172.21.15.23:0/119162314 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.043+0000 7f7fb3e00700 1 -- 172.21.15.23:0/119162314 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4079e50 con 0x7f7fb4106520 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.043+0000 7f7fb3e00700 1 --2- 172.21.15.23:0/119162314 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb4108900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40098a0 tx=0x7f7fa4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3144f58087cb280 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.043+0000 7f7fb2a00700 1 -- 172.21.15.23:0/119162314 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa4004180 con 0x7f7fb4106520 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.043+0000 7f7fb2a00700 1 -- 172.21.15.23:0/119162314 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7fa40042e0 con 0x7f7fb4106520 2024-02-28T16:12:09.005 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.043+0000 7f7fb2a00700 1 -- 172.21.15.23:0/119162314 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa4011af0 con 0x7f7fb4106520 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.044+0000 7f7fbae00700 1 -- 172.21.15.23:0/119162314 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 msgr2=0x7f7fb4108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.044+0000 7f7fbae00700 1 --2- 172.21.15.23:0/119162314 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb4108900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40098a0 tx=0x7f7fa4009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.044+0000 7f7fbae00700 1 -- 172.21.15.23:0/119162314 shutdown_connections 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.044+0000 7f7fbae00700 1 --2- 172.21.15.23:0/119162314 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb4108900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.044+0000 7f7fbae00700 1 -- 172.21.15.23:0/119162314 >> 172.21.15.23:0/119162314 conn(0x7f7fb40fff00 msgr2=0x7f7fb4102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.044+0000 7f7fbae00700 1 -- 172.21.15.23:0/119162314 shutdown_connections 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.044+0000 7f7fbae00700 1 -- 172.21.15.23:0/119162314 wait complete. 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.045+0000 7f7fbae00700 1 Processor -- start 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.046+0000 7f7fbae00700 1 -- start start 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.046+0000 7f7fbae00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb41996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.046+0000 7f7fbae00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4199c30 con 0x7f7fb4106520 2024-02-28T16:12:09.010 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.046+0000 7f7fb3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb41996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.046+0000 7f7fb3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb41996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36166/0 (socket says 172.21.15.23:36166) 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.046+0000 7f7fb3e00700 1 -- 172.21.15.23:0/2903005290 learned_addr learned my addr 172.21.15.23:0/2903005290 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.047+0000 7f7fb3e00700 1 -- 172.21.15.23:0/2903005290 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009550 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.047+0000 7f7fb3e00700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb41996f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4011670 tx=0x7f7fa4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.047+0000 7f7fb0c00700 1 -- 172.21.15.23:0/2903005290 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa40039c0 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.047+0000 7f7fb0c00700 1 -- 172.21.15.23:0/2903005290 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7fa4003b20 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.047+0000 7f7fb0c00700 1 -- 172.21.15.23:0/2903005290 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa40247f0 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.047+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4199e90 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.048+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb419cc90 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.049+0000 7f7fb0c00700 1 -- 172.21.15.23:0/2903005290 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7fa401a430 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.049+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4062380 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.049+0000 7f7fb0c00700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7f98038400 0x7f7f9803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.050+0000 7f7fb0c00700 1 -- 172.21.15.23:0/2903005290 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7fa404c220 con 0x7f7fb4106520 2024-02-28T16:12:09.011 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.050+0000 7f7fb3400700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7f98038400 0x7f7f9803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.051+0000 7f7fb3400700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7f98038400 0x7f7f9803a8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0006fd0 tx=0x7f7fa0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.056+0000 7f7fb0c00700 1 -- 172.21.15.23:0/2903005290 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7fa4018530 con 0x7f7fb4106520 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.311+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fb41021e0 con 0x7f7f98038400 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.319+0000 7f7fb0c00700 1 -- 172.21.15.23:0/2903005290 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f7fb41021e0 con 0x7f7f98038400 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7f98038400 msgr2=0x7f7f9803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7f98038400 0x7f7f9803a8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0006fd0 tx=0x7f7fa0006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 msgr2=0x7f7fb41996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb41996f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4011670 tx=0x7f7fa4011aa0 comp rx=0 tx=0).stop 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 shutdown_connections 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7f98038400 0x7f7f9803a8b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 --2- 172.21.15.23:0/2903005290 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fb4106520 0x7f7fb41996f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 >> 172.21.15.23:0/2903005290 conn(0x7f7fb40fff00 msgr2=0x7f7fb41015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 shutdown_connections 2024-02-28T16:12:09.012 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:08.322+0000 7f7fbae00700 1 -- 172.21.15.23:0/2903005290 wait complete. 2024-02-28T16:12:09.013 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying grafana service with default placement... 2024-02-28T16:12:09.283 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:09 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:09.283 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:09 smithi023 ceph-mon[29137]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:09.283 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:09 smithi023 ceph-mon[29137]: Saving service prometheus spec with placement count:1 2024-02-28T16:12:09.283 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:09 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:10.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:10 smithi023 ceph-mon[29137]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:10.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:10 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:10.716 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-28T16:12:10.716 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.637+0000 7f1a9ac00700 1 Processor -- start 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.638+0000 7f1a9ac00700 1 -- start start 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.638+0000 7f1a9ac00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a94105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.638+0000 7f1a9ac00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94106310 con 0x7f1a941059c0 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.638+0000 7f1a93e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a94105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.638+0000 7f1a93e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a94105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45608/0 (socket says 172.21.15.23:45608) 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.638+0000 7f1a93e00700 1 -- 172.21.15.23:0/15025446 learned_addr learned my addr 172.21.15.23:0/15025446 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.639+0000 7f1a93e00700 1 -- 172.21.15.23:0/15025446 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a94106450 con 0x7f1a941059c0 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.639+0000 7f1a93e00700 1 --2- 172.21.15.23:0/15025446 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a94105dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a840098a0 tx=0x7f1a84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e0b03025202df server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.639+0000 7f1a92a00700 1 -- 172.21.15.23:0/15025446 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a84004180 con 0x7f1a941059c0 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a92a00700 1 -- 172.21.15.23:0/15025446 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1a840042e0 con 0x7f1a941059c0 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a92a00700 1 -- 172.21.15.23:0/15025446 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a84011af0 con 0x7f1a941059c0 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a9ac00700 1 -- 172.21.15.23:0/15025446 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 msgr2=0x7f1a94105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:10.717 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a9ac00700 1 --2- 172.21.15.23:0/15025446 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a94105dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a840098a0 tx=0x7f1a84009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a9ac00700 1 -- 172.21.15.23:0/15025446 shutdown_connections 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a9ac00700 1 --2- 172.21.15.23:0/15025446 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a94105dd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a9ac00700 1 -- 172.21.15.23:0/15025446 >> 172.21.15.23:0/15025446 conn(0x7f1a94100ff0 msgr2=0x7f1a94103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a9ac00700 1 -- 172.21.15.23:0/15025446 shutdown_connections 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.640+0000 7f1a9ac00700 1 -- 172.21.15.23:0/15025446 wait complete. 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.641+0000 7f1a9ac00700 1 Processor -- start 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.642+0000 7f1a9ac00700 1 -- start start 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.642+0000 7f1a9ac00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a9419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.642+0000 7f1a9ac00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9419beb0 con 0x7f1a941059c0 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.642+0000 7f1a93e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a9419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.642+0000 7f1a93e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a9419b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45618/0 (socket says 172.21.15.23:45618) 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.642+0000 7f1a93e00700 1 -- 172.21.15.23:0/355421811 learned_addr learned my addr 172.21.15.23:0/355421811 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.643+0000 7f1a93e00700 1 -- 172.21.15.23:0/355421811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84009550 con 0x7f1a941059c0 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.643+0000 7f1a93e00700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a9419b970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a84011670 tx=0x7f1a84011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:10.718 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.643+0000 7f1a90c00700 1 -- 172.21.15.23:0/355421811 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a84003a40 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.643+0000 7f1a90c00700 1 -- 172.21.15.23:0/355421811 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1a84003ba0 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.643+0000 7f1a90c00700 1 -- 172.21.15.23:0/355421811 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a84024790 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.643+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9419c0b0 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.643+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9419c550 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.644+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a94062380 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.644+0000 7f1a90c00700 1 -- 172.21.15.23:0/355421811 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1a8401a430 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.645+0000 7f1a90c00700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f1a78038490 0x7f1a7803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.645+0000 7f1a90c00700 1 -- 172.21.15.23:0/355421811 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1a8404c500 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.645+0000 7f1a93400700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f1a78038490 0x7f1a7803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.646+0000 7f1a93400700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f1a78038490 0x7f1a7803a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1a80006fd0 tx=0x7f1a80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.650+0000 7f1a90c00700 1 -- 172.21.15.23:0/355421811 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1a84018ba0 con 0x7f1a941059c0 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.901+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a9419f390 con 0x7f1a78038490 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.911+0000 7f1a90c00700 1 -- 172.21.15.23:0/355421811 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f1a9419f390 con 0x7f1a78038490 2024-02-28T16:12:10.719 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.913+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f1a78038490 msgr2=0x7f1a7803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.913+0000 7f1a9ac00700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f1a78038490 0x7f1a7803a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1a80006fd0 tx=0x7f1a80006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.913+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 msgr2=0x7f1a9419b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.913+0000 7f1a9ac00700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a9419b970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a84011670 tx=0x7f1a84011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.914+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 shutdown_connections 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.914+0000 7f1a9ac00700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f1a78038490 0x7f1a7803a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.914+0000 7f1a9ac00700 1 --2- 172.21.15.23:0/355421811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a941059c0 0x7f1a9419b970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.914+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 >> 172.21.15.23:0/355421811 conn(0x7f1a94100ff0 msgr2=0x7f1a941026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.914+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 shutdown_connections 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:09.914+0000 7f1a9ac00700 1 -- 172.21.15.23:0/355421811 wait complete. 2024-02-28T16:12:10.720 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying node-exporter service with default placement... 2024-02-28T16:12:11.419 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:11 smithi023 ceph-mon[29137]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:11.419 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:11 smithi023 ceph-mon[29137]: Saving service grafana spec with placement count:1 2024-02-28T16:12:12.329 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:12 smithi023 ceph-mon[29137]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:12.329 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:12 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:12.344 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-28T16:12:12.345 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.427+0000 7fa150800700 1 Processor -- start 2024-02-28T16:12:12.345 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.428+0000 7fa150800700 1 -- start start 2024-02-28T16:12:12.345 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.428+0000 7fa150800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14810ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:12.345 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.428+0000 7fa150800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14810f1f0 con 0x7fa148080210 2024-02-28T16:12:12.345 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.429+0000 7fa14de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14810ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:12.345 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.429+0000 7fa14de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14810ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45630/0 (socket says 172.21.15.23:45630) 2024-02-28T16:12:12.346 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.429+0000 7fa14de00700 1 -- 172.21.15.23:0/767116593 learned_addr learned my addr 172.21.15.23:0/767116593 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:12.346 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.429+0000 7fa14de00700 1 -- 172.21.15.23:0/767116593 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14810f330 con 0x7fa148080210 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.430+0000 7fa14de00700 1 --2- 172.21.15.23:0/767116593 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14810ecb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0098a0 tx=0x7fa13c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e261631f45e33e4e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.430+0000 7fa14ca00700 1 -- 172.21.15.23:0/767116593 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c004180 con 0x7fa148080210 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.430+0000 7fa14ca00700 1 -- 172.21.15.23:0/767116593 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa13c0042e0 con 0x7fa148080210 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.430+0000 7fa14ca00700 1 -- 172.21.15.23:0/767116593 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c011af0 con 0x7fa148080210 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.430+0000 7fa150800700 1 -- 172.21.15.23:0/767116593 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 msgr2=0x7fa14810ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.430+0000 7fa150800700 1 --2- 172.21.15.23:0/767116593 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14810ecb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0098a0 tx=0x7fa13c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.431+0000 7fa150800700 1 -- 172.21.15.23:0/767116593 shutdown_connections 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.431+0000 7fa150800700 1 --2- 172.21.15.23:0/767116593 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14810ecb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:12.347 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.431+0000 7fa150800700 1 -- 172.21.15.23:0/767116593 >> 172.21.15.23:0/767116593 conn(0x7fa14807b200 msgr2=0x7fa14807d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:12.348 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.431+0000 7fa150800700 1 -- 172.21.15.23:0/767116593 shutdown_connections 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.431+0000 7fa150800700 1 -- 172.21.15.23:0/767116593 wait complete. 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.432+0000 7fa150800700 1 Processor -- start 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.432+0000 7fa150800700 1 -- start start 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.432+0000 7fa150800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.432+0000 7fa150800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1481a0310 con 0x7fa148080210 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.432+0000 7fa14de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.432+0000 7fa14de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45638/0 (socket says 172.21.15.23:45638) 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.432+0000 7fa14de00700 1 -- 172.21.15.23:0/917713559 learned_addr learned my addr 172.21.15.23:0/917713559 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.433+0000 7fa14de00700 1 -- 172.21.15.23:0/917713559 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c009550 con 0x7fa148080210 2024-02-28T16:12:12.350 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.433+0000 7fa14de00700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14819fdd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa13c011670 tx=0x7fa13c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.433+0000 7fa142a00700 1 -- 172.21.15.23:0/917713559 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c0039f0 con 0x7fa148080210 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.433+0000 7fa142a00700 1 -- 172.21.15.23:0/917713559 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa13c003b50 con 0x7fa148080210 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.433+0000 7fa142a00700 1 -- 172.21.15.23:0/917713559 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c0247c0 con 0x7fa148080210 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.433+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1481a0510 con 0x7fa148080210 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.434+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1481a09b0 con 0x7fa148080210 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.435+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1481100b0 con 0x7fa148080210 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.435+0000 7fa142a00700 1 -- 172.21.15.23:0/917713559 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa13c01ac00 con 0x7fa148080210 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.436+0000 7fa142a00700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fa1300383f0 0x7fa13003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:12.351 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.436+0000 7fa142a00700 1 -- 172.21.15.23:0/917713559 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa13c04c490 con 0x7fa148080210 2024-02-28T16:12:12.353 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.436+0000 7fa14d400700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fa1300383f0 0x7fa13003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:12.353 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.437+0000 7fa14d400700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fa1300383f0 0x7fa13003a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa138006fd0 tx=0x7fa138006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:12.353 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.441+0000 7fa142a00700 1 -- 172.21.15.23:0/917713559 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa13c010380 con 0x7fa148080210 2024-02-28T16:12:12.353 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.680+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fa14807e580 con 0x7fa1300383f0 2024-02-28T16:12:12.353 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.689+0000 7fa142a00700 1 -- 172.21.15.23:0/917713559 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fa14807e580 con 0x7fa1300383f0 2024-02-28T16:12:12.353 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fa1300383f0 msgr2=0x7fa13003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:12.353 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fa1300383f0 0x7fa13003a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa138006fd0 tx=0x7fa138006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 msgr2=0x7fa14819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14819fdd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa13c011670 tx=0x7fa13c011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 shutdown_connections 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fa1300383f0 0x7fa13003a8a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 --2- 172.21.15.23:0/917713559 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa148080210 0x7fa14819fdd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 >> 172.21.15.23:0/917713559 conn(0x7fa14807b200 msgr2=0x7fa14807d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 shutdown_connections 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:11.693+0000 7fa150800700 1 -- 172.21.15.23:0/917713559 wait complete. 2024-02-28T16:12:12.354 INFO:teuthology.orchestra.run.smithi023.stdout:Deploying alertmanager service with default placement... 2024-02-28T16:12:13.583 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:13 smithi023 ceph-mon[29137]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:13.583 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:13 smithi023 ceph-mon[29137]: Saving service node-exporter spec with placement * 2024-02-28T16:12:13.583 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:13 smithi023 ceph-mon[29137]: from='mgr.14120 172.21.15.23:0/889601719' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:13.933 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-28T16:12:13.933 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.936+0000 7fe650c00700 1 Processor -- start 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.936+0000 7fe650c00700 1 -- start start 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.937+0000 7fe650c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c108920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.937+0000 7fe650c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c079cf0 con 0x7fe64c106540 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.937+0000 7fe649e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c108920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.937+0000 7fe649e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c108920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45648/0 (socket says 172.21.15.23:45648) 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.937+0000 7fe649e00700 1 -- 172.21.15.23:0/2370249550 learned_addr learned my addr 172.21.15.23:0/2370249550 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.938+0000 7fe649e00700 1 -- 172.21.15.23:0/2370249550 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c079e30 con 0x7fe64c106540 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.938+0000 7fe649e00700 1 --2- 172.21.15.23:0/2370249550 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c108920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0098a0 tx=0x7fe63c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab06f09dfd5974a server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.938+0000 7fe648a00700 1 -- 172.21.15.23:0/2370249550 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe63c004180 con 0x7fe64c106540 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.939+0000 7fe648a00700 1 -- 172.21.15.23:0/2370249550 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe63c0042e0 con 0x7fe64c106540 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.939+0000 7fe648a00700 1 -- 172.21.15.23:0/2370249550 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe63c011af0 con 0x7fe64c106540 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.939+0000 7fe650c00700 1 -- 172.21.15.23:0/2370249550 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 msgr2=0x7fe64c108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:13.934 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.939+0000 7fe650c00700 1 --2- 172.21.15.23:0/2370249550 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c108920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0098a0 tx=0x7fe63c009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.940+0000 7fe650c00700 1 -- 172.21.15.23:0/2370249550 shutdown_connections 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.940+0000 7fe650c00700 1 --2- 172.21.15.23:0/2370249550 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c108920 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.940+0000 7fe650c00700 1 -- 172.21.15.23:0/2370249550 >> 172.21.15.23:0/2370249550 conn(0x7fe64c0fff00 msgr2=0x7fe64c102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.940+0000 7fe650c00700 1 -- 172.21.15.23:0/2370249550 shutdown_connections 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.940+0000 7fe650c00700 1 -- 172.21.15.23:0/2370249550 wait complete. 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.941+0000 7fe650c00700 1 Processor -- start 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.941+0000 7fe650c00700 1 -- start start 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.942+0000 7fe650c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.942+0000 7fe650c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c199cb0 con 0x7fe64c106540 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.942+0000 7fe649e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:13.935 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.942+0000 7fe649e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45662/0 (socket says 172.21.15.23:45662) 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.942+0000 7fe649e00700 1 -- 172.21.15.23:0/809065724 learned_addr learned my addr 172.21.15.23:0/809065724 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.942+0000 7fe649e00700 1 -- 172.21.15.23:0/809065724 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c009550 con 0x7fe64c106540 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.943+0000 7fe649e00700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c199770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe63c011670 tx=0x7fe63c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.943+0000 7fe642a00700 1 -- 172.21.15.23:0/809065724 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe63c0039f0 con 0x7fe64c106540 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.943+0000 7fe642a00700 1 -- 172.21.15.23:0/809065724 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe63c003b50 con 0x7fe64c106540 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.943+0000 7fe650c00700 1 -- 172.21.15.23:0/809065724 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c199eb0 con 0x7fe64c106540 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.943+0000 7fe642a00700 1 -- 172.21.15.23:0/809065724 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe63c0247c0 con 0x7fe64c106540 2024-02-28T16:12:13.938 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.943+0000 7fe650c00700 1 -- 172.21.15.23:0/809065724 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c19a350 con 0x7fe64c106540 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.944+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c109ac0 con 0x7fe64c106540 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.945+0000 7fe642a00700 1 -- 172.21.15.23:0/809065724 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe63c01ac00 con 0x7fe64c106540 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.945+0000 7fe642a00700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fe6300383f0 0x7fe63003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.945+0000 7fe642a00700 1 -- 172.21.15.23:0/809065724 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe63c04c3f0 con 0x7fe64c106540 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.946+0000 7fe649400700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fe6300383f0 0x7fe63003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.946+0000 7fe649400700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fe6300383f0 0x7fe63003a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:12.950+0000 7fe642a00700 1 -- 172.21.15.23:0/809065724 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe63c018d20 con 0x7fe64c106540 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.183+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fe64c109c50 con 0x7fe6300383f0 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.195+0000 7fe642a00700 1 -- 172.21.15.23:0/809065724 <== mgr.14120 v2:172.21.15.23:6800/2571222747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fe64c109c50 con 0x7fe6300383f0 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.198+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fe6300383f0 msgr2=0x7fe63003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.198+0000 7fe637e00700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fe6300383f0 0x7fe63003a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 msgr2=0x7fe64c199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c199770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe63c011670 tx=0x7fe63c011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 shutdown_connections 2024-02-28T16:12:13.939 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7fe6300383f0 0x7fe63003a8a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:13.940 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 --2- 172.21.15.23:0/809065724 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe64c106540 0x7fe64c199770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:13.940 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 >> 172.21.15.23:0/809065724 conn(0x7fe64c0fff00 msgr2=0x7fe64c1015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:13.940 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 shutdown_connections 2024-02-28T16:12:13.940 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:13.199+0000 7fe637e00700 1 -- 172.21.15.23:0/809065724 wait complete. 2024-02-28T16:12:14.521 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:14 smithi023 ceph-mon[29137]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:14.521 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:14 smithi023 ceph-mon[29137]: Saving service alertmanager spec with placement count:1 2024-02-28T16:12:14.521 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:14 smithi023 ceph-mon[29137]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:15.469 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.529+0000 7faf6f000700 1 Processor -- start 2024-02-28T16:12:15.469 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.529+0000 7faf6f000700 1 -- start start 2024-02-28T16:12:15.470 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.530+0000 7faf6f000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6810ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:15.470 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.530+0000 7faf6f000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6810f1f0 con 0x7faf68080210 2024-02-28T16:12:15.470 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.530+0000 7faf67e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6810ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:15.470 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.530+0000 7faf67e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6810ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45676/0 (socket says 172.21.15.23:45676) 2024-02-28T16:12:15.470 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.531+0000 7faf67e00700 1 -- 172.21.15.23:0/2370287079 learned_addr learned my addr 172.21.15.23:0/2370287079 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:15.470 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.531+0000 7faf67e00700 1 -- 172.21.15.23:0/2370287079 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6810f330 con 0x7faf68080210 2024-02-28T16:12:15.470 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.531+0000 7faf67e00700 1 --2- 172.21.15.23:0/2370287079 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6810ecb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf580098a0 tx=0x7faf58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b097eb89c9747639 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf66a00700 1 -- 172.21.15.23:0/2370287079 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf58004180 con 0x7faf68080210 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf66a00700 1 -- 172.21.15.23:0/2370287079 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf580042e0 con 0x7faf68080210 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf66a00700 1 -- 172.21.15.23:0/2370287079 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf58011af0 con 0x7faf68080210 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf6f000700 1 -- 172.21.15.23:0/2370287079 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 msgr2=0x7faf6810ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf6f000700 1 --2- 172.21.15.23:0/2370287079 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6810ecb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf580098a0 tx=0x7faf58009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf6f000700 1 -- 172.21.15.23:0/2370287079 shutdown_connections 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf6f000700 1 --2- 172.21.15.23:0/2370287079 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6810ecb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.532+0000 7faf6f000700 1 -- 172.21.15.23:0/2370287079 >> 172.21.15.23:0/2370287079 conn(0x7faf6807b200 msgr2=0x7faf6807d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.533+0000 7faf6f000700 1 -- 172.21.15.23:0/2370287079 shutdown_connections 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.533+0000 7faf6f000700 1 -- 172.21.15.23:0/2370287079 wait complete. 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.534+0000 7faf6f000700 1 Processor -- start 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.534+0000 7faf6f000700 1 -- start start 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.534+0000 7faf6f000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:15.471 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.534+0000 7faf6f000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf681a02f0 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.534+0000 7faf67e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.534+0000 7faf67e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6819fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45684/0 (socket says 172.21.15.23:45684) 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.534+0000 7faf67e00700 1 -- 172.21.15.23:0/2063906904 learned_addr learned my addr 172.21.15.23:0/2063906904 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.535+0000 7faf67e00700 1 -- 172.21.15.23:0/2063906904 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58009550 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.535+0000 7faf67e00700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6819fdb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf58011670 tx=0x7faf58011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.535+0000 7faf64c00700 1 -- 172.21.15.23:0/2063906904 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf580039f0 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.535+0000 7faf64c00700 1 -- 172.21.15.23:0/2063906904 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf58003b50 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.535+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf681a04f0 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.535+0000 7faf64c00700 1 -- 172.21.15.23:0/2063906904 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf580247c0 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.536+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf681a0990 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.537+0000 7faf64c00700 1 -- 172.21.15.23:0/2063906904 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7faf5801a430 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.537+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf681100b0 con 0x7faf68080210 2024-02-28T16:12:15.472 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.537+0000 7faf64c00700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7faf4c0383f0 0x7faf4c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.537+0000 7faf64c00700 1 -- 172.21.15.23:0/2063906904 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7faf5804c480 con 0x7faf68080210 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.538+0000 7faf67400700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7faf4c0383f0 0x7faf4c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.538+0000 7faf67400700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7faf4c0383f0 0x7faf4c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf54006fd0 tx=0x7faf54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.543+0000 7faf64c00700 1 -- 172.21.15.23:0/2063906904 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faf58018b40 con 0x7faf68080210 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.766+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7faf681102d0 con 0x7faf68080210 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.774+0000 7faf64c00700 1 -- 172.21.15.23:0/2063906904 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7faf58018b40 con 0x7faf68080210 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7faf4c0383f0 msgr2=0x7faf4c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7faf4c0383f0 0x7faf4c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf54006fd0 tx=0x7faf54006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 msgr2=0x7faf6819fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6819fdb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf58011670 tx=0x7faf58011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 shutdown_connections 2024-02-28T16:12:15.473 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7faf4c0383f0 0x7faf4c03a8a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:15.474 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 --2- 172.21.15.23:0/2063906904 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7faf68080210 0x7faf6819fdb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:15.474 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 >> 172.21.15.23:0/2063906904 conn(0x7faf6807b200 msgr2=0x7faf6807d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:15.474 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.777+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 shutdown_connections 2024-02-28T16:12:15.474 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:14.778+0000 7faf6f000700 1 -- 172.21.15.23:0/2063906904 wait complete. 2024-02-28T16:12:16.061 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:15 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2063906904' entity='client.admin' 2024-02-28T16:12:16.062 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:15 smithi023 ceph-mon[29137]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:17.151 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.241+0000 7f5fd0000700 1 Processor -- start 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.241+0000 7f5fd0000700 1 -- start start 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.242+0000 7f5fd0000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc8107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.242+0000 7f5fd0000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc8108530 con 0x7f5fc8107be0 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.242+0000 7f5fcd600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc8107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.243+0000 7f5fcd600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc8107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45688/0 (socket says 172.21.15.23:45688) 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.243+0000 7f5fcd600700 1 -- 172.21.15.23:0/2501628580 learned_addr learned my addr 172.21.15.23:0/2501628580 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.243+0000 7f5fcd600700 1 -- 172.21.15.23:0/2501628580 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8108670 con 0x7f5fc8107be0 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.243+0000 7f5fcd600700 1 --2- 172.21.15.23:0/2501628580 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc8107ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0098a0 tx=0x7f5fbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45602f674610b688 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.244+0000 7f5fc7e00700 1 -- 172.21.15.23:0/2501628580 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fbc004180 con 0x7f5fc8107be0 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.244+0000 7f5fc7e00700 1 -- 172.21.15.23:0/2501628580 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fbc0042e0 con 0x7f5fc8107be0 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.244+0000 7f5fc7e00700 1 -- 172.21.15.23:0/2501628580 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fbc011af0 con 0x7f5fc8107be0 2024-02-28T16:12:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.244+0000 7f5fd0000700 1 -- 172.21.15.23:0/2501628580 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 msgr2=0x7f5fc8107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.244+0000 7f5fd0000700 1 --2- 172.21.15.23:0/2501628580 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc8107ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0098a0 tx=0x7f5fbc009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.245+0000 7f5fd0000700 1 -- 172.21.15.23:0/2501628580 shutdown_connections 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.245+0000 7f5fd0000700 1 --2- 172.21.15.23:0/2501628580 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc8107ff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.245+0000 7f5fd0000700 1 -- 172.21.15.23:0/2501628580 >> 172.21.15.23:0/2501628580 conn(0x7f5fc807b200 msgr2=0x7f5fc807b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.245+0000 7f5fd0000700 1 -- 172.21.15.23:0/2501628580 shutdown_connections 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.245+0000 7f5fd0000700 1 -- 172.21.15.23:0/2501628580 wait complete. 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.246+0000 7f5fd0000700 1 Processor -- start 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.246+0000 7f5fd0000700 1 -- start start 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.246+0000 7f5fd0000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.246+0000 7f5fd0000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc819bf10 con 0x7f5fc8107be0 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.247+0000 7f5fcd600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.247+0000 7f5fcd600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc819b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45700/0 (socket says 172.21.15.23:45700) 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.247+0000 7f5fcd600700 1 -- 172.21.15.23:0/1437893908 learned_addr learned my addr 172.21.15.23:0/1437893908 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.247+0000 7f5fcd600700 1 -- 172.21.15.23:0/1437893908 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc009550 con 0x7f5fc8107be0 2024-02-28T16:12:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.247+0000 7f5fcd600700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc819b9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc011670 tx=0x7f5fbc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.248+0000 7f5fc6000700 1 -- 172.21.15.23:0/1437893908 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fbc003a40 con 0x7f5fc8107be0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.248+0000 7f5fc6000700 1 -- 172.21.15.23:0/1437893908 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fbc003ba0 con 0x7f5fc8107be0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.248+0000 7f5fc6000700 1 -- 172.21.15.23:0/1437893908 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fbc024790 con 0x7f5fc8107be0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.248+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc819c110 con 0x7f5fc8107be0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.248+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc819c5b0 con 0x7f5fc8107be0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.249+0000 7f5fc6000700 1 -- 172.21.15.23:0/1437893908 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5fbc01a430 con 0x7f5fc8107be0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.249+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc8062380 con 0x7f5fc8107be0 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.249+0000 7f5fc6000700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5fb0038440 0x7f5fb003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.250+0000 7f5fc6000700 1 -- 172.21.15.23:0/1437893908 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5fbc04c530 con 0x7f5fc8107be0 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.250+0000 7f5fccc00700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5fb0038440 0x7f5fb003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.251+0000 7f5fccc00700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5fb0038440 0x7f5fb003a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4006fd0 tx=0x7f5fb4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.255+0000 7f5fc6000700 1 -- 172.21.15.23:0/1437893908 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5fbc010380 con 0x7f5fc8107be0 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.477+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5fc819f790 con 0x7f5fc8107be0 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.484+0000 7f5fc6000700 1 -- 172.21.15.23:0/1437893908 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5fbc018b40 con 0x7f5fc8107be0 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5fb0038440 msgr2=0x7f5fb003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5fb0038440 0x7f5fb003a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4006fd0 tx=0x7f5fb4006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:17.156 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 msgr2=0x7f5fc819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc819b9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc011670 tx=0x7f5fbc011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 shutdown_connections 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5fb0038440 0x7f5fb003a8f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 --2- 172.21.15.23:0/1437893908 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5fc8107be0 0x7f5fc819b9d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 >> 172.21.15.23:0/1437893908 conn(0x7f5fc807b200 msgr2=0x7f5fc8106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 shutdown_connections 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:16.488+0000 7f5fd0000700 1 -- 172.21.15.23:0/1437893908 wait complete. 2024-02-28T16:12:17.157 INFO:teuthology.orchestra.run.smithi023.stdout:Enabling the dashboard module... 2024-02-28T16:12:17.763 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:17 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1437893908' entity='client.admin' 2024-02-28T16:12:18.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:18 smithi023 ceph-mon[29137]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:18.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:18 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2616460616' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-28T16:12:19.198 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.771+0000 7f7e3d800700 1 Processor -- start 2024-02-28T16:12:19.199 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.772+0000 7f7e3d800700 1 -- start start 2024-02-28T16:12:19.200 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.772+0000 7f7e3d800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3810ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.200 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.772+0000 7f7e3d800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3810f1f0 con 0x7f7e38080210 2024-02-28T16:12:19.200 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.773+0000 7f7e36a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3810ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.200 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.773+0000 7f7e36a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3810ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45702/0 (socket says 172.21.15.23:45702) 2024-02-28T16:12:19.206 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.773+0000 7f7e36a00700 1 -- 172.21.15.23:0/855921358 learned_addr learned my addr 172.21.15.23:0/855921358 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.773+0000 7f7e36a00700 1 -- 172.21.15.23:0/855921358 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3810f330 con 0x7f7e38080210 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.773+0000 7f7e36a00700 1 --2- 172.21.15.23:0/855921358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3810ecb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e280098a0 tx=0x7f7e28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fae10be7ae3172f server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.774+0000 7f7e35600700 1 -- 172.21.15.23:0/855921358 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e28004180 con 0x7f7e38080210 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.774+0000 7f7e35600700 1 -- 172.21.15.23:0/855921358 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e280042e0 con 0x7f7e38080210 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.774+0000 7f7e35600700 1 -- 172.21.15.23:0/855921358 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e28011af0 con 0x7f7e38080210 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.774+0000 7f7e3d800700 1 -- 172.21.15.23:0/855921358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 msgr2=0x7f7e3810ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.774+0000 7f7e3d800700 1 --2- 172.21.15.23:0/855921358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3810ecb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e280098a0 tx=0x7f7e28009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.775+0000 7f7e3d800700 1 -- 172.21.15.23:0/855921358 shutdown_connections 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.775+0000 7f7e3d800700 1 --2- 172.21.15.23:0/855921358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3810ecb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.775+0000 7f7e3d800700 1 -- 172.21.15.23:0/855921358 >> 172.21.15.23:0/855921358 conn(0x7f7e3807b200 msgr2=0x7f7e3807d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.775+0000 7f7e3d800700 1 -- 172.21.15.23:0/855921358 shutdown_connections 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.775+0000 7f7e3d800700 1 -- 172.21.15.23:0/855921358 wait complete. 2024-02-28T16:12:19.207 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.776+0000 7f7e3d800700 1 Processor -- start 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.776+0000 7f7e3d800700 1 -- start start 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.776+0000 7f7e3d800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.776+0000 7f7e3d800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381a0310 con 0x7f7e38080210 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.777+0000 7f7e36a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.777+0000 7f7e36a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45704/0 (socket says 172.21.15.23:45704) 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.777+0000 7f7e36a00700 1 -- 172.21.15.23:0/2616460616 learned_addr learned my addr 172.21.15.23:0/2616460616 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.777+0000 7f7e36a00700 1 -- 172.21.15.23:0/2616460616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28009550 con 0x7f7e38080210 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.777+0000 7f7e36a00700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3819fdd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e28011670 tx=0x7f7e28011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.778+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e280039f0 con 0x7f7e38080210 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.778+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e28003b50 con 0x7f7e38080210 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.778+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e381a0510 con 0x7f7e38080210 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.778+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e381a09b0 con 0x7f7e38080210 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.778+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e280247c0 con 0x7f7e38080210 2024-02-28T16:12:19.208 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.779+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e381100b0 con 0x7f7e38080210 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.779+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7e2801ac00 con 0x7f7e38080210 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.780+0000 7f7e2f400700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7e1c038440 0x7f7e1c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.780+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7e2804c430 con 0x7f7e38080210 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.780+0000 7f7e36000700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7e1c038440 0x7f7e1c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.781+0000 7f7e36000700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7e1c038440 0x7f7e1c03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e24006fd0 tx=0x7f7e24006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:17.785+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7e2801a430 con 0x7f7e38080210 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.066+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f7e381102d0 con 0x7f7e38080210 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.495+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f7e2802d770 con 0x7f7e38080210 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.497+0000 7f7e2f400700 1 -- 172.21.15.23:0/2616460616 <== mon.0 v2:172.21.15.23:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f7e2804be20 con 0x7f7e38080210 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.501+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7e1c038440 msgr2=0x7f7e1c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.501+0000 7f7e3d800700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7e1c038440 0x7f7e1c03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e24006fd0 tx=0x7f7e24006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.501+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 msgr2=0x7f7e3819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.501+0000 7f7e3d800700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3819fdd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e28011670 tx=0x7f7e28011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.501+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 shutdown_connections 2024-02-28T16:12:19.209 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.501+0000 7f7e3d800700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f7e1c038440 0x7f7e1c03a8f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.210 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.501+0000 7f7e3d800700 1 --2- 172.21.15.23:0/2616460616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7e38080210 0x7f7e3819fdd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.210 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.502+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 >> 172.21.15.23:0/2616460616 conn(0x7f7e3807b200 msgr2=0x7f7e3807d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:19.210 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.502+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 shutdown_connections 2024-02-28T16:12:19.210 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:18.502+0000 7f7e3d800700 1 -- 172.21.15.23:0/2616460616 wait complete. 2024-02-28T16:12:19.730 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:19 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2616460616' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-28T16:12:19.730 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:19 smithi023 ceph-mon[29137]: mgrmap e9: smithi023.bbebnt(active, since 33s) 2024-02-28T16:12:20.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:20 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3373100066' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T16:12:20.875 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:12:20.875 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-28T16:12:20.875 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T16:12:20.875 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "active_name": "smithi023.bbebnt", 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.767+0000 7f5255c00700 1 Processor -- start 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.768+0000 7f5255c00700 1 -- start start 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.768+0000 7f5255c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f5250079200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.768+0000 7f5255c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250079740 con 0x7f525007ad00 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.768+0000 7f524ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f5250079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.768+0000 7f524ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f5250079200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36242/0 (socket says 172.21.15.23:36242) 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.768+0000 7f524ea00700 1 -- 172.21.15.23:0/4097844029 learned_addr learned my addr 172.21.15.23:0/4097844029 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.769+0000 7f524ea00700 1 -- 172.21.15.23:0/4097844029 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250079880 con 0x7f525007ad00 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.769+0000 7f524ea00700 1 --2- 172.21.15.23:0/4097844029 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f5250079200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f52400098a0 tx=0x7f5240009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b14a842c6344f server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:20.876 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.769+0000 7f524d600700 1 -- 172.21.15.23:0/4097844029 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5240004180 con 0x7f525007ad00 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.769+0000 7f524d600700 1 -- 172.21.15.23:0/4097844029 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52400042e0 con 0x7f525007ad00 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.769+0000 7f524d600700 1 -- 172.21.15.23:0/4097844029 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5240011af0 con 0x7f525007ad00 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.770+0000 7f5255c00700 1 -- 172.21.15.23:0/4097844029 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 msgr2=0x7f5250079200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.770+0000 7f5255c00700 1 --2- 172.21.15.23:0/4097844029 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f5250079200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f52400098a0 tx=0x7f5240009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.770+0000 7f5255c00700 1 -- 172.21.15.23:0/4097844029 shutdown_connections 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.770+0000 7f5255c00700 1 --2- 172.21.15.23:0/4097844029 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f5250079200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.770+0000 7f5255c00700 1 -- 172.21.15.23:0/4097844029 >> 172.21.15.23:0/4097844029 conn(0x7f5250100fd0 msgr2=0x7f5250103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.770+0000 7f5255c00700 1 -- 172.21.15.23:0/4097844029 shutdown_connections 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.770+0000 7f5255c00700 1 -- 172.21.15.23:0/4097844029 wait complete. 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.771+0000 7f5255c00700 1 Processor -- start 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.772+0000 7f5255c00700 1 -- start start 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.772+0000 7f5255c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f525019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.772+0000 7f5255c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525019bed0 con 0x7f525007ad00 2024-02-28T16:12:20.877 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.772+0000 7f524ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f525019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.772+0000 7f524ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f525019b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36256/0 (socket says 172.21.15.23:36256) 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.772+0000 7f524ea00700 1 -- 172.21.15.23:0/3373100066 learned_addr learned my addr 172.21.15.23:0/3373100066 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.772+0000 7f524ea00700 1 -- 172.21.15.23:0/3373100066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240009550 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.773+0000 7f524ea00700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f525019b990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5240011670 tx=0x7f5240011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.773+0000 7f5247400700 1 -- 172.21.15.23:0/3373100066 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52400039f0 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.773+0000 7f5247400700 1 -- 172.21.15.23:0/3373100066 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5240003b50 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.773+0000 7f5247400700 1 -- 172.21.15.23:0/3373100066 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52400247c0 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.773+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525019c0d0 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.773+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525019c570 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.774+0000 7f5247400700 1 -- 172.21.15.23:0/3373100066 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f524001ac00 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.774+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525010bcb0 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.775+0000 7f5247400700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 0x7f523403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.775+0000 7f5247400700 1 -- 172.21.15.23:0/3373100066 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f524004c4c0 con 0x7f525007ad00 2024-02-28T16:12:20.878 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.775+0000 7f524e000700 1 -- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 msgr2=0x7f523403a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/2571222747 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.775+0000 7f524e000700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 0x7f523403a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.780+0000 7f5247400700 1 -- 172.21.15.23:0/3373100066 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f524001a430 con 0x7f525007ad00 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.976+0000 7f524e000700 1 -- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 msgr2=0x7f523403a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/2571222747 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:19.976+0000 7f524e000700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 0x7f523403a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.057+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f525019f350 con 0x7f525007ad00 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.058+0000 7f5247400700 1 -- 172.21.15.23:0/3373100066 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f5240018b40 con 0x7f525007ad00 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.061+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 msgr2=0x7f523403a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.061+0000 7f5255c00700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 0x7f523403a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 msgr2=0x7f525019b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f525019b990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5240011670 tx=0x7f5240011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 shutdown_connections 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7f5234038490 0x7f523403a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 --2- 172.21.15.23:0/3373100066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f525007ad00 0x7f525019b990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 >> 172.21.15.23:0/3373100066 conn(0x7f5250100fd0 msgr2=0x7f52501026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:20.879 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 shutdown_connections 2024-02-28T16:12:20.880 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:20.062+0000 7f5255c00700 1 -- 172.21.15.23:0/3373100066 wait complete. 2024-02-28T16:12:20.880 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for the mgr to restart... 2024-02-28T16:12:20.880 INFO:teuthology.orchestra.run.smithi023.stdout:Waiting for mgr epoch 9... 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: Active manager daemon smithi023.bbebnt restarted 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: Activating manager daemon smithi023.bbebnt 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: osdmap e3: 0 total, 0 up, 0 in 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: mgrmap e10: smithi023.bbebnt(active, starting, since 0.0107267s) 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:12:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:27 smithi023 ceph-mon[29137]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:12:28.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:28 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:28.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:28 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:28.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:28 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:12:28.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:28 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:12:28.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:28 smithi023 ceph-mon[29137]: mgrmap e11: smithi023.bbebnt(active, since 1.01357s) 2024-02-28T16:12:29.735 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:29 smithi023 ceph-mon[29137]: [28/Feb/2024:16:12:28] ENGINE Bus STARTING 2024-02-28T16:12:29.735 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:29 smithi023 ceph-mon[29137]: [28/Feb/2024:16:12:28] ENGINE Serving on http://172.21.15.23:8765 2024-02-28T16:12:29.735 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:29 smithi023 ceph-mon[29137]: [28/Feb/2024:16:12:28] ENGINE Serving on https://172.21.15.23:7150 2024-02-28T16:12:29.735 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:29 smithi023 ceph-mon[29137]: [28/Feb/2024:16:12:28] ENGINE Bus STARTED 2024-02-28T16:12:29.736 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:29 smithi023 ceph-mon[29137]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T16:12:29.736 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:29 smithi023 ceph-mon[29137]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T16:12:29.742 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:12:29.742 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-28T16:12:29.742 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T16:12:29.743 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:12:29.743 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.425+0000 7efc3b200700 1 Processor -- start 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.425+0000 7efc3b200700 1 -- start start 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.426+0000 7efc3b200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc34105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.426+0000 7efc3b200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34106310 con 0x7efc341059c0 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.426+0000 7efc33e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc34105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.426+0000 7efc33e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc34105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36272/0 (socket says 172.21.15.23:36272) 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.426+0000 7efc33e00700 1 -- 172.21.15.23:0/1017383734 learned_addr learned my addr 172.21.15.23:0/1017383734 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.427+0000 7efc33e00700 1 -- 172.21.15.23:0/1017383734 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34106450 con 0x7efc341059c0 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.427+0000 7efc33e00700 1 --2- 172.21.15.23:0/1017383734 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc34105dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc240098a0 tx=0x7efc24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf675481341f8375 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.427+0000 7efc32a00700 1 -- 172.21.15.23:0/1017383734 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc24004180 con 0x7efc341059c0 2024-02-28T16:12:29.745 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.427+0000 7efc32a00700 1 -- 172.21.15.23:0/1017383734 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc240042e0 con 0x7efc341059c0 2024-02-28T16:12:29.746 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.427+0000 7efc32a00700 1 -- 172.21.15.23:0/1017383734 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc24011af0 con 0x7efc341059c0 2024-02-28T16:12:29.746 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.428+0000 7efc3b200700 1 -- 172.21.15.23:0/1017383734 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 msgr2=0x7efc34105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:29.746 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.428+0000 7efc3b200700 1 --2- 172.21.15.23:0/1017383734 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc34105dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc240098a0 tx=0x7efc24009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:29.746 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.428+0000 7efc3b200700 1 -- 172.21.15.23:0/1017383734 shutdown_connections 2024-02-28T16:12:29.752 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.428+0000 7efc3b200700 1 --2- 172.21.15.23:0/1017383734 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc34105dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:29.752 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.428+0000 7efc3b200700 1 -- 172.21.15.23:0/1017383734 >> 172.21.15.23:0/1017383734 conn(0x7efc34100fd0 msgr2=0x7efc34103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:29.752 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.428+0000 7efc3b200700 1 -- 172.21.15.23:0/1017383734 shutdown_connections 2024-02-28T16:12:29.752 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.428+0000 7efc3b200700 1 -- 172.21.15.23:0/1017383734 wait complete. 2024-02-28T16:12:29.752 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.429+0000 7efc3b200700 1 Processor -- start 2024-02-28T16:12:29.752 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.430+0000 7efc3b200700 1 -- start start 2024-02-28T16:12:29.752 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.430+0000 7efc3b200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc3419b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.430+0000 7efc3b200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3419be70 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.430+0000 7efc33e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc3419b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.430+0000 7efc33e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc3419b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36274/0 (socket says 172.21.15.23:36274) 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.430+0000 7efc33e00700 1 -- 172.21.15.23:0/2761068581 learned_addr learned my addr 172.21.15.23:0/2761068581 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.431+0000 7efc33e00700 1 -- 172.21.15.23:0/2761068581 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24009550 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.431+0000 7efc33e00700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc3419b930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc24011670 tx=0x7efc24011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.431+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc24003a40 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.431+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc24003ba0 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.431+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3419c070 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.431+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc24024790 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.431+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3419c510 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.433+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7efc2401a430 con 0x7efc341059c0 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.433+0000 7efc30c00700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.433+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 --> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc1803b050 con 0x7efc18038490 2024-02-28T16:12:29.753 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.433+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efc2404c590 con 0x7efc341059c0 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.434+0000 7efc33400700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 msgr2=0x7efc1803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/2571222747 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.434+0000 7efc33400700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.635+0000 7efc33400700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 msgr2=0x7efc1803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/2571222747 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:21.635+0000 7efc33400700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:22.036+0000 7efc33400700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 msgr2=0x7efc1803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/2571222747 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:22.036+0000 7efc33400700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:22.837+0000 7efc33400700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 msgr2=0x7efc1803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/2571222747 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:22.837+0000 7efc33400700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:24.439+0000 7efc33400700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 msgr2=0x7efc1803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/2571222747 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:24.439+0000 7efc33400700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:27.420+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7efc2401a730 con 0x7efc341059c0 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:27.421+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 msgr2=0x7efc1803a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:27.421+0000 7efc30c00700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:29.754 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.421+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7efc24018350 con 0x7efc341059c0 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.421+0000 7efc30c00700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efc1803bef0 0x7efc1803e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.421+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc1803b050 con 0x7efc1803bef0 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.422+0000 7efc33400700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efc1803bef0 0x7efc1803e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.424+0000 7efc33400700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efc1803bef0 0x7efc1803e2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efc20003a10 tx=0x7efc20009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.425+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mgr.14164 v2:172.21.15.23:6800/3150303808 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7efc1803b050 con 0x7efc1803bef0 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.433+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7efc14002630 con 0x7efc1803bef0 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.433+0000 7efc30c00700 1 -- 172.21.15.23:0/2761068581 <== mgr.14164 v2:172.21.15.23:6800/3150303808 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7efc14002630 con 0x7efc1803bef0 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.433+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efc1803bef0 msgr2=0x7efc1803e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.433+0000 7efc3b200700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efc1803bef0 0x7efc1803e2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efc20003a10 tx=0x7efc20009270 comp rx=0 tx=0).stop 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.433+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 msgr2=0x7efc3419b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.433+0000 7efc3b200700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc3419b930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc24011670 tx=0x7efc24011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.434+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 shutdown_connections 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.434+0000 7efc3b200700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efc1803bef0 0x7efc1803e2d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.434+0000 7efc3b200700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc341059c0 0x7efc3419b930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:29.755 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.434+0000 7efc3b200700 1 --2- 172.21.15.23:0/2761068581 >> [v2:172.21.15.23:6800/2571222747,v1:172.21.15.23:6801/2571222747] conn(0x7efc18038490 0x7efc1803a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:29.756 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.434+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 >> 172.21.15.23:0/2761068581 conn(0x7efc34100fd0 msgr2=0x7efc34101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:29.756 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.434+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 shutdown_connections 2024-02-28T16:12:29.756 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.434+0000 7efc3b200700 1 -- 172.21.15.23:0/2761068581 wait complete. 2024-02-28T16:12:29.756 INFO:teuthology.orchestra.run.smithi023.stdout:mgr epoch 9 is available 2024-02-28T16:12:29.756 INFO:teuthology.orchestra.run.smithi023.stdout:Generating a dashboard self-signed certificate... 2024-02-28T16:12:31.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:30 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:31.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:30 smithi023 ceph-mon[29137]: mgrmap e12: smithi023.bbebnt(active, since 2s) 2024-02-28T16:12:31.808 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-28T16:12:31.808 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.488+0000 7f56c4a00700 1 Processor -- start 2024-02-28T16:12:31.808 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.488+0000 7f56c4a00700 1 -- start start 2024-02-28T16:12:31.812 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.488+0000 7f56c4a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c0105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:31.812 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.488+0000 7f56c4a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0106310 con 0x7f56c01059c0 2024-02-28T16:12:31.812 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.489+0000 7f56bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c0105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:31.812 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.489+0000 7f56bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c0105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44276/0 (socket says 172.21.15.23:44276) 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.489+0000 7f56bde00700 1 -- 172.21.15.23:0/3074034536 learned_addr learned my addr 172.21.15.23:0/3074034536 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.489+0000 7f56bde00700 1 -- 172.21.15.23:0/3074034536 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0106450 con 0x7f56c01059c0 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.490+0000 7f56bde00700 1 --2- 172.21.15.23:0/3074034536 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c0105dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56b00098a0 tx=0x7f56b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e6b88e7923a574 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.490+0000 7f56bca00700 1 -- 172.21.15.23:0/3074034536 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0004180 con 0x7f56c01059c0 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.490+0000 7f56bca00700 1 -- 172.21.15.23:0/3074034536 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f56b00042e0 con 0x7f56c01059c0 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.490+0000 7f56bca00700 1 -- 172.21.15.23:0/3074034536 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0011af0 con 0x7f56c01059c0 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.491+0000 7f56c4a00700 1 -- 172.21.15.23:0/3074034536 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 msgr2=0x7f56c0105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.491+0000 7f56c4a00700 1 --2- 172.21.15.23:0/3074034536 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c0105dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56b00098a0 tx=0x7f56b0009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.491+0000 7f56c4a00700 1 -- 172.21.15.23:0/3074034536 shutdown_connections 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.491+0000 7f56c4a00700 1 --2- 172.21.15.23:0/3074034536 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c0105dd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:31.813 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.491+0000 7f56c4a00700 1 -- 172.21.15.23:0/3074034536 >> 172.21.15.23:0/3074034536 conn(0x7f56c0100fd0 msgr2=0x7f56c0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.491+0000 7f56c4a00700 1 -- 172.21.15.23:0/3074034536 shutdown_connections 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.491+0000 7f56c4a00700 1 -- 172.21.15.23:0/3074034536 wait complete. 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.492+0000 7f56c4a00700 1 Processor -- start 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.492+0000 7f56c4a00700 1 -- start start 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.492+0000 7f56c4a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.492+0000 7f56c4a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c019be70 con 0x7f56c01059c0 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.493+0000 7f56bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.493+0000 7f56bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44292/0 (socket says 172.21.15.23:44292) 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.493+0000 7f56bde00700 1 -- 172.21.15.23:0/3422830901 learned_addr learned my addr 172.21.15.23:0/3422830901 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.493+0000 7f56bde00700 1 -- 172.21.15.23:0/3422830901 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0009550 con 0x7f56c01059c0 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.493+0000 7f56bde00700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c019b930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56b0011670 tx=0x7f56b0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.494+0000 7f56b6a00700 1 -- 172.21.15.23:0/3422830901 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0003a40 con 0x7f56c01059c0 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.494+0000 7f56b6a00700 1 -- 172.21.15.23:0/3422830901 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f56b0003ba0 con 0x7f56c01059c0 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.494+0000 7f56b6a00700 1 -- 172.21.15.23:0/3422830901 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0024790 con 0x7f56c01059c0 2024-02-28T16:12:31.814 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.494+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c019c070 con 0x7f56c01059c0 2024-02-28T16:12:31.815 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.494+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c019c510 con 0x7f56c01059c0 2024-02-28T16:12:31.815 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.495+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c0062380 con 0x7f56c01059c0 2024-02-28T16:12:31.815 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.495+0000 7f56b6a00700 1 -- 172.21.15.23:0/3422830901 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f56b001a430 con 0x7f56c01059c0 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.496+0000 7f56b6a00700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f56a4038490 0x7f56a403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.496+0000 7f56b6a00700 1 -- 172.21.15.23:0/3422830901 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f56b004c760 con 0x7f56c01059c0 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.496+0000 7f56bd400700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f56a4038490 0x7f56a403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.497+0000 7f56bd400700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f56a4038490 0x7f56a403a940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56ac006fd0 tx=0x7f56ac006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.501+0000 7f56b6a00700 1 -- 172.21.15.23:0/3422830901 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f56b0010380 con 0x7f56c01059c0 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.729+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f56c019f350 con 0x7f56a4038490 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.862+0000 7f56b6a00700 1 -- 172.21.15.23:0/3422830901 <== mgr.14164 v2:172.21.15.23:6800/3150303808 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f56c019f350 con 0x7f56a4038490 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f56a4038490 msgr2=0x7f56a403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f56a4038490 0x7f56a403a940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56ac006fd0 tx=0x7f56ac006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 msgr2=0x7f56c019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:31.817 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c019b930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56b0011670 tx=0x7f56b0011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:31.818 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 shutdown_connections 2024-02-28T16:12:31.818 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f56a4038490 0x7f56a403a940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:31.818 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 --2- 172.21.15.23:0/3422830901 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56c01059c0 0x7f56c019b930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:31.818 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 >> 172.21.15.23:0/3422830901 conn(0x7f56c0100fd0 msgr2=0x7f56c0101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:31.818 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 shutdown_connections 2024-02-28T16:12:31.818 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.865+0000 7f56c4a00700 1 -- 172.21.15.23:0/3422830901 wait complete. 2024-02-28T16:12:31.818 INFO:teuthology.orchestra.run.smithi023.stdout:Creating initial admin user... 2024-02-28T16:12:32.117 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:31 smithi023 ceph-mon[29137]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:32.117 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:32.117 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:32.117 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:34.347 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:34 smithi023 ceph-mon[29137]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:34.348 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:34 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:34.360 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$eMCQIuGaRGVyUB7uHUXwZOduB0wNZXWVhdMGHljupjayCxDDiquky", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1709136753, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-28T16:12:34.360 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.583+0000 7f1574400700 1 Processor -- start 2024-02-28T16:12:34.360 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.583+0000 7f1574400700 1 -- start start 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.584+0000 7f1574400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.584+0000 7f1574400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c108510 con 0x7f156c107bc0 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.584+0000 7f1571a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.584+0000 7f1571a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c107fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44298/0 (socket says 172.21.15.23:44298) 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.584+0000 7f1571a00700 1 -- 172.21.15.23:0/3708663640 learned_addr learned my addr 172.21.15.23:0/3708663640 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.585+0000 7f1571a00700 1 -- 172.21.15.23:0/3708663640 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c108650 con 0x7f156c107bc0 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.585+0000 7f1571a00700 1 --2- 172.21.15.23:0/3708663640 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c107fd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1560009e80 tx=0x7f156000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a11c535610e20d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.586+0000 7f156be00700 1 -- 172.21.15.23:0/3708663640 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f156000e070 con 0x7f156c107bc0 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.586+0000 7f156be00700 1 -- 172.21.15.23:0/3708663640 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f156000b8c0 con 0x7f156c107bc0 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.586+0000 7f156be00700 1 -- 172.21.15.23:0/3708663640 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15600044d0 con 0x7f156c107bc0 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.587+0000 7f1574400700 1 -- 172.21.15.23:0/3708663640 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 msgr2=0x7f156c107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.587+0000 7f1574400700 1 --2- 172.21.15.23:0/3708663640 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c107fd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1560009e80 tx=0x7f156000b330 comp rx=0 tx=0).stop 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.587+0000 7f1574400700 1 -- 172.21.15.23:0/3708663640 shutdown_connections 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.587+0000 7f1574400700 1 --2- 172.21.15.23:0/3708663640 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c107fd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.587+0000 7f1574400700 1 -- 172.21.15.23:0/3708663640 >> 172.21.15.23:0/3708663640 conn(0x7f156c103550 msgr2=0x7f156c105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.587+0000 7f1574400700 1 -- 172.21.15.23:0/3708663640 shutdown_connections 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.587+0000 7f1574400700 1 -- 172.21.15.23:0/3708663640 wait complete. 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.588+0000 7f1574400700 1 Processor -- start 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.589+0000 7f1574400700 1 -- start start 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.589+0000 7f1574400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.589+0000 7f1574400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c19be80 con 0x7f156c107bc0 2024-02-28T16:12:34.366 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.589+0000 7f1571a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.589+0000 7f1571a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44314/0 (socket says 172.21.15.23:44314) 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.589+0000 7f1571a00700 1 -- 172.21.15.23:0/2274510525 learned_addr learned my addr 172.21.15.23:0/2274510525 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.590+0000 7f1571a00700 1 -- 172.21.15.23:0/2274510525 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560009b30 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.590+0000 7f1571a00700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c19b940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1560000f80 tx=0x7f15600049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.590+0000 7f156a000700 1 -- 172.21.15.23:0/2274510525 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f156000e040 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.591+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c19c080 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.591+0000 7f156a000700 1 -- 172.21.15.23:0/2274510525 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f156000bd00 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.591+0000 7f156a000700 1 -- 172.21.15.23:0/2274510525 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1560012770 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.591+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c19c580 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.592+0000 7f156a000700 1 -- 172.21.15.23:0/2274510525 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f1560019040 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.592+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c062380 con 0x7f156c107bc0 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.593+0000 7f156a000700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1554038490 0x7f155403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:34.367 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.593+0000 7f156a000700 1 -- 172.21.15.23:0/2274510525 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f156004bd70 con 0x7f156c107bc0 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.593+0000 7f1571000700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1554038490 0x7f155403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.594+0000 7f1571000700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1554038490 0x7f155403a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1558006fd0 tx=0x7f1558006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.598+0000 7f156a000700 1 -- 172.21.15.23:0/2274510525 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1560011750 con 0x7f156c107bc0 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:32.862+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f156c0621a0 con 0x7f1554038490 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.124+0000 7f156a000700 1 -- 172.21.15.23:0/2274510525 <== mgr.14164 v2:172.21.15.23:6800/3150303808 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f156c0621a0 con 0x7f1554038490 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.128+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1554038490 msgr2=0x7f155403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.128+0000 7f1574400700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1554038490 0x7f155403a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1558006fd0 tx=0x7f1558006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.128+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 msgr2=0x7f156c19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.128+0000 7f1574400700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c19b940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1560000f80 tx=0x7f15600049f0 comp rx=0 tx=0).stop 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.129+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 shutdown_connections 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.129+0000 7f1574400700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1554038490 0x7f155403a940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.129+0000 7f1574400700 1 --2- 172.21.15.23:0/2274510525 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f156c107bc0 0x7f156c19b940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:34.368 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.129+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 >> 172.21.15.23:0/2274510525 conn(0x7f156c103550 msgr2=0x7f156c105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:34.369 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.129+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 shutdown_connections 2024-02-28T16:12:34.369 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:33.129+0000 7f1574400700 1 -- 172.21.15.23:0/2274510525 wait complete. 2024-02-28T16:12:34.369 INFO:teuthology.orchestra.run.smithi023.stdout:Fetching dashboard port number... 2024-02-28T16:12:35.217 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:35 smithi023 ceph-mon[29137]: mgrmap e13: smithi023.bbebnt(active, since 6s) 2024-02-28T16:12:35.790 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stdout 8443 2024-02-28T16:12:35.791 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.969+0000 7f9827200700 1 Processor -- start 2024-02-28T16:12:35.792 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.970+0000 7f9827200700 1 -- start start 2024-02-28T16:12:35.792 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.970+0000 7f9827200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:35.792 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.970+0000 7f9827200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982007d0e0 con 0x7f982007c790 2024-02-28T16:12:35.792 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.970+0000 7f981fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:35.792 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.971+0000 7f981fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982007cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44318/0 (socket says 172.21.15.23:44318) 2024-02-28T16:12:35.792 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.971+0000 7f981fe00700 1 -- 172.21.15.23:0/3141947264 learned_addr learned my addr 172.21.15.23:0/3141947264 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:35.793 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.971+0000 7f981fe00700 1 -- 172.21.15.23:0/3141947264 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982007d220 con 0x7f982007c790 2024-02-28T16:12:35.793 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.971+0000 7f981fe00700 1 --2- 172.21.15.23:0/3141947264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982007cba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98100098a0 tx=0x7f9810009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b6f1a9b88c9597 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:35.793 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.972+0000 7f981ea00700 1 -- 172.21.15.23:0/3141947264 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9810004180 con 0x7f982007c790 2024-02-28T16:12:35.794 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.972+0000 7f981ea00700 1 -- 172.21.15.23:0/3141947264 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98100042e0 con 0x7f982007c790 2024-02-28T16:12:35.794 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.972+0000 7f981ea00700 1 -- 172.21.15.23:0/3141947264 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9810011af0 con 0x7f982007c790 2024-02-28T16:12:35.794 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.973+0000 7f9827200700 1 -- 172.21.15.23:0/3141947264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 msgr2=0x7f982007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:35.794 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.973+0000 7f9827200700 1 --2- 172.21.15.23:0/3141947264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982007cba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98100098a0 tx=0x7f9810009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:35.794 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.973+0000 7f9827200700 1 -- 172.21.15.23:0/3141947264 shutdown_connections 2024-02-28T16:12:35.794 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.973+0000 7f9827200700 1 --2- 172.21.15.23:0/3141947264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982007cba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:35.795 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.973+0000 7f9827200700 1 -- 172.21.15.23:0/3141947264 >> 172.21.15.23:0/3141947264 conn(0x7f982007b200 msgr2=0x7f982007b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:35.795 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.973+0000 7f9827200700 1 -- 172.21.15.23:0/3141947264 shutdown_connections 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.973+0000 7f9827200700 1 -- 172.21.15.23:0/3141947264 wait complete. 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.974+0000 7f9827200700 1 Processor -- start 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.974+0000 7f9827200700 1 -- start start 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.974+0000 7f9827200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.974+0000 7f9827200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98201a0330 con 0x7f982007c790 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.975+0000 7f981fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.975+0000 7f981fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982019fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44334/0 (socket says 172.21.15.23:44334) 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.975+0000 7f981fe00700 1 -- 172.21.15.23:0/1004393475 learned_addr learned my addr 172.21.15.23:0/1004393475 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.975+0000 7f981fe00700 1 -- 172.21.15.23:0/1004393475 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009550 con 0x7f982007c790 2024-02-28T16:12:35.796 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.976+0000 7f981fe00700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982019fdf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9810011670 tx=0x7f98100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.976+0000 7f981cc00700 1 -- 172.21.15.23:0/1004393475 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98100038b0 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.976+0000 7f981cc00700 1 -- 172.21.15.23:0/1004393475 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9810003a10 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.976+0000 7f981cc00700 1 -- 172.21.15.23:0/1004393475 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98100246e0 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.976+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98201a0530 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.976+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98201a09d0 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.977+0000 7f981cc00700 1 -- 172.21.15.23:0/1004393475 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f981001ab70 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.977+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98201996b0 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.978+0000 7f981cc00700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f9804038530 0x7f980403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.978+0000 7f981cc00700 1 -- 172.21.15.23:0/1004393475 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f981004c480 con 0x7f982007c790 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.978+0000 7f981f400700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f9804038530 0x7f980403a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:35.799 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.979+0000 7f981f400700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f9804038530 0x7f980403a9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f980c006fd0 tx=0x7f980c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:34.984+0000 7f981cc00700 1 -- 172.21.15.23:0/1004393475 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9810003b80 con 0x7f982007c790 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.204+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f982002d050 con 0x7f982007c790 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.205+0000 7f981cc00700 1 -- 172.21.15.23:0/1004393475 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f981002c350 con 0x7f982007c790 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f9804038530 msgr2=0x7f980403a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f9804038530 0x7f980403a9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f980c006fd0 tx=0x7f980c006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 msgr2=0x7f982019fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982019fdf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9810011670 tx=0x7f98100047c0 comp rx=0 tx=0).stop 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 shutdown_connections 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f9804038530 0x7f980403a9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:35.800 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 --2- 172.21.15.23:0/1004393475 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f982007c790 0x7f982019fdf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:35.801 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 >> 172.21.15.23:0/1004393475 conn(0x7f982007b200 msgr2=0x7f9820106b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:35.801 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 shutdown_connections 2024-02-28T16:12:35.801 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.209+0000 7f9827200700 1 -- 172.21.15.23:0/1004393475 wait complete. 2024-02-28T16:12:35.831 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:12:35.831 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout disabled 2024-02-28T16:12:35.856 INFO:teuthology.orchestra.run.smithi023.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:12:35.856 INFO:teuthology.orchestra.run.smithi023.stdout:systemctl: stdout inactive 2024-02-28T16:12:35.856 INFO:teuthology.orchestra.run.smithi023.stdout:firewalld.service is not enabled 2024-02-28T16:12:35.856 INFO:teuthology.orchestra.run.smithi023.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-28T16:12:35.860 INFO:teuthology.orchestra.run.smithi023.stdout:Ceph Dashboard is now available at: 2024-02-28T16:12:35.860 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:35.861 INFO:teuthology.orchestra.run.smithi023.stdout: URL: https://smithi023.front.sepia.ceph.com:8443/ 2024-02-28T16:12:35.861 INFO:teuthology.orchestra.run.smithi023.stdout: User: admin 2024-02-28T16:12:35.861 INFO:teuthology.orchestra.run.smithi023.stdout: Password: zwu5s0pf5u 2024-02-28T16:12:35.861 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:35.861 INFO:teuthology.orchestra.run.smithi023.stdout:Saving cluster configuration to /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config directory 2024-02-28T16:12:35.862 INFO:teuthology.orchestra.run.smithi023.stdout:Enabling autotune for osd_memory_target 2024-02-28T16:12:36.342 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:36 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1004393475' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-28T16:12:37.408 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.523+0000 7f847fc00700 1 Processor -- start 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.523+0000 7f847fc00700 1 -- start start 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.523+0000 7f847fc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f8478105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.523+0000 7f847fc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8478106300 con 0x7f84781059b0 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.524+0000 7f847d200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f8478105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.524+0000 7f847d200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f8478105dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44342/0 (socket says 172.21.15.23:44342) 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.524+0000 7f847d200700 1 -- 172.21.15.23:0/2960086054 learned_addr learned my addr 172.21.15.23:0/2960086054 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.524+0000 7f847d200700 1 -- 172.21.15.23:0/2960086054 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8478106440 con 0x7f84781059b0 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.525+0000 7f847d200700 1 --2- 172.21.15.23:0/2960086054 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f8478105dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f84680098a0 tx=0x7f8468009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad37d201a2b4112 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.525+0000 7f8477e00700 1 -- 172.21.15.23:0/2960086054 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8468004180 con 0x7f84781059b0 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.525+0000 7f8477e00700 1 -- 172.21.15.23:0/2960086054 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84680042e0 con 0x7f84781059b0 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.525+0000 7f8477e00700 1 -- 172.21.15.23:0/2960086054 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8468011af0 con 0x7f84781059b0 2024-02-28T16:12:37.409 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.526+0000 7f847fc00700 1 -- 172.21.15.23:0/2960086054 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 msgr2=0x7f8478105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:37.414 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.526+0000 7f847fc00700 1 --2- 172.21.15.23:0/2960086054 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f8478105dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f84680098a0 tx=0x7f8468009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.526+0000 7f847fc00700 1 -- 172.21.15.23:0/2960086054 shutdown_connections 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.526+0000 7f847fc00700 1 --2- 172.21.15.23:0/2960086054 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f8478105dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.526+0000 7f847fc00700 1 -- 172.21.15.23:0/2960086054 >> 172.21.15.23:0/2960086054 conn(0x7f8478101020 msgr2=0x7f8478103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.526+0000 7f847fc00700 1 -- 172.21.15.23:0/2960086054 shutdown_connections 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.526+0000 7f847fc00700 1 -- 172.21.15.23:0/2960086054 wait complete. 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.528+0000 7f847fc00700 1 Processor -- start 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.528+0000 7f847fc00700 1 -- start start 2024-02-28T16:12:37.415 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.528+0000 7f847fc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f847807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.528+0000 7f847fc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847807c160 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.529+0000 7f847d200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f847807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.529+0000 7f847d200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f847807bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44350/0 (socket says 172.21.15.23:44350) 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.529+0000 7f847d200700 1 -- 172.21.15.23:0/576507603 learned_addr learned my addr 172.21.15.23:0/576507603 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.529+0000 7f847d200700 1 -- 172.21.15.23:0/576507603 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009550 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.529+0000 7f847d200700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f847807bc20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8468011670 tx=0x7f8468011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.530+0000 7f8476000700 1 -- 172.21.15.23:0/576507603 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8468003a40 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.530+0000 7f8476000700 1 -- 172.21.15.23:0/576507603 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8468003ba0 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.530+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847807a270 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.530+0000 7f8476000700 1 -- 172.21.15.23:0/576507603 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8468024790 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.530+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847807a710 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.531+0000 7f8476000700 1 -- 172.21.15.23:0/576507603 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f846801a430 con 0x7f84781059b0 2024-02-28T16:12:37.416 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.531+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8478062380 con 0x7f84781059b0 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.532+0000 7f8476000700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f845c038580 0x7f845c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.532+0000 7f8476000700 1 -- 172.21.15.23:0/576507603 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f846804c740 con 0x7f84781059b0 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.532+0000 7f846fe00700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f845c038580 0x7f845c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.533+0000 7f846fe00700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f845c038580 0x7f845c03aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8460006fd0 tx=0x7f8460006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.537+0000 7f8476000700 1 -- 172.21.15.23:0/576507603 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8468018b40 con 0x7f84781059b0 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.758+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f847807b0e0 con 0x7f84781059b0 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.759+0000 7f8476000700 1 -- 172.21.15.23:0/576507603 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f8468018b40 con 0x7f84781059b0 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f845c038580 msgr2=0x7f845c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f845c038580 0x7f845c03aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8460006fd0 tx=0x7f8460006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 msgr2=0x7f847807bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f847807bc20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8468011670 tx=0x7f8468011b50 comp rx=0 tx=0).stop 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 shutdown_connections 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f845c038580 0x7f845c03aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:37.417 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 --2- 172.21.15.23:0/576507603 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84781059b0 0x7f847807bc20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:37.418 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 >> 172.21.15.23:0/576507603 conn(0x7f8478101020 msgr2=0x7f8478102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:37.418 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.762+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 shutdown_connections 2024-02-28T16:12:37.418 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:36.763+0000 7f847fc00700 1 -- 172.21.15.23:0/576507603 wait complete. 2024-02-28T16:12:39.033 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.006+0000 7f7acde00700 1 Processor -- start 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.007+0000 7f7acde00700 1 -- start start 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.007+0000 7f7acde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.007+0000 7f7acde00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac807d0e0 con 0x7f7ac807c790 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.008+0000 7f7ac6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.008+0000 7f7ac6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac807cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44364/0 (socket says 172.21.15.23:44364) 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.008+0000 7f7ac6a00700 1 -- 172.21.15.23:0/1637662915 learned_addr learned my addr 172.21.15.23:0/1637662915 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.008+0000 7f7ac6a00700 1 -- 172.21.15.23:0/1637662915 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac807d220 con 0x7f7ac807c790 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.009+0000 7f7ac6a00700 1 --2- 172.21.15.23:0/1637662915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac807cba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098a0 tx=0x7f7ab8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22433fe05120bd31 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.009+0000 7f7ac5600700 1 -- 172.21.15.23:0/1637662915 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ab8004180 con 0x7f7ac807c790 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.009+0000 7f7ac5600700 1 -- 172.21.15.23:0/1637662915 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ab80042e0 con 0x7f7ac807c790 2024-02-28T16:12:39.034 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.009+0000 7f7ac5600700 1 -- 172.21.15.23:0/1637662915 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ab8011af0 con 0x7f7ac807c790 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.010+0000 7f7acde00700 1 -- 172.21.15.23:0/1637662915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 msgr2=0x7f7ac807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.010+0000 7f7acde00700 1 --2- 172.21.15.23:0/1637662915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac807cba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098a0 tx=0x7f7ab8009bb0 comp rx=0 tx=0).stop 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.010+0000 7f7acde00700 1 -- 172.21.15.23:0/1637662915 shutdown_connections 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.010+0000 7f7acde00700 1 --2- 172.21.15.23:0/1637662915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac807cba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.010+0000 7f7acde00700 1 -- 172.21.15.23:0/1637662915 >> 172.21.15.23:0/1637662915 conn(0x7f7ac807b200 msgr2=0x7f7ac807b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.010+0000 7f7acde00700 1 -- 172.21.15.23:0/1637662915 shutdown_connections 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.010+0000 7f7acde00700 1 -- 172.21.15.23:0/1637662915 wait complete. 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.011+0000 7f7acde00700 1 Processor -- start 2024-02-28T16:12:39.035 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.011+0000 7f7acde00700 1 -- start start 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.012+0000 7f7acde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.012+0000 7f7acde00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac81a0330 con 0x7f7ac807c790 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.012+0000 7f7ac6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.012+0000 7f7ac6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44380/0 (socket says 172.21.15.23:44380) 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.012+0000 7f7ac6a00700 1 -- 172.21.15.23:0/2086013289 learned_addr learned my addr 172.21.15.23:0/2086013289 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.012+0000 7f7ac6a00700 1 -- 172.21.15.23:0/2086013289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009550 con 0x7f7ac807c790 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.012+0000 7f7ac6a00700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac819fdf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8011670 tx=0x7f7ab80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.013+0000 7f7acca00700 1 -- 172.21.15.23:0/2086013289 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ab80038b0 con 0x7f7ac807c790 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.013+0000 7f7acca00700 1 -- 172.21.15.23:0/2086013289 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ab8003a10 con 0x7f7ac807c790 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.013+0000 7f7acca00700 1 -- 172.21.15.23:0/2086013289 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ab80246e0 con 0x7f7ac807c790 2024-02-28T16:12:39.036 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.013+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac81a0530 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.013+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac81a09d0 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.014+0000 7f7acca00700 1 -- 172.21.15.23:0/2086013289 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f7ab801ab70 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.014+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac81996b0 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.015+0000 7f7acca00700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f7aac038530 0x7f7aac03a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.015+0000 7f7acca00700 1 -- 172.21.15.23:0/2086013289 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7ab804c4c0 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.016+0000 7f7ac6000700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f7aac038530 0x7f7aac03a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.017+0000 7f7ac6000700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f7aac038530 0x7f7aac03a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4006fd0 tx=0x7f7ab4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.021+0000 7f7acca00700 1 -- 172.21.15.23:0/2086013289 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7ab8003b80 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.355+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f7ac802d050 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.361+0000 7f7acca00700 1 -- 172.21.15.23:0/2086013289 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f7ab802cb40 con 0x7f7ac807c790 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.363+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f7aac038530 msgr2=0x7f7aac03a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:39.037 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.363+0000 7f7acde00700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f7aac038530 0x7f7aac03a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4006fd0 tx=0x7f7ab4006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.363+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 msgr2=0x7f7ac819fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.363+0000 7f7acde00700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac819fdf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8011670 tx=0x7f7ab80047c0 comp rx=0 tx=0).stop 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.364+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 shutdown_connections 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.364+0000 7f7acde00700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f7aac038530 0x7f7aac03a9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.364+0000 7f7acde00700 1 --2- 172.21.15.23:0/2086013289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ac807c790 0x7f7ac819fdf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.364+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 >> 172.21.15.23:0/2086013289 conn(0x7f7ac807b200 msgr2=0x7f7ac8106b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.364+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 shutdown_connections 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:38.364+0000 7f7acde00700 1 -- 172.21.15.23:0/2086013289 wait complete. 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-28T16:12:39.038 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout:Or, if you are only running a single cluster on this host: 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: ceph telemetry on 2024-02-28T16:12:39.039 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.040 INFO:teuthology.orchestra.run.smithi023.stdout:For more information see: 2024-02-28T16:12:39.040 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.040 INFO:teuthology.orchestra.run.smithi023.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-28T16:12:39.040 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:12:39.040 INFO:teuthology.orchestra.run.smithi023.stdout:Bootstrap complete. 2024-02-28T16:12:39.130 INFO:tasks.cephadm:Fetching config... 2024-02-28T16:12:39.130 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:12:39.131 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-28T16:12:39.186 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-28T16:12:39.187 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:12:39.187 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-28T16:12:39.229 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-28T16:12:39.229 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:12:39.229 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/keyring of=/dev/stdout 2024-02-28T16:12:39.358 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-28T16:12:39.358 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:12:39.358 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-28T16:12:39.455 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-28T16:12:39.456 DEBUG:teuthology.orchestra.run.smithi023:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn+mc6SNsVTQQgmJtPGFEMTad8GqbUp44EWQkFgC71JxsH2BhE+ERKtUKfJPFs1+5ZmzoXkKf2or7u2WYbOvW8/WfQpIR/M16gpBFcBJE3D1cGMwFHZADR1S/Zs+i2PJIXbg8g0ZRVWmQmjafwY+xENrJIHvXGbodnacNm4kh0rFkKoPN3FzKn8VdtJeZhIGYKQuE7g5P9e82Gfkn1gk4R9cF3BKUGvYJAl7PGdzJzCNmjUYkjw58PAtUqX/o0XMpTYO3MIJXvvYMQ4Cp6VPatZ3Q81N1owagWYFhAAcBLSvhvfK1n9U2A41kKdxr46V6V98ZDYCRuywDgYP+gZi2X1faiwLbqng0OhIPStG4k3wdMwIBb91PbpCWxbxGiYpAK8pUOZRpls34edtj0kw9kETbzb1VVaCE6UnNoLRU2qSN4jteMCnl39+PNH+EfoXLRBxVXbMJ+P5yjlvCCOWcy9t0HbMd39OSDu+DwxLRCGmtVn9bB3F6tXlyH9WYHIpc= ceph-dea052fa-d653-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T16:12:39.586 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:39 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2086013289' entity='client.admin' 2024-02-28T16:12:39.592 INFO:teuthology.orchestra.run.smithi023.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn+mc6SNsVTQQgmJtPGFEMTad8GqbUp44EWQkFgC71JxsH2BhE+ERKtUKfJPFs1+5ZmzoXkKf2or7u2WYbOvW8/WfQpIR/M16gpBFcBJE3D1cGMwFHZADR1S/Zs+i2PJIXbg8g0ZRVWmQmjafwY+xENrJIHvXGbodnacNm4kh0rFkKoPN3FzKn8VdtJeZhIGYKQuE7g5P9e82Gfkn1gk4R9cF3BKUGvYJAl7PGdzJzCNmjUYkjw58PAtUqX/o0XMpTYO3MIJXvvYMQ4Cp6VPatZ3Q81N1owagWYFhAAcBLSvhvfK1n9U2A41kKdxr46V6V98ZDYCRuywDgYP+gZi2X1faiwLbqng0OhIPStG4k3wdMwIBb91PbpCWxbxGiYpAK8pUOZRpls34edtj0kw9kETbzb1VVaCE6UnNoLRU2qSN4jteMCnl39+PNH+EfoXLRBxVXbMJ+P5yjlvCCOWcy9t0HbMd39OSDu+DwxLRCGmtVn9bB3F6tXlyH9WYHIpc= ceph-dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:12:39.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn+mc6SNsVTQQgmJtPGFEMTad8GqbUp44EWQkFgC71JxsH2BhE+ERKtUKfJPFs1+5ZmzoXkKf2or7u2WYbOvW8/WfQpIR/M16gpBFcBJE3D1cGMwFHZADR1S/Zs+i2PJIXbg8g0ZRVWmQmjafwY+xENrJIHvXGbodnacNm4kh0rFkKoPN3FzKn8VdtJeZhIGYKQuE7g5P9e82Gfkn1gk4R9cF3BKUGvYJAl7PGdzJzCNmjUYkjw58PAtUqX/o0XMpTYO3MIJXvvYMQ4Cp6VPatZ3Q81N1owagWYFhAAcBLSvhvfK1n9U2A41kKdxr46V6V98ZDYCRuywDgYP+gZi2X1faiwLbqng0OhIPStG4k3wdMwIBb91PbpCWxbxGiYpAK8pUOZRpls34edtj0kw9kETbzb1VVaCE6UnNoLRU2qSN4jteMCnl39+PNH+EfoXLRBxVXbMJ+P5yjlvCCOWcy9t0HbMd39OSDu+DwxLRCGmtVn9bB3F6tXlyH9WYHIpc= ceph-dea052fa-d653-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T16:12:39.768 INFO:teuthology.orchestra.run.smithi153.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn+mc6SNsVTQQgmJtPGFEMTad8GqbUp44EWQkFgC71JxsH2BhE+ERKtUKfJPFs1+5ZmzoXkKf2or7u2WYbOvW8/WfQpIR/M16gpBFcBJE3D1cGMwFHZADR1S/Zs+i2PJIXbg8g0ZRVWmQmjafwY+xENrJIHvXGbodnacNm4kh0rFkKoPN3FzKn8VdtJeZhIGYKQuE7g5P9e82Gfkn1gk4R9cF3BKUGvYJAl7PGdzJzCNmjUYkjw58PAtUqX/o0XMpTYO3MIJXvvYMQ4Cp6VPatZ3Q81N1owagWYFhAAcBLSvhvfK1n9U2A41kKdxr46V6V98ZDYCRuywDgYP+gZi2X1faiwLbqng0OhIPStG4k3wdMwIBb91PbpCWxbxGiYpAK8pUOZRpls34edtj0kw9kETbzb1VVaCE6UnNoLRU2qSN4jteMCnl39+PNH+EfoXLRBxVXbMJ+P5yjlvCCOWcy9t0HbMd39OSDu+DwxLRCGmtVn9bB3F6tXlyH9WYHIpc= ceph-dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:12:39.829 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-28T16:12:40.219 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi023", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:42.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:42 smithi023 ceph-mon[29137]: Deploying daemon ceph-exporter.smithi023 on smithi023 2024-02-28T16:12:42.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.954+0000 7fcfd2800700 1 -- 172.21.15.23:0/2213487972 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 msgr2=0x7fcfcc100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:42.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.954+0000 7fcfd2800700 1 --2- 172.21.15.23:0/2213487972 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc100230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009910 tx=0x7fcfbc009c20 comp rx=0 tx=0).stop 2024-02-28T16:12:42.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.954+0000 7fcfd2800700 1 -- 172.21.15.23:0/2213487972 shutdown_connections 2024-02-28T16:12:42.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.954+0000 7fcfd2800700 1 --2- 172.21.15.23:0/2213487972 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc100230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:42.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.954+0000 7fcfd2800700 1 -- 172.21.15.23:0/2213487972 >> 172.21.15.23:0/2213487972 conn(0x7fcfcc0fb3d0 msgr2=0x7fcfcc0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:42.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.954+0000 7fcfd2800700 1 -- 172.21.15.23:0/2213487972 shutdown_connections 2024-02-28T16:12:42.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.954+0000 7fcfd2800700 1 -- 172.21.15.23:0/2213487972 wait complete. 2024-02-28T16:12:42.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.955+0000 7fcfd2800700 1 Processor -- start 2024-02-28T16:12:42.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.955+0000 7fcfd2800700 1 -- start start 2024-02-28T16:12:42.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.956+0000 7fcfd2800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:42.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.956+0000 7fcfd2800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc1976b0 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.956+0000 7fcfcb400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:42.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.956+0000 7fcfcb400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36196/0 (socket says 172.21.15.23:36196) 2024-02-28T16:12:42.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.956+0000 7fcfcb400700 1 -- 172.21.15.23:0/3606518785 learned_addr learned my addr 172.21.15.23:0/3606518785 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:42.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.957+0000 7fcfcb400700 1 -- 172.21.15.23:0/3606518785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0095f0 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.957+0000 7fcfcb400700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc197170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0092e0 tx=0x7fcfbc009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:42.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.957+0000 7fcfc3e00700 1 -- 172.21.15.23:0/3606518785 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfbc01d070 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.957+0000 7fcfc3e00700 1 -- 172.21.15.23:0/3606518785 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfbc00be10 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.957+0000 7fcfc3e00700 1 -- 172.21.15.23:0/3606518785 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfbc00f460 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.957+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc1978b0 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.957+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc197d50 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.959+0000 7fcfc3e00700 1 -- 172.21.15.23:0/3606518785 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fcfbc00b960 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.959+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc190e80 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.959+0000 7fcfc3e00700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fcfb0038490 0x7fcfb003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:42.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.959+0000 7fcfc3e00700 1 -- 172.21.15.23:0/3606518785 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcfbc04c2f0 con 0x7fcfcc0ffe20 2024-02-28T16:12:42.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.959+0000 7fcfcaa00700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fcfb0038490 0x7fcfb003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:42.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.960+0000 7fcfcaa00700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fcfb0038490 0x7fcfb003a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8006fd0 tx=0x7fcfb8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:42.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:42.965+0000 7fcfc3e00700 1 -- 172.21.15.23:0/3606518785 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcfbc022790 con 0x7fcfcc0ffe20 2024-02-28T16:12:43.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.189+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fcfcc1008b0 con 0x7fcfcc0ffe20 2024-02-28T16:12:43.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.194+0000 7fcfc3e00700 1 -- 172.21.15.23:0/3606518785 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fcfcc1008b0 con 0x7fcfcc0ffe20 2024-02-28T16:12:43.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.197+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fcfb0038490 msgr2=0x7fcfb003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:43.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.197+0000 7fcfd2800700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fcfb0038490 0x7fcfb003a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8006fd0 tx=0x7fcfb8006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:43.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.197+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 msgr2=0x7fcfcc197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:43.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.197+0000 7fcfd2800700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc197170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0092e0 tx=0x7fcfbc009e60 comp rx=0 tx=0).stop 2024-02-28T16:12:43.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.198+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 shutdown_connections 2024-02-28T16:12:43.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.198+0000 7fcfd2800700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fcfb0038490 0x7fcfb003a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:43.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.198+0000 7fcfd2800700 1 --2- 172.21.15.23:0/3606518785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcfcc0ffe20 0x7fcfcc197170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:43.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.198+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 >> 172.21.15.23:0/3606518785 conn(0x7fcfcc0fb3d0 msgr2=0x7fcfcc0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:43.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.198+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 shutdown_connections 2024-02-28T16:12:43.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:43.198+0000 7fcfd2800700 1 -- 172.21.15.23:0/3606518785 wait complete. 2024-02-28T16:12:44.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:44 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3606518785' entity='client.admin' 2024-02-28T16:12:44.728 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-28T16:12:44.728 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-28T16:12:45.863 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:12:48.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.899+0000 7f15b3200700 1 -- 172.21.15.23:0/358811522 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 msgr2=0x7f15b40731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:48.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.899+0000 7f15b3200700 1 --2- 172.21.15.23:0/358811522 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b40731e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009910 tx=0x7f15a4009c20 comp rx=0 tx=0).stop 2024-02-28T16:12:48.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.899+0000 7f15b3200700 1 -- 172.21.15.23:0/358811522 shutdown_connections 2024-02-28T16:12:48.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.899+0000 7f15b3200700 1 --2- 172.21.15.23:0/358811522 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b40731e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.899+0000 7f15b3200700 1 -- 172.21.15.23:0/358811522 >> 172.21.15.23:0/358811522 conn(0x7f15b40fb1e0 msgr2=0x7f15b40fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.899+0000 7f15b3200700 1 -- 172.21.15.23:0/358811522 shutdown_connections 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.899+0000 7f15b3200700 1 -- 172.21.15.23:0/358811522 wait complete. 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.900+0000 7f15b3200700 1 Processor -- start 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.901+0000 7f15b3200700 1 -- start start 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.901+0000 7f15b3200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b4196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.901+0000 7f15b3200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4197510 con 0x7f15b4074d80 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.901+0000 7f15b1e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b4196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.901+0000 7f15b1e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b4196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36216/0 (socket says 172.21.15.23:36216) 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.901+0000 7f15b1e00700 1 -- 172.21.15.23:0/1954368266 learned_addr learned my addr 172.21.15.23:0/1954368266 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.902+0000 7f15b1e00700 1 -- 172.21.15.23:0/1954368266 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40095f0 con 0x7f15b4074d80 2024-02-28T16:12:48.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.902+0000 7f15b1e00700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b4196fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f15a40092e0 tx=0x7f15a4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.902+0000 7f15aaa00700 1 -- 172.21.15.23:0/1954368266 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15a401d070 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.902+0000 7f15aaa00700 1 -- 172.21.15.23:0/1954368266 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f15a400be10 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.903+0000 7f15aaa00700 1 -- 172.21.15.23:0/1954368266 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15a400f460 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.903+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4197710 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.903+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4197bb0 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.904+0000 7f15aaa00700 1 -- 172.21.15.23:0/1954368266 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f15a4022470 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.904+0000 7f15aaa00700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1598038490 0x7f159803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.904+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4190b30 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.904+0000 7f15aaa00700 1 -- 172.21.15.23:0/1954368266 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f15a404c560 con 0x7f15b4074d80 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.905+0000 7f15b1400700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1598038490 0x7f159803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.905+0000 7f15b1400700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1598038490 0x7f159803a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f15a0006fd0 tx=0x7f15a0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:48.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:47.910+0000 7f15aaa00700 1 -- 172.21.15.23:0/1954368266 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f15a4027020 con 0x7f15b4074d80 2024-02-28T16:12:48.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.153+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f15b4061220 con 0x7f1598038490 2024-02-28T16:12:48.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.157+0000 7f15aaa00700 1 -- 172.21.15.23:0/1954368266 <== mgr.14164 v2:172.21.15.23:6800/3150303808 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f15b4061220 con 0x7f1598038490 2024-02-28T16:12:48.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1598038490 msgr2=0x7f159803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:48.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1598038490 0x7f159803a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f15a0006fd0 tx=0x7f15a0006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:48.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 msgr2=0x7f15b4196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:48.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b4196fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f15a40092e0 tx=0x7f15a4009e60 comp rx=0 tx=0).stop 2024-02-28T16:12:48.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 shutdown_connections 2024-02-28T16:12:48.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1598038490 0x7f159803a940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:48.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 --2- 172.21.15.23:0/1954368266 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f15b4074d80 0x7f15b4196fd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:48.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 >> 172.21.15.23:0/1954368266 conn(0x7f15b40fb1e0 msgr2=0x7f15b40fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:48.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 shutdown_connections 2024-02-28T16:12:48.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:48.160+0000 7f15b3200700 1 -- 172.21.15.23:0/1954368266 wait complete. 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:48.879 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:48 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:48.932 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi153 2024-02-28T16:12:48.932 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:12:48.932 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.conf 2024-02-28T16:12:48.990 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:12:48.991 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:12:49.086 INFO:tasks.cephadm:Adding host smithi153 to orchestrator... 2024-02-28T16:12:49.086 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch host add smithi153 2024-02-28T16:12:49.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:49 smithi023 ceph-mon[29137]: Deploying daemon crash.smithi023 on smithi023 2024-02-28T16:12:49.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:49 smithi023 ceph-mon[29137]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:12:50.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:50 smithi023 ceph-mon[29137]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:52.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.668+0000 7fe941800700 1 -- 172.21.15.23:0/1687023520 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 msgr2=0x7fe93c102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.668+0000 7fe941800700 1 --2- 172.21.15.23:0/1687023520 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c102d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009910 tx=0x7fe92c009c20 comp rx=0 tx=0).stop 2024-02-28T16:12:52.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.668+0000 7fe941800700 1 -- 172.21.15.23:0/1687023520 shutdown_connections 2024-02-28T16:12:52.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.668+0000 7fe941800700 1 --2- 172.21.15.23:0/1687023520 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c102d30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.668+0000 7fe941800700 1 -- 172.21.15.23:0/1687023520 >> 172.21.15.23:0/1687023520 conn(0x7fe93c0fa2b0 msgr2=0x7fe93c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:52.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.668+0000 7fe941800700 1 -- 172.21.15.23:0/1687023520 shutdown_connections 2024-02-28T16:12:52.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.668+0000 7fe941800700 1 -- 172.21.15.23:0/1687023520 wait complete. 2024-02-28T16:12:52.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.669+0000 7fe941800700 1 Processor -- start 2024-02-28T16:12:52.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.669+0000 7fe941800700 1 -- start start 2024-02-28T16:12:52.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.670+0000 7fe941800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.670+0000 7fe941800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1976b0 con 0x7fe93c100950 2024-02-28T16:12:52.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.670+0000 7fe93aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.670+0000 7fe93aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47804/0 (socket says 172.21.15.23:47804) 2024-02-28T16:12:52.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.670+0000 7fe93aa00700 1 -- 172.21.15.23:0/2154248195 learned_addr learned my addr 172.21.15.23:0/2154248195 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:12:52.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.670+0000 7fe93aa00700 1 -- 172.21.15.23:0/2154248195 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0095f0 con 0x7fe93c100950 2024-02-28T16:12:52.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.671+0000 7fe93aa00700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c197170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0092e0 tx=0x7fe92c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.671+0000 7fe933400700 1 -- 172.21.15.23:0/2154248195 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe92c01d070 con 0x7fe93c100950 2024-02-28T16:12:52.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.671+0000 7fe933400700 1 -- 172.21.15.23:0/2154248195 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe92c00be10 con 0x7fe93c100950 2024-02-28T16:12:52.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.671+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c1978b0 con 0x7fe93c100950 2024-02-28T16:12:52.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.671+0000 7fe933400700 1 -- 172.21.15.23:0/2154248195 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe92c00f460 con 0x7fe93c100950 2024-02-28T16:12:52.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.671+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c197d50 con 0x7fe93c100950 2024-02-28T16:12:52.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.672+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c190f00 con 0x7fe93c100950 2024-02-28T16:12:52.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.672+0000 7fe933400700 1 -- 172.21.15.23:0/2154248195 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fe92c00b960 con 0x7fe93c100950 2024-02-28T16:12:52.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.673+0000 7fe933400700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fe920038490 0x7fe92003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.673+0000 7fe933400700 1 -- 172.21.15.23:0/2154248195 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe92c04c4b0 con 0x7fe93c100950 2024-02-28T16:12:52.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.673+0000 7fe93a000700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fe920038490 0x7fe92003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.674+0000 7fe93a000700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fe920038490 0x7fe92003a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe928006fd0 tx=0x7fe928006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.678+0000 7fe933400700 1 -- 172.21.15.23:0/2154248195 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe92c00f6d0 con 0x7fe93c100950 2024-02-28T16:12:52.896 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:52 smithi023 ceph-mon[29137]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:52.896 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:52 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:52.896 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:52 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:52.896 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:52 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:52.896 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:52 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:52.896 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:52 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:52.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:52.917+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}) v1 -- 0x7fe93c061190 con 0x7fe920038490 2024-02-28T16:12:53.602 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:53 smithi023 ceph-mon[29137]: Deploying daemon node-exporter.smithi023 on smithi023 2024-02-28T16:12:54.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:54 smithi023 ceph-mon[29137]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:54.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:54 smithi023 ceph-mon[29137]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:55.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:55 smithi023 ceph-mon[29137]: Deploying cephadm binary to smithi153 2024-02-28T16:12:56.736 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:56 smithi023 ceph-mon[29137]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:57.591 INFO:teuthology.orchestra.run.smithi023.stdout:Added host 'smithi153' with addr '172.21.15.153' 2024-02-28T16:12:57.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.597+0000 7fe933400700 1 -- 172.21.15.23:0/2154248195 <== mgr.14164 v2:172.21.15.23:6800/3150303808 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe93c061190 con 0x7fe920038490 2024-02-28T16:12:57.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fe920038490 msgr2=0x7fe92003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:57.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fe920038490 0x7fe92003a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe928006fd0 tx=0x7fe928006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:57.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 msgr2=0x7fe93c197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:57.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c197170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0092e0 tx=0x7fe92c009e60 comp rx=0 tx=0).stop 2024-02-28T16:12:57.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 shutdown_connections 2024-02-28T16:12:57.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fe920038490 0x7fe92003a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:57.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 --2- 172.21.15.23:0/2154248195 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe93c100950 0x7fe93c197170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:57.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.600+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 >> 172.21.15.23:0/2154248195 conn(0x7fe93c0fa2b0 msgr2=0x7fe93c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:57.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.601+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 shutdown_connections 2024-02-28T16:12:57.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:12:57.601+0000 7fe941800700 1 -- 172.21.15.23:0/2154248195 wait complete. 2024-02-28T16:12:58.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:58.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:58.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:58.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:58.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: Deploying daemon alertmanager.smithi023 on smithi023 2024-02-28T16:12:58.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:12:58.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:58.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:12:58.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:12:58 smithi023 ceph-mon[29137]: Added host smithi153 2024-02-28T16:12:58.453 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch host ls --format=json 2024-02-28T16:12:58.867 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:13:00.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:00 smithi023 ceph-mon[29137]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:01.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.653+0000 7f62e9400700 1 -- 172.21.15.23:0/1386822052 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e40ffc70 msgr2=0x7f62e4100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:01.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.653+0000 7f62e9400700 1 --2- 172.21.15.23:0/1386822052 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e40ffc70 0x7f62e4100080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009910 tx=0x7f62d4009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:01.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.653+0000 7f62e9400700 1 -- 172.21.15.23:0/1386822052 shutdown_connections 2024-02-28T16:13:01.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.653+0000 7f62e9400700 1 --2- 172.21.15.23:0/1386822052 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e40ffc70 0x7f62e4100080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:01.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.653+0000 7f62e9400700 1 -- 172.21.15.23:0/1386822052 >> 172.21.15.23:0/1386822052 conn(0x7f62e40fb220 msgr2=0x7f62e40fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:01.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.653+0000 7f62e9400700 1 -- 172.21.15.23:0/1386822052 shutdown_connections 2024-02-28T16:13:01.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.654+0000 7f62e9400700 1 -- 172.21.15.23:0/1386822052 wait complete. 2024-02-28T16:13:01.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.656+0000 7f62e9400700 1 Processor -- start 2024-02-28T16:13:01.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.656+0000 7f62e9400700 1 -- start start 2024-02-28T16:13:01.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.657+0000 7f62e9400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e4074ab0 0x7f62e4073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:01.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.657+0000 7f62e9400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4074ec0 con 0x7f62e4074ab0 2024-02-28T16:13:01.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.657+0000 7f62e3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e4074ab0 0x7f62e4073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:01.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.657+0000 7f62e3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e4074ab0 0x7f62e4073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42332/0 (socket says 172.21.15.23:42332) 2024-02-28T16:13:01.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.657+0000 7f62e3e00700 1 -- 172.21.15.23:0/4021343316 learned_addr learned my addr 172.21.15.23:0/4021343316 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:13:01.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.657+0000 7f62e3e00700 1 -- 172.21.15.23:0/4021343316 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d40095f0 con 0x7f62e4074ab0 2024-02-28T16:13:01.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.658+0000 7f62e3e00700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e4074ab0 0x7f62e4073140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62e4100cd0 tx=0x7f62d4009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:01.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.658+0000 7f62e0c00700 1 -- 172.21.15.23:0/4021343316 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d401d070 con 0x7f62e4074ab0 2024-02-28T16:13:01.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.658+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e4073680 con 0x7f62e4074ab0 2024-02-28T16:13:01.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.658+0000 7f62e0c00700 1 -- 172.21.15.23:0/4021343316 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62d4005dc0 con 0x7f62e4074ab0 2024-02-28T16:13:01.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.658+0000 7f62e0c00700 1 -- 172.21.15.23:0/4021343316 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d4022da0 con 0x7f62e4074ab0 2024-02-28T16:13:01.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.658+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e4073b20 con 0x7f62e4074ab0 2024-02-28T16:13:01.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.659+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e418e950 con 0x7f62e4074ab0 2024-02-28T16:13:01.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.660+0000 7f62e0c00700 1 -- 172.21.15.23:0/4021343316 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f62d4022690 con 0x7f62e4074ab0 2024-02-28T16:13:01.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.660+0000 7f62e0c00700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f62c80384e0 0x7f62c803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:01.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.660+0000 7f62e0c00700 1 -- 172.21.15.23:0/4021343316 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f62d404c310 con 0x7f62e4074ab0 2024-02-28T16:13:01.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.660+0000 7f62e3400700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f62c80384e0 0x7f62c803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:01.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.661+0000 7f62e3400700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f62c80384e0 0x7f62c803a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f62d0006fd0 tx=0x7f62d0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:01.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.666+0000 7f62e0c00700 1 -- 172.21.15.23:0/4021343316 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f62d4022470 con 0x7f62e4074ab0 2024-02-28T16:13:01.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.898+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62e402cde0 con 0x7f62c80384e0 2024-02-28T16:13:01.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.900+0000 7f62e0c00700 1 -- 172.21.15.23:0/4021343316 <== mgr.14164 v2:172.21.15.23:6800/3150303808 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f62e402cde0 con 0x7f62c80384e0 2024-02-28T16:13:01.892 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:13:01.892 INFO:teuthology.orchestra.run.smithi023.stdout:[{"addr": "172.21.15.23", "hostname": "smithi023", "labels": [], "status": ""}, {"addr": "172.21.15.153", "hostname": "smithi153", "labels": [], "status": ""}] 2024-02-28T16:13:01.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.903+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f62c80384e0 msgr2=0x7f62c803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:01.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.903+0000 7f62e9400700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f62c80384e0 0x7f62c803a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f62d0006fd0 tx=0x7f62d0006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:01.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.903+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e4074ab0 msgr2=0x7f62e4073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:01.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.903+0000 7f62e9400700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e4074ab0 0x7f62e4073140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62e4100cd0 tx=0x7f62d4009f80 comp rx=0 tx=0).stop 2024-02-28T16:13:01.896 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.905+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 shutdown_connections 2024-02-28T16:13:01.896 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.905+0000 7f62e9400700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f62c80384e0 0x7f62c803a990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:01.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.905+0000 7f62e9400700 1 --2- 172.21.15.23:0/4021343316 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62e4074ab0 0x7f62e4073140 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:01.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.905+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 >> 172.21.15.23:0/4021343316 conn(0x7f62e40fb220 msgr2=0x7f62e40fbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:01.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.905+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 shutdown_connections 2024-02-28T16:13:01.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:01.905+0000 7f62e9400700 1 -- 172.21.15.23:0/4021343316 wait complete. 2024-02-28T16:13:02.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:02 smithi023 ceph-mon[29137]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:03.872 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:03 smithi023 ceph-mon[29137]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:13:03.992 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-28T16:13:03.992 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd crush tunables default 2024-02-28T16:13:04.837 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:04 smithi023 ceph-mon[29137]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:06.158 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:13:06.560 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:06 smithi023 ceph-mon[29137]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:08.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:08 smithi023 ceph-mon[29137]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:08.799 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.573+0000 7f375b800700 1 -- 172.21.15.23:0/938323463 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 msgr2=0x7f3754100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:08.799 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.573+0000 7f375b800700 1 --2- 172.21.15.23:0/938323463 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754100230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3748009910 tx=0x7f3748009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:08.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.573+0000 7f375b800700 1 -- 172.21.15.23:0/938323463 shutdown_connections 2024-02-28T16:13:08.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.573+0000 7f375b800700 1 --2- 172.21.15.23:0/938323463 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754100230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:08.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.573+0000 7f375b800700 1 -- 172.21.15.23:0/938323463 >> 172.21.15.23:0/938323463 conn(0x7f37540fb3d0 msgr2=0x7f37540fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:08.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.573+0000 7f375b800700 1 -- 172.21.15.23:0/938323463 shutdown_connections 2024-02-28T16:13:08.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.573+0000 7f375b800700 1 -- 172.21.15.23:0/938323463 wait complete. 2024-02-28T16:13:08.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.575+0000 7f375b800700 1 Processor -- start 2024-02-28T16:13:08.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.575+0000 7f375b800700 1 -- start start 2024-02-28T16:13:08.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.575+0000 7f375b800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:08.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.575+0000 7f375b800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754075030 con 0x7f37540ffe20 2024-02-28T16:13:08.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.576+0000 7f3758e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:08.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.576+0000 7f3758e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:42346/0 (socket says 172.21.15.23:42346) 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.576+0000 7f3758e00700 1 -- 172.21.15.23:0/583290491 learned_addr learned my addr 172.21.15.23:0/583290491 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.576+0000 7f3758e00700 1 -- 172.21.15.23:0/583290491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480095f0 con 0x7f37540ffe20 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.576+0000 7f3758e00700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754074af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37480092e0 tx=0x7f3748009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.576+0000 7f3751600700 1 -- 172.21.15.23:0/583290491 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f374801d070 con 0x7f37540ffe20 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.577+0000 7f3751600700 1 -- 172.21.15.23:0/583290491 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f374800be10 con 0x7f37540ffe20 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.577+0000 7f3751600700 1 -- 172.21.15.23:0/583290491 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f374800f460 con 0x7f37540ffe20 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.577+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3754073140 con 0x7f37540ffe20 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.577+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540735e0 con 0x7f37540ffe20 2024-02-28T16:13:08.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.578+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754062380 con 0x7f37540ffe20 2024-02-28T16:13:08.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.578+0000 7f3751600700 1 -- 172.21.15.23:0/583290491 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f3748022470 con 0x7f37540ffe20 2024-02-28T16:13:08.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.578+0000 7f3751600700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f373c0384e0 0x7f373c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:08.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.578+0000 7f3751600700 1 -- 172.21.15.23:0/583290491 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f374804c360 con 0x7f37540ffe20 2024-02-28T16:13:08.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.579+0000 7f3753e00700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f373c0384e0 0x7f373c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:08.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.579+0000 7f3753e00700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f373c0384e0 0x7f373c03a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3740006fd0 tx=0x7f3740006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:08.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.584+0000 7f3751600700 1 -- 172.21.15.23:0/583290491 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f374800b960 con 0x7f37540ffe20 2024-02-28T16:13:08.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:08.816+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f375418e460 con 0x7f37540ffe20 2024-02-28T16:13:09.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.533+0000 7f3751600700 1 -- 172.21.15.23:0/583290491 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3748027070 con 0x7f37540ffe20 2024-02-28T16:13:09.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f373c0384e0 msgr2=0x7f373c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:09.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f373c0384e0 0x7f373c03a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3740006fd0 tx=0x7f3740006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:09.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 msgr2=0x7f3754074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:09.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754074af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37480092e0 tx=0x7f3748009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:09.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 shutdown_connections 2024-02-28T16:13:09.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f373c0384e0 0x7f373c03a990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:09.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 --2- 172.21.15.23:0/583290491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f37540ffe20 0x7f3754074af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:09.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.538+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 >> 172.21.15.23:0/583290491 conn(0x7f37540fb3d0 msgr2=0x7f37540fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:09.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.539+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 shutdown_connections 2024-02-28T16:13:09.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:13:09.539+0000 7f375b800700 1 -- 172.21.15.23:0/583290491 wait complete. 2024-02-28T16:13:09.532 INFO:teuthology.orchestra.run.smithi023.stderr:adjusted tunables profile to default 2024-02-28T16:13:09.609 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:09 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/583290491' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-28T16:13:10.310 INFO:tasks.cephadm:Adding mon.smithi023 on smithi023 2024-02-28T16:13:10.310 INFO:tasks.cephadm:Adding mon.smithi153 on smithi153 2024-02-28T16:13:10.311 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch apply mon '2;smithi023:172.21.15.23=smithi023;smithi153:172.21.15.153=smithi153' 2024-02-28T16:13:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:10.784 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:10.894 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:10 smithi023 ceph-mon[29137]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:10.894 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:10 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/583290491' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-28T16:13:10.894 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:10 smithi023 ceph-mon[29137]: osdmap e4: 0 total, 0 up, 0 in 2024-02-28T16:13:12.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:12.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:12 smithi023 ceph-mon[29137]: Deploying daemon grafana.smithi023 on smithi023 2024-02-28T16:13:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.811+0000 7f5386600700 1 -- 172.21.15.153:0/1560304207 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 msgr2=0x7f5380100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.811+0000 7f5386600700 1 --2- 172.21.15.153:0/1560304207 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380100230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5370009910 tx=0x7f5370009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.811+0000 7f5386600700 1 -- 172.21.15.153:0/1560304207 shutdown_connections 2024-02-28T16:13:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.811+0000 7f5386600700 1 --2- 172.21.15.153:0/1560304207 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380100230 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.811+0000 7f5386600700 1 -- 172.21.15.153:0/1560304207 >> 172.21.15.153:0/1560304207 conn(0x7f53800fb3d0 msgr2=0x7f53800fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.811+0000 7f5386600700 1 -- 172.21.15.153:0/1560304207 shutdown_connections 2024-02-28T16:13:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.811+0000 7f5386600700 1 -- 172.21.15.153:0/1560304207 wait complete. 2024-02-28T16:13:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.812+0000 7f5386600700 1 Processor -- start 2024-02-28T16:13:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.813+0000 7f5386600700 1 -- start start 2024-02-28T16:13:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.813+0000 7f5386600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.813+0000 7f5386600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53801976c0 con 0x7f53800ffe20 2024-02-28T16:13:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.814+0000 7f537f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.814+0000 7f537f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:60266/0 (socket says 172.21.15.153:60266) 2024-02-28T16:13:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.814+0000 7f537f400700 1 -- 172.21.15.153:0/1162411812 learned_addr learned my addr 172.21.15.153:0/1162411812 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.814+0000 7f537f400700 1 -- 172.21.15.153:0/1162411812 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700095f0 con 0x7f53800ffe20 2024-02-28T16:13:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.815+0000 7f537f400700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380197180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53700092e0 tx=0x7f5370009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:12.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.815+0000 7f5377e00700 1 -- 172.21.15.153:0/1162411812 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f537001d070 con 0x7f53800ffe20 2024-02-28T16:13:12.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.815+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53801978c0 con 0x7f53800ffe20 2024-02-28T16:13:12.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.816+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5380197d60 con 0x7f53800ffe20 2024-02-28T16:13:12.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.816+0000 7f5377e00700 1 -- 172.21.15.153:0/1162411812 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f537000be10 con 0x7f53800ffe20 2024-02-28T16:13:12.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.816+0000 7f5377e00700 1 -- 172.21.15.153:0/1162411812 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f537000f460 con 0x7f53800ffe20 2024-02-28T16:13:12.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.817+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5380190e80 con 0x7f53800ffe20 2024-02-28T16:13:12.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.817+0000 7f5377e00700 1 -- 172.21.15.153:0/1162411812 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f5370022470 con 0x7f53800ffe20 2024-02-28T16:13:12.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.818+0000 7f5377e00700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f5364038490 0x7f536403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:12.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.818+0000 7f5377e00700 1 -- 172.21.15.153:0/1162411812 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f537004c580 con 0x7f53800ffe20 2024-02-28T16:13:12.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.818+0000 7f537ea00700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f5364038490 0x7f536403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:12.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.820+0000 7f537ea00700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f5364038490 0x7f536403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f536c006fd0 tx=0x7f536c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:12.832+0000 7f5377e00700 1 -- 172.21.15.153:0/1162411812 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5370022790 con 0x7f53800ffe20 2024-02-28T16:13:13.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.058+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 --> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi023:172.21.15.23=smithi023;smithi153:172.21.15.153=smithi153", "target": ["mon-mgr", ""]}) v1 -- 0x7f5380061190 con 0x7f5364038490 2024-02-28T16:13:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.077+0000 7f5377e00700 1 -- 172.21.15.153:0/1162411812 <== mgr.14164 v2:172.21.15.23:6800/3150303808 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5380061190 con 0x7f5364038490 2024-02-28T16:13:13.068 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mon update... 2024-02-28T16:13:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f5364038490 msgr2=0x7f536403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f5364038490 0x7f536403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f536c006fd0 tx=0x7f536c006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 msgr2=0x7f5380197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380197180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53700092e0 tx=0x7f5370009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 shutdown_connections 2024-02-28T16:13:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f5364038490 0x7f536403a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:13.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 --2- 172.21.15.153:0/1162411812 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f53800ffe20 0x7f5380197180 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:13.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 >> 172.21.15.153:0/1162411812 conn(0x7f53800fb3d0 msgr2=0x7f53800fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:13.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 shutdown_connections 2024-02-28T16:13:13.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:13.080+0000 7f5386600700 1 -- 172.21.15.153:0/1162411812 wait complete. 2024-02-28T16:13:13.792 DEBUG:teuthology.orchestra.run.smithi153:mon.smithi153> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi153.service 2024-02-28T16:13:13.797 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:13.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:13.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:13 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:13.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:13 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:14.191 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:14.287 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:14.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:14 smithi023 ceph-mon[29137]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi023:172.21.15.23=smithi023;smithi153:172.21.15.153=smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:14.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:14 smithi023 ceph-mon[29137]: Saving service mon spec with placement smithi023:172.21.15.23=smithi023;smithi153:172.21.15.153=smithi153;count:2 2024-02-28T16:13:14.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:14 smithi023 ceph-mon[29137]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.245+0000 7fdf02e00700 1 -- 172.21.15.153:0/1829107158 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 msgr2=0x7fdefc102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.245+0000 7fdf02e00700 1 --2- 172.21.15.153:0/1829107158 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc102430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009910 tx=0x7fdeec009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.246+0000 7fdf02e00700 1 -- 172.21.15.153:0/1829107158 shutdown_connections 2024-02-28T16:13:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.246+0000 7fdf02e00700 1 --2- 172.21.15.153:0/1829107158 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc102430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.246+0000 7fdf02e00700 1 -- 172.21.15.153:0/1829107158 >> 172.21.15.153:0/1829107158 conn(0x7fdefc0fd700 msgr2=0x7fdefc0ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.246+0000 7fdf02e00700 1 -- 172.21.15.153:0/1829107158 shutdown_connections 2024-02-28T16:13:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.246+0000 7fdf02e00700 1 -- 172.21.15.153:0/1829107158 wait complete. 2024-02-28T16:13:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.247+0000 7fdf02e00700 1 Processor -- start 2024-02-28T16:13:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.247+0000 7fdf02e00700 1 -- start start 2024-02-28T16:13:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.248+0000 7fdf02e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.248+0000 7fdf02e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1976e0 con 0x7fdefc102020 2024-02-28T16:13:16.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.248+0000 7fdefbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:16.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.248+0000 7fdefbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:60284/0 (socket says 172.21.15.153:60284) 2024-02-28T16:13:16.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.249+0000 7fdefbe00700 1 -- 172.21.15.153:0/3638323118 learned_addr learned my addr 172.21.15.153:0/3638323118 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:16.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.249+0000 7fdefbe00700 1 -- 172.21.15.153:0/3638323118 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0095f0 con 0x7fdefc102020 2024-02-28T16:13:16.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.250+0000 7fdefbe00700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc1971a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdeec005950 tx=0x7fdeec009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.250+0000 7fdef8c00700 1 -- 172.21.15.153:0/3638323118 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdeec01d070 con 0x7fdefc102020 2024-02-28T16:13:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.250+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc1978e0 con 0x7fdefc102020 2024-02-28T16:13:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.250+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc197d80 con 0x7fdefc102020 2024-02-28T16:13:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.250+0000 7fdef8c00700 1 -- 172.21.15.153:0/3638323118 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdeec00be10 con 0x7fdefc102020 2024-02-28T16:13:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.250+0000 7fdef8c00700 1 -- 172.21.15.153:0/3638323118 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdeec00f460 con 0x7fdefc102020 2024-02-28T16:13:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.251+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc190d00 con 0x7fdefc102020 2024-02-28T16:13:16.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.252+0000 7fdef8c00700 1 -- 172.21.15.153:0/3638323118 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fdeec0227c0 con 0x7fdefc102020 2024-02-28T16:13:16.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.252+0000 7fdef8c00700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fdee00384e0 0x7fdee003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:16.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.252+0000 7fdef8c00700 1 -- 172.21.15.153:0/3638323118 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdeec04c740 con 0x7fdefc102020 2024-02-28T16:13:16.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.253+0000 7fdefb400700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fdee00384e0 0x7fdee003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:16.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.254+0000 7fdefb400700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fdee00384e0 0x7fdee003a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.273+0000 7fdef8c00700 1 -- 172.21.15.153:0/3638323118 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdeec00b960 con 0x7fdefc102020 2024-02-28T16:13:16.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.568+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdefc02cc30 con 0x7fdefc102020 2024-02-28T16:13:16.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.569+0000 7fdef8c00700 1 -- 172.21.15.153:0/3638323118 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fdeec027020 con 0x7fdefc102020 2024-02-28T16:13:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:16.560 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:16.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.571+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fdee00384e0 msgr2=0x7fdee003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:16.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.571+0000 7fdf02e00700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fdee00384e0 0x7fdee003a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.571+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 msgr2=0x7fdefc1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.571+0000 7fdf02e00700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc1971a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdeec005950 tx=0x7fdeec009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.572+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 shutdown_connections 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.572+0000 7fdf02e00700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fdee00384e0 0x7fdee003a990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.572+0000 7fdf02e00700 1 --2- 172.21.15.153:0/3638323118 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdefc102020 0x7fdefc1971a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.572+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 >> 172.21.15.153:0/3638323118 conn(0x7fdefc0fd700 msgr2=0x7fdefc0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.572+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 shutdown_connections 2024-02-28T16:13:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:16.572+0000 7fdf02e00700 1 -- 172.21.15.153:0/3638323118 wait complete. 2024-02-28T16:13:16.565 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:16.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:16 smithi023 ceph-mon[29137]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:17.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:17 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/3638323118' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:18.498 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:18.498 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:18.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:18 smithi023 ceph-mon[29137]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:19.000 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:20.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:20 smithi023 ceph-mon[29137]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.997+0000 7f1415400700 1 -- 172.21.15.153:0/35532704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 msgr2=0x7f1410100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.997+0000 7f1415400700 1 --2- 172.21.15.153:0/35532704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410100230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f140000b0a0 tx=0x7f140000b3b0 comp rx=0 tx=0).stop 2024-02-28T16:13:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.998+0000 7f1415400700 1 -- 172.21.15.153:0/35532704 shutdown_connections 2024-02-28T16:13:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.998+0000 7f1415400700 1 --2- 172.21.15.153:0/35532704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410100230 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.998+0000 7f1415400700 1 -- 172.21.15.153:0/35532704 >> 172.21.15.153:0/35532704 conn(0x7f14100fb3d0 msgr2=0x7f14100fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.998+0000 7f1415400700 1 -- 172.21.15.153:0/35532704 shutdown_connections 2024-02-28T16:13:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.998+0000 7f1415400700 1 -- 172.21.15.153:0/35532704 wait complete. 2024-02-28T16:13:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.999+0000 7f1415400700 1 Processor -- start 2024-02-28T16:13:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:20.999+0000 7f1415400700 1 -- start start 2024-02-28T16:13:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.000+0000 7f1415400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.000+0000 7f1415400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14101954b0 con 0x7f14100ffe20 2024-02-28T16:13:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.000+0000 7f140e800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.000+0000 7f140e800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:45980/0 (socket says 172.21.15.153:45980) 2024-02-28T16:13:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.000+0000 7f140e800700 1 -- 172.21.15.153:0/3743429297 learned_addr learned my addr 172.21.15.153:0/3743429297 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.000+0000 7f140e800700 1 -- 172.21.15.153:0/3743429297 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009d00 con 0x7f14100ffe20 2024-02-28T16:13:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.001+0000 7f140e800700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410194f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1400009fd0 tx=0x7f140000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.001+0000 7f1407e00700 1 -- 172.21.15.153:0/3743429297 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f140000e040 con 0x7f14100ffe20 2024-02-28T16:13:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.001+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14101956b0 con 0x7f14100ffe20 2024-02-28T16:13:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.001+0000 7f1407e00700 1 -- 172.21.15.153:0/3743429297 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f140000bdc0 con 0x7f14100ffe20 2024-02-28T16:13:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.001+0000 7f1407e00700 1 -- 172.21.15.153:0/3743429297 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f140001da40 con 0x7f14100ffe20 2024-02-28T16:13:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.001+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1410195ad0 con 0x7f14100ffe20 2024-02-28T16:13:20.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.003+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141018ea80 con 0x7f14100ffe20 2024-02-28T16:13:20.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.003+0000 7f1407e00700 1 -- 172.21.15.153:0/3743429297 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f140001dc30 con 0x7f14100ffe20 2024-02-28T16:13:20.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.003+0000 7f1407e00700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f13f4038530 0x7f13f403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:20.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.003+0000 7f1407e00700 1 -- 172.21.15.153:0/3743429297 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f140004c760 con 0x7f14100ffe20 2024-02-28T16:13:20.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.004+0000 7f1405e00700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f13f4038530 0x7f13f403a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:20.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.005+0000 7f1405e00700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f13f4038530 0x7f13f403a9e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13f8006fd0 tx=0x7f13f8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:21.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.014+0000 7f1407e00700 1 -- 172.21.15.153:0/3743429297 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1400012640 con 0x7f14100ffe20 2024-02-28T16:13:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.314+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f141002cc30 con 0x7f14100ffe20 2024-02-28T16:13:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.315+0000 7f1407e00700 1 -- 172.21.15.153:0/3743429297 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f140001c3e0 con 0x7f14100ffe20 2024-02-28T16:13:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:21.307 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f13f4038530 msgr2=0x7f13f403a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f13f4038530 0x7f13f403a9e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13f8006fd0 tx=0x7f13f8006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 msgr2=0x7f1410194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410194f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1400009fd0 tx=0x7f140000bb10 comp rx=0 tx=0).stop 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 shutdown_connections 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f13f4038530 0x7f13f403a9e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 --2- 172.21.15.153:0/3743429297 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f14100ffe20 0x7f1410194f70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 >> 172.21.15.153:0/3743429297 conn(0x7f14100fb3d0 msgr2=0x7f14100fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:21.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 shutdown_connections 2024-02-28T16:13:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:21.318+0000 7f1415400700 1 -- 172.21.15.153:0/3743429297 wait complete. 2024-02-28T16:13:21.311 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:21.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:21 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/3743429297' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:22.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:22 smithi023 ceph-mon[29137]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:23.142 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:23.143 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:23.506 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:23.606 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:24.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:24 smithi023 ceph-mon[29137]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:25.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.517+0000 7f56bda00700 1 -- 172.21.15.153:0/1984713608 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 msgr2=0x7f56b8075b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.517+0000 7f56bda00700 1 --2- 172.21.15.153:0/1984713608 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b8075b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009910 tx=0x7f56a8009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:25.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.517+0000 7f56bda00700 1 -- 172.21.15.153:0/1984713608 shutdown_connections 2024-02-28T16:13:25.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.517+0000 7f56bda00700 1 --2- 172.21.15.153:0/1984713608 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b8075b10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.517+0000 7f56bda00700 1 -- 172.21.15.153:0/1984713608 >> 172.21.15.153:0/1984713608 conn(0x7f56b80fd700 msgr2=0x7f56b80ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:25.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.517+0000 7f56bda00700 1 -- 172.21.15.153:0/1984713608 shutdown_connections 2024-02-28T16:13:25.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.518+0000 7f56bda00700 1 -- 172.21.15.153:0/1984713608 wait complete. 2024-02-28T16:13:25.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.518+0000 7f56bda00700 1 Processor -- start 2024-02-28T16:13:25.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.519+0000 7f56bda00700 1 -- start start 2024-02-28T16:13:25.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.519+0000 7f56bda00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.519+0000 7f56bda00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b819bad0 con 0x7f56b8075700 2024-02-28T16:13:25.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.519+0000 7f56b6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.520+0000 7f56b6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b819b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:46000/0 (socket says 172.21.15.153:46000) 2024-02-28T16:13:25.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.520+0000 7f56b6a00700 1 -- 172.21.15.153:0/1940524309 learned_addr learned my addr 172.21.15.153:0/1940524309 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.520+0000 7f56b6a00700 1 -- 172.21.15.153:0/1940524309 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a80095f0 con 0x7f56b8075700 2024-02-28T16:13:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.520+0000 7f56b6a00700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b819b590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f56a80092e0 tx=0x7f56a8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.521+0000 7f56af400700 1 -- 172.21.15.153:0/1940524309 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56a801d070 con 0x7f56b8075700 2024-02-28T16:13:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.521+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b819bcd0 con 0x7f56b8075700 2024-02-28T16:13:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.521+0000 7f56af400700 1 -- 172.21.15.153:0/1940524309 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f56a800be10 con 0x7f56b8075700 2024-02-28T16:13:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.521+0000 7f56af400700 1 -- 172.21.15.153:0/1940524309 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56a800f460 con 0x7f56b8075700 2024-02-28T16:13:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.521+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b819c170 con 0x7f56b8075700 2024-02-28T16:13:25.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.522+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b81950f0 con 0x7f56b8075700 2024-02-28T16:13:25.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.523+0000 7f56af400700 1 -- 172.21.15.153:0/1940524309 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f56a8022470 con 0x7f56b8075700 2024-02-28T16:13:25.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.523+0000 7f56af400700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f569c038490 0x7f569c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.523+0000 7f56af400700 1 -- 172.21.15.153:0/1940524309 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f56a804c560 con 0x7f56b8075700 2024-02-28T16:13:25.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.523+0000 7f56afe00700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f569c038490 0x7f569c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.524+0000 7f56afe00700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f569c038490 0x7f569c03a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f56a0006fd0 tx=0x7f56a0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:25.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.541+0000 7f56af400700 1 -- 172.21.15.153:0/1940524309 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f56a800b960 con 0x7f56b8075700 2024-02-28T16:13:25.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.834+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f56b802cc30 con 0x7f56b8075700 2024-02-28T16:13:25.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.835+0000 7f56af400700 1 -- 172.21.15.153:0/1940524309 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f56a8027070 con 0x7f56b8075700 2024-02-28T16:13:25.827 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:25.827 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:25.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f569c038490 msgr2=0x7f569c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f569c038490 0x7f569c03a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f56a0006fd0 tx=0x7f56a0006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 msgr2=0x7f56b819b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b819b590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f56a80092e0 tx=0x7f56a8009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 shutdown_connections 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f569c038490 0x7f569c03a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 --2- 172.21.15.153:0/1940524309 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f56b8075700 0x7f56b819b590 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 >> 172.21.15.153:0/1940524309 conn(0x7f56b80fd700 msgr2=0x7f56b80ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 shutdown_connections 2024-02-28T16:13:25.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:25.838+0000 7f56bda00700 1 -- 172.21.15.153:0/1940524309 wait complete. 2024-02-28T16:13:25.831 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:26.747 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:26 smithi023 ceph-mon[29137]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:26.747 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:26 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/1940524309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:27.615 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:27.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:27.981 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:28.082 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:28.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:28 smithi023 ceph-mon[29137]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:30.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.068+0000 7f2512c00700 1 -- 172.21.15.153:0/2800948233 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 msgr2=0x7f250c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:30.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.068+0000 7f2512c00700 1 --2- 172.21.15.153:0/2800948233 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c102430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009910 tx=0x7f24fc009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:30.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.068+0000 7f2512c00700 1 -- 172.21.15.153:0/2800948233 shutdown_connections 2024-02-28T16:13:30.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.068+0000 7f2512c00700 1 --2- 172.21.15.153:0/2800948233 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c102430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:30.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.068+0000 7f2512c00700 1 -- 172.21.15.153:0/2800948233 >> 172.21.15.153:0/2800948233 conn(0x7f250c0fd700 msgr2=0x7f250c0ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:30.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.068+0000 7f2512c00700 1 -- 172.21.15.153:0/2800948233 shutdown_connections 2024-02-28T16:13:30.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.068+0000 7f2512c00700 1 -- 172.21.15.153:0/2800948233 wait complete. 2024-02-28T16:13:30.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.069+0000 7f2512c00700 1 Processor -- start 2024-02-28T16:13:30.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.069+0000 7f2512c00700 1 -- start start 2024-02-28T16:13:30.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.070+0000 7f2512c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:30.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.070+0000 7f2512c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c1976e0 con 0x7f250c102020 2024-02-28T16:13:30.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.070+0000 7f250be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:30.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.070+0000 7f250be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:52530/0 (socket says 172.21.15.153:52530) 2024-02-28T16:13:30.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.070+0000 7f250be00700 1 -- 172.21.15.153:0/3156692735 learned_addr learned my addr 172.21.15.153:0/3156692735 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:30.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.071+0000 7f250be00700 1 -- 172.21.15.153:0/3156692735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc0095f0 con 0x7f250c102020 2024-02-28T16:13:30.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.071+0000 7f250be00700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c1971a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005950 tx=0x7f24fc009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:30.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.071+0000 7f2508c00700 1 -- 172.21.15.153:0/3156692735 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24fc01d070 con 0x7f250c102020 2024-02-28T16:13:30.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.071+0000 7f2508c00700 1 -- 172.21.15.153:0/3156692735 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24fc00be10 con 0x7f250c102020 2024-02-28T16:13:30.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.071+0000 7f2508c00700 1 -- 172.21.15.153:0/3156692735 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24fc00f460 con 0x7f250c102020 2024-02-28T16:13:30.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.071+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c1978e0 con 0x7f250c102020 2024-02-28T16:13:30.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.072+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c197d80 con 0x7f250c102020 2024-02-28T16:13:30.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.073+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c190d00 con 0x7f250c102020 2024-02-28T16:13:30.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.073+0000 7f2508c00700 1 -- 172.21.15.153:0/3156692735 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f24fc0227c0 con 0x7f250c102020 2024-02-28T16:13:30.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.073+0000 7f2508c00700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f24f00384e0 0x7f24f003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:30.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.073+0000 7f2508c00700 1 -- 172.21.15.153:0/3156692735 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f24fc04c4d0 con 0x7f250c102020 2024-02-28T16:13:30.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.074+0000 7f250b400700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f24f00384e0 0x7f24f003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:30.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.074+0000 7f250b400700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f24f00384e0 0x7f24f003a990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24f8006fd0 tx=0x7f24f8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:30.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.079+0000 7f2508c00700 1 -- 172.21.15.153:0/3156692735 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f24fc02ba00 con 0x7f250c102020 2024-02-28T16:13:30.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.378+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f250c02cc30 con 0x7f250c102020 2024-02-28T16:13:30.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.380+0000 7f2508c00700 1 -- 172.21.15.153:0/3156692735 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f24fc027070 con 0x7f250c102020 2024-02-28T16:13:30.371 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:30.372 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f24f00384e0 msgr2=0x7f24f003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f24f00384e0 0x7f24f003a990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24f8006fd0 tx=0x7f24f8006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 msgr2=0x7f250c1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c1971a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005950 tx=0x7f24fc009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 shutdown_connections 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f24f00384e0 0x7f24f003a990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 --2- 172.21.15.153:0/3156692735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f250c102020 0x7f250c1971a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.382+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 >> 172.21.15.153:0/3156692735 conn(0x7f250c0fd700 msgr2=0x7f250c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:30.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.383+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 shutdown_connections 2024-02-28T16:13:30.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:30.383+0000 7f2512c00700 1 -- 172.21.15.153:0/3156692735 wait complete. 2024-02-28T16:13:30.375 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:30.529 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:30 smithi023 ceph-mon[29137]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:31.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:31 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/3156692735' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:31.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:31.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:31.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:31.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:31.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:31.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:31 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:32.125 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:32.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:32.510 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:32.609 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:32.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:32 smithi023 ceph-mon[29137]: Deploying daemon prometheus.smithi023 on smithi023 2024-02-28T16:13:32.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:32 smithi023 ceph-mon[29137]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:33.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:33 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:34.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.530+0000 7f0012600700 1 -- 172.21.15.153:0/2035503202 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 msgr2=0x7f000c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:34.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.530+0000 7f0012600700 1 --2- 172.21.15.153:0/2035503202 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c0731e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efffc009910 tx=0x7efffc009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:34.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.530+0000 7f0012600700 1 -- 172.21.15.153:0/2035503202 shutdown_connections 2024-02-28T16:13:34.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.530+0000 7f0012600700 1 --2- 172.21.15.153:0/2035503202 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c0731e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:34.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.530+0000 7f0012600700 1 -- 172.21.15.153:0/2035503202 >> 172.21.15.153:0/2035503202 conn(0x7f000c0fb3c0 msgr2=0x7f000c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:34.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.530+0000 7f0012600700 1 -- 172.21.15.153:0/2035503202 shutdown_connections 2024-02-28T16:13:34.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.531+0000 7f0012600700 1 -- 172.21.15.153:0/2035503202 wait complete. 2024-02-28T16:13:34.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.532+0000 7f0012600700 1 Processor -- start 2024-02-28T16:13:34.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.532+0000 7f0012600700 1 -- start start 2024-02-28T16:13:34.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.532+0000 7f0012600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:34.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.532+0000 7f0012600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c19bab0 con 0x7f000c074d80 2024-02-28T16:13:34.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.533+0000 7f000b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:34.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.533+0000 7f000b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c19b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:52554/0 (socket says 172.21.15.153:52554) 2024-02-28T16:13:34.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.533+0000 7f000b400700 1 -- 172.21.15.153:0/4174265793 learned_addr learned my addr 172.21.15.153:0/4174265793 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.533+0000 7f000b400700 1 -- 172.21.15.153:0/4174265793 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0095f0 con 0x7f000c074d80 2024-02-28T16:13:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.534+0000 7f000b400700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c19b570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efffc0092e0 tx=0x7efffc009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.534+0000 7f0003e00700 1 -- 172.21.15.153:0/4174265793 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efffc01d070 con 0x7f000c074d80 2024-02-28T16:13:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.534+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c19bcb0 con 0x7f000c074d80 2024-02-28T16:13:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.534+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c19c150 con 0x7f000c074d80 2024-02-28T16:13:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.534+0000 7f0003e00700 1 -- 172.21.15.153:0/4174265793 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efffc00be10 con 0x7f000c074d80 2024-02-28T16:13:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.534+0000 7f0003e00700 1 -- 172.21.15.153:0/4174265793 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efffc00f460 con 0x7f000c074d80 2024-02-28T16:13:34.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.536+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec005320 con 0x7f000c074d80 2024-02-28T16:13:34.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.536+0000 7f0003e00700 1 -- 172.21.15.153:0/4174265793 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7efffc022470 con 0x7f000c074d80 2024-02-28T16:13:34.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.536+0000 7f0003e00700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efff0038490 0x7efff003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:34.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.536+0000 7f0003e00700 1 -- 172.21.15.153:0/4174265793 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efffc04c2c0 con 0x7f000c074d80 2024-02-28T16:13:34.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.537+0000 7f000aa00700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efff0038490 0x7efff003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:34.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.538+0000 7f000aa00700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efff0038490 0x7efff003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efff8006fd0 tx=0x7efff8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:34.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.553+0000 7f0003e00700 1 -- 172.21.15.153:0/4174265793 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efffc00b960 con 0x7f000c074d80 2024-02-28T16:13:34.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.851+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7effec005190 con 0x7f000c074d80 2024-02-28T16:13:34.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.852+0000 7f0003e00700 1 -- 172.21.15.153:0/4174265793 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7efffc027020 con 0x7f000c074d80 2024-02-28T16:13:34.844 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:34.844 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efff0038490 msgr2=0x7efff003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efff0038490 0x7efff003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efff8006fd0 tx=0x7efff8006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 msgr2=0x7f000c19b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c19b570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efffc0092e0 tx=0x7efffc009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 shutdown_connections 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7efff0038490 0x7efff003a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 --2- 172.21.15.153:0/4174265793 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f000c074d80 0x7f000c19b570 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 >> 172.21.15.153:0/4174265793 conn(0x7f000c0fb3c0 msgr2=0x7f000c0fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 shutdown_connections 2024-02-28T16:13:34.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:34.855+0000 7f0012600700 1 -- 172.21.15.153:0/4174265793 wait complete. 2024-02-28T16:13:34.848 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:34.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:34 smithi023 ceph-mon[29137]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:35.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:35 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/4174265793' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:36.574 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:36.574 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:36.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:36 smithi023 ceph-mon[29137]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:37.048 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:38.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.919+0000 7f3f2e200700 1 -- 172.21.15.153:0/3069707584 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 msgr2=0x7f3f28106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:38.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.919+0000 7f3f2e200700 1 --2- 172.21.15.153:0/3069707584 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f28106850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009910 tx=0x7f3f18009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:38.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.920+0000 7f3f2e200700 1 -- 172.21.15.153:0/3069707584 shutdown_connections 2024-02-28T16:13:38.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.920+0000 7f3f2e200700 1 --2- 172.21.15.153:0/3069707584 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f28106850 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:38.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.920+0000 7f3f2e200700 1 -- 172.21.15.153:0/3069707584 >> 172.21.15.153:0/3069707584 conn(0x7f3f280756e0 msgr2=0x7f3f28077b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:38.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.920+0000 7f3f2e200700 1 -- 172.21.15.153:0/3069707584 shutdown_connections 2024-02-28T16:13:38.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.920+0000 7f3f2e200700 1 -- 172.21.15.153:0/3069707584 wait complete. 2024-02-28T16:13:38.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.921+0000 7f3f2e200700 1 Processor -- start 2024-02-28T16:13:38.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.921+0000 7f3f2e200700 1 -- start start 2024-02-28T16:13:38.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.922+0000 7f3f2e200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f2819b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:38.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.922+0000 7f3f2e200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2819bae0 con 0x7f3f28106440 2024-02-28T16:13:38.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.922+0000 7f3f27400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f2819b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:38.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.922+0000 7f3f27400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f2819b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:52582/0 (socket says 172.21.15.153:52582) 2024-02-28T16:13:38.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.922+0000 7f3f27400700 1 -- 172.21.15.153:0/1826789433 learned_addr learned my addr 172.21.15.153:0/1826789433 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:38.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.923+0000 7f3f27400700 1 -- 172.21.15.153:0/1826789433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180095f0 con 0x7f3f28106440 2024-02-28T16:13:38.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.923+0000 7f3f27400700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f2819b5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3f18005950 tx=0x7f3f18009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:38.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.924+0000 7f3f1fe00700 1 -- 172.21.15.153:0/1826789433 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f1801d070 con 0x7f3f28106440 2024-02-28T16:13:38.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.924+0000 7f3f1fe00700 1 -- 172.21.15.153:0/1826789433 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f1800be10 con 0x7f3f28106440 2024-02-28T16:13:38.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.924+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2819bce0 con 0x7f3f28106440 2024-02-28T16:13:38.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.924+0000 7f3f1fe00700 1 -- 172.21.15.153:0/1826789433 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f1800f460 con 0x7f3f28106440 2024-02-28T16:13:38.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.924+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2819c180 con 0x7f3f28106440 2024-02-28T16:13:38.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.925+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f28195110 con 0x7f3f28106440 2024-02-28T16:13:38.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.926+0000 7f3f1fe00700 1 -- 172.21.15.153:0/1826789433 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f3f180227c0 con 0x7f3f28106440 2024-02-28T16:13:38.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.926+0000 7f3f1fe00700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f3f0c038490 0x7f3f0c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:38.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.926+0000 7f3f1fe00700 1 -- 172.21.15.153:0/1826789433 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3f1804c510 con 0x7f3f28106440 2024-02-28T16:13:38.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.927+0000 7f3f26a00700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f3f0c038490 0x7f3f0c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:38.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.928+0000 7f3f26a00700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f3f0c038490 0x7f3f0c03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006fd0 tx=0x7f3f14006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:38.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:38 smithi023 ceph-mon[29137]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:38.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:38.941+0000 7f3f1fe00700 1 -- 172.21.15.153:0/1826789433 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3f1802bba0 con 0x7f3f28106440 2024-02-28T16:13:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.236+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3f2802cc30 con 0x7f3f28106440 2024-02-28T16:13:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.237+0000 7f3f1fe00700 1 -- 172.21.15.153:0/1826789433 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f3f18027030 con 0x7f3f28106440 2024-02-28T16:13:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:39.229 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f3f0c038490 msgr2=0x7f3f0c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f3f0c038490 0x7f3f0c03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006fd0 tx=0x7f3f14006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 msgr2=0x7f3f2819b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f2819b5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3f18005950 tx=0x7f3f18009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 shutdown_connections 2024-02-28T16:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f3f0c038490 0x7f3f0c03a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 --2- 172.21.15.153:0/1826789433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3f28106440 0x7f3f2819b5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 >> 172.21.15.153:0/1826789433 conn(0x7f3f280756e0 msgr2=0x7f3f280773a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 shutdown_connections 2024-02-28T16:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:39.240+0000 7f3f2e200700 1 -- 172.21.15.153:0/1826789433 wait complete. 2024-02-28T16:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:39.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:39 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/1826789433' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:40.777 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:40 smithi023 ceph-mon[29137]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:40.889 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:40.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:41.269 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:41.364 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:42.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:42 smithi023 ceph-mon[29137]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:43.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.154+0000 7fab23000700 1 -- 172.21.15.153:0/2489815197 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 msgr2=0x7fab1c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.154+0000 7fab23000700 1 --2- 172.21.15.153:0/2489815197 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c100230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009910 tx=0x7fab0c009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.155+0000 7fab23000700 1 -- 172.21.15.153:0/2489815197 shutdown_connections 2024-02-28T16:13:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.155+0000 7fab23000700 1 --2- 172.21.15.153:0/2489815197 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c100230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.155+0000 7fab23000700 1 -- 172.21.15.153:0/2489815197 >> 172.21.15.153:0/2489815197 conn(0x7fab1c0fb3d0 msgr2=0x7fab1c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.155+0000 7fab23000700 1 -- 172.21.15.153:0/2489815197 shutdown_connections 2024-02-28T16:13:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.155+0000 7fab23000700 1 -- 172.21.15.153:0/2489815197 wait complete. 2024-02-28T16:13:43.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.156+0000 7fab23000700 1 Processor -- start 2024-02-28T16:13:43.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.156+0000 7fab23000700 1 -- start start 2024-02-28T16:13:43.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.156+0000 7fab23000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.156+0000 7fab23000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c1976b0 con 0x7fab1c0ffe20 2024-02-28T16:13:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.157+0000 7fab1be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.157+0000 7fab1be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:56796/0 (socket says 172.21.15.153:56796) 2024-02-28T16:13:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.157+0000 7fab1be00700 1 -- 172.21.15.153:0/4012485508 learned_addr learned my addr 172.21.15.153:0/4012485508 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.157+0000 7fab1be00700 1 -- 172.21.15.153:0/4012485508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c0095f0 con 0x7fab1c0ffe20 2024-02-28T16:13:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.158+0000 7fab1be00700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c197170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab0c005b40 tx=0x7fab0c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.158+0000 7fab18c00700 1 -- 172.21.15.153:0/4012485508 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab0c01d070 con 0x7fab1c0ffe20 2024-02-28T16:13:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.158+0000 7fab18c00700 1 -- 172.21.15.153:0/4012485508 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab0c00be10 con 0x7fab1c0ffe20 2024-02-28T16:13:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.158+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c1978b0 con 0x7fab1c0ffe20 2024-02-28T16:13:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.158+0000 7fab18c00700 1 -- 172.21.15.153:0/4012485508 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab0c00f460 con 0x7fab1c0ffe20 2024-02-28T16:13:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.159+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c197d50 con 0x7fab1c0ffe20 2024-02-28T16:13:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.160+0000 7fab18c00700 1 -- 172.21.15.153:0/4012485508 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fab0c0227e0 con 0x7fab1c0ffe20 2024-02-28T16:13:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.160+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c190e80 con 0x7fab1c0ffe20 2024-02-28T16:13:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.160+0000 7fab18c00700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fab00038490 0x7fab0003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.160+0000 7fab18c00700 1 -- 172.21.15.153:0/4012485508 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fab0c04c1a0 con 0x7fab1c0ffe20 2024-02-28T16:13:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.160+0000 7fab1b400700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fab00038490 0x7fab0003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.161+0000 7fab1b400700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fab00038490 0x7fab0003a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab08006fd0 tx=0x7fab08006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:43.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.169+0000 7fab18c00700 1 -- 172.21.15.153:0/4012485508 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fab0c02b590 con 0x7fab1c0ffe20 2024-02-28T16:13:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.471+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fab1c02cc30 con 0x7fab1c0ffe20 2024-02-28T16:13:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.472+0000 7fab18c00700 1 -- 172.21.15.153:0/4012485508 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fab0c027020 con 0x7fab1c0ffe20 2024-02-28T16:13:43.464 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:43.464 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fab00038490 msgr2=0x7fab0003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fab00038490 0x7fab0003a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab08006fd0 tx=0x7fab08006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 msgr2=0x7fab1c197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c197170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab0c005b40 tx=0x7fab0c004740 comp rx=0 tx=0).stop 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 shutdown_connections 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fab00038490 0x7fab0003a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 --2- 172.21.15.153:0/4012485508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab1c0ffe20 0x7fab1c197170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 >> 172.21.15.153:0/4012485508 conn(0x7fab1c0fb3d0 msgr2=0x7fab1c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.475+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 shutdown_connections 2024-02-28T16:13:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:43.476+0000 7fab23000700 1 -- 172.21.15.153:0/4012485508 wait complete. 2024-02-28T16:13:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:43.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:43 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/4012485508' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:44.870 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:44 smithi023 ceph-mon[29137]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:45.179 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:45.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:45.556 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:46.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:46 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:46.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:46 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:46.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:46 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:46.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:46 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-28T16:13:46.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:46 smithi023 ceph-mon[29137]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:47.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:47 smithi023 ceph-mon[29137]: from='mgr.14164 172.21.15.23:0/3996814256' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-28T16:13:47.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:47 smithi023 ceph-mon[29137]: mgrmap e14: smithi023.bbebnt(active, since 78s) 2024-02-28T16:13:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.596+0000 7f1286e00700 1 -- 172.21.15.153:0/1480293848 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 msgr2=0x7f1280100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.596+0000 7f1286e00700 1 --2- 172.21.15.153:0/1480293848 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280100230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f127000b0a0 tx=0x7f127000b3b0 comp rx=0 tx=0).stop 2024-02-28T16:13:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.596+0000 7f1286e00700 1 -- 172.21.15.153:0/1480293848 shutdown_connections 2024-02-28T16:13:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.596+0000 7f1286e00700 1 --2- 172.21.15.153:0/1480293848 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280100230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.596+0000 7f1286e00700 1 -- 172.21.15.153:0/1480293848 >> 172.21.15.153:0/1480293848 conn(0x7f12800fb3d0 msgr2=0x7f12800fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.596+0000 7f1286e00700 1 -- 172.21.15.153:0/1480293848 shutdown_connections 2024-02-28T16:13:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.596+0000 7f1286e00700 1 -- 172.21.15.153:0/1480293848 wait complete. 2024-02-28T16:13:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.597+0000 7f1286e00700 1 Processor -- start 2024-02-28T16:13:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.598+0000 7f1286e00700 1 -- start start 2024-02-28T16:13:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.598+0000 7f1286e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.598+0000 7f1286e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280075030 con 0x7f12800ffe20 2024-02-28T16:13:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.598+0000 7f127fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.599+0000 7f127fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:56812/0 (socket says 172.21.15.153:56812) 2024-02-28T16:13:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.599+0000 7f127fe00700 1 -- 172.21.15.153:0/2444902304 learned_addr learned my addr 172.21.15.153:0/2444902304 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.599+0000 7f127fe00700 1 -- 172.21.15.153:0/2444902304 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270009d00 con 0x7f12800ffe20 2024-02-28T16:13:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.599+0000 7f127fe00700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280074af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1270009fd0 tx=0x7f127000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.600+0000 7f127cc00700 1 -- 172.21.15.153:0/2444902304 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f127000e040 con 0x7f12800ffe20 2024-02-28T16:13:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.600+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1280073140 con 0x7f12800ffe20 2024-02-28T16:13:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.600+0000 7f127cc00700 1 -- 172.21.15.153:0/2444902304 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f127000bdc0 con 0x7f12800ffe20 2024-02-28T16:13:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.600+0000 7f127cc00700 1 -- 172.21.15.153:0/2444902304 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f127001da40 con 0x7f12800ffe20 2024-02-28T16:13:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.600+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1280073560 con 0x7f12800ffe20 2024-02-28T16:13:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.601+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280073f70 con 0x7f12800ffe20 2024-02-28T16:13:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.601+0000 7f127cc00700 1 -- 172.21.15.153:0/2444902304 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f127001d480 con 0x7f12800ffe20 2024-02-28T16:13:47.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.602+0000 7f127cc00700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 0x7f126403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:47.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.602+0000 7f127cc00700 1 -- 172.21.15.153:0/2444902304 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f127004c850 con 0x7f12800ffe20 2024-02-28T16:13:47.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.602+0000 7f127f400700 1 -- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 msgr2=0x7f126403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/3150303808 2024-02-28T16:13:47.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.602+0000 7f127f400700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 0x7f126403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:13:47.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.619+0000 7f127cc00700 1 -- 172.21.15.153:0/2444902304 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1270012b60 con 0x7f12800ffe20 2024-02-28T16:13:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.803+0000 7f127f400700 1 -- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 msgr2=0x7f126403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/3150303808 2024-02-28T16:13:47.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.803+0000 7f127f400700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 0x7f126403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:13:47.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.925+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f12801008b0 con 0x7f12800ffe20 2024-02-28T16:13:47.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.926+0000 7f127cc00700 1 -- 172.21.15.153:0/2444902304 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f12801008b0 con 0x7f12800ffe20 2024-02-28T16:13:47.918 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:47.918 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 msgr2=0x7f126403a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 0x7f126403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 msgr2=0x7f1280074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280074af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1270009fd0 tx=0x7f127000bb10 comp rx=0 tx=0).stop 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 shutdown_connections 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7f1264038530 0x7f126403a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 --2- 172.21.15.153:0/2444902304 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12800ffe20 0x7f1280074af0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 >> 172.21.15.153:0/2444902304 conn(0x7f12800fb3d0 msgr2=0x7f12800fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 shutdown_connections 2024-02-28T16:13:47.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:47.929+0000 7f1286e00700 1 -- 172.21.15.153:0/2444902304 wait complete. 2024-02-28T16:13:47.922 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:48.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:48 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2444902304' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:49.583 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:49.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:49.977 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:50.075 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:51.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.985+0000 7fb735e00700 1 -- 172.21.15.153:0/2025572497 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 msgr2=0x7fb7300731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.985+0000 7fb735e00700 1 --2- 172.21.15.153:0/2025572497 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb7300731e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb72400b0a0 tx=0x7fb72400b3b0 comp rx=0 tx=0).stop 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.985+0000 7fb735e00700 1 -- 172.21.15.153:0/2025572497 shutdown_connections 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.985+0000 7fb735e00700 1 --2- 172.21.15.153:0/2025572497 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb7300731e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.985+0000 7fb735e00700 1 -- 172.21.15.153:0/2025572497 >> 172.21.15.153:0/2025572497 conn(0x7fb7300fb1e0 msgr2=0x7fb7300fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.985+0000 7fb735e00700 1 -- 172.21.15.153:0/2025572497 shutdown_connections 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.985+0000 7fb735e00700 1 -- 172.21.15.153:0/2025572497 wait complete. 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.986+0000 7fb735e00700 1 Processor -- start 2024-02-28T16:13:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.986+0000 7fb735e00700 1 -- start start 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.987+0000 7fb735e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb730196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.987+0000 7fb735e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730197510 con 0x7fb730074d80 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.987+0000 7fb734a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb730196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.987+0000 7fb734a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb730196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:45262/0 (socket says 172.21.15.153:45262) 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.987+0000 7fb734a00700 1 -- 172.21.15.153:0/2009713386 learned_addr learned my addr 172.21.15.153:0/2009713386 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.987+0000 7fb734a00700 1 -- 172.21.15.153:0/2009713386 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724009d00 con 0x7fb730074d80 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.988+0000 7fb734a00700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb730196fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb724009fd0 tx=0x7fb72400bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.988+0000 7fb72d600700 1 -- 172.21.15.153:0/2009713386 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb72400e040 con 0x7fb730074d80 2024-02-28T16:13:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.988+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb730197710 con 0x7fb730074d80 2024-02-28T16:13:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.988+0000 7fb72d600700 1 -- 172.21.15.153:0/2009713386 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb72400bdc0 con 0x7fb730074d80 2024-02-28T16:13:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.988+0000 7fb72d600700 1 -- 172.21.15.153:0/2009713386 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb72401da40 con 0x7fb730074d80 2024-02-28T16:13:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.988+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb730197b30 con 0x7fb730074d80 2024-02-28T16:13:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.989+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb730190b30 con 0x7fb730074d80 2024-02-28T16:13:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.990+0000 7fb72d600700 1 -- 172.21.15.153:0/2009713386 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7fb72401d480 con 0x7fb730074d80 2024-02-28T16:13:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.990+0000 7fb72d600700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 0x7fb71803a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.990+0000 7fb72d600700 1 -- 172.21.15.153:0/2009713386 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb72404c960 con 0x7fb730074d80 2024-02-28T16:13:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.990+0000 7fb72fe00700 1 -- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 msgr2=0x7fb71803a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/3150303808 2024-02-28T16:13:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:51.990+0000 7fb72fe00700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 0x7fb71803a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:13:51.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.005+0000 7fb72d600700 1 -- 172.21.15.153:0/2009713386 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb72401c9b0 con 0x7fb730074d80 2024-02-28T16:13:52.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.191+0000 7fb72fe00700 1 -- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 msgr2=0x7fb71803a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.23:6800/3150303808 2024-02-28T16:13:52.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.191+0000 7fb72fe00700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 0x7fb71803a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:13:52.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.294+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb73002cc30 con 0x7fb730074d80 2024-02-28T16:13:52.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.295+0000 7fb72d600700 1 -- 172.21.15.153:0/2009713386 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb72401c3e0 con 0x7fb730074d80 2024-02-28T16:13:52.287 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:52.287 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:52.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 msgr2=0x7fb71803a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:13:52.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 0x7fb71803a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 msgr2=0x7fb730196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb730196fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb724009fd0 tx=0x7fb72400bb10 comp rx=0 tx=0).stop 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 shutdown_connections 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:6800/3150303808,v1:172.21.15.23:6801/3150303808] conn(0x7fb718038530 0x7fb71803a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 --2- 172.21.15.153:0/2009713386 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb730074d80 0x7fb730196fd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 >> 172.21.15.153:0/2009713386 conn(0x7fb7300fb1e0 msgr2=0x7fb7300fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 shutdown_connections 2024-02-28T16:13:52.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:52.298+0000 7fb735e00700 1 -- 172.21.15.153:0/2009713386 wait complete. 2024-02-28T16:13:52.291 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:52.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:52 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2009713386' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:54.057 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:54.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:54.427 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:54.526 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: Active manager daemon smithi023.bbebnt restarted 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: Activating manager daemon smithi023.bbebnt 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: mgrmap e15: smithi023.bbebnt(active, starting, since 0.00648591s) 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:13:55.371 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:13:55.372 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:13:56.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.483+0000 7fb5eba00700 1 -- 172.21.15.153:0/807544240 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 msgr2=0x7fb5e4073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:56.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.483+0000 7fb5eba00700 1 --2- 172.21.15.153:0/807544240 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4073160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009910 tx=0x7fb5d8009c20 comp rx=0 tx=0).stop 2024-02-28T16:13:56.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.483+0000 7fb5eba00700 1 -- 172.21.15.153:0/807544240 shutdown_connections 2024-02-28T16:13:56.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.483+0000 7fb5eba00700 1 --2- 172.21.15.153:0/807544240 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4073160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:56.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.483+0000 7fb5eba00700 1 -- 172.21.15.153:0/807544240 >> 172.21.15.153:0/807544240 conn(0x7fb5e40fb470 msgr2=0x7fb5e40fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:56.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.483+0000 7fb5eba00700 1 -- 172.21.15.153:0/807544240 shutdown_connections 2024-02-28T16:13:56.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.483+0000 7fb5eba00700 1 -- 172.21.15.153:0/807544240 wait complete. 2024-02-28T16:13:56.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.484+0000 7fb5eba00700 1 Processor -- start 2024-02-28T16:13:56.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.484+0000 7fb5eba00700 1 -- start start 2024-02-28T16:13:56.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.485+0000 7fb5eba00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:56.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.485+0000 7fb5eba00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41976c0 con 0x7fb5e4074c60 2024-02-28T16:13:56.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.485+0000 7fb5e9000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:56.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.485+0000 7fb5e9000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:45290/0 (socket says 172.21.15.153:45290) 2024-02-28T16:13:56.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.485+0000 7fb5e9000700 1 -- 172.21.15.153:0/2401555257 learned_addr learned my addr 172.21.15.153:0/2401555257 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:13:56.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.486+0000 7fb5e9000700 1 -- 172.21.15.153:0/2401555257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80095f0 con 0x7fb5e4074c60 2024-02-28T16:13:56.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.486+0000 7fb5e9000700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4197180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8005b40 tx=0x7fb5d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:56.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.487+0000 7fb5e1600700 1 -- 172.21.15.153:0/2401555257 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5d801d070 con 0x7fb5e4074c60 2024-02-28T16:13:56.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.487+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e41978c0 con 0x7fb5e4074c60 2024-02-28T16:13:56.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.487+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e4197d60 con 0x7fb5e4074c60 2024-02-28T16:13:56.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.487+0000 7fb5e1600700 1 -- 172.21.15.153:0/2401555257 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5d800be10 con 0x7fb5e4074c60 2024-02-28T16:13:56.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.487+0000 7fb5e1600700 1 -- 172.21.15.153:0/2401555257 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5d800f460 con 0x7fb5e4074c60 2024-02-28T16:13:56.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.488+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4005320 con 0x7fb5e4074c60 2024-02-28T16:13:56.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.488+0000 7fb5e1600700 1 -- 172.21.15.153:0/2401555257 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7fb5d800b960 con 0x7fb5e4074c60 2024-02-28T16:13:56.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.489+0000 7fb5e1600700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb5cc038380 0x7fb5cc03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:56.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.489+0000 7fb5e1600700 1 -- 172.21.15.153:0/2401555257 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb5d804c210 con 0x7fb5e4074c60 2024-02-28T16:13:56.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.490+0000 7fb5e3e00700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb5cc038380 0x7fb5cc03a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:56.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.491+0000 7fb5e3e00700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb5cc038380 0x7fb5cc03a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0006fd0 tx=0x7fb5d0006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:56.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.504+0000 7fb5e1600700 1 -- 172.21.15.153:0/2401555257 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb5d802bba0 con 0x7fb5e4074c60 2024-02-28T16:13:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.795+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb5c4005190 con 0x7fb5e4074c60 2024-02-28T16:13:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.798+0000 7fb5e1600700 1 -- 172.21.15.153:0/2401555257 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb5d8027030 con 0x7fb5e4074c60 2024-02-28T16:13:56.788 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:13:56.788 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:13:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb5cc038380 msgr2=0x7fb5cc03a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb5cc038380 0x7fb5cc03a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0006fd0 tx=0x7fb5d0006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 msgr2=0x7fb5e4197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4197180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8005b40 tx=0x7fb5d8004740 comp rx=0 tx=0).stop 2024-02-28T16:13:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 shutdown_connections 2024-02-28T16:13:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb5cc038380 0x7fb5cc03a830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 --2- 172.21.15.153:0/2401555257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb5e4074c60 0x7fb5e4197180 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.800+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 >> 172.21.15.153:0/2401555257 conn(0x7fb5e40fb470 msgr2=0x7fb5e40fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.801+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 shutdown_connections 2024-02-28T16:13:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:13:56.801+0000 7fb5eba00700 1 -- 172.21.15.153:0/2401555257 wait complete. 2024-02-28T16:13:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:13:57.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:57 smithi023 ceph-mon[29137]: [28/Feb/2024:16:13:55] ENGINE Bus STARTING 2024-02-28T16:13:57.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:57 smithi023 ceph-mon[29137]: [28/Feb/2024:16:13:55] ENGINE Serving on http://172.21.15.23:8765 2024-02-28T16:13:57.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:57 smithi023 ceph-mon[29137]: [28/Feb/2024:16:13:56] ENGINE Serving on https://172.21.15.23:7150 2024-02-28T16:13:57.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:57 smithi023 ceph-mon[29137]: [28/Feb/2024:16:13:56] ENGINE Bus STARTED 2024-02-28T16:13:57.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:57 smithi023 ceph-mon[29137]: mgrmap e16: smithi023.bbebnt(active, since 1.01324s) 2024-02-28T16:13:57.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:57 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:57.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:57 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2401555257' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:13:58.463 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:13:58.464 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:13:58.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:58 smithi023 ceph-mon[29137]: mgrmap e17: smithi023.bbebnt(active, since 2s) 2024-02-28T16:13:58.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:13:58 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:13:58.820 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:13:58.919 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:01.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.196+0000 7f8dd1000700 1 -- 172.21.15.153:0/4165164985 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 msgr2=0x7f8dcc102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:01.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.196+0000 7f8dd1000700 1 --2- 172.21.15.153:0/4165164985 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc102430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009910 tx=0x7f8dbc009c20 comp rx=0 tx=0).stop 2024-02-28T16:14:01.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.197+0000 7f8dd1000700 1 -- 172.21.15.153:0/4165164985 shutdown_connections 2024-02-28T16:14:01.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.197+0000 7f8dd1000700 1 --2- 172.21.15.153:0/4165164985 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc102430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.197+0000 7f8dd1000700 1 -- 172.21.15.153:0/4165164985 >> 172.21.15.153:0/4165164985 conn(0x7f8dcc0fd700 msgr2=0x7f8dcc0ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.197+0000 7f8dd1000700 1 -- 172.21.15.153:0/4165164985 shutdown_connections 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.197+0000 7f8dd1000700 1 -- 172.21.15.153:0/4165164985 wait complete. 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.198+0000 7f8dd1000700 1 Processor -- start 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.198+0000 7f8dd1000700 1 -- start start 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.198+0000 7f8dd1000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.198+0000 7f8dd1000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc1976e0 con 0x7f8dcc102020 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.199+0000 7f8dc9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.199+0000 7f8dc9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:34526/0 (socket says 172.21.15.153:34526) 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.199+0000 7f8dc9e00700 1 -- 172.21.15.153:0/2522728917 learned_addr learned my addr 172.21.15.153:0/2522728917 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.200+0000 7f8dc9e00700 1 -- 172.21.15.153:0/2522728917 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0095f0 con 0x7f8dcc102020 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.200+0000 7f8dc9e00700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc1971a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc005b40 tx=0x7f8dbc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.201+0000 7f8dc2a00700 1 -- 172.21.15.153:0/2522728917 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8dbc01d070 con 0x7f8dcc102020 2024-02-28T16:14:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.201+0000 7f8dc2a00700 1 -- 172.21.15.153:0/2522728917 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8dbc00be10 con 0x7f8dcc102020 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.201+0000 7f8dc2a00700 1 -- 172.21.15.153:0/2522728917 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8dbc00f460 con 0x7f8dcc102020 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.201+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc1978e0 con 0x7f8dcc102020 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.201+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc197d80 con 0x7f8dcc102020 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.202+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc190d00 con 0x7f8dcc102020 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.203+0000 7f8dc2a00700 1 -- 172.21.15.153:0/2522728917 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f8dbc0227e0 con 0x7f8dcc102020 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.203+0000 7f8dc2a00700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f8db00385d0 0x7f8db003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.203+0000 7f8dc2a00700 1 -- 172.21.15.153:0/2522728917 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f8dbc04c550 con 0x7f8dcc102020 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.204+0000 7f8dc9400700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f8db00385d0 0x7f8db003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.205+0000 7f8dc9400700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f8db00385d0 0x7f8db003aa80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8db8006fd0 tx=0x7f8db8006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.214+0000 7f8dc2a00700 1 -- 172.21.15.153:0/2522728917 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8dbc02ba00 con 0x7f8dcc102020 2024-02-28T16:14:01.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.517+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8dcc02cc30 con 0x7f8dcc102020 2024-02-28T16:14:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.519+0000 7f8dc2a00700 1 -- 172.21.15.153:0/2522728917 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8dbc027020 con 0x7f8dcc102020 2024-02-28T16:14:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:14:01.509 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f8db00385d0 msgr2=0x7f8db003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f8db00385d0 0x7f8db003aa80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8db8006fd0 tx=0x7f8db8006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 msgr2=0x7f8dcc1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc1971a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc005b40 tx=0x7f8dbc004740 comp rx=0 tx=0).stop 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 shutdown_connections 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f8db00385d0 0x7f8db003aa80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 --2- 172.21.15.153:0/2522728917 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dcc102020 0x7f8dcc1971a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 >> 172.21.15.153:0/2522728917 conn(0x7f8dcc0fd700 msgr2=0x7f8dcc0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.521+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 shutdown_connections 2024-02-28T16:14:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:01.522+0000 7f8dd1000700 1 -- 172.21.15.153:0/2522728917 wait complete. 2024-02-28T16:14:01.513 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:14:01.903 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:01 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2522728917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:03.404 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:03.404 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:03.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:03.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:04.154 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:04.261 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi023", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:14:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:05 smithi023 ceph-mon[29137]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:14:06.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:06 smithi023 ceph-mon[29137]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:06.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:06 smithi023 ceph-mon[29137]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.454+0000 7f1e4bc00700 1 -- 172.21.15.153:0/1939792104 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 msgr2=0x7f1e44100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.454+0000 7f1e4bc00700 1 --2- 172.21.15.153:0/1939792104 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44100230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009910 tx=0x7f1e38009c20 comp rx=0 tx=0).stop 2024-02-28T16:14:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.454+0000 7f1e4bc00700 1 -- 172.21.15.153:0/1939792104 shutdown_connections 2024-02-28T16:14:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.454+0000 7f1e4bc00700 1 --2- 172.21.15.153:0/1939792104 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44100230 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.454+0000 7f1e4bc00700 1 -- 172.21.15.153:0/1939792104 >> 172.21.15.153:0/1939792104 conn(0x7f1e440fb3d0 msgr2=0x7f1e440fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.454+0000 7f1e4bc00700 1 -- 172.21.15.153:0/1939792104 shutdown_connections 2024-02-28T16:14:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.454+0000 7f1e4bc00700 1 -- 172.21.15.153:0/1939792104 wait complete. 2024-02-28T16:14:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.455+0000 7f1e4bc00700 1 Processor -- start 2024-02-28T16:14:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.455+0000 7f1e4bc00700 1 -- start start 2024-02-28T16:14:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.456+0000 7f1e4bc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.456+0000 7f1e4bc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e441976b0 con 0x7f1e440ffe20 2024-02-28T16:14:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.456+0000 7f1e49200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.456+0000 7f1e49200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:34546/0 (socket says 172.21.15.153:34546) 2024-02-28T16:14:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.456+0000 7f1e49200700 1 -- 172.21.15.153:0/2588610771 learned_addr learned my addr 172.21.15.153:0/2588610771 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:14:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.457+0000 7f1e49200700 1 -- 172.21.15.153:0/2588610771 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380095f0 con 0x7f1e440ffe20 2024-02-28T16:14:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.457+0000 7f1e49200700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44197170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e380092e0 tx=0x7f1e38009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.458+0000 7f1e41600700 1 -- 172.21.15.153:0/2588610771 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e3801d070 con 0x7f1e440ffe20 2024-02-28T16:14:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.458+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e441978b0 con 0x7f1e440ffe20 2024-02-28T16:14:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.458+0000 7f1e41600700 1 -- 172.21.15.153:0/2588610771 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e3800be10 con 0x7f1e440ffe20 2024-02-28T16:14:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.458+0000 7f1e41600700 1 -- 172.21.15.153:0/2588610771 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e3800f460 con 0x7f1e440ffe20 2024-02-28T16:14:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.458+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e44197d50 con 0x7f1e440ffe20 2024-02-28T16:14:06.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.459+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44190e80 con 0x7f1e440ffe20 2024-02-28T16:14:06.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.459+0000 7f1e41600700 1 -- 172.21.15.153:0/2588610771 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f1e38022470 con 0x7f1e440ffe20 2024-02-28T16:14:06.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.460+0000 7f1e41600700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1e2c038580 0x7f1e2c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:06.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.460+0000 7f1e41600700 1 -- 172.21.15.153:0/2588610771 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f1e3804c4b0 con 0x7f1e440ffe20 2024-02-28T16:14:06.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.460+0000 7f1e43e00700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1e2c038580 0x7f1e2c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:06.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.461+0000 7f1e43e00700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1e2c038580 0x7f1e2c03aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e30006fd0 tx=0x7f1e30006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:06.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.477+0000 7f1e41600700 1 -- 172.21.15.153:0/2588610771 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1e38022790 con 0x7f1e440ffe20 2024-02-28T16:14:06.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.781+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1e4402cc30 con 0x7f1e440ffe20 2024-02-28T16:14:06.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.782+0000 7f1e41600700 1 -- 172.21.15.153:0/2588610771 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1e38027030 con 0x7f1e440ffe20 2024-02-28T16:14:06.772 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:14:06.772 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:06.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1e2c038580 msgr2=0x7f1e2c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:06.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1e2c038580 0x7f1e2c03aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e30006fd0 tx=0x7f1e30006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 msgr2=0x7f1e44197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44197170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e380092e0 tx=0x7f1e38009e60 comp rx=0 tx=0).stop 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 shutdown_connections 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1e2c038580 0x7f1e2c03aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 --2- 172.21.15.153:0/2588610771 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1e440ffe20 0x7f1e44197170 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 >> 172.21.15.153:0/2588610771 conn(0x7f1e440fb3d0 msgr2=0x7f1e440fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 shutdown_connections 2024-02-28T16:14:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:06.785+0000 7f1e4bc00700 1 -- 172.21.15.153:0/2588610771 wait complete. 2024-02-28T16:14:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:14:07.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:07 smithi023 ceph-mon[29137]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:14:07.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:07 smithi023 ceph-mon[29137]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:14:07.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:07 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2588610771' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:07.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:07 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:07.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:07 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:08.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:14:08.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:14:08.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:08.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:08.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:08.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:14:08.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T16:14:08.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:08.459 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:08.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:09.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:09 smithi023 ceph-mon[29137]: Deploying daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:14:10.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.796+0000 7ff2b6c00700 1 -- 172.21.15.153:0/1571848574 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 msgr2=0x7ff2b00734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.796+0000 7ff2b6c00700 1 --2- 172.21.15.153:0/1571848574 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b00734c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009910 tx=0x7ff2a0009c20 comp rx=0 tx=0).stop 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.796+0000 7ff2b6c00700 1 -- 172.21.15.153:0/1571848574 shutdown_connections 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.796+0000 7ff2b6c00700 1 --2- 172.21.15.153:0/1571848574 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b00734c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.796+0000 7ff2b6c00700 1 -- 172.21.15.153:0/1571848574 >> 172.21.15.153:0/1571848574 conn(0x7ff2b00fb970 msgr2=0x7ff2b00fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.796+0000 7ff2b6c00700 1 -- 172.21.15.153:0/1571848574 shutdown_connections 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.796+0000 7ff2b6c00700 1 -- 172.21.15.153:0/1571848574 wait complete. 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.798+0000 7ff2b6c00700 1 Processor -- start 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.798+0000 7ff2b6c00700 1 -- start start 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.798+0000 7ff2b6c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b01a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.798+0000 7ff2b6c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b01a1c50 con 0x7ff2b00730f0 2024-02-28T16:14:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.799+0000 7ff2afe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b01a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.799+0000 7ff2afe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b01a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:37252/0 (socket says 172.21.15.153:37252) 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.799+0000 7ff2afe00700 1 -- 172.21.15.153:0/3624657949 learned_addr learned my addr 172.21.15.153:0/3624657949 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.800+0000 7ff2afe00700 1 -- 172.21.15.153:0/3624657949 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00095f0 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.800+0000 7ff2afe00700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b01a1710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00092e0 tx=0x7ff2a0004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.801+0000 7ff2acc00700 1 -- 172.21.15.153:0/3624657949 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2a001d070 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.801+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b01a1df0 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.801+0000 7ff2acc00700 1 -- 172.21.15.153:0/3624657949 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2a000be10 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.801+0000 7ff2acc00700 1 -- 172.21.15.153:0/3624657949 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2a0022e10 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.801+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b01a2210 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.802+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b0062380 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.802+0000 7ff2acc00700 1 -- 172.21.15.153:0/3624657949 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7ff2a0022470 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.803+0000 7ff2acc00700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff294038530 0x7ff29403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.803+0000 7ff2acc00700 1 -- 172.21.15.153:0/3624657949 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff2a004c520 con 0x7ff2b00730f0 2024-02-28T16:14:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.804+0000 7ff2af400700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff294038530 0x7ff29403a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:11.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.805+0000 7ff2af400700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff294038530 0x7ff29403a9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff29c006fd0 tx=0x7ff29c006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:11.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:11.818+0000 7ff2acc00700 1 -- 172.21.15.153:0/3624657949 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff2a002a540 con 0x7ff2b00730f0 2024-02-28T16:14:12.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.123+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff2b019cca0 con 0x7ff2b00730f0 2024-02-28T16:14:12.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.124+0000 7ff2acc00700 1 -- 172.21.15.153:0/3624657949 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff2a0027030 con 0x7ff2b00730f0 2024-02-28T16:14:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:14:12.115 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff294038530 msgr2=0x7ff29403a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff294038530 0x7ff29403a9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff29c006fd0 tx=0x7ff29c006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 msgr2=0x7ff2b01a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b01a1710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00092e0 tx=0x7ff2a0004c80 comp rx=0 tx=0).stop 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 shutdown_connections 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff294038530 0x7ff29403a9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 --2- 172.21.15.153:0/3624657949 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff2b00730f0 0x7ff2b01a1710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 >> 172.21.15.153:0/3624657949 conn(0x7ff2b00fb970 msgr2=0x7ff2b00fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:12.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 shutdown_connections 2024-02-28T16:14:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:12.127+0000 7ff2b6c00700 1 -- 172.21.15.153:0/3624657949 wait complete. 2024-02-28T16:14:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:14:13.156 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:13.156 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:13.156 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:13.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:13.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:14:13.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T16:14:13.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:13.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: Deploying daemon crash.smithi153 on smithi153 2024-02-28T16:14:13.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:12 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/3624657949' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:13.814 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:13.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:14.244 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:16.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:16 smithi023 ceph-mon[29137]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:16.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:16 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:16.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:16 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:16.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:16 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.694+0000 7fa679a00700 1 -- 172.21.15.153:0/3060996676 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 msgr2=0x7fa674100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.694+0000 7fa679a00700 1 --2- 172.21.15.153:0/3060996676 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674100460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa664009910 tx=0x7fa664009c20 comp rx=0 tx=0).stop 2024-02-28T16:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.694+0000 7fa679a00700 1 -- 172.21.15.153:0/3060996676 shutdown_connections 2024-02-28T16:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.694+0000 7fa679a00700 1 --2- 172.21.15.153:0/3060996676 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674100460 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.694+0000 7fa679a00700 1 -- 172.21.15.153:0/3060996676 >> 172.21.15.153:0/3060996676 conn(0x7fa6740fb970 msgr2=0x7fa6740fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.694+0000 7fa679a00700 1 -- 172.21.15.153:0/3060996676 shutdown_connections 2024-02-28T16:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.694+0000 7fa679a00700 1 -- 172.21.15.153:0/3060996676 wait complete. 2024-02-28T16:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.695+0000 7fa679a00700 1 Processor -- start 2024-02-28T16:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.695+0000 7fa679a00700 1 -- start start 2024-02-28T16:14:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.696+0000 7fa679a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.696+0000 7fa679a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674197a60 con 0x7fa674100090 2024-02-28T16:14:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.696+0000 7fa672a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.696+0000 7fa672a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:37274/0 (socket says 172.21.15.153:37274) 2024-02-28T16:14:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.696+0000 7fa672a00700 1 -- 172.21.15.153:0/2256688595 learned_addr learned my addr 172.21.15.153:0/2256688595 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:14:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.697+0000 7fa672a00700 1 -- 172.21.15.153:0/2256688595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640095f0 con 0x7fa674100090 2024-02-28T16:14:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.697+0000 7fa672a00700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674197520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa664005b40 tx=0x7fa664004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.698+0000 7fa66b400700 1 -- 172.21.15.153:0/2256688595 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa66401d070 con 0x7fa674100090 2024-02-28T16:14:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.698+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa674197c60 con 0x7fa674100090 2024-02-28T16:14:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.698+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674198020 con 0x7fa674100090 2024-02-28T16:14:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.698+0000 7fa66b400700 1 -- 172.21.15.153:0/2256688595 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa66400be10 con 0x7fa674100090 2024-02-28T16:14:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.698+0000 7fa66b400700 1 -- 172.21.15.153:0/2256688595 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa664022d90 con 0x7fa674100090 2024-02-28T16:14:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.699+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa674062380 con 0x7fa674100090 2024-02-28T16:14:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.700+0000 7fa66b400700 1 -- 172.21.15.153:0/2256688595 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fa664022650 con 0x7fa674100090 2024-02-28T16:14:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.700+0000 7fa66b400700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa658038580 0x7fa65803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.700+0000 7fa66b400700 1 -- 172.21.15.153:0/2256688595 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa66404c580 con 0x7fa674100090 2024-02-28T16:14:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.701+0000 7fa672000700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa658038580 0x7fa65803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.702+0000 7fa672000700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa658038580 0x7fa65803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa660006fd0 tx=0x7fa660006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:16.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:16.716+0000 7fa66b400700 1 -- 172.21.15.153:0/2256688595 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa6640213d0 con 0x7fa674100090 2024-02-28T16:14:17.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.032+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa674198880 con 0x7fa674100090 2024-02-28T16:14:17.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.033+0000 7fa66b400700 1 -- 172.21.15.153:0/2256688595 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa6640213d0 con 0x7fa674100090 2024-02-28T16:14:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:14:17.024 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:17.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.035+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa658038580 msgr2=0x7fa65803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:17.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.035+0000 7fa679a00700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa658038580 0x7fa65803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa660006fd0 tx=0x7fa660006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.035+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 msgr2=0x7fa674197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.035+0000 7fa679a00700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674197520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa664005b40 tx=0x7fa664004c80 comp rx=0 tx=0).stop 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.036+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 shutdown_connections 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.036+0000 7fa679a00700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa658038580 0x7fa65803aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.036+0000 7fa679a00700 1 --2- 172.21.15.153:0/2256688595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa674100090 0x7fa674197520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.036+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 >> 172.21.15.153:0/2256688595 conn(0x7fa6740fb970 msgr2=0x7fa674102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.036+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 shutdown_connections 2024-02-28T16:14:17.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:17.036+0000 7fa679a00700 1 -- 172.21.15.153:0/2256688595 wait complete. 2024-02-28T16:14:17.029 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:14:17.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:17 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:17.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:17 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:17.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:17 smithi023 ceph-mon[29137]: Deploying daemon node-exporter.smithi153 on smithi153 2024-02-28T16:14:17.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:17 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2256688595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:18.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:18 smithi023 ceph-mon[29137]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:18.926 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:18.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:20.096 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:20.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:20 smithi023 ceph-mon[29137]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:20.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:20 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:22.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:22.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:22.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:22.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:22.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:22.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:14:22.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-28T16:14:22.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:14:22.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.786+0000 7f80d8800700 1 -- 172.21.15.153:0/2385049071 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 msgr2=0x7f80d0100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.786+0000 7f80d8800700 1 --2- 172.21.15.153:0/2385049071 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0100460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009910 tx=0x7f80c4009c20 comp rx=0 tx=0).stop 2024-02-28T16:14:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.786+0000 7f80d8800700 1 -- 172.21.15.153:0/2385049071 shutdown_connections 2024-02-28T16:14:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.786+0000 7f80d8800700 1 --2- 172.21.15.153:0/2385049071 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0100460 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.786+0000 7f80d8800700 1 -- 172.21.15.153:0/2385049071 >> 172.21.15.153:0/2385049071 conn(0x7f80d00fb970 msgr2=0x7f80d00fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.787+0000 7f80d8800700 1 -- 172.21.15.153:0/2385049071 shutdown_connections 2024-02-28T16:14:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.787+0000 7f80d8800700 1 -- 172.21.15.153:0/2385049071 wait complete. 2024-02-28T16:14:22.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.788+0000 7f80d8800700 1 Processor -- start 2024-02-28T16:14:22.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.789+0000 7f80d8800700 1 -- start start 2024-02-28T16:14:22.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.789+0000 7f80d8800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:22.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.789+0000 7f80d8800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0197a60 con 0x7f80d0100090 2024-02-28T16:14:22.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.790+0000 7f80d5e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:22.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.790+0000 7f80d5e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:54842/0 (socket says 172.21.15.153:54842) 2024-02-28T16:14:22.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.790+0000 7f80d5e00700 1 -- 172.21.15.153:0/408857956 learned_addr learned my addr 172.21.15.153:0/408857956 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:14:22.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.791+0000 7f80d5e00700 1 -- 172.21.15.153:0/408857956 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40095f0 con 0x7f80d0100090 2024-02-28T16:14:22.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.791+0000 7f80d5e00700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0197520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80c40092e0 tx=0x7f80c4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:22.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.792+0000 7f80caa00700 1 -- 172.21.15.153:0/408857956 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80c401d070 con 0x7f80d0100090 2024-02-28T16:14:22.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.792+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d0197c60 con 0x7f80d0100090 2024-02-28T16:14:22.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.792+0000 7f80caa00700 1 -- 172.21.15.153:0/408857956 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f80c400be10 con 0x7f80d0100090 2024-02-28T16:14:22.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.792+0000 7f80caa00700 1 -- 172.21.15.153:0/408857956 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80c4022e10 con 0x7f80d0100090 2024-02-28T16:14:22.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.792+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d0198080 con 0x7f80d0100090 2024-02-28T16:14:22.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.793+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d0062380 con 0x7f80d0100090 2024-02-28T16:14:22.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.794+0000 7f80caa00700 1 -- 172.21.15.153:0/408857956 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f80c4022470 con 0x7f80d0100090 2024-02-28T16:14:22.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.794+0000 7f80caa00700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f80b8038530 0x7f80b803a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:22.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.794+0000 7f80caa00700 1 -- 172.21.15.153:0/408857956 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f80c404c430 con 0x7f80d0100090 2024-02-28T16:14:22.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.795+0000 7f80d5400700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f80b8038530 0x7f80b803a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:22.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.796+0000 7f80d5400700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f80b8038530 0x7f80b803a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f80c0006fd0 tx=0x7f80c0006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:22.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:22.809+0000 7f80caa00700 1 -- 172.21.15.153:0/408857956 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f80c402a540 con 0x7f80d0100090 2024-02-28T16:14:23.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.111+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f80d019c010 con 0x7f80d0100090 2024-02-28T16:14:23.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.112+0000 7f80caa00700 1 -- 172.21.15.153:0/408857956 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f80c4027030 con 0x7f80d0100090 2024-02-28T16:14:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:14:23.104 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f80b8038530 msgr2=0x7f80b803a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f80b8038530 0x7f80b803a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f80c0006fd0 tx=0x7f80c0006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 msgr2=0x7f80d0197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0197520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80c40092e0 tx=0x7f80c4004c80 comp rx=0 tx=0).stop 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 shutdown_connections 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f80b8038530 0x7f80b803a9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 --2- 172.21.15.153:0/408857956 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f80d0100090 0x7f80d0197520 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 >> 172.21.15.153:0/408857956 conn(0x7f80d00fb970 msgr2=0x7f80d01039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 shutdown_connections 2024-02-28T16:14:23.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:23.115+0000 7f80d8800700 1 -- 172.21.15.153:0/408857956 wait complete. 2024-02-28T16:14:23.108 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:14:23.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:23 smithi023 ceph-mon[29137]: Deploying daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:14:23.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:23 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/408857956' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:24.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:24 smithi023 ceph-mon[29137]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:25.389 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:25.390 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:26.218 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:26 smithi023 ceph-mon[29137]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:14:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: Deploying daemon mon.smithi153 on smithi153 2024-02-28T16:14:27.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:27 smithi023 ceph-mon[29137]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:29.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.024+0000 7fde25600700 1 -- 172.21.15.153:0/2823421351 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 msgr2=0x7fde20101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:29.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.024+0000 7fde25600700 1 --2- 172.21.15.153:0/2823421351 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde20101300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde10009910 tx=0x7fde10009c20 comp rx=0 tx=0).stop 2024-02-28T16:14:29.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.024+0000 7fde25600700 1 -- 172.21.15.153:0/2823421351 shutdown_connections 2024-02-28T16:14:29.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.024+0000 7fde25600700 1 --2- 172.21.15.153:0/2823421351 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde20101300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:29.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.024+0000 7fde25600700 1 -- 172.21.15.153:0/2823421351 >> 172.21.15.153:0/2823421351 conn(0x7fde20074af0 msgr2=0x7fde20074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:29.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.024+0000 7fde25600700 1 -- 172.21.15.153:0/2823421351 shutdown_connections 2024-02-28T16:14:29.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.024+0000 7fde25600700 1 -- 172.21.15.153:0/2823421351 wait complete. 2024-02-28T16:14:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.026+0000 7fde25600700 1 Processor -- start 2024-02-28T16:14:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.026+0000 7fde25600700 1 -- start start 2024-02-28T16:14:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.027+0000 7fde25600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde200fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.027+0000 7fde25600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde20100ce0 con 0x7fde20100f30 2024-02-28T16:14:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.027+0000 7fde1ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde200fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.027+0000 7fde1ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde200fed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.153:54866/0 (socket says 172.21.15.153:54866) 2024-02-28T16:14:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.027+0000 7fde1ea00700 1 -- 172.21.15.153:0/1155472964 learned_addr learned my addr 172.21.15.153:0/1155472964 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:14:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.028+0000 7fde1ea00700 1 -- 172.21.15.153:0/1155472964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100095f0 con 0x7fde20100f30 2024-02-28T16:14:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.028+0000 7fde1ea00700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde200fed60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde10005b40 tx=0x7fde10004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.029+0000 7fde17400700 1 -- 172.21.15.153:0/1155472964 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde1001d070 con 0x7fde20100f30 2024-02-28T16:14:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.029+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde200ff2a0 con 0x7fde20100f30 2024-02-28T16:14:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.029+0000 7fde17400700 1 -- 172.21.15.153:0/1155472964 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fde1000be10 con 0x7fde20100f30 2024-02-28T16:14:29.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.029+0000 7fde17400700 1 -- 172.21.15.153:0/1155472964 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde10022d90 con 0x7fde20100f30 2024-02-28T16:14:29.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.029+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde200ff720 con 0x7fde20100f30 2024-02-28T16:14:29.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.031+0000 7fde17400700 1 -- 172.21.15.153:0/1155472964 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fde10022650 con 0x7fde20100f30 2024-02-28T16:14:29.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.031+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde20107610 con 0x7fde20100f30 2024-02-28T16:14:29.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.031+0000 7fde17400700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fde040385d0 0x7fde0403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:29.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.031+0000 7fde17400700 1 -- 172.21.15.153:0/1155472964 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fde1004c540 con 0x7fde20100f30 2024-02-28T16:14:29.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.032+0000 7fde1e000700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fde040385d0 0x7fde0403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.033+0000 7fde1e000700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fde040385d0 0x7fde0403aa80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde0c006fd0 tx=0x7fde0c006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:29.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.046+0000 7fde17400700 1 -- 172.21.15.153:0/1155472964 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fde100213d0 con 0x7fde20100f30 2024-02-28T16:14:29.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.341+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde20062380 con 0x7fde20100f30 2024-02-28T16:14:29.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.343+0000 7fde17400700 1 -- 172.21.15.153:0/1155472964 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fde100213d0 con 0x7fde20100f30 2024-02-28T16:14:29.334 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:14:29.334 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:10:59.880374Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:29.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fde040385d0 msgr2=0x7fde0403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:29.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fde040385d0 0x7fde0403aa80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde0c006fd0 tx=0x7fde0c006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:29.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 msgr2=0x7fde200fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde200fed60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde10005b40 tx=0x7fde10004c80 comp rx=0 tx=0).stop 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 shutdown_connections 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fde040385d0 0x7fde0403aa80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 --2- 172.21.15.153:0/1155472964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde20100f30 0x7fde200fed60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 >> 172.21.15.153:0/1155472964 conn(0x7fde20074af0 msgr2=0x7fde20104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 shutdown_connections 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:29.346+0000 7fde25600700 1 -- 172.21.15.153:0/1155472964 wait complete. 2024-02-28T16:14:29.338 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-02-28T16:14:30.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:30 smithi023 ceph-mon[29137]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:30.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:30 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/1155472964' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:30.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:30 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:31.222 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:31.223 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:31.633 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:14:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:32 smithi023 ceph-mon[29137]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 podman[35302]: 2024-02-28 16:14:33.29612795 +0000 UTC m=+0.158209717 container create e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_BRANCH=HEAD) 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 podman[35302]: 2024-02-28 16:14:33.63476672 +0000 UTC m=+0.496848558 container init e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, ceph=True, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 podman[35302]: 2024-02-28 16:14:33.645183647 +0000 UTC m=+0.507265430 container start e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212) 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pidfile_write: ignore empty --pid-file 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: load: jerasure load: lrc 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Git sha 0 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Compile date 2023-08-03 19:21:13 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: DB SUMMARY 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: DB Session ID: 0I28HSD2UEGG260L9LL8 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-02-28T16:14:33.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi153/store.db dir, Total Num: 0, files: 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi153/store.db: 000004.log size: 511 ; 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.env: 0x55e16fb14720 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.info_log: 0x55e1720572c0 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:14:33.900 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.statistics: (nil) 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.use_fsync: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:14:33.901 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.db_log_dir: 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.wal_dir: 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.write_buffer_manager: 0x55e1712c83c0 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:14:33.902 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.unordered_write: 0 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.row_cache: None 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.wal_filter: None 2024-02-28T16:14:33.903 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.wal_compression: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:14:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:14:33.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_open_files: -1 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Compression algorithms supported: 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kZSTD supported: 0 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:14:33.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000005 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.merge_operator: 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_filter: None 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e1720573c0) 2024-02-28T16:14:33.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_type: 0 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_index_type: 0 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_shortening: 1 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: checksum: 4 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: no_block_cache: 0 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache: 0x55e171369350 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_options: 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: capacity : 536870912 2024-02-28T16:14:33.908 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: num_shard_bits : 4 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: strict_capacity_limit : 0 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_compressed: (nil) 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: persistent_cache: (nil) 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size: 4096 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size_deviation: 10 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_restart_interval: 16 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_block_restart_interval: 1 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: metadata_block_size: 4096 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: partition_filters: 0 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: use_delta_encoding: 1 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: filter_policy: bloomfilter 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: whole_key_filtering: 1 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: verify_compression: 0 2024-02-28T16:14:33.909 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:14:33.910 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: format_version: 5 2024-02-28T16:14:33.910 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_index_compression: 1 2024-02-28T16:14:33.910 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_align: 0 2024-02-28T16:14:33.910 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_auto_readahead_size: 262144 2024-02-28T16:14:33.910 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: prepopulate_block_cache: 0 2024-02-28T16:14:33.910 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:14:33.910 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:14:33.911 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression: NoCompression 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.num_levels: 7 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:14:33.912 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:14:33.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:14:33.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:14:33.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.ttl: 2592000 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:14:33.916 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 41ba2316-185e-431d-b6d1-b56e38d07cfa 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136873700227, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136873701541, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709136873, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "41ba2316-185e-431d-b6d1-b56e38d07cfa", "db_session_id": "0I28HSD2UEGG260L9LL8", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:14:33.917 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136873701783, "job": 1, "event": "recovery_finished"} 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi153/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e171406000 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: DB pointer 0x55e1713f2000 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** DB Stats ** 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:14:33.918 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:14:33.919 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Block cache BinnedLRUCache@0x55e171369350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:14:33.920 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153 does not exist in monmap, will attempt to join an existing cluster 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: using public_addr v2:172.21.15.153:0/0 -> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: starting mon.smithi153 rank -1 at public addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] at bind addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi153 fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(???) e0 preinit fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 bash[35302]: e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 systemd[1]: Started Ceph mon.smithi153 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).mds e1 new map 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).mds e1 print_map 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: e1 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: legacy client fscid: -1 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: No filesystems configured 2024-02-28T16:14:33.921 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mgrmap e17: smithi023.bbebnt(active, since 2s) 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2522728917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:33.922 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi023", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:33.923 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2588610771' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:33.924 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Deploying daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Deploying daemon crash.smithi153 on smithi153 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/3624657949' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.925 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Deploying daemon node-exporter.smithi153 on smithi153 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2256688595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-28T16:14:33.926 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Deploying daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/408857956' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: Deploying daemon mon.smithi153 on smithi153 2024-02-28T16:14:33.927 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/1155472964' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expand map: {default=false} 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta from 'false' to 'false' 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expanded map: {default=false} 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expand map: {default=info} 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta from 'info' to 'info' 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expanded map: {default=info} 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expand map: {default=daemon} 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta from 'daemon' to 'daemon' 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expanded map: {default=daemon} 2024-02-28T16:14:33.928 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expand map: {default=debug} 2024-02-28T16:14:33.929 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta from 'debug' to 'debug' 2024-02-28T16:14:33.929 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: expand_channel_meta expanded map: {default=debug} 2024-02-28T16:14:33.929 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:33 smithi153 ceph-mon[35341]: mon.smithi153@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-02-28T16:14:39.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: mon.smithi023 calling monitor election 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: mon.smithi153 calling monitor election 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:39.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: mon.smithi023 is new leader, mons smithi023,smithi153 in quorum (ranks 0,1) 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: monmap e2: 2 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: fsmap 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: mgrmap e17: smithi023.bbebnt(active, since 43s) 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: overall HEALTH_OK 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:39.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: mon.smithi023 calling monitor election 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: mon.smithi153 calling monitor election 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: mon.smithi023 is new leader, mons smithi023,smithi153 in quorum (ranks 0,1) 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: monmap e2: 2 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: fsmap 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: mgrmap e17: smithi023.bbebnt(active, since 43s) 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: overall HEALTH_OK 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/164088259' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:39.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: mgrmap e18: smithi023.bbebnt(active, since 43s), standbys: smithi153.qlkchp 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:40.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: mgrmap e18: smithi023.bbebnt(active, since 43s), standbys: smithi153.qlkchp 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:40.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:14:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.234+0000 7f20b3a00700 1 -- 172.21.15.153:0/4117141661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 msgr2=0x7f2094008690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.234+0000 7f20b3a00700 1 --2- 172.21.15.153:0/4117141661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 0x7f2094008690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f20ac101030 tx=0x7f20a000fe90 comp rx=0 tx=0).stop 2024-02-28T16:14:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.234+0000 7f20b3a00700 1 -- 172.21.15.153:0/4117141661 shutdown_connections 2024-02-28T16:14:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.234+0000 7f20b3a00700 1 --2- 172.21.15.153:0/4117141661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 0x7f2094008690 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.234+0000 7f20b3a00700 1 -- 172.21.15.153:0/4117141661 >> 172.21.15.153:0/4117141661 conn(0x7f20ac0fba50 msgr2=0x7f20ac0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.234+0000 7f20b3a00700 1 -- 172.21.15.153:0/4117141661 shutdown_connections 2024-02-28T16:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.234+0000 7f20b3a00700 1 -- 172.21.15.153:0/4117141661 wait complete. 2024-02-28T16:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.236+0000 7f20b3a00700 1 Processor -- start 2024-02-28T16:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.236+0000 7f20b3a00700 1 -- start start 2024-02-28T16:14:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20b3a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 0x7f20ac19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20b3a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 0x7f20ac197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20b3a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac19e1e0 con 0x7f2094006210 2024-02-28T16:14:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20b3a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac197c50 con 0x7f20ac19dbd0 2024-02-28T16:14:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20abe00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 0x7f20ac197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20abe00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 0x7f20ac197710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35488/0 (socket says 172.21.15.153:35488) 2024-02-28T16:14:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20abe00700 1 -- 172.21.15.153:0/2561548810 learned_addr learned my addr 172.21.15.153:0/2561548810 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:14:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.237+0000 7f20abe00700 1 -- 172.21.15.153:0/2561548810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 msgr2=0x7f20ac197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-28T16:14:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.238+0000 7f20abe00700 1 -- 172.21.15.153:0/2561548810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 msgr2=0x7f20ac197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-28T16:14:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.238+0000 7f20abe00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 0x7f20ac197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-28T16:14:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.238+0000 7f20b1000700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 0x7f20ac19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.238+0000 7f20abe00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 0x7f20ac197710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.238+0000 7f20b1000700 1 -- 172.21.15.153:0/2561548810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 msgr2=0x7f20ac197710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.238+0000 7f20b1000700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 0x7f20ac197710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.238+0000 7f20b1000700 1 -- 172.21.15.153:0/2561548810 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a000f8e0 con 0x7f2094006210 2024-02-28T16:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.239+0000 7f20b1000700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 0x7f20ac19d690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f20a0010010 tx=0x7f20a001d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.239+0000 7f20a9600700 1 -- 172.21.15.153:0/2561548810 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a0005da0 con 0x7f2094006210 2024-02-28T16:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.240+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac197e70 con 0x7f2094006210 2024-02-28T16:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.240+0000 7f20a9600700 1 -- 172.21.15.153:0/2561548810 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f20a0005430 con 0x7f2094006210 2024-02-28T16:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.240+0000 7f20a9600700 1 -- 172.21.15.153:0/2561548810 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a0011790 con 0x7f2094006210 2024-02-28T16:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.240+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac1983c0 con 0x7f2094006210 2024-02-28T16:14:40.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.241+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac062380 con 0x7f2094006210 2024-02-28T16:14:40.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.245+0000 7f20a9600700 1 -- 172.21.15.153:0/2561548810 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f20a0003bc0 con 0x7f2094006210 2024-02-28T16:14:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.246+0000 7f20a9600700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f208c06c7a0 0x7f208c06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.246+0000 7f20a9600700 1 -- 172.21.15.153:0/2561548810 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f20a008da40 con 0x7f2094006210 2024-02-28T16:14:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.246+0000 7f20abe00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f208c06c7a0 0x7f208c06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.248+0000 7f20abe00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f208c06c7a0 0x7f208c06ec50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2098009180 tx=0x7f2098008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.258+0000 7f20a9600700 1 -- 172.21.15.153:0/2561548810 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f20a005cda0 con 0x7f2094006210 2024-02-28T16:14:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.563+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f20ac1a24a0 con 0x7f2094006210 2024-02-28T16:14:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.564+0000 7f20a9600700 1 -- 172.21.15.153:0/2561548810 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f20a0035020 con 0x7f2094006210 2024-02-28T16:14:40.556 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-02-28T16:14:40.556 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","modified":"2024-02-28T16:14:33.756625Z","created":"2024-02-28T16:10:59.880374Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi023","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:3300","nonce":0},{"type":"v1","addr":"172.21.15.23:6789","nonce":0}]},"addr":"172.21.15.23:6789/0","public_addr":"172.21.15.23:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi153","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-28T16:14:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f208c06c7a0 msgr2=0x7f208c06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f208c06c7a0 0x7f208c06ec50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2098009180 tx=0x7f2098008040 comp rx=0 tx=0).stop 2024-02-28T16:14:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 msgr2=0x7f20ac19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 0x7f20ac19d690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f20a0010010 tx=0x7f20a001d9b0 comp rx=0 tx=0).stop 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 shutdown_connections 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f208c06c7a0 0x7f208c06ec50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2094006210 0x7f20ac19d690 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 --2- 172.21.15.153:0/2561548810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac19dbd0 0x7f20ac197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 >> 172.21.15.153:0/2561548810 conn(0x7f20ac0fba50 msgr2=0x7f20ac0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 shutdown_connections 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:14:40.567+0000 7f20b3a00700 1 -- 172.21.15.153:0/2561548810 wait complete. 2024-02-28T16:14:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-02-28T16:14:41.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:41.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:41.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:40 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2561548810' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:41.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:41.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:41.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:40 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2561548810' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:41.750 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-28T16:14:41.750 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph config generate-minimal-conf 2024-02-28T16:14:42.113 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:41 smithi153 ceph-mon[35341]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:42.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:41 smithi023 ceph-mon[29137]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:42.178 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:14:44.107 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:14:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:14:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:43 smithi023 ceph-mon[29137]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:14:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:14:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:44.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:43 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:44.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.574+0000 7fa2f9800700 1 -- 172.21.15.23:0/1570026675 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 msgr2=0x7fa2f40734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:44.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.574+0000 7fa2f9800700 1 --2- 172.21.15.23:0/1570026675 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f40734c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009910 tx=0x7fa2e4009c20 comp rx=0 tx=0).stop 2024-02-28T16:14:44.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.574+0000 7fa2f9800700 1 -- 172.21.15.23:0/1570026675 shutdown_connections 2024-02-28T16:14:44.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.574+0000 7fa2f9800700 1 --2- 172.21.15.23:0/1570026675 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f40734c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:44.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.574+0000 7fa2f9800700 1 -- 172.21.15.23:0/1570026675 >> 172.21.15.23:0/1570026675 conn(0x7fa2f40fb970 msgr2=0x7fa2f40fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:44.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.575+0000 7fa2f9800700 1 -- 172.21.15.23:0/1570026675 shutdown_connections 2024-02-28T16:14:44.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.575+0000 7fa2f9800700 1 -- 172.21.15.23:0/1570026675 wait complete. 2024-02-28T16:14:44.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.576+0000 7fa2f9800700 1 Processor -- start 2024-02-28T16:14:44.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.576+0000 7fa2f9800700 1 -- start start 2024-02-28T16:14:44.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.576+0000 7fa2f9800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f4197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:44.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.577+0000 7fa2f9800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f4197c30 0x7fa2f419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:44.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.577+0000 7fa2f9800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4198240 con 0x7fa2f40730f0 2024-02-28T16:14:44.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.577+0000 7fa2f9800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f419c550 con 0x7fa2f4197c30 2024-02-28T16:14:44.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.577+0000 7fa2f2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f4197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:44.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.577+0000 7fa2f2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f4197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36018/0 (socket says 172.21.15.23:36018) 2024-02-28T16:14:44.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.577+0000 7fa2f2a00700 1 -- 172.21.15.23:0/2376319994 learned_addr learned my addr 172.21.15.23:0/2376319994 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:14:44.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.577+0000 7fa2f2000700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f4197c30 0x7fa2f419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:44.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2f2a00700 1 -- 172.21.15.23:0/2376319994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f4197c30 msgr2=0x7fa2f419c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:44.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2f2a00700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f4197c30 0x7fa2f419c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:44.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2f2a00700 1 -- 172.21.15.23:0/2376319994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40095f0 con 0x7fa2f40730f0 2024-02-28T16:14:44.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2f2a00700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f4197660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4006010 tx=0x7fa2e400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:44.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2eb400700 1 -- 172.21.15.23:0/2376319994 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e401d070 con 0x7fa2f40730f0 2024-02-28T16:14:44.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2eb400700 1 -- 172.21.15.23:0/2376319994 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2e4005140 con 0x7fa2f40730f0 2024-02-28T16:14:44.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2eb400700 1 -- 172.21.15.23:0/2376319994 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e4017440 con 0x7fa2f40730f0 2024-02-28T16:14:44.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.578+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f419c7d0 con 0x7fa2f40730f0 2024-02-28T16:14:44.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.579+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f419cc70 con 0x7fa2f40730f0 2024-02-28T16:14:44.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.580+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f41098d0 con 0x7fa2f40730f0 2024-02-28T16:14:44.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.581+0000 7fa2eb400700 1 -- 172.21.15.23:0/2376319994 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fa2e400f460 con 0x7fa2f40730f0 2024-02-28T16:14:44.573 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.582+0000 7fa2eb400700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa2d806c760 0x7fa2d806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:44.573 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.582+0000 7fa2eb400700 1 -- 172.21.15.23:0/2376319994 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa2e408bb50 con 0x7fa2f40730f0 2024-02-28T16:14:44.573 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.583+0000 7fa2f2000700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa2d806c760 0x7fa2d806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:44.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.583+0000 7fa2f2000700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa2d806c760 0x7fa2d806ec10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009850 tx=0x7fa2e0008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:44.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.588+0000 7fa2eb400700 1 -- 172.21.15.23:0/2376319994 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa2e4057270 con 0x7fa2f40730f0 2024-02-28T16:14:44.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.811+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa2f41989c0 con 0x7fa2f40730f0 2024-02-28T16:14:44.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.811+0000 7fa2eb400700 1 -- 172.21.15.23:0/2376319994 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7fa2e4026090 con 0x7fa2f40730f0 2024-02-28T16:14:44.803 INFO:teuthology.orchestra.run.smithi023.stdout:# minimal ceph.conf for dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:14:44.803 INFO:teuthology.orchestra.run.smithi023.stdout:[global] 2024-02-28T16:14:44.803 INFO:teuthology.orchestra.run.smithi023.stdout: fsid = dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:14:44.803 INFO:teuthology.orchestra.run.smithi023.stdout: mon_host = [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-02-28T16:14:44.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa2d806c760 msgr2=0x7fa2d806ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:44.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa2d806c760 0x7fa2d806ec10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009850 tx=0x7fa2e0008040 comp rx=0 tx=0).stop 2024-02-28T16:14:44.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 msgr2=0x7fa2f4197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:44.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f4197660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4006010 tx=0x7fa2e400bda0 comp rx=0 tx=0).stop 2024-02-28T16:14:44.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 shutdown_connections 2024-02-28T16:14:44.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa2d806c760 0x7fa2d806ec10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:44.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2f40730f0 0x7fa2f4197660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:44.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 --2- 172.21.15.23:0/2376319994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f4197c30 0x7fa2f419c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:44.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.814+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 >> 172.21.15.23:0/2376319994 conn(0x7fa2f40fb970 msgr2=0x7fa2f4106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:44.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.815+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 shutdown_connections 2024-02-28T16:14:44.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:44.815+0000 7fa2f9800700 1 -- 172.21.15.23:0/2376319994 wait complete. 2024-02-28T16:14:45.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:45.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:45.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:44 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2376319994' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:45.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:14:45.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:45.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:44 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2376319994' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:45.472 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-28T16:14:45.472 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:14:45.472 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T16:14:45.553 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:14:45.553 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:14:45.686 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:14:45.686 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T16:14:45.787 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:14:45.788 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:14:45.927 INFO:tasks.cephadm:Deploying OSDs... 2024-02-28T16:14:45.928 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:14:45.928 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T16:14:45.970 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T16:14:45.970 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_1 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-02-28 16:13:44.129150073 +0000 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-02-28 16:06:23.122211732 +0000 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-02-28 16:06:23.122211732 +0000 2024-02-28T16:14:46.058 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-02-28 16:06:23.122211732 +0000 2024-02-28T16:14:46.059 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T16:14:46.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:45 smithi153 ceph-mon[35341]: Reconfiguring mon.smithi023 (unknown last config time)... 2024-02-28T16:14:46.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:45 smithi153 ceph-mon[35341]: Reconfiguring daemon mon.smithi023 on smithi023 2024-02-28T16:14:46.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:45 smithi153 ceph-mon[35341]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:46.196 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-02-28T16:14:46.196 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-02-28T16:14:46.196 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.000444026 s, 1.2 MB/s 2024-02-28T16:14:46.199 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T16:14:46.247 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_2 2024-02-28T16:14:46.289 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-02-28 16:13:44.130150066 +0000 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-02-28 16:06:23.720206953 +0000 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-02-28 16:06:23.720206953 +0000 2024-02-28T16:14:46.290 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-02-28 16:06:23.720206953 +0000 2024-02-28T16:14:46.296 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T16:14:46.303 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:45 smithi023 ceph-mon[29137]: Reconfiguring mon.smithi023 (unknown last config time)... 2024-02-28T16:14:46.303 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:45 smithi023 ceph-mon[29137]: Reconfiguring daemon mon.smithi023 on smithi023 2024-02-28T16:14:46.303 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:45 smithi023 ceph-mon[29137]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:46.391 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-02-28T16:14:46.391 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-02-28T16:14:46.391 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.000416345 s, 1.2 MB/s 2024-02-28T16:14:46.396 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T16:14:46.450 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_3 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-02-28 16:13:44.130150066 +0000 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-02-28 16:06:24.290202396 +0000 2024-02-28T16:14:46.498 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-02-28 16:06:24.290202396 +0000 2024-02-28T16:14:46.499 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-02-28 16:06:24.290202396 +0000 2024-02-28T16:14:46.499 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T16:14:46.573 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-02-28T16:14:46.573 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-02-28T16:14:46.573 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.000409298 s, 1.3 MB/s 2024-02-28T16:14:46.577 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T16:14:46.636 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_4 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-02-28 16:13:44.131150058 +0000 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-02-28 16:06:25.007196665 +0000 2024-02-28T16:14:46.685 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-02-28 16:06:25.007196665 +0000 2024-02-28T16:14:46.686 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-02-28 16:06:25.007196665 +0000 2024-02-28T16:14:46.686 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T16:14:46.812 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-02-28T16:14:46.812 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-02-28T16:14:46.812 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.000403096 s, 1.3 MB/s 2024-02-28T16:14:46.815 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T16:14:46.857 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:14:46.857 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T16:14:46.913 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T16:14:46.913 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-02-28T16:14:46.961 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T16:14:46.961 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:46.962 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-02-28T16:14:46.962 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:46.962 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:46.962 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-02-28 16:14:31.953672931 +0000 2024-02-28T16:14:46.962 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-02-28 16:06:08.371629768 +0000 2024-02-28T16:14:46.962 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-02-28 16:06:08.371629768 +0000 2024-02-28T16:14:46.962 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-02-28 16:06:08.371629768 +0000 2024-02-28T16:14:46.962 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T16:14:47.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-02-28T16:14:47.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-02-28T16:14:47.044 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000545002 s, 939 kB/s 2024-02-28T16:14:47.048 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T16:14:47.103 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-02-28T16:14:47.151 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T16:14:47.151 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:47.152 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-02-28T16:14:47.152 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:47.152 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:47.152 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-02-28 16:14:31.954672914 +0000 2024-02-28T16:14:47.152 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-02-28 16:06:08.922620060 +0000 2024-02-28T16:14:47.152 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-02-28 16:06:08.922620060 +0000 2024-02-28T16:14:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-02-28 16:06:08.922620060 +0000 2024-02-28T16:14:47.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T16:14:47.238 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-02-28T16:14:47.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-02-28T16:14:47.239 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00036563 s, 1.4 MB/s 2024-02-28T16:14:47.242 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T16:14:47.297 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-02-28 16:14:31.955672896 +0000 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-02-28 16:06:09.498609912 +0000 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-02-28 16:06:09.498609912 +0000 2024-02-28T16:14:47.346 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-02-28 16:06:09.498609912 +0000 2024-02-28T16:14:47.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T16:14:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-02-28T16:14:47.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-02-28T16:14:47.436 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000349492 s, 1.5 MB/s 2024-02-28T16:14:47.440 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T16:14:47.496 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-02-28T16:14:47.545 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-02-28 16:14:31.955672896 +0000 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-02-28 16:06:10.096599377 +0000 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-02-28 16:06:10.096599377 +0000 2024-02-28T16:14:47.546 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-02-28 16:06:10.096599377 +0000 2024-02-28T16:14:47.546 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T16:14:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-02-28T16:14:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-02-28T16:14:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000411343 s, 1.2 MB/s 2024-02-28T16:14:47.635 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T16:14:47.690 INFO:tasks.cephadm:Deploying osd.0 on smithi023 with /dev/vg_nvme/lv_4... 2024-02-28T16:14:47.691 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T16:14:47.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:47.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:47.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: Reconfiguring mgr.smithi023.bbebnt (unknown last config time)... 2024-02-28T16:14:47.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:14:47.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:14:47.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:47.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: Reconfiguring daemon mgr.smithi023.bbebnt on smithi023 2024-02-28T16:14:47.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:47 smithi153 ceph-mon[35341]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:48.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:48.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:48.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: Reconfiguring mgr.smithi023.bbebnt (unknown last config time)... 2024-02-28T16:14:48.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:14:48.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:14:48.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:48.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: Reconfiguring daemon mgr.smithi023.bbebnt on smithi023 2024-02-28T16:14:48.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:47 smithi023 ceph-mon[29137]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:48.733 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:14:49.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:49 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:49.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:49 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:49.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:49 smithi023 ceph-mon[29137]: Reconfiguring ceph-exporter.smithi023 (monmap changed)... 2024-02-28T16:14:49.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:49 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:14:49.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:49 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:49.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:49 smithi023 ceph-mon[29137]: Reconfiguring daemon ceph-exporter.smithi023 on smithi023 2024-02-28T16:14:49.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:49 smithi023 ceph-mon[29137]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:50.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:49 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:50.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:49 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:50.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:49 smithi153 ceph-mon[35341]: Reconfiguring ceph-exporter.smithi023 (monmap changed)... 2024-02-28T16:14:50.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:49 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:14:50.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:49 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:50.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:49 smithi153 ceph-mon[35341]: Reconfiguring daemon ceph-exporter.smithi023 on smithi023 2024-02-28T16:14:50.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:49 smithi153 ceph-mon[35341]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:51.420 INFO:teuthology.orchestra.run.smithi023.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T16:14:51.421 INFO:teuthology.orchestra.run.smithi023.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T16:14:51.421 INFO:teuthology.orchestra.run.smithi023.stderr: stderr: 10+0 records in 2024-02-28T16:14:51.421 INFO:teuthology.orchestra.run.smithi023.stderr:10+0 records out 2024-02-28T16:14:51.421 INFO:teuthology.orchestra.run.smithi023.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0353462 s, 297 MB/s 2024-02-28T16:14:51.421 INFO:teuthology.orchestra.run.smithi023.stderr:--> Zapping successful for: 2024-02-28T16:14:52.367 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:52 smithi023 ceph-mon[29137]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:52.367 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:52.367 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:52.367 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:14:52.367 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:52.419 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi023:vg_nvme/lv_4 2024-02-28T16:14:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:52 smithi153 ceph-mon[35341]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:52.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:14:52.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:53.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:53 smithi023 ceph-mon[29137]: Reconfiguring crash.smithi023 (monmap changed)... 2024-02-28T16:14:53.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:53 smithi023 ceph-mon[29137]: Reconfiguring daemon crash.smithi023 on smithi023 2024-02-28T16:14:53.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:53 smithi153 ceph-mon[35341]: Reconfiguring crash.smithi023 (monmap changed)... 2024-02-28T16:14:53.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:53 smithi153 ceph-mon[35341]: Reconfiguring daemon crash.smithi023 on smithi023 2024-02-28T16:14:53.821 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:14:54.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:54 smithi023 ceph-mon[29137]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:54.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:54.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:54.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:54 smithi153 ceph-mon[35341]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:54.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:54.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:14:55.413 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:55 smithi023 ceph-mon[29137]: Reconfiguring alertmanager.smithi023 (dependencies changed)... 2024-02-28T16:14:55.413 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:55 smithi023 ceph-mon[29137]: Reconfiguring daemon alertmanager.smithi023 on smithi023 2024-02-28T16:14:55.413 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:55.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:55 smithi153 ceph-mon[35341]: Reconfiguring alertmanager.smithi023 (dependencies changed)... 2024-02-28T16:14:55.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:55 smithi153 ceph-mon[35341]: Reconfiguring daemon alertmanager.smithi023 on smithi023 2024-02-28T16:14:55.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:56.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:56 smithi023 ceph-mon[29137]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:56.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:56 smithi153 ceph-mon[35341]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:57.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 -- 172.21.15.23:0/1051265819 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc1900737b0 msgr2=0x7fc190073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 --2- 172.21.15.23:0/1051265819 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc1900737b0 0x7fc190073c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc178009940 tx=0x7fc178009c50 comp rx=0 tx=0).stop 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 -- 172.21.15.23:0/1051265819 shutdown_connections 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 --2- 172.21.15.23:0/1051265819 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc1900737b0 0x7fc190073c20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 --2- 172.21.15.23:0/1051265819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc190074d80 0x7fc1900731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 -- 172.21.15.23:0/1051265819 >> 172.21.15.23:0/1051265819 conn(0x7fc1900fb7f0 msgr2=0x7fc1900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 -- 172.21.15.23:0/1051265819 shutdown_connections 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.992+0000 7fc194c00700 1 -- 172.21.15.23:0/1051265819 wait complete. 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.993+0000 7fc194c00700 1 Processor -- start 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.993+0000 7fc194c00700 1 -- start start 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.993+0000 7fc194c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1900737b0 0x7fc190197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc194c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc190074d80 0x7fc1901982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:57.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc194c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc190198900 con 0x7fc190074d80 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc194c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc190198a40 con 0x7fc1900737b0 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc185400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc190074d80 0x7fc1901982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc185400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc190074d80 0x7fc1901982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44790/0 (socket says 172.21.15.23:44790) 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc185400700 1 -- 172.21.15.23:0/3525533103 learned_addr learned my addr 172.21.15.23:0/3525533103 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc18de00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1900737b0 0x7fc190197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc185400700 1 -- 172.21.15.23:0/3525533103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1900737b0 msgr2=0x7fc190197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc185400700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1900737b0 0x7fc190197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.994+0000 7fc185400700 1 -- 172.21.15.23:0/3525533103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780095f0 con 0x7fc190074d80 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.995+0000 7fc185400700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc190074d80 0x7fc1901982e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc178005620 tx=0x7fc178005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.995+0000 7fc187400700 1 -- 172.21.15.23:0/3525533103 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc17801d070 con 0x7fc190074d80 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.995+0000 7fc187400700 1 -- 172.21.15.23:0/3525533103 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc17800f460 con 0x7fc190074d80 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.995+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19019d490 con 0x7fc190074d80 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.995+0000 7fc187400700 1 -- 172.21.15.23:0/3525533103 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc178021640 con 0x7fc190074d80 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.995+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19019d980 con 0x7fc190074d80 2024-02-28T16:14:57.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.996+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19010b000 con 0x7fc190074d80 2024-02-28T16:14:57.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.997+0000 7fc187400700 1 -- 172.21.15.23:0/3525533103 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fc17800fa60 con 0x7fc190074d80 2024-02-28T16:14:57.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.999+0000 7fc187400700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc17406c650 0x7fc17406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:57.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.999+0000 7fc187400700 1 -- 172.21.15.23:0/3525533103 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc17808bb90 con 0x7fc190074d80 2024-02-28T16:14:57.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:56.999+0000 7fc18de00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc17406c650 0x7fc17406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:57.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:57.000+0000 7fc18de00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc17406c650 0x7fc17406eb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc180006fd0 tx=0x7fc180008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:57.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:57.004+0000 7fc187400700 1 -- 172.21.15.23:0/3525533103 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc17805adc0 con 0x7fc190074d80 2024-02-28T16:14:57.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:14:57.236+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc19019e010 con 0x7fc17406c650 2024-02-28T16:14:57.567 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:57 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:14:57.567 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:57 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:14:57.567 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:57 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:57.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:57 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:14:57.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:57 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:14:57.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:57 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:58.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:58 smithi153 ceph-mon[35341]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:58.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:14:58 smithi153 ceph-mon[35341]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:58.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:58 smithi023 ceph-mon[29137]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:58.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:14:58 smithi023 ceph-mon[29137]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:15:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:00 smithi153 ceph-mon[35341]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:00 smithi023 ceph-mon[29137]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:02.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:02 smithi023 ceph-mon[29137]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:02.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:02 smithi153 ceph-mon[35341]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:04.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:03 smithi153 ceph-mon[35341]: Reconfiguring grafana.smithi023 (dependencies changed)... 2024-02-28T16:15:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:03 smithi153 ceph-mon[35341]: Reconfiguring daemon grafana.smithi023 on smithi023 2024-02-28T16:15:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:03 smithi153 ceph-mon[35341]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:03 smithi023 ceph-mon[29137]: Reconfiguring grafana.smithi023 (dependencies changed)... 2024-02-28T16:15:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:03 smithi023 ceph-mon[29137]: Reconfiguring daemon grafana.smithi023 on smithi023 2024-02-28T16:15:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:03 smithi023 ceph-mon[29137]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:05 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2917383395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1936c40d-0a71-495b-af57-ea0cb7224068"}]: dispatch 2024-02-28T16:15:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:05 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2917383395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1936c40d-0a71-495b-af57-ea0cb7224068"}]': finished 2024-02-28T16:15:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:05 smithi023 ceph-mon[29137]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T16:15:05.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:05 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:05.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:05 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2917383395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1936c40d-0a71-495b-af57-ea0cb7224068"}]: dispatch 2024-02-28T16:15:05.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:05 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2917383395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1936c40d-0a71-495b-af57-ea0cb7224068"}]': finished 2024-02-28T16:15:05.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:05 smithi153 ceph-mon[35341]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T16:15:05.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:05 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:06.874 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:06 smithi153 ceph-mon[35341]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:06.874 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:06 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/693124219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:15:06.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:06 smithi023 ceph-mon[29137]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:06.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:06 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/693124219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:15:07.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:07 smithi153 ceph-mon[35341]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:07.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:07 smithi023 ceph-mon[29137]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:10.602 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:10 smithi153 ceph-mon[35341]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:10.602 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:10.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:10 smithi023 ceph-mon[29137]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:10.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:12.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:12 smithi023 ceph-mon[29137]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:12.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:12 smithi153 ceph-mon[35341]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:14.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:14 smithi153 ceph-mon[35341]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:14.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:14 smithi023 ceph-mon[29137]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:16.368 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:16 smithi023 ceph-mon[29137]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:16 smithi153 ceph-mon[35341]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:17.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:17 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:17.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:17 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:17.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:17 smithi153 ceph-mon[35341]: Reconfiguring prometheus.smithi023 (dependencies changed)... 2024-02-28T16:15:17.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:17 smithi153 ceph-mon[35341]: Reconfiguring daemon prometheus.smithi023 on smithi023 2024-02-28T16:15:17.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:17 smithi153 ceph-mon[35341]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:17.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:17 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:17.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:17 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:17.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:17 smithi023 ceph-mon[29137]: Reconfiguring prometheus.smithi023 (dependencies changed)... 2024-02-28T16:15:17.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:17 smithi023 ceph-mon[29137]: Reconfiguring daemon prometheus.smithi023 on smithi023 2024-02-28T16:15:17.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:17 smithi023 ceph-mon[29137]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:18.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:15:18.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:18.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:15:18.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:20.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:20 smithi023 ceph-mon[29137]: Deploying daemon osd.0 on smithi023 2024-02-28T16:15:20.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:20 smithi023 ceph-mon[29137]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:20.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:20 smithi153 ceph-mon[35341]: Deploying daemon osd.0 on smithi023 2024-02-28T16:15:20.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:20 smithi153 ceph-mon[35341]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:22.431 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:22 smithi023 ceph-mon[29137]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:22 smithi153 ceph-mon[35341]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:24.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:24 smithi153 ceph-mon[35341]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:24.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:24 smithi023 ceph-mon[29137]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:25.370 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:25.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:25.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: Reconfiguring ceph-exporter.smithi153 (monmap changed)... 2024-02-28T16:15:25.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:15:25.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:25.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: Reconfiguring daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:15:25.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:25.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: Reconfiguring ceph-exporter.smithi153 (monmap changed)... 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: Reconfiguring daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:27.508 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:27.508 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:27.508 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:27 smithi153 ceph-mon[35341]: Reconfiguring crash.smithi153 (monmap changed)... 2024-02-28T16:15:27.509 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:15:27.509 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:27.509 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:27 smithi153 ceph-mon[35341]: Reconfiguring daemon crash.smithi153 on smithi153 2024-02-28T16:15:27.509 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:27 smithi153 ceph-mon[35341]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:27.615 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:27.615 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:27.615 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:27 smithi023 ceph-mon[29137]: Reconfiguring crash.smithi153 (monmap changed)... 2024-02-28T16:15:27.615 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:15:27.615 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:27.615 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:27 smithi023 ceph-mon[29137]: Reconfiguring daemon crash.smithi153 on smithi153 2024-02-28T16:15:27.615 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:27 smithi023 ceph-mon[29137]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:29.598 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:29.598 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:29.599 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: Reconfiguring mgr.smithi153.qlkchp (monmap changed)... 2024-02-28T16:15:29.599 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:15:29.599 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:15:29.599 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:29.599 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: Reconfiguring daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:15:29.599 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:29 smithi153 ceph-mon[35341]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:29.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:29.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:29.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: Reconfiguring mgr.smithi153.qlkchp (monmap changed)... 2024-02-28T16:15:29.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:15:29.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:15:29.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:29.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: Reconfiguring daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:15:29.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:29 smithi023 ceph-mon[29137]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:31.486 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:31.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:31.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: Reconfiguring mon.smithi153 (monmap changed)... 2024-02-28T16:15:31.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:15:31.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:15:31.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:31.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: Reconfiguring daemon mon.smithi153 on smithi153 2024-02-28T16:15:31.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:31 smithi153 ceph-mon[35341]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: Reconfiguring mon.smithi153 (monmap changed)... 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: Reconfiguring daemon mon.smithi153 on smithi153 2024-02-28T16:15:31.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:31 smithi023 ceph-mon[29137]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:32.996 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:32.996 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:32.996 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:32.996 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi023.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi023.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi023.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:32.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi023.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:33.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:15:33.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi023.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:15:33.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:33.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:15:33.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi023.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:15:33.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:33.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:33.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:33 smithi153 ceph-mon[35341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:15:33.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:33 smithi153 ceph-mon[35341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi023.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:15:33.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:33 smithi153 ceph-mon[35341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:15:33.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:33 smithi153 ceph-mon[35341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi023.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:15:33.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:33 smithi153 ceph-mon[35341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:15:33.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:33 smithi153 ceph-mon[35341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi023.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:15:33.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:33 smithi153 ceph-mon[35341]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:34.164 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:33 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:15:34.164 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:33 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi023.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:15:34.164 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:33 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:15:34.164 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:33 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi023.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:15:34.164 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:33 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:15:34.164 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:33 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi023.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:15:34.164 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:33 smithi023 ceph-mon[29137]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:36.015 INFO:teuthology.orchestra.run.smithi023.stdout:Created osd(s) 0 on host 'smithi023' 2024-02-28T16:15:36.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.023+0000 7fc187400700 1 -- 172.21.15.23:0/3525533103 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc19019e010 con 0x7fc17406c650 2024-02-28T16:15:36.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.026+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc17406c650 msgr2=0x7fc17406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.026+0000 7fc194c00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc17406c650 0x7fc17406eb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc180006fd0 tx=0x7fc180008040 comp rx=0 tx=0).stop 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.026+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc190074d80 msgr2=0x7fc1901982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.026+0000 7fc194c00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc190074d80 0x7fc1901982e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc178005620 tx=0x7fc178005700 comp rx=0 tx=0).stop 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.027+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 shutdown_connections 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.027+0000 7fc194c00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc17406c650 0x7fc17406eb00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.027+0000 7fc194c00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1900737b0 0x7fc190197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.027+0000 7fc194c00700 1 --2- 172.21.15.23:0/3525533103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc190074d80 0x7fc1901982e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.027+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 >> 172.21.15.23:0/3525533103 conn(0x7fc1900fb7f0 msgr2=0x7fc190106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.027+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 shutdown_connections 2024-02-28T16:15:36.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:36.027+0000 7fc194c00700 1 -- 172.21.15.23:0/3525533103 wait complete. 2024-02-28T16:15:36.626 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:36 smithi023 ceph-mon[29137]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:36.626 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:36.626 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:36.626 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:36 smithi023 ceph-mon[29137]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:15:36.626 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:36.627 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:36.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:36 smithi153 ceph-mon[35341]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:36.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:36.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:36.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:36 smithi153 ceph-mon[35341]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:15:36.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:36.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:37.094 DEBUG:teuthology.orchestra.run.smithi023:osd.0> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.0.service 2024-02-28T16:15:37.100 INFO:tasks.cephadm:Deploying osd.1 on smithi023 with /dev/vg_nvme/lv_3... 2024-02-28T16:15:37.101 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T16:15:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:37 smithi023 ceph-mon[29137]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:15:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:37 smithi023 ceph-mon[29137]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T16:15:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:37 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:37 smithi023 ceph-mon[29137]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:15:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:37 smithi023 ceph-mon[29137]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:37.676 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:15:37 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[43906]: 2024-02-28T16:15:37.421+0000 7f7503000700 -1 osd.0 0 waiting for initial osdmap 2024-02-28T16:15:37.676 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:15:37 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[43906]: 2024-02-28T16:15:37.431+0000 7f74fe800700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:15:37.695 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:15:37.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:37 smithi153 ceph-mon[35341]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:15:37.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:37 smithi153 ceph-mon[35341]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T16:15:37.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:37 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:37.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:37 smithi153 ceph-mon[35341]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:15:37.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:37 smithi153 ceph-mon[35341]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:38.482 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:38 smithi023 ceph-mon[29137]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]': finished 2024-02-28T16:15:38.483 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:38 smithi023 ceph-mon[29137]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T16:15:38.483 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:38.483 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:38 smithi153 ceph-mon[35341]: from='osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]': finished 2024-02-28T16:15:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:38 smithi153 ceph-mon[35341]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T16:15:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:39.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:39 smithi023 ceph-mon[29137]: purged_snaps scrub starts 2024-02-28T16:15:39.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:39 smithi023 ceph-mon[29137]: purged_snaps scrub ok 2024-02-28T16:15:39.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:39 smithi023 ceph-mon[29137]: osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] boot 2024-02-28T16:15:39.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:39 smithi023 ceph-mon[29137]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T16:15:39.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:39.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:39 smithi023 ceph-mon[29137]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:39.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:39 smithi153 ceph-mon[35341]: purged_snaps scrub starts 2024-02-28T16:15:39.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:39 smithi153 ceph-mon[35341]: purged_snaps scrub ok 2024-02-28T16:15:39.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:39 smithi153 ceph-mon[35341]: osd.0 [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] boot 2024-02-28T16:15:39.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:39 smithi153 ceph-mon[35341]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T16:15:39.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:15:39.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:39 smithi153 ceph-mon[35341]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:40 smithi023 ceph-mon[29137]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T16:15:40.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:40.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:40 smithi153 ceph-mon[35341]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T16:15:40.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:41.278 INFO:teuthology.orchestra.run.smithi023.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T16:15:41.279 INFO:teuthology.orchestra.run.smithi023.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T16:15:41.279 INFO:teuthology.orchestra.run.smithi023.stderr: stderr: 10+0 records in 2024-02-28T16:15:41.279 INFO:teuthology.orchestra.run.smithi023.stderr:10+0 records out 2024-02-28T16:15:41.279 INFO:teuthology.orchestra.run.smithi023.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0363019 s, 289 MB/s 2024-02-28T16:15:41.279 INFO:teuthology.orchestra.run.smithi023.stderr:--> Zapping successful for: 2024-02-28T16:15:41.656 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:41 smithi023 ceph-mon[29137]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:41.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:41 smithi153 ceph-mon[35341]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:42.044 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi023:vg_nvme/lv_3 2024-02-28T16:15:42.467 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:15:42.988 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:42 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:42.988 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:42 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:43.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:42 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:43.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:42 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:43.952 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:43 smithi023 ceph-mon[29137]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:44.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:43 smithi153 ceph-mon[35341]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 -- 172.21.15.23:0/4055584520 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec102440 msgr2=0x7fa1ec102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/4055584520 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec102440 0x7fa1ec102850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009910 tx=0x7fa1e0009c20 comp rx=0 tx=0).stop 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 -- 172.21.15.23:0/4055584520 shutdown_connections 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/4055584520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1ec103640 0x7fa1ec103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/4055584520 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec102440 0x7fa1ec102850 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 -- 172.21.15.23:0/4055584520 >> 172.21.15.23:0/4055584520 conn(0x7fa1ec0fd9f0 msgr2=0x7fa1ec0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 -- 172.21.15.23:0/4055584520 shutdown_connections 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.693+0000 7fa1f3a00700 1 -- 172.21.15.23:0/4055584520 wait complete. 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.695+0000 7fa1f3a00700 1 Processor -- start 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.695+0000 7fa1f3a00700 1 -- start start 2024-02-28T16:15:44.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.695+0000 7fa1f3a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1ec102440 0x7fa1ec197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.695+0000 7fa1f3a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec103640 0x7fa1ec198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.695+0000 7fa1f3a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec198850 con 0x7fa1ec103640 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.695+0000 7fa1f3a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec19d260 con 0x7fa1ec102440 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1ebe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec103640 0x7fa1ec198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1ebe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec103640 0x7fa1ec198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50822/0 (socket says 172.21.15.23:50822) 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1ebe00700 1 -- 172.21.15.23:0/1266391175 learned_addr learned my addr 172.21.15.23:0/1266391175 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1f1000700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1ec102440 0x7fa1ec197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1ebe00700 1 -- 172.21.15.23:0/1266391175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1ec102440 msgr2=0x7fa1ec197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1ebe00700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1ec102440 0x7fa1ec197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1ebe00700 1 -- 172.21.15.23:0/1266391175 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00095f0 con 0x7fa1ec103640 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.696+0000 7fa1ebe00700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec103640 0x7fa1ec198230 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c8a0 tx=0x7fa1d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:44.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.697+0000 7fa1e9600700 1 -- 172.21.15.23:0/1266391175 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d800cea0 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.697+0000 7fa1e9600700 1 -- 172.21.15.23:0/1266391175 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1d8004830 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.697+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ec19d460 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.697+0000 7fa1e9600700 1 -- 172.21.15.23:0/1266391175 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d80055b0 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.697+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec19d980 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.698+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ec10af90 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.699+0000 7fa1e9600700 1 -- 172.21.15.23:0/1266391175 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fa1d8007ad0 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.700+0000 7fa1e9600700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa1d406c600 0x7fa1d406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.700+0000 7fa1e9600700 1 -- 172.21.15.23:0/1266391175 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fa1d808a7c0 con 0x7fa1ec103640 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.700+0000 7fa1f1000700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa1d406c600 0x7fa1d406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.701+0000 7fa1f1000700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa1d406c600 0x7fa1d406eab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005090 tx=0x7fa1e000b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:44.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.705+0000 7fa1e9600700 1 -- 172.21.15.23:0/1266391175 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa1d8055c80 con 0x7fa1ec103640 2024-02-28T16:15:44.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:15:44.940+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1ec107f90 con 0x7fa1d406c600 2024-02-28T16:15:45.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:45 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:15:45.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:45 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:15:45.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:45 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:45.670 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:45 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:15:45.670 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:45 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:15:45.670 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:45 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:46.473 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:46 smithi023 ceph-mon[29137]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:15:46.474 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:46 smithi023 ceph-mon[29137]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:46 smithi153 ceph-mon[35341]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:15:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:46 smithi153 ceph-mon[35341]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:48.588 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:48.588 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:48.588 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:48.588 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:15:48.588 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:48.588 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:48.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:15:48.589 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:48.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:48.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:48.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:48.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:15:48.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:48.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:48.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:15:48.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:49.579 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:49 smithi153 ceph-mon[35341]: Detected new or changed devices on smithi023 2024-02-28T16:15:49.579 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:49 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi023 to 11843M 2024-02-28T16:15:49.580 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:49 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:49.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:49 smithi023 ceph-mon[29137]: Detected new or changed devices on smithi023 2024-02-28T16:15:49.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:49 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi023 to 11843M 2024-02-28T16:15:49.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:49 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:50.540 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:50 smithi023 ceph-mon[29137]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:50.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:50 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/199486303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2211134-0ddf-4faf-8fda-41ff13201231"}]: dispatch 2024-02-28T16:15:50.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:50 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/199486303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2211134-0ddf-4faf-8fda-41ff13201231"}]': finished 2024-02-28T16:15:50.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:50 smithi023 ceph-mon[29137]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T16:15:50.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:50 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:15:50.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:50 smithi153 ceph-mon[35341]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:50.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:50 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/199486303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2211134-0ddf-4faf-8fda-41ff13201231"}]: dispatch 2024-02-28T16:15:50.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:50 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/199486303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2211134-0ddf-4faf-8fda-41ff13201231"}]': finished 2024-02-28T16:15:50.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:50 smithi153 ceph-mon[35341]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T16:15:50.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:50 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:15:51.773 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:51 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2445009164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:15:51.773 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:51 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:52.036 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:51 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2445009164' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:15:52.036 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:51 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:52.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:52 smithi153 ceph-mon[35341]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:52.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:53.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:52 smithi023 ceph-mon[29137]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:53.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:54.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:53 smithi153 ceph-mon[35341]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:54.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:53 smithi023 ceph-mon[29137]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:55.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:55.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:55.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:55.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:15:55.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:55.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:55.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:55.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:55.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:15:55.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:15:56.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:55 smithi023 ceph-mon[29137]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:56.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:56.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:55 smithi153 ceph-mon[35341]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:56.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:58.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:15:58 smithi023 ceph-mon[29137]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:15:58.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:15:58 smithi153 ceph-mon[35341]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:00.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:00 smithi023 ceph-mon[29137]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:00.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:16:00.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:00 smithi153 ceph-mon[35341]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:16:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:01.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:01 smithi153 ceph-mon[35341]: Deploying daemon osd.1 on smithi023 2024-02-28T16:16:01.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:01 smithi023 ceph-mon[29137]: Deploying daemon osd.1 on smithi023 2024-02-28T16:16:02.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:02 smithi153 ceph-mon[35341]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:02.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:02 smithi023 ceph-mon[29137]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:04.542 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:04 smithi023 ceph-mon[29137]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:04.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:04 smithi153 ceph-mon[35341]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:06 smithi153 ceph-mon[35341]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:06 smithi023 ceph-mon[29137]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:08.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:08 smithi153 ceph-mon[35341]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:08.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:08 smithi023 ceph-mon[29137]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:09.599 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:09.599 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:09.599 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:09.599 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:09 smithi023 ceph-mon[29137]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:09.788 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:09.788 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:09.788 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:09.788 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:09 smithi153 ceph-mon[35341]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:10.804 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:10.836 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:12.373 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:12 smithi153 ceph-mon[35341]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:12.373 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:12 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:12.373 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:12 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:12.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:12 smithi023 ceph-mon[29137]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:12.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:12.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:13.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.389+0000 7fa1e9600700 1 -- 172.21.15.23:0/1266391175 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa1ec107f90 con 0x7fa1d406c600 2024-02-28T16:16:13.381 INFO:teuthology.orchestra.run.smithi023.stdout:Created osd(s) 1 on host 'smithi023' 2024-02-28T16:16:13.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa1d406c600 msgr2=0x7fa1d406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:13.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa1d406c600 0x7fa1d406eab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005090 tx=0x7fa1e000b560 comp rx=0 tx=0).stop 2024-02-28T16:16:13.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec103640 msgr2=0x7fa1ec198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec103640 0x7fa1ec198230 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c8a0 tx=0x7fa1d800cc60 comp rx=0 tx=0).stop 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 shutdown_connections 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa1d406c600 0x7fa1d406eab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1ec102440 0x7fa1ec197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 --2- 172.21.15.23:0/1266391175 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa1ec103640 0x7fa1ec198230 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.393+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 >> 172.21.15.23:0/1266391175 conn(0x7fa1ec0fd9f0 msgr2=0x7fa1ec106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.394+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 shutdown_connections 2024-02-28T16:16:13.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:13.394+0000 7fa1f3a00700 1 -- 172.21.15.23:0/1266391175 wait complete. 2024-02-28T16:16:13.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:13 smithi153 ceph-mon[35341]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:16:13.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:13 smithi023 ceph-mon[29137]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:16:14.384 DEBUG:teuthology.orchestra.run.smithi023:osd.1> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.1.service 2024-02-28T16:16:14.392 INFO:tasks.cephadm:Deploying osd.2 on smithi023 with /dev/vg_nvme/lv_2... 2024-02-28T16:16:14.392 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T16:16:14.467 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:14 smithi023 ceph-mon[29137]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:14.467 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:14 smithi023 ceph-mon[29137]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:16:14.467 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:14 smithi023 ceph-mon[29137]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T16:16:14.467 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:14.467 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:14 smithi023 ceph-mon[29137]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:16:14.467 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:14.468 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:14.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:14 smithi153 ceph-mon[35341]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:14.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:14 smithi153 ceph-mon[35341]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:16:14.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:14 smithi153 ceph-mon[35341]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T16:16:14.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:14.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:14 smithi153 ceph-mon[35341]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:16:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:15.189 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:16:15.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:15 smithi153 ceph-mon[35341]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]': finished 2024-02-28T16:16:15.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:15 smithi153 ceph-mon[35341]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T16:16:15.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:15 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:15.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:15 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:15.667 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:15 smithi023 ceph-mon[29137]: from='osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]': finished 2024-02-28T16:16:15.667 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:15 smithi023 ceph-mon[29137]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T16:16:15.668 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:15 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:15.668 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:15 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:16.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:16 smithi023 ceph-mon[29137]: purged_snaps scrub starts 2024-02-28T16:16:16.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:16 smithi023 ceph-mon[29137]: purged_snaps scrub ok 2024-02-28T16:16:16.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:16 smithi023 ceph-mon[29137]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:16.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:16 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:16.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:16 smithi023 ceph-mon[29137]: osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] boot 2024-02-28T16:16:16.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:16 smithi023 ceph-mon[29137]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T16:16:16.426 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:16 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:16 smithi153 ceph-mon[35341]: purged_snaps scrub starts 2024-02-28T16:16:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:16 smithi153 ceph-mon[35341]: purged_snaps scrub ok 2024-02-28T16:16:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:16 smithi153 ceph-mon[35341]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:16:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:16 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:16 smithi153 ceph-mon[35341]: osd.1 [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] boot 2024-02-28T16:16:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:16 smithi153 ceph-mon[35341]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T16:16:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:16 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:16:17.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:17 smithi153 ceph-mon[35341]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T16:16:17.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:17 smithi153 ceph-mon[35341]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:17.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:17 smithi023 ceph-mon[29137]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T16:16:17.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:17 smithi023 ceph-mon[29137]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:18.404 INFO:teuthology.orchestra.run.smithi023.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T16:16:18.404 INFO:teuthology.orchestra.run.smithi023.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T16:16:18.404 INFO:teuthology.orchestra.run.smithi023.stderr: stderr: 10+0 records in 2024-02-28T16:16:18.404 INFO:teuthology.orchestra.run.smithi023.stderr:10+0 records out 2024-02-28T16:16:18.405 INFO:teuthology.orchestra.run.smithi023.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0339125 s, 309 MB/s 2024-02-28T16:16:18.405 INFO:teuthology.orchestra.run.smithi023.stderr:--> Zapping successful for: 2024-02-28T16:16:19.239 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi023:vg_nvme/lv_2 2024-02-28T16:16:19.462 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:19 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:19.462 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:19 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:19.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:19 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:19.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:19 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:20.577 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:20 smithi023 ceph-mon[29137]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:20.601 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:16:20.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:20 smithi153 ceph-mon[35341]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:22.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:22 smithi153 ceph-mon[35341]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:22.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:22 smithi023 ceph-mon[29137]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:23.576 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:23 smithi023 ceph-mon[29137]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:23.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:23 smithi153 ceph-mon[35341]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:23.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 -- 172.21.15.23:0/2968074848 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 msgr2=0x7f65a4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 --2- 172.21.15.23:0/2968074848 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a4100840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6590009910 tx=0x7f6590009c20 comp rx=0 tx=0).stop 2024-02-28T16:16:23.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 -- 172.21.15.23:0/2968074848 shutdown_connections 2024-02-28T16:16:23.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 --2- 172.21.15.23:0/2968074848 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a4100840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 --2- 172.21.15.23:0/2968074848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a40ff130 0x7f65a40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 -- 172.21.15.23:0/2968074848 >> 172.21.15.23:0/2968074848 conn(0x7f65a40fa780 msgr2=0x7f65a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:23.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 -- 172.21.15.23:0/2968074848 shutdown_connections 2024-02-28T16:16:23.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.764+0000 7f65ac200700 1 -- 172.21.15.23:0/2968074848 wait complete. 2024-02-28T16:16:23.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.765+0000 7f65ac200700 1 Processor -- start 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.765+0000 7f65ac200700 1 -- start start 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65ac200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a40ff130 0x7f65a4103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65ac200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65ac200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4101cf0 con 0x7f65a41003d0 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65ac200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4101e30 con 0x7f65a40ff130 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65a8e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65a8e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a41017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33744/0 (socket says 172.21.15.23:33744) 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65a8e00700 1 -- 172.21.15.23:0/3291613585 learned_addr learned my addr 172.21.15.23:0/3291613585 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.766+0000 7f65a9800700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a40ff130 0x7f65a4103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.767+0000 7f65a8e00700 1 -- 172.21.15.23:0/3291613585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a40ff130 msgr2=0x7f65a4103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.767+0000 7f65a8e00700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a40ff130 0x7f65a4103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.767+0000 7f65a8e00700 1 -- 172.21.15.23:0/3291613585 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900095f0 con 0x7f65a41003d0 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.767+0000 7f65a8e00700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a41017b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6590005b40 tx=0x7f659000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.767+0000 7f65a2000700 1 -- 172.21.15.23:0/3291613585 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659001d070 con 0x7f65a41003d0 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.767+0000 7f65a2000700 1 -- 172.21.15.23:0/3291613585 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6590022470 con 0x7f65a41003d0 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.767+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a41020b0 con 0x7f65a41003d0 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.768+0000 7f65a2000700 1 -- 172.21.15.23:0/3291613585 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659000f690 con 0x7f65a41003d0 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.768+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a41025a0 con 0x7f65a41003d0 2024-02-28T16:16:23.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.769+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a4107c90 con 0x7f65a41003d0 2024-02-28T16:16:23.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.771+0000 7f65a2000700 1 -- 172.21.15.23:0/3291613585 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f65900225e0 con 0x7f65a41003d0 2024-02-28T16:16:23.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.772+0000 7f65a2000700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f658c06c610 0x7f658c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.772+0000 7f65a2000700 1 -- 172.21.15.23:0/3291613585 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f659008c460 con 0x7f65a41003d0 2024-02-28T16:16:23.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.772+0000 7f65a9800700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f658c06c610 0x7f658c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.773+0000 7f65a9800700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f658c06c610 0x7f658c06eac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6598006fd0 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:23.777+0000 7f65a2000700 1 -- 172.21.15.23:0/3291613585 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f659005b280 con 0x7f65a41003d0 2024-02-28T16:16:24.005 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:24.012+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f65a4068c50 con 0x7f658c06c610 2024-02-28T16:16:24.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: Detected new or changed devices on smithi023 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi023 to 5921M 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:16:24.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:16:24.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:16:24.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:24 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:24.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: Detected new or changed devices on smithi023 2024-02-28T16:16:24.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:16:24.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:16:24.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi023 to 5921M 2024-02-28T16:16:24.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi023:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:16:24.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:24 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:25.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:25 smithi153 ceph-mon[35341]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:25.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:25 smithi023 ceph-mon[29137]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:27.866 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:27.866 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:27.866 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:27 smithi023 ceph-mon[29137]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:27 smithi153 ceph-mon[35341]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:28.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:28 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3912397377' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "513a900d-c438-4f9a-ad29-c667f5335070"}]: dispatch 2024-02-28T16:16:28.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:28 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3912397377' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "513a900d-c438-4f9a-ad29-c667f5335070"}]': finished 2024-02-28T16:16:28.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:28 smithi023 ceph-mon[29137]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T16:16:28.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:28 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:28 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3912397377' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "513a900d-c438-4f9a-ad29-c667f5335070"}]: dispatch 2024-02-28T16:16:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:28 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3912397377' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "513a900d-c438-4f9a-ad29-c667f5335070"}]': finished 2024-02-28T16:16:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:28 smithi153 ceph-mon[35341]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T16:16:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:28 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:30.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:30 smithi153 ceph-mon[35341]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:30.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:30 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/4195896336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:16:30.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:30 smithi023 ceph-mon[29137]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:30.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:30 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/4195896336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:16:32.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:32.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:32.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:32.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:32.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:32.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:31 smithi023 ceph-mon[29137]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:32.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:32.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:32.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:32.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:32.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:32.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:31 smithi153 ceph-mon[35341]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:34 smithi023 ceph-mon[29137]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:34 smithi153 ceph-mon[35341]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:36.644 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:36 smithi023 ceph-mon[29137]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:36.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:36 smithi153 ceph-mon[35341]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:38.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:38 smithi023 ceph-mon[29137]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:38.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:38 smithi153 ceph-mon[35341]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:39.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:16:39.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:39 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:39.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:16:39.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:39 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:40.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:40 smithi153 ceph-mon[35341]: Deploying daemon osd.2 on smithi023 2024-02-28T16:16:40.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:40 smithi153 ceph-mon[35341]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:40.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:40.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:40 smithi023 ceph-mon[29137]: Deploying daemon osd.2 on smithi023 2024-02-28T16:16:40.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:40 smithi023 ceph-mon[29137]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:40.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:42.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:42 smithi023 ceph-mon[29137]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:42.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:42 smithi153 ceph-mon[35341]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:43.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:43 smithi153 ceph-mon[35341]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:43.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:43 smithi023 ceph-mon[29137]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:46.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:46 smithi023 ceph-mon[29137]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:46 smithi153 ceph-mon[35341]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:47.992 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:47.992 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:47.992 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:47.992 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:47 smithi023 ceph-mon[29137]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:48.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:48.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:48.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:48.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:47 smithi153 ceph-mon[35341]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:50.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:50 smithi153 ceph-mon[35341]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:50.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:50 smithi023 ceph-mon[29137]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:51.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:51 smithi023 ceph-mon[29137]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:16:51.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:51 smithi153 ceph-mon[35341]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:16:52.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.173+0000 7f65a2000700 1 -- 172.21.15.23:0/3291613585 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f65a4068c50 con 0x7f658c06c610 2024-02-28T16:16:52.164 INFO:teuthology.orchestra.run.smithi023.stdout:Created osd(s) 2 on host 'smithi023' 2024-02-28T16:16:52.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f658c06c610 msgr2=0x7f658c06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:52.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f658c06c610 0x7f658c06eac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6598006fd0 tx=0x7f6598008040 comp rx=0 tx=0).stop 2024-02-28T16:16:52.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 msgr2=0x7f65a41017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:52.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a41017b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6590005b40 tx=0x7f659000be20 comp rx=0 tx=0).stop 2024-02-28T16:16:52.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 shutdown_connections 2024-02-28T16:16:52.168 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f658c06c610 0x7f658c06eac0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:52.168 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a40ff130 0x7f65a4103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:52.168 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 --2- 172.21.15.23:0/3291613585 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f65a41003d0 0x7f65a41017b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:52.168 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 >> 172.21.15.23:0/3291613585 conn(0x7f65a40fa780 msgr2=0x7f65a4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:52.168 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.176+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 shutdown_connections 2024-02-28T16:16:52.168 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:16:52.177+0000 7f65ac200700 1 -- 172.21.15.23:0/3291613585 wait complete. 2024-02-28T16:16:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:52 smithi153 ceph-mon[35341]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:52 smithi153 ceph-mon[35341]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:16:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:52 smithi153 ceph-mon[35341]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T16:16:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:52.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:52 smithi153 ceph-mon[35341]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:16:52.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:52.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:52 smithi023 ceph-mon[29137]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:52 smithi023 ceph-mon[29137]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:16:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:52 smithi023 ceph-mon[29137]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T16:16:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:52 smithi023 ceph-mon[29137]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:16:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:53.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:53 smithi153 ceph-mon[35341]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]': finished 2024-02-28T16:16:53.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:53 smithi153 ceph-mon[35341]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T16:16:53.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:53 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:53.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:53 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:53.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:53 smithi153 ceph-mon[35341]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:53.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:53 smithi023 ceph-mon[29137]: from='osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]': finished 2024-02-28T16:16:53.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:53 smithi023 ceph-mon[29137]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T16:16:53.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:53 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:53.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:53 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:53.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:53 smithi023 ceph-mon[29137]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T16:16:53.735 DEBUG:teuthology.orchestra.run.smithi023:osd.2> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.2.service 2024-02-28T16:16:53.741 INFO:tasks.cephadm:Deploying osd.3 on smithi153 with /dev/vg_nvme/lv_4... 2024-02-28T16:16:53.741 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T16:16:54.139 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:16:54.584 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:54 smithi153 ceph-mon[35341]: purged_snaps scrub starts 2024-02-28T16:16:54.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:54 smithi153 ceph-mon[35341]: purged_snaps scrub ok 2024-02-28T16:16:54.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:54.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:54 smithi153 ceph-mon[35341]: osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] boot 2024-02-28T16:16:54.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:54 smithi153 ceph-mon[35341]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T16:16:54.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:54 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:54.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:54 smithi023 ceph-mon[29137]: purged_snaps scrub starts 2024-02-28T16:16:54.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:54 smithi023 ceph-mon[29137]: purged_snaps scrub ok 2024-02-28T16:16:54.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:54.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:54 smithi023 ceph-mon[29137]: osd.2 [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] boot 2024-02-28T16:16:54.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:54 smithi023 ceph-mon[29137]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T16:16:54.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:54 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:16:56.131 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:55 smithi153 ceph-mon[35341]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T16:16:56.131 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:56.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:55 smithi023 ceph-mon[29137]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T16:16:56.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:56.818 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T16:16:56.818 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T16:16:56.818 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-02-28T16:16:56.818 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-02-28T16:16:56.818 INFO:teuthology.orchestra.run.smithi153.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0323715 s, 324 MB/s 2024-02-28T16:16:56.819 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-02-28T16:16:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:56 smithi153 ceph-mon[35341]: pgmap v98: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:16:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:56 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-28T16:16:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:56 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:56 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-28T16:16:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:56 smithi153 ceph-mon[35341]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T16:16:57.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:56 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T16:16:57.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:56 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:56 smithi023 ceph-mon[29137]: pgmap v98: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:16:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:56 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-28T16:16:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:56 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:56 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-28T16:16:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:56 smithi023 ceph-mon[29137]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T16:16:57.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:56 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T16:16:57.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:56 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:16:57.621 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi153:vg_nvme/lv_4 2024-02-28T16:16:57.991 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:16:58.168 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:57 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T16:16:58.168 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:57 smithi023 ceph-mon[29137]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T16:16:58.168 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:57 smithi023 ceph-mon[29137]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:16:58.292 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:57 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T16:16:58.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:57 smithi153 ceph-mon[35341]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T16:16:58.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:57 smithi153 ceph-mon[35341]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:16:58.910 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:58 smithi023 sudo[56910]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:16:58.911 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:58 smithi023 sudo[56910]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:16:58.911 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:58 smithi023 sudo[56910]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:16:58.911 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:58 smithi023 sudo[56910]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:16:59.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:16:58 smithi153 ceph-mon[35341]: osdmap e23: 3 total, 3 up, 3 in 2024-02-28T16:16:59.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:16:58 smithi023 ceph-mon[29137]: osdmap e23: 3 total, 3 up, 3 in 2024-02-28T16:16:59.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56919]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:16:59.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56919]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:16:59.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56919]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:16:59.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56919]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.920+0000 7f12b0800700 1 -- 172.21.15.153:0/2260098849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 msgr2=0x7f12a8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.920+0000 7f12b0800700 1 --2- 172.21.15.153:0/2260098849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8100650 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f129c009910 tx=0x7f129c009c20 comp rx=0 tx=0).stop 2024-02-28T16:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.920+0000 7f12b0800700 1 -- 172.21.15.153:0/2260098849 shutdown_connections 2024-02-28T16:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.920+0000 7f12b0800700 1 --2- 172.21.15.153:0/2260098849 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12a8101440 0x7f12a8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.920+0000 7f12b0800700 1 --2- 172.21.15.153:0/2260098849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8100650 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.920+0000 7f12b0800700 1 -- 172.21.15.153:0/2260098849 >> 172.21.15.153:0/2260098849 conn(0x7f12a80fb7f0 msgr2=0x7f12a80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.921+0000 7f12b0800700 1 -- 172.21.15.153:0/2260098849 shutdown_connections 2024-02-28T16:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.921+0000 7f12b0800700 1 -- 172.21.15.153:0/2260098849 wait complete. 2024-02-28T16:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.922+0000 7f12b0800700 1 Processor -- start 2024-02-28T16:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.922+0000 7f12b0800700 1 -- start start 2024-02-28T16:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.922+0000 7f12b0800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.922+0000 7f12b0800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12a8101440 0x7f12a8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.922+0000 7f12b0800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8073680 con 0x7f12a8101440 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.922+0000 7f12b0800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80737c0 con 0x7f12a8100240 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.923+0000 7f12ade00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.923+0000 7f12ade00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48314/0 (socket says 172.21.15.153:48314) 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.923+0000 7f12ade00700 1 -- 172.21.15.153:0/2576365744 learned_addr learned my addr 172.21.15.153:0/2576365744 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.923+0000 7f12ad400700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12a8101440 0x7f12a8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.923+0000 7f12ade00700 1 -- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12a8101440 msgr2=0x7f12a8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.923+0000 7f12ade00700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12a8101440 0x7f12a8073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.923+0000 7f12ade00700 1 -- 172.21.15.153:0/2576365744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0095f0 con 0x7f12a8100240 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.924+0000 7f12ade00700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8074af0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f129c00bd70 tx=0x7f129c00bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.925+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129c01d070 con 0x7f12a8100240 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.925+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f129c005dc0 con 0x7f12a8100240 2024-02-28T16:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.925+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129c021410 con 0x7f12a8100240 2024-02-28T16:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.925+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8073a40 con 0x7f12a8100240 2024-02-28T16:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.925+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a8073f30 con 0x7f12a8100240 2024-02-28T16:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.926+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a8108db0 con 0x7f12a8100240 2024-02-28T16:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.927+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f129c00f7f0 con 0x7f12a8100240 2024-02-28T16:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.928+0000 7f12a2a00700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f129006c610 0x7f129006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.928+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3232+0+0 (secure 0 0 0) 0x7f129c08c150 con 0x7f12a8100240 2024-02-28T16:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.929+0000 7f12ad400700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f129006c610 0x7f129006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.930+0000 7f12ad400700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f129006c610 0x7f129006eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1298004630 tx=0x7f129800b3c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:16:59.934+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f129c05abe0 con 0x7f12a8100240 2024-02-28T16:16:59.924 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56948]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:16:59.925 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56948]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:16:59.925 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56948]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:16:59.925 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:16:59 smithi023 sudo[56948]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:00.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:00.158+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a8105d90 con 0x7f129006c610 2024-02-28T16:17:00.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:00.203+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f129c057520 con 0x7f12a8100240 2024-02-28T16:17:00.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:00 smithi153 ceph-mon[35341]: pgmap v103: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:00.674 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57291]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:17:00.674 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57291]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:17:00.675 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57291]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:17:00.675 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57291]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:00 smithi023 ceph-mon[29137]: pgmap v103: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:01.170 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57308]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:17:01.170 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57308]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:17:01.170 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57308]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:17:01.170 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:00 smithi023 sudo[57308]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:01.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:01 smithi023 ceph-mon[29137]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:01.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:01 smithi023 ceph-mon[29137]: mgrmap e19: smithi023.bbebnt(active, since 3m), standbys: smithi153.qlkchp 2024-02-28T16:17:01.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:01 smithi153 ceph-mon[35341]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:01.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:01 smithi153 ceph-mon[35341]: mgrmap e19: smithi023.bbebnt(active, since 3m), standbys: smithi153.qlkchp 2024-02-28T16:17:01.925 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:01 smithi023 sudo[57343]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:17:01.925 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:01 smithi023 sudo[57343]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:17:01.925 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:01 smithi023 sudo[57343]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:17:01.925 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:17:01 smithi023 sudo[57343]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:02.386 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57346]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:17:02.386 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57346]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:17:02.386 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57346]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:17:02.386 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57346]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:02.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:02.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: Detected new or changed devices on smithi023 2024-02-28T16:17:02.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:02.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:02.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:02.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi023 to 3947M 2024-02-28T16:17:02.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:02.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:02.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:02 smithi153 ceph-mon[35341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:17:02.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57349]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:17:02.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57349]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:17:02.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57349]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:17:02.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 sudo[57349]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:02.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:02.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: Detected new or changed devices on smithi023 2024-02-28T16:17:02.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:02.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:02.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:02.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi023 to 3947M 2024-02-28T16:17:02.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.927 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:02.927 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:02.927 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:02.927 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:02 smithi023 ceph-mon[29137]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:17:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39182]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:17:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39182]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:17:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39182]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:17:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39182]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39203]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39203]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39203]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 sudo[39203]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 ceph-mon[35341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:17:04.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:17:04.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:03 smithi153 ceph-mon[35341]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:03 smithi023 ceph-mon[29137]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:17:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:17:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:17:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:17:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:17:04.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:03 smithi023 ceph-mon[29137]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/987435972' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9875a7-8961-49db-bee2-40980eeec169"}]: dispatch 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9875a7-8961-49db-bee2-40980eeec169"}]: dispatch 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b9875a7-8961-49db-bee2-40980eeec169"}]': finished 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T16:17:04.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:04 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/987435972' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9875a7-8961-49db-bee2-40980eeec169"}]: dispatch 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9875a7-8961-49db-bee2-40980eeec169"}]: dispatch 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b9875a7-8961-49db-bee2-40980eeec169"}]': finished 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T16:17:05.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:04 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:06.122 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:05 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2520467279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:06.123 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:05 smithi023 ceph-mon[29137]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:05 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2520467279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:05 smithi153 ceph-mon[35341]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:08.479 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:08 smithi153 ceph-mon[35341]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-02-28T16:17:08.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:08 smithi023 ceph-mon[29137]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-02-28T16:17:09.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:09.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:09.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:09.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:09.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:09.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:09 smithi153 ceph-mon[35341]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-28T16:17:09.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:09.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:09.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:09.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:09.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:09.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:09 smithi023 ceph-mon[29137]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-28T16:17:10.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:10.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:11.850 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:11 smithi153 ceph-mon[35341]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-28T16:17:11.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:11 smithi023 ceph-mon[29137]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-28T16:17:13.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:13 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:17:13.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:13 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:13.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:13 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:17:13.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:13 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:14.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:14 smithi153 ceph-mon[35341]: Deploying daemon osd.3 on smithi153 2024-02-28T16:17:14.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:14 smithi153 ceph-mon[35341]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:17:14.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:14 smithi023 ceph-mon[29137]: Deploying daemon osd.3 on smithi153 2024-02-28T16:17:14.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:14 smithi023 ceph-mon[29137]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:17:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:16 smithi153 ceph-mon[35341]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-02-28T16:17:16.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:16 smithi023 ceph-mon[29137]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-02-28T16:17:18.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:18 smithi153 ceph-mon[35341]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T16:17:18.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:18 smithi023 ceph-mon[29137]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T16:17:20.501 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:20 smithi153 ceph-mon[35341]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:20.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:20 smithi023 ceph-mon[29137]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:22.033 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:21 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:22.033 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:21 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:22.033 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:21 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:22.033 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:21 smithi153 ceph-mon[35341]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:22.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:21 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:22.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:21 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:22.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:21 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:22.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:21 smithi023 ceph-mon[29137]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:24.503 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:24 smithi153 ceph-mon[35341]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:24.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:24 smithi023 ceph-mon[29137]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:25.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:25 smithi153 ceph-mon[35341]: from='osd.3 [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:17:25.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:25 smithi153 ceph-mon[35341]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:17:25.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:25.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.566+0000 7f12a2a00700 1 -- 172.21.15.153:0/2576365744 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f12a8105d90 con 0x7f129006c610 2024-02-28T16:17:25.558 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 3 on host 'smithi153' 2024-02-28T16:17:25.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.569+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f129006c610 msgr2=0x7f129006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:25.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.569+0000 7f12b0800700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f129006c610 0x7f129006eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1298004630 tx=0x7f129800b3c0 comp rx=0 tx=0).stop 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.569+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 msgr2=0x7f12a8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.569+0000 7f12b0800700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8074af0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f129c00bd70 tx=0x7f129c00bda0 comp rx=0 tx=0).stop 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.570+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 shutdown_connections 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.570+0000 7f12b0800700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f129006c610 0x7f129006eac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.570+0000 7f12b0800700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a8100240 0x7f12a8074af0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.570+0000 7f12b0800700 1 --2- 172.21.15.153:0/2576365744 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f12a8101440 0x7f12a8073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.570+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 >> 172.21.15.153:0/2576365744 conn(0x7f12a80fb7f0 msgr2=0x7f12a8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:17:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.570+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 shutdown_connections 2024-02-28T16:17:25.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:25.570+0000 7f12b0800700 1 -- 172.21.15.153:0/2576365744 wait complete. 2024-02-28T16:17:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:25 smithi023 ceph-mon[29137]: from='osd.3 [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:17:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:25 smithi023 ceph-mon[29137]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:17:25.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:26.326 DEBUG:teuthology.orchestra.run.smithi153:osd.3> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.3.service 2024-02-28T16:17:26.331 INFO:tasks.cephadm:Deploying osd.4 on smithi153 with /dev/vg_nvme/lv_3... 2024-02-28T16:17:26.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T16:17:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:17:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T16:17:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='osd.3 [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:17:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:17:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:26 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='osd.3 [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:26 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:26.743 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:17:27.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:27 smithi153 ceph-mon[35341]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-02-28T16:17:27.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:27 smithi153 ceph-mon[35341]: osdmap e26: 4 total, 3 up, 4 in 2024-02-28T16:17:27.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:27.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:27.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:27 smithi153 ceph-mon[35341]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:27.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:27 smithi023 ceph-mon[29137]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-02-28T16:17:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:27 smithi023 ceph-mon[29137]: osdmap e26: 4 total, 3 up, 4 in 2024-02-28T16:17:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:27.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:27 smithi023 ceph-mon[29137]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T16:17:28.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:28 smithi153 ceph-mon[35341]: purged_snaps scrub starts 2024-02-28T16:17:28.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:28 smithi153 ceph-mon[35341]: purged_snaps scrub ok 2024-02-28T16:17:28.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:28 smithi153 ceph-mon[35341]: osd.3 [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] boot 2024-02-28T16:17:28.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:28 smithi153 ceph-mon[35341]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T16:17:28.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:28 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:28.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:28 smithi023 ceph-mon[29137]: purged_snaps scrub starts 2024-02-28T16:17:28.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:28 smithi023 ceph-mon[29137]: purged_snaps scrub ok 2024-02-28T16:17:28.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:28 smithi023 ceph-mon[29137]: osd.3 [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] boot 2024-02-28T16:17:28.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:28 smithi023 ceph-mon[29137]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T16:17:28.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:28 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:17:29.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:29 smithi153 ceph-mon[35341]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T16:17:29.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:29 smithi153 ceph-mon[35341]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:29.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:29 smithi153 ceph-mon[35341]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T16:17:29.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:29 smithi023 ceph-mon[29137]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T16:17:29.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:29 smithi023 ceph-mon[29137]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:29.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:29 smithi023 ceph-mon[29137]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T16:17:30.547 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T16:17:30.548 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T16:17:30.548 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-02-28T16:17:30.548 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-02-28T16:17:30.548 INFO:teuthology.orchestra.run.smithi153.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0317009 s, 331 MB/s 2024-02-28T16:17:30.548 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 2024-02-28T16:17:30.548 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-02-28T16:17:31.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi153:vg_nvme/lv_3 2024-02-28T16:17:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:31 smithi153 ceph-mon[35341]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T16:17:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:31 smithi153 ceph-mon[35341]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:31.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:31 smithi023 ceph-mon[29137]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T16:17:31.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:31 smithi023 ceph-mon[29137]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:32.247 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:17:32.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: osdmap e31: 4 total, 4 up, 4 in 2024-02-28T16:17:32.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: Detected new or changed devices on smithi153 2024-02-28T16:17:32.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi153 to 14915M 2024-02-28T16:17:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:32.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:32 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:32.758 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: osdmap e31: 4 total, 4 up, 4 in 2024-02-28T16:17:32.758 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: Detected new or changed devices on smithi153 2024-02-28T16:17:32.758 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:32.758 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:32.758 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:32.759 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi153 to 14915M 2024-02-28T16:17:32.759 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:32.759 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:32.759 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:32.759 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:32 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:33.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:33.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:33.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:33.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:33 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:33.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:33 smithi153 ceph-mon[35341]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-02-28T16:17:33.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:33 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:33.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:33 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:33.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:33 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:33.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:33 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:33.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:33 smithi023 ceph-mon[29137]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.351+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1548469987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4107a40 msgr2=0x7fa2a4107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.351+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1548469987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4107a40 0x7fa2a4107e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa290009910 tx=0x7fa290009c20 comp rx=0 tx=0).stop 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.351+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1548469987 shutdown_connections 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.351+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1548469987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4107a40 0x7fa2a4107e90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.351+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1548469987 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2a4106840 0x7fa2a4106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.351+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1548469987 >> 172.21.15.153:0/1548469987 conn(0x7fa2a4075970 msgr2=0x7fa2a4077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.351+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1548469987 shutdown_connections 2024-02-28T16:17:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.352+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1548469987 wait complete. 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.352+0000 7fa2a8a00700 1 Processor -- start 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a8a00700 1 -- start start 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a8a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4106840 0x7fa2a419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a8a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2a4107a40 0x7fa2a419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a8a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a419cc10 con 0x7fa2a4107a40 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a8a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a419cd50 con 0x7fa2a4106840 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a1e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4106840 0x7fa2a419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a1e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4106840 0x7fa2a419c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35074/0 (socket says 172.21.15.153:35074) 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.353+0000 7fa2a1e00700 1 -- 172.21.15.153:0/1890689050 learned_addr learned my addr 172.21.15.153:0/1890689050 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:17:34.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa2a1400700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2a4107a40 0x7fa2a419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa2a1e00700 1 -- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2a4107a40 msgr2=0x7fa2a419c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa2a1e00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2a4107a40 0x7fa2a419c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa2a1e00700 1 -- 172.21.15.153:0/1890689050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900095f0 con 0x7fa2a4106840 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa2a1e00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4106840 0x7fa2a419c0b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c8f0 tx=0x7fa29400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa29aa00700 1 -- 172.21.15.153:0/1890689050 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa294007a70 con 0x7fa2a4106840 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa29aa00700 1 -- 172.21.15.153:0/1890689050 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa294007bd0 con 0x7fa2a4106840 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa29aa00700 1 -- 172.21.15.153:0/1890689050 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa294018630 con 0x7fa2a4106840 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.354+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a41a1800 con 0x7fa2a4106840 2024-02-28T16:17:34.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.355+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a41a1d00 con 0x7fa2a4106840 2024-02-28T16:17:34.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.356+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a410f390 con 0x7fa2a4106840 2024-02-28T16:17:34.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.357+0000 7fa29aa00700 1 -- 172.21.15.153:0/1890689050 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa29400f450 con 0x7fa2a4106840 2024-02-28T16:17:34.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.357+0000 7fa29aa00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa28806c680 0x7fa28806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:17:34.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.358+0000 7fa29aa00700 1 -- 172.21.15.153:0/1890689050 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3774+0+0 (secure 0 0 0) 0x7fa29408b1c0 con 0x7fa2a4106840 2024-02-28T16:17:34.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.358+0000 7fa2a1400700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa28806c680 0x7fa28806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:17:34.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.359+0000 7fa2a1400700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa28806c680 0x7fa28806eb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa290006010 tx=0x7fa29000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:17:34.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.363+0000 7fa29aa00700 1 -- 172.21.15.153:0/1890689050 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa294059a60 con 0x7fa2a4106840 2024-02-28T16:17:34.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:34.585+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2a410c390 con 0x7fa28806c680 2024-02-28T16:17:35.596 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:35 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:35.596 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:35 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:35.596 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:35 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:35.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:35 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:35.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:35 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:35.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:35 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:36.479 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:36 smithi153 ceph-mon[35341]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:36.479 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:36 smithi153 ceph-mon[35341]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-28T16:17:36.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:36 smithi023 ceph-mon[29137]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:36.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:36 smithi023 ceph-mon[29137]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-28T16:17:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:37 smithi023 ceph-mon[29137]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-28T16:17:37.746 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:37 smithi153 ceph-mon[35341]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-28T16:17:38.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:38 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2553517132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3266acd3-21ec-4c65-bb5d-48d82334bf09"}]: dispatch 2024-02-28T16:17:38.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:38 smithi023 ceph-mon[29137]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3266acd3-21ec-4c65-bb5d-48d82334bf09"}]: dispatch 2024-02-28T16:17:38.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:38 smithi023 ceph-mon[29137]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3266acd3-21ec-4c65-bb5d-48d82334bf09"}]': finished 2024-02-28T16:17:38.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:38 smithi023 ceph-mon[29137]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T16:17:38.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:17:38.685 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:38 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2553517132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3266acd3-21ec-4c65-bb5d-48d82334bf09"}]: dispatch 2024-02-28T16:17:38.686 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:38 smithi153 ceph-mon[35341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3266acd3-21ec-4c65-bb5d-48d82334bf09"}]: dispatch 2024-02-28T16:17:38.686 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:38 smithi153 ceph-mon[35341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3266acd3-21ec-4c65-bb5d-48d82334bf09"}]': finished 2024-02-28T16:17:38.686 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:38 smithi153 ceph-mon[35341]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T16:17:38.686 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:17:39.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:39 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2291276186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:39.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:39 smithi153 ceph-mon[35341]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-28T16:17:39.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:39 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2291276186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:39.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:39 smithi023 ceph-mon[29137]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-28T16:17:40.799 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:40.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:41.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:41 smithi153 ceph-mon[35341]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:41.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:41 smithi023 ceph-mon[29137]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:44.450 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:44 smithi153 ceph-mon[35341]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:44.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:44 smithi023 ceph-mon[29137]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:46 smithi153 ceph-mon[35341]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:46 smithi023 ceph-mon[29137]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:47.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:17:47.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:47.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:17:47.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:48.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:48 smithi153 ceph-mon[35341]: Deploying daemon osd.4 on smithi153 2024-02-28T16:17:48.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:48 smithi153 ceph-mon[35341]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:48.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:48 smithi023 ceph-mon[29137]: Deploying daemon osd.4 on smithi153 2024-02-28T16:17:48.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:48 smithi023 ceph-mon[29137]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:50.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:50 smithi153 ceph-mon[35341]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:50.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:50 smithi023 ceph-mon[29137]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:52.603 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:52 smithi153 ceph-mon[35341]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:52.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:52 smithi023 ceph-mon[29137]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:54.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:54 smithi153 ceph-mon[35341]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:54.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:54 smithi023 ceph-mon[29137]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:56.047 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:56.048 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:56.048 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:56.048 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:55 smithi153 ceph-mon[35341]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:56.048 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:56.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:56.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:17:56.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:56.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:55 smithi023 ceph-mon[29137]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:56.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:58.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:58 smithi153 ceph-mon[35341]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:58.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:58 smithi023 ceph-mon[29137]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:17:59.486 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:59 smithi153 ceph-mon[35341]: from='osd.4 [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:17:59.486 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:17:59 smithi153 ceph-mon[35341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:17:59.585 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 4 on host 'smithi153' 2024-02-28T16:17:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.594+0000 7fa29aa00700 1 -- 172.21.15.153:0/1890689050 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa2a410c390 con 0x7fa28806c680 2024-02-28T16:17:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.597+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa28806c680 msgr2=0x7fa28806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.597+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa28806c680 0x7fa28806eb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa290006010 tx=0x7fa29000b540 comp rx=0 tx=0).stop 2024-02-28T16:17:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.597+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4106840 msgr2=0x7fa2a419c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.597+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4106840 0x7fa2a419c0b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c8f0 tx=0x7fa29400ccb0 comp rx=0 tx=0).stop 2024-02-28T16:17:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.598+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 shutdown_connections 2024-02-28T16:17:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.598+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa28806c680 0x7fa28806eb30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.598+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a4106840 0x7fa2a419c0b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.598+0000 7fa2a8a00700 1 --2- 172.21.15.153:0/1890689050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa2a4107a40 0x7fa2a419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.598+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 >> 172.21.15.153:0/1890689050 conn(0x7fa2a4075970 msgr2=0x7fa2a410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:17:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.598+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 shutdown_connections 2024-02-28T16:17:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:17:59.598+0000 7fa2a8a00700 1 -- 172.21.15.153:0/1890689050 wait complete. 2024-02-28T16:17:59.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:59 smithi023 ceph-mon[29137]: from='osd.4 [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:17:59.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:17:59 smithi023 ceph-mon[29137]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:18:00.347 DEBUG:teuthology.orchestra.run.smithi153:osd.4> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.4.service 2024-02-28T16:18:00.354 INFO:tasks.cephadm:Deploying osd.5 on smithi153 with /dev/vg_nvme/lv_2... 2024-02-28T16:18:00.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='osd.4 [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:00 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='osd.4 [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:00 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:00.759 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:18:01.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:01 smithi153 ceph-mon[35341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-02-28T16:18:01.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:01 smithi153 ceph-mon[35341]: osdmap e34: 5 total, 4 up, 5 in 2024-02-28T16:18:01.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:01 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:01.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:01 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:01.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:01 smithi023 ceph-mon[29137]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-02-28T16:18:01.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:01 smithi023 ceph-mon[29137]: osdmap e34: 5 total, 4 up, 5 in 2024-02-28T16:18:01.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:01 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:01.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:01 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:02.514 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:02 smithi153 ceph-mon[35341]: purged_snaps scrub starts 2024-02-28T16:18:02.514 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:02 smithi153 ceph-mon[35341]: purged_snaps scrub ok 2024-02-28T16:18:02.515 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:02 smithi153 ceph-mon[35341]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:18:02.515 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:02.515 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:02 smithi153 ceph-mon[35341]: osd.4 [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] boot 2024-02-28T16:18:02.515 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:02 smithi153 ceph-mon[35341]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T16:18:02.515 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:02 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:02.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:02 smithi023 ceph-mon[29137]: purged_snaps scrub starts 2024-02-28T16:18:02.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:02 smithi023 ceph-mon[29137]: purged_snaps scrub ok 2024-02-28T16:18:02.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:02 smithi023 ceph-mon[29137]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T16:18:02.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:02.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:02 smithi023 ceph-mon[29137]: osd.4 [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] boot 2024-02-28T16:18:02.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:02 smithi023 ceph-mon[29137]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T16:18:02.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:02 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:18:03.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:03 smithi153 ceph-mon[35341]: osdmap e36: 5 total, 5 up, 5 in 2024-02-28T16:18:03.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:03 smithi023 ceph-mon[29137]: osdmap e36: 5 total, 5 up, 5 in 2024-02-28T16:18:04.140 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T16:18:04.140 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T16:18:04.141 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-02-28T16:18:04.141 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-02-28T16:18:04.141 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0345865 s, 303 MB/s 2024-02-28T16:18:04.141 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-02-28T16:18:04.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:04 smithi023 ceph-mon[29137]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:04.576 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:04 smithi153 ceph-mon[35341]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:04.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi153:vg_nvme/lv_2 2024-02-28T16:18:05.795 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:18:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:06.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:06.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:06 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:06.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:06.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:06.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:06 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:07.611 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:07 smithi153 ceph-mon[35341]: Detected new or changed devices on smithi153 2024-02-28T16:18:07.611 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:07 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi153 to 7457M 2024-02-28T16:18:07.611 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:07 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:07.611 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:07 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:07.611 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:07 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:07.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:07 smithi023 ceph-mon[29137]: Detected new or changed devices on smithi153 2024-02-28T16:18:07.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:07 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi153 to 7457M 2024-02-28T16:18:07.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:07 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:07.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:07 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:07.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:07 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 -- 172.21.15.153:0/1843867058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 msgr2=0x7f7d10107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 --2- 172.21.15.153:0/1843867058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d10107eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009910 tx=0x7f7cf8009c20 comp rx=0 tx=0).stop 2024-02-28T16:18:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 -- 172.21.15.153:0/1843867058 shutdown_connections 2024-02-28T16:18:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 --2- 172.21.15.153:0/1843867058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d10107eb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 --2- 172.21.15.153:0/1843867058 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7d10106860 0x7f7d10106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 -- 172.21.15.153:0/1843867058 >> 172.21.15.153:0/1843867058 conn(0x7f7d100758b0 msgr2=0x7f7d10077d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 -- 172.21.15.153:0/1843867058 shutdown_connections 2024-02-28T16:18:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.904+0000 7f7d16400700 1 -- 172.21.15.153:0/1843867058 wait complete. 2024-02-28T16:18:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.905+0000 7f7d16400700 1 Processor -- start 2024-02-28T16:18:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d16400700 1 -- start start 2024-02-28T16:18:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d16400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7d10106860 0x7f7d1019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d16400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d1019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d16400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1019cc10 con 0x7f7d10106860 2024-02-28T16:18:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d16400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1019cd50 con 0x7f7d10107a60 2024-02-28T16:18:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d06a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d1019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d06a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d1019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46930/0 (socket says 172.21.15.153:46930) 2024-02-28T16:18:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d06a00700 1 -- 172.21.15.153:0/286129599 learned_addr learned my addr 172.21.15.153:0/286129599 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:18:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.906+0000 7f7d0f400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7d10106860 0x7f7d1019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d06a00700 1 -- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7d10106860 msgr2=0x7f7d1019c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d06a00700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7d10106860 0x7f7d1019c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d06a00700 1 -- 172.21.15.153:0/286129599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80095f0 con 0x7f7d10107a60 2024-02-28T16:18:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d06a00700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d1019c5f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8005b40 tx=0x7f7cf800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d0cc00700 1 -- 172.21.15.153:0/286129599 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf801d070 con 0x7f7d10107a60 2024-02-28T16:18:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d0cc00700 1 -- 172.21.15.153:0/286129599 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7cf8022470 con 0x7f7d10107a60 2024-02-28T16:18:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d101a17a0 con 0x7f7d10107a60 2024-02-28T16:18:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d0cc00700 1 -- 172.21.15.153:0/286129599 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf800f690 con 0x7f7d10107a60 2024-02-28T16:18:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.907+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d101a1c90 con 0x7f7d10107a60 2024-02-28T16:18:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.908+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1010f3b0 con 0x7f7d10107a60 2024-02-28T16:18:07.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.910+0000 7f7d0cc00700 1 -- 172.21.15.153:0/286129599 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7cf80225e0 con 0x7f7d10107a60 2024-02-28T16:18:07.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.910+0000 7f7d0cc00700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7cf406c680 0x7f7cf406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:07.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.911+0000 7f7d0cc00700 1 -- 172.21.15.153:0/286129599 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f7cf808cb80 con 0x7f7d10107a60 2024-02-28T16:18:07.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.911+0000 7f7d0f400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7cf406c680 0x7f7cf406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:07.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.912+0000 7f7d0f400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7cf406c680 0x7f7cf406eb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d00005fd0 tx=0x7f7d00005dd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:07.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:07.915+0000 7f7d0cc00700 1 -- 172.21.15.153:0/286129599 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7cf805b260 con 0x7f7d10107a60 2024-02-28T16:18:08.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:08.137+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d1010c3b0 con 0x7f7cf406c680 2024-02-28T16:18:08.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:08 smithi153 ceph-mon[35341]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:08.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:08 smithi153 ceph-mon[35341]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:18:08.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:08 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:18:08.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:08 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:18:08.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:08 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:08.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:08 smithi023 ceph-mon[29137]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:08.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:08 smithi023 ceph-mon[29137]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:18:08.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:18:08.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:18:08.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:10 smithi153 ceph-mon[35341]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:10.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:10 smithi023 ceph-mon[29137]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:10.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:12.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:12 smithi153 ceph-mon[35341]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:12.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:12 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/2803058566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e08ef8-51d2-494b-b140-ac7bd2c5a320"}]: dispatch 2024-02-28T16:18:12.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:12 smithi153 ceph-mon[35341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e08ef8-51d2-494b-b140-ac7bd2c5a320"}]: dispatch 2024-02-28T16:18:12.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:12 smithi153 ceph-mon[35341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82e08ef8-51d2-494b-b140-ac7bd2c5a320"}]': finished 2024-02-28T16:18:12.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:12 smithi153 ceph-mon[35341]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T16:18:12.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:12 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:12.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:12 smithi023 ceph-mon[29137]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:12.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:12 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/2803058566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e08ef8-51d2-494b-b140-ac7bd2c5a320"}]: dispatch 2024-02-28T16:18:12.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:12 smithi023 ceph-mon[29137]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82e08ef8-51d2-494b-b140-ac7bd2c5a320"}]: dispatch 2024-02-28T16:18:12.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:12 smithi023 ceph-mon[29137]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82e08ef8-51d2-494b-b140-ac7bd2c5a320"}]': finished 2024-02-28T16:18:12.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:12 smithi023 ceph-mon[29137]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T16:18:12.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:12 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:13.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:13 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/4137834645' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:18:13.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:13 smithi153 ceph-mon[35341]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:13.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:13 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/4137834645' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:18:13.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:13 smithi023 ceph-mon[29137]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:16.623 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:16 smithi153 ceph-mon[35341]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:16.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:16 smithi023 ceph-mon[29137]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:17.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:17 smithi023 ceph-mon[29137]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:17.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:17 smithi153 ceph-mon[35341]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:20.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:20 smithi153 ceph-mon[35341]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:20.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:20 smithi023 ceph-mon[29137]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:21.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:21 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:18:21.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:21 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:21.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:21 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:18:21.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:21 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:22 smithi153 ceph-mon[35341]: Deploying daemon osd.5 on smithi153 2024-02-28T16:18:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:22 smithi153 ceph-mon[35341]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:22.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:22 smithi023 ceph-mon[29137]: Deploying daemon osd.5 on smithi153 2024-02-28T16:18:22.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:22 smithi023 ceph-mon[29137]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:23.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:23 smithi153 ceph-mon[35341]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:23.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:23 smithi023 ceph-mon[29137]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:25.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:26.600 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:26 smithi153 ceph-mon[35341]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:26.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:26 smithi023 ceph-mon[29137]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:27.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:27 smithi153 ceph-mon[35341]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:27.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:27 smithi023 ceph-mon[29137]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:29.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:29.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:29.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:29 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:29.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:29.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:29.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:29 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:30.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:30 smithi153 ceph-mon[35341]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:30.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:30 smithi023 ceph-mon[29137]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:31.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:31 smithi023 ceph-mon[29137]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:31.703 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:31 smithi153 ceph-mon[35341]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:33.253 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:33 smithi153 ceph-mon[35341]: from='osd.5 [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:18:33.254 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:33 smithi153 ceph-mon[35341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:18:33.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:33 smithi023 ceph-mon[29137]: from='osd.5 [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:18:33.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:33 smithi023 ceph-mon[29137]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:18:34.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.398+0000 7f7d0cc00700 1 -- 172.21.15.153:0/286129599 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7d1010c3b0 con 0x7f7cf406c680 2024-02-28T16:18:34.391 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 5 on host 'smithi153' 2024-02-28T16:18:34.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7cf406c680 msgr2=0x7f7cf406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:34.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7cf406c680 0x7f7cf406eb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d00005fd0 tx=0x7f7d00005dd0 comp rx=0 tx=0).stop 2024-02-28T16:18:34.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 msgr2=0x7f7d1019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:34.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d1019c5f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8005b40 tx=0x7f7cf800be20 comp rx=0 tx=0).stop 2024-02-28T16:18:34.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 shutdown_connections 2024-02-28T16:18:34.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7cf406c680 0x7f7cf406eb30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:34.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7d10106860 0x7f7d1019c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:34.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 --2- 172.21.15.153:0/286129599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d10107a60 0x7f7d1019c5f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:34.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.402+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 >> 172.21.15.153:0/286129599 conn(0x7f7d100758b0 msgr2=0x7f7d1010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:34.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.403+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 shutdown_connections 2024-02-28T16:18:34.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:34.403+0000 7f7d16400700 1 -- 172.21.15.153:0/286129599 wait complete. 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: from='osd.5 [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: osdmap e39: 6 total, 5 up, 6 in 2024-02-28T16:18:34.425 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:34 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: from='osd.5 [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: osdmap e39: 6 total, 5 up, 6 in 2024-02-28T16:18:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:34 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:35.241 DEBUG:teuthology.orchestra.run.smithi153:osd.5> sudo journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.5.service 2024-02-28T16:18:35.247 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-28T16:18:35.248 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd stat -f json 2024-02-28T16:18:35.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:35 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:35.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:35 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:35.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:35 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:35 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:35 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:35 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:35.678 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:18:36.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: purged_snaps scrub starts 2024-02-28T16:18:36.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: purged_snaps scrub ok 2024-02-28T16:18:36.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:36.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: osd.5 [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] boot 2024-02-28T16:18:36.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T16:18:36.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:36.355 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:36.356 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:36.356 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:36 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: purged_snaps scrub starts 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: purged_snaps scrub ok 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: osd.5 [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] boot 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:36.440 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:36 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:37 smithi023 ceph-mon[29137]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T16:18:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:37 smithi023 ceph-mon[29137]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:37.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 -- 172.21.15.23:0/2753236808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 msgr2=0x7f21b4107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:37.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 --2- 172.21.15.23:0/2753236808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b4107cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009910 tx=0x7f21a0009c20 comp rx=0 tx=0).stop 2024-02-28T16:18:37.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 -- 172.21.15.23:0/2753236808 shutdown_connections 2024-02-28T16:18:37.881 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 --2- 172.21.15.23:0/2753236808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b4107cc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:37.881 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 --2- 172.21.15.23:0/2753236808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21b4106670 0x7f21b4106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:37.881 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 -- 172.21.15.23:0/2753236808 >> 172.21.15.23:0/2753236808 conn(0x7f21b4075740 msgr2=0x7f21b4077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:37.881 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 -- 172.21.15.23:0/2753236808 shutdown_connections 2024-02-28T16:18:37.881 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.889+0000 7f21baa00700 1 -- 172.21.15.23:0/2753236808 wait complete. 2024-02-28T16:18:37.881 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.890+0000 7f21baa00700 1 Processor -- start 2024-02-28T16:18:37.881 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.890+0000 7f21baa00700 1 -- start start 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21baa00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21b4106670 0x7f21b419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21baa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21baa00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b419c9d0 con 0x7f21b4107870 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21baa00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b419cb10 con 0x7f21b4106670 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21b8c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21b8c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b419c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47440/0 (socket says 172.21.15.23:47440) 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21b8c00700 1 -- 172.21.15.23:0/2025196367 learned_addr learned my addr 172.21.15.23:0/2025196367 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21b9600700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21b4106670 0x7f21b419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21b8c00700 1 -- 172.21.15.23:0/2025196367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21b4106670 msgr2=0x7f21b419be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:37.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21b8c00700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21b4106670 0x7f21b419be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.891+0000 7f21b8c00700 1 -- 172.21.15.23:0/2025196367 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00095f0 con 0x7f21b4107870 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.892+0000 7f21b8c00700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b419c3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f21a0005b40 tx=0x7f21a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.892+0000 7f21b2000700 1 -- 172.21.15.23:0/2025196367 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a001d070 con 0x7f21b4107870 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.892+0000 7f21b2000700 1 -- 172.21.15.23:0/2025196367 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f21a0022470 con 0x7f21b4107870 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.892+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b41a1560 con 0x7f21b4107870 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.892+0000 7f21b2000700 1 -- 172.21.15.23:0/2025196367 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a000f690 con 0x7f21b4107870 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.892+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b41a1a50 con 0x7f21b4107870 2024-02-28T16:18:37.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.893+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b410f1c0 con 0x7f21b4107870 2024-02-28T16:18:37.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.895+0000 7f21b2000700 1 -- 172.21.15.23:0/2025196367 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f21a00225e0 con 0x7f21b4107870 2024-02-28T16:18:37.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.896+0000 7f21b2000700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f219c06c680 0x7f219c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:37.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.896+0000 7f21b2000700 1 -- 172.21.15.23:0/2025196367 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f21a008cde0 con 0x7f21b4107870 2024-02-28T16:18:37.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.896+0000 7f21b9600700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f219c06c680 0x7f219c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:37.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.897+0000 7f21b9600700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f219c06c680 0x7f219c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a8005dd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:37.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:37.902+0000 7f21b2000700 1 -- 172.21.15.23:0/2025196367 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f21a005b2b0 con 0x7f21b4107870 2024-02-28T16:18:37.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:37 smithi153 ceph-mon[35341]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T16:18:37.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:37 smithi153 ceph-mon[35341]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:38.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.123+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f21b41a2150 con 0x7f21b4107870 2024-02-28T16:18:38.114 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.124+0000 7f21b2000700 1 -- 172.21.15.23:0/2025196367 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f21a0027020 con 0x7f21b4107870 2024-02-28T16:18:38.114 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:18:38.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f219c06c680 msgr2=0x7f219c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:38.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f219c06c680 0x7f219c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a8005dd0 comp rx=0 tx=0).stop 2024-02-28T16:18:38.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 msgr2=0x7f21b419c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b419c3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f21a0005b40 tx=0x7f21a000be20 comp rx=0 tx=0).stop 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 shutdown_connections 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f219c06c680 0x7f219c06eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21b4106670 0x7f21b419be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 --2- 172.21.15.23:0/2025196367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f21b4107870 0x7f21b419c3b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 >> 172.21.15.23:0/2025196367 conn(0x7f21b4075740 msgr2=0x7f21b410aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 shutdown_connections 2024-02-28T16:18:38.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:38.127+0000 7f21baa00700 1 -- 172.21.15.23:0/2025196367 wait complete. 2024-02-28T16:18:38.828 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:38 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2025196367' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T16:18:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:38 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2025196367' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T16:18:39.014 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1709137115,"num_in_osds":6,"osd_in_since":1709137091,"num_remapped_pgs":0} 2024-02-28T16:18:39.015 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T16:18:39.439 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:18:40.622 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:40.623 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:40.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:40.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:40.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:40.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:40.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 -- 172.21.15.23:0/1523044533 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4102470 msgr2=0x7f34c41028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 --2- 172.21.15.23:0/1523044533 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4102470 0x7f34c41028e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009910 tx=0x7f34b0009c20 comp rx=0 tx=0).stop 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 -- 172.21.15.23:0/1523044533 shutdown_connections 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 --2- 172.21.15.23:0/1523044533 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4102470 0x7f34c41028e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 --2- 172.21.15.23:0/1523044533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c4108470 0x7f34c4108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 -- 172.21.15.23:0/1523044533 >> 172.21.15.23:0/1523044533 conn(0x7f34c40fdf90 msgr2=0x7f34c41003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 -- 172.21.15.23:0/1523044533 shutdown_connections 2024-02-28T16:18:41.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.429+0000 7f34cae00700 1 -- 172.21.15.23:0/1523044533 wait complete. 2024-02-28T16:18:41.421 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.430+0000 7f34cae00700 1 Processor -- start 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.430+0000 7f34cae00700 1 -- start start 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.430+0000 7f34cae00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c4102470 0x7f34c41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34cae00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4108470 0x7f34c4198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34cae00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c4198e10 con 0x7f34c4108470 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34cae00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c419cba0 con 0x7f34c4102470 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34c3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4108470 0x7f34c4198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34c3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4108470 0x7f34c4198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:46744/0 (socket says 172.21.15.23:46744) 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34c3400700 1 -- 172.21.15.23:0/1210403978 learned_addr learned my addr 172.21.15.23:0/1210403978 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34c3e00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c4102470 0x7f34c41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34c3400700 1 -- 172.21.15.23:0/1210403978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c4102470 msgr2=0x7f34c41981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34c3400700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c4102470 0x7f34c41981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.431+0000 7f34c3400700 1 -- 172.21.15.23:0/1210403978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00095f0 con 0x7f34c4108470 2024-02-28T16:18:41.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.432+0000 7f34c3400700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4108470 0x7f34c4198730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f34b000b5c0 tx=0x7f34b000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:41.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.432+0000 7f34c0c00700 1 -- 172.21.15.23:0/1210403978 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b001d070 con 0x7f34c4108470 2024-02-28T16:18:41.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.432+0000 7f34c0c00700 1 -- 172.21.15.23:0/1210403978 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f34b0022470 con 0x7f34c4108470 2024-02-28T16:18:41.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.432+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c419ce20 con 0x7f34c4108470 2024-02-28T16:18:41.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.432+0000 7f34c0c00700 1 -- 172.21.15.23:0/1210403978 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b000f670 con 0x7f34c4108470 2024-02-28T16:18:41.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.432+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c419d310 con 0x7f34c4108470 2024-02-28T16:18:41.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.433+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c410a970 con 0x7f34c4108470 2024-02-28T16:18:41.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.434+0000 7f34c0c00700 1 -- 172.21.15.23:0/1210403978 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f34b0004c30 con 0x7f34c4108470 2024-02-28T16:18:41.425 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.435+0000 7f34c0c00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f34a806c680 0x7f34a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:41.426 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.435+0000 7f34c0c00700 1 -- 172.21.15.23:0/1210403978 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f34b008cb10 con 0x7f34c4108470 2024-02-28T16:18:41.426 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.436+0000 7f34c3e00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f34a806c680 0x7f34a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:41.426 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.436+0000 7f34c3e00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f34a806c680 0x7f34a806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f34b4005fd0 tx=0x7f34b400a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:41.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.441+0000 7f34c0c00700 1 -- 172.21.15.23:0/1210403978 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f34b00575c0 con 0x7f34c4108470 2024-02-28T16:18:41.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:41 smithi153 ceph-mon[35341]: Detected new or changed devices on smithi153 2024-02-28T16:18:41.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:41 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi153 to 4971M 2024-02-28T16:18:41.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:41 smithi153 ceph-mon[35341]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:41.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.666+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34c4199550 con 0x7f34c4108470 2024-02-28T16:18:41.657 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:41 smithi023 ceph-mon[29137]: Detected new or changed devices on smithi153 2024-02-28T16:18:41.657 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:41 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi153 to 4971M 2024-02-28T16:18:41.657 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:41 smithi023 ceph-mon[29137]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:41.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.669+0000 7f34c0c00700 1 -- 172.21.15.23:0/1210403978 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11310 (secure 0 0 0) 0x7f34b0027090 con 0x7f34c4108470 2024-02-28T16:18:41.659 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:18:41.660 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":41,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","created":"2024-02-28T16:11:11.971217+0000","modified":"2024-02-28T16:18:36.486484+0000","last_up_change":"2024-02-28T16:18:35.188913+0000","last_in_change":"2024-02-28T16:18:11.748474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:16:55.847665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1936c40d-0a71-495b-af57-ea0cb7224068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6803","nonce":4264284372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6805","nonce":4264284372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6809","nonce":4264284372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6807","nonce":4264284372}]},"public_addr":"172.21.15.23:6803/4264284372","cluster_addr":"172.21.15.23:6805/4264284372","heartbeat_back_addr":"172.21.15.23:6809/4264284372","heartbeat_front_addr":"172.21.15.23:6807/4264284372","state":["exists","up"]},{"osd":1,"uuid":"f2211134-0ddf-4faf-8fda-41ff13201231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6811","nonce":329835342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6813","nonce":329835342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6817","nonce":329835342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6815","nonce":329835342}]},"public_addr":"172.21.15.23:6811/329835342","cluster_addr":"172.21.15.23:6813/329835342","heartbeat_back_addr":"172.21.15.23:6817/329835342","heartbeat_front_addr":"172.21.15.23:6815/329835342","state":["exists","up"]},{"osd":2,"uuid":"513a900d-c438-4f9a-ad29-c667f5335070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6819","nonce":1429476012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6821","nonce":1429476012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6825","nonce":1429476012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6823","nonce":1429476012}]},"public_addr":"172.21.15.23:6819/1429476012","cluster_addr":"172.21.15.23:6821/1429476012","heartbeat_back_addr":"172.21.15.23:6825/1429476012","heartbeat_front_addr":"172.21.15.23:6823/1429476012","state":["exists","up"]},{"osd":3,"uuid":"0b9875a7-8961-49db-bee2-40980eeec169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6801","nonce":2582260620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6803","nonce":2582260620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6807","nonce":2582260620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6805","nonce":2582260620}]},"public_addr":"172.21.15.153:6801/2582260620","cluster_addr":"172.21.15.153:6803/2582260620","heartbeat_back_addr":"172.21.15.153:6807/2582260620","heartbeat_front_addr":"172.21.15.153:6805/2582260620","state":["exists","up"]},{"osd":4,"uuid":"3266acd3-21ec-4c65-bb5d-48d82334bf09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6809","nonce":559262574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6811","nonce":559262574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6815","nonce":559262574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6813","nonce":559262574}]},"public_addr":"172.21.15.153:6809/559262574","cluster_addr":"172.21.15.153:6811/559262574","heartbeat_back_addr":"172.21.15.153:6815/559262574","heartbeat_front_addr":"172.21.15.153:6813/559262574","state":["exists","up"]},{"osd":5,"uuid":"82e08ef8-51d2-494b-b140-ac7bd2c5a320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6817","nonce":625161245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6819","nonce":625161245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6823","nonce":625161245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6821","nonce":625161245}]},"public_addr":"172.21.15.153:6817/625161245","cluster_addr":"172.21.15.153:6819/625161245","heartbeat_back_addr":"172.21.15.153:6823/625161245","heartbeat_front_addr":"172.21.15.153:6821/625161245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:15:36.785669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:13.722392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:51.886029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:25.675647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:59.836960+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:34.102730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.23:0/3191093495":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1357875446":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6801/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6801/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6800/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/4127609829":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6800/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/2047089350":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/2569614083":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/222399421":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/488139137":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/287772389":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6801/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/3255579829":"2024-02-29T16:12:27.412905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:18:41.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f34a806c680 msgr2=0x7f34a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:41.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f34a806c680 0x7f34a806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f34b4005fd0 tx=0x7f34b400a560 comp rx=0 tx=0).stop 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4108470 msgr2=0x7f34c4198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4108470 0x7f34c4198730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f34b000b5c0 tx=0x7f34b000be00 comp rx=0 tx=0).stop 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 shutdown_connections 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f34a806c680 0x7f34a806eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c4102470 0x7f34c41981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 --2- 172.21.15.23:0/1210403978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34c4108470 0x7f34c4198730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.672+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 >> 172.21.15.23:0/1210403978 conn(0x7f34c40fdf90 msgr2=0x7f34c40ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:41.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.673+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 shutdown_connections 2024-02-28T16:18:41.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:41.673+0000 7f34cae00700 1 -- 172.21.15.23:0/1210403978 wait complete. 2024-02-28T16:18:42.429 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:16:55.847665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:18:42.430 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-28T16:18:42.501 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:42 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1210403978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:18:42.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:42 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1210403978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:18:42.859 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:18:43.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:43 smithi153 ceph-mon[35341]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:43.662 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:43 smithi023 ceph-mon[29137]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 -- 172.21.15.23:0/1360495785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 msgr2=0x7fd1b8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 --2- 172.21.15.23:0/1360495785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b8068b70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009910 tx=0x7fd1a8009c20 comp rx=0 tx=0).stop 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 -- 172.21.15.23:0/1360495785 shutdown_connections 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 --2- 172.21.15.23:0/1360495785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8069140 0x7fd1b8104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 --2- 172.21.15.23:0/1360495785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b8068b70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 -- 172.21.15.23:0/1360495785 >> 172.21.15.23:0/1360495785 conn(0x7fd1b8075130 msgr2=0x7fd1b8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 -- 172.21.15.23:0/1360495785 shutdown_connections 2024-02-28T16:18:44.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.820+0000 7fd1bee00700 1 -- 172.21.15.23:0/1360495785 wait complete. 2024-02-28T16:18:44.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.821+0000 7fd1bee00700 1 Processor -- start 2024-02-28T16:18:44.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.821+0000 7fd1bee00700 1 -- start start 2024-02-28T16:18:44.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1bee00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:44.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1bee00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8069140 0x7fd1b8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:44.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1bee00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8198d10 con 0x7fd1b80687a0 2024-02-28T16:18:44.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1bee00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b819caa0 con 0x7fd1b8069140 2024-02-28T16:18:44.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1b7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:44.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1b7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:46762/0 (socket says 172.21.15.23:46762) 2024-02-28T16:18:44.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1b7e00700 1 -- 172.21.15.23:0/334964231 learned_addr learned my addr 172.21.15.23:0/334964231 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:18:44.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.822+0000 7fd1b7400700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8069140 0x7fd1b8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.823+0000 7fd1b7e00700 1 -- 172.21.15.23:0/334964231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8069140 msgr2=0x7fd1b8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.823+0000 7fd1b7e00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8069140 0x7fd1b8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.823+0000 7fd1b7e00700 1 -- 172.21.15.23:0/334964231 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80095f0 con 0x7fd1b80687a0 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.823+0000 7fd1b7400700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8069140 0x7fd1b8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.823+0000 7fd1b7e00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b81980f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8006010 tx=0x7fd1a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.823+0000 7fd1b4c00700 1 -- 172.21.15.23:0/334964231 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a801d070 con 0x7fd1b80687a0 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.823+0000 7fd1b4c00700 1 -- 172.21.15.23:0/334964231 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1a800f460 con 0x7fd1b80687a0 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.824+0000 7fd1b4c00700 1 -- 172.21.15.23:0/334964231 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a8017630 con 0x7fd1b80687a0 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.824+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b819cd20 con 0x7fd1b80687a0 2024-02-28T16:18:44.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.824+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b819d210 con 0x7fd1b80687a0 2024-02-28T16:18:44.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.825+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b804f2a0 con 0x7fd1b80687a0 2024-02-28T16:18:44.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.827+0000 7fd1b4c00700 1 -- 172.21.15.23:0/334964231 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd1a800f5d0 con 0x7fd1b80687a0 2024-02-28T16:18:44.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.828+0000 7fd1b4c00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd19c06c680 0x7fd19c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:44.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.828+0000 7fd1b4c00700 1 -- 172.21.15.23:0/334964231 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd1a808caf0 con 0x7fd1b80687a0 2024-02-28T16:18:44.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.828+0000 7fd1b7400700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd19c06c680 0x7fd19c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:44.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.829+0000 7fd1b7400700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd19c06c680 0x7fd19c06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8199710 tx=0x7fd1a4005f50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:44.826 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:44.835+0000 7fd1b4c00700 1 -- 172.21.15.23:0/334964231 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd1a8057530 con 0x7fd1b80687a0 2024-02-28T16:18:45.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.056+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1b819d540 con 0x7fd1b80687a0 2024-02-28T16:18:45.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.056+0000 7fd1b4c00700 1 -- 172.21.15.23:0/334964231 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1a805ab50 con 0x7fd1b80687a0 2024-02-28T16:18:45.047 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 1 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.059+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd19c06c680 msgr2=0x7fd19c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.059+0000 7fd1bee00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd19c06c680 0x7fd19c06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8199710 tx=0x7fd1a4005f50 comp rx=0 tx=0).stop 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.059+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 msgr2=0x7fd1b81980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.059+0000 7fd1bee00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b81980f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8006010 tx=0x7fd1a800be20 comp rx=0 tx=0).stop 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.059+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 shutdown_connections 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.060+0000 7fd1bee00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd19c06c680 0x7fd19c06eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.060+0000 7fd1bee00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd1b80687a0 0x7fd1b81980f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.060+0000 7fd1bee00700 1 --2- 172.21.15.23:0/334964231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8069140 0x7fd1b8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.060+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 >> 172.21.15.23:0/334964231 conn(0x7fd1b8075130 msgr2=0x7fd1b80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:45.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.060+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 shutdown_connections 2024-02-28T16:18:45.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:45.060+0000 7fd1bee00700 1 -- 172.21.15.23:0/334964231 wait complete. 2024-02-28T16:18:45.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:45 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/334964231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:18:45.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:45 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/334964231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:18:45.877 INFO:tasks.cephadm:Setting up client nodes... 2024-02-28T16:18:45.878 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T16:18:46.322 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:18:46.645 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:46 smithi023 ceph-mon[29137]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:46 smithi153 ceph-mon[35341]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:47.504 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:47 smithi023 ceph-mon[29137]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:47.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:47 smithi153 ceph-mon[35341]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:48.339 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.348+0000 7efdaec00700 1 -- 172.21.15.23:0/2118845876 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8101440 msgr2=0x7efda8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:48.339 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.348+0000 7efdaec00700 1 --2- 172.21.15.23:0/2118845876 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8101440 0x7efda8101890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd90009910 tx=0x7efd90009c20 comp rx=0 tx=0).stop 2024-02-28T16:18:48.339 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.349+0000 7efdaec00700 1 -- 172.21.15.23:0/2118845876 shutdown_connections 2024-02-28T16:18:48.339 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.349+0000 7efdaec00700 1 --2- 172.21.15.23:0/2118845876 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8101440 0x7efda8101890 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:48.339 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.349+0000 7efdaec00700 1 --2- 172.21.15.23:0/2118845876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda8100240 0x7efda8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:48.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.349+0000 7efdaec00700 1 -- 172.21.15.23:0/2118845876 >> 172.21.15.23:0/2118845876 conn(0x7efda80fb7f0 msgr2=0x7efda80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:48.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.349+0000 7efdaec00700 1 -- 172.21.15.23:0/2118845876 shutdown_connections 2024-02-28T16:18:48.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.349+0000 7efdaec00700 1 -- 172.21.15.23:0/2118845876 wait complete. 2024-02-28T16:18:48.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.350+0000 7efdaec00700 1 Processor -- start 2024-02-28T16:18:48.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.350+0000 7efdaec00700 1 -- start start 2024-02-28T16:18:48.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efdaec00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8100240 0x7efda8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:48.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efdaec00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda8101440 0x7efda8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:48.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efdaec00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8073680 con 0x7efda8100240 2024-02-28T16:18:48.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efdaec00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80737c0 con 0x7efda8101440 2024-02-28T16:18:48.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efda7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8100240 0x7efda8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:48.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efda7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8100240 0x7efda8074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:46784/0 (socket says 172.21.15.23:46784) 2024-02-28T16:18:48.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efda7e00700 1 -- 172.21.15.23:0/2803296762 learned_addr learned my addr 172.21.15.23:0/2803296762 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:18:48.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.351+0000 7efd9f400700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda8101440 0x7efda8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:48.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efda7e00700 1 -- 172.21.15.23:0/2803296762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda8101440 msgr2=0x7efda8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efda7e00700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda8101440 0x7efda8073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efda7e00700 1 -- 172.21.15.23:0/2803296762 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd900095f0 con 0x7efda8100240 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efd9f400700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda8101440 0x7efda8073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efda7e00700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8100240 0x7efda8074af0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd9800b9c0 tx=0x7efd9800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efda5600700 1 -- 172.21.15.23:0/2803296762 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd9800c980 con 0x7efda8100240 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efda5600700 1 -- 172.21.15.23:0/2803296762 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd98014440 con 0x7efda8100240 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efda5600700 1 -- 172.21.15.23:0/2803296762 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd98012550 con 0x7efda8100240 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda8073aa0 con 0x7efda8100240 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.352+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda819dbb0 con 0x7efda8100240 2024-02-28T16:18:48.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.353+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8108e30 con 0x7efda8100240 2024-02-28T16:18:48.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.354+0000 7efda5600700 1 -- 172.21.15.23:0/2803296762 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efd980145b0 con 0x7efda8100240 2024-02-28T16:18:48.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.355+0000 7efda5600700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efd8c06c680 0x7efd8c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:48.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.355+0000 7efda5600700 1 -- 172.21.15.23:0/2803296762 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efd98006e40 con 0x7efda8100240 2024-02-28T16:18:48.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.356+0000 7efd9f400700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efd8c06c680 0x7efd8c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:48.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.356+0000 7efd9f400700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efd8c06c680 0x7efd8c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd9000b5c0 tx=0x7efd90005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:48.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.360+0000 7efda5600700 1 -- 172.21.15.23:0/2803296762 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd9804e720 con 0x7efda8100240 2024-02-28T16:18:48.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.677+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7efda819e160 con 0x7efda8100240 2024-02-28T16:18:48.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.686+0000 7efda5600700 1 -- 172.21.15.23:0/2803296762 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7efd98019050 con 0x7efda8100240 2024-02-28T16:18:48.677 INFO:teuthology.orchestra.run.smithi023.stdout:[client.0] 2024-02-28T16:18:48.677 INFO:teuthology.orchestra.run.smithi023.stdout: key = AQDoXN9lkhN9KBAAvT9ey85V7Z1ZUrxXUzc32w== 2024-02-28T16:18:48.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.689+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efd8c06c680 msgr2=0x7efd8c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:48.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.689+0000 7efdaec00700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efd8c06c680 0x7efd8c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd9000b5c0 tx=0x7efd90005960 comp rx=0 tx=0).stop 2024-02-28T16:18:48.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.689+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8100240 msgr2=0x7efda8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:48.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8100240 0x7efda8074af0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd9800b9c0 tx=0x7efd9800bd80 comp rx=0 tx=0).stop 2024-02-28T16:18:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 shutdown_connections 2024-02-28T16:18:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efd8c06c680 0x7efd8c06eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efda8100240 0x7efda8074af0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 --2- 172.21.15.23:0/2803296762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda8101440 0x7efda8073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 >> 172.21.15.23:0/2803296762 conn(0x7efda80fb7f0 msgr2=0x7efda8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 shutdown_connections 2024-02-28T16:18:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:48.690+0000 7efdaec00700 1 -- 172.21.15.23:0/2803296762 wait complete. 2024-02-28T16:18:48.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:48 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2803296762' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:18:48.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:48 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2803296762' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:18:49.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:48 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2803296762' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:18:49.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:48 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2803296762' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:18:49.362 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:18:49.362 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-28T16:18:49.362 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-28T16:18:49.527 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T16:18:49.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:49 smithi153 ceph-mon[35341]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:49.942 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi153/config 2024-02-28T16:18:50.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:49 smithi023 ceph-mon[29137]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 -- 172.21.15.153:0/4084672950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0106840 msgr2=0x7f9cc0106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/4084672950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0106840 0x7f9cc0106c50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009910 tx=0x7f9cb4009c20 comp rx=0 tx=0).stop 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 -- 172.21.15.153:0/4084672950 shutdown_connections 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/4084672950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9cc0107a40 0x7f9cc0107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/4084672950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0106840 0x7f9cc0106c50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 -- 172.21.15.153:0/4084672950 >> 172.21.15.153:0/4084672950 conn(0x7f9cc0075970 msgr2=0x7f9cc0077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 -- 172.21.15.153:0/4084672950 shutdown_connections 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.067+0000 7f9cc7e00700 1 -- 172.21.15.153:0/4084672950 wait complete. 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.068+0000 7f9cc7e00700 1 Processor -- start 2024-02-28T16:18:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.068+0000 7f9cc7e00700 1 -- start start 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9cc0106840 0x7f9cc019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc7e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0107a40 0x7f9cc019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc7e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019cd10 con 0x7f9cc0106840 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc7e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019ce50 con 0x7f9cc0107a40 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc4a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0107a40 0x7f9cc019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc4a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0107a40 0x7f9cc019c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60814/0 (socket says 172.21.15.153:60814) 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc4a00700 1 -- 172.21.15.153:0/1814568486 learned_addr learned my addr 172.21.15.153:0/1814568486 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc5400700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9cc0106840 0x7f9cc019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc4a00700 1 -- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9cc0106840 msgr2=0x7f9cc019c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc4a00700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9cc0106840 0x7f9cc019c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.069+0000 7f9cc4a00700 1 -- 172.21.15.153:0/1814568486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40095f0 con 0x7f9cc0107a40 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.070+0000 7f9cc4a00700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0107a40 0x7f9cc019c6f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00b4b0 tx=0x7f9cac00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.070+0000 7f9cbe000700 1 -- 172.21.15.153:0/1814568486 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cac011800 con 0x7f9cc0107a40 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.070+0000 7f9cbe000700 1 -- 172.21.15.153:0/1814568486 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cac011e10 con 0x7f9cc0107a40 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.070+0000 7f9cbe000700 1 -- 172.21.15.153:0/1814568486 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cac00f2e0 con 0x7f9cc0107a40 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.070+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc01a1900 con 0x7f9cc0107a40 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.070+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a1e50 con 0x7f9cc0107a40 2024-02-28T16:18:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.071+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc010f410 con 0x7f9cc0107a40 2024-02-28T16:18:52.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.072+0000 7f9cbe000700 1 -- 172.21.15.153:0/1814568486 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9cac010380 con 0x7f9cc0107a40 2024-02-28T16:18:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.073+0000 7f9cbe000700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f9ca806c680 0x7f9ca806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.073+0000 7f9cbe000700 1 -- 172.21.15.153:0/1814568486 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9cac08b090 con 0x7f9cc0107a40 2024-02-28T16:18:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.074+0000 7f9cc5400700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f9ca806c680 0x7f9ca806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.075+0000 7f9cc5400700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f9ca806c680 0x7f9ca806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.078+0000 7f9cbe000700 1 -- 172.21.15.153:0/1814568486 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9cac0595c0 con 0x7f9cc0107a40 2024-02-28T16:18:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.375+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9cc010f600 con 0x7f9cc0107a40 2024-02-28T16:18:52.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.386+0000 7f9cbe000700 1 -- 172.21.15.153:0/1814568486 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9cac059150 con 0x7f9cc0107a40 2024-02-28T16:18:52.376 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-02-28T16:18:52.376 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDsXN9lsMqEFhAAqxX5MlneNJxfeH54PMe23w== 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.388+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f9ca806c680 msgr2=0x7f9ca806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.388+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f9ca806c680 0x7f9ca806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb400b540 comp rx=0 tx=0).stop 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0107a40 msgr2=0x7f9cc019c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0107a40 0x7f9cc019c6f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00b4b0 tx=0x7f9cac00b870 comp rx=0 tx=0).stop 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 shutdown_connections 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f9ca806c680 0x7f9ca806eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9cc0106840 0x7f9cc019c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 --2- 172.21.15.153:0/1814568486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc0107a40 0x7f9cc019c6f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 >> 172.21.15.153:0/1814568486 conn(0x7f9cc0075970 msgr2=0x7f9cc010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:52.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 shutdown_connections 2024-02-28T16:18:52.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:18:52.389+0000 7f9cc7e00700 1 -- 172.21.15.153:0/1814568486 wait complete. 2024-02-28T16:18:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:52 smithi153 ceph-mon[35341]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:52.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:52 smithi023 ceph-mon[29137]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:53.258 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:18:53.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-28T16:18:53.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-28T16:18:53.375 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:53 smithi023 ceph-mon[29137]: from='client.? 172.21.15.153:0/1814568486' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:18:53.376 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:53 smithi023 ceph-mon[29137]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:18:53.376 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:53 smithi023 ceph-mon[29137]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:18:53.411 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-28T16:18:53.412 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-28T16:18:53.412 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph mgr dump --format=json 2024-02-28T16:18:53.484 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:53 smithi153 ceph-mon[35341]: from='client.? 172.21.15.153:0/1814568486' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:18:53.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:53 smithi153 ceph-mon[35341]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:18:53.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:53 smithi153 ceph-mon[35341]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:18:53.830 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:18:54.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:54 smithi023 ceph-mon[29137]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:54.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:54 smithi153 ceph-mon[35341]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:55.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:55 smithi153 ceph-mon[35341]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:55.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:55.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:55 smithi023 ceph-mon[29137]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:55.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 -- 172.21.15.23:0/1410680068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 msgr2=0x7ff1fc104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 --2- 172.21.15.23:0/1410680068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc104eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009910 tx=0x7ff1e4009c20 comp rx=0 tx=0).stop 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 -- 172.21.15.23:0/1410680068 shutdown_connections 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 --2- 172.21.15.23:0/1410680068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc104eb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 --2- 172.21.15.23:0/1410680068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1fc0687a0 0x7ff1fc068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 -- 172.21.15.23:0/1410680068 >> 172.21.15.23:0/1410680068 conn(0x7ff1fc075130 msgr2=0x7ff1fc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 -- 172.21.15.23:0/1410680068 shutdown_connections 2024-02-28T16:18:55.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.866+0000 7ff201e00700 1 -- 172.21.15.23:0/1410680068 wait complete. 2024-02-28T16:18:55.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.867+0000 7ff201e00700 1 Processor -- start 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.867+0000 7ff201e00700 1 -- start start 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.868+0000 7ff201e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1fc0687a0 0x7ff1fc195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.868+0000 7ff201e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.868+0000 7ff201e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc196a80 con 0x7ff1fc069140 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.868+0000 7ff201e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc19a810 con 0x7ff1fc0687a0 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.868+0000 7ff1f2000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.869+0000 7ff1f2000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47280/0 (socket says 172.21.15.23:47280) 2024-02-28T16:18:55.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.869+0000 7ff1f2000700 1 -- 172.21.15.23:0/1635565319 learned_addr learned my addr 172.21.15.23:0/1635565319 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:18:55.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.869+0000 7ff1faa00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1fc0687a0 0x7ff1fc195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:55.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.869+0000 7ff1f2000700 1 -- 172.21.15.23:0/1635565319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1fc0687a0 msgr2=0x7ff1fc195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.869+0000 7ff1f2000700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1fc0687a0 0x7ff1fc195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.869+0000 7ff1f2000700 1 -- 172.21.15.23:0/1635565319 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40095f0 con 0x7ff1fc069140 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.869+0000 7ff1f2000700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc1963a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400bda0 tx=0x7ff1e400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.870+0000 7ff200a00700 1 -- 172.21.15.23:0/1635565319 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e401d070 con 0x7ff1fc069140 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.870+0000 7ff200a00700 1 -- 172.21.15.23:0/1635565319 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1e4022470 con 0x7ff1fc069140 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.870+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc19aa90 con 0x7ff1fc069140 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.870+0000 7ff200a00700 1 -- 172.21.15.23:0/1635565319 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e400f690 con 0x7ff1fc069140 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.870+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc19af80 con 0x7ff1fc069140 2024-02-28T16:18:55.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.871+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc108750 con 0x7ff1fc069140 2024-02-28T16:18:55.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.872+0000 7ff200a00700 1 -- 172.21.15.23:0/1635565319 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff1e4022b00 con 0x7ff1fc069140 2024-02-28T16:18:55.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.873+0000 7ff200a00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff1e006c680 0x7ff1e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:55.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.873+0000 7ff200a00700 1 -- 172.21.15.23:0/1635565319 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff1e408cb20 con 0x7ff1fc069140 2024-02-28T16:18:55.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.873+0000 7ff1faa00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff1e006c680 0x7ff1e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:55.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.874+0000 7ff1faa00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff1e006c680 0x7ff1e006eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec005fd0 tx=0x7ff1ec00a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:55.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:55.878+0000 7ff200a00700 1 -- 172.21.15.23:0/1635565319 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff1e4057550 con 0x7ff1fc069140 2024-02-28T16:18:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.166+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff1fc04f2a0 con 0x7ff1fc069140 2024-02-28T16:18:56.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.174+0000 7ff200a00700 1 -- 172.21.15.23:0/1635565319 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172854 (secure 0 0 0) 0x7ff1e405ab70 con 0x7ff1fc069140 2024-02-28T16:18:56.168 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff1e006c680 msgr2=0x7ff1e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff1e006c680 0x7ff1e006eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec005fd0 tx=0x7ff1ec00a560 comp rx=0 tx=0).stop 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 msgr2=0x7ff1fc1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc1963a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400bda0 tx=0x7ff1e400be80 comp rx=0 tx=0).stop 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 shutdown_connections 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff1e006c680 0x7ff1e006eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1fc0687a0 0x7ff1fc195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 --2- 172.21.15.23:0/1635565319 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff1fc069140 0x7ff1fc1963a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 >> 172.21.15.23:0/1635565319 conn(0x7ff1fc075130 msgr2=0x7ff1fc104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 shutdown_connections 2024-02-28T16:18:56.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:56.179+0000 7ff201e00700 1 -- 172.21.15.23:0/1635565319 wait complete. 2024-02-28T16:18:56.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:56 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1635565319' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T16:18:56.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:56 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1635565319' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T16:18:56.995 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":19,"active_gid":14213,"active_name":"smithi023.bbebnt","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6800","nonce":3957078359},{"type":"v1","addr":"172.21.15.23:6801","nonce":3957078359}]},"active_addr":"172.21.15.23:6801/3957078359","active_change":"2024-02-28T16:13:55.119634+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14238,"name":"smithi153.qlkchp","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.23:8443/","prometheus":"http://172.21.15.23:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":364787592}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":2032489561}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":2855046725}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":1385314359}]}]} 2024-02-28T16:18:56.999 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-28T16:18:57.000 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-28T16:18:57.000 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T16:18:57.446 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:18:57.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:18:57 smithi153 ceph-mon[35341]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:57.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:18:57 smithi023 ceph-mon[29137]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:18:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.503+0000 7f4eece00700 1 -- 172.21.15.23:0/508640107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80730b0 msgr2=0x7f4ee8073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.503+0000 7f4eece00700 1 --2- 172.21.15.23:0/508640107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80730b0 0x7f4ee8073480 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009940 tx=0x7f4ed8009c50 comp rx=0 tx=0).stop 2024-02-28T16:18:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.504+0000 7f4eece00700 1 -- 172.21.15.23:0/508640107 shutdown_connections 2024-02-28T16:18:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.504+0000 7f4eece00700 1 --2- 172.21.15.23:0/508640107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ee80739c0 0x7f4ee810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.504+0000 7f4eece00700 1 --2- 172.21.15.23:0/508640107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80730b0 0x7f4ee8073480 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.504+0000 7f4eece00700 1 -- 172.21.15.23:0/508640107 >> 172.21.15.23:0/508640107 conn(0x7f4ee80fbda0 msgr2=0x7f4ee80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.504+0000 7f4eece00700 1 -- 172.21.15.23:0/508640107 shutdown_connections 2024-02-28T16:18:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.504+0000 7f4eece00700 1 -- 172.21.15.23:0/508640107 wait complete. 2024-02-28T16:18:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.505+0000 7f4eece00700 1 Processor -- start 2024-02-28T16:18:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.505+0000 7f4eece00700 1 -- start start 2024-02-28T16:18:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.505+0000 7f4eece00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ee80730b0 0x7f4ee8100220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.505+0000 7f4eece00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80739c0 0x7f4ee8100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.505+0000 7f4eece00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81043b0 con 0x7f4ee80739c0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.505+0000 7f4eece00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8100ca0 con 0x7f4ee80730b0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80739c0 0x7f4ee8100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80739c0 0x7f4ee8100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52286/0 (socket says 172.21.15.23:52286) 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5400700 1 -- 172.21.15.23:0/805301978 learned_addr learned my addr 172.21.15.23:0/805301978 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5e00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ee80730b0 0x7f4ee8100220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5400700 1 -- 172.21.15.23:0/805301978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ee80730b0 msgr2=0x7f4ee8100220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5400700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ee80730b0 0x7f4ee8100220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5400700 1 -- 172.21.15.23:0/805301978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80095f0 con 0x7f4ee80739c0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.506+0000 7f4ee5400700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80739c0 0x7f4ee8100760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400d8d0 tx=0x7f4ed400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.507+0000 7f4edea00700 1 -- 172.21.15.23:0/805301978 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed4009940 con 0x7f4ee80739c0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.507+0000 7f4edea00700 1 -- 172.21.15.23:0/805301978 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ed4010460 con 0x7f4ee80739c0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.507+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8100f80 con 0x7f4ee80739c0 2024-02-28T16:18:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.507+0000 7f4edea00700 1 -- 172.21.15.23:0/805301978 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed400f5f0 con 0x7f4ee80739c0 2024-02-28T16:18:59.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.507+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee81a6a40 con 0x7f4ee80739c0 2024-02-28T16:18:59.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.508+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee8109cc0 con 0x7f4ee80739c0 2024-02-28T16:18:59.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.509+0000 7f4edea00700 1 -- 172.21.15.23:0/805301978 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4ed40105d0 con 0x7f4ee80739c0 2024-02-28T16:18:59.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.510+0000 7f4edea00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f4ecc06c680 0x7f4ecc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:59.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.510+0000 7f4edea00700 1 -- 172.21.15.23:0/805301978 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4ed408b560 con 0x7f4ee80739c0 2024-02-28T16:18:59.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.510+0000 7f4ee5e00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f4ecc06c680 0x7f4ecc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:59.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.511+0000 7f4ee5e00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f4ecc06c680 0x7f4ecc06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800b840 tx=0x7f4ed800b790 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:59.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.515+0000 7f4edea00700 1 -- 172.21.15.23:0/805301978 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4ed4055f80 con 0x7f4ee80739c0 2024-02-28T16:18:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.735+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ee804f2a0 con 0x7f4ee80739c0 2024-02-28T16:18:59.728 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.738+0000 7f4edea00700 1 -- 172.21.15.23:0/805301978 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11310 (secure 0 0 0) 0x7f4ed40595a0 con 0x7f4ee80739c0 2024-02-28T16:18:59.728 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:18:59.728 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":41,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","created":"2024-02-28T16:11:11.971217+0000","modified":"2024-02-28T16:18:36.486484+0000","last_up_change":"2024-02-28T16:18:35.188913+0000","last_in_change":"2024-02-28T16:18:11.748474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:16:55.847665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1936c40d-0a71-495b-af57-ea0cb7224068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6803","nonce":4264284372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6805","nonce":4264284372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6809","nonce":4264284372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6807","nonce":4264284372}]},"public_addr":"172.21.15.23:6803/4264284372","cluster_addr":"172.21.15.23:6805/4264284372","heartbeat_back_addr":"172.21.15.23:6809/4264284372","heartbeat_front_addr":"172.21.15.23:6807/4264284372","state":["exists","up"]},{"osd":1,"uuid":"f2211134-0ddf-4faf-8fda-41ff13201231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6811","nonce":329835342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6813","nonce":329835342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6817","nonce":329835342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6815","nonce":329835342}]},"public_addr":"172.21.15.23:6811/329835342","cluster_addr":"172.21.15.23:6813/329835342","heartbeat_back_addr":"172.21.15.23:6817/329835342","heartbeat_front_addr":"172.21.15.23:6815/329835342","state":["exists","up"]},{"osd":2,"uuid":"513a900d-c438-4f9a-ad29-c667f5335070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6819","nonce":1429476012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6821","nonce":1429476012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6825","nonce":1429476012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6823","nonce":1429476012}]},"public_addr":"172.21.15.23:6819/1429476012","cluster_addr":"172.21.15.23:6821/1429476012","heartbeat_back_addr":"172.21.15.23:6825/1429476012","heartbeat_front_addr":"172.21.15.23:6823/1429476012","state":["exists","up"]},{"osd":3,"uuid":"0b9875a7-8961-49db-bee2-40980eeec169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6801","nonce":2582260620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6803","nonce":2582260620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6807","nonce":2582260620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6805","nonce":2582260620}]},"public_addr":"172.21.15.153:6801/2582260620","cluster_addr":"172.21.15.153:6803/2582260620","heartbeat_back_addr":"172.21.15.153:6807/2582260620","heartbeat_front_addr":"172.21.15.153:6805/2582260620","state":["exists","up"]},{"osd":4,"uuid":"3266acd3-21ec-4c65-bb5d-48d82334bf09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6809","nonce":559262574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6811","nonce":559262574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6815","nonce":559262574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6813","nonce":559262574}]},"public_addr":"172.21.15.153:6809/559262574","cluster_addr":"172.21.15.153:6811/559262574","heartbeat_back_addr":"172.21.15.153:6815/559262574","heartbeat_front_addr":"172.21.15.153:6813/559262574","state":["exists","up"]},{"osd":5,"uuid":"82e08ef8-51d2-494b-b140-ac7bd2c5a320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6817","nonce":625161245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6819","nonce":625161245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6823","nonce":625161245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6821","nonce":625161245}]},"public_addr":"172.21.15.153:6817/625161245","cluster_addr":"172.21.15.153:6819/625161245","heartbeat_back_addr":"172.21.15.153:6823/625161245","heartbeat_front_addr":"172.21.15.153:6821/625161245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:15:36.785669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:13.722392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:51.886029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:25.675647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:59.836960+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:34.102730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.23:0/3191093495":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1357875446":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6801/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6801/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6800/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/4127609829":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6800/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/2047089350":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/2569614083":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/222399421":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/488139137":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/287772389":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6801/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/3255579829":"2024-02-29T16:12:27.412905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:18:59.731 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f4ecc06c680 msgr2=0x7f4ecc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:59.731 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f4ecc06c680 0x7f4ecc06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800b840 tx=0x7f4ed800b790 comp rx=0 tx=0).stop 2024-02-28T16:18:59.731 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80739c0 msgr2=0x7f4ee8100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:59.731 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80739c0 0x7f4ee8100760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400d8d0 tx=0x7f4ed400dc90 comp rx=0 tx=0).stop 2024-02-28T16:18:59.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 shutdown_connections 2024-02-28T16:18:59.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f4ecc06c680 0x7f4ecc06eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:59.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ee80730b0 0x7f4ee8100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:59.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 --2- 172.21.15.23:0/805301978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ee80739c0 0x7f4ee8100760 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:59.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 >> 172.21.15.23:0/805301978 conn(0x7f4ee80fbda0 msgr2=0x7f4ee8106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:59.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 shutdown_connections 2024-02-28T16:18:59.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:18:59.741+0000 7f4eece00700 1 -- 172.21.15.23:0/805301978 wait complete. 2024-02-28T16:19:00.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:00 smithi023 ceph-mon[29137]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:00.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:00 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/805301978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:19:00.479 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-28T16:19:00.479 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T16:19:00.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:00 smithi153 ceph-mon[35341]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:00 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/805301978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:19:00.914 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:02.501 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:02 smithi023 ceph-mon[29137]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:02 smithi153 ceph-mon[35341]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 -- 172.21.15.23:0/1144676517 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c100e80 msgr2=0x7f972c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 --2- 172.21.15.23:0/1144676517 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c100e80 0x7f972c104e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9718009910 tx=0x7f9718009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 -- 172.21.15.23:0/1144676517 shutdown_connections 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 --2- 172.21.15.23:0/1144676517 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c100e80 0x7f972c104e50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 --2- 172.21.15.23:0/1144676517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c1004e0 0x7f972c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 -- 172.21.15.23:0/1144676517 >> 172.21.15.23:0/1144676517 conn(0x7f972c0fbda0 msgr2=0x7f972c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 -- 172.21.15.23:0/1144676517 shutdown_connections 2024-02-28T16:19:02.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.973+0000 7f9731e00700 1 -- 172.21.15.23:0/1144676517 wait complete. 2024-02-28T16:19:02.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.975+0000 7f9731e00700 1 Processor -- start 2024-02-28T16:19:02.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.975+0000 7f9731e00700 1 -- start start 2024-02-28T16:19:02.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f9731e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c1004e0 0x7f972c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:02.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f9731e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c100e80 0x7f972c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:02.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f9731e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c198d50 con 0x7f972c1004e0 2024-02-28T16:19:02.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f9731e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c19cae0 con 0x7f972c100e80 2024-02-28T16:19:02.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f972aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c1004e0 0x7f972c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:02.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f972aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c1004e0 0x7f972c198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52302/0 (socket says 172.21.15.23:52302) 2024-02-28T16:19:02.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f972aa00700 1 -- 172.21.15.23:0/3990881298 learned_addr learned my addr 172.21.15.23:0/3990881298 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:02.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f972a000700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c100e80 0x7f972c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:02.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f972aa00700 1 -- 172.21.15.23:0/3990881298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c100e80 msgr2=0x7f972c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:02.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f972aa00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c100e80 0x7f972c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:02.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.976+0000 7f972aa00700 1 -- 172.21.15.23:0/3990881298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180095f0 con 0x7f972c1004e0 2024-02-28T16:19:02.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.977+0000 7f972aa00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c1004e0 0x7f972c198130 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f971c00d8d0 tx=0x7f971c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:02.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.977+0000 7f9730a00700 1 -- 172.21.15.23:0/3990881298 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f971c009940 con 0x7f972c1004e0 2024-02-28T16:19:02.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.977+0000 7f9730a00700 1 -- 172.21.15.23:0/3990881298 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f971c010460 con 0x7f972c1004e0 2024-02-28T16:19:02.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.977+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c19cdc0 con 0x7f972c1004e0 2024-02-28T16:19:02.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.977+0000 7f9730a00700 1 -- 172.21.15.23:0/3990881298 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f971c00f5f0 con 0x7f972c1004e0 2024-02-28T16:19:02.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.977+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c19d310 con 0x7f972c1004e0 2024-02-28T16:19:02.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.978+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c1045d0 con 0x7f972c1004e0 2024-02-28T16:19:02.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.979+0000 7f9730a00700 1 -- 172.21.15.23:0/3990881298 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f971c0105d0 con 0x7f972c1004e0 2024-02-28T16:19:02.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.980+0000 7f9730a00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f971006c680 0x7f971006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:02.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.980+0000 7f9730a00700 1 -- 172.21.15.23:0/3990881298 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f971c08b5e0 con 0x7f972c1004e0 2024-02-28T16:19:02.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.981+0000 7f972a000700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f971006c680 0x7f971006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:02.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.981+0000 7f972a000700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f971006c680 0x7f971006eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97180059d0 tx=0x7f9718005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:02.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:02.985+0000 7f9730a00700 1 -- 172.21.15.23:0/3990881298 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f971c055f60 con 0x7f972c1004e0 2024-02-28T16:19:03.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.206+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f972c04f2a0 con 0x7f972c1004e0 2024-02-28T16:19:03.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.207+0000 7f9730a00700 1 -- 172.21.15.23:0/3990881298 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11310 (secure 0 0 0) 0x7f971c059580 con 0x7f972c1004e0 2024-02-28T16:19:03.199 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:19:03.199 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":41,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","created":"2024-02-28T16:11:11.971217+0000","modified":"2024-02-28T16:18:36.486484+0000","last_up_change":"2024-02-28T16:18:35.188913+0000","last_in_change":"2024-02-28T16:18:11.748474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:16:55.847665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1936c40d-0a71-495b-af57-ea0cb7224068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6803","nonce":4264284372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6805","nonce":4264284372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6809","nonce":4264284372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6807","nonce":4264284372}]},"public_addr":"172.21.15.23:6803/4264284372","cluster_addr":"172.21.15.23:6805/4264284372","heartbeat_back_addr":"172.21.15.23:6809/4264284372","heartbeat_front_addr":"172.21.15.23:6807/4264284372","state":["exists","up"]},{"osd":1,"uuid":"f2211134-0ddf-4faf-8fda-41ff13201231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6811","nonce":329835342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6813","nonce":329835342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6817","nonce":329835342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6815","nonce":329835342}]},"public_addr":"172.21.15.23:6811/329835342","cluster_addr":"172.21.15.23:6813/329835342","heartbeat_back_addr":"172.21.15.23:6817/329835342","heartbeat_front_addr":"172.21.15.23:6815/329835342","state":["exists","up"]},{"osd":2,"uuid":"513a900d-c438-4f9a-ad29-c667f5335070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6819","nonce":1429476012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6821","nonce":1429476012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6825","nonce":1429476012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6823","nonce":1429476012}]},"public_addr":"172.21.15.23:6819/1429476012","cluster_addr":"172.21.15.23:6821/1429476012","heartbeat_back_addr":"172.21.15.23:6825/1429476012","heartbeat_front_addr":"172.21.15.23:6823/1429476012","state":["exists","up"]},{"osd":3,"uuid":"0b9875a7-8961-49db-bee2-40980eeec169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6801","nonce":2582260620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6803","nonce":2582260620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6807","nonce":2582260620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6805","nonce":2582260620}]},"public_addr":"172.21.15.153:6801/2582260620","cluster_addr":"172.21.15.153:6803/2582260620","heartbeat_back_addr":"172.21.15.153:6807/2582260620","heartbeat_front_addr":"172.21.15.153:6805/2582260620","state":["exists","up"]},{"osd":4,"uuid":"3266acd3-21ec-4c65-bb5d-48d82334bf09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6809","nonce":559262574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6811","nonce":559262574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6815","nonce":559262574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6813","nonce":559262574}]},"public_addr":"172.21.15.153:6809/559262574","cluster_addr":"172.21.15.153:6811/559262574","heartbeat_back_addr":"172.21.15.153:6815/559262574","heartbeat_front_addr":"172.21.15.153:6813/559262574","state":["exists","up"]},{"osd":5,"uuid":"82e08ef8-51d2-494b-b140-ac7bd2c5a320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6817","nonce":625161245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6819","nonce":625161245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6823","nonce":625161245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6821","nonce":625161245}]},"public_addr":"172.21.15.153:6817/625161245","cluster_addr":"172.21.15.153:6819/625161245","heartbeat_back_addr":"172.21.15.153:6823/625161245","heartbeat_front_addr":"172.21.15.153:6821/625161245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:15:36.785669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:13.722392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:51.886029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:25.675647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:59.836960+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:34.102730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.23:0/3191093495":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1357875446":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6801/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6801/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6800/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/4127609829":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6800/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/2047089350":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/2569614083":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/222399421":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/488139137":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/287772389":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6801/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/3255579829":"2024-02-29T16:12:27.412905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:19:03.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f971006c680 msgr2=0x7f971006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:03.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f971006c680 0x7f971006eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97180059d0 tx=0x7f9718005960 comp rx=0 tx=0).stop 2024-02-28T16:19:03.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c1004e0 msgr2=0x7f972c198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c1004e0 0x7f972c198130 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f971c00d8d0 tx=0x7f971c00dc90 comp rx=0 tx=0).stop 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 shutdown_connections 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f971006c680 0x7f971006eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f972c1004e0 0x7f972c198130 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 --2- 172.21.15.23:0/3990881298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c100e80 0x7f972c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.210+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 >> 172.21.15.23:0/3990881298 conn(0x7f972c0fbda0 msgr2=0x7f972c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.211+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 shutdown_connections 2024-02-28T16:19:03.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:03.211+0000 7f9731e00700 1 -- 172.21.15.23:0/3990881298 wait complete. 2024-02-28T16:19:03.587 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:03 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3990881298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:19:03.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:03 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3990881298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:19:03.949 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-28T16:19:03.949 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-28T16:19:03.950 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-28T16:19:03.950 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-28T16:19:03.951 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-28T16:19:03.951 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-28T16:19:04.493 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:04.502 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:04.544 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:04.549 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:04.559 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:04.570 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:04 smithi153 ceph-mon[35341]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:04.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:04 smithi023 ceph-mon[29137]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:05.550 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:05 smithi023 ceph-mon[29137]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:05.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:05 smithi153 ceph-mon[35341]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:08.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:08 smithi023 ceph-mon[29137]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:08.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:08 smithi153 ceph-mon[35341]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:10.570 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:10 smithi023 ceph-mon[29137]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:10.570 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:10.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:10 smithi153 ceph-mon[35341]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:10.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 -- 172.21.15.23:0/151616929 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 msgr2=0x7f24ac1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 --2- 172.21.15.23:0/151616929 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac1028a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f249c009910 tx=0x7f249c009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 -- 172.21.15.23:0/151616929 shutdown_connections 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 --2- 172.21.15.23:0/151616929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24ac102e70 0x7f24ac106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 --2- 172.21.15.23:0/151616929 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac1028a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 -- 172.21.15.23:0/151616929 >> 172.21.15.23:0/151616929 conn(0x7f24ac0fdd90 msgr2=0x7f24ac1001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 -- 172.21.15.23:0/151616929 shutdown_connections 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.578+0000 7f24b1a00700 1 -- 172.21.15.23:0/151616929 wait complete. 2024-02-28T16:19:11.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.579+0000 7f24b1a00700 1 Processor -- start 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.580+0000 7f24b1a00700 1 -- start start 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.580+0000 7f24b1a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.580+0000 7f24b1a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24ac102e70 0x7f24ac1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.580+0000 7f24b1a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac198aa0 con 0x7f24ac1024d0 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.580+0000 7f24b1a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac19c830 con 0x7f24ac102e70 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24abe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24abe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43878/0 (socket says 172.21.15.23:43878) 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24abe00700 1 -- 172.21.15.23:0/1951615897 learned_addr learned my addr 172.21.15.23:0/1951615897 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24ab400700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24ac102e70 0x7f24ac1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24abe00700 1 -- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24ac102e70 msgr2=0x7f24ac1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:11.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24abe00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24ac102e70 0x7f24ac1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24abe00700 1 -- 172.21.15.23:0/1951615897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0095f0 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24abe00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac197e80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f249c006010 tx=0x7f249c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.581+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f249c01d070 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.582+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f249c00f460 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.582+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac19cab0 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.582+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f249c021640 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.582+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac19cfa0 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.583+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24ac10f760 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.584+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f249c00fab0 con 0x7f24ac1024d0 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.584+0000 7f24a8c00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f249006c680 0x7f249006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:11.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.585+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f249c08c9d0 con 0x7f24ac1024d0 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.585+0000 7f24ab400700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f249006c680 0x7f249006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.585+0000 7f24a8c00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] conn(0x7f2490072350 0x7f2490074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.585+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 --> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2490074e10 con 0x7f2490072350 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.585+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f249c0912a0 con 0x7f24ac1024d0 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.585+0000 7f24ab400700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f249006c680 0x7f249006eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2498006fd0 tx=0x7f2498008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.585+0000 7f24b1000700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] conn(0x7f2490072350 0x7f2490074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.586+0000 7f24b1000700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] conn(0x7f2490072350 0x7f2490074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.589+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== osd.3 v2:172.21.15.153:6800/2582260620 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2490074e10 con 0x7f2490072350 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.606+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 --> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24ac062380 con 0x7f2490072350 2024-02-28T16:19:11.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.607+0000 7f24a8c00700 1 -- 172.21.15.23:0/1951615897 <== osd.3 v2:172.21.15.153:6800/2582260620 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f24ac062380 con 0x7f2490072350 2024-02-28T16:19:11.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.607+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] conn(0x7f2490072350 msgr2=0x7f2490074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:11.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.607+0000 7f24b1a00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] conn(0x7f2490072350 0x7f2490074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f249006c680 msgr2=0x7f249006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:11.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f249006c680 0x7f249006eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2498006fd0 tx=0x7f2498008040 comp rx=0 tx=0).stop 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 msgr2=0x7f24ac197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac197e80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f249c006010 tx=0x7f249c00be20 comp rx=0 tx=0).stop 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 shutdown_connections 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:6800/2582260620,v1:172.21.15.153:6801/2582260620] conn(0x7f2490072350 0x7f2490074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f249006c680 0x7f249006eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24ac1024d0 0x7f24ac197e80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 --2- 172.21.15.23:0/1951615897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24ac102e70 0x7f24ac1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 >> 172.21.15.23:0/1951615897 conn(0x7f24ac0fdd90 msgr2=0x7f24ac0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 shutdown_connections 2024-02-28T16:19:11.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:10.608+0000 7f24b1a00700 1 -- 172.21.15.23:0/1951615897 wait complete. 2024-02-28T16:19:12.086 INFO:teuthology.orchestra.run.smithi023.stdout:115964117015 2024-02-28T16:19:12.087 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-28T16:19:12.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:12 smithi023 ceph-mon[29137]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:12.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:12 smithi153 ceph-mon[35341]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.518+0000 7fd28c400700 1 -- 172.21.15.23:0/1730905916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd2841004e0 msgr2=0x7fd2841008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.519+0000 7fd28c400700 1 --2- 172.21.15.23:0/1730905916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd2841004e0 0x7fd2841008b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd278009910 tx=0x7fd278009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.519+0000 7fd28c400700 1 -- 172.21.15.23:0/1730905916 shutdown_connections 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.519+0000 7fd28c400700 1 --2- 172.21.15.23:0/1730905916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd284100e80 0x7fd284104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.519+0000 7fd28c400700 1 --2- 172.21.15.23:0/1730905916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd2841004e0 0x7fd2841008b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.519+0000 7fd28c400700 1 -- 172.21.15.23:0/1730905916 >> 172.21.15.23:0/1730905916 conn(0x7fd2840fbda0 msgr2=0x7fd2840fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.519+0000 7fd28c400700 1 -- 172.21.15.23:0/1730905916 shutdown_connections 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.519+0000 7fd28c400700 1 -- 172.21.15.23:0/1730905916 wait complete. 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.520+0000 7fd28c400700 1 Processor -- start 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.520+0000 7fd28c400700 1 -- start start 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd28c400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2841004e0 0x7fd284195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd28c400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd284100e80 0x7fd2841964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd28c400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd284196bb0 con 0x7fd284100e80 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd28c400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28419a940 con 0x7fd2841004e0 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd289000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd284100e80 0x7fd2841964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd289000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd284100e80 0x7fd2841964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43894/0 (socket says 172.21.15.23:43894) 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd289000700 1 -- 172.21.15.23:0/3801034491 learned_addr learned my addr 172.21.15.23:0/3801034491 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd289a00700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2841004e0 0x7fd284195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd289000700 1 -- 172.21.15.23:0/3801034491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2841004e0 msgr2=0x7fd284195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd289000700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2841004e0 0x7fd284195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.521+0000 7fd289000700 1 -- 172.21.15.23:0/3801034491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780095f0 con 0x7fd284100e80 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.522+0000 7fd289000700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd284100e80 0x7fd2841964d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd27000b480 tx=0x7fd27000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.522+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2700118c0 con 0x7fd284100e80 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.522+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd270010380 con 0x7fd284100e80 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.522+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28419ac20 con 0x7fd284100e80 2024-02-28T16:19:13.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.522+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27000f4f0 con 0x7fd284100e80 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.522+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28419b170 con 0x7fd284100e80 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.523+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd28410d6f0 con 0x7fd284100e80 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.524+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd2700104f0 con 0x7fd284100e80 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.525+0000 7fd282000700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd26c06c680 0x7fd26c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.525+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd27008b160 con 0x7fd284100e80 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.525+0000 7fd289a00700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd26c06c680 0x7fd26c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.526+0000 7fd282000700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] conn(0x7fd26c072350 0x7fd26c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.526+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 --> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd26c074e10 con 0x7fd26c072350 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.526+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd27008d790 con 0x7fd284100e80 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.526+0000 7fd28a400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] conn(0x7fd26c072350 0x7fd26c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.526+0000 7fd289a00700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd26c06c680 0x7fd26c06eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd278006010 tx=0x7fd27801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.527+0000 7fd28a400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] conn(0x7fd26c072350 0x7fd26c074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.528+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== osd.0 v2:172.21.15.23:6802/4264284372 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd26c074e10 con 0x7fd26c072350 2024-02-28T16:19:13.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.546+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 --> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd28404f2a0 con 0x7fd26c072350 2024-02-28T16:19:13.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.546+0000 7fd282000700 1 -- 172.21.15.23:0/3801034491 <== osd.0 v2:172.21.15.23:6802/4264284372 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd28404f2a0 con 0x7fd26c072350 2024-02-28T16:19:13.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.546+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] conn(0x7fd26c072350 msgr2=0x7fd26c074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] conn(0x7fd26c072350 0x7fd26c074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd26c06c680 msgr2=0x7fd26c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd26c06c680 0x7fd26c06eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd278006010 tx=0x7fd27801a040 comp rx=0 tx=0).stop 2024-02-28T16:19:13.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd284100e80 msgr2=0x7fd2841964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd284100e80 0x7fd2841964d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd27000b480 tx=0x7fd27000b840 comp rx=0 tx=0).stop 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 shutdown_connections 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6802/4264284372,v1:172.21.15.23:6803/4264284372] conn(0x7fd26c072350 0x7fd26c074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd26c06c680 0x7fd26c06eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2841004e0 0x7fd284195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 --2- 172.21.15.23:0/3801034491 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd284100e80 0x7fd2841964d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 >> 172.21.15.23:0/3801034491 conn(0x7fd2840fbda0 msgr2=0x7fd2840fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 shutdown_connections 2024-02-28T16:19:13.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:11.547+0000 7fd28c400700 1 -- 172.21.15.23:0/3801034491 wait complete. 2024-02-28T16:19:13.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.760+0000 7ff88c400700 1 -- 172.21.15.23:0/741970395 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff884069140 msgr2=0x7ff884104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.760+0000 7ff88c400700 1 --2- 172.21.15.23:0/741970395 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff884069140 0x7ff884104eb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff870009910 tx=0x7ff870009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:13.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.760+0000 7ff88c400700 1 -- 172.21.15.23:0/741970395 shutdown_connections 2024-02-28T16:19:13.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.760+0000 7ff88c400700 1 --2- 172.21.15.23:0/741970395 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff884069140 0x7ff884104eb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.761+0000 7ff88c400700 1 --2- 172.21.15.23:0/741970395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8840687a0 0x7ff884068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.761+0000 7ff88c400700 1 -- 172.21.15.23:0/741970395 >> 172.21.15.23:0/741970395 conn(0x7ff884075130 msgr2=0x7ff884075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:13.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.761+0000 7ff88c400700 1 -- 172.21.15.23:0/741970395 shutdown_connections 2024-02-28T16:19:13.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.761+0000 7ff88c400700 1 -- 172.21.15.23:0/741970395 wait complete. 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.762+0000 7ff88c400700 1 Processor -- start 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.762+0000 7ff88c400700 1 -- start start 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.762+0000 7ff88c400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff8840687a0 0x7ff884195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.762+0000 7ff88c400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff884069140 0x7ff8841963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.762+0000 7ff88c400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884196a80 con 0x7ff8840687a0 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.762+0000 7ff88c400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88419a810 con 0x7ff884069140 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.762+0000 7ff889a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff8840687a0 0x7ff884195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.763+0000 7ff889a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff8840687a0 0x7ff884195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43928/0 (socket says 172.21.15.23:43928) 2024-02-28T16:19:13.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.763+0000 7ff889a00700 1 -- 172.21.15.23:0/3950337273 learned_addr learned my addr 172.21.15.23:0/3950337273 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:13.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.763+0000 7ff889000700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff884069140 0x7ff8841963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.763+0000 7ff889a00700 1 -- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff884069140 msgr2=0x7ff8841963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.763+0000 7ff889a00700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff884069140 0x7ff8841963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.763+0000 7ff889a00700 1 -- 172.21.15.23:0/3950337273 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700095f0 con 0x7ff8840687a0 2024-02-28T16:19:13.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.763+0000 7ff889a00700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff8840687a0 0x7ff884195e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff87800c8a0 tx=0x7ff87800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:13.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.764+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87800cea0 con 0x7ff8840687a0 2024-02-28T16:19:13.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.764+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff878004830 con 0x7ff8840687a0 2024-02-28T16:19:13.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.764+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8780055b0 con 0x7ff8840687a0 2024-02-28T16:19:13.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.764+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88419aaf0 con 0x7ff8840687a0 2024-02-28T16:19:13.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.764+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88419b040 con 0x7ff8840687a0 2024-02-28T16:19:13.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.765+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff88410d650 con 0x7ff8840687a0 2024-02-28T16:19:13.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.766+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff878007ad0 con 0x7ff8840687a0 2024-02-28T16:19:13.758 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.767+0000 7ff882000700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff86c06c680 0x7ff86c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.758 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.767+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff87808b1f0 con 0x7ff8840687a0 2024-02-28T16:19:13.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.767+0000 7ff889000700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff86c06c680 0x7ff86c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.767+0000 7ff882000700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] conn(0x7ff86c072350 0x7ff86c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:13.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.767+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 --> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff86c074e10 con 0x7ff86c072350 2024-02-28T16:19:13.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.767+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff87808d8c0 con 0x7ff8840687a0 2024-02-28T16:19:13.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.768+0000 7ff88a400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] conn(0x7ff86c072350 0x7ff86c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:13.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.768+0000 7ff889000700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff86c06c680 0x7ff86c06eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff870006010 tx=0x7ff87000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:13.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.769+0000 7ff88a400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] conn(0x7ff86c072350 0x7ff86c074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:13.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.771+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== osd.5 v2:172.21.15.153:6816/625161245 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff86c074e10 con 0x7ff86c072350 2024-02-28T16:19:13.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.788+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 --> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff88404f2a0 con 0x7ff86c072350 2024-02-28T16:19:13.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.789+0000 7ff882000700 1 -- 172.21.15.23:0/3950337273 <== osd.5 v2:172.21.15.153:6816/625161245 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff88404f2a0 con 0x7ff86c072350 2024-02-28T16:19:13.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] conn(0x7ff86c072350 msgr2=0x7ff86c074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] conn(0x7ff86c072350 0x7ff86c074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff86c06c680 msgr2=0x7ff86c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff86c06c680 0x7ff86c06eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff870006010 tx=0x7ff87000b540 comp rx=0 tx=0).stop 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff8840687a0 msgr2=0x7ff884195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff8840687a0 0x7ff884195e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff87800c8a0 tx=0x7ff87800cc60 comp rx=0 tx=0).stop 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 shutdown_connections 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:6816/625161245,v1:172.21.15.153:6817/625161245] conn(0x7ff86c072350 0x7ff86c074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff86c06c680 0x7ff86c06eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff8840687a0 0x7ff884195e60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 --2- 172.21.15.23:0/3950337273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff884069140 0x7ff8841963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:13.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 >> 172.21.15.23:0/3950337273 conn(0x7ff884075130 msgr2=0x7ff884104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:13.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 shutdown_connections 2024-02-28T16:19:13.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.791+0000 7ff88c400700 1 -- 172.21.15.23:0/3950337273 wait complete. 2024-02-28T16:19:14.357 INFO:teuthology.orchestra.run.smithi023.stdout:38654705709 2024-02-28T16:19:14.357 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 -- 172.21.15.23:0/3252709642 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 msgr2=0x7f0e74104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/3252709642 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74104e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009910 tx=0x7f0e60009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 -- 172.21.15.23:0/3252709642 shutdown_connections 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/3252709642 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74104e50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/3252709642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741004e0 0x7f0e741008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 -- 172.21.15.23:0/3252709642 >> 172.21.15.23:0/3252709642 conn(0x7f0e740fbda0 msgr2=0x7f0e740fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 -- 172.21.15.23:0/3252709642 shutdown_connections 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.052+0000 7f0e7bc00700 1 -- 172.21.15.23:0/3252709642 wait complete. 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.053+0000 7f0e7bc00700 1 Processor -- start 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e7bc00700 1 -- start start 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e7bc00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741004e0 0x7f0e74198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:14.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e7bc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e7bc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e74198be0 con 0x7f0e74100e80 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e7bc00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e74198d20 con 0x7f0e741004e0 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e73e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e73e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43906/0 (socket says 172.21.15.23:43906) 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.054+0000 7f0e73e00700 1 -- 172.21.15.23:0/2062907213 learned_addr learned my addr 172.21.15.23:0/2062907213 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.055+0000 7f0e79200700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741004e0 0x7f0e74198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.055+0000 7f0e73e00700 1 -- 172.21.15.23:0/2062907213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741004e0 msgr2=0x7f0e74198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.055+0000 7f0e73e00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741004e0 0x7f0e74198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.055+0000 7f0e73e00700 1 -- 172.21.15.23:0/2062907213 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600095f0 con 0x7f0e74100e80 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.055+0000 7f0e73e00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74198590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000bda0 tx=0x7f0e6000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.055+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e6001d070 con 0x7f0e74100e80 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.056+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0e60022470 con 0x7f0e74100e80 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.056+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7419cb10 con 0x7f0e74100e80 2024-02-28T16:19:14.367 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.056+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e6000f690 con 0x7f0e74100e80 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.056+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7419d000 con 0x7f0e74100e80 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.057+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e7410d650 con 0x7f0e74100e80 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.058+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0e60022ae0 con 0x7f0e74100e80 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.059+0000 7f0e71600700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0e5c06c680 0x7f0e5c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.059+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0e6008caa0 con 0x7f0e74100e80 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.059+0000 7f0e71600700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] conn(0x7f0e5c072350 0x7f0e5c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.059+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 --> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e5c074e10 con 0x7f0e5c072350 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.060+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e600912a0 con 0x7f0e74100e80 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.060+0000 7f0e79200700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0e5c06c680 0x7f0e5c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.060+0000 7f0e79c00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] conn(0x7f0e5c072350 0x7f0e5c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.060+0000 7f0e79200700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0e5c06c680 0x7f0e5c06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e68005ea0 tx=0x7f0e68005e30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.061+0000 7f0e79c00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] conn(0x7f0e5c072350 0x7f0e5c074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.061+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== osd.1 v2:172.21.15.23:6810/329835342 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0e5c074e10 con 0x7f0e5c072350 2024-02-28T16:19:14.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.079+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 --> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e7404f2a0 con 0x7f0e5c072350 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.080+0000 7f0e71600700 1 -- 172.21.15.23:0/2062907213 <== osd.1 v2:172.21.15.23:6810/329835342 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e7404f2a0 con 0x7f0e5c072350 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.080+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] conn(0x7f0e5c072350 msgr2=0x7f0e5c074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.080+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] conn(0x7f0e5c072350 0x7f0e5c074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.080+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0e5c06c680 msgr2=0x7f0e5c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.080+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0e5c06c680 0x7f0e5c06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e68005ea0 tx=0x7f0e68005e30 comp rx=0 tx=0).stop 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 msgr2=0x7f0e74198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74198590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000bda0 tx=0x7f0e6000be80 comp rx=0 tx=0).stop 2024-02-28T16:19:14.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 shutdown_connections 2024-02-28T16:19:14.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0e5c06c680 0x7f0e5c06eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741004e0 0x7f0e74198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:6810/329835342,v1:172.21.15.23:6811/329835342] conn(0x7f0e5c072350 0x7f0e5c074760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 --2- 172.21.15.23:0/2062907213 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e74100e80 0x7f0e74198590 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:14.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 >> 172.21.15.23:0/2062907213 conn(0x7f0e740fbda0 msgr2=0x7f0e74101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:14.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 shutdown_connections 2024-02-28T16:19:14.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:13.081+0000 7f0e7bc00700 1 -- 172.21.15.23:0/2062907213 wait complete. 2024-02-28T16:19:14.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:14 smithi153 ceph-mon[35341]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:14.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:14 smithi023 ceph-mon[29137]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:15.066 INFO:teuthology.orchestra.run.smithi023.stdout:60129542183 2024-02-28T16:19:15.066 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-28T16:19:15.574 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:15 smithi023 ceph-mon[29137]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:15.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:15 smithi153 ceph-mon[35341]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:15.902 INFO:teuthology.orchestra.run.smithi023.stdout:171798691849 2024-02-28T16:19:15.902 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 -- 172.21.15.23:0/3275392430 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c102e70 msgr2=0x7f124c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 --2- 172.21.15.23:0/3275392430 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c102e70 0x7f124c106e40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1238009910 tx=0x7f1238009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 -- 172.21.15.23:0/3275392430 shutdown_connections 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 --2- 172.21.15.23:0/3275392430 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c102e70 0x7f124c106e40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 --2- 172.21.15.23:0/3275392430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f124c1024d0 0x7f124c1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 -- 172.21.15.23:0/3275392430 >> 172.21.15.23:0/3275392430 conn(0x7f124c0fdd90 msgr2=0x7f124c1001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 -- 172.21.15.23:0/3275392430 shutdown_connections 2024-02-28T16:19:15.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.603+0000 7f1253000700 1 -- 172.21.15.23:0/3275392430 wait complete. 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.604+0000 7f1253000700 1 Processor -- start 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.604+0000 7f1253000700 1 -- start start 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1253000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c1024d0 0x7f124c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1253000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f124c102e70 0x7f124c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1253000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c198a30 con 0x7f124c1024d0 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1253000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c19c7c0 con 0x7f124c102e70 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1251c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c1024d0 0x7f124c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1251c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c1024d0 0x7f124c197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43938/0 (socket says 172.21.15.23:43938) 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1251c00700 1 -- 172.21.15.23:0/657768629 learned_addr learned my addr 172.21.15.23:0/657768629 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1251c00700 1 -- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f124c102e70 msgr2=0x7f124c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1251c00700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f124c102e70 0x7f124c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.605+0000 7f1251c00700 1 -- 172.21.15.23:0/657768629 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380095f0 con 0x7f124c1024d0 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.606+0000 7f1251c00700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c1024d0 0x7f124c197e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f124000c8a0 tx=0x7f124000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.606+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124000cea0 con 0x7f124c1024d0 2024-02-28T16:19:15.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.606+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1240004830 con 0x7f124c1024d0 2024-02-28T16:19:15.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.606+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12400055b0 con 0x7f124c1024d0 2024-02-28T16:19:15.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.606+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c19caa0 con 0x7f124c1024d0 2024-02-28T16:19:15.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.606+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c19cff0 con 0x7f124c1024d0 2024-02-28T16:19:15.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.607+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f124c10f6c0 con 0x7f124c1024d0 2024-02-28T16:19:15.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.608+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1240007ad0 con 0x7f124c1024d0 2024-02-28T16:19:15.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.609+0000 7f124a000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f123406c680 0x7f123406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.609+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f124008b1f0 con 0x7f124c1024d0 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.609+0000 7f124a000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] conn(0x7f1234072350 0x7f1234074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.609+0000 7f1251200700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f123406c680 0x7f123406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.609+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 --> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1234074e10 con 0x7f1234072350 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.609+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f124008d8c0 con 0x7f124c1024d0 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.610+0000 7f1252600700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] conn(0x7f1234072350 0x7f1234074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.610+0000 7f1251200700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f123406c680 0x7f123406eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f123800b5c0 tx=0x7f1238005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.611+0000 7f1252600700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] conn(0x7f1234072350 0x7f1234074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.613+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== osd.4 v2:172.21.15.153:6808/559262574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1234074e10 con 0x7f1234072350 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.631+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 --> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f124c062380 con 0x7f1234072350 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.632+0000 7f124a000700 1 -- 172.21.15.23:0/657768629 <== osd.4 v2:172.21.15.153:6808/559262574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f124c062380 con 0x7f1234072350 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] conn(0x7f1234072350 msgr2=0x7f1234074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:15.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] conn(0x7f1234072350 0x7f1234074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f123406c680 msgr2=0x7f123406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f123406c680 0x7f123406eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f123800b5c0 tx=0x7f1238005960 comp rx=0 tx=0).stop 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c1024d0 msgr2=0x7f124c197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c1024d0 0x7f124c197e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f124000c8a0 tx=0x7f124000cc60 comp rx=0 tx=0).stop 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 shutdown_connections 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:6808/559262574,v1:172.21.15.153:6809/559262574] conn(0x7f1234072350 0x7f1234074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f123406c680 0x7f123406eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f124c1024d0 0x7f124c197e10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 --2- 172.21.15.23:0/657768629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f124c102e70 0x7f124c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.633+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 >> 172.21.15.23:0/657768629 conn(0x7f124c0fdd90 msgr2=0x7f124c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.634+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 shutdown_connections 2024-02-28T16:19:15.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:15.634+0000 7f1253000700 1 -- 172.21.15.23:0/657768629 wait complete. 2024-02-28T16:19:16.831 INFO:teuthology.orchestra.run.smithi023.stdout:150323855377 2024-02-28T16:19:16.832 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-28T16:19:16.923 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 -- 172.21.15.23:0/300789306 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e810c8f0 msgr2=0x7f06e810ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 --2- 172.21.15.23:0/300789306 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e810c8f0 0x7f06e810ccc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009910 tx=0x7f06d8009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 -- 172.21.15.23:0/300789306 shutdown_connections 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 --2- 172.21.15.23:0/300789306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e8106b80 0x7f06e8106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 --2- 172.21.15.23:0/300789306 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e810c8f0 0x7f06e810ccc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 -- 172.21.15.23:0/300789306 >> 172.21.15.23:0/300789306 conn(0x7f06e8076060 msgr2=0x7f06e8078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 -- 172.21.15.23:0/300789306 shutdown_connections 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.590+0000 7f06eea00700 1 -- 172.21.15.23:0/300789306 wait complete. 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.591+0000 7f06eea00700 1 Processor -- start 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.591+0000 7f06eea00700 1 -- start start 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.592+0000 7f06eea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e8106b80 0x7f06e819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.592+0000 7f06eea00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e810c8f0 0x7f06e819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:16.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.592+0000 7f06eea00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e819d060 con 0x7f06e8106b80 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.592+0000 7f06eea00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e81a0df0 con 0x7f06e810c8f0 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.592+0000 7f06e7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e8106b80 0x7f06e819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.592+0000 7f06e7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e8106b80 0x7f06e819c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43952/0 (socket says 172.21.15.23:43952) 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.592+0000 7f06e7e00700 1 -- 172.21.15.23:0/394521068 learned_addr learned my addr 172.21.15.23:0/394521068 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e7e00700 1 -- 172.21.15.23:0/394521068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e810c8f0 msgr2=0x7f06e819c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e7400700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e810c8f0 0x7f06e819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e7e00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e810c8f0 0x7f06e819c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e7e00700 1 -- 172.21.15.23:0/394521068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80095f0 con 0x7f06e8106b80 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e7400700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e810c8f0 0x7f06e819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e7e00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e8106b80 0x7f06e819c440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06d800b5c0 tx=0x7f06d800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d801d070 con 0x7f06e8106b80 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06d8022470 con 0x7f06e8106b80 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e81a1070 con 0x7f06e8106b80 2024-02-28T16:19:16.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d800f670 con 0x7f06e8106b80 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.593+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e81a1560 con 0x7f06e8106b80 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.594+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06e8113d30 con 0x7f06e8106b80 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.596+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f06d8004c30 con 0x7f06e8106b80 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.596+0000 7f06e4c00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f06cc06c680 0x7f06cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.597+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f06d808cbf0 con 0x7f06e8106b80 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.597+0000 7f06e7400700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f06cc06c680 0x7f06cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.597+0000 7f06e4c00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] conn(0x7f06cc072350 0x7f06cc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.597+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 --> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06cc074e10 con 0x7f06cc072350 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.597+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d80922d0 con 0x7f06e8106b80 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.597+0000 7f06eca00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] conn(0x7f06cc072350 0x7f06cc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.598+0000 7f06e7400700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f06cc06c680 0x7f06cc06eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06e819da60 tx=0x7f06d4008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:16.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.598+0000 7f06eca00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] conn(0x7f06cc072350 0x7f06cc074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.599+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== osd.2 v2:172.21.15.23:6818/1429476012 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f06cc074e10 con 0x7f06cc072350 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.617+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 --> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06e804f2a0 con 0x7f06cc072350 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.617+0000 7f06e4c00700 1 -- 172.21.15.23:0/394521068 <== osd.2 v2:172.21.15.23:6818/1429476012 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06e804f2a0 con 0x7f06cc072350 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] conn(0x7f06cc072350 msgr2=0x7f06cc074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] conn(0x7f06cc072350 0x7f06cc074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f06cc06c680 msgr2=0x7f06cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f06cc06c680 0x7f06cc06eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06e819da60 tx=0x7f06d4008040 comp rx=0 tx=0).stop 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e8106b80 msgr2=0x7f06e819c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:16.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e8106b80 0x7f06e819c440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06d800b5c0 tx=0x7f06d800be00 comp rx=0 tx=0).stop 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 shutdown_connections 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6818/1429476012,v1:172.21.15.23:6819/1429476012] conn(0x7f06cc072350 0x7f06cc074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f06cc06c680 0x7f06cc06eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f06e8106b80 0x7f06e819c440 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 --2- 172.21.15.23:0/394521068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e810c8f0 0x7f06e819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 >> 172.21.15.23:0/394521068 conn(0x7f06e8076060 msgr2=0x7f06e80779c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 shutdown_connections 2024-02-28T16:19:16.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:16.618+0000 7f06eea00700 1 -- 172.21.15.23:0/394521068 wait complete. 2024-02-28T16:19:17.543 INFO:teuthology.orchestra.run.smithi023.stdout:81604378655 2024-02-28T16:19:17.543 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-28T16:19:17.588 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:17.677 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:17.694 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:17.696 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:17.940 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:18.348 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:18 smithi023 ceph-mon[29137]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:18.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:18 smithi153 ceph-mon[35341]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:20.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:20 smithi023 ceph-mon[29137]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:20.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:20 smithi153 ceph-mon[35341]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:22.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:22 smithi023 ceph-mon[29137]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:22.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:22 smithi153 ceph-mon[35341]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:24.335 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.309+0000 7fabaa000700 1 -- 172.21.15.23:0/1395751791 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab980054b0 con 0x7fabac102460 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 -- 172.21.15.23:0/1395751791 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac102460 msgr2=0x7fabac1028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 --2- 172.21.15.23:0/1395751791 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac102460 0x7fabac1028d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab98009910 tx=0x7fab98009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 -- 172.21.15.23:0/1395751791 shutdown_connections 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 --2- 172.21.15.23:0/1395751791 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac102460 0x7fabac1028d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 --2- 172.21.15.23:0/1395751791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac108460 0x7fabac108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 -- 172.21.15.23:0/1395751791 >> 172.21.15.23:0/1395751791 conn(0x7fabac0fdf40 msgr2=0x7fabac100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 -- 172.21.15.23:0/1395751791 shutdown_connections 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.310+0000 7fabb2600700 1 -- 172.21.15.23:0/1395751791 wait complete. 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.311+0000 7fabb2600700 1 Processor -- start 2024-02-28T16:19:24.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.311+0000 7fabb2600700 1 -- start start 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabb2600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac108460 0x7fabac198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabb2600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac198970 0x7fabac19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabb2600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac198ef0 con 0x7fabac198970 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabb2600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac199060 con 0x7fabac108460 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabaaa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac198970 0x7fabac19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabaaa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac198970 0x7fabac19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56496/0 (socket says 172.21.15.23:56496) 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabaaa00700 1 -- 172.21.15.23:0/2548625996 learned_addr learned my addr 172.21.15.23:0/2548625996 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabaaa00700 1 -- 172.21.15.23:0/2548625996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac108460 msgr2=0x7fabac198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabaaa00700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac108460 0x7fabac198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabaaa00700 1 -- 172.21.15.23:0/2548625996 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980095f0 con 0x7fabac198970 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.312+0000 7fabaaa00700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac198970 0x7fabac19cde0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab98015000 tx=0x7fab9800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.313+0000 7faba3e00700 1 -- 172.21.15.23:0/2548625996 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9801d070 con 0x7fabac198970 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.313+0000 7faba3e00700 1 -- 172.21.15.23:0/2548625996 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab98004fa0 con 0x7fabac198970 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.313+0000 7faba3e00700 1 -- 172.21.15.23:0/2548625996 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab98017400 con 0x7fabac198970 2024-02-28T16:19:24.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.313+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac19d380 con 0x7fabac198970 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.313+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac19d830 con 0x7fabac198970 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.314+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac10a9d0 con 0x7fabac198970 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.315+0000 7faba3e00700 1 -- 172.21.15.23:0/2548625996 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fab9800f840 con 0x7fabac198970 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.316+0000 7faba3e00700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fab9006c680 0x7fab9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.316+0000 7faba3e00700 1 -- 172.21.15.23:0/2548625996 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fab9808c990 con 0x7fabac198970 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.316+0000 7fabab400700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fab9006c680 0x7fab9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.317+0000 7fabab400700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fab9006c680 0x7fab9006eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab9c005fd0 tx=0x7fab9c005d00 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:24.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.321+0000 7faba3e00700 1 -- 172.21.15.23:0/2548625996 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fab98057310 con 0x7fabac198970 2024-02-28T16:19:24.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:24 smithi153 ceph-mon[35341]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:24.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:24 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3217396050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T16:19:24.494 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:24 smithi023 ceph-mon[29137]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:24.494 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:24 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3217396050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T16:19:24.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.547+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fabac199790 con 0x7fabac198970 2024-02-28T16:19:24.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.548+0000 7faba3e00700 1 -- 172.21.15.23:0/2548625996 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab9805a930 con 0x7fabac198970 2024-02-28T16:19:24.539 INFO:teuthology.orchestra.run.smithi023.stdout:171798691851 2024-02-28T16:19:24.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fab9006c680 msgr2=0x7fab9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fab9006c680 0x7fab9006eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab9c005fd0 tx=0x7fab9c005d00 comp rx=0 tx=0).stop 2024-02-28T16:19:24.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac198970 msgr2=0x7fabac19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac198970 0x7fabac19cde0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab98015000 tx=0x7fab9800be20 comp rx=0 tx=0).stop 2024-02-28T16:19:24.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 shutdown_connections 2024-02-28T16:19:24.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fab9006c680 0x7fab9006eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac108460 0x7fabac198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 --2- 172.21.15.23:0/2548625996 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fabac198970 0x7fabac19cde0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 >> 172.21.15.23:0/2548625996 conn(0x7fabac0fdf40 msgr2=0x7fabac0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:24.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 shutdown_connections 2024-02-28T16:19:24.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.552+0000 7fabb2600700 1 -- 172.21.15.23:0/2548625996 wait complete. 2024-02-28T16:19:24.746 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:24.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.785+0000 7efed8000700 1 -- 172.21.15.23:0/503430916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed0073090 msgr2=0x7efed0073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.785+0000 7efed8000700 1 --2- 172.21.15.23:0/503430916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed0073090 0x7efed0073460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efec4009940 tx=0x7efec4009c50 comp rx=0 tx=0).stop 2024-02-28T16:19:24.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.785+0000 7efed8000700 1 -- 172.21.15.23:0/503430916 shutdown_connections 2024-02-28T16:19:24.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.785+0000 7efed8000700 1 --2- 172.21.15.23:0/503430916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed00739a0 0x7efed010c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.785+0000 7efed8000700 1 --2- 172.21.15.23:0/503430916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed0073090 0x7efed0073460 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.785+0000 7efed8000700 1 -- 172.21.15.23:0/503430916 >> 172.21.15.23:0/503430916 conn(0x7efed00fbda0 msgr2=0x7efed00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.785+0000 7efed8000700 1 -- 172.21.15.23:0/503430916 shutdown_connections 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.786+0000 7efed8000700 1 -- 172.21.15.23:0/503430916 wait complete. 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.787+0000 7efed8000700 1 Processor -- start 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.787+0000 7efed8000700 1 -- start start 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.787+0000 7efed8000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed0073090 0x7efed0198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.787+0000 7efed8000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed00739a0 0x7efed01986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.787+0000 7efed8000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0198da0 con 0x7efed00739a0 2024-02-28T16:19:24.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.787+0000 7efed8000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed019cb30 con 0x7efed0073090 2024-02-28T16:19:24.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.788+0000 7efed4c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed00739a0 0x7efed01986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.788+0000 7efed4c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed00739a0 0x7efed01986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56510/0 (socket says 172.21.15.23:56510) 2024-02-28T16:19:24.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.788+0000 7efed4c00700 1 -- 172.21.15.23:0/4195085203 learned_addr learned my addr 172.21.15.23:0/4195085203 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:24.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.788+0000 7efed5600700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed0073090 0x7efed0198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.788+0000 7efed4c00700 1 -- 172.21.15.23:0/4195085203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed0073090 msgr2=0x7efed0198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.788+0000 7efed4c00700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed0073090 0x7efed0198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.788+0000 7efed4c00700 1 -- 172.21.15.23:0/4195085203 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40095f0 con 0x7efed00739a0 2024-02-28T16:19:24.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.789+0000 7efed4c00700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed00739a0 0x7efed01986c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c8a0 tx=0x7efebc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:24.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.789+0000 7efece000700 1 -- 172.21.15.23:0/4195085203 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efebc00cea0 con 0x7efed00739a0 2024-02-28T16:19:24.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.789+0000 7efece000700 1 -- 172.21.15.23:0/4195085203 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efebc004830 con 0x7efed00739a0 2024-02-28T16:19:24.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.789+0000 7efece000700 1 -- 172.21.15.23:0/4195085203 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efebc0055b0 con 0x7efed00739a0 2024-02-28T16:19:24.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.789+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed019ce10 con 0x7efed00739a0 2024-02-28T16:19:24.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.789+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed019d360 con 0x7efed00739a0 2024-02-28T16:19:24.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.791+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed0109ce0 con 0x7efed00739a0 2024-02-28T16:19:24.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.793+0000 7efece000700 1 -- 172.21.15.23:0/4195085203 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efebc007ad0 con 0x7efed00739a0 2024-02-28T16:19:24.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.794+0000 7efece000700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efeb806c680 0x7efeb806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.794+0000 7efece000700 1 -- 172.21.15.23:0/4195085203 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efebc08b270 con 0x7efed00739a0 2024-02-28T16:19:24.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.794+0000 7efed5600700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efeb806c680 0x7efeb806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.795+0000 7efed5600700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efeb806c680 0x7efeb806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efec4006010 tx=0x7efec4005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:24.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:24.800+0000 7efece000700 1 -- 172.21.15.23:0/4195085203 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efebc055c70 con 0x7efed00739a0 2024-02-28T16:19:24.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 -- 172.21.15.23:0/2597534545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c108470 msgr2=0x7fcc8c108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 --2- 172.21.15.23:0/2597534545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c108470 0x7fcc8c108840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009910 tx=0x7fcc80009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 -- 172.21.15.23:0/2597534545 shutdown_connections 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 --2- 172.21.15.23:0/2597534545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc8c102470 0x7fcc8c1028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 --2- 172.21.15.23:0/2597534545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c108470 0x7fcc8c108840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 -- 172.21.15.23:0/2597534545 >> 172.21.15.23:0/2597534545 conn(0x7fcc8c0fdf90 msgr2=0x7fcc8c1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 -- 172.21.15.23:0/2597534545 shutdown_connections 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.268+0000 7fcc94200700 1 -- 172.21.15.23:0/2597534545 wait complete. 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.269+0000 7fcc94200700 1 Processor -- start 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.269+0000 7fcc94200700 1 -- start start 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.269+0000 7fcc94200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c102470 0x7fcc8c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.269+0000 7fcc94200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc8c108470 0x7fcc8c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.269+0000 7fcc94200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c198e10 con 0x7fcc8c102470 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.269+0000 7fcc94200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c19cba0 con 0x7fcc8c108470 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc91800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c102470 0x7fcc8c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc91800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c102470 0x7fcc8c1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56480/0 (socket says 172.21.15.23:56480) 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc91800700 1 -- 172.21.15.23:0/3217396050 learned_addr learned my addr 172.21.15.23:0/3217396050 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc90e00700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc8c108470 0x7fcc8c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc91800700 1 -- 172.21.15.23:0/3217396050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc8c108470 msgr2=0x7fcc8c198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc91800700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc8c108470 0x7fcc8c198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc91800700 1 -- 172.21.15.23:0/3217396050 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800095f0 con 0x7fcc8c102470 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.270+0000 7fcc90e00700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc8c108470 0x7fcc8c198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.271+0000 7fcc91800700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c102470 0x7fcc8c1981f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000b5c0 tx=0x7fcc8000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.271+0000 7fcc8a000700 1 -- 172.21.15.23:0/3217396050 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc8001d070 con 0x7fcc8c102470 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.271+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c19ce20 con 0x7fcc8c102470 2024-02-28T16:19:24.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.271+0000 7fcc8a000700 1 -- 172.21.15.23:0/3217396050 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc80022470 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.271+0000 7fcc8a000700 1 -- 172.21.15.23:0/3217396050 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc8000f670 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.271+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c19d310 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.273+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c10a9e0 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.274+0000 7fcc8a000700 1 -- 172.21.15.23:0/3217396050 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcc80004c30 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.275+0000 7fcc8a000700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc7406c680 0x7fcc7406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.275+0000 7fcc8a000700 1 -- 172.21.15.23:0/3217396050 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcc8008cbd0 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.276+0000 7fcc90e00700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc7406c680 0x7fcc7406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.276+0000 7fcc90e00700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc7406c680 0x7fcc7406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005fd0 tx=0x7fcc78005dc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.281+0000 7fcc8a000700 1 -- 172.21.15.23:0/3217396050 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcc80057640 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.521+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcc8c199580 con 0x7fcc8c102470 2024-02-28T16:19:24.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.521+0000 7fcc8a000700 1 -- 172.21.15.23:0/3217396050 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc8005ac60 con 0x7fcc8c102470 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stdout:38654705711 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc7406c680 msgr2=0x7fcc7406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc7406c680 0x7fcc7406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005fd0 tx=0x7fcc78005dc0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c102470 msgr2=0x7fcc8c1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c102470 0x7fcc8c1981f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000b5c0 tx=0x7fcc8000be00 comp rx=0 tx=0).stop 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 shutdown_connections 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc7406c680 0x7fcc7406eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc8c102470 0x7fcc8c1981f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 --2- 172.21.15.23:0/3217396050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc8c108470 0x7fcc8c198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:24.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 >> 172.21.15.23:0/3217396050 conn(0x7fcc8c0fdf90 msgr2=0x7fcc8c1002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:24.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 shutdown_connections 2024-02-28T16:19:24.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:23.524+0000 7fcc94200700 1 -- 172.21.15.23:0/3217396050 wait complete. 2024-02-28T16:19:25.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.024+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efed004f2a0 con 0x7efed00739a0 2024-02-28T16:19:25.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.024+0000 7efece000700 1 -- 172.21.15.23:0/4195085203 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efebc059290 con 0x7efed00739a0 2024-02-28T16:19:25.015 INFO:teuthology.orchestra.run.smithi023.stdout:115964117017 2024-02-28T16:19:25.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.027+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efeb806c680 msgr2=0x7efeb806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.027+0000 7efed8000700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efeb806c680 0x7efeb806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efec4006010 tx=0x7efec4005a90 comp rx=0 tx=0).stop 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.027+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed00739a0 msgr2=0x7efed01986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.027+0000 7efed8000700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed00739a0 0x7efed01986c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c8a0 tx=0x7efebc00cc60 comp rx=0 tx=0).stop 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.028+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 shutdown_connections 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.028+0000 7efed8000700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efeb806c680 0x7efeb806eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.028+0000 7efed8000700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed0073090 0x7efed0198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.028+0000 7efed8000700 1 --2- 172.21.15.23:0/4195085203 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efed00739a0 0x7efed01986c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:25.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.028+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 >> 172.21.15.23:0/4195085203 conn(0x7efed00fbda0 msgr2=0x7efed0106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:25.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.028+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 shutdown_connections 2024-02-28T16:19:25.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:25.028+0000 7efed8000700 1 -- 172.21.15.23:0/4195085203 wait complete. 2024-02-28T16:19:25.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:25 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2548625996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T16:19:25.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:25 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/4195085203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T16:19:25.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:25 smithi153 ceph-mon[35341]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:25.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:25 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2548625996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T16:19:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:25 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/4195085203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T16:19:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:25 smithi023 ceph-mon[29137]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:25.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 -- 172.21.15.23:0/1433055957 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a41085b0 msgr2=0x7f13a4108980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 --2- 172.21.15.23:0/1433055957 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a41085b0 0x7f13a4108980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1398009910 tx=0x7f1398009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 -- 172.21.15.23:0/1433055957 shutdown_connections 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 --2- 172.21.15.23:0/1433055957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a4068540 0x7f13a40689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 --2- 172.21.15.23:0/1433055957 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a41085b0 0x7f13a4108980 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 -- 172.21.15.23:0/1433055957 >> 172.21.15.23:0/1433055957 conn(0x7f13a4075130 msgr2=0x7f13a4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 -- 172.21.15.23:0/1433055957 shutdown_connections 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.265+0000 7f13abc00700 1 -- 172.21.15.23:0/1433055957 wait complete. 2024-02-28T16:19:26.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.266+0000 7f13abc00700 1 Processor -- start 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.266+0000 7f13abc00700 1 -- start start 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13abc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a4068540 0x7f13a41980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13abc00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a41085b0 0x7f13a4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13abc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4198d00 con 0x7f13a4068540 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13abc00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a419ca90 con 0x7f13a41085b0 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13a9200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a4068540 0x7f13a41980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13a9200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a4068540 0x7f13a41980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56528/0 (socket says 172.21.15.23:56528) 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13a9200700 1 -- 172.21.15.23:0/2741120729 learned_addr learned my addr 172.21.15.23:0/2741120729 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13a3e00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a41085b0 0x7f13a4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13a9200700 1 -- 172.21.15.23:0/2741120729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a41085b0 msgr2=0x7f13a4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13a9200700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a41085b0 0x7f13a4198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.267+0000 7f13a9200700 1 -- 172.21.15.23:0/2741120729 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980095f0 con 0x7f13a4068540 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.268+0000 7f13a9200700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a4068540 0x7f13a41980e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f139800bda0 tx=0x7f139800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:26.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.268+0000 7f13a1600700 1 -- 172.21.15.23:0/2741120729 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f139801d070 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.268+0000 7f13a1600700 1 -- 172.21.15.23:0/2741120729 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f139800f460 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.268+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a419cd10 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.268+0000 7f13a1600700 1 -- 172.21.15.23:0/2741120729 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1398017630 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.268+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a419d200 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.270+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a410aa00 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.271+0000 7f13a1600700 1 -- 172.21.15.23:0/2741120729 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f139800fab0 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.271+0000 7f13a1600700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f138c06c680 0x7f138c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.272+0000 7f13a1600700 1 -- 172.21.15.23:0/2741120729 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f139808c8d0 con 0x7f13a4068540 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.272+0000 7f13a3e00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f138c06c680 0x7f138c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.272+0000 7f13a3e00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f138c06c680 0x7f138c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1390005950 tx=0x7f13900058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:26.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.276+0000 7f13a1600700 1 -- 172.21.15.23:0/2741120729 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1398057370 con 0x7f13a4068540 2024-02-28T16:19:26.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705709 got 38654705711 for osd.0 2024-02-28T16:19:26.458 DEBUG:teuthology.parallel:result is None 2024-02-28T16:19:26.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.516+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13a41994e0 con 0x7f13a4068540 2024-02-28T16:19:26.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.517+0000 7f13a1600700 1 -- 172.21.15.23:0/2741120729 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f139805a990 con 0x7f13a4068540 2024-02-28T16:19:26.507 INFO:teuthology.orchestra.run.smithi023.stdout:60129542185 2024-02-28T16:19:26.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.519+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f138c06c680 msgr2=0x7f138c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:26.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.519+0000 7f13abc00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f138c06c680 0x7f138c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1390005950 tx=0x7f13900058e0 comp rx=0 tx=0).stop 2024-02-28T16:19:26.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.519+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a4068540 msgr2=0x7f13a41980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:26.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.519+0000 7f13abc00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a4068540 0x7f13a41980e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f139800bda0 tx=0x7f139800be80 comp rx=0 tx=0).stop 2024-02-28T16:19:26.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.520+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 shutdown_connections 2024-02-28T16:19:26.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.520+0000 7f13abc00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f138c06c680 0x7f138c06eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:26.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.520+0000 7f13abc00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a4068540 0x7f13a41980e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:26.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.520+0000 7f13abc00700 1 --2- 172.21.15.23:0/2741120729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a41085b0 0x7f13a4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:26.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.520+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 >> 172.21.15.23:0/2741120729 conn(0x7f13a4075130 msgr2=0x7f13a4106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:26.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.520+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 shutdown_connections 2024-02-28T16:19:26.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.520+0000 7f13abc00700 1 -- 172.21.15.23:0/2741120729 wait complete. 2024-02-28T16:19:26.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:26 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2741120729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T16:19:26.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:26 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2741120729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 -- 172.21.15.23:0/287649897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c100c50 msgr2=0x7f991c104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 --2- 172.21.15.23:0/287649897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c100c50 0x7f991c104c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9908009910 tx=0x7f9908009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 -- 172.21.15.23:0/287649897 shutdown_connections 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 --2- 172.21.15.23:0/287649897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c100c50 0x7f991c104c20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 --2- 172.21.15.23:0/287649897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991c1002b0 0x7f991c100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 -- 172.21.15.23:0/287649897 >> 172.21.15.23:0/287649897 conn(0x7f991c0fbb50 msgr2=0x7f991c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 -- 172.21.15.23:0/287649897 shutdown_connections 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.377+0000 7f9921600700 1 -- 172.21.15.23:0/287649897 wait complete. 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.378+0000 7f9921600700 1 Processor -- start 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f9921600700 1 -- start start 2024-02-28T16:19:27.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f9921600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c1002b0 0x7f991c195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f9921600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991c100c50 0x7f991c1961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f9921600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1967e0 con 0x7f991c1002b0 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f9921600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c196950 con 0x7f991c100c50 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f991be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c1002b0 0x7f991c195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f991be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c1002b0 0x7f991c195ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56544/0 (socket says 172.21.15.23:56544) 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.379+0000 7f991be00700 1 -- 172.21.15.23:0/647692288 learned_addr learned my addr 172.21.15.23:0/647692288 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f991b400700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991c100c50 0x7f991c1961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f991be00700 1 -- 172.21.15.23:0/647692288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991c100c50 msgr2=0x7f991c1961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f991be00700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991c100c50 0x7f991c1961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f991be00700 1 -- 172.21.15.23:0/647692288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99080095f0 con 0x7f991c1002b0 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f991b400700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991c100c50 0x7f991c1961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f991be00700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c1002b0 0x7f991c195ca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f990c00c930 tx=0x7f990c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:27.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f9918c00700 1 -- 172.21.15.23:0/647692288 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f990c007ad0 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c1996f0 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f9918c00700 1 -- 172.21.15.23:0/647692288 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f990c007c30 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f9918c00700 1 -- 172.21.15.23:0/647692288 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f990c018630 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.380+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c199c40 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.382+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c062380 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.383+0000 7f9918c00700 1 -- 172.21.15.23:0/647692288 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f990c00f450 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.383+0000 7f9918c00700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f990006c680 0x7f990006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.384+0000 7f9918c00700 1 -- 172.21.15.23:0/647692288 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f990c08b730 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.384+0000 7f991b400700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f990006c680 0x7f990006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.385+0000 7f991b400700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f990006c680 0x7f990006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9908006010 tx=0x7f990800b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.388+0000 7f9918c00700 1 -- 172.21.15.23:0/647692288 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f990c056130 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.633+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f991c196fc0 con 0x7f991c1002b0 2024-02-28T16:19:27.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.634+0000 7f9918c00700 1 -- 172.21.15.23:0/647692288 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f990c059750 con 0x7f991c1002b0 2024-02-28T16:19:27.524 INFO:teuthology.orchestra.run.smithi023.stdout:150323855379 2024-02-28T16:19:27.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f990006c680 msgr2=0x7f990006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:27.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f990006c680 0x7f990006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9908006010 tx=0x7f990800b540 comp rx=0 tx=0).stop 2024-02-28T16:19:27.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c1002b0 msgr2=0x7f991c195ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:27.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c1002b0 0x7f991c195ca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f990c00c930 tx=0x7f990c00ccf0 comp rx=0 tx=0).stop 2024-02-28T16:19:27.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 shutdown_connections 2024-02-28T16:19:27.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f990006c680 0x7f990006eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:27.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f991c1002b0 0x7f991c195ca0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:27.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 --2- 172.21.15.23:0/647692288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991c100c50 0x7f991c1961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:27.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.637+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 >> 172.21.15.23:0/647692288 conn(0x7f991c0fbb50 msgr2=0x7f991c0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:27.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.638+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 shutdown_connections 2024-02-28T16:19:27.525 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:26.638+0000 7f9921600700 1 -- 172.21.15.23:0/647692288 wait complete. 2024-02-28T16:19:27.839 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:27 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/647692288' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T16:19:27.839 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:27 smithi023 ceph-mon[29137]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:27 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/647692288' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T16:19:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:27 smithi153 ceph-mon[35341]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:28.445 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855377 got 150323855379 for osd.4 2024-02-28T16:19:28.445 DEBUG:teuthology.parallel:result is None 2024-02-28T16:19:29.075 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691851 for osd.5 2024-02-28T16:19:29.076 DEBUG:teuthology.parallel:result is None 2024-02-28T16:19:29.179 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117015 got 115964117017 for osd.3 2024-02-28T16:19:29.179 DEBUG:teuthology.parallel:result is None 2024-02-28T16:19:29.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542183 got 60129542185 for osd.1 2024-02-28T16:19:29.649 DEBUG:teuthology.parallel:result is None 2024-02-28T16:19:30.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:30 smithi023 ceph-mon[29137]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:30.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 -- 172.21.15.23:0/2622267081 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 msgr2=0x7f49f0073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:30.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 --2- 172.21.15.23:0/2622267081 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0073440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009940 tx=0x7f49e0009c50 comp rx=0 tx=0).stop 2024-02-28T16:19:30.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 -- 172.21.15.23:0/2622267081 shutdown_connections 2024-02-28T16:19:30.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 --2- 172.21.15.23:0/2622267081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0073980 0x7f49f010c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:30.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 --2- 172.21.15.23:0/2622267081 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0073440 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:30.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 -- 172.21.15.23:0/2622267081 >> 172.21.15.23:0/2622267081 conn(0x7f49f00fbb60 msgr2=0x7f49f00fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:30.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 -- 172.21.15.23:0/2622267081 shutdown_connections 2024-02-28T16:19:30.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.574+0000 7f49efe00700 1 -- 172.21.15.23:0/2622267081 wait complete. 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.575+0000 7f49efe00700 1 Processor -- start 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.575+0000 7f49efe00700 1 -- start start 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49efe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49efe00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0073980 0x7f49f0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49efe00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0198b00 con 0x7f49f0073070 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49efe00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f019c890 con 0x7f49f0073980 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49eea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:30.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49eea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:38990/0 (socket says 172.21.15.23:38990) 2024-02-28T16:19:30.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49eea00700 1 -- 172.21.15.23:0/2858723877 learned_addr learned my addr 172.21.15.23:0/2858723877 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:30.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.576+0000 7f49ee000700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0073980 0x7f49f0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49eea00700 1 -- 172.21.15.23:0/2858723877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0073980 msgr2=0x7f49f0198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49eea00700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0073980 0x7f49f0198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49eea00700 1 -- 172.21.15.23:0/2858723877 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00095f0 con 0x7f49f0073070 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49ee000700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0073980 0x7f49f0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49eea00700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0197ee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49e00055f0 tx=0x7f49e00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49e7400700 1 -- 172.21.15.23:0/2858723877 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e001d070 con 0x7f49f0073070 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49e7400700 1 -- 172.21.15.23:0/2858723877 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49e000f460 con 0x7f49f0073070 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49e7400700 1 -- 172.21.15.23:0/2858723877 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e0021620 con 0x7f49f0073070 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f019cb10 con 0x7f49f0073070 2024-02-28T16:19:30.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.577+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f019cfb0 con 0x7f49f0073070 2024-02-28T16:19:30.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.579+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0109ae0 con 0x7f49f0073070 2024-02-28T16:19:30.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.579+0000 7f49e7400700 1 -- 172.21.15.23:0/2858723877 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f49e000fa50 con 0x7f49f0073070 2024-02-28T16:19:30.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.580+0000 7f49e7400700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f49d406c680 0x7f49d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:30.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.581+0000 7f49e7400700 1 -- 172.21.15.23:0/2858723877 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f49e008c8d0 con 0x7f49f0073070 2024-02-28T16:19:30.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.581+0000 7f49ee000700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f49d406c680 0x7f49d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:30.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.582+0000 7f49ee000700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f49d406c680 0x7f49d406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49f0199500 tx=0x7f49dc008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:30.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.586+0000 7f49e7400700 1 -- 172.21.15.23:0/2858723877 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f49e0057250 con 0x7f49f0073070 2024-02-28T16:19:30.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:30 smithi153 ceph-mon[35341]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:30.798 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.808+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f49f0062380 con 0x7f49f0073070 2024-02-28T16:19:30.799 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.809+0000 7f49e7400700 1 -- 172.21.15.23:0/2858723877 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49e005a870 con 0x7f49f0073070 2024-02-28T16:19:30.799 INFO:teuthology.orchestra.run.smithi023.stdout:81604378657 2024-02-28T16:19:30.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.811+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f49d406c680 msgr2=0x7f49d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:30.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.811+0000 7f49efe00700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f49d406c680 0x7f49d406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49f0199500 tx=0x7f49dc008040 comp rx=0 tx=0).stop 2024-02-28T16:19:30.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.811+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 msgr2=0x7f49f0197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:30.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.811+0000 7f49efe00700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0197ee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49e00055f0 tx=0x7f49e00056d0 comp rx=0 tx=0).stop 2024-02-28T16:19:30.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.812+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 shutdown_connections 2024-02-28T16:19:30.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.812+0000 7f49efe00700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f49d406c680 0x7f49d406eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:30.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.812+0000 7f49efe00700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0073070 0x7f49f0197ee0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:30.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.812+0000 7f49efe00700 1 --2- 172.21.15.23:0/2858723877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0073980 0x7f49f0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:30.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.812+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 >> 172.21.15.23:0/2858723877 conn(0x7f49f00fbb60 msgr2=0x7f49f0106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:30.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.812+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 shutdown_connections 2024-02-28T16:19:30.803 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:30.812+0000 7f49efe00700 1 -- 172.21.15.23:0/2858723877 wait complete. 2024-02-28T16:19:31.497 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:31 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2858723877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T16:19:31.559 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378655 got 81604378657 for osd.2 2024-02-28T16:19:31.559 DEBUG:teuthology.parallel:result is None 2024-02-28T16:19:31.559 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-28T16:19:31.560 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T16:19:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:31 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2858723877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T16:19:32.014 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:32.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:32 smithi023 ceph-mon[29137]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:32 smithi153 ceph-mon[35341]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 -- 172.21.15.23:0/4226735645 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc106b80 msgr2=0x7ff9bc106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 --2- 172.21.15.23:0/4226735645 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc106b80 0x7ff9bc106ff0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009910 tx=0x7ff9a8009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 -- 172.21.15.23:0/4226735645 shutdown_connections 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 --2- 172.21.15.23:0/4226735645 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc106b80 0x7ff9bc106ff0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 --2- 172.21.15.23:0/4226735645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc10c8f0 0x7ff9bc10ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 -- 172.21.15.23:0/4226735645 >> 172.21.15.23:0/4226735645 conn(0x7ff9bc076060 msgr2=0x7ff9bc078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 -- 172.21.15.23:0/4226735645 shutdown_connections 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.207+0000 7ff9c4200700 1 -- 172.21.15.23:0/4226735645 wait complete. 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.208+0000 7ff9c4200700 1 Processor -- start 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.208+0000 7ff9c4200700 1 -- start start 2024-02-28T16:19:34.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c4200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc106b80 0x7ff9bc19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:34.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c4200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc10c8f0 0x7ff9bc19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:34.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c4200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc19cfd0 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c4200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc19d110 con 0x7ff9bc106b80 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c0e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc10c8f0 0x7ff9bc19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c0e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc10c8f0 0x7ff9bc19c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39006/0 (socket says 172.21.15.23:39006) 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c0e00700 1 -- 172.21.15.23:0/1779435033 learned_addr learned my addr 172.21.15.23:0/1779435033 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c1800700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc106b80 0x7ff9bc19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c0e00700 1 -- 172.21.15.23:0/1779435033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc106b80 msgr2=0x7ff9bc19c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c0e00700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc106b80 0x7ff9bc19c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.209+0000 7ff9c0e00700 1 -- 172.21.15.23:0/1779435033 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80095f0 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.210+0000 7ff9c0e00700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc10c8f0 0x7ff9bc19c980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8006010 tx=0x7ff9a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.210+0000 7ff9ba000700 1 -- 172.21.15.23:0/1779435033 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9a801d070 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.210+0000 7ff9ba000700 1 -- 172.21.15.23:0/1779435033 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9a800f460 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.210+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc1a0f00 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.210+0000 7ff9ba000700 1 -- 172.21.15.23:0/1779435033 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9a8017630 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.210+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc1a13f0 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.211+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc10ecc0 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.212+0000 7ff9ba000700 1 -- 172.21.15.23:0/1779435033 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff9a800f5d0 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.214+0000 7ff9ba000700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff9a406c680 0x7ff9a406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:34.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.214+0000 7ff9ba000700 1 -- 172.21.15.23:0/1779435033 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff9a808cb70 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.214+0000 7ff9c1800700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff9a406c680 0x7ff9a406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:34.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.215+0000 7ff9c1800700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff9a406c680 0x7ff9a406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0005ea0 tx=0x7ff9b0005e30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:34.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.218+0000 7ff9ba000700 1 -- 172.21.15.23:0/1779435033 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff9a8057570 con 0x7ff9bc10c8f0 2024-02-28T16:19:34.427 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.437+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9bc02cca0 con 0x7ff9a406c680 2024-02-28T16:19:34.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.440+0000 7ff9ba000700 1 -- 172.21.15.23:0/1779435033 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27336 (secure 0 0 0) 0x7ff9bc02cca0 con 0x7ff9a406c680 2024-02-28T16:19:34.530 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:19:34.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff9a406c680 msgr2=0x7ff9a406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:34.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff9a406c680 0x7ff9a406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0005ea0 tx=0x7ff9b0005e30 comp rx=0 tx=0).stop 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc10c8f0 msgr2=0x7ff9bc19c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc10c8f0 0x7ff9bc19c980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8006010 tx=0x7ff9a800be20 comp rx=0 tx=0).stop 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 shutdown_connections 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7ff9a406c680 0x7ff9a406eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc106b80 0x7ff9bc19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 --2- 172.21.15.23:0/1779435033 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9bc10c8f0 0x7ff9bc19c980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 >> 172.21.15.23:0/1779435033 conn(0x7ff9bc076060 msgr2=0x7ff9bc077ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 shutdown_connections 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:34.443+0000 7ff9c4200700 1 -- 172.21.15.23:0/1779435033 wait complete. 2024-02-28T16:19:34.531 INFO:teuthology.orchestra.run.smithi023.stderr:dumped all 2024-02-28T16:19:34.611 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:34 smithi023 ceph-mon[29137]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:34.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:34 smithi153 ceph-mon[35341]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:35.277 INFO:teuthology.orchestra.run.smithi023.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-02-28T16:19:33.219878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165636,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305276,"statfs":{"total":575970213888,"available":575800602624,"internally_reserved":0,"allocated":4018176,"data_stored":2627442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003698"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-28T16:18:35.197189+0000","last_change":"2024-02-28T16:18:01.295390+0000","last_active":"2024-02-28T16:18:35.197189+0000","last_peered":"2024-02-28T16:18:35.197189+0000","last_clean":"2024-02-28T16:18:35.197189+0000","last_became_active":"2024-02-28T16:18:01.295026+0000","last_became_peered":"2024-02-28T16:18:01.295026+0000","last_unstale":"2024-02-28T16:18:35.197189+0000","last_undegraded":"2024-02-28T16:18:35.197189+0000","last_fullsized":"2024-02-28T16:18:35.197189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T16:16:55.901501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T16:16:55.901501+0000","last_clean_scrub_stamp":"2024-02-28T16:16:55.901501+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-01T02:05:22.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855381,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.876},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.0680000000000001}]},{"osd":1,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":1.1020000000000001}]},{"osd":2,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":4.96,"5min":4.96,"15min":4.96},"last":0.95799999999999996}]},{"osd":3,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":3,"up_from":27,"seq":115964117019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:18:27 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Wed Feb 28 16:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed Feb 28 16:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.194}]},{"osd":4,"last update":"Wed Feb 28 16:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83399999999999996,"15min":0.82899999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90400000000000003,"15min":0.89800000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.84199999999999997}]},{"osd":1,"last update":"Wed Feb 28 16:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.995,"15min":1.0049999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.121,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.96899999999999997,"15min":0.97199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Wed Feb 28 16:18:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.3260000000000001}]},{"osd":4,"last update":"Wed Feb 28 16:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":6.4980000000000002,"5min":6.4980000000000002,"15min":6.4980000000000002},"last":1.103},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":5.9379999999999997,"5min":5.9379999999999997,"15min":5.9379999999999997},"last":1.085}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 16:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.80500000000000005,"15min":0.77200000000000002},"min":{"1min":0.52000000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.004,"15min":1.0229999999999999},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5649999999999999,"5min":5.0339999999999998,"15min":5.0339999999999998},"last":0.85199999999999998}]},{"osd":2,"last update":"Wed Feb 28 16:19:01 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":0.98799999999999999,"15min":0.96899999999999997},"min":{"1min":0.78300000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.0469999999999999,"15min":1.026},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed Feb 28 16:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.103}]},{"osd":4,"last update":"Wed Feb 28 16:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:19:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76500000000000001,"15min":0.73299999999999998},"min":{"1min":0.47799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.046,"5min":1.361,"15min":1.361},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76100000000000001,"15min":0.71799999999999997},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.999,"5min":1.304,"15min":1.304},"last":0.59599999999999997}]},{"osd":2,"last update":"Wed Feb 28 16:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3140000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.57899999999999996}]},{"osd":3,"last update":"Wed Feb 28 16:19:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1910000000000001,"15min":1.1919999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.222,"15min":1.212},"min":{"1min":0.96299999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.024}]},{"osd":4,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T16:19:35.278 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T16:19:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:35 smithi153 ceph-mon[35341]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:19:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:35 smithi153 ceph-mon[35341]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:35.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:35 smithi023 ceph-mon[29137]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:19:35.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:35 smithi023 ceph-mon[29137]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:35.730 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:37.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 -- 172.21.15.23:0/1916614646 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a34069140 msgr2=0x7f5a34104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:37.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 --2- 172.21.15.23:0/1916614646 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a34069140 0x7f5a34104eb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009910 tx=0x7f5a20009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:37.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 -- 172.21.15.23:0/1916614646 shutdown_connections 2024-02-28T16:19:37.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 --2- 172.21.15.23:0/1916614646 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a34069140 0x7f5a34104eb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:37.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 --2- 172.21.15.23:0/1916614646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a340687a0 0x7f5a34068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:37.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 -- 172.21.15.23:0/1916614646 >> 172.21.15.23:0/1916614646 conn(0x7f5a34075130 msgr2=0x7f5a34075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:37.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 -- 172.21.15.23:0/1916614646 shutdown_connections 2024-02-28T16:19:37.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.637+0000 7f5a39c00700 1 -- 172.21.15.23:0/1916614646 wait complete. 2024-02-28T16:19:37.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.638+0000 7f5a39c00700 1 Processor -- start 2024-02-28T16:19:37.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.638+0000 7f5a39c00700 1 -- start start 2024-02-28T16:19:37.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.638+0000 7f5a39c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a340687a0 0x7f5a34198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a39c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a34069140 0x7f5a34198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a39c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34198d20 con 0x7f5a340687a0 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a39c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3419cab0 con 0x7f5a34069140 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a32a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a340687a0 0x7f5a34198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a32a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a340687a0 0x7f5a34198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39030/0 (socket says 172.21.15.23:39030) 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a32a00700 1 -- 172.21.15.23:0/3823529613 learned_addr learned my addr 172.21.15.23:0/3823529613 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a32000700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a34069140 0x7f5a34198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a32a00700 1 -- 172.21.15.23:0/3823529613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a34069140 msgr2=0x7f5a34198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a32a00700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a34069140 0x7f5a34198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.639+0000 7f5a32a00700 1 -- 172.21.15.23:0/3823529613 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a200095f0 con 0x7f5a340687a0 2024-02-28T16:19:37.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.640+0000 7f5a32a00700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a340687a0 0x7f5a34198100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400b480 tx=0x7f5a2400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:37.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.640+0000 7f5a2b400700 1 -- 172.21.15.23:0/3823529613 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a240118c0 con 0x7f5a340687a0 2024-02-28T16:19:37.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.640+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3419cd90 con 0x7f5a340687a0 2024-02-28T16:19:37.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.640+0000 7f5a2b400700 1 -- 172.21.15.23:0/3823529613 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a24010380 con 0x7f5a340687a0 2024-02-28T16:19:37.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.640+0000 7f5a2b400700 1 -- 172.21.15.23:0/3823529613 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2400f4f0 con 0x7f5a340687a0 2024-02-28T16:19:37.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.640+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3419d2e0 con 0x7f5a340687a0 2024-02-28T16:19:37.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.641+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3404f2a0 con 0x7f5a340687a0 2024-02-28T16:19:37.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.642+0000 7f5a2b400700 1 -- 172.21.15.23:0/3823529613 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5a24011a20 con 0x7f5a340687a0 2024-02-28T16:19:37.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.643+0000 7f5a2b400700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f5a1806c680 0x7f5a1806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:37.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.643+0000 7f5a2b400700 1 -- 172.21.15.23:0/3823529613 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5a2408aef0 con 0x7f5a340687a0 2024-02-28T16:19:37.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.644+0000 7f5a32000700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f5a1806c680 0x7f5a1806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:37.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.644+0000 7f5a32000700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f5a1806c680 0x7f5a1806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a20006010 tx=0x7f5a2000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:37.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.648+0000 7f5a2b400700 1 -- 172.21.15.23:0/3823529613 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5a240558f0 con 0x7f5a340687a0 2024-02-28T16:19:37.853 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.863+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a3419d720 con 0x7f5a1806c680 2024-02-28T16:19:37.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.866+0000 7f5a2b400700 1 -- 172.21.15.23:0/3823529613 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+29236 (secure 0 0 0) 0x7f5a3419d720 con 0x7f5a1806c680 2024-02-28T16:19:37.857 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:19:37.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f5a1806c680 msgr2=0x7f5a1806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:37.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f5a1806c680 0x7f5a1806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a20006010 tx=0x7f5a2000b540 comp rx=0 tx=0).stop 2024-02-28T16:19:37.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a340687a0 msgr2=0x7f5a34198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:37.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a340687a0 0x7f5a34198100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400b480 tx=0x7f5a2400b840 comp rx=0 tx=0).stop 2024-02-28T16:19:37.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 shutdown_connections 2024-02-28T16:19:37.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f5a1806c680 0x7f5a1806eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:37.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5a340687a0 0x7f5a34198100 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:37.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 --2- 172.21.15.23:0/3823529613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a34069140 0x7f5a34198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:37.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 >> 172.21.15.23:0/3823529613 conn(0x7f5a34075130 msgr2=0x7f5a34103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:37.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 shutdown_connections 2024-02-28T16:19:37.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:37.870+0000 7f5a39c00700 1 -- 172.21.15.23:0/3823529613 wait complete. 2024-02-28T16:19:37.862 INFO:teuthology.orchestra.run.smithi023.stderr:dumped all 2024-02-28T16:19:38.565 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:38 smithi023 ceph-mon[29137]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:38.631 INFO:teuthology.orchestra.run.smithi023.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-02-28T16:19:37.221211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165636,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305276,"statfs":{"total":575970213888,"available":575800602624,"internally_reserved":0,"allocated":4018176,"data_stored":2627442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003798"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-28T16:18:35.197189+0000","last_change":"2024-02-28T16:18:01.295390+0000","last_active":"2024-02-28T16:18:35.197189+0000","last_peered":"2024-02-28T16:18:35.197189+0000","last_clean":"2024-02-28T16:18:35.197189+0000","last_became_active":"2024-02-28T16:18:01.295026+0000","last_became_peered":"2024-02-28T16:18:01.295026+0000","last_unstale":"2024-02-28T16:18:35.197189+0000","last_undegraded":"2024-02-28T16:18:35.197189+0000","last_fullsized":"2024-02-28T16:18:35.197189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T16:16:55.901501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T16:16:55.901501+0000","last_clean_scrub_stamp":"2024-02-28T16:16:55.901501+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-01T02:05:22.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:19:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.89300000000000002}]},{"osd":1,"last update":"Wed Feb 28 16:19:35 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.016},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.84199999999999997}]},{"osd":2,"last update":"Wed Feb 28 16:19:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.218}]},{"osd":3,"last update":"Wed Feb 28 16:19:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.087}]},{"osd":4,"last update":"Wed Feb 28 16:19:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.7749999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.4690000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855381,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.876},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.0680000000000001}]},{"osd":1,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":1.1020000000000001}]},{"osd":2,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":4.96,"5min":4.96,"15min":4.96},"last":0.95799999999999996}]},{"osd":3,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":3,"up_from":27,"seq":115964117020,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.97999999999999998,"15min":0.97899999999999998},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3720000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0549999999999999,"15min":1.0489999999999999},"min":{"1min":0.71599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.96399999999999997}]},{"osd":1,"last update":"Wed Feb 28 16:19:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.044,"15min":1.038},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0740000000000001,"15min":1.0800000000000001},"min":{"1min":0.78400000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.335,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.1970000000000001}]},{"osd":2,"last update":"Wed Feb 28 16:19:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.099,"15min":1.1000000000000001},"min":{"1min":0.82199999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.3380000000000001,"5min":1.978,"15min":1.978},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.226,"15min":1.2290000000000001},"min":{"1min":0.76600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.415,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.153}]},{"osd":4,"last update":"Wed Feb 28 16:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.26},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.3009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]},{"osd":2,"up_from":19,"seq":81604378659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83399999999999996,"15min":0.82899999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90400000000000003,"15min":0.89800000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.95599999999999996}]},{"osd":1,"last update":"Wed Feb 28 16:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.995,"15min":1.0049999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.121,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.96899999999999997,"15min":0.97199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.266}]},{"osd":3,"last update":"Wed Feb 28 16:19:33 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1859999999999999,"15min":1.1830000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.147,"15min":1.131},"min":{"1min":0.84199999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.3280000000000001}]},{"osd":4,"last update":"Wed Feb 28 16:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":6.4980000000000002,"5min":6.4980000000000002,"15min":6.4980000000000002},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":5.9379999999999997,"5min":5.9379999999999997,"15min":5.9379999999999997},"last":1.425}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]}]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 16:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.80500000000000005,"15min":0.77200000000000002},"min":{"1min":0.52000000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.004,"15min":1.0229999999999999},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5649999999999999,"5min":5.0339999999999998,"15min":5.0339999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed Feb 28 16:19:01 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":0.98799999999999999,"15min":0.96899999999999997},"min":{"1min":0.78300000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.0469999999999999,"15min":1.026},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Wed Feb 28 16:19:30 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.198,"15min":1.198},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.25,"15min":1.232},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.073}]},{"osd":4,"last update":"Wed Feb 28 16:19:02 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.113},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:19:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76500000000000001,"15min":0.73299999999999998},"min":{"1min":0.47799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.046,"5min":1.361,"15min":1.361},"last":1.139},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76100000000000001,"15min":0.71799999999999997},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.999,"5min":1.304,"15min":1.304},"last":1.0149999999999999}]},{"osd":2,"last update":"Wed Feb 28 16:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3140000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.0780000000000001}]},{"osd":3,"last update":"Wed Feb 28 16:19:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1910000000000001,"15min":1.1919999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.222,"15min":1.212},"min":{"1min":0.96299999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.2969999999999999}]},{"osd":4,"last update":"Wed Feb 28 16:19:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.246},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.2190000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T16:19:38.632 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-28T16:19:38.632 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-28T16:19:38.632 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-28T16:19:38.632 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph health --format=json 2024-02-28T16:19:38.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:38 smithi153 ceph-mon[35341]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:39.076 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:39.520 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:39 smithi023 ceph-mon[29137]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:19:39.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:39 smithi153 ceph-mon[35341]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:19:40.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:40 smithi023 ceph-mon[29137]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:40.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:40.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:40 smithi153 ceph-mon[35341]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:40.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:41.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 -- 172.21.15.23:0/1346330360 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c069140 msgr2=0x7fe05c104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:41.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 --2- 172.21.15.23:0/1346330360 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c069140 0x7fe05c104eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe048009910 tx=0x7fe048009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:41.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 -- 172.21.15.23:0/1346330360 shutdown_connections 2024-02-28T16:19:41.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 --2- 172.21.15.23:0/1346330360 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c069140 0x7fe05c104eb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:41.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 --2- 172.21.15.23:0/1346330360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c0687a0 0x7fe05c068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:41.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 -- 172.21.15.23:0/1346330360 >> 172.21.15.23:0/1346330360 conn(0x7fe05c075130 msgr2=0x7fe05c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:41.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 -- 172.21.15.23:0/1346330360 shutdown_connections 2024-02-28T16:19:41.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.288+0000 7fe061e00700 1 -- 172.21.15.23:0/1346330360 wait complete. 2024-02-28T16:19:41.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.289+0000 7fe061e00700 1 Processor -- start 2024-02-28T16:19:41.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.289+0000 7fe061e00700 1 -- start start 2024-02-28T16:19:41.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe061e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c0687a0 0x7fe05c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:41.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe061e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c069140 0x7fe05c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:41.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe061e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c196a80 con 0x7fe05c0687a0 2024-02-28T16:19:41.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe061e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c19a810 con 0x7fe05c069140 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe05aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c0687a0 0x7fe05c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe05aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c0687a0 0x7fe05c195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45428/0 (socket says 172.21.15.23:45428) 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe05aa00700 1 -- 172.21.15.23:0/3162236107 learned_addr learned my addr 172.21.15.23:0/3162236107 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe05a000700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c069140 0x7fe05c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe05aa00700 1 -- 172.21.15.23:0/3162236107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c069140 msgr2=0x7fe05c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe05aa00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c069140 0x7fe05c1963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.290+0000 7fe05aa00700 1 -- 172.21.15.23:0/3162236107 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480095f0 con 0x7fe05c0687a0 2024-02-28T16:19:41.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.291+0000 7fe05aa00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c0687a0 0x7fe05c195e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00e920 tx=0x7fe04c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:41.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.291+0000 7fe060a00700 1 -- 172.21.15.23:0/3162236107 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04c00c9d0 con 0x7fe05c0687a0 2024-02-28T16:19:41.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.291+0000 7fe060a00700 1 -- 172.21.15.23:0/3162236107 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe04c010430 con 0x7fe05c0687a0 2024-02-28T16:19:41.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.291+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c19aaf0 con 0x7fe05c0687a0 2024-02-28T16:19:41.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.291+0000 7fe060a00700 1 -- 172.21.15.23:0/3162236107 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04c018650 con 0x7fe05c0687a0 2024-02-28T16:19:41.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.291+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c19b010 con 0x7fe05c0687a0 2024-02-28T16:19:41.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.293+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c108750 con 0x7fe05c0687a0 2024-02-28T16:19:41.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.294+0000 7fe060a00700 1 -- 172.21.15.23:0/3162236107 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe04c0105a0 con 0x7fe05c0687a0 2024-02-28T16:19:41.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.294+0000 7fe060a00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe04006c680 0x7fe04006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:41.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.295+0000 7fe060a00700 1 -- 172.21.15.23:0/3162236107 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe04c014070 con 0x7fe05c0687a0 2024-02-28T16:19:41.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.295+0000 7fe05a000700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe04006c680 0x7fe04006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:41.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.295+0000 7fe05a000700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe04006c680 0x7fe04006eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe048009fd0 tx=0x7fe048005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:41.289 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.299+0000 7fe060a00700 1 -- 172.21.15.23:0/3162236107 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe04c051720 con 0x7fe05c0687a0 2024-02-28T16:19:41.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:41 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:41.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.583+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe05c19b230 con 0x7fe05c0687a0 2024-02-28T16:19:41.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.584+0000 7fe060a00700 1 -- 172.21.15.23:0/3162236107 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe04c056330 con 0x7fe05c0687a0 2024-02-28T16:19:41.574 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:19:41.575 INFO:teuthology.orchestra.run.smithi023.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.586+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe04006c680 msgr2=0x7fe04006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.586+0000 7fe061e00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe04006c680 0x7fe04006eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe048009fd0 tx=0x7fe048005a90 comp rx=0 tx=0).stop 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.586+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c0687a0 msgr2=0x7fe05c195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.586+0000 7fe061e00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c0687a0 0x7fe05c195e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00e920 tx=0x7fe04c00ec30 comp rx=0 tx=0).stop 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.587+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 shutdown_connections 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.587+0000 7fe061e00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe04006c680 0x7fe04006eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.587+0000 7fe061e00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe05c0687a0 0x7fe05c195e60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.587+0000 7fe061e00700 1 --2- 172.21.15.23:0/3162236107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c069140 0x7fe05c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:41.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.587+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 >> 172.21.15.23:0/3162236107 conn(0x7fe05c075130 msgr2=0x7fe05c104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:41.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.587+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 shutdown_connections 2024-02-28T16:19:41.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:41.587+0000 7fe061e00700 1 -- 172.21.15.23:0/3162236107 wait complete. 2024-02-28T16:19:41.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:41 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:42.482 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-28T16:19:42.482 INFO:tasks.cephadm:Setup complete, yielding 2024-02-28T16:19:42.482 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:19:42.492 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-02-28T16:19:42.492 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:19:42.500 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:19:42.501 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-28T16:19:42.594 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:42 smithi023 ceph-mon[29137]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:42.594 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:42 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3162236107' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T16:19:42.594 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:42 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:42.594 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:42 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:42.594 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:42 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:19:42.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:42 smithi153 ceph-mon[35341]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:42.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:42 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3162236107' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T16:19:42.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:42 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:42.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:42 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:42.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:42 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:19:42.948 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:44.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:44 smithi153 ceph-mon[35341]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:44.664 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:44 smithi023 ceph-mon[29137]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 -- 172.21.15.23:0/872476072 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded01003d0 msgr2=0x7fded0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 --2- 172.21.15.23:0/872476072 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded01003d0 0x7fded0100840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009910 tx=0x7fdebc009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 -- 172.21.15.23:0/872476072 shutdown_connections 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 --2- 172.21.15.23:0/872476072 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded01003d0 0x7fded0100840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 --2- 172.21.15.23:0/872476072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fded00ff130 0x7fded00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 -- 172.21.15.23:0/872476072 >> 172.21.15.23:0/872476072 conn(0x7fded00fa780 msgr2=0x7fded00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 -- 172.21.15.23:0/872476072 shutdown_connections 2024-02-28T16:19:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.213+0000 7fded5000700 1 -- 172.21.15.23:0/872476072 wait complete. 2024-02-28T16:19:45.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.215+0000 7fded5000700 1 Processor -- start 2024-02-28T16:19:45.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.215+0000 7fded5000700 1 -- start start 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.215+0000 7fded5000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded00ff130 0x7fded019c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.215+0000 7fded5000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fded01003d0 0x7fded019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.215+0000 7fded5000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded019cbe0 con 0x7fded00ff130 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.215+0000 7fded5000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded019cd20 con 0x7fded01003d0 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.216+0000 7fdecde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded00ff130 0x7fded019c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.216+0000 7fdecde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded00ff130 0x7fded019c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45444/0 (socket says 172.21.15.23:45444) 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.216+0000 7fdecde00700 1 -- 172.21.15.23:0/3630469528 learned_addr learned my addr 172.21.15.23:0/3630469528 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.216+0000 7fdecd400700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fded01003d0 0x7fded019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:45.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.216+0000 7fdecde00700 1 -- 172.21.15.23:0/3630469528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fded01003d0 msgr2=0x7fded019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:45.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.216+0000 7fdecde00700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fded01003d0 0x7fded019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:45.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.216+0000 7fdecde00700 1 -- 172.21.15.23:0/3630469528 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc0095f0 con 0x7fded00ff130 2024-02-28T16:19:45.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.217+0000 7fdecde00700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded00ff130 0x7fded019c080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdec000c8a0 tx=0x7fdec000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:45.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.217+0000 7fdec6a00700 1 -- 172.21.15.23:0/3630469528 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec000cea0 con 0x7fded00ff130 2024-02-28T16:19:45.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.217+0000 7fdec6a00700 1 -- 172.21.15.23:0/3630469528 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdec0004830 con 0x7fded00ff130 2024-02-28T16:19:45.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.217+0000 7fdec6a00700 1 -- 172.21.15.23:0/3630469528 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec00055b0 con 0x7fded00ff130 2024-02-28T16:19:45.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.217+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded01a17d0 con 0x7fded00ff130 2024-02-28T16:19:45.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.217+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded01a1cd0 con 0x7fded00ff130 2024-02-28T16:19:45.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.219+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded0107c10 con 0x7fded00ff130 2024-02-28T16:19:45.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.219+0000 7fdec6a00700 1 -- 172.21.15.23:0/3630469528 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdec0007ad0 con 0x7fded00ff130 2024-02-28T16:19:45.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.220+0000 7fdec6a00700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdeb406c680 0x7fdeb406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:45.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.220+0000 7fdec6a00700 1 -- 172.21.15.23:0/3630469528 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fdec008b340 con 0x7fded00ff130 2024-02-28T16:19:45.211 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.221+0000 7fdecd400700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdeb406c680 0x7fdeb406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:45.211 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.221+0000 7fdecd400700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdeb406c680 0x7fdeb406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006010 tx=0x7fdebc00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:45.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.225+0000 7fdec6a00700 1 -- 172.21.15.23:0/3630469528 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdec0059750 con 0x7fded00ff130 2024-02-28T16:19:45.444 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.453+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fded0107dd0 con 0x7fded00ff130 2024-02-28T16:19:45.453 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.463+0000 7fdec6a00700 1 -- 172.21.15.23:0/3630469528 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fdec00592e0 con 0x7fded00ff130 2024-02-28T16:19:45.457 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:45 smithi023 ceph-mon[29137]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:45.457 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.466+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdeb406c680 msgr2=0x7fdeb406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:45.457 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.466+0000 7fded5000700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdeb406c680 0x7fdeb406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006010 tx=0x7fdebc00b540 comp rx=0 tx=0).stop 2024-02-28T16:19:45.457 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.466+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded00ff130 msgr2=0x7fded019c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.466+0000 7fded5000700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded00ff130 0x7fded019c080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdec000c8a0 tx=0x7fdec000cc60 comp rx=0 tx=0).stop 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.466+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 shutdown_connections 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.467+0000 7fded5000700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdeb406c680 0x7fdeb406eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.467+0000 7fded5000700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fded00ff130 0x7fded019c080 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.467+0000 7fded5000700 1 --2- 172.21.15.23:0/3630469528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fded01003d0 0x7fded019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.467+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 >> 172.21.15.23:0/3630469528 conn(0x7fded00fa780 msgr2=0x7fded0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.467+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 shutdown_connections 2024-02-28T16:19:45.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:45.467+0000 7fded5000700 1 -- 172.21.15.23:0/3630469528 wait complete. 2024-02-28T16:19:45.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:45 smithi153 ceph-mon[35341]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:46.266 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:19:46.276 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-28T16:19:46.276 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:19:46.284 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:19:46.284 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph orch status' 2024-02-28T16:19:46.733 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:46.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:46 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3630469528' entity='client.admin' 2024-02-28T16:19:46.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:46.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:46.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:46.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:19:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:46 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3630469528' entity='client.admin' 2024-02-28T16:19:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:19:47.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:47 smithi153 ceph-mon[35341]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:47.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:47 smithi023 ceph-mon[29137]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:48.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 -- 172.21.15.23:0/1815109205 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 msgr2=0x7f3468103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:48.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 --2- 172.21.15.23:0/1815109205 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468103b40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3454009910 tx=0x7f3454009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:48.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 -- 172.21.15.23:0/1815109205 shutdown_connections 2024-02-28T16:19:48.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 --2- 172.21.15.23:0/1815109205 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468103b40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:48.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 --2- 172.21.15.23:0/1815109205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3468102430 0x7f3468102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:48.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 -- 172.21.15.23:0/1815109205 >> 172.21.15.23:0/1815109205 conn(0x7f34680fda80 msgr2=0x7f34680ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:48.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 -- 172.21.15.23:0/1815109205 shutdown_connections 2024-02-28T16:19:48.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.870+0000 7f346e200700 1 -- 172.21.15.23:0/1815109205 wait complete. 2024-02-28T16:19:48.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.871+0000 7f346e200700 1 Processor -- start 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.871+0000 7f346e200700 1 -- start start 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.871+0000 7f346e200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3468102430 0x7f3468197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.871+0000 7f346e200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.871+0000 7f346e200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3468198880 con 0x7f34681036d0 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.871+0000 7f346e200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346819d290 con 0x7f3468102430 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.872+0000 7f3466a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.872+0000 7f3466a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45462/0 (socket says 172.21.15.23:45462) 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.872+0000 7f3466a00700 1 -- 172.21.15.23:0/2425719548 learned_addr learned my addr 172.21.15.23:0/2425719548 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.872+0000 7f3467400700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3468102430 0x7f3468197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.872+0000 7f3466a00700 1 -- 172.21.15.23:0/2425719548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3468102430 msgr2=0x7f3468197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.872+0000 7f3466a00700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3468102430 0x7f3468197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:48.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.872+0000 7f3466a00700 1 -- 172.21.15.23:0/2425719548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540095f0 con 0x7f34681036d0 2024-02-28T16:19:48.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.873+0000 7f3466a00700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468198260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f345400b5c0 tx=0x7f345400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:48.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.873+0000 7f345fe00700 1 -- 172.21.15.23:0/2425719548 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345401d070 con 0x7f34681036d0 2024-02-28T16:19:48.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.873+0000 7f345fe00700 1 -- 172.21.15.23:0/2425719548 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3454022470 con 0x7f34681036d0 2024-02-28T16:19:48.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.873+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346819d430 con 0x7f34681036d0 2024-02-28T16:19:48.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.873+0000 7f345fe00700 1 -- 172.21.15.23:0/2425719548 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345400f690 con 0x7f34681036d0 2024-02-28T16:19:48.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.873+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346819d8f0 con 0x7f34681036d0 2024-02-28T16:19:48.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.874+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346810af90 con 0x7f34681036d0 2024-02-28T16:19:48.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.875+0000 7f345fe00700 1 -- 172.21.15.23:0/2425719548 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f34540225e0 con 0x7f34681036d0 2024-02-28T16:19:48.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.876+0000 7f345fe00700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f344c06c680 0x7f344c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:48.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.876+0000 7f345fe00700 1 -- 172.21.15.23:0/2425719548 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f345408cce0 con 0x7f34681036d0 2024-02-28T16:19:48.867 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.877+0000 7f3467400700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f344c06c680 0x7f344c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:48.867 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.877+0000 7f3467400700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f344c06c680 0x7f344c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3468199200 tx=0x7f3458009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:48.871 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:48.881+0000 7f345fe00700 1 -- 172.21.15.23:0/2425719548 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f34540576e0 con 0x7f34681036d0 2024-02-28T16:19:49.107 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.117+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3468108020 con 0x7f344c06c680 2024-02-28T16:19:49.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.119+0000 7f345fe00700 1 -- 172.21.15.23:0/2425719548 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3468108020 con 0x7f344c06c680 2024-02-28T16:19:49.109 INFO:teuthology.orchestra.run.smithi023.stdout:Backend: cephadm 2024-02-28T16:19:49.109 INFO:teuthology.orchestra.run.smithi023.stdout:Available: Yes 2024-02-28T16:19:49.109 INFO:teuthology.orchestra.run.smithi023.stdout:Paused: No 2024-02-28T16:19:49.111 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f344c06c680 msgr2=0x7f344c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:49.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f344c06c680 0x7f344c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3468199200 tx=0x7f3458009190 comp rx=0 tx=0).stop 2024-02-28T16:19:49.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 msgr2=0x7f3468198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:49.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468198260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f345400b5c0 tx=0x7f345400bd70 comp rx=0 tx=0).stop 2024-02-28T16:19:49.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 shutdown_connections 2024-02-28T16:19:49.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f344c06c680 0x7f344c06eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:49.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3468102430 0x7f3468197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:49.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 --2- 172.21.15.23:0/2425719548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f34681036d0 0x7f3468198260 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:49.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 >> 172.21.15.23:0/2425719548 conn(0x7f34680fda80 msgr2=0x7f3468106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:49.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 shutdown_connections 2024-02-28T16:19:49.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:49.122+0000 7f346e200700 1 -- 172.21.15.23:0/2425719548 wait complete. 2024-02-28T16:19:49.982 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-28T16:19:50.436 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:50.599 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:50 smithi023 ceph-mon[29137]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:50.599 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:50 smithi023 ceph-mon[29137]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:50.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:50 smithi153 ceph-mon[35341]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:50.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:50 smithi153 ceph-mon[35341]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:52.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:52 smithi023 ceph-mon[29137]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:52 smithi153 ceph-mon[35341]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:52.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 -- 172.21.15.23:0/1958689656 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc102430 msgr2=0x7f6abc102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:52.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 --2- 172.21.15.23:0/1958689656 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc102430 0x7f6abc102840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009910 tx=0x7f6aac009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 -- 172.21.15.23:0/1958689656 shutdown_connections 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 --2- 172.21.15.23:0/1958689656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc1036d0 0x7f6abc103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 --2- 172.21.15.23:0/1958689656 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc102430 0x7f6abc102840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 -- 172.21.15.23:0/1958689656 >> 172.21.15.23:0/1958689656 conn(0x7f6abc0fda80 msgr2=0x7f6abc0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 -- 172.21.15.23:0/1958689656 shutdown_connections 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.660+0000 7f6ac1400700 1 -- 172.21.15.23:0/1958689656 wait complete. 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.661+0000 7f6ac1400700 1 Processor -- start 2024-02-28T16:19:52.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6ac1400700 1 -- start start 2024-02-28T16:19:52.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6ac1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc1036d0 0x7f6abc197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:52.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6ac1400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc198450 0x7f6abc19d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6ac1400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc1988c0 con 0x7f6abc1036d0 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6ac1400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc198a30 con 0x7f6abc198450 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6aba800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc1036d0 0x7f6abc197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6aba800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc1036d0 0x7f6abc197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52448/0 (socket says 172.21.15.23:52448) 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6aba800700 1 -- 172.21.15.23:0/245827723 learned_addr learned my addr 172.21.15.23:0/245827723 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.662+0000 7f6ab1e00700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc198450 0x7f6abc19d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6aba800700 1 -- 172.21.15.23:0/245827723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc198450 msgr2=0x7f6abc19d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6aba800700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc198450 0x7f6abc19d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:52.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6aba800700 1 -- 172.21.15.23:0/245827723 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac0095f0 con 0x7f6abc1036d0 2024-02-28T16:19:52.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6aba800700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc1036d0 0x7f6abc197f10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:52.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6ab3e00700 1 -- 172.21.15.23:0/245827723 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac01d070 con 0x7f6abc1036d0 2024-02-28T16:19:52.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6ab3e00700 1 -- 172.21.15.23:0/245827723 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6aac022470 con 0x7f6abc1036d0 2024-02-28T16:19:52.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6ab3e00700 1 -- 172.21.15.23:0/245827723 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac00f690 con 0x7f6abc1036d0 2024-02-28T16:19:52.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.663+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc19da00 con 0x7f6abc1036d0 2024-02-28T16:19:52.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.664+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc19de20 con 0x7f6abc1036d0 2024-02-28T16:19:52.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.665+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc10af10 con 0x7f6abc1036d0 2024-02-28T16:19:52.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.666+0000 7f6ab3e00700 1 -- 172.21.15.23:0/245827723 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6aac004af0 con 0x7f6abc1036d0 2024-02-28T16:19:52.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.666+0000 7f6ab3e00700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f6a9c06c680 0x7f6a9c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:52.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.667+0000 7f6ab3e00700 1 -- 172.21.15.23:0/245827723 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6aac08ca00 con 0x7f6abc1036d0 2024-02-28T16:19:52.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.667+0000 7f6ab1e00700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f6a9c06c680 0x7f6a9c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:52.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.667+0000 7f6ab1e00700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f6a9c06c680 0x7f6a9c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4005ea0 tx=0x7f6aa4005e30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:52.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.672+0000 7f6ab3e00700 1 -- 172.21.15.23:0/245827723 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6aac05af40 con 0x7f6abc1036d0 2024-02-28T16:19:52.893 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.903+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6abc19e520 con 0x7f6a9c06c680 2024-02-28T16:19:52.903 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.913+0000 7f6ab3e00700 1 -- 172.21.15.23:0/245827723 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2860 (secure 0 0 0) 0x7f6abc19e520 con 0x7f6a9c06c680 2024-02-28T16:19:52.903 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:19:52.903 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (4m) 2m ago 6m 13.7M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:19:52.903 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (7m) 2m ago 7m 7092k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:19:52.903 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (5m) 77s ago 5m 6987k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (7m) 2m ago 7m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (5m) 77s ago 5m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (4m) 2m ago 6m 73.8M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:9283,8765,8443 running (8m) 2m ago 8m 480M - 18.2.0 dc2bc1663786 b278ec72c436 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (5m) 77s ago 5m 436M - 18.2.0 dc2bc1663786 cbabf8088ddf 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (8m) 2m ago 8m 44.7M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (5m) 77s ago 5m 32.8M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (6m) 2m ago 6m 7646k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (5m) 77s ago 5m 7583k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (4m) 2m ago 4m 39.3M 3947M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (3m) 2m ago 3m 39.2M 3947M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (3m) 2m ago 3m 39.6M 3947M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (2m) 77s ago 2m 41.0M 4971M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (118s) 77s ago 118s 37.9M 4971M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:19:52.904 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (84s) 77s ago 83s 11.0M 4971M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:19:52.905 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (4m) 2m ago 6m 38.2M - 2.43.0 a07b618ecd1d 8297ca033a9b 2024-02-28T16:19:52.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.916+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f6a9c06c680 msgr2=0x7f6a9c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:52.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.916+0000 7f6ac1400700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f6a9c06c680 0x7f6a9c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4005ea0 tx=0x7f6aa4005e30 comp rx=0 tx=0).stop 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.916+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc1036d0 msgr2=0x7f6abc197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.916+0000 7f6ac1400700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc1036d0 0x7f6abc197f10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac00be20 comp rx=0 tx=0).stop 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.917+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 shutdown_connections 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.917+0000 7f6ac1400700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f6a9c06c680 0x7f6a9c06eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.917+0000 7f6ac1400700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6abc1036d0 0x7f6abc197f10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.917+0000 7f6ac1400700 1 --2- 172.21.15.23:0/245827723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc198450 0x7f6abc19d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.917+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 >> 172.21.15.23:0/245827723 conn(0x7f6abc0fda80 msgr2=0x7f6abc106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.917+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 shutdown_connections 2024-02-28T16:19:52.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:52.917+0000 7f6ac1400700 1 -- 172.21.15.23:0/245827723 wait complete. 2024-02-28T16:19:53.770 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-28T16:19:54.186 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:54.538 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:54 smithi023 ceph-mon[29137]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:54.538 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:54 smithi023 ceph-mon[29137]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:54.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:54 smithi153 ceph-mon[35341]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:54.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:54 smithi153 ceph-mon[35341]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:55.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:55 smithi023 ceph-mon[29137]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:55.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:55.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:55 smithi153 ceph-mon[35341]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:55.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 -- 172.21.15.23:0/627746991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fe500 msgr2=0x7fe62c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 --2- 172.21.15.23:0/627746991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fe500 0x7fe62c0fe910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe620009910 tx=0x7fe620009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 -- 172.21.15.23:0/627746991 shutdown_connections 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 --2- 172.21.15.23:0/627746991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe62c0fee50 0x7fe62c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 --2- 172.21.15.23:0/627746991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fe500 0x7fe62c0fe910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 -- 172.21.15.23:0/627746991 >> 172.21.15.23:0/627746991 conn(0x7fe62c0f9f10 msgr2=0x7fe62c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 -- 172.21.15.23:0/627746991 shutdown_connections 2024-02-28T16:19:56.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.319+0000 7fe633c00700 1 -- 172.21.15.23:0/627746991 wait complete. 2024-02-28T16:19:56.311 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.320+0000 7fe633c00700 1 Processor -- start 2024-02-28T16:19:56.311 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe633c00700 1 -- start start 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe633c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe62c0fe500 0x7fe62c195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe633c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fee50 0x7fe62c196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe633c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c196690 con 0x7fe62c0fee50 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe633c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c1967d0 con 0x7fe62c0fe500 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe62be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fee50 0x7fe62c196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe62be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fee50 0x7fe62c196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52464/0 (socket says 172.21.15.23:52464) 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe62be00700 1 -- 172.21.15.23:0/3893480444 learned_addr learned my addr 172.21.15.23:0/3893480444 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:56.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.321+0000 7fe631200700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe62c0fe500 0x7fe62c195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.322+0000 7fe62be00700 1 -- 172.21.15.23:0/3893480444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe62c0fe500 msgr2=0x7fe62c195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.322+0000 7fe62be00700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe62c0fe500 0x7fe62c195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.322+0000 7fe62be00700 1 -- 172.21.15.23:0/3893480444 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200095f0 con 0x7fe62c0fee50 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.322+0000 7fe62be00700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fee50 0x7fe62c196070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe61800d8d0 tx=0x7fe61800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.323+0000 7fe629600700 1 -- 172.21.15.23:0/3893480444 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe61800f860 con 0x7fe62c0fee50 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.323+0000 7fe629600700 1 -- 172.21.15.23:0/3893480444 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe61800fe70 con 0x7fe62c0fee50 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.323+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62c19b280 con 0x7fe62c0fee50 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.323+0000 7fe629600700 1 -- 172.21.15.23:0/3893480444 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe61800e5e0 con 0x7fe62c0fee50 2024-02-28T16:19:56.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.323+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c19b7d0 con 0x7fe62c0fee50 2024-02-28T16:19:56.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.324+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c108d50 con 0x7fe62c0fee50 2024-02-28T16:19:56.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.326+0000 7fe629600700 1 -- 172.21.15.23:0/3893480444 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe618010460 con 0x7fe62c0fee50 2024-02-28T16:19:56.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.327+0000 7fe629600700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe61406c680 0x7fe61406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:56.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.327+0000 7fe629600700 1 -- 172.21.15.23:0/3893480444 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe61808b1e0 con 0x7fe62c0fee50 2024-02-28T16:19:56.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.328+0000 7fe631200700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe61406c680 0x7fe61406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:56.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.328+0000 7fe631200700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe61406c680 0x7fe61406eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe620006010 tx=0x7fe62000b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:56.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.332+0000 7fe629600700 1 -- 172.21.15.23:0/3893480444 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe6180595f0 con 0x7fe62c0fee50 2024-02-28T16:19:56.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.566+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe62c105ed0 con 0x7fe61406c680 2024-02-28T16:19:56.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.578+0000 7fe629600700 1 -- 172.21.15.23:0/3893480444 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7fe62c105ed0 con 0x7fe61406c680 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter 2/2 2m ago 7m * 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:crash 2/2 2m ago 7m * 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:mgr 2/2 2m ago 7m count:2 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:mon 2/2 2m ago 6m smithi023:172.21.15.23=smithi023;smithi153:172.21.15.153=smithi153;count:2 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:osd 6 2m ago - 2024-02-28T16:19:56.569 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-02-28T16:19:56.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe61406c680 msgr2=0x7fe61406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe61406c680 0x7fe61406eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe620006010 tx=0x7fe62000b560 comp rx=0 tx=0).stop 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fee50 msgr2=0x7fe62c196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fee50 0x7fe62c196070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe61800d8d0 tx=0x7fe61800dbe0 comp rx=0 tx=0).stop 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 shutdown_connections 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe61406c680 0x7fe61406eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe62c0fe500 0x7fe62c195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 --2- 172.21.15.23:0/3893480444 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe62c0fee50 0x7fe62c196070 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 >> 172.21.15.23:0/3893480444 conn(0x7fe62c0f9f10 msgr2=0x7fe62c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 shutdown_connections 2024-02-28T16:19:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:56.581+0000 7fe633c00700 1 -- 172.21.15.23:0/3893480444 wait complete. 2024-02-28T16:19:57.268 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-28T16:19:57.695 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:19:58.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:58 smithi023 ceph-mon[29137]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:58.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:19:58 smithi023 ceph-mon[29137]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:58.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:58 smithi153 ceph-mon[35341]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:58.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:19:58 smithi153 ceph-mon[35341]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.812+0000 7f0a84600700 1 -- 172.21.15.23:0/334607626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 msgr2=0x7f0a7c073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.812+0000 7f0a84600700 1 --2- 172.21.15.23:0/334607626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c073c20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009910 tx=0x7f0a68009c20 comp rx=0 tx=0).stop 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.812+0000 7f0a84600700 1 -- 172.21.15.23:0/334607626 shutdown_connections 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.812+0000 7f0a84600700 1 --2- 172.21.15.23:0/334607626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c073c20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.812+0000 7f0a84600700 1 --2- 172.21.15.23:0/334607626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a7c074d80 0x7f0a7c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.812+0000 7f0a84600700 1 -- 172.21.15.23:0/334607626 >> 172.21.15.23:0/334607626 conn(0x7f0a7c0fb7f0 msgr2=0x7f0a7c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.813+0000 7f0a84600700 1 -- 172.21.15.23:0/334607626 shutdown_connections 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.813+0000 7f0a84600700 1 -- 172.21.15.23:0/334607626 wait complete. 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a84600700 1 Processor -- start 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a84600700 1 -- start start 2024-02-28T16:19:59.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a84600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a84600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a7c074d80 0x7f0a7c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a84600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c19cb40 con 0x7f0a7c0737b0 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a84600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c19cc80 con 0x7f0a7c074d80 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a81c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a81c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c19c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43040/0 (socket says 172.21.15.23:43040) 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.814+0000 7f0a81c00700 1 -- 172.21.15.23:0/2785371890 learned_addr learned my addr 172.21.15.23:0/2785371890 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a81200700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a7c074d80 0x7f0a7c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a81c00700 1 -- 172.21.15.23:0/2785371890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a7c074d80 msgr2=0x7f0a7c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a81c00700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a7c074d80 0x7f0a7c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:59.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a81c00700 1 -- 172.21.15.23:0/2785371890 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680095f0 con 0x7f0a7c0737b0 2024-02-28T16:19:59.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a81c00700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c19c070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000cfd0 tx=0x7f0a7000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:59.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a7a000700 1 -- 172.21.15.23:0/2785371890 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7000ad70 con 0x7f0a7c0737b0 2024-02-28T16:19:59.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a7a000700 1 -- 172.21.15.23:0/2785371890 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a700128d0 con 0x7f0a7c0737b0 2024-02-28T16:19:59.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.815+0000 7f0a7a000700 1 -- 172.21.15.23:0/2785371890 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a70011880 con 0x7f0a7c0737b0 2024-02-28T16:19:59.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.816+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c1a1740 con 0x7f0a7c0737b0 2024-02-28T16:19:59.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.816+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c1a1c60 con 0x7f0a7c0737b0 2024-02-28T16:19:59.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.817+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7c10f380 con 0x7f0a7c0737b0 2024-02-28T16:19:59.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.818+0000 7f0a7a000700 1 -- 172.21.15.23:0/2785371890 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0a70012420 con 0x7f0a7c0737b0 2024-02-28T16:19:59.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.819+0000 7f0a7a000700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0a6406c680 0x7f0a6406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:59.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.819+0000 7f0a7a000700 1 -- 172.21.15.23:0/2785371890 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0a7008b9b0 con 0x7f0a7c0737b0 2024-02-28T16:19:59.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.819+0000 7f0a81200700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0a6406c680 0x7f0a6406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:59.810 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.820+0000 7f0a81200700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0a6406c680 0x7f0a6406eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a68006010 tx=0x7f0a6800b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:59.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:19:59.824+0000 7f0a7a000700 1 -- 172.21.15.23:0/2785371890 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0a70059e40 con 0x7f0a7c0737b0 2024-02-28T16:20:00.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.051+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a7c1031e0 con 0x7f0a6406c680 2024-02-28T16:20:00.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.053+0000 7f0a7a000700 1 -- 172.21.15.23:0/2785371890 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f0a7c1031e0 con 0x7f0a6406c680 2024-02-28T16:20:00.043 INFO:teuthology.orchestra.run.smithi023.stdout:HOST ADDR LABELS STATUS 2024-02-28T16:20:00.043 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023 172.21.15.23 2024-02-28T16:20:00.044 INFO:teuthology.orchestra.run.smithi023.stdout:smithi153 172.21.15.153 2024-02-28T16:20:00.044 INFO:teuthology.orchestra.run.smithi023.stdout:2 hosts in cluster 2024-02-28T16:20:00.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0a6406c680 msgr2=0x7f0a6406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:00.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0a6406c680 0x7f0a6406eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a68006010 tx=0x7f0a6800b540 comp rx=0 tx=0).stop 2024-02-28T16:20:00.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 msgr2=0x7f0a7c19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:00.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c19c070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000cfd0 tx=0x7f0a7000a340 comp rx=0 tx=0).stop 2024-02-28T16:20:00.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 shutdown_connections 2024-02-28T16:20:00.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f0a6406c680 0x7f0a6406eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:00.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0a7c0737b0 0x7f0a7c19c070 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:00.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 --2- 172.21.15.23:0/2785371890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a7c074d80 0x7f0a7c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:00.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 >> 172.21.15.23:0/2785371890 conn(0x7f0a7c0fb7f0 msgr2=0x7f0a7c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:00.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.056+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 shutdown_connections 2024-02-28T16:20:00.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:00.057+0000 7f0a84600700 1 -- 172.21.15.23:0/2785371890 wait complete. 2024-02-28T16:20:00.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:00 smithi023 ceph-mon[29137]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:00.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:00 smithi023 ceph-mon[29137]: overall HEALTH_OK 2024-02-28T16:20:00.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:00 smithi153 ceph-mon[35341]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:00.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:00 smithi153 ceph-mon[35341]: overall HEALTH_OK 2024-02-28T16:20:00.947 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-28T16:20:01.383 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:01.571 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:01 smithi023 ceph-mon[29137]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:01.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:01 smithi153 ceph-mon[35341]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:02.582 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:02 smithi023 ceph-mon[29137]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:02 smithi153 ceph-mon[35341]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 -- 172.21.15.23:0/2100519445 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 msgr2=0x7fd4d8073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 --2- 172.21.15.23:0/2100519445 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8073c20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009940 tx=0x7fd4c4009c50 comp rx=0 tx=0).stop 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 -- 172.21.15.23:0/2100519445 shutdown_connections 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 --2- 172.21.15.23:0/2100519445 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8073c20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 --2- 172.21.15.23:0/2100519445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d8074d80 0x7fd4d80731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 -- 172.21.15.23:0/2100519445 >> 172.21.15.23:0/2100519445 conn(0x7fd4d80fb5e0 msgr2=0x7fd4d80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 -- 172.21.15.23:0/2100519445 shutdown_connections 2024-02-28T16:20:03.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.408+0000 7fd4de800700 1 -- 172.21.15.23:0/2100519445 wait complete. 2024-02-28T16:20:03.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.409+0000 7fd4de800700 1 Processor -- start 2024-02-28T16:20:03.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4de800700 1 -- start start 2024-02-28T16:20:03.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4de800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4de800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d8074d80 0x7fd4d8197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4de800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8198570 con 0x7fd4d80737b0 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4de800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d81986b0 con 0x7fd4d8074d80 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4dd400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4dd400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43052/0 (socket says 172.21.15.23:43052) 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.410+0000 7fd4dd400700 1 -- 172.21.15.23:0/1609198433 learned_addr learned my addr 172.21.15.23:0/1609198433 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.411+0000 7fd4dca00700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d8074d80 0x7fd4d8197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.411+0000 7fd4dd400700 1 -- 172.21.15.23:0/1609198433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d8074d80 msgr2=0x7fd4d8197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.411+0000 7fd4dd400700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d8074d80 0x7fd4d8197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.411+0000 7fd4dd400700 1 -- 172.21.15.23:0/1609198433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40095f0 con 0x7fd4d80737b0 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.411+0000 7fd4dca00700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d8074d80 0x7fd4d8197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:20:03.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.411+0000 7fd4dd400700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8197a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00c8a0 tx=0x7fd4cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:03.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.412+0000 7fd4d6000700 1 -- 172.21.15.23:0/1609198433 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4cc00cea0 con 0x7fd4d80737b0 2024-02-28T16:20:03.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.412+0000 7fd4d6000700 1 -- 172.21.15.23:0/1609198433 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc004830 con 0x7fd4d80737b0 2024-02-28T16:20:03.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.412+0000 7fd4d6000700 1 -- 172.21.15.23:0/1609198433 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4cc0055b0 con 0x7fd4d80737b0 2024-02-28T16:20:03.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.412+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d819d160 con 0x7fd4d80737b0 2024-02-28T16:20:03.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.412+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d819d730 con 0x7fd4d80737b0 2024-02-28T16:20:03.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.413+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d810ad90 con 0x7fd4d80737b0 2024-02-28T16:20:03.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.414+0000 7fd4d6000700 1 -- 172.21.15.23:0/1609198433 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd4cc007ad0 con 0x7fd4d80737b0 2024-02-28T16:20:03.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.415+0000 7fd4d6000700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd4c006c680 0x7fd4c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:03.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.415+0000 7fd4d6000700 1 -- 172.21.15.23:0/1609198433 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd4cc08b290 con 0x7fd4d80737b0 2024-02-28T16:20:03.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.415+0000 7fd4dca00700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd4c006c680 0x7fd4c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:03.406 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.416+0000 7fd4dca00700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd4c006c680 0x7fd4c006eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4005b40 tx=0x7fd4c4005ab0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:03.409 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.419+0000 7fd4d6000700 1 -- 172.21.15.23:0/1609198433 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd4cc059720 con 0x7fd4d80737b0 2024-02-28T16:20:03.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.650+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4d8107550 con 0x7fd4c006c680 2024-02-28T16:20:03.643 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.653+0000 7fd4d6000700 1 -- 172.21.15.23:0/1609198433 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd4d8107550 con 0x7fd4c006c680 2024-02-28T16:20:03.643 INFO:teuthology.orchestra.run.smithi023.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-28T16:20:03.643 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736103B14P0KGN 3726G No 3m ago LVM detected, locked 2024-02-28T16:20:03.643 INFO:teuthology.orchestra.run.smithi023.stdout:smithi153 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300MV400BGN 372G No 83s ago LVM detected, locked 2024-02-28T16:20:03.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd4c006c680 msgr2=0x7fd4c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:03.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd4c006c680 0x7fd4c006eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4005b40 tx=0x7fd4c4005ab0 comp rx=0 tx=0).stop 2024-02-28T16:20:03.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 msgr2=0x7fd4d8197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:03.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8197a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00c8a0 tx=0x7fd4cc00cc60 comp rx=0 tx=0).stop 2024-02-28T16:20:03.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 shutdown_connections 2024-02-28T16:20:03.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd4c006c680 0x7fd4c006eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:03.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd4d80737b0 0x7fd4d8197a10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:03.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 --2- 172.21.15.23:0/1609198433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d8074d80 0x7fd4d8197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:03.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 >> 172.21.15.23:0/1609198433 conn(0x7fd4d80fb5e0 msgr2=0x7fd4d8105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:03.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 shutdown_connections 2024-02-28T16:20:03.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:03.656+0000 7fd4de800700 1 -- 172.21.15.23:0/1609198433 wait complete. 2024-02-28T16:20:04.400 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:20:04.411 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:20:04.411 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-28T16:20:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:04 smithi153 ceph-mon[35341]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:04.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:04 smithi023 ceph-mon[29137]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:04.864 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:05.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:05 smithi153 ceph-mon[35341]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:05.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:05 smithi023 ceph-mon[29137]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:06.414 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:06 smithi023 ceph-mon[29137]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:06.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:06 smithi153 ceph-mon[35341]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:06.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 -- 172.21.15.23:0/188637860 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 msgr2=0x7fee80102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 --2- 172.21.15.23:0/188637860 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80102840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fee74009910 tx=0x7fee74009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 -- 172.21.15.23:0/188637860 shutdown_connections 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 --2- 172.21.15.23:0/188637860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee801036d0 0x7fee80103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 --2- 172.21.15.23:0/188637860 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80102840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 -- 172.21.15.23:0/188637860 >> 172.21.15.23:0/188637860 conn(0x7fee800fda80 msgr2=0x7fee800ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 -- 172.21.15.23:0/188637860 shutdown_connections 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.936+0000 7fee88200700 1 -- 172.21.15.23:0/188637860 wait complete. 2024-02-28T16:20:06.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.937+0000 7fee88200700 1 Processor -- start 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee88200700 1 -- start start 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee88200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee88200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee801036d0 0x7fee80198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee88200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80198850 con 0x7fee80102430 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee88200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8019d260 con 0x7fee801036d0 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee85800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee85800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43076/0 (socket says 172.21.15.23:43076) 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.938+0000 7fee85800700 1 -- 172.21.15.23:0/2540545473 learned_addr learned my addr 172.21.15.23:0/2540545473 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.939+0000 7fee84e00700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee801036d0 0x7fee80198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.939+0000 7fee85800700 1 -- 172.21.15.23:0/2540545473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee801036d0 msgr2=0x7fee80198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.939+0000 7fee85800700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee801036d0 0x7fee80198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.939+0000 7fee85800700 1 -- 172.21.15.23:0/2540545473 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740095f0 con 0x7fee80102430 2024-02-28T16:20:06.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.939+0000 7fee85800700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80197cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee74006010 tx=0x7fee7400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:06.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.939+0000 7fee7e000700 1 -- 172.21.15.23:0/2540545473 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee7401d070 con 0x7fee80102430 2024-02-28T16:20:06.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.940+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8019d400 con 0x7fee80102430 2024-02-28T16:20:06.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.940+0000 7fee7e000700 1 -- 172.21.15.23:0/2540545473 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fee7400f460 con 0x7fee80102430 2024-02-28T16:20:06.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.940+0000 7fee7e000700 1 -- 172.21.15.23:0/2540545473 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee74017630 con 0x7fee80102430 2024-02-28T16:20:06.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.940+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8019d8c0 con 0x7fee80102430 2024-02-28T16:20:06.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.941+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8010af10 con 0x7fee80102430 2024-02-28T16:20:06.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.942+0000 7fee7e000700 1 -- 172.21.15.23:0/2540545473 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fee7400f5d0 con 0x7fee80102430 2024-02-28T16:20:06.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.943+0000 7fee7e000700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fee6806c680 0x7fee6806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:06.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.943+0000 7fee7e000700 1 -- 172.21.15.23:0/2540545473 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fee7408ca50 con 0x7fee80102430 2024-02-28T16:20:06.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.943+0000 7fee84e00700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fee6806c680 0x7fee6806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:06.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.944+0000 7fee84e00700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fee6806c680 0x7fee6806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005950 tx=0x7fee6c0058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:06.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:06.948+0000 7fee7e000700 1 -- 172.21.15.23:0/2540545473 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fee74057470 con 0x7fee80102430 2024-02-28T16:20:07.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:07.200+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fee80108020 con 0x7fee6806c680 2024-02-28T16:20:08.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:08 smithi153 ceph-mon[35341]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:08.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:08 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T16:20:08.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:08 smithi153 ceph-mon[35341]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:08.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:08 smithi023 ceph-mon[29137]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:08.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T16:20:08.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:08 smithi023 ceph-mon[29137]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:08.853 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.863+0000 7fee7e000700 1 -- 172.21.15.23:0/2540545473 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fee80108020 con 0x7fee6806c680 2024-02-28T16:20:08.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fee6806c680 msgr2=0x7fee6806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:08.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fee6806c680 0x7fee6806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005950 tx=0x7fee6c0058e0 comp rx=0 tx=0).stop 2024-02-28T16:20:08.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 msgr2=0x7fee80197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:08.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80197cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee74006010 tx=0x7fee7400be20 comp rx=0 tx=0).stop 2024-02-28T16:20:08.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 shutdown_connections 2024-02-28T16:20:08.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fee6806c680 0x7fee6806eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:08.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fee80102430 0x7fee80197cf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:08.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 --2- 172.21.15.23:0/2540545473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee801036d0 0x7fee80198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:08.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 >> 172.21.15.23:0/2540545473 conn(0x7fee800fda80 msgr2=0x7fee80106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:08.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 shutdown_connections 2024-02-28T16:20:08.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:08.866+0000 7fee88200700 1 -- 172.21.15.23:0/2540545473 wait complete. 2024-02-28T16:20:09.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:08 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[29133]: 2024-02-28T16:20:08.830+0000 7fa613400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:20:09.555 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: fsmap cephfs:0 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:09.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:09 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:09.595 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T16:20:09.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T16:20:09.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T16:20:09.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:20:09.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T16:20:09.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T16:20:09.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: fsmap cephfs:0 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:09.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:09 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:10 smithi153 ceph-mon[35341]: Saving service mds.cephfs spec with placement count:4 2024-02-28T16:20:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:10 smithi153 ceph-mon[35341]: Deploying daemon mds.cephfs.smithi023.pplvdo on smithi023 2024-02-28T16:20:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:10 smithi153 ceph-mon[35341]: pgmap v219: 65 pgs: 9 creating+peering, 55 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:10 smithi153 ceph-mon[35341]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T16:20:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:10.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:10.475 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:10 smithi023 ceph-mon[29137]: Saving service mds.cephfs spec with placement count:4 2024-02-28T16:20:10.475 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:10 smithi023 ceph-mon[29137]: Deploying daemon mds.cephfs.smithi023.pplvdo on smithi023 2024-02-28T16:20:10.475 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:10 smithi023 ceph-mon[29137]: pgmap v219: 65 pgs: 9 creating+peering, 55 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:10.475 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:10 smithi023 ceph-mon[29137]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T16:20:10.475 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:10.475 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:11.290 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:11.872 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:11 smithi023 ceph-mon[29137]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T16:20:11.872 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:11 smithi023 ceph-mon[29137]: pgmap v222: 65 pgs: 19 creating+peering, 24 unknown, 22 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:12.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:11 smithi153 ceph-mon[35341]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T16:20:12.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:11 smithi153 ceph-mon[35341]: pgmap v222: 65 pgs: 19 creating+peering, 24 unknown, 22 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 -- 172.21.15.23:0/3869279768 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678073750 msgr2=0x7fd678073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 --2- 172.21.15.23:0/3869279768 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678073750 0x7fd678073bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd664009910 tx=0x7fd664009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 -- 172.21.15.23:0/3869279768 shutdown_connections 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 --2- 172.21.15.23:0/3869279768 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678073750 0x7fd678073bc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 --2- 172.21.15.23:0/3869279768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd678074d20 0x7fd678073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 -- 172.21.15.23:0/3869279768 >> 172.21.15.23:0/3869279768 conn(0x7fd6780fb7f0 msgr2=0x7fd6780fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 -- 172.21.15.23:0/3869279768 shutdown_connections 2024-02-28T16:20:13.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.776+0000 7fd67e400700 1 -- 172.21.15.23:0/3869279768 wait complete. 2024-02-28T16:20:13.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.777+0000 7fd67e400700 1 Processor -- start 2024-02-28T16:20:13.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd67e400700 1 -- start start 2024-02-28T16:20:13.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd67e400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd678073750 0x7fd678197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:13.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd67e400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678074d20 0x7fd6781981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:13.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd67e400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6781987e0 con 0x7fd678074d20 2024-02-28T16:20:13.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd67e400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd678198950 con 0x7fd678073750 2024-02-28T16:20:13.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd676a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678074d20 0x7fd6781981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:13.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd676a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678074d20 0x7fd6781981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44714/0 (socket says 172.21.15.23:44714) 2024-02-28T16:20:13.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd676a00700 1 -- 172.21.15.23:0/3736497280 learned_addr learned my addr 172.21.15.23:0/3736497280 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:13.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.778+0000 7fd677400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd678073750 0x7fd678197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.779+0000 7fd676a00700 1 -- 172.21.15.23:0/3736497280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd678073750 msgr2=0x7fd678197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.779+0000 7fd676a00700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd678073750 0x7fd678197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.779+0000 7fd676a00700 1 -- 172.21.15.23:0/3736497280 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6640095f0 con 0x7fd678074d20 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.779+0000 7fd676a00700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678074d20 0x7fd6781981e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd664006010 tx=0x7fd66400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.779+0000 7fd66fe00700 1 -- 172.21.15.23:0/3736497280 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66401d070 con 0x7fd678074d20 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.780+0000 7fd66fe00700 1 -- 172.21.15.23:0/3736497280 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd66400f460 con 0x7fd678074d20 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.780+0000 7fd66fe00700 1 -- 172.21.15.23:0/3736497280 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd664021640 con 0x7fd678074d20 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.780+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67819d380 con 0x7fd678074d20 2024-02-28T16:20:13.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.780+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67819d870 con 0x7fd678074d20 2024-02-28T16:20:13.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.781+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67810af80 con 0x7fd678074d20 2024-02-28T16:20:13.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.782+0000 7fd66fe00700 1 -- 172.21.15.23:0/3736497280 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd66400fab0 con 0x7fd678074d20 2024-02-28T16:20:13.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.783+0000 7fd66fe00700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd65c06c680 0x7fd65c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:13.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.783+0000 7fd66fe00700 1 -- 172.21.15.23:0/3736497280 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd66408cb70 con 0x7fd678074d20 2024-02-28T16:20:13.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.783+0000 7fd677400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd65c06c680 0x7fd65c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:13.774 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.784+0000 7fd677400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd65c06c680 0x7fd65c06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd678198b80 tx=0x7fd66800b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:13.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:13.789+0000 7fd66fe00700 1 -- 172.21.15.23:0/3736497280 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd6640571b0 con 0x7fd678074d20 2024-02-28T16:20:14.059 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.069+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd67810b170 con 0x7fd678074d20 2024-02-28T16:20:14.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.070+0000 7fd66fe00700 1 -- 172.21.15.23:0/3736497280 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7fd664026460 con 0x7fd678074d20 2024-02-28T16:20:14.060 INFO:teuthology.orchestra.run.smithi023.stdout:e2 2024-02-28T16:20:14.060 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 2 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:08.831368+0000 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:20:14.061 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 0 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:in 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:up {} 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 0 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:14.062 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:14.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd65c06c680 msgr2=0x7fd65c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:14.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd65c06c680 0x7fd65c06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd678198b80 tx=0x7fd66800b410 comp rx=0 tx=0).stop 2024-02-28T16:20:14.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678074d20 msgr2=0x7fd6781981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:14.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678074d20 0x7fd6781981e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd664006010 tx=0x7fd66400bd70 comp rx=0 tx=0).stop 2024-02-28T16:20:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 shutdown_connections 2024-02-28T16:20:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd65c06c680 0x7fd65c06eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd678073750 0x7fd678197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 --2- 172.21.15.23:0/3736497280 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd678074d20 0x7fd6781981e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.073+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 >> 172.21.15.23:0/3736497280 conn(0x7fd6780fb7f0 msgr2=0x7fd678106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.074+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 shutdown_connections 2024-02-28T16:20:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:14.074+0000 7fd67e400700 1 -- 172.21.15.23:0/3736497280 wait complete. 2024-02-28T16:20:14.065 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 2 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: pgmap v223: 65 pgs: 19 creating+peering, 6 unknown, 40 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:14 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3736497280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:20:14.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: pgmap v223: 65 pgs: 19 creating+peering, 6 unknown, 40 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:14.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:14 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3736497280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:20:14.922 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:20:14.932 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:20:14.932 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-02-28T16:20:15.368 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:15.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: Deploying daemon mds.cephfs.smithi153.senzwp on smithi153 2024-02-28T16:20:15.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6826/1762270035,v1:172.21.15.23:6827/1762270035] up:boot 2024-02-28T16:20:15.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: daemon mds.cephfs.smithi023.pplvdo assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T16:20:15.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:20:15.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T16:20:15.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: Cluster is now healthy 2024-02-28T16:20:15.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: fsmap cephfs:0 1 up:standby 2024-02-28T16:20:15.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:20:15.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:creating} 2024-02-28T16:20:15.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:15 smithi153 ceph-mon[35341]: daemon mds.cephfs.smithi023.pplvdo is now active in filesystem cephfs as rank 0 2024-02-28T16:20:15.562 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: Deploying daemon mds.cephfs.smithi153.senzwp on smithi153 2024-02-28T16:20:15.562 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6826/1762270035,v1:172.21.15.23:6827/1762270035] up:boot 2024-02-28T16:20:15.562 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: daemon mds.cephfs.smithi023.pplvdo assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T16:20:15.562 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:20:15.563 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T16:20:15.563 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: Cluster is now healthy 2024-02-28T16:20:15.563 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: fsmap cephfs:0 1 up:standby 2024-02-28T16:20:15.563 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:20:15.563 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:creating} 2024-02-28T16:20:15.563 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:15 smithi023 ceph-mon[29137]: daemon mds.cephfs.smithi023.pplvdo is now active in filesystem cephfs as rank 0 2024-02-28T16:20:16.453 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:16 smithi153 ceph-mon[35341]: pgmap v224: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 3 op/s 2024-02-28T16:20:16.453 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:16 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6826/1762270035,v1:172.21.15.23:6827/1762270035] up:active 2024-02-28T16:20:16.453 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:16 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 2024-02-28T16:20:16.571 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:16 smithi023 ceph-mon[29137]: pgmap v224: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 3 op/s 2024-02-28T16:20:16.572 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:16 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6826/1762270035,v1:172.21.15.23:6827/1762270035] up:active 2024-02-28T16:20:16.572 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:16 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 -- 172.21.15.23:0/266361062 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044100240 msgr2=0x7fd044100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 --2- 172.21.15.23:0/266361062 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044100240 0x7fd044100650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd034009910 tx=0x7fd034009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 -- 172.21.15.23:0/266361062 shutdown_connections 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 --2- 172.21.15.23:0/266361062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044101440 0x7fd044101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 --2- 172.21.15.23:0/266361062 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044100240 0x7fd044100650 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 -- 172.21.15.23:0/266361062 >> 172.21.15.23:0/266361062 conn(0x7fd0440fb7f0 msgr2=0x7fd0440fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 -- 172.21.15.23:0/266361062 shutdown_connections 2024-02-28T16:20:17.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.565+0000 7fd049200700 1 -- 172.21.15.23:0/266361062 wait complete. 2024-02-28T16:20:17.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.567+0000 7fd049200700 1 Processor -- start 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.567+0000 7fd049200700 1 -- start start 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.567+0000 7fd049200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044100240 0x7fd044195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.567+0000 7fd049200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044101440 0x7fd044195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.567+0000 7fd049200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044196580 con 0x7fd044101440 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.567+0000 7fd049200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0441966c0 con 0x7fd044100240 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044101440 0x7fd044195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044101440 0x7fd044195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44734/0 (socket says 172.21.15.23:44734) 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041400700 1 -- 172.21.15.23:0/2684036813 learned_addr learned my addr 172.21.15.23:0/2684036813 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:17.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041e00700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044100240 0x7fd044195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041400700 1 -- 172.21.15.23:0/2684036813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044100240 msgr2=0x7fd044195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041400700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044100240 0x7fd044195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041400700 1 -- 172.21.15.23:0/2684036813 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0340095f0 con 0x7fd044101440 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.568+0000 7fd041400700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044101440 0x7fd044195ff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c930 tx=0x7fd03000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.569+0000 7fd03aa00700 1 -- 172.21.15.23:0/2684036813 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd030007ad0 con 0x7fd044101440 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.569+0000 7fd03aa00700 1 -- 172.21.15.23:0/2684036813 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd030007c30 con 0x7fd044101440 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.569+0000 7fd03aa00700 1 -- 172.21.15.23:0/2684036813 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd030018630 con 0x7fd044101440 2024-02-28T16:20:17.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.569+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04419b180 con 0x7fd044101440 2024-02-28T16:20:17.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.569+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04419b600 con 0x7fd044101440 2024-02-28T16:20:17.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.570+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd044108d90 con 0x7fd044101440 2024-02-28T16:20:17.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.571+0000 7fd03aa00700 1 -- 172.21.15.23:0/2684036813 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd03000f450 con 0x7fd044101440 2024-02-28T16:20:17.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.572+0000 7fd03aa00700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd02806c680 0x7fd02806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.572+0000 7fd03aa00700 1 -- 172.21.15.23:0/2684036813 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd03008ba80 con 0x7fd044101440 2024-02-28T16:20:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.573+0000 7fd041e00700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd02806c680 0x7fd02806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.573+0000 7fd041e00700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd02806c680 0x7fd02806eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd034006010 tx=0x7fd03400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:17.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.578+0000 7fd03aa00700 1 -- 172.21.15.23:0/2684036813 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd030059bf0 con 0x7fd044101440 2024-02-28T16:20:17.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:17.852+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fd04419bcf0 con 0x7fd044101440 2024-02-28T16:20:18.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.446+0000 7fd03aa00700 1 -- 172.21.15.23:0/2684036813 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd030059780 con 0x7fd044101440 2024-02-28T16:20:18.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd02806c680 msgr2=0x7fd02806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd02806c680 0x7fd02806eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd034006010 tx=0x7fd03400b540 comp rx=0 tx=0).stop 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044101440 msgr2=0x7fd044195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044101440 0x7fd044195ff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c930 tx=0x7fd03000ccf0 comp rx=0 tx=0).stop 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 shutdown_connections 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd02806c680 0x7fd02806eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044100240 0x7fd044195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 --2- 172.21.15.23:0/2684036813 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd044101440 0x7fd044195ff0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 >> 172.21.15.23:0/2684036813 conn(0x7fd0440fb7f0 msgr2=0x7fd044104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.450+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 shutdown_connections 2024-02-28T16:20:18.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:18.451+0000 7fd049200700 1 -- 172.21.15.23:0/2684036813 wait complete. 2024-02-28T16:20:18.533 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T16:20:18.533 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:boot 2024-02-28T16:20:18.533 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 1 up:standby 2024-02-28T16:20:18.533 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 1 up:standby 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:18.534 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:18 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2684036813' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T16:20:18.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T16:20:18.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:boot 2024-02-28T16:20:18.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 1 up:standby 2024-02-28T16:20:18.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:20:18.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 1 up:standby 2024-02-28T16:20:18.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:18.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:18.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:18.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:18.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:18.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:18.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:18 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2684036813' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T16:20:19.570 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:19 smithi023 ceph-mon[29137]: Deploying daemon mds.cephfs.smithi023.klbbrl on smithi023 2024-02-28T16:20:19.570 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:19 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2684036813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T16:20:19.570 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:19 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 1 up:standby 2024-02-28T16:20:19.639 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:20:19.660 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:20:19.660 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-28T16:20:19.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:19 smithi153 ceph-mon[35341]: Deploying daemon mds.cephfs.smithi023.klbbrl on smithi023 2024-02-28T16:20:19.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:19 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2684036813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T16:20:19.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:19 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 1 up:standby 2024-02-28T16:20:20.373 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:20.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:20 smithi023 ceph-mon[29137]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-02-28T16:20:20.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:20 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:20.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:20 smithi153 ceph-mon[35341]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-02-28T16:20:20.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:20 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:22 smithi153 ceph-mon[35341]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-28T16:20:22.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:22 smithi023 ceph-mon[29137]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.156+0000 7f0913800700 1 -- 172.21.15.23:0/890462192 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 msgr2=0x7f090c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.156+0000 7f0913800700 1 --2- 172.21.15.23:0/890462192 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c100650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009910 tx=0x7f08f4009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.156+0000 7f0913800700 1 -- 172.21.15.23:0/890462192 shutdown_connections 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.156+0000 7f0913800700 1 --2- 172.21.15.23:0/890462192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f090c101440 0x7f090c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.156+0000 7f0913800700 1 --2- 172.21.15.23:0/890462192 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c100650 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.157+0000 7f0913800700 1 -- 172.21.15.23:0/890462192 >> 172.21.15.23:0/890462192 conn(0x7f090c0fb7f0 msgr2=0x7f090c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.157+0000 7f0913800700 1 -- 172.21.15.23:0/890462192 shutdown_connections 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.157+0000 7f0913800700 1 -- 172.21.15.23:0/890462192 wait complete. 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.158+0000 7f0913800700 1 Processor -- start 2024-02-28T16:20:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.158+0000 7f0913800700 1 -- start start 2024-02-28T16:20:23.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.158+0000 7f0913800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:23.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.158+0000 7f0913800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f090c101440 0x7f090c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:23.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.158+0000 7f0913800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c073680 con 0x7f090c100240 2024-02-28T16:20:23.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.158+0000 7f0913800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0737c0 con 0x7f090c101440 2024-02-28T16:20:23.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.158+0000 7f0910e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:23.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.159+0000 7f0910e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59294/0 (socket says 172.21.15.23:59294) 2024-02-28T16:20:23.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.159+0000 7f0910e00700 1 -- 172.21.15.23:0/4198381234 learned_addr learned my addr 172.21.15.23:0/4198381234 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.159+0000 7f0903e00700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f090c101440 0x7f090c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.159+0000 7f0910e00700 1 -- 172.21.15.23:0/4198381234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f090c101440 msgr2=0x7f090c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.159+0000 7f0910e00700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f090c101440 0x7f090c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.159+0000 7f0910e00700 1 -- 172.21.15.23:0/4198381234 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40095f0 con 0x7f090c100240 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.159+0000 7f0910e00700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c074af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f08f400bda0 tx=0x7f08f400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.160+0000 7f090a000700 1 -- 172.21.15.23:0/4198381234 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f401d070 con 0x7f090c100240 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.160+0000 7f090a000700 1 -- 172.21.15.23:0/4198381234 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08f400f460 con 0x7f090c100240 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.160+0000 7f090a000700 1 -- 172.21.15.23:0/4198381234 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f4021620 con 0x7f090c100240 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.160+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c073a40 con 0x7f090c100240 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.160+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c073f30 con 0x7f090c100240 2024-02-28T16:20:23.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.161+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c108d90 con 0x7f090c100240 2024-02-28T16:20:23.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.162+0000 7f090a000700 1 -- 172.21.15.23:0/4198381234 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f08f400f5d0 con 0x7f090c100240 2024-02-28T16:20:23.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.163+0000 7f090a000700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f08ec06c680 0x7f08ec06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:23.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.163+0000 7f090a000700 1 -- 172.21.15.23:0/4198381234 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f08f408cb00 con 0x7f090c100240 2024-02-28T16:20:23.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.164+0000 7f0903e00700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f08ec06c680 0x7f08ec06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:23.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.164+0000 7f0903e00700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f08ec06c680 0x7f08ec06eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08fc005950 tx=0x7f08fc0058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:23.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.169+0000 7f090a000700 1 -- 172.21.15.23:0/4198381234 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f08f405ac70 con 0x7f090c100240 2024-02-28T16:20:23.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:23.441+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f090c108f80 con 0x7f090c100240 2024-02-28T16:20:24.005 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:24.005 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:24.005 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:24.005 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:24.005 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:24.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:24.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: Deploying daemon mds.cephfs.smithi153.dhwpyj on smithi153 2024-02-28T16:20:24.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T16:20:24.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:boot 2024-02-28T16:20:24.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 2 up:standby 2024-02-28T16:20:24.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:20:24.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:23 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/4198381234' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-28T16:20:24.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:24.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:24.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: Deploying daemon mds.cephfs.smithi153.dhwpyj on smithi153 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:boot 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 2 up:standby 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:23 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/4198381234' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-28T16:20:24.339 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.348+0000 7f090a000700 1 -- 172.21.15.23:0/4198381234 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f08f405a800 con 0x7f090c100240 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.351+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f08ec06c680 msgr2=0x7f08ec06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.351+0000 7f0913800700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f08ec06c680 0x7f08ec06eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08fc005950 tx=0x7f08fc0058e0 comp rx=0 tx=0).stop 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 msgr2=0x7f090c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c074af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f08f400bda0 tx=0x7f08f400be80 comp rx=0 tx=0).stop 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 shutdown_connections 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f08ec06c680 0x7f08ec06eb30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f090c100240 0x7f090c074af0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:24.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 --2- 172.21.15.23:0/4198381234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f090c101440 0x7f090c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:24.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 >> 172.21.15.23:0/4198381234 conn(0x7f090c0fb7f0 msgr2=0x7f090c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:24.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 shutdown_connections 2024-02-28T16:20:24.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:24.352+0000 7f0913800700 1 -- 172.21.15.23:0/4198381234 wait complete. 2024-02-28T16:20:25.173 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:20:25.184 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:20:25.184 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-28T16:20:25.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:25 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/4198381234' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-28T16:20:25.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:25 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 2 up:standby 2024-02-28T16:20:25.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:25.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:25.589 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:25 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/4198381234' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-28T16:20:25.589 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:25 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 2 up:standby 2024-02-28T16:20:25.589 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:25.589 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:25.622 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:26.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:26 smithi023 ceph-mon[29137]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T16:20:26.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:26 smithi153 ceph-mon[35341]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T16:20:27.654 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 1 op/s 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:boot 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:standby 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: Dropping low affinity active daemon mds.cephfs.smithi023.pplvdo in favor of higher affinity standby. 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: Replacing daemon mds.cephfs.smithi023.pplvdo as rank 0 with standby daemon mds.cephfs.smithi023.klbbrl 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:20:27.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 3 up:standby 2024-02-28T16:20:27.656 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:20:27.656 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T16:20:27.656 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:27 smithi023 ceph-mon[29137]: fsmap cephfs:1/1 {0=cephfs.smithi023.klbbrl=up:replay} 2 up:standby 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.840+0000 7fae99e00700 1 -- 172.21.15.23:0/3377381749 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 msgr2=0x7fae94101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.840+0000 7fae99e00700 1 --2- 172.21.15.23:0/3377381749 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94101890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae80009910 tx=0x7fae80009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.840+0000 7fae99e00700 1 -- 172.21.15.23:0/3377381749 shutdown_connections 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.840+0000 7fae99e00700 1 --2- 172.21.15.23:0/3377381749 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94101890 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.840+0000 7fae99e00700 1 --2- 172.21.15.23:0/3377381749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94100240 0x7fae94100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.840+0000 7fae99e00700 1 -- 172.21.15.23:0/3377381749 >> 172.21.15.23:0/3377381749 conn(0x7fae940fb7f0 msgr2=0x7fae940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.841+0000 7fae99e00700 1 -- 172.21.15.23:0/3377381749 shutdown_connections 2024-02-28T16:20:27.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.841+0000 7fae99e00700 1 -- 172.21.15.23:0/3377381749 wait complete. 2024-02-28T16:20:27.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.842+0000 7fae99e00700 1 Processor -- start 2024-02-28T16:20:27.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.842+0000 7fae99e00700 1 -- start start 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.842+0000 7fae99e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94100240 0x7fae94197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.842+0000 7fae99e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.842+0000 7fae99e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94198820 con 0x7fae94101440 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.842+0000 7fae99e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94198990 con 0x7fae94100240 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59330/0 (socket says 172.21.15.23:59330) 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92000700 1 -- 172.21.15.23:0/2876624335 learned_addr learned my addr 172.21.15.23:0/2876624335 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92a00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94100240 0x7fae94197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92000700 1 -- 172.21.15.23:0/2876624335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94100240 msgr2=0x7fae94197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92000700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94100240 0x7fae94197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92000700 1 -- 172.21.15.23:0/2876624335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800095f0 con 0x7fae94101440 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.843+0000 7fae92a00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94100240 0x7fae94197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.844+0000 7fae92000700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94198220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fae80005b40 tx=0x7fae8000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.844+0000 7fae98a00700 1 -- 172.21.15.23:0/2876624335 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8001d070 con 0x7fae94101440 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.844+0000 7fae98a00700 1 -- 172.21.15.23:0/2876624335 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fae8000f460 con 0x7fae94101440 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.844+0000 7fae98a00700 1 -- 172.21.15.23:0/2876624335 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae80021640 con 0x7fae94101440 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.844+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9419d370 con 0x7fae94101440 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.844+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9419d860 con 0x7fae94101440 2024-02-28T16:20:27.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.846+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae94105520 con 0x7fae94101440 2024-02-28T16:20:27.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.846+0000 7fae98a00700 1 -- 172.21.15.23:0/2876624335 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fae8000fa90 con 0x7fae94101440 2024-02-28T16:20:27.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.847+0000 7fae98a00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fae7806c680 0x7fae7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:27.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.847+0000 7fae98a00700 1 -- 172.21.15.23:0/2876624335 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fae8008cb20 con 0x7fae94101440 2024-02-28T16:20:27.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.848+0000 7fae92a00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fae7806c680 0x7fae7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:27.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.849+0000 7fae92a00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fae7806c680 0x7fae7806eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae84005950 tx=0x7fae840058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:27.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:27.853+0000 7fae98a00700 1 -- 172.21.15.23:0/2876624335 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fae80057220 con 0x7fae94101440 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 1 op/s 2024-02-28T16:20:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:boot 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:standby 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: Dropping low affinity active daemon mds.cephfs.smithi023.pplvdo in favor of higher affinity standby. 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: Replacing daemon mds.cephfs.smithi023.pplvdo as rank 0 with standby daemon mds.cephfs.smithi023.klbbrl 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 3 up:standby 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T16:20:27.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:27 smithi153 ceph-mon[35341]: fsmap cephfs:1/1 {0=cephfs.smithi023.klbbrl=up:replay} 2 up:standby 2024-02-28T16:20:28.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.188+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fae9402cc30 con 0x7fae94101440 2024-02-28T16:20:28.254 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.264+0000 7fae98a00700 1 -- 172.21.15.23:0/2876624335 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v13) v1 ==== 133+0+0 (secure 0 0 0) 0x7fae8005a840 con 0x7fae94101440 2024-02-28T16:20:28.258 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fae7806c680 msgr2=0x7fae7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:28.258 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fae7806c680 0x7fae7806eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae84005950 tx=0x7fae840058e0 comp rx=0 tx=0).stop 2024-02-28T16:20:28.258 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 msgr2=0x7fae94198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:28.258 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94198220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fae80005b40 tx=0x7fae8000be20 comp rx=0 tx=0).stop 2024-02-28T16:20:28.258 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 shutdown_connections 2024-02-28T16:20:28.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fae7806c680 0x7fae7806eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:28.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94100240 0x7fae94197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:28.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 --2- 172.21.15.23:0/2876624335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fae94101440 0x7fae94198220 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:28.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.268+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 >> 172.21.15.23:0/2876624335 conn(0x7fae940fb7f0 msgr2=0x7fae94102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:28.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.269+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 shutdown_connections 2024-02-28T16:20:28.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:28.269+0000 7fae99e00700 1 -- 172.21.15.23:0/2876624335 wait complete. 2024-02-28T16:20:28.260 INFO:teuthology.orchestra.run.smithi023.stderr:inline data disabled 2024-02-28T16:20:28.864 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:28 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2876624335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-28T16:20:28.864 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:28 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:reconnect 2024-02-28T16:20:28.864 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:28 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] up:boot 2024-02-28T16:20:28.864 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:28 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2876624335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-28T16:20:28.865 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:28 smithi023 ceph-mon[29137]: fsmap cephfs:1/1 {0=cephfs.smithi023.klbbrl=up:reconnect} 3 up:standby 2024-02-28T16:20:28.865 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:28 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:20:28.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:28 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2876624335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-28T16:20:28.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:28 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:reconnect 2024-02-28T16:20:28.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:28 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] up:boot 2024-02-28T16:20:28.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:28 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2876624335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-28T16:20:28.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:28 smithi153 ceph-mon[35341]: fsmap cephfs:1/1 {0=cephfs.smithi023.klbbrl=up:reconnect} 3 up:standby 2024-02-28T16:20:28.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:28 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:20:29.527 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:20:29.538 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:20:29.538 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T16:20:30.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:30 smithi023 ceph-mon[29137]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 614 B/s rd, 0 B/s wr, 0 op/s 2024-02-28T16:20:30.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:30 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:rejoin 2024-02-28T16:20:30.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:30 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:standby 2024-02-28T16:20:30.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:30 smithi023 ceph-mon[29137]: fsmap cephfs:1/1 {0=cephfs.smithi023.klbbrl=up:rejoin} 3 up:standby 2024-02-28T16:20:30.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:30 smithi023 ceph-mon[29137]: daemon mds.cephfs.smithi023.klbbrl is now active in filesystem cephfs as rank 0 2024-02-28T16:20:30.575 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:30 smithi153 ceph-mon[35341]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 614 B/s rd, 0 B/s wr, 0 op/s 2024-02-28T16:20:30.575 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:30 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:rejoin 2024-02-28T16:20:30.575 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:30 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:standby 2024-02-28T16:20:30.575 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:30 smithi153 ceph-mon[35341]: fsmap cephfs:1/1 {0=cephfs.smithi023.klbbrl=up:rejoin} 3 up:standby 2024-02-28T16:20:30.576 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:30 smithi153 ceph-mon[35341]: daemon mds.cephfs.smithi023.klbbrl is now active in filesystem cephfs as rank 0 2024-02-28T16:20:30.672 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:31.307 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:31 smithi023 ceph-mon[29137]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:20:31.307 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:31 smithi023 ceph-mon[29137]: Cluster is now healthy 2024-02-28T16:20:31.307 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:31 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:active 2024-02-28T16:20:31.307 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:31 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:20:31.307 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:31.307 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:31.307 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:31 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:31.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:31 smithi153 ceph-mon[35341]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:20:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:31 smithi153 ceph-mon[35341]: Cluster is now healthy 2024-02-28T16:20:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:31 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] up:active 2024-02-28T16:20:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:31 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:20:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:31.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:31 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:32.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:32 smithi023 ceph-mon[29137]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 0 B/s wr, 0 op/s 2024-02-28T16:20:32.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:32 smithi023 ceph-mon[29137]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:standby 2024-02-28T16:20:32.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:32 smithi023 ceph-mon[29137]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:20:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:32 smithi153 ceph-mon[35341]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 0 B/s wr, 0 op/s 2024-02-28T16:20:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:32 smithi153 ceph-mon[35341]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:standby 2024-02-28T16:20:32.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:32 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:20:33.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 -- 172.21.15.23:0/3838244682 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 msgr2=0x7fdad00731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:33.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 --2- 172.21.15.23:0/3838244682 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad00731e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009910 tx=0x7fdac0009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:33.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 -- 172.21.15.23:0/3838244682 shutdown_connections 2024-02-28T16:20:33.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 --2- 172.21.15.23:0/3838244682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad00737b0 0x7fdad0073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:33.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 --2- 172.21.15.23:0/3838244682 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad00731e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:33.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 -- 172.21.15.23:0/3838244682 >> 172.21.15.23:0/3838244682 conn(0x7fdad00fb7f0 msgr2=0x7fdad00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:33.270 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 -- 172.21.15.23:0/3838244682 shutdown_connections 2024-02-28T16:20:33.270 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.279+0000 7fdad6000700 1 -- 172.21.15.23:0/3838244682 wait complete. 2024-02-28T16:20:33.270 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.280+0000 7fdad6000700 1 Processor -- start 2024-02-28T16:20:33.271 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.280+0000 7fdad6000700 1 -- start start 2024-02-28T16:20:33.271 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdad6000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad00737b0 0x7fdad019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:33.271 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdad6000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:33.271 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdad6000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad019cb30 con 0x7fdad0074d80 2024-02-28T16:20:33.271 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdad6000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad019cc70 con 0x7fdad00737b0 2024-02-28T16:20:33.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdacea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:33.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdacea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad019c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:41726/0 (socket says 172.21.15.23:41726) 2024-02-28T16:20:33.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdacea00700 1 -- 172.21.15.23:0/3352523212 learned_addr learned my addr 172.21.15.23:0/3352523212 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.281+0000 7fdacf400700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad00737b0 0x7fdad019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdacea00700 1 -- 172.21.15.23:0/3352523212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad00737b0 msgr2=0x7fdad019c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdacea00700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad00737b0 0x7fdad019c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdacea00700 1 -- 172.21.15.23:0/3352523212 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00095f0 con 0x7fdad0074d80 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdacea00700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad019c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c930 tx=0x7fdabc00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdac7e00700 1 -- 172.21.15.23:0/3352523212 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdabc007ad0 con 0x7fdad0074d80 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdac7e00700 1 -- 172.21.15.23:0/3352523212 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdabc007c30 con 0x7fdad0074d80 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad01a1730 con 0x7fdad0074d80 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdac7e00700 1 -- 172.21.15.23:0/3352523212 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdabc018630 con 0x7fdad0074d80 2024-02-28T16:20:33.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.282+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad01a1c50 con 0x7fdad0074d80 2024-02-28T16:20:33.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.284+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad010f370 con 0x7fdad0074d80 2024-02-28T16:20:33.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.285+0000 7fdac7e00700 1 -- 172.21.15.23:0/3352523212 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdabc0188a0 con 0x7fdad0074d80 2024-02-28T16:20:33.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.286+0000 7fdac7e00700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdab406c680 0x7fdab406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:33.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.286+0000 7fdac7e00700 1 -- 172.21.15.23:0/3352523212 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdabc08bad0 con 0x7fdad0074d80 2024-02-28T16:20:33.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.286+0000 7fdacf400700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdab406c680 0x7fdab406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:33.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.287+0000 7fdacf400700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdab406c680 0x7fdab406eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdac0006010 tx=0x7fdac000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:33.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.291+0000 7fdac7e00700 1 -- 172.21.15.23:0/3352523212 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdabc059cc0 con 0x7fdad0074d80 2024-02-28T16:20:33.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.562+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdad010f530 con 0x7fdad0074d80 2024-02-28T16:20:33.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.563+0000 7fdac7e00700 1 -- 172.21.15.23:0/3352523212 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7fdabc059850 con 0x7fdad0074d80 2024-02-28T16:20:33.553 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:20:33.553 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:20:33.553 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:20:33.554 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:33.555 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:20:33.556 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:33.556 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:20:33.556 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:20:33.556 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:20:33.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdab406c680 msgr2=0x7fdab406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:33.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdab406c680 0x7fdab406eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdac0006010 tx=0x7fdac000b540 comp rx=0 tx=0).stop 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 msgr2=0x7fdad019c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad019c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c930 tx=0x7fdabc00ccf0 comp rx=0 tx=0).stop 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 shutdown_connections 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fdab406c680 0x7fdab406eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad00737b0 0x7fdad019c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 --2- 172.21.15.23:0/3352523212 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdad0074d80 0x7fdad019c5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 >> 172.21.15.23:0/3352523212 conn(0x7fdad00fb7f0 msgr2=0x7fdad0101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 shutdown_connections 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:33.566+0000 7fdad6000700 1 -- 172.21.15.23:0/3352523212 wait complete. 2024-02-28T16:20:33.557 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:20:34.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:34 smithi153 ceph-mon[35341]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-02-28T16:20:34.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:34 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3352523212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:20:34.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:34 smithi023 ceph-mon[29137]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-02-28T16:20:34.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:34 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3352523212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:20:34.751 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-28T16:20:35.618 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:35.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:35 smithi023 ceph-mon[29137]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-02-28T16:20:35.708 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:35 smithi153 ceph-mon[35341]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-02-28T16:20:37.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 -- 172.21.15.23:0/3059431003 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac0737b0 msgr2=0x7feaac073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:37.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 --2- 172.21.15.23:0/3059431003 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac0737b0 0x7feaac073c20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fea98009940 tx=0x7fea98009c50 comp rx=0 tx=0).stop 2024-02-28T16:20:37.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 -- 172.21.15.23:0/3059431003 shutdown_connections 2024-02-28T16:20:37.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 --2- 172.21.15.23:0/3059431003 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac0737b0 0x7feaac073c20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:37.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 --2- 172.21.15.23:0/3059431003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac074d80 0x7feaac0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:37.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 -- 172.21.15.23:0/3059431003 >> 172.21.15.23:0/3059431003 conn(0x7feaac0fb7f0 msgr2=0x7feaac0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:37.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 -- 172.21.15.23:0/3059431003 shutdown_connections 2024-02-28T16:20:37.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.694+0000 7feab1400700 1 -- 172.21.15.23:0/3059431003 wait complete. 2024-02-28T16:20:37.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.695+0000 7feab1400700 1 Processor -- start 2024-02-28T16:20:37.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.695+0000 7feab1400700 1 -- start start 2024-02-28T16:20:37.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feab1400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0737b0 0x7feaac197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:37.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feab1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac074d80 0x7feaac1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:37.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feab1400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac198900 con 0x7feaac074d80 2024-02-28T16:20:37.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feab1400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac198a40 con 0x7feaac0737b0 2024-02-28T16:20:37.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feaa9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac074d80 0x7feaac1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:37.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feaaa800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0737b0 0x7feaac197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:37.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feaa9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac074d80 0x7feaac1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:41750/0 (socket says 172.21.15.23:41750) 2024-02-28T16:20:37.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.696+0000 7feaa9e00700 1 -- 172.21.15.23:0/1477522015 learned_addr learned my addr 172.21.15.23:0/1477522015 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:37.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feaa9e00700 1 -- 172.21.15.23:0/1477522015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0737b0 msgr2=0x7feaac197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feaa9e00700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0737b0 0x7feaac197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feaa9e00700 1 -- 172.21.15.23:0/1477522015 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980095f0 con 0x7feaac074d80 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feaa9e00700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac074d80 0x7feaac1982e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fea980055f0 tx=0x7fea98005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feaa3400700 1 -- 172.21.15.23:0/1477522015 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9801d070 con 0x7feaac074d80 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feaa3400700 1 -- 172.21.15.23:0/1477522015 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea9800f460 con 0x7feaac074d80 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feaa3400700 1 -- 172.21.15.23:0/1477522015 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea98021640 con 0x7feaac074d80 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.697+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac19d490 con 0x7feaac074d80 2024-02-28T16:20:37.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.698+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac19d980 con 0x7feaac074d80 2024-02-28T16:20:37.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.699+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac10b000 con 0x7feaac074d80 2024-02-28T16:20:37.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.700+0000 7feaa3400700 1 -- 172.21.15.23:0/1477522015 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fea9800fa70 con 0x7feaac074d80 2024-02-28T16:20:37.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.701+0000 7feaa3400700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fea9006c680 0x7fea9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:37.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.701+0000 7feaa3400700 1 -- 172.21.15.23:0/1477522015 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fea9808cb50 con 0x7feaac074d80 2024-02-28T16:20:37.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.701+0000 7feaaa800700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fea9006c680 0x7fea9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:37.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.702+0000 7feaaa800700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fea9006c680 0x7fea9006eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009a10 tx=0x7fea9c009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:37.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.706+0000 7feaa3400700 1 -- 172.21.15.23:0/1477522015 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fea9805ace0 con 0x7feaac074d80 2024-02-28T16:20:37.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.976+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaac10b1f0 con 0x7feaac074d80 2024-02-28T16:20:37.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.977+0000 7feaa3400700 1 -- 172.21.15.23:0/1477522015 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fea9805a870 con 0x7feaac074d80 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.980+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fea9006c680 msgr2=0x7fea9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.980+0000 7feab1400700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fea9006c680 0x7fea9006eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009a10 tx=0x7fea9c009190 comp rx=0 tx=0).stop 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.980+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac074d80 msgr2=0x7feaac1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac074d80 0x7feaac1982e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fea980055f0 tx=0x7fea98005620 comp rx=0 tx=0).stop 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 shutdown_connections 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fea9006c680 0x7fea9006eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0737b0 0x7feaac197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 --2- 172.21.15.23:0/1477522015 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feaac074d80 0x7feaac1982e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 >> 172.21.15.23:0/1477522015 conn(0x7feaac0fb7f0 msgr2=0x7feaac106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 shutdown_connections 2024-02-28T16:20:37.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:37.981+0000 7feab1400700 1 -- 172.21.15.23:0/1477522015 wait complete. 2024-02-28T16:20:37.972 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:20:37.987 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:20:38.270 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:38.271 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:38.271 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:38.271 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:38.271 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:38.271 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T16:20:38.271 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:38.271 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:38 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1477522015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:20:38.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:38.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:38.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:38.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:38.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:38.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T16:20:38.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:38.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:38 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1477522015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:20:38.786 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-28T16:20:39.934 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:40.406 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:40 smithi023 ceph-mon[29137]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-28T16:20:40.407 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:40.580 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:40 smithi153 ceph-mon[35341]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-28T16:20:40.581 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:41.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:41 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:41.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:41 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:41.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:41 smithi023 ceph-mon[29137]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-28T16:20:42.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:41 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:42.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:41 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:42.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:41 smithi153 ceph-mon[35341]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 -- 172.21.15.23:0/2112124782 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 msgr2=0x7fda18105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 --2- 172.21.15.23:0/2112124782 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda18105a80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda04009910 tx=0x7fda04009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 -- 172.21.15.23:0/2112124782 shutdown_connections 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 --2- 172.21.15.23:0/2112124782 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda18105a80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 --2- 172.21.15.23:0/2112124782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda18100d80 0x7fda18103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 -- 172.21.15.23:0/2112124782 >> 172.21.15.23:0/2112124782 conn(0x7fda180fa7a0 msgr2=0x7fda180fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 -- 172.21.15.23:0/2112124782 shutdown_connections 2024-02-28T16:20:42.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.839+0000 7fda1cc00700 1 -- 172.21.15.23:0/2112124782 wait complete. 2024-02-28T16:20:42.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.840+0000 7fda1cc00700 1 Processor -- start 2024-02-28T16:20:42.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.840+0000 7fda1cc00700 1 -- start start 2024-02-28T16:20:42.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda1cc00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda18100d80 0x7fda181980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:42.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda1cc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda181985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:42.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda1cc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18198c10 con 0x7fda181036a0 2024-02-28T16:20:42.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda1cc00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18198d50 con 0x7fda18100d80 2024-02-28T16:20:42.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda15400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda181985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:42.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda15400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda181985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45398/0 (socket says 172.21.15.23:45398) 2024-02-28T16:20:42.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda15400700 1 -- 172.21.15.23:0/279145094 learned_addr learned my addr 172.21.15.23:0/279145094 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:42.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.841+0000 7fda15e00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda18100d80 0x7fda181980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:42.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda15400700 1 -- 172.21.15.23:0/279145094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda18100d80 msgr2=0x7fda181980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda15400700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda18100d80 0x7fda181980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda15400700 1 -- 172.21.15.23:0/279145094 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda040095f0 con 0x7fda181036a0 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda15400700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda181985f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda04005b40 tx=0x7fda0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda0ea00700 1 -- 172.21.15.23:0/279145094 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0401d070 con 0x7fda181036a0 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda0ea00700 1 -- 172.21.15.23:0/279145094 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda04022470 con 0x7fda181036a0 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1819d7a0 con 0x7fda181036a0 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.842+0000 7fda0ea00700 1 -- 172.21.15.23:0/279145094 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0400f690 con 0x7fda181036a0 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.843+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1819dc90 con 0x7fda181036a0 2024-02-28T16:20:42.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.844+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda180fc360 con 0x7fda181036a0 2024-02-28T16:20:42.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.845+0000 7fda0ea00700 1 -- 172.21.15.23:0/279145094 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fda040225e0 con 0x7fda181036a0 2024-02-28T16:20:42.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.846+0000 7fda0ea00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd9fc06c680 0x7fd9fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:42.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.846+0000 7fda0ea00700 1 -- 172.21.15.23:0/279145094 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fda0408d0f0 con 0x7fda181036a0 2024-02-28T16:20:42.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.846+0000 7fda15e00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd9fc06c680 0x7fd9fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:42.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.847+0000 7fda15e00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd9fc06c680 0x7fd9fc06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda08006fd0 tx=0x7fda08008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:42.851+0000 7fda0ea00700 1 -- 172.21.15.23:0/279145094 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fda0405b260 con 0x7fda181036a0 2024-02-28T16:20:43.169 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.179+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fda18068ab0 con 0x7fda181036a0 2024-02-28T16:20:43.170 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.179+0000 7fda0ea00700 1 -- 172.21.15.23:0/279145094 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+83 (secure 0 0 0) 0x7fda0405adf0 con 0x7fda181036a0 2024-02-28T16:20:43.172 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.182+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd9fc06c680 msgr2=0x7fd9fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:43.172 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.182+0000 7fda1cc00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd9fc06c680 0x7fd9fc06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda08006fd0 tx=0x7fda08008040 comp rx=0 tx=0).stop 2024-02-28T16:20:43.172 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.182+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 msgr2=0x7fda181985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:43.172 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.182+0000 7fda1cc00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda181985f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda04005b40 tx=0x7fda0400be20 comp rx=0 tx=0).stop 2024-02-28T16:20:43.173 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.183+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 shutdown_connections 2024-02-28T16:20:43.173 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.183+0000 7fda1cc00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fd9fc06c680 0x7fd9fc06eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:43.173 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.183+0000 7fda1cc00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda18100d80 0x7fda181980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:43.173 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.183+0000 7fda1cc00700 1 --2- 172.21.15.23:0/279145094 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda181036a0 0x7fda181985f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:43.173 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.183+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 >> 172.21.15.23:0/279145094 conn(0x7fda180fa7a0 msgr2=0x7fda18104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:43.173 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.183+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 shutdown_connections 2024-02-28T16:20:43.174 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:43.183+0000 7fda1cc00700 1 -- 172.21.15.23:0/279145094 wait complete. 2024-02-28T16:20:43.187 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:20:43.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:43 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/279145094' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T16:20:43.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:43 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/279145094' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T16:20:44.385 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-28T16:20:44.400 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:20:44.483 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:44 smithi023 ceph-mon[29137]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-02-28T16:20:44.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 -- 172.21.15.23:0/2632268614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8102a50 msgr2=0x7f1bf8102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:44.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 --2- 172.21.15.23:0/2632268614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8102a50 0x7f1bf8102ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009880 tx=0x7f1be002bce0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 -- 172.21.15.23:0/2632268614 shutdown_connections 2024-02-28T16:20:44.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 --2- 172.21.15.23:0/2632268614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8102a50 0x7f1bf8102ec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 --2- 172.21.15.23:0/2632268614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bf8101860 0x7f1bf8101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 -- 172.21.15.23:0/2632268614 >> 172.21.15.23:0/2632268614 conn(0x7f1bf80fce10 msgr2=0x7f1bf80ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:44.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 -- 172.21.15.23:0/2632268614 shutdown_connections 2024-02-28T16:20:44.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.646+0000 7f1bfd800640 1 -- 172.21.15.23:0/2632268614 wait complete. 2024-02-28T16:20:44.638 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.647+0000 7f1bfd800640 1 Processor -- start 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.647+0000 7f1bfd800640 1 -- start start 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.647+0000 7f1bfd800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8101860 0x7f1bf81970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.647+0000 7f1bfd800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bf8102a50 0x7f1bf8197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.647+0000 7f1bfd800640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8197bd0 con 0x7f1bf8101860 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bfd800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8197d40 con 0x7f1bf8102a50 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bf6a00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8101860 0x7f1bf81970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bf6a00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8101860 0x7f1bf81970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45422/0 (socket says 172.21.15.23:45422) 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bf6a00640 1 -- 172.21.15.23:0/1924373625 learned_addr learned my addr 172.21.15.23:0/1924373625 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bf6a00640 1 -- 172.21.15.23:0/1924373625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bf8102a50 msgr2=0x7f1bf8197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bf6a00640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bf8102a50 0x7f1bf8197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bf6a00640 1 -- 172.21.15.23:0/1924373625 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0009560 con 0x7f1bf8101860 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.648+0000 7f1bf6a00640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8101860 0x7f1bf81970c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1be800c8f0 tx=0x7f1be800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.649+0000 7f1bef400640 1 -- 172.21.15.23:0/1924373625 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1be8007b80 con 0x7f1bf8101860 2024-02-28T16:20:44.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.649+0000 7f1bef400640 1 -- 172.21.15.23:0/1924373625 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1be8007ce0 con 0x7f1bf8101860 2024-02-28T16:20:44.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.649+0000 7f1bef400640 1 -- 172.21.15.23:0/1924373625 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1be80187d0 con 0x7f1bf8101860 2024-02-28T16:20:44.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.649+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf819c7d0 con 0x7f1bf8101860 2024-02-28T16:20:44.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.649+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf819cd30 con 0x7f1bf8101860 2024-02-28T16:20:44.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.650+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf810a580 con 0x7f1bf8101860 2024-02-28T16:20:44.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.651+0000 7f1bef400640 1 -- 172.21.15.23:0/1924373625 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1be8018930 con 0x7f1bf8101860 2024-02-28T16:20:44.642 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.652+0000 7f1bef400640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1bdc06c6b0 0x7f1bdc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:44.642 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.652+0000 7f1bef400640 1 -- 172.21.15.23:0/1924373625 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1be808b980 con 0x7f1bf8101860 2024-02-28T16:20:44.642 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.652+0000 7f1befe00640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1bdc06c6b0 0x7f1bdc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:44.643 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.653+0000 7f1befe00640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1bdc06c6b0 0x7f1bdc06eb60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1be002efd0 tx=0x7f1be0000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:44.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:44 smithi153 ceph-mon[35341]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-02-28T16:20:44.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.657+0000 7f1bef400640 1 -- 172.21.15.23:0/1924373625 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1be8056080 con 0x7f1bf8101860 2024-02-28T16:20:44.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.867+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bf819d000 con 0x7f1bf8101860 2024-02-28T16:20:44.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.869+0000 7f1bef400640 1 -- 172.21.15.23:0/1924373625 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15103 (secure 0 0 0) 0x7f1be80596a0 con 0x7f1bf8101860 2024-02-28T16:20:44.860 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:44.860 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":47,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","created":"2024-02-28T16:11:11.971217+0000","modified":"2024-02-28T16:20:27.240723+0000","last_up_change":"2024-02-28T16:18:35.188913+0000","last_in_change":"2024-02-28T16:18:11.748474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:16:55.847665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:20:07.748175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:20:08.353450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1936c40d-0a71-495b-af57-ea0cb7224068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6803","nonce":4264284372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6805","nonce":4264284372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6809","nonce":4264284372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":4264284372},{"type":"v1","addr":"172.21.15.23:6807","nonce":4264284372}]},"public_addr":"172.21.15.23:6803/4264284372","cluster_addr":"172.21.15.23:6805/4264284372","heartbeat_back_addr":"172.21.15.23:6809/4264284372","heartbeat_front_addr":"172.21.15.23:6807/4264284372","state":["exists","up"]},{"osd":1,"uuid":"f2211134-0ddf-4faf-8fda-41ff13201231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6811","nonce":329835342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6813","nonce":329835342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6817","nonce":329835342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":329835342},{"type":"v1","addr":"172.21.15.23:6815","nonce":329835342}]},"public_addr":"172.21.15.23:6811/329835342","cluster_addr":"172.21.15.23:6813/329835342","heartbeat_back_addr":"172.21.15.23:6817/329835342","heartbeat_front_addr":"172.21.15.23:6815/329835342","state":["exists","up"]},{"osd":2,"uuid":"513a900d-c438-4f9a-ad29-c667f5335070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6819","nonce":1429476012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6821","nonce":1429476012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6825","nonce":1429476012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":1429476012},{"type":"v1","addr":"172.21.15.23:6823","nonce":1429476012}]},"public_addr":"172.21.15.23:6819/1429476012","cluster_addr":"172.21.15.23:6821/1429476012","heartbeat_back_addr":"172.21.15.23:6825/1429476012","heartbeat_front_addr":"172.21.15.23:6823/1429476012","state":["exists","up"]},{"osd":3,"uuid":"0b9875a7-8961-49db-bee2-40980eeec169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6801","nonce":2582260620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6803","nonce":2582260620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6807","nonce":2582260620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2582260620},{"type":"v1","addr":"172.21.15.153:6805","nonce":2582260620}]},"public_addr":"172.21.15.153:6801/2582260620","cluster_addr":"172.21.15.153:6803/2582260620","heartbeat_back_addr":"172.21.15.153:6807/2582260620","heartbeat_front_addr":"172.21.15.153:6805/2582260620","state":["exists","up"]},{"osd":4,"uuid":"3266acd3-21ec-4c65-bb5d-48d82334bf09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6809","nonce":559262574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6811","nonce":559262574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6815","nonce":559262574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":559262574},{"type":"v1","addr":"172.21.15.153:6813","nonce":559262574}]},"public_addr":"172.21.15.153:6809/559262574","cluster_addr":"172.21.15.153:6811/559262574","heartbeat_back_addr":"172.21.15.153:6815/559262574","heartbeat_front_addr":"172.21.15.153:6813/559262574","state":["exists","up"]},{"osd":5,"uuid":"82e08ef8-51d2-494b-b140-ac7bd2c5a320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6817","nonce":625161245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6819","nonce":625161245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6823","nonce":625161245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":625161245},{"type":"v1","addr":"172.21.15.153:6821","nonce":625161245}]},"public_addr":"172.21.15.153:6817/625161245","cluster_addr":"172.21.15.153:6819/625161245","heartbeat_back_addr":"172.21.15.153:6823/625161245","heartbeat_front_addr":"172.21.15.153:6821/625161245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:15:36.785669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:13.722392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:51.886029+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:25.675647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:59.836960+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:34.102730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.23:6801/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/488139137":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/222399421":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/2569614083":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/2047089350":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/287772389":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/3255579829":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/4127609829":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6801/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6827/1762270035":"2024-02-29T16:20:27.240686+0000","172.21.15.23:6800/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6801/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/1357875446":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/3191093495":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6826/1762270035":"2024-02-29T16:20:27.240686+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:20:44.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1bdc06c6b0 msgr2=0x7f1bdc06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:44.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1bdc06c6b0 0x7f1bdc06eb60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1be002efd0 tx=0x7f1be0000bc0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8101860 msgr2=0x7f1bf81970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:44.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8101860 0x7f1bf81970c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1be800c8f0 tx=0x7f1be800cdb0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 shutdown_connections 2024-02-28T16:20:44.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f1bdc06c6b0 0x7f1bdc06eb60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bf8102a50 0x7f1bf8197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 --2- 172.21.15.23:0/1924373625 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1bf8101860 0x7f1bf81970c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:44.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 >> 172.21.15.23:0/1924373625 conn(0x7f1bf80fce10 msgr2=0x7f1bf8105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:44.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 shutdown_connections 2024-02-28T16:20:44.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:44.872+0000 7f1bfd800640 1 -- 172.21.15.23:0/1924373625 wait complete. 2024-02-28T16:20:44.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:16:55.847665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:20:07.748175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:20:08.353450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:20:44.884 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.115+0000 7fa7b3000640 1 -- 172.21.15.23:0/626511431 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 msgr2=0x7fa7ac0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.115+0000 7fa7b3000640 1 --2- 172.21.15.23:0/626511431 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac0730a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa798009880 tx=0x7fa79802bce0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.115+0000 7fa7b3000640 1 -- 172.21.15.23:0/626511431 shutdown_connections 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.115+0000 7fa7b3000640 1 --2- 172.21.15.23:0/626511431 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac0730a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.115+0000 7fa7b3000640 1 --2- 172.21.15.23:0/626511431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7ac074200 0x7fa7ac0726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.115+0000 7fa7b3000640 1 -- 172.21.15.23:0/626511431 >> 172.21.15.23:0/626511431 conn(0x7fa7ac0faab0 msgr2=0x7fa7ac0fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.116+0000 7fa7b3000640 1 -- 172.21.15.23:0/626511431 shutdown_connections 2024-02-28T16:20:45.106 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.116+0000 7fa7b3000640 1 -- 172.21.15.23:0/626511431 wait complete. 2024-02-28T16:20:45.108 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b3000640 1 Processor -- start 2024-02-28T16:20:45.108 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b3000640 1 -- start start 2024-02-28T16:20:45.108 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b3000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.108 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7ac074200 0x7fa7ac1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b3000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac197ac0 con 0x7fa7ac072c30 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac197c30 con 0x7fa7ac074200 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b1c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b1c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45442/0 (socket says 172.21.15.23:45442) 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.117+0000 7fa7b1c00640 1 -- 172.21.15.23:0/3033987164 learned_addr learned my addr 172.21.15.23:0/3033987164 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7b1200640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7ac074200 0x7fa7ac1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7b1c00640 1 -- 172.21.15.23:0/3033987164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7ac074200 msgr2=0x7fa7ac1974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7b1c00640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7ac074200 0x7fa7ac1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7b1c00640 1 -- 172.21.15.23:0/3033987164 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009560 con 0x7fa7ac072c30 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7b1c00640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac196fb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000d8d0 tx=0x7fa7a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7aa000640 1 -- 172.21.15.23:0/3033987164 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a0009a30 con 0x7fa7ac072c30 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7aa000640 1 -- 172.21.15.23:0/3033987164 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa7a0009b90 con 0x7fa7ac072c30 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac19c6c0 con 0x7fa7ac072c30 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7aa000640 1 -- 172.21.15.23:0/3033987164 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a000f680 con 0x7fa7ac072c30 2024-02-28T16:20:45.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.118+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac19cc20 con 0x7fa7ac072c30 2024-02-28T16:20:45.110 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.120+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac10a340 con 0x7fa7ac072c30 2024-02-28T16:20:45.110 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.120+0000 7fa7aa000640 1 -- 172.21.15.23:0/3033987164 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa7a0009d00 con 0x7fa7ac072c30 2024-02-28T16:20:45.111 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.121+0000 7fa7aa000640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa79406c5f0 0x7fa79406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.111 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.122+0000 7fa7aa000640 1 -- 172.21.15.23:0/3033987164 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa7a008b680 con 0x7fa7ac072c30 2024-02-28T16:20:45.111 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.122+0000 7fa7b1200640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa79406c5f0 0x7fa79406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.122+0000 7fa7b1200640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa79406c5f0 0x7fa79406eaa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa798036040 tx=0x7fa79802cf90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.126+0000 7fa7aa000640 1 -- 172.21.15.23:0/3033987164 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa7a0055d80 con 0x7fa7ac072c30 2024-02-28T16:20:45.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.324+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7ac19ce90 con 0x7fa7ac072c30 2024-02-28T16:20:45.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.325+0000 7fa7aa000640 1 -- 172.21.15.23:0/3033987164 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7a00593a0 con 0x7fa7ac072c30 2024-02-28T16:20:45.315 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 1 2024-02-28T16:20:45.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa79406c5f0 msgr2=0x7fa79406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa79406c5f0 0x7fa79406eaa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa798036040 tx=0x7fa79802cf90 comp rx=0 tx=0).stop 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 msgr2=0x7fa7ac196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac196fb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000d8d0 tx=0x7fa7a000dd90 comp rx=0 tx=0).stop 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 shutdown_connections 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fa79406c5f0 0x7fa79406eaa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7ac074200 0x7fa7ac1974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 --2- 172.21.15.23:0/3033987164 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa7ac072c30 0x7fa7ac196fb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.327+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 >> 172.21.15.23:0/3033987164 conn(0x7fa7ac0faab0 msgr2=0x7fa7ac1052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.328+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 shutdown_connections 2024-02-28T16:20:45.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.328+0000 7fa7b3000640 1 -- 172.21.15.23:0/3033987164 wait complete. 2024-02-28T16:20:45.337 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:20:45.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 -- 172.21.15.23:0/1033039837 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f86680fdeb0 msgr2=0x7f86681002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 --2- 172.21.15.23:0/1033039837 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f86680fdeb0 0x7f86681002d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8658009880 tx=0x7f865802bce0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 -- 172.21.15.23:0/1033039837 shutdown_connections 2024-02-28T16:20:45.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 --2- 172.21.15.23:0/1033039837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8668100810 0x7f8668102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 --2- 172.21.15.23:0/1033039837 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f86680fdeb0 0x7f86681002d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 -- 172.21.15.23:0/1033039837 >> 172.21.15.23:0/1033039837 conn(0x7f86680f9aa0 msgr2=0x7f86680fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:45.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 -- 172.21.15.23:0/1033039837 shutdown_connections 2024-02-28T16:20:45.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.550+0000 7f866ec00640 1 -- 172.21.15.23:0/1033039837 wait complete. 2024-02-28T16:20:45.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.552+0000 7f866ec00640 1 Processor -- start 2024-02-28T16:20:45.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.552+0000 7f866ec00640 1 -- start start 2024-02-28T16:20:45.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.552+0000 7f866ec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86680fdeb0 0x7f866819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.552+0000 7f866ec00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8668100810 0x7f866819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.552+0000 7f866ec00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866819c050 con 0x7f8668100810 2024-02-28T16:20:45.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.552+0000 7f866ec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866819c1c0 con 0x7f86680fdeb0 2024-02-28T16:20:45.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.553+0000 7f8667e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86680fdeb0 0x7f866819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.553+0000 7f8667400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8668100810 0x7f866819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.553+0000 7f8667e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86680fdeb0 0x7f866819b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:44002/0 (socket says 172.21.15.23:44002) 2024-02-28T16:20:45.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.553+0000 7f8667e00640 1 -- 172.21.15.23:0/1261544334 learned_addr learned my addr 172.21.15.23:0/1261544334 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:45.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.553+0000 7f8667400640 1 -- 172.21.15.23:0/1261544334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86680fdeb0 msgr2=0x7f866819b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.553+0000 7f8667400640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86680fdeb0 0x7f866819b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.553+0000 7f8667400640 1 -- 172.21.15.23:0/1261544334 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009560 con 0x7f8668100810 2024-02-28T16:20:45.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.554+0000 7f8667400640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8668100810 0x7f866819ba80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f865400d6d0 tx=0x7f865400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.554+0000 7f8664c00640 1 -- 172.21.15.23:0/1261544334 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86540051f0 con 0x7f8668100810 2024-02-28T16:20:45.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.554+0000 7f8664c00640 1 -- 172.21.15.23:0/1261544334 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8654004c50 con 0x7f8668100810 2024-02-28T16:20:45.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.554+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86681a0c50 con 0x7f8668100810 2024-02-28T16:20:45.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.554+0000 7f8664c00640 1 -- 172.21.15.23:0/1261544334 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8654009d30 con 0x7f8668100810 2024-02-28T16:20:45.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.554+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86681a11b0 con 0x7f8668100810 2024-02-28T16:20:45.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.556+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8668195630 con 0x7f8668100810 2024-02-28T16:20:45.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.557+0000 7f8664c00640 1 -- 172.21.15.23:0/1261544334 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f86540047a0 con 0x7f8668100810 2024-02-28T16:20:45.547 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.558+0000 7f8664c00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f864c06c5f0 0x7f864c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.547 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.558+0000 7f8664c00640 1 -- 172.21.15.23:0/1261544334 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f865408b490 con 0x7f8668100810 2024-02-28T16:20:45.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.558+0000 7f8667e00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f864c06c5f0 0x7f864c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.559+0000 7f8667e00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f864c06c5f0 0x7f864c06eaa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f865802c7c0 tx=0x7f86580058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.566+0000 7f8664c00640 1 -- 172.21.15.23:0/1261544334 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8654055bc0 con 0x7f8668100810 2024-02-28T16:20:45.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:45 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1924373625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:20:45.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:45 smithi023 ceph-mon[29137]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T16:20:45.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:45 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3033987164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:20:45.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.760+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f866802c520 con 0x7f8668100810 2024-02-28T16:20:45.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.761+0000 7f8664c00640 1 -- 172.21.15.23:0/1261544334 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f86540591e0 con 0x7f8668100810 2024-02-28T16:20:45.751 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.763+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f864c06c5f0 msgr2=0x7f864c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.763+0000 7f866ec00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f864c06c5f0 0x7f864c06eaa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f865802c7c0 tx=0x7f86580058d0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8668100810 msgr2=0x7f866819ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8668100810 0x7f866819ba80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f865400d6d0 tx=0x7f865400db90 comp rx=0 tx=0).stop 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 shutdown_connections 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f864c06c5f0 0x7f864c06eaa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8668100810 0x7f866819ba80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 --2- 172.21.15.23:0/1261544334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86680fdeb0 0x7f866819b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 >> 172.21.15.23:0/1261544334 conn(0x7f86680f9aa0 msgr2=0x7f86680fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:45.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 shutdown_connections 2024-02-28T16:20:45.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.764+0000 7f866ec00640 1 -- 172.21.15.23:0/1261544334 wait complete. 2024-02-28T16:20:45.774 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:20:45.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:45 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1924373625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:20:45.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:45 smithi153 ceph-mon[35341]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T16:20:45.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:45 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3033987164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:20:45.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.981+0000 7f3190000640 1 -- 172.21.15.23:0/2924862860 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 msgr2=0x7f3188101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.981+0000 7f3190000640 1 --2- 172.21.15.23:0/2924862860 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f3188101c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f317c009880 tx=0x7f317c02bce0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.982+0000 7f3190000640 1 -- 172.21.15.23:0/2924862860 shutdown_connections 2024-02-28T16:20:45.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.982+0000 7f3190000640 1 --2- 172.21.15.23:0/2924862860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3188102a60 0x7f3188102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.982+0000 7f3190000640 1 --2- 172.21.15.23:0/2924862860 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f3188101c80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.982+0000 7f3190000640 1 -- 172.21.15.23:0/2924862860 >> 172.21.15.23:0/2924862860 conn(0x7f31880fce10 msgr2=0x7f31880ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:45.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.982+0000 7f3190000640 1 -- 172.21.15.23:0/2924862860 shutdown_connections 2024-02-28T16:20:45.973 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.982+0000 7f3190000640 1 -- 172.21.15.23:0/2924862860 wait complete. 2024-02-28T16:20:45.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.983+0000 7f3190000640 1 Processor -- start 2024-02-28T16:20:45.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.983+0000 7f3190000640 1 -- start start 2024-02-28T16:20:45.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.983+0000 7f3190000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f31881971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.983+0000 7f3190000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3188102a60 0x7f3188197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.983+0000 7f3190000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3188197ce0 con 0x7f3188101870 2024-02-28T16:20:45.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.983+0000 7f3190000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3188197e50 con 0x7f3188102a60 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.984+0000 7f318d600640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f31881971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.984+0000 7f318d600640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f31881971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45466/0 (socket says 172.21.15.23:45466) 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.984+0000 7f318d600640 1 -- 172.21.15.23:0/323267461 learned_addr learned my addr 172.21.15.23:0/323267461 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.984+0000 7f318cc00640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3188102a60 0x7f3188197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.984+0000 7f318d600640 1 -- 172.21.15.23:0/323267461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3188102a60 msgr2=0x7f3188197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.984+0000 7f318d600640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3188102a60 0x7f3188197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.984+0000 7f318d600640 1 -- 172.21.15.23:0/323267461 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c009560 con 0x7f3188101870 2024-02-28T16:20:45.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.985+0000 7f318d600640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f31881971d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f317c02c220 tx=0x7f317c02c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.985+0000 7f3186000640 1 -- 172.21.15.23:0/323267461 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c004420 con 0x7f3188101870 2024-02-28T16:20:45.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.985+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318819c880 con 0x7f3188101870 2024-02-28T16:20:45.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.985+0000 7f3186000640 1 -- 172.21.15.23:0/323267461 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f317c0054b0 con 0x7f3188101870 2024-02-28T16:20:45.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.985+0000 7f3186000640 1 -- 172.21.15.23:0/323267461 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c034440 con 0x7f3188101870 2024-02-28T16:20:45.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.985+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318819cd80 con 0x7f3188101870 2024-02-28T16:20:45.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.986+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318810a5a0 con 0x7f3188101870 2024-02-28T16:20:45.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.987+0000 7f3186000640 1 -- 172.21.15.23:0/323267461 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f317c003880 con 0x7f3188101870 2024-02-28T16:20:45.978 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.988+0000 7f3186000640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f317006c5f0 0x7f317006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.978 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.989+0000 7f3186000640 1 -- 172.21.15.23:0/323267461 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f317c0ade00 con 0x7f3188101870 2024-02-28T16:20:45.978 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.989+0000 7f318cc00640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f317006c5f0 0x7f317006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.989+0000 7f318cc00640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f317006c5f0 0x7f317006eaa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f31881986e0 tx=0x7f3174005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.984 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:45.994+0000 7f3186000640 1 -- 172.21.15.23:0/323267461 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f317c0783e0 con 0x7f3188101870 2024-02-28T16:20:46.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.192+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f318819d4c0 con 0x7f3188101870 2024-02-28T16:20:46.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.193+0000 7f3186000640 1 -- 172.21.15.23:0/323267461 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f317c04b020 con 0x7f3188101870 2024-02-28T16:20:46.183 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:20:46.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f317006c5f0 msgr2=0x7f317006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f317006c5f0 0x7f317006eaa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f31881986e0 tx=0x7f3174005f90 comp rx=0 tx=0).stop 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 msgr2=0x7f31881971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f31881971d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f317c02c220 tx=0x7f317c02c750 comp rx=0 tx=0).stop 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 shutdown_connections 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f317006c5f0 0x7f317006eaa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3188102a60 0x7f3188197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 --2- 172.21.15.23:0/323267461 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3188101870 0x7f31881971d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.195+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 >> 172.21.15.23:0/323267461 conn(0x7f31880fce10 msgr2=0x7f3188105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.196+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 shutdown_connections 2024-02-28T16:20:46.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.196+0000 7f3190000640 1 -- 172.21.15.23:0/323267461 wait complete. 2024-02-28T16:20:46.204 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.425+0000 7f2f64000640 1 -- 172.21.15.23:0/943144023 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 msgr2=0x7f2f5c104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.425+0000 7f2f64000640 1 --2- 172.21.15.23:0/943144023 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c104e90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009880 tx=0x7f2f4802bce0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.425+0000 7f2f64000640 1 -- 172.21.15.23:0/943144023 shutdown_connections 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.425+0000 7f2f64000640 1 --2- 172.21.15.23:0/943144023 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c104e90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.425+0000 7f2f64000640 1 --2- 172.21.15.23:0/943144023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f5c100190 0x7f2f5c102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.425+0000 7f2f64000640 1 -- 172.21.15.23:0/943144023 >> 172.21.15.23:0/943144023 conn(0x7f2f5c0f9af0 msgr2=0x7f2f5c0fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.425+0000 7f2f64000640 1 -- 172.21.15.23:0/943144023 shutdown_connections 2024-02-28T16:20:46.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.426+0000 7f2f64000640 1 -- 172.21.15.23:0/943144023 wait complete. 2024-02-28T16:20:46.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.426+0000 7f2f64000640 1 Processor -- start 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f64000640 1 -- start start 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f64000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f5c100190 0x7f2f5c197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f64000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f64000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c197c50 con 0x7f2f5c102ab0 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f64000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c197dc0 con 0x7f2f5c100190 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f60c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f60c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45480/0 (socket says 172.21.15.23:45480) 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.427+0000 7f2f60c00640 1 -- 172.21.15.23:0/1711029759 learned_addr learned my addr 172.21.15.23:0/1711029759 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.428+0000 7f2f61600640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f5c100190 0x7f2f5c197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.428+0000 7f2f60c00640 1 -- 172.21.15.23:0/1711029759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f5c100190 msgr2=0x7f2f5c197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.428+0000 7f2f60c00640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f5c100190 0x7f2f5c197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.428+0000 7f2f60c00640 1 -- 172.21.15.23:0/1711029759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48009560 con 0x7f2f5c102ab0 2024-02-28T16:20:46.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.428+0000 7f2f60c00640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c197680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802c220 tx=0x7f2f48004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:46.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.429+0000 7f2f5a000640 1 -- 172.21.15.23:0/1711029759 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f48005000 con 0x7f2f5c102ab0 2024-02-28T16:20:46.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.429+0000 7f2f5a000640 1 -- 172.21.15.23:0/1711029759 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f48005610 con 0x7f2f5c102ab0 2024-02-28T16:20:46.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.429+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c19c7f0 con 0x7f2f5c102ab0 2024-02-28T16:20:46.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.429+0000 7f2f5a000640 1 -- 172.21.15.23:0/1711029759 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f4803e680 con 0x7f2f5c102ab0 2024-02-28T16:20:46.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.429+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c19cdd0 con 0x7f2f5c102ab0 2024-02-28T16:20:46.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.430+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c0fb5d0 con 0x7f2f5c102ab0 2024-02-28T16:20:46.421 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.431+0000 7f2f5a000640 1 -- 172.21.15.23:0/1711029759 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2f480035f0 con 0x7f2f5c102ab0 2024-02-28T16:20:46.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.433+0000 7f2f5a000640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2f4406c6b0 0x7f2f4406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:46.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.433+0000 7f2f5a000640 1 -- 172.21.15.23:0/1711029759 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2f480ae700 con 0x7f2f5c102ab0 2024-02-28T16:20:46.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.433+0000 7f2f61600640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2f4406c6b0 0x7f2f4406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:46.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.434+0000 7f2f61600640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2f4406c6b0 0x7f2f4406eb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009890 tx=0x7f2f50008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:46.429 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.440+0000 7f2f5a000640 1 -- 172.21.15.23:0/1711029759 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2f48078d80 con 0x7f2f5c102ab0 2024-02-28T16:20:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:46 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1261544334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:20:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:46 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/323267461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:20:46.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.743+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f5c108370 con 0x7f2f5c102ab0 2024-02-28T16:20:46.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.744+0000 7f2f5a000640 1 -- 172.21.15.23:0/1711029759 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f2f4807c3a0 con 0x7f2f5c102ab0 2024-02-28T16:20:46.734 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:20:46.734 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2195483511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2195483511},{"type":"v1","addr":"172.21.15.23:6827","nonce":2195483511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:20:30.265323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi023.klbbrl","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.23:6829/869339807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":869339807},{"type":"v1","addr":"172.21.15.23:6829","nonce":869339807}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:20:46.734 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:20:46.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2f4406c6b0 msgr2=0x7f2f4406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:46.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2f4406c6b0 0x7f2f4406eb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009890 tx=0x7f2f50008040 comp rx=0 tx=0).stop 2024-02-28T16:20:46.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 msgr2=0x7f2f5c197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:46.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c197680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802c220 tx=0x7f2f48004f00 comp rx=0 tx=0).stop 2024-02-28T16:20:46.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 shutdown_connections 2024-02-28T16:20:46.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2f4406c6b0 0x7f2f4406eb60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2f5c102ab0 0x7f2f5c197680 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 --2- 172.21.15.23:0/1711029759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f5c100190 0x7f2f5c197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:46.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 >> 172.21.15.23:0/1711029759 conn(0x7f2f5c0f9af0 msgr2=0x7f2f5c0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:46.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 shutdown_connections 2024-02-28T16:20:46.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:46.748+0000 7f2f64000640 1 -- 172.21.15.23:0/1711029759 wait complete. 2024-02-28T16:20:46.760 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-02-28T16:20:46.760 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-28T16:20:46.789 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-28T16:20:46.789 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-02-28T16:20:46.790 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-28T16:20:46.790 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T16:20:46.790 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T16:20:46.790 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-28T16:20:46.790 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T16:20:46.790 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T16:20:46.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:46.790 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-02-28T16:20:46.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:46.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-02-28T16:20:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:46 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1261544334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:20:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:46 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/323267461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:20:46.952 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-02-28T16:20:46.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:20:46.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:46.957 DEBUG:teuthology.orchestra.run.smithi023:> ip netns list 2024-02-28T16:20:47.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:47.003 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip link delete ceph-brx 2024-02-28T16:20:47.142 INFO:teuthology.orchestra.run.smithi023.stderr:Cannot find device "ceph-brx" 2024-02-28T16:20:47.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:20:47.146 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-28T16:20:47.147 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T16:20:47.556 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:47.703 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:47 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1711029759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:20:47.703 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:47.703 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:47 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:47.703 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:47 smithi023 ceph-mon[29137]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-28T16:20:47.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:47 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1711029759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:20:47.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:47.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:47 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:47.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:47 smithi153 ceph-mon[35341]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-28T16:20:48.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:48.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:48.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:48 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:49.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:49.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:49.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:48 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 -- 172.21.15.23:0/858606835 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea8102f50 msgr2=0x7fbea8106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 --2- 172.21.15.23:0/858606835 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea8102f50 0x7fbea8106f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009910 tx=0x7fbe94009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 -- 172.21.15.23:0/858606835 shutdown_connections 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 --2- 172.21.15.23:0/858606835 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea8102f50 0x7fbea8106f20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 --2- 172.21.15.23:0/858606835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea81025b0 0x7fbea8102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 -- 172.21.15.23:0/858606835 >> 172.21.15.23:0/858606835 conn(0x7fbea80fde50 msgr2=0x7fbea8100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 -- 172.21.15.23:0/858606835 shutdown_connections 2024-02-28T16:20:49.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.800+0000 7fbeb0400700 1 -- 172.21.15.23:0/858606835 wait complete. 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.801+0000 7fbeb0400700 1 Processor -- start 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeb0400700 1 -- start start 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeb0400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea81025b0 0x7fbea8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeb0400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea8102f50 0x7fbea81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeb0400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8198b80 con 0x7fbea81025b0 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeb0400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea819c910 con 0x7fbea8102f50 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeada00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea81025b0 0x7fbea8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeada00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea81025b0 0x7fbea8197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39236/0 (socket says 172.21.15.23:39236) 2024-02-28T16:20:49.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.802+0000 7fbeada00700 1 -- 172.21.15.23:0/2001920262 learned_addr learned my addr 172.21.15.23:0/2001920262 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:49.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbeada00700 1 -- 172.21.15.23:0/2001920262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea8102f50 msgr2=0x7fbea81984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:49.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbead000700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea8102f50 0x7fbea81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:49.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbeada00700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea8102f50 0x7fbea81984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbeada00700 1 -- 172.21.15.23:0/2001920262 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940095f0 con 0x7fbea81025b0 2024-02-28T16:20:49.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbeada00700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea81025b0 0x7fbea8197f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0060b0 tx=0x7fbe9c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:49.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbea6000700 1 -- 172.21.15.23:0/2001920262 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9c00dda0 con 0x7fbea81025b0 2024-02-28T16:20:49.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbea6000700 1 -- 172.21.15.23:0/2001920262 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbe9c00f040 con 0x7fbea81025b0 2024-02-28T16:20:49.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea819cbf0 con 0x7fbea81025b0 2024-02-28T16:20:49.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.803+0000 7fbea6000700 1 -- 172.21.15.23:0/2001920262 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9c014790 con 0x7fbea81025b0 2024-02-28T16:20:49.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.804+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea819d140 con 0x7fbea81025b0 2024-02-28T16:20:49.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.805+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea804f2a0 con 0x7fbea81025b0 2024-02-28T16:20:49.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.806+0000 7fbea6000700 1 -- 172.21.15.23:0/2001920262 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbe9c0148f0 con 0x7fbea81025b0 2024-02-28T16:20:49.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.806+0000 7fbea6000700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe9006c680 0x7fbe9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:49.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.807+0000 7fbea6000700 1 -- 172.21.15.23:0/2001920262 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbe9c08b2f0 con 0x7fbea81025b0 2024-02-28T16:20:49.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.807+0000 7fbead000700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe9006c680 0x7fbe9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:49.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.807+0000 7fbead000700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe9006c680 0x7fbe9006eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe94006010 tx=0x7fbe9400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:49.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:49.811+0000 7fbea6000700 1 -- 172.21.15.23:0/2001920262 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbe9c04f720 con 0x7fbea81025b0 2024-02-28T16:20:49.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:49 smithi023 ceph-mon[29137]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:50.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.092+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbea819d550 con 0x7fbea81025b0 2024-02-28T16:20:50.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.093+0000 7fbea6000700 1 -- 172.21.15.23:0/2001920262 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7fbe9c055aa0 con 0x7fbea81025b0 2024-02-28T16:20:50.084 INFO:teuthology.orchestra.run.smithi023.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe9006c680 msgr2=0x7fbe9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe9006c680 0x7fbe9006eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe94006010 tx=0x7fbe9400b540 comp rx=0 tx=0).stop 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea81025b0 msgr2=0x7fbea8197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea81025b0 0x7fbea8197f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0060b0 tx=0x7fbe9c00d3b0 comp rx=0 tx=0).stop 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 shutdown_connections 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe9006c680 0x7fbe9006eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbea81025b0 0x7fbea8197f60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:50.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 --2- 172.21.15.23:0/2001920262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbea8102f50 0x7fbea81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:50.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.096+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 >> 172.21.15.23:0/2001920262 conn(0x7fbea80fde50 msgr2=0x7fbea80ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:50.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.097+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 shutdown_connections 2024-02-28T16:20:50.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:50.097+0000 7fbeb0400700 1 -- 172.21.15.23:0/2001920262 wait complete. 2024-02-28T16:20:50.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:49 smithi153 ceph-mon[35341]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi023.front.sepia.ceph.com 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T16:20:50.789 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-28T16:20:50.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:50.790 DEBUG:teuthology.orchestra.run.smithi023:> ip addr 2024-02-28T16:20:50.850 INFO:teuthology.orchestra.run.smithi023.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T16:20:50.850 INFO:teuthology.orchestra.run.smithi023.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T16:20:50.850 INFO:teuthology.orchestra.run.smithi023.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T16:20:50.850 INFO:teuthology.orchestra.run.smithi023.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:20:50.850 INFO:teuthology.orchestra.run.smithi023.stdout: inet6 ::1/128 scope host 2024-02-28T16:20:50.850 INFO:teuthology.orchestra.run.smithi023.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:20:50.850 INFO:teuthology.orchestra.run.smithi023.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: link/ether 0c:c4:7a:6b:fd:ae brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: altname enp7s0f0 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: link/ether 0c:c4:7a:6b:fd:af brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: altname enp7s0f1 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: link/ether 0c:c4:7a:59:ce:42 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: altname enp1s0f0 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: inet 172.21.15.23/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: valid_lft 41726sec preferred_lft 41726sec 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: inet6 fe80::ec4:7aff:fe59:ce42/64 scope link noprefixroute 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: link/ether 0c:c4:7a:59:ce:43 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:50.851 INFO:teuthology.orchestra.run.smithi023.stdout: altname enp1s0f1 2024-02-28T16:20:50.853 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T16:20:50.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:50.853 DEBUG:teuthology.orchestra.run.smithi023:> (cd / && exec bash -c ' 2024-02-28T16:20:50.853 DEBUG:teuthology.orchestra.run.smithi023:> set -e 2024-02-28T16:20:50.853 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip link add name ceph-brx type bridge 2024-02-28T16:20:50.853 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip addr flush dev ceph-brx 2024-02-28T16:20:50.853 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip link set ceph-brx up 2024-02-28T16:20:50.853 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T16:20:50.853 DEBUG:teuthology.orchestra.run.smithi023:> ') 2024-02-28T16:20:51.007 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:50 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2001920262' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:20:51.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:50 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2001920262' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:20:51.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:51.322 DEBUG:teuthology.orchestra.run.smithi023:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T16:20:51.404 INFO:teuthology.orchestra.run.smithi023.stdout:1 2024-02-28T16:20:51.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:51.407 DEBUG:teuthology.orchestra.run.smithi023:> route 2024-02-28T16:20:51.464 INFO:teuthology.orchestra.run.smithi023.stdout:Kernel IP routing table 2024-02-28T16:20:51.464 INFO:teuthology.orchestra.run.smithi023.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T16:20:51.465 INFO:teuthology.orchestra.run.smithi023.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-28T16:20:51.465 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-28T16:20:51.465 INFO:teuthology.orchestra.run.smithi023.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T16:20:51.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:51.465 DEBUG:teuthology.orchestra.run.smithi023:> (cd / && exec bash -c ' 2024-02-28T16:20:51.465 DEBUG:teuthology.orchestra.run.smithi023:> set -e 2024-02-28T16:20:51.465 DEBUG:teuthology.orchestra.run.smithi023:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-28T16:20:51.465 DEBUG:teuthology.orchestra.run.smithi023:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-28T16:20:51.466 DEBUG:teuthology.orchestra.run.smithi023:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-28T16:20:51.466 DEBUG:teuthology.orchestra.run.smithi023:> ') 2024-02-28T16:20:52.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:51 smithi153 ceph-mon[35341]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:52.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:51 smithi023 ceph-mon[29137]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:52.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:52.222 DEBUG:teuthology.orchestra.run.smithi023:> ip netns list 2024-02-28T16:20:52.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:52.279 DEBUG:teuthology.orchestra.run.smithi023:> ip netns list-id 2024-02-28T16:20:52.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:52.332 DEBUG:teuthology.orchestra.run.smithi023:> (cd / && exec bash -c ' 2024-02-28T16:20:52.332 DEBUG:teuthology.orchestra.run.smithi023:> set -e 2024-02-28T16:20:52.332 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:20:52.332 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-28T16:20:52.332 DEBUG:teuthology.orchestra.run.smithi023:> ') 2024-02-28T16:20:52.478 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-28T16:20:52.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:52.478 DEBUG:teuthology.orchestra.run.smithi023:> (cd / && exec bash -c ' 2024-02-28T16:20:52.479 DEBUG:teuthology.orchestra.run.smithi023:> set -e 2024-02-28T16:20:52.479 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-28T16:20:52.479 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T16:20:52.479 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-28T16:20:52.479 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-28T16:20:52.479 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-28T16:20:52.479 DEBUG:teuthology.orchestra.run.smithi023:> ') 2024-02-28T16:20:52.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:52.788 DEBUG:teuthology.orchestra.run.smithi023:> (cd / && exec bash -c ' 2024-02-28T16:20:52.788 DEBUG:teuthology.orchestra.run.smithi023:> set -e 2024-02-28T16:20:52.788 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip link set brx.0 up 2024-02-28T16:20:52.788 DEBUG:teuthology.orchestra.run.smithi023:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T16:20:52.788 DEBUG:teuthology.orchestra.run.smithi023:> ') 2024-02-28T16:20:52.953 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-28T16:20:52.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:20:52.954 DEBUG:teuthology.orchestra.run.smithi023:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-28T16:20:53.009 INFO:teuthology.orchestra.run.smithi023.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-28T16:20:53.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:20:53.009 DEBUG:teuthology.orchestra.run.smithi023:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-28T16:20:53.060 DEBUG:teuthology.orchestra.run.smithi023:> sudo modprobe fuse 2024-02-28T16:20:53.157 DEBUG:teuthology.orchestra.run.smithi023:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:20:53.216 INFO:teuthology.orchestra.run.smithi023.stdout:/proc 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/sys 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/dev 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/security 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/shm 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/pts 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/run 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/cgroup 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/pstore 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/bpf 2024-02-28T16:20:53.217 INFO:teuthology.orchestra.run.smithi023.stdout:/ 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/selinux 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/hugepages 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/mqueue 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/debug 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/tracing 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/fuse/connections 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/config 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:20:53.218 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/run/user/1000 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/ceph 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/4e0b0201e951f4a6b1c2a41204b87d4732850838383ae30f8ff7344172740f1a/merged 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/4efbc2674bf278f44440a877dee6a7b9530f12543a400144fb45784a99e80e27/merged 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/run/user/0 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/3859d6bb561337aabebded9e3e6cd65dc76d4a60afe34bde7038eb0cd513a77c/merged 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/6031d6179e86c1a93fdadd246b550d25e5f43f011c166658cef07ccd3fe66ca2/merged 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/9ed887b004b26a8c4950e18a2444252c3b1dc4749ec21cdc8adefcf7d2b304e0/merged 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/94acbc629db039f9188838a10b2967581b1e0e4a0e3283a67675c4d91418a204/merged 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/3f561f004053afd013b371b3028a825f350c8d522ecf3575cdc9ce1d82e3cc39/merged 2024-02-28T16:20:53.219 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/a4dae78c5945fc664699b53fa0802279ef5fd52dfa6fa0bcb7d9367215df61a2/merged 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/f852116a31be3bd5e7172eea8bb9ce09ab8678267475b942ea0136859eba22cb/merged 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/c6a4260ef3217fe8d58618e5461bf70373e77d57dcc14d87cf5131a4c7bb832e/merged 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/6d0f64325745e83e383997617ca0b6840123dbd52675b456754340f9106516d8/merged 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/386a916706caabf61da5004178801f9416fa4b2bfd0379f8b4f12b9ca84a61bd/merged 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/0e8e1954931b1ff97aed66c64dcf98e76aabaf0018925fcb141c0e12b8be9a6b/merged 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:20:53.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:53.220 DEBUG:teuthology.orchestra.run.smithi023:> ls /sys/fs/fuse/connections 2024-02-28T16:20:53.271 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T16:20:53.271 DEBUG:teuthology.orchestra.run.smithi023:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-28T16:20:53.276 DEBUG:teuthology.orchestra.run.smithi023:> sudo modprobe fuse 2024-02-28T16:20:53.352 DEBUG:teuthology.orchestra.run.smithi023:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/proc 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/sys 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/dev 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/security 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/shm 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/pts 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/run 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/cgroup 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/pstore 2024-02-28T16:20:53.394 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/bpf 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/ 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/selinux 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/hugepages 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/mqueue 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/debug 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/tracing 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/fuse/connections 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/config 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:20:53.395 INFO:teuthology.orchestra.run.smithi023.stdout:/run/user/1000 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/ceph 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/4e0b0201e951f4a6b1c2a41204b87d4732850838383ae30f8ff7344172740f1a/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/4efbc2674bf278f44440a877dee6a7b9530f12543a400144fb45784a99e80e27/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/run/user/0 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/3859d6bb561337aabebded9e3e6cd65dc76d4a60afe34bde7038eb0cd513a77c/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/6031d6179e86c1a93fdadd246b550d25e5f43f011c166658cef07ccd3fe66ca2/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/9ed887b004b26a8c4950e18a2444252c3b1dc4749ec21cdc8adefcf7d2b304e0/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/94acbc629db039f9188838a10b2967581b1e0e4a0e3283a67675c4d91418a204/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/3f561f004053afd013b371b3028a825f350c8d522ecf3575cdc9ce1d82e3cc39/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/a4dae78c5945fc664699b53fa0802279ef5fd52dfa6fa0bcb7d9367215df61a2/merged 2024-02-28T16:20:53.396 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/f852116a31be3bd5e7172eea8bb9ce09ab8678267475b942ea0136859eba22cb/merged 2024-02-28T16:20:53.397 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/c6a4260ef3217fe8d58618e5461bf70373e77d57dcc14d87cf5131a4c7bb832e/merged 2024-02-28T16:20:53.397 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/6d0f64325745e83e383997617ca0b6840123dbd52675b456754340f9106516d8/merged 2024-02-28T16:20:53.397 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/386a916706caabf61da5004178801f9416fa4b2bfd0379f8b4f12b9ca84a61bd/merged 2024-02-28T16:20:53.397 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/0e8e1954931b1ff97aed66c64dcf98e76aabaf0018925fcb141c0e12b8be9a6b/merged 2024-02-28T16:20:53.397 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns 2024-02-28T16:20:53.397 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:20:53.397 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:20:53.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:53.398 DEBUG:teuthology.orchestra.run.smithi023:> ls /sys/fs/fuse/connections 2024-02-28T16:20:53.509 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi023.stderr:2024-02-28T16:20:53.519+0000 7f413820b480 -1 init, newargv = 0x55c114fe3870 newargc=15 2024-02-28T16:20:53.510 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi023.stderr:ceph-fuse[66945]: starting ceph client 2024-02-28T16:20:53.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi023.stderr:ceph-fuse[66945]: starting fuse 2024-02-28T16:20:54.594 DEBUG:teuthology.orchestra.run.smithi023:> sudo modprobe fuse 2024-02-28T16:20:54.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:54 smithi153 ceph-mon[35341]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:54.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:54 smithi023 ceph-mon[29137]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:54.703 DEBUG:teuthology.orchestra.run.smithi023:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/proc 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/sys 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/dev 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/security 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/shm 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/pts 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/run 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/cgroup 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/pstore 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/bpf 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/ 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/selinux 2024-02-28T16:20:54.765 INFO:teuthology.orchestra.run.smithi023.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/hugepages 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/dev/mqueue 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/debug 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/tracing 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/fs/fuse/connections 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/sys/kernel/config 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:20:54.766 INFO:teuthology.orchestra.run.smithi023.stdout:/run/user/1000 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/ceph 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/4e0b0201e951f4a6b1c2a41204b87d4732850838383ae30f8ff7344172740f1a/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/4efbc2674bf278f44440a877dee6a7b9530f12543a400144fb45784a99e80e27/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/run/user/0 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/3859d6bb561337aabebded9e3e6cd65dc76d4a60afe34bde7038eb0cd513a77c/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/6031d6179e86c1a93fdadd246b550d25e5f43f011c166658cef07ccd3fe66ca2/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/9ed887b004b26a8c4950e18a2444252c3b1dc4749ec21cdc8adefcf7d2b304e0/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/94acbc629db039f9188838a10b2967581b1e0e4a0e3283a67675c4d91418a204/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/3f561f004053afd013b371b3028a825f350c8d522ecf3575cdc9ce1d82e3cc39/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/a4dae78c5945fc664699b53fa0802279ef5fd52dfa6fa0bcb7d9367215df61a2/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/f852116a31be3bd5e7172eea8bb9ce09ab8678267475b942ea0136859eba22cb/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/c6a4260ef3217fe8d58618e5461bf70373e77d57dcc14d87cf5131a4c7bb832e/merged 2024-02-28T16:20:54.767 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/6d0f64325745e83e383997617ca0b6840123dbd52675b456754340f9106516d8/merged 2024-02-28T16:20:54.768 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/386a916706caabf61da5004178801f9416fa4b2bfd0379f8b4f12b9ca84a61bd/merged 2024-02-28T16:20:54.768 INFO:teuthology.orchestra.run.smithi023.stdout:/var/lib/containers/storage/overlay/0e8e1954931b1ff97aed66c64dcf98e76aabaf0018925fcb141c0e12b8be9a6b/merged 2024-02-28T16:20:54.768 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns 2024-02-28T16:20:54.768 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:20:54.768 INFO:teuthology.orchestra.run.smithi023.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:20:54.768 INFO:teuthology.orchestra.run.smithi023.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-28T16:20:54.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:54.769 DEBUG:teuthology.orchestra.run.smithi023:> ls /sys/fs/fuse/connections 2024-02-28T16:20:54.825 INFO:teuthology.orchestra.run.smithi023.stdout:158 2024-02-28T16:20:54.826 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [158] 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> sudo stdin-killer -- python3 -c ' 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> import glob 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> import re 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> import os 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> import subprocess 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> def _find_admin_socket(client_name): 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-28T16:20:54.826 DEBUG:teuthology.orchestra.run.smithi023:> files = glob.glob(asok_path) 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> # Given a non-glob path, it better be there 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> if "*" not in asok_path: 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> assert(len(files) == 1) 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> return files[0] 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> for f in files: 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> contents = proc_f.read() 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> if mountpoint in contents: 2024-02-28T16:20:54.827 DEBUG:teuthology.orchestra.run.smithi023:> return f 2024-02-28T16:20:54.828 DEBUG:teuthology.orchestra.run.smithi023:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T16:20:54.828 DEBUG:teuthology.orchestra.run.smithi023:> 2024-02-28T16:20:54.828 DEBUG:teuthology.orchestra.run.smithi023:> print(_find_admin_socket("client.0")) 2024-02-28T16:20:54.828 DEBUG:teuthology.orchestra.run.smithi023:> ' 2024-02-28T16:20:55.018 INFO:teuthology.orchestra.run.smithi023.stdout:/var/run/ceph/ceph-client.0.66945.asok 2024-02-28T16:20:55.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T16:20:55.037 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.66945.asok 2024-02-28T16:20:55.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:55.038 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.66945.asok status 2024-02-28T16:20:55.287 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "metadata": { 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "entity_id": "0", 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "hostname": "smithi023", 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "pid": "66945", 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "root": "/" 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "dentry_count": 0, 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "dentry_pinned_count": 0, 2024-02-28T16:20:55.288 INFO:teuthology.orchestra.run.smithi023.stdout: "id": 14528, 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "inst": { 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "name": { 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "type": "client", 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "num": 14528 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "addr": { 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "type": "v1", 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: "nonce": 3625101817 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:20:55.289 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "addr": { 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "type": "v1", 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "nonce": 3625101817 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "inst_str": "client.14528 192.168.0.1:0/3625101817", 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "addr_str": "192.168.0.1:0/3625101817", 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "inode_count": 1, 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "mds_epoch": 15, 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "osd_epoch": 47, 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "osd_epoch_barrier": 0, 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "blocklisted": false, 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout: "fs_name": "cephfs" 2024-02-28T16:20:55.290 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:20:55.306 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T16:20:55.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:55.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:55 smithi023 ceph-mon[29137]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:55.738 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:20:55.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:55.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:55 smithi153 ceph-mon[35341]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:57.903 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 -- 172.21.15.23:0/3221990540 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 msgr2=0x7f3d40104c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:57.903 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 --2- 172.21.15.23:0/3221990540 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40104c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009910 tx=0x7f3d2c009c20 comp rx=0 tx=0).stop 2024-02-28T16:20:57.903 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 -- 172.21.15.23:0/3221990540 shutdown_connections 2024-02-28T16:20:57.903 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 --2- 172.21.15.23:0/3221990540 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40104c40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:57.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 --2- 172.21.15.23:0/3221990540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d401002d0 0x7f3d401006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:57.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 -- 172.21.15.23:0/3221990540 >> 172.21.15.23:0/3221990540 conn(0x7f3d400fbbb0 msgr2=0x7f3d400fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:57.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 -- 172.21.15.23:0/3221990540 shutdown_connections 2024-02-28T16:20:57.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.912+0000 7f3d46600700 1 -- 172.21.15.23:0/3221990540 wait complete. 2024-02-28T16:20:57.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.914+0000 7f3d46600700 1 Processor -- start 2024-02-28T16:20:57.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.914+0000 7f3d46600700 1 -- start start 2024-02-28T16:20:57.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d46600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d401002d0 0x7f3d40073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:57.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d46600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:57.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d46600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40073ad0 con 0x7f3d40100c70 2024-02-28T16:20:57.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d46600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40073c10 con 0x7f3d401002d0 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d3fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d3fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39266/0 (socket says 172.21.15.23:39266) 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d3fe00700 1 -- 172.21.15.23:0/1662991051 learned_addr learned my addr 172.21.15.23:0/1662991051 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.915+0000 7f3d45200700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d401002d0 0x7f3d40073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d3fe00700 1 -- 172.21.15.23:0/1662991051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d401002d0 msgr2=0x7f3d40073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d3fe00700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d401002d0 0x7f3d40073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d3fe00700 1 -- 172.21.15.23:0/1662991051 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0095f0 con 0x7f3d40100c70 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d3fe00700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40073590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00bda0 tx=0x7f3d2c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:57.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d3d600700 1 -- 172.21.15.23:0/1662991051 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d2c01d070 con 0x7f3d40100c70 2024-02-28T16:20:57.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d3d600700 1 -- 172.21.15.23:0/1662991051 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d2c00f460 con 0x7f3d40100c70 2024-02-28T16:20:57.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d3d600700 1 -- 172.21.15.23:0/1662991051 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d2c017630 con 0x7f3d40100c70 2024-02-28T16:20:57.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d40073e90 con 0x7f3d40100c70 2024-02-28T16:20:57.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.916+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d401a2160 con 0x7f3d40100c70 2024-02-28T16:20:57.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.918+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d40062380 con 0x7f3d40100c70 2024-02-28T16:20:57.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.919+0000 7f3d3d600700 1 -- 172.21.15.23:0/1662991051 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3d2c00fab0 con 0x7f3d40100c70 2024-02-28T16:20:57.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.920+0000 7f3d3d600700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3d2806c680 0x7f3d2806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:57.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.920+0000 7f3d3d600700 1 -- 172.21.15.23:0/1662991051 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3d2c08cce0 con 0x7f3d40100c70 2024-02-28T16:20:57.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.920+0000 7f3d45200700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3d2806c680 0x7f3d2806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:57.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.921+0000 7f3d45200700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3d2806c680 0x7f3d2806eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d34005950 tx=0x7f3d340058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:57.915 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:57.925+0000 7f3d3d600700 1 -- 172.21.15.23:0/1662991051 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3d2c057340 con 0x7f3d40100c70 2024-02-28T16:20:58.192 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.202+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d401a2570 con 0x7f3d40100c70 2024-02-28T16:20:58.193 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.203+0000 7f3d3d600700 1 -- 172.21.15.23:0/1662991051 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f3d2c05a960 con 0x7f3d40100c70 2024-02-28T16:20:58.193 INFO:teuthology.orchestra.run.smithi023.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T16:20:58.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.205+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3d2806c680 msgr2=0x7f3d2806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:58.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.205+0000 7f3d46600700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3d2806c680 0x7f3d2806eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d34005950 tx=0x7f3d340058e0 comp rx=0 tx=0).stop 2024-02-28T16:20:58.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.205+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 msgr2=0x7f3d40073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:58.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.205+0000 7f3d46600700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40073590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00bda0 tx=0x7f3d2c00be80 comp rx=0 tx=0).stop 2024-02-28T16:20:58.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.206+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 shutdown_connections 2024-02-28T16:20:58.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.206+0000 7f3d46600700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3d2806c680 0x7f3d2806eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:58.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.206+0000 7f3d46600700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d401002d0 0x7f3d40073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:58.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.206+0000 7f3d46600700 1 --2- 172.21.15.23:0/1662991051 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d40100c70 0x7f3d40073590 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:58.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.206+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 >> 172.21.15.23:0/1662991051 conn(0x7f3d400fbbb0 msgr2=0x7f3d400fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:58.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.206+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 shutdown_connections 2024-02-28T16:20:58.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:20:58.206+0000 7f3d46600700 1 -- 172.21.15.23:0/1662991051 wait complete. 2024-02-28T16:20:58.565 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:58 smithi023 ceph-mon[29137]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:58.565 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:20:58 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1662991051' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:20:58.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:58 smithi153 ceph-mon[35341]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:20:58.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:20:58 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1662991051' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:20:59.124 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T16:20:59.124 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T16:20:59.124 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-02-28T16:20:59.124 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-28T16:20:59.124 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T16:20:59.124 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T16:20:59.125 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T16:20:59.125 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T16:20:59.125 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-28T16:20:59.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:59.125 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-02-28T16:20:59.182 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T16:20:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T16:20:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-02-28T16:20:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-28T16:20:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41971sec preferred_lft 41971sec 2024-02-28T16:20:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-02-28T16:20:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:20:59.185 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T16:20:59.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:59.185 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-02-28T16:20:59.185 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-02-28T16:20:59.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-02-28T16:20:59.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-02-28T16:20:59.186 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-02-28T16:20:59.186 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T16:20:59.186 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-02-28T16:20:59.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:59.626 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T16:20:59.703 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-02-28T16:20:59.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:59.706 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-02-28T16:20:59.777 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-02-28T16:20:59.778 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T16:20:59.778 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-28T16:20:59.778 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-28T16:20:59.778 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T16:20:59.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:20:59.779 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-02-28T16:20:59.779 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-02-28T16:20:59.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-28T16:20:59.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-28T16:20:59.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-28T16:20:59.780 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-02-28T16:21:00.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:00 smithi153 ceph-mon[35341]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:21:00.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:00.438 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-02-28T16:21:00.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:00.488 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-02-28T16:21:00.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:00.533 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-02-28T16:21:00.533 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-02-28T16:21:00.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:21:00.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-28T16:21:00.533 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-02-28T16:21:00.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:00 smithi023 ceph-mon[29137]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:21:00.711 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-28T16:21:00.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-28T16:21:00.712 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-02-28T16:21:00.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:00.980 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-02-28T16:21:00.980 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-02-28T16:21:00.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-02-28T16:21:00.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T16:21:00.980 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-02-28T16:21:01.135 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-28T16:21:01.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:21:01.135 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:01.172 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-28T16:21:01.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:21:01.172 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:01.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-02-28T16:21:01.395 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:21:01.436 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:21:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/0 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:21:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/2e286d693692c8f6d863051a903b757a61d44a0f64141fbad0805d04eaf57bca/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/6a5177cd9dd29e50625c3cb02e233794d12a502818bbcc639b838f045da36bb6/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/689671a1d371307e544a9d9967b8c1dcdecc67fe322c554b1fbf500c5b0a5a3e/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/4fcd63a8fd20d57776fe59c8528d911156c132477947a7ff03fc19000743a3df/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/c6bc8471069247d06f7351500744a8c72865ce53e376344cd5084ec041537ba2/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/232679033c9abed6151c93c056ccd8a23a94f822effc8f814fae125134077bc1/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/83df505bebfa89d3f494a115d3885c9d0f1a40c5e50016d05f47d45fa25c12b8/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/8951cd5f72d358fd2ef1e887030f0690dfdfa0db77d610f9a9345564889d4f88/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/cd66fcb602811705f808e4edaa531e7ff1fb847840018bcda9a88d352cb4466f/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/581722b92476f077efd094bdf67339cd7df419906962d09b9f17416acdf64f46/merged 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:21:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:21:01.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:01.440 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-02-28T16:21:01.535 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T16:21:01.535 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-28T16:21:01.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-02-28T16:21:01.614 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:21:01.658 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-02-28T16:21:01.659 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-02-28T16:21:01.660 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/0 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/2e286d693692c8f6d863051a903b757a61d44a0f64141fbad0805d04eaf57bca/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/6a5177cd9dd29e50625c3cb02e233794d12a502818bbcc639b838f045da36bb6/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/689671a1d371307e544a9d9967b8c1dcdecc67fe322c554b1fbf500c5b0a5a3e/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/4fcd63a8fd20d57776fe59c8528d911156c132477947a7ff03fc19000743a3df/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/c6bc8471069247d06f7351500744a8c72865ce53e376344cd5084ec041537ba2/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/232679033c9abed6151c93c056ccd8a23a94f822effc8f814fae125134077bc1/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/83df505bebfa89d3f494a115d3885c9d0f1a40c5e50016d05f47d45fa25c12b8/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/8951cd5f72d358fd2ef1e887030f0690dfdfa0db77d610f9a9345564889d4f88/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/cd66fcb602811705f808e4edaa531e7ff1fb847840018bcda9a88d352cb4466f/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/581722b92476f077efd094bdf67339cd7df419906962d09b9f17416acdf64f46/merged 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:21:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:21:01.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:01.663 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-02-28T16:21:01.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-02-28T16:21:01.761+0000 7f6268c52480 -1 init, newargv = 0x55bb61e6c6b0 newargc=15 2024-02-28T16:21:01.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[55109]: starting ceph client 2024-02-28T16:21:01.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[55109]: starting fuse 2024-02-28T16:21:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:02 smithi153 ceph-mon[35341]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:21:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:02 smithi023 ceph-mon[29137]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:21:02.846 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-02-28T16:21:02.949 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:21:03.003 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-02-28T16:21:03.003 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-02-28T16:21:03.003 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-02-28T16:21:03.004 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/0 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/2e286d693692c8f6d863051a903b757a61d44a0f64141fbad0805d04eaf57bca/merged 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/6a5177cd9dd29e50625c3cb02e233794d12a502818bbcc639b838f045da36bb6/merged 2024-02-28T16:21:03.005 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/689671a1d371307e544a9d9967b8c1dcdecc67fe322c554b1fbf500c5b0a5a3e/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/4fcd63a8fd20d57776fe59c8528d911156c132477947a7ff03fc19000743a3df/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/c6bc8471069247d06f7351500744a8c72865ce53e376344cd5084ec041537ba2/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/232679033c9abed6151c93c056ccd8a23a94f822effc8f814fae125134077bc1/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/83df505bebfa89d3f494a115d3885c9d0f1a40c5e50016d05f47d45fa25c12b8/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/8951cd5f72d358fd2ef1e887030f0690dfdfa0db77d610f9a9345564889d4f88/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/cd66fcb602811705f808e4edaa531e7ff1fb847840018bcda9a88d352cb4466f/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/containers/storage/overlay/581722b92476f077efd094bdf67339cd7df419906962d09b9f17416acdf64f46/merged 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:21:03.006 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:03.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:03.007 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-02-28T16:21:03.060 INFO:teuthology.orchestra.run.smithi153.stdout:125 2024-02-28T16:21:03.061 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [125] 2024-02-28T16:21:03.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo stdin-killer -- python3 -c ' 2024-02-28T16:21:03.061 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-02-28T16:21:03.061 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-02-28T16:21:03.062 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-02-28T16:21:03.062 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-02-28T16:21:03.062 DEBUG:teuthology.orchestra.run.smithi153:> 2024-02-28T16:21:03.062 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-02-28T16:21:03.062 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-28T16:21:03.062 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-02-28T16:21:03.063 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-28T16:21:03.063 DEBUG:teuthology.orchestra.run.smithi153:> 2024-02-28T16:21:03.063 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-02-28T16:21:03.063 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-02-28T16:21:03.063 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-02-28T16:21:03.063 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-02-28T16:21:03.064 DEBUG:teuthology.orchestra.run.smithi153:> 2024-02-28T16:21:03.064 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-02-28T16:21:03.064 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T16:21:03.064 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T16:21:03.064 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T16:21:03.064 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-02-28T16:21:03.065 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-02-28T16:21:03.065 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-02-28T16:21:03.065 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T16:21:03.065 DEBUG:teuthology.orchestra.run.smithi153:> 2024-02-28T16:21:03.065 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-02-28T16:21:03.065 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-02-28T16:21:03.244 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.55109.asok 2024-02-28T16:21:03.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-02-28T16:21:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T16:21:03.262 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.55109.asok 2024-02-28T16:21:03.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:03.263 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.55109.asok status 2024-02-28T16:21:03.497 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-02-28T16:21:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "55109", 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-02-28T16:21:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-02-28T16:21:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-02-28T16:21:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-02-28T16:21:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 24297, 2024-02-28T16:21:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-02-28T16:21:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-02-28T16:21:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-02-28T16:21:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 24297 2024-02-28T16:21:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-02-28T16:21:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-02-28T16:21:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-02-28T16:21:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:21:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 123756084 2024-02-28T16:21:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-02-28T16:21:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-02-28T16:21:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-02-28T16:21:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-02-28T16:21:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:21:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 123756084 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.24297 192.168.0.1:0/123756084", 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/123756084", 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 15, 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 47, 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-02-28T16:21:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-02-28T16:21:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-02-28T16:21:03.503 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-02-28T16:21:03.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:03.513 DEBUG:teuthology.orchestra.run.smithi023:> stat --file-system '--printf=%T 2024-02-28T16:21:03.513 DEBUG:teuthology.orchestra.run.smithi023:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-28T16:21:03.576 INFO:teuthology.orchestra.run.smithi023.stdout:fuseblk 2024-02-28T16:21:03.577 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-28T16:21:03.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:03.577 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-28T16:21:03.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:03.689 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-02-28T16:21:03.689 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:03.747 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-02-28T16:21:03.748 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:03.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:21:03.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:03.851 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:21:03.863 INFO:teuthology.task.print:**** done client 2024-02-28T16:21:03.864 INFO:teuthology.run_tasks:Running task parallel... 2024-02-28T16:21:03.875 INFO:teuthology.task.parallel:starting parallel... 2024-02-28T16:21:03.875 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T16:21:03.876 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T16:21:03.876 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:21:03.877 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-02-28T16:21:03.877 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T16:21:03.877 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-28T16:21:03.881 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:03.882 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-28T16:21:03.882 INFO:tasks.workunit:timeout=3h 2024-02-28T16:21:03.882 INFO:tasks.workunit:cleanup=True 2024-02-28T16:21:03.882 DEBUG:teuthology.orchestra.run.smithi023:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 9eh/158d Inode: 1 Links: 2 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-02-28 16:20:14.310976591 +0000 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-02-28 16:21:03.693397533 +0000 2024-02-28T16:21:03.940 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: - 2024-02-28T16:21:03.941 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-28T16:21:03.941 DEBUG:teuthology.orchestra.run.smithi023:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-28T16:21:04.090 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 7dh/125d Inode: 1 Links: 3 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-02-28 16:21:04.085374603 +0000 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-02-28 16:21:04.085374603 +0000 2024-02-28T16:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-02-28T16:21:04.149 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-28T16:21:04.149 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-28T16:21:04.254 DEBUG:teuthology.orchestra.run.smithi023:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:04.255 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:04.291 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:21:04.300 INFO:tasks.workunit.client.0.smithi023.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-28T16:21:04.307 INFO:tasks.workunit.client.1.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-28T16:21:04.631 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:04 smithi023 ceph-mon[29137]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:21:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:04 smithi153 ceph-mon[35341]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:21:05.645 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:05 smithi023 ceph-mon[29137]: pgmap v250: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:21:05.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:05 smithi153 ceph-mon[35341]: pgmap v250: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 -- 172.21.15.23:0/391708866 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 msgr2=0x7f7078100670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 --2- 172.21.15.23:0/391708866 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078100670 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7064009910 tx=0x7f7064009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 -- 172.21.15.23:0/391708866 shutdown_connections 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 --2- 172.21.15.23:0/391708866 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078100670 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 --2- 172.21.15.23:0/391708866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780fef60 0x7f70780ff370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 -- 172.21.15.23:0/391708866 >> 172.21.15.23:0/391708866 conn(0x7f70780fa5d0 msgr2=0x7f70780fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 -- 172.21.15.23:0/391708866 shutdown_connections 2024-02-28T16:21:06.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.512+0000 7f707ca00700 1 -- 172.21.15.23:0/391708866 wait complete. 2024-02-28T16:21:06.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.514+0000 7f707ca00700 1 Processor -- start 2024-02-28T16:21:06.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.514+0000 7f707ca00700 1 -- start start 2024-02-28T16:21:06.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.514+0000 7f707ca00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780fef60 0x7f70781979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:06.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.514+0000 7f707ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:06.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.514+0000 7f707ca00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078198520 con 0x7f7078100200 2024-02-28T16:21:06.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.514+0000 7f707ca00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078198660 con 0x7f70780fef60 2024-02-28T16:21:06.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.515+0000 7f7075e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:06.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.515+0000 7f7075e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:40194/0 (socket says 172.21.15.23:40194) 2024-02-28T16:21:06.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.515+0000 7f7075e00700 1 -- 172.21.15.23:0/736885619 learned_addr learned my addr 172.21.15.23:0/736885619 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.515+0000 7f7076800700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780fef60 0x7f70781979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.515+0000 7f7075e00700 1 -- 172.21.15.23:0/736885619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780fef60 msgr2=0x7f70781979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.515+0000 7f7075e00700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780fef60 0x7f70781979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.515+0000 7f7075e00700 1 -- 172.21.15.23:0/736885619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70640095f0 con 0x7f7078100200 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.516+0000 7f7075e00700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078197f00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7064005b40 tx=0x7f706400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.516+0000 7f706f400700 1 -- 172.21.15.23:0/736885619 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706401d070 con 0x7f7078100200 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.516+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707819d0b0 con 0x7f7078100200 2024-02-28T16:21:06.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.516+0000 7f706f400700 1 -- 172.21.15.23:0/736885619 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7064022470 con 0x7f7078100200 2024-02-28T16:21:06.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.516+0000 7f706f400700 1 -- 172.21.15.23:0/736885619 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706400f690 con 0x7f7078100200 2024-02-28T16:21:06.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.516+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707819d5a0 con 0x7f7078100200 2024-02-28T16:21:06.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.518+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7078107a40 con 0x7f7078100200 2024-02-28T16:21:06.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.519+0000 7f706f400700 1 -- 172.21.15.23:0/736885619 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f70640225e0 con 0x7f7078100200 2024-02-28T16:21:06.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.520+0000 7f706f400700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f705c06c680 0x7f705c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:06.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.520+0000 7f706f400700 1 -- 172.21.15.23:0/736885619 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f706408d120 con 0x7f7078100200 2024-02-28T16:21:06.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.520+0000 7f7076800700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f705c06c680 0x7f705c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:06.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.521+0000 7f7076800700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f705c06c680 0x7f705c06eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70680060b0 tx=0x7f7068007b80 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:06.515 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.525+0000 7f706f400700 1 -- 172.21.15.23:0/736885619 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f706405b2b0 con 0x7f7078100200 2024-02-28T16:21:06.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.748+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f7078107c00 con 0x7f7078100200 2024-02-28T16:21:06.749 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.759+0000 7f706f400700 1 -- 172.21.15.23:0/736885619 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v22)=0 v22) v1 ==== 126+0+0 (secure 0 0 0) 0x7f70640270c0 con 0x7f7078100200 2024-02-28T16:21:06.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f705c06c680 msgr2=0x7f705c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:06.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f705c06c680 0x7f705c06eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70680060b0 tx=0x7f7068007b80 comp rx=0 tx=0).stop 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 msgr2=0x7f7078197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078197f00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7064005b40 tx=0x7f706400be20 comp rx=0 tx=0).stop 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 shutdown_connections 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f705c06c680 0x7f705c06eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780fef60 0x7f70781979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 --2- 172.21.15.23:0/736885619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7078100200 0x7f7078197f00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 >> 172.21.15.23:0/736885619 conn(0x7f70780fa5d0 msgr2=0x7f70780fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.762+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 shutdown_connections 2024-02-28T16:21:06.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:06.763+0000 7f707ca00700 1 -- 172.21.15.23:0/736885619 wait complete. 2024-02-28T16:21:07.605 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T16:21:07.606 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:21:07.606 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-28T16:21:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:07 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/736885619' entity='client.admin' 2024-02-28T16:21:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:07 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:07 smithi023 ceph-mon[29137]: pgmap v251: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:21:08.091 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:21:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:07 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/736885619' entity='client.admin' 2024-02-28T16:21:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:07 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:07 smithi153 ceph-mon[35341]: pgmap v251: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:21:08.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:08.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:08.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:08 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:21:09.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:08 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:09.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:08 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:09.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:08 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:21:10.046 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:09 smithi023 ceph-mon[29137]: pgmap v252: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-28T16:21:10.048 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:09 smithi153 ceph-mon[35341]: pgmap v252: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.236+0000 7feef6400700 1 -- 172.21.15.23:0/3145157723 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0101250 msgr2=0x7feef01016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.236+0000 7feef6400700 1 --2- 172.21.15.23:0/3145157723 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0101250 0x7feef01016a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feedc009910 tx=0x7feedc009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.236+0000 7feef6400700 1 -- 172.21.15.23:0/3145157723 shutdown_connections 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.236+0000 7feef6400700 1 --2- 172.21.15.23:0/3145157723 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0101250 0x7feef01016a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.236+0000 7feef6400700 1 --2- 172.21.15.23:0/3145157723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0100050 0x7feef0100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.236+0000 7feef6400700 1 -- 172.21.15.23:0/3145157723 >> 172.21.15.23:0/3145157723 conn(0x7feef00fb5e0 msgr2=0x7feef00fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.237+0000 7feef6400700 1 -- 172.21.15.23:0/3145157723 shutdown_connections 2024-02-28T16:21:10.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.237+0000 7feef6400700 1 -- 172.21.15.23:0/3145157723 wait complete. 2024-02-28T16:21:10.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.238+0000 7feef6400700 1 Processor -- start 2024-02-28T16:21:10.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.238+0000 7feef6400700 1 -- start start 2024-02-28T16:21:10.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.238+0000 7feef6400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0100050 0x7feef01958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:10.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.238+0000 7feef6400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0101250 0x7feef0195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:10.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.238+0000 7feef6400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef0196420 con 0x7feef0100050 2024-02-28T16:21:10.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.238+0000 7feef6400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef0196560 con 0x7feef0101250 2024-02-28T16:21:10.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.239+0000 7feef5000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0100050 0x7feef01958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:10.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.239+0000 7feef5000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0100050 0x7feef01958c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51112/0 (socket says 172.21.15.23:51112) 2024-02-28T16:21:10.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.239+0000 7feef5000700 1 -- 172.21.15.23:0/2527995445 learned_addr learned my addr 172.21.15.23:0/2527995445 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:10.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.239+0000 7feeefe00700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0101250 0x7feef0195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:10.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.239+0000 7feef5000700 1 -- 172.21.15.23:0/2527995445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0101250 msgr2=0x7feef0195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:10.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.239+0000 7feef5000700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0101250 0x7feef0195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:10.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.239+0000 7feef5000700 1 -- 172.21.15.23:0/2527995445 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0095f0 con 0x7feef0100050 2024-02-28T16:21:10.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.240+0000 7feef5000700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0100050 0x7feef01958c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee400b480 tx=0x7feee400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:10.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.240+0000 7feeed600700 1 -- 172.21.15.23:0/2527995445 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee40118c0 con 0x7feef0100050 2024-02-28T16:21:10.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.240+0000 7feeed600700 1 -- 172.21.15.23:0/2527995445 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feee4010380 con 0x7feef0100050 2024-02-28T16:21:10.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.240+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef019afb0 con 0x7feef0100050 2024-02-28T16:21:10.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.240+0000 7feeed600700 1 -- 172.21.15.23:0/2527995445 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee400f4f0 con 0x7feef0100050 2024-02-28T16:21:10.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.240+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef019b550 con 0x7feef0100050 2024-02-28T16:21:10.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.242+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef0108c40 con 0x7feef0100050 2024-02-28T16:21:10.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.243+0000 7feeed600700 1 -- 172.21.15.23:0/2527995445 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7feee4011a20 con 0x7feef0100050 2024-02-28T16:21:10.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.244+0000 7feeed600700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7feed806c680 0x7feed806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:10.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.244+0000 7feeed600700 1 -- 172.21.15.23:0/2527995445 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feee408b540 con 0x7feef0100050 2024-02-28T16:21:10.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.244+0000 7feeefe00700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7feed806c680 0x7feed806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:10.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.245+0000 7feeefe00700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7feed806c680 0x7feed806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feedc006010 tx=0x7feedc00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:10.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.249+0000 7feeed600700 1 -- 172.21.15.23:0/2527995445 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7feee4059630 con 0x7feef0100050 2024-02-28T16:21:10.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.486+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7feef0108e00 con 0x7feef0100050 2024-02-28T16:21:10.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.487+0000 7feeed600700 1 -- 172.21.15.23:0/2527995445 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v22)=0 v22) v1 ==== 155+0+0 (secure 0 0 0) 0x7feee40591c0 con 0x7feef0100050 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.489+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7feed806c680 msgr2=0x7feed806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.489+0000 7feef6400700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7feed806c680 0x7feed806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feedc006010 tx=0x7feedc00b540 comp rx=0 tx=0).stop 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.489+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0100050 msgr2=0x7feef01958c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.489+0000 7feef6400700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0100050 0x7feef01958c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee400b480 tx=0x7feee400b840 comp rx=0 tx=0).stop 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.490+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 shutdown_connections 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.490+0000 7feef6400700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7feed806c680 0x7feed806eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.490+0000 7feef6400700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feef0100050 0x7feef01958c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.490+0000 7feef6400700 1 --2- 172.21.15.23:0/2527995445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef0101250 0x7feef0195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.490+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 >> 172.21.15.23:0/2527995445 conn(0x7feef00fb5e0 msgr2=0x7feef0104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.490+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 shutdown_connections 2024-02-28T16:21:10.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:10.490+0000 7feef6400700 1 -- 172.21.15.23:0/2527995445 wait complete. 2024-02-28T16:21:10.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:11.148 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:11.215 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-28T16:21:11.654 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:21:12.068 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:11 smithi023 ceph-mon[29137]: pgmap v253: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:21:12.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:11 smithi153 ceph-mon[35341]: pgmap v253: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:21:13.829 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 -- 172.21.15.23:0/236850526 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 msgr2=0x7f3008107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 --2- 172.21.15.23:0/236850526 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f3008107e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009910 tx=0x7f2ff4009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 -- 172.21.15.23:0/236850526 shutdown_connections 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 --2- 172.21.15.23:0/236850526 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f3008107e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 --2- 172.21.15.23:0/236850526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3008106840 0x7f3008106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 -- 172.21.15.23:0/236850526 >> 172.21.15.23:0/236850526 conn(0x7f3008075970 msgr2=0x7f3008077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 -- 172.21.15.23:0/236850526 shutdown_connections 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.839+0000 7f300d800700 1 -- 172.21.15.23:0/236850526 wait complete. 2024-02-28T16:21:13.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.840+0000 7f300d800700 1 Processor -- start 2024-02-28T16:21:13.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.840+0000 7f300d800700 1 -- start start 2024-02-28T16:21:13.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.840+0000 7f300d800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3008106840 0x7f300819c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.840+0000 7f300d800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f300819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.840+0000 7f300d800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300819cc40 con 0x7f3008107a40 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.840+0000 7f300d800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300819cd80 con 0x7f3008106840 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.841+0000 7f3006000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f300819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.841+0000 7f3006000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f300819c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51132/0 (socket says 172.21.15.23:51132) 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.841+0000 7f3006000700 1 -- 172.21.15.23:0/450639133 learned_addr learned my addr 172.21.15.23:0/450639133 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.841+0000 7f3006a00700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3008106840 0x7f300819c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.841+0000 7f3006000700 1 -- 172.21.15.23:0/450639133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3008106840 msgr2=0x7f300819c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.841+0000 7f3006000700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3008106840 0x7f300819c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.841+0000 7f3006000700 1 -- 172.21.15.23:0/450639133 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40095f0 con 0x7f3008107a40 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.842+0000 7f3006000700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f300819c620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4005b40 tx=0x7f2ff400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.842+0000 7f2fff400700 1 -- 172.21.15.23:0/450639133 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff401d070 con 0x7f3008107a40 2024-02-28T16:21:13.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.842+0000 7f2fff400700 1 -- 172.21.15.23:0/450639133 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ff4022470 con 0x7f3008107a40 2024-02-28T16:21:13.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.842+0000 7f2fff400700 1 -- 172.21.15.23:0/450639133 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff400f690 con 0x7f3008107a40 2024-02-28T16:21:13.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.842+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30081a17d0 con 0x7f3008107a40 2024-02-28T16:21:13.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.842+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30081a1cc0 con 0x7f3008107a40 2024-02-28T16:21:13.833 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.843+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300810f390 con 0x7f3008107a40 2024-02-28T16:21:13.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.844+0000 7f2fff400700 1 -- 172.21.15.23:0/450639133 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2ff40225e0 con 0x7f3008107a40 2024-02-28T16:21:13.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.845+0000 7f2fff400700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2fec06c680 0x7f2fec06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:13.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.845+0000 7f2fff400700 1 -- 172.21.15.23:0/450639133 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2ff408cf70 con 0x7f3008107a40 2024-02-28T16:21:13.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.845+0000 7f3006a00700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2fec06c680 0x7f2fec06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:13.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.846+0000 7f3006a00700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2fec06c680 0x7f2fec06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005fd0 tx=0x7f2ff8005dd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:13.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:13.851+0000 7f2fff400700 1 -- 172.21.15.23:0/450639133 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2ff40bf720 con 0x7f3008107a40 2024-02-28T16:21:14.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.073+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f300810f550 con 0x7f3008107a40 2024-02-28T16:21:14.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.074+0000 7f2fff400700 1 -- 172.21.15.23:0/450639133 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v22)=0 v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2ff405af10 con 0x7f3008107a40 2024-02-28T16:21:14.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.077+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2fec06c680 msgr2=0x7f2fec06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:14.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.077+0000 7f300d800700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2fec06c680 0x7f2fec06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005fd0 tx=0x7f2ff8005dd0 comp rx=0 tx=0).stop 2024-02-28T16:21:14.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.077+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 msgr2=0x7f300819c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:14.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.077+0000 7f300d800700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f300819c620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4005b40 tx=0x7f2ff400be20 comp rx=0 tx=0).stop 2024-02-28T16:21:14.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.078+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 shutdown_connections 2024-02-28T16:21:14.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.078+0000 7f300d800700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f2fec06c680 0x7f2fec06eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:14.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.078+0000 7f300d800700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3008106840 0x7f300819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:14.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.078+0000 7f300d800700 1 --2- 172.21.15.23:0/450639133 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3008107a40 0x7f300819c620 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:14.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.078+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 >> 172.21.15.23:0/450639133 conn(0x7f3008075970 msgr2=0x7f300810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:14.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.078+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 shutdown_connections 2024-02-28T16:21:14.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:14.078+0000 7f300d800700 1 -- 172.21.15.23:0/450639133 wait complete. 2024-02-28T16:21:14.408 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:14 smithi023 ceph-mon[29137]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:21:14.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:14 smithi153 ceph-mon[35341]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:21:14.876 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-28T16:21:15.316 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:21:15.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:15 smithi023 ceph-mon[29137]: pgmap v255: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:21:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:15 smithi153 ceph-mon[35341]: pgmap v255: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:21:17.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.571+0000 7f11d2e00700 1 -- 172.21.15.23:0/1945593914 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 msgr2=0x7f11cc0fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.571+0000 7f11d2e00700 1 --2- 172.21.15.23:0/1945593914 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc0fe320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009910 tx=0x7f11b8009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.571+0000 7f11d2e00700 1 -- 172.21.15.23:0/1945593914 shutdown_connections 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.572+0000 7f11d2e00700 1 --2- 172.21.15.23:0/1945593914 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc0fe320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.572+0000 7f11d2e00700 1 --2- 172.21.15.23:0/1945593914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc1018a0 0x7f11cc101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.572+0000 7f11d2e00700 1 -- 172.21.15.23:0/1945593914 >> 172.21.15.23:0/1945593914 conn(0x7f11cc0f9f10 msgr2=0x7f11cc0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.572+0000 7f11d2e00700 1 -- 172.21.15.23:0/1945593914 shutdown_connections 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.572+0000 7f11d2e00700 1 -- 172.21.15.23:0/1945593914 wait complete. 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11d2e00700 1 Processor -- start 2024-02-28T16:21:17.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11d2e00700 1 -- start start 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11d2e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc1018a0 0x7f11cc195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11d2e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11d2e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc196640 con 0x7f11cc1021f0 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11d2e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc196780 con 0x7f11cc1018a0 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11cb400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11cb400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51144/0 (socket says 172.21.15.23:51144) 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.573+0000 7f11cb400700 1 -- 172.21.15.23:0/3586708423 learned_addr learned my addr 172.21.15.23:0/3586708423 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.574+0000 7f11cb400700 1 -- 172.21.15.23:0/3586708423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc1018a0 msgr2=0x7f11cc195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.574+0000 7f11cbe00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc1018a0 0x7f11cc195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.574+0000 7f11cb400700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc1018a0 0x7f11cc195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.574+0000 7f11cb400700 1 -- 172.21.15.23:0/3586708423 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80095f0 con 0x7f11cc1021f0 2024-02-28T16:21:17.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.574+0000 7f11cbe00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc1018a0 0x7f11cc195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:21:17.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.574+0000 7f11cb400700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc196020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f11b800bda0 tx=0x7f11b800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:17.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.575+0000 7f11c8c00700 1 -- 172.21.15.23:0/3586708423 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b801d070 con 0x7f11cc1021f0 2024-02-28T16:21:17.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.575+0000 7f11c8c00700 1 -- 172.21.15.23:0/3586708423 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11b8004c50 con 0x7f11cc1021f0 2024-02-28T16:21:17.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.575+0000 7f11c8c00700 1 -- 172.21.15.23:0/3586708423 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b800f690 con 0x7f11cc1021f0 2024-02-28T16:21:17.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.575+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc19b1d0 con 0x7f11cc1021f0 2024-02-28T16:21:17.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.575+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc19b6c0 con 0x7f11cc1021f0 2024-02-28T16:21:17.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.576+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc108d10 con 0x7f11cc1021f0 2024-02-28T16:21:17.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.577+0000 7f11c8c00700 1 -- 172.21.15.23:0/3586708423 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f11b8022a20 con 0x7f11cc1021f0 2024-02-28T16:21:17.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.578+0000 7f11c8c00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f11b006c680 0x7f11b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:17.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.578+0000 7f11c8c00700 1 -- 172.21.15.23:0/3586708423 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f11b808cf40 con 0x7f11cc1021f0 2024-02-28T16:21:17.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.578+0000 7f11cbe00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f11b006c680 0x7f11b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:17.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.579+0000 7f11cbe00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f11b006c680 0x7f11b006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005fd0 tx=0x7f11bc005dc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:17.573 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.583+0000 7f11c8c00700 1 -- 172.21.15.23:0/3586708423 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f11b805b0e0 con 0x7f11cc1021f0 2024-02-28T16:21:17.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.801+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f11cc108ed0 con 0x7f11cc1021f0 2024-02-28T16:21:17.792 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.802+0000 7f11c8c00700 1 -- 172.21.15.23:0/3586708423 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7f11b805ac70 con 0x7f11cc1021f0 2024-02-28T16:21:17.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f11b006c680 msgr2=0x7f11b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:17.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f11b006c680 0x7f11b006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005fd0 tx=0x7f11bc005dc0 comp rx=0 tx=0).stop 2024-02-28T16:21:17.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 msgr2=0x7f11cc196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:17.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc196020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f11b800bda0 tx=0x7f11b800be80 comp rx=0 tx=0).stop 2024-02-28T16:21:17.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 shutdown_connections 2024-02-28T16:21:17.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f11b006c680 0x7f11b006eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:17.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc1018a0 0x7f11cc195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:17.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 --2- 172.21.15.23:0/3586708423 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f11cc1021f0 0x7f11cc196020 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:17.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.805+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 >> 172.21.15.23:0/3586708423 conn(0x7f11cc0f9f10 msgr2=0x7f11cc104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:17.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.806+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 shutdown_connections 2024-02-28T16:21:17.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:17.806+0000 7f11d2e00700 1 -- 172.21.15.23:0/3586708423 wait complete. 2024-02-28T16:21:18.592 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:18 smithi023 ceph-mon[29137]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:21:18.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:18 smithi153 ceph-mon[35341]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:21:18.668 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-28T16:21:19.092 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:21:20.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:20 smithi023 ceph-mon[29137]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:21:20.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:20 smithi153 ceph-mon[35341]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:21:21.390 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 -- 172.21.15.23:0/2420448683 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 msgr2=0x7f550c0ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:21.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 --2- 172.21.15.23:0/2420448683 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c0ff330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009910 tx=0x7f54fc009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:21.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 -- 172.21.15.23:0/2420448683 shutdown_connections 2024-02-28T16:21:21.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 --2- 172.21.15.23:0/2420448683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c100080 0x7f550c1004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:21.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 --2- 172.21.15.23:0/2420448683 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c0ff330 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:21.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 -- 172.21.15.23:0/2420448683 >> 172.21.15.23:0/2420448683 conn(0x7f550c0fa4d0 msgr2=0x7f550c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:21.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 -- 172.21.15.23:0/2420448683 shutdown_connections 2024-02-28T16:21:21.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.399+0000 7f550b200700 1 -- 172.21.15.23:0/2420448683 wait complete. 2024-02-28T16:21:21.392 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.400+0000 7f550b200700 1 Processor -- start 2024-02-28T16:21:21.392 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.400+0000 7f550b200700 1 -- start start 2024-02-28T16:21:21.392 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f550b200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f550b200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c100080 0x7f550c195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f550b200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1963e0 con 0x7f550c0fef20 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f550b200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c196520 con 0x7f550c100080 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f5509e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f5509e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c195880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:34960/0 (socket says 172.21.15.23:34960) 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f5509e00700 1 -- 172.21.15.23:0/851014139 learned_addr learned my addr 172.21.15.23:0/851014139 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f5509e00700 1 -- 172.21.15.23:0/851014139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c100080 msgr2=0x7f550c195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f5509e00700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c100080 0x7f550c195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.401+0000 7f5509e00700 1 -- 172.21.15.23:0/851014139 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0095f0 con 0x7f550c0fef20 2024-02-28T16:21:21.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.402+0000 7f5509e00700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c195880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00bd70 tx=0x7f54fc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:21.394 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.402+0000 7f5502a00700 1 -- 172.21.15.23:0/851014139 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54fc01d070 con 0x7f550c0fef20 2024-02-28T16:21:21.394 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.402+0000 7f5502a00700 1 -- 172.21.15.23:0/851014139 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f54fc022470 con 0x7f550c0fef20 2024-02-28T16:21:21.394 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.402+0000 7f5502a00700 1 -- 172.21.15.23:0/851014139 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54fc00f670 con 0x7f550c0fef20 2024-02-28T16:21:21.394 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.402+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c19af70 con 0x7f550c0fef20 2024-02-28T16:21:21.394 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.402+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c19b490 con 0x7f550c0fef20 2024-02-28T16:21:21.394 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.403+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c107a70 con 0x7f550c0fef20 2024-02-28T16:21:21.395 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.405+0000 7f5502a00700 1 -- 172.21.15.23:0/851014139 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f54fc022a50 con 0x7f550c0fef20 2024-02-28T16:21:21.397 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.406+0000 7f5502a00700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f54f006c680 0x7f54f006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:21.397 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.406+0000 7f5502a00700 1 -- 172.21.15.23:0/851014139 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f54fc08cfa0 con 0x7f550c0fef20 2024-02-28T16:21:21.397 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.406+0000 7f5503e00700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f54f006c680 0x7f54f006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:21.397 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.407+0000 7f5503e00700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f54f006c680 0x7f54f006eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097b0 tx=0x7f54f4006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:21.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.411+0000 7f5502a00700 1 -- 172.21.15.23:0/851014139 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f54fc05b140 con 0x7f550c0fef20 2024-02-28T16:21:21.643 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.652+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}) v1 -- 0x7f550c068cf0 con 0x7f54f006c680 2024-02-28T16:21:21.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.664+0000 7f5502a00700 1 -- 172.21.15.23:0/851014139 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f550c068cf0 con 0x7f54f006c680 2024-02-28T16:21:21.655 INFO:teuthology.orchestra.run.smithi023.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:21.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f54f006c680 msgr2=0x7f54f006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:21.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f54f006c680 0x7f54f006eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097b0 tx=0x7f54f4006d20 comp rx=0 tx=0).stop 2024-02-28T16:21:21.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 msgr2=0x7f550c195880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:21.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c195880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00bd70 tx=0x7f54fc00be50 comp rx=0 tx=0).stop 2024-02-28T16:21:21.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 shutdown_connections 2024-02-28T16:21:21.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f54f006c680 0x7f54f006eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:21.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f550c0fef20 0x7f550c195880 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:21.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 --2- 172.21.15.23:0/851014139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f550c100080 0x7f550c195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:21.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 >> 172.21.15.23:0/851014139 conn(0x7f550c0fa4d0 msgr2=0x7f550c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:21.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 shutdown_connections 2024-02-28T16:21:21.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:21.667+0000 7f550b200700 1 -- 172.21.15.23:0/851014139 wait complete. 2024-02-28T16:21:22.490 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T16:21:22.490 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:21:22.490 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-28T16:21:22.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:22 smithi153 ceph-mon[35341]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:21:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:22 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:21:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:22 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:22 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:22 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:22 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:21:22.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:22 smithi023 ceph-mon[29137]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:21:22.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:21:22.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:22.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:22.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:22.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:22 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:21:22.891 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:21:23.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:23 smithi153 ceph-mon[35341]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:23.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:23 smithi153 ceph-mon[35341]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:23.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:23 smithi153 ceph-mon[35341]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:23.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:23 smithi023 ceph-mon[29137]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:23.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:23 smithi023 ceph-mon[29137]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:23.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:23 smithi023 ceph-mon[29137]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:21:24.560 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:24 smithi023 ceph-mon[29137]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:21:24.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:24 smithi153 ceph-mon[35341]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:21:25.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 -- 172.21.15.23:0/2179559344 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570103430 msgr2=0x7f6570105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 --2- 172.21.15.23:0/2179559344 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570103430 0x7f6570105810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f655c009910 tx=0x7f655c009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 -- 172.21.15.23:0/2179559344 shutdown_connections 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 --2- 172.21.15.23:0/2179559344 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570103430 0x7f6570105810 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 --2- 172.21.15.23:0/2179559344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6570100b10 0x7f6570102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 -- 172.21.15.23:0/2179559344 >> 172.21.15.23:0/2179559344 conn(0x7f65700fa4d0 msgr2=0x7f65700fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 -- 172.21.15.23:0/2179559344 shutdown_connections 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.167+0000 7f6575a00700 1 -- 172.21.15.23:0/2179559344 wait complete. 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.168+0000 7f6575a00700 1 Processor -- start 2024-02-28T16:21:25.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.169+0000 7f6575a00700 1 -- start start 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.169+0000 7f6575a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570100b10 0x7f6570195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.169+0000 7f6575a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6570103430 0x7f6570195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.169+0000 7f6575a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570196390 con 0x7f6570100b10 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.169+0000 7f6575a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701964d0 con 0x7f6570103430 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570100b10 0x7f6570195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570100b10 0x7f6570195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:34978/0 (socket says 172.21.15.23:34978) 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656fe00700 1 -- 172.21.15.23:0/1836323190 learned_addr learned my addr 172.21.15.23:0/1836323190 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:25.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656f400700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6570103430 0x7f6570195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656fe00700 1 -- 172.21.15.23:0/1836323190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6570103430 msgr2=0x7f6570195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656fe00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6570103430 0x7f6570195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656fe00700 1 -- 172.21.15.23:0/1836323190 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0095f0 con 0x7f6570100b10 2024-02-28T16:21:25.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.170+0000 7f656f400700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6570103430 0x7f6570195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:21:25.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.171+0000 7f656fe00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570100b10 0x7f6570195830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f656000d8d0 tx=0x7f656000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:25.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.171+0000 7f656cc00700 1 -- 172.21.15.23:0/1836323190 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6560009940 con 0x7f6570100b10 2024-02-28T16:21:25.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.171+0000 7f656cc00700 1 -- 172.21.15.23:0/1836323190 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6560010460 con 0x7f6570100b10 2024-02-28T16:21:25.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.171+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700fe960 con 0x7f6570100b10 2024-02-28T16:21:25.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.171+0000 7f656cc00700 1 -- 172.21.15.23:0/1836323190 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656000f5f0 con 0x7f6570100b10 2024-02-28T16:21:25.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.171+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700feeb0 con 0x7f6570100b10 2024-02-28T16:21:25.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.173+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657018fa40 con 0x7f6570100b10 2024-02-28T16:21:25.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.174+0000 7f656cc00700 1 -- 172.21.15.23:0/1836323190 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f65600105d0 con 0x7f6570100b10 2024-02-28T16:21:25.166 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.175+0000 7f656cc00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f655406c680 0x7f655406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.166 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.176+0000 7f656cc00700 1 -- 172.21.15.23:0/1836323190 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f656008b980 con 0x7f6570100b10 2024-02-28T16:21:25.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.176+0000 7f656f400700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f655406c680 0x7f655406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.177+0000 7f656f400700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f655406c680 0x7f655406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f655c006010 tx=0x7f655c00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:25.173 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.182+0000 7f656cc00700 1 -- 172.21.15.23:0/1836323190 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f65600599f0 con 0x7f6570100b10 2024-02-28T16:21:25.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.504+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65701002c0 con 0x7f655406c680 2024-02-28T16:21:25.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.507+0000 7f656cc00700 1 -- 172.21.15.23:0/1836323190 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f65701002c0 con 0x7f655406c680 2024-02-28T16:21:25.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f655406c680 msgr2=0x7f655406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f655406c680 0x7f655406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f655c006010 tx=0x7f655c00b540 comp rx=0 tx=0).stop 2024-02-28T16:21:25.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570100b10 msgr2=0x7f6570195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570100b10 0x7f6570195830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f656000d8d0 tx=0x7f656000dc90 comp rx=0 tx=0).stop 2024-02-28T16:21:25.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 shutdown_connections 2024-02-28T16:21:25.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f655406c680 0x7f655406eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6570100b10 0x7f6570195830 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 --2- 172.21.15.23:0/1836323190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6570103430 0x7f6570195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 >> 172.21.15.23:0/1836323190 conn(0x7f65700fa4d0 msgr2=0x7f65700fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:25.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.510+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 shutdown_connections 2024-02-28T16:21:25.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.511+0000 7f6575a00700 1 -- 172.21.15.23:0/1836323190 wait complete. 2024-02-28T16:21:25.521 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:21:25.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 -- 172.21.15.23:0/1791437885 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 msgr2=0x7f3ad0105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 --2- 172.21.15.23:0/1791437885 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad0105790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009910 tx=0x7f3abc009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:25.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 -- 172.21.15.23:0/1791437885 shutdown_connections 2024-02-28T16:21:25.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:25.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:25 smithi023 ceph-mon[29137]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:21:25.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 --2- 172.21.15.23:0/1791437885 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad0105790 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 --2- 172.21.15.23:0/1791437885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0069230 0x7f3ad0102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 -- 172.21.15.23:0/1791437885 >> 172.21.15.23:0/1791437885 conn(0x7f3ad00fa780 msgr2=0x7f3ad00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:25.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 -- 172.21.15.23:0/1791437885 shutdown_connections 2024-02-28T16:21:25.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.701+0000 7f3ad6200700 1 -- 172.21.15.23:0/1791437885 wait complete. 2024-02-28T16:21:25.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.703+0000 7f3ad6200700 1 Processor -- start 2024-02-28T16:21:25.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.703+0000 7f3ad6200700 1 -- start start 2024-02-28T16:21:25.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3ad6200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0069230 0x7f3ad0100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3ad6200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad00fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3ad6200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00ff2f0 con 0x7f3ad0103350 2024-02-28T16:21:25.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3ad6200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00ff430 con 0x7f3ad0069230 2024-02-28T16:21:25.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3acea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad00fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3acea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad00fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35006/0 (socket says 172.21.15.23:35006) 2024-02-28T16:21:25.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3acea00700 1 -- 172.21.15.23:0/3767077052 learned_addr learned my addr 172.21.15.23:0/3767077052 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:25.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.704+0000 7f3acf400700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0069230 0x7f3ad0100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.705+0000 7f3acea00700 1 -- 172.21.15.23:0/3767077052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0069230 msgr2=0x7f3ad0100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.705+0000 7f3acea00700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0069230 0x7f3ad0100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.705+0000 7f3acea00700 1 -- 172.21.15.23:0/3767077052 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc0095f0 con 0x7f3ad0103350 2024-02-28T16:21:25.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.705+0000 7f3acf400700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0069230 0x7f3ad0100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:21:25.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.706+0000 7f3acea00700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad00fedb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3abc006010 tx=0x7f3abc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:25.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.706+0000 7f3ac7e00700 1 -- 172.21.15.23:0/3767077052 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3abc01d070 con 0x7f3ad0103350 2024-02-28T16:21:25.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.706+0000 7f3ac7e00700 1 -- 172.21.15.23:0/3767077052 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3abc00f460 con 0x7f3ad0103350 2024-02-28T16:21:25.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.706+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad00ff6b0 con 0x7f3ad0103350 2024-02-28T16:21:25.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.706+0000 7f3ac7e00700 1 -- 172.21.15.23:0/3767077052 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3abc017630 con 0x7f3ad0103350 2024-02-28T16:21:25.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.706+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad00ffba0 con 0x7f3ad0103350 2024-02-28T16:21:25.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.708+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad018fbf0 con 0x7f3ad0103350 2024-02-28T16:21:25.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.709+0000 7f3ac7e00700 1 -- 172.21.15.23:0/3767077052 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3abc00f5d0 con 0x7f3ad0103350 2024-02-28T16:21:25.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.710+0000 7f3ac7e00700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3ab406c680 0x7f3ab406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.710+0000 7f3ac7e00700 1 -- 172.21.15.23:0/3767077052 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3abc08cd40 con 0x7f3ad0103350 2024-02-28T16:21:25.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.710+0000 7f3acf400700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3ab406c680 0x7f3ab406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.712+0000 7f3acf400700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3ab406c680 0x7f3ab406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0005fd0 tx=0x7f3ac0005f00 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:25.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:25.715+0000 7f3ac7e00700 1 -- 172.21.15.23:0/3767077052 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3abc05ae30 con 0x7f3ad0103350 2024-02-28T16:21:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:25 smithi153 ceph-mon[35341]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:21:25.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.003+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ad0061190 con 0x7f3ab406c680 2024-02-28T16:21:25.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.007+0000 7f3ac7e00700 1 -- 172.21.15.23:0/3767077052 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f3ad0061190 con 0x7f3ab406c680 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.009+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3ab406c680 msgr2=0x7f3ab406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3ab406c680 0x7f3ab406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0005fd0 tx=0x7f3ac0005f00 comp rx=0 tx=0).stop 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 msgr2=0x7f3ad00fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad00fedb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3abc006010 tx=0x7f3abc00be20 comp rx=0 tx=0).stop 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 shutdown_connections 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3ab406c680 0x7f3ab406eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0069230 0x7f3ad0100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 --2- 172.21.15.23:0/3767077052 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ad0103350 0x7f3ad00fedb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 >> 172.21.15.23:0/3767077052 conn(0x7f3ad00fa780 msgr2=0x7f3ad00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 shutdown_connections 2024-02-28T16:21:26.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.010+0000 7f3ad6200700 1 -- 172.21.15.23:0/3767077052 wait complete. 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.189+0000 7fb81de00700 1 -- 172.21.15.23:0/2962930134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818069270 msgr2=0x7fb8181051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.189+0000 7fb81de00700 1 --2- 172.21.15.23:0/2962930134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818069270 0x7fb8181051d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb808009910 tx=0x7fb808009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.189+0000 7fb81de00700 1 -- 172.21.15.23:0/2962930134 shutdown_connections 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.189+0000 7fb81de00700 1 --2- 172.21.15.23:0/2962930134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb818105710 0x7fb818107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.189+0000 7fb81de00700 1 --2- 172.21.15.23:0/2962930134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818069270 0x7fb8181051d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.189+0000 7fb81de00700 1 -- 172.21.15.23:0/2962930134 >> 172.21.15.23:0/2962930134 conn(0x7fb8180fa780 msgr2=0x7fb8180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.190+0000 7fb81de00700 1 -- 172.21.15.23:0/2962930134 shutdown_connections 2024-02-28T16:21:26.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.190+0000 7fb81de00700 1 -- 172.21.15.23:0/2962930134 wait complete. 2024-02-28T16:21:26.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.191+0000 7fb81de00700 1 Processor -- start 2024-02-28T16:21:26.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.191+0000 7fb81de00700 1 -- start start 2024-02-28T16:21:26.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.191+0000 7fb81de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818105710 0x7fb818197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.191+0000 7fb81de00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb818198220 0x7fb81819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.191+0000 7fb81de00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818198690 con 0x7fb818105710 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.191+0000 7fb81de00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818198800 con 0x7fb818198220 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818105710 0x7fb818197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818105710 0x7fb818197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35024/0 (socket says 172.21.15.23:35024) 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816a00700 1 -- 172.21.15.23:0/1455364797 learned_addr learned my addr 172.21.15.23:0/1455364797 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816a00700 1 -- 172.21.15.23:0/1455364797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb818198220 msgr2=0x7fb81819d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816000700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb818198220 0x7fb81819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816a00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb818198220 0x7fb81819d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816a00700 1 -- 172.21.15.23:0/1455364797 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080095f0 con 0x7fb818105710 2024-02-28T16:21:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.192+0000 7fb816000700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb818198220 0x7fb81819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:21:26.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.193+0000 7fb816a00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818105710 0x7fb818197ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb80800bda0 tx=0x7fb80800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:26.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.193+0000 7fb81ca00700 1 -- 172.21.15.23:0/1455364797 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80801d070 con 0x7fb818105710 2024-02-28T16:21:26.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.193+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81819d790 con 0x7fb818105710 2024-02-28T16:21:26.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.193+0000 7fb81ca00700 1 -- 172.21.15.23:0/1455364797 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb808004c50 con 0x7fb818105710 2024-02-28T16:21:26.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.194+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81819dc50 con 0x7fb818105710 2024-02-28T16:21:26.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.195+0000 7fb81ca00700 1 -- 172.21.15.23:0/1455364797 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80800f690 con 0x7fb818105710 2024-02-28T16:21:26.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.195+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f8005320 con 0x7fb818105710 2024-02-28T16:21:26.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.196+0000 7fb81ca00700 1 -- 172.21.15.23:0/1455364797 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb808022a20 con 0x7fb818105710 2024-02-28T16:21:26.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.199+0000 7fb81ca00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb7fc06c680 0x7fb7fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.191 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.200+0000 7fb816000700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb7fc06c680 0x7fb7fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.191 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.200+0000 7fb81ca00700 1 -- 172.21.15.23:0/1455364797 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb80808d180 con 0x7fb818105710 2024-02-28T16:21:26.191 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.201+0000 7fb816000700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb7fc06c680 0x7fb7fc06eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb804005dc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:26.193 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.202+0000 7fb81ca00700 1 -- 172.21.15.23:0/1455364797 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb808057890 con 0x7fb818105710 2024-02-28T16:21:26.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.500+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7f8000bf0 con 0x7fb7fc06c680 2024-02-28T16:21:26.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.529+0000 7fb81ca00700 1 -- 172.21.15.23:0/1455364797 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7fb7f8000bf0 con 0x7fb7fc06c680 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (6m) 39s ago 8m 13.5M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (8m) 39s ago 8m 7490k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (7m) 45s ago 7m 7201k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (8m) 39s ago 8m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (7m) 45s ago 7m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (6m) 39s ago 7m 74.3M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:21:26.521 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (64s) 39s ago 63s 14.1M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (73s) 39s ago 73s 11.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (60s) 45s ago 60s 11.5M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (69s) 45s ago 69s 11.7M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:9283,8765,8443 running (10m) 39s ago 10m 488M - 18.2.0 dc2bc1663786 b278ec72c436 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (7m) 45s ago 7m 437M - 18.2.0 dc2bc1663786 cbabf8088ddf 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (10m) 39s ago 10m 45.3M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (6m) 45s ago 6m 33.8M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (8m) 39s ago 8m 7818k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (7m) 45s ago 7m 7926k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (5m) 39s ago 5m 46.7M 3947M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (5m) 39s ago 5m 46.6M 3947M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (4m) 39s ago 4m 45.8M 3947M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (4m) 45s ago 4m 45.3M 4971M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (3m) 45s ago 3m 42.6M 4971M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:21:26.522 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (2m) 45s ago 2m 42.0M 4971M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:21:26.523 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (6m) 39s ago 7m 53.0M - 2.43.0 a07b618ecd1d 8297ca033a9b 2024-02-28T16:21:26.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb7fc06c680 msgr2=0x7fb7fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb7fc06c680 0x7fb7fc06eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb804005dc0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818105710 msgr2=0x7fb818197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818105710 0x7fb818197ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb80800bda0 tx=0x7fb80800be80 comp rx=0 tx=0).stop 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 shutdown_connections 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fb7fc06c680 0x7fb7fc06eb30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb818105710 0x7fb818197ce0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 --2- 172.21.15.23:0/1455364797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb818198220 0x7fb81819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.532+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 >> 172.21.15.23:0/1455364797 conn(0x7fb8180fa780 msgr2=0x7fb8180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.533+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 shutdown_connections 2024-02-28T16:21:26.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.533+0000 7fb81de00700 1 -- 172.21.15.23:0/1455364797 wait complete. 2024-02-28T16:21:26.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.726+0000 7f75e0e00700 1 -- 172.21.15.23:0/902887018 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 msgr2=0x7f75dc103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.726+0000 7f75e0e00700 1 --2- 172.21.15.23:0/902887018 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc103b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009910 tx=0x7f75c8009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:26.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.727+0000 7f75e0e00700 1 -- 172.21.15.23:0/902887018 shutdown_connections 2024-02-28T16:21:26.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.727+0000 7f75e0e00700 1 --2- 172.21.15.23:0/902887018 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc103b60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.727+0000 7f75e0e00700 1 --2- 172.21.15.23:0/902887018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc102450 0x7f75dc102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.727+0000 7f75e0e00700 1 -- 172.21.15.23:0/902887018 >> 172.21.15.23:0/902887018 conn(0x7f75dc0fdac0 msgr2=0x7f75dc0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:26.718 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:26 smithi023 ceph-mon[29137]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:26.718 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:26 smithi023 ceph-mon[29137]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:26.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.729+0000 7f75e0e00700 1 -- 172.21.15.23:0/902887018 shutdown_connections 2024-02-28T16:21:26.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.729+0000 7f75e0e00700 1 -- 172.21.15.23:0/902887018 wait complete. 2024-02-28T16:21:26.721 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.731+0000 7f75e0e00700 1 Processor -- start 2024-02-28T16:21:26.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.731+0000 7f75e0e00700 1 -- start start 2024-02-28T16:21:26.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75e0e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc102450 0x7f75dc197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75e0e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75e0e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc1987c0 con 0x7f75dc1036f0 2024-02-28T16:21:26.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75e0e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc198930 con 0x7f75dc102450 2024-02-28T16:21:26.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75d9400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75d9400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35048/0 (socket says 172.21.15.23:35048) 2024-02-28T16:21:26.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75d9400700 1 -- 172.21.15.23:0/1305607421 learned_addr learned my addr 172.21.15.23:0/1305607421 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:26.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.732+0000 7f75d9e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc102450 0x7f75dc197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.733+0000 7f75d9400700 1 -- 172.21.15.23:0/1305607421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc102450 msgr2=0x7f75dc197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.733+0000 7f75d9400700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc102450 0x7f75dc197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.733+0000 7f75d9400700 1 -- 172.21.15.23:0/1305607421 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80095f0 con 0x7f75dc1036f0 2024-02-28T16:21:26.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.733+0000 7f75d9400700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc1981c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f75c8005b40 tx=0x7f75c800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:26.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.733+0000 7f75d2a00700 1 -- 172.21.15.23:0/1305607421 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c801d070 con 0x7f75dc1036f0 2024-02-28T16:21:26.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.733+0000 7f75d2a00700 1 -- 172.21.15.23:0/1305607421 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75c800f460 con 0x7f75dc1036f0 2024-02-28T16:21:26.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.733+0000 7f75d2a00700 1 -- 172.21.15.23:0/1305607421 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c8021640 con 0x7f75dc1036f0 2024-02-28T16:21:26.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.734+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc19d360 con 0x7f75dc1036f0 2024-02-28T16:21:26.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.734+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc19d850 con 0x7f75dc1036f0 2024-02-28T16:21:26.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.735+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc10af30 con 0x7f75dc1036f0 2024-02-28T16:21:26.727 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.737+0000 7f75d2a00700 1 -- 172.21.15.23:0/1305607421 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f75c800fa90 con 0x7f75dc1036f0 2024-02-28T16:21:26.729 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.738+0000 7f75d2a00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f75c006c680 0x7f75c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.729 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.738+0000 7f75d2a00700 1 -- 172.21.15.23:0/1305607421 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f75c808cb20 con 0x7f75dc1036f0 2024-02-28T16:21:26.729 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.739+0000 7f75d9e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f75c006c680 0x7f75c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.730 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.740+0000 7f75d9e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f75c006c680 0x7f75c006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75cc005950 tx=0x7f75cc0058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:26.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:26.744+0000 7f75d2a00700 1 -- 172.21.15.23:0/1305607421 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f75c8057220 con 0x7f75dc1036f0 2024-02-28T16:21:26.855 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:26 smithi153 ceph-mon[35341]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:26.855 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:26 smithi153 ceph-mon[35341]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:27.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.122+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f75dc19dee0 con 0x7f75dc1036f0 2024-02-28T16:21:27.114 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.124+0000 7f75d2a00700 1 -- 172.21.15.23:0/1305607421 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f75c8060240 con 0x7f75dc1036f0 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:21:27.115 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:21:27.116 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:21:27.116 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:21:27.116 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:21:27.116 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:21:27.116 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-02-28T16:21:27.116 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:21:27.116 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:21:27.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f75c006c680 msgr2=0x7f75c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f75c006c680 0x7f75c006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75cc005950 tx=0x7f75cc0058e0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 msgr2=0x7f75dc1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc1981c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f75c8005b40 tx=0x7f75c800be20 comp rx=0 tx=0).stop 2024-02-28T16:21:27.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 shutdown_connections 2024-02-28T16:21:27.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f75c006c680 0x7f75c006eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc102450 0x7f75dc197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 --2- 172.21.15.23:0/1305607421 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f75dc1036f0 0x7f75dc1981c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.127+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 >> 172.21.15.23:0/1305607421 conn(0x7f75dc0fdac0 msgr2=0x7f75dc106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:27.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.128+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 shutdown_connections 2024-02-28T16:21:27.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.128+0000 7f75e0e00700 1 -- 172.21.15.23:0/1305607421 wait complete. 2024-02-28T16:21:27.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 -- 172.21.15.23:0/2479585348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 msgr2=0x7f7fe0107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 --2- 172.21.15.23:0/2479585348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe0107e90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009910 tx=0x7f7fcc009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:27.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 -- 172.21.15.23:0/2479585348 shutdown_connections 2024-02-28T16:21:27.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 --2- 172.21.15.23:0/2479585348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe0107e90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 --2- 172.21.15.23:0/2479585348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe0106840 0x7f7fe0106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 -- 172.21.15.23:0/2479585348 >> 172.21.15.23:0/2479585348 conn(0x7f7fe0075970 msgr2=0x7f7fe0077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:27.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 -- 172.21.15.23:0/2479585348 shutdown_connections 2024-02-28T16:21:27.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.305+0000 7f7fe7800700 1 -- 172.21.15.23:0/2479585348 wait complete. 2024-02-28T16:21:27.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.306+0000 7f7fe7800700 1 Processor -- start 2024-02-28T16:21:27.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fe7800700 1 -- start start 2024-02-28T16:21:27.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fe7800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe0106840 0x7f7fe019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fe7800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fe7800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe019cc40 con 0x7f7fe0107a40 2024-02-28T16:21:27.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fe7800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe019cd80 con 0x7f7fe0106840 2024-02-28T16:21:27.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fdfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fdfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe019c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35072/0 (socket says 172.21.15.23:35072) 2024-02-28T16:21:27.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.307+0000 7f7fdfe00700 1 -- 172.21.15.23:0/693445909 learned_addr learned my addr 172.21.15.23:0/693445909 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:27.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.308+0000 7f7fe4e00700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe0106840 0x7f7fe019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.308+0000 7f7fdfe00700 1 -- 172.21.15.23:0/693445909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe0106840 msgr2=0x7f7fe019c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.308+0000 7f7fdfe00700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe0106840 0x7f7fe019c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.308+0000 7f7fdfe00700 1 -- 172.21.15.23:0/693445909 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0095f0 con 0x7f7fe0107a40 2024-02-28T16:21:27.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.308+0000 7f7fdfe00700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe019c620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00bd70 tx=0x7f7fcc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:27.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.309+0000 7f7fdd600700 1 -- 172.21.15.23:0/693445909 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc01d070 con 0x7f7fe0107a40 2024-02-28T16:21:27.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.309+0000 7f7fdd600700 1 -- 172.21.15.23:0/693445909 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7fcc022470 con 0x7f7fe0107a40 2024-02-28T16:21:27.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.309+0000 7f7fdd600700 1 -- 172.21.15.23:0/693445909 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc00f670 con 0x7f7fe0107a40 2024-02-28T16:21:27.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.309+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe01a17d0 con 0x7f7fe0107a40 2024-02-28T16:21:27.301 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.309+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe01a1cc0 con 0x7f7fe0107a40 2024-02-28T16:21:27.302 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.311+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe010f390 con 0x7f7fe0107a40 2024-02-28T16:21:27.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.313+0000 7f7fdd600700 1 -- 172.21.15.23:0/693445909 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7fcc022a50 con 0x7f7fe0107a40 2024-02-28T16:21:27.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.315+0000 7f7fdd600700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7fc806c680 0x7f7fc806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.315+0000 7f7fdd600700 1 -- 172.21.15.23:0/693445909 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7fcc08cf10 con 0x7f7fe0107a40 2024-02-28T16:21:27.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.315+0000 7f7fe4e00700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7fc806c680 0x7f7fc806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.316+0000 7f7fe4e00700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7fc806c680 0x7f7fc806eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4005fd0 tx=0x7f7fd4005dd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:27.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.319+0000 7f7fdd600700 1 -- 172.21.15.23:0/693445909 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7fcc05b0b0 con 0x7f7fe0107a40 2024-02-28T16:21:27.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.654+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7fe010f580 con 0x7f7fe0107a40 2024-02-28T16:21:27.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.655+0000 7f7fdd600700 1 -- 172.21.15.23:0/693445909 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7f7fcc027740 con 0x7f7fe0107a40 2024-02-28T16:21:27.646 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:21:27.646 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:21:27.646 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:21:27.647 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:21:27.648 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7fc806c680 msgr2=0x7f7fc806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7fc806c680 0x7f7fc806eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4005fd0 tx=0x7f7fd4005dd0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 msgr2=0x7f7fe019c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe019c620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00bd70 tx=0x7f7fcc00be50 comp rx=0 tx=0).stop 2024-02-28T16:21:27.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 shutdown_connections 2024-02-28T16:21:27.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7fc806c680 0x7f7fc806eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe0106840 0x7f7fe019c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 --2- 172.21.15.23:0/693445909 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7fe0107a40 0x7f7fe019c620 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.659+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 >> 172.21.15.23:0/693445909 conn(0x7f7fe0075970 msgr2=0x7f7fe010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:27.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.660+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 shutdown_connections 2024-02-28T16:21:27.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.660+0000 7f7fe7800700 1 -- 172.21.15.23:0/693445909 wait complete. 2024-02-28T16:21:27.651 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:21:27.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.846+0000 7fe05a800700 1 -- 172.21.15.23:0/3502708548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 msgr2=0x7fe0540ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.846+0000 7fe05a800700 1 --2- 172.21.15.23:0/3502708548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe0540ff710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe040009910 tx=0x7fe040009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:27.838 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:27 smithi023 ceph-mon[29137]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:27.838 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:27 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1305607421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:21:27.838 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:27 smithi023 ceph-mon[29137]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-28T16:21:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.847+0000 7fe05a800700 1 -- 172.21.15.23:0/3502708548 shutdown_connections 2024-02-28T16:21:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.847+0000 7fe05a800700 1 --2- 172.21.15.23:0/3502708548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe0540ff710 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.847+0000 7fe05a800700 1 --2- 172.21.15.23:0/3502708548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0540fe950 0x7fe0540fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.847+0000 7fe05a800700 1 -- 172.21.15.23:0/3502708548 >> 172.21.15.23:0/3502708548 conn(0x7fe0540fa520 msgr2=0x7fe0540fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.847+0000 7fe05a800700 1 -- 172.21.15.23:0/3502708548 shutdown_connections 2024-02-28T16:21:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.847+0000 7fe05a800700 1 -- 172.21.15.23:0/3502708548 wait complete. 2024-02-28T16:21:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.848+0000 7fe05a800700 1 Processor -- start 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.848+0000 7fe05a800700 1 -- start start 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.849+0000 7fe05a800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0540fe950 0x7fe054197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.849+0000 7fe05a800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe054197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.849+0000 7fe05a800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054198600 con 0x7fe0540ff2a0 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.849+0000 7fe05a800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054198740 con 0x7fe0540fe950 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.849+0000 7fe058a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe054197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.849+0000 7fe058a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe054197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35090/0 (socket says 172.21.15.23:35090) 2024-02-28T16:21:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.849+0000 7fe058a00700 1 -- 172.21.15.23:0/1406985039 learned_addr learned my addr 172.21.15.23:0/1406985039 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:27.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.850+0000 7fe059400700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0540fe950 0x7fe054197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.850+0000 7fe058a00700 1 -- 172.21.15.23:0/1406985039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0540fe950 msgr2=0x7fe054197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.850+0000 7fe058a00700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0540fe950 0x7fe054197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.850+0000 7fe058a00700 1 -- 172.21.15.23:0/1406985039 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0400095f0 con 0x7fe0540ff2a0 2024-02-28T16:21:27.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.850+0000 7fe058a00700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe054197fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe040005b40 tx=0x7fe04000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:27.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.851+0000 7fe052000700 1 -- 172.21.15.23:0/1406985039 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04001d070 con 0x7fe0540ff2a0 2024-02-28T16:21:27.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.851+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05419d190 con 0x7fe0540ff2a0 2024-02-28T16:21:27.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.851+0000 7fe052000700 1 -- 172.21.15.23:0/1406985039 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe040022470 con 0x7fe0540ff2a0 2024-02-28T16:21:27.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.851+0000 7fe052000700 1 -- 172.21.15.23:0/1406985039 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04000f670 con 0x7fe0540ff2a0 2024-02-28T16:21:27.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.851+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05419d700 con 0x7fe0540ff2a0 2024-02-28T16:21:27.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.853+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05410ae20 con 0x7fe0540ff2a0 2024-02-28T16:21:27.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.854+0000 7fe052000700 1 -- 172.21.15.23:0/1406985039 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe040004b70 con 0x7fe0540ff2a0 2024-02-28T16:21:27.846 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.855+0000 7fe052000700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe03c06c680 0x7fe03c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.846 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.855+0000 7fe052000700 1 -- 172.21.15.23:0/1406985039 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe04008cfd0 con 0x7fe0540ff2a0 2024-02-28T16:21:27.846 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.856+0000 7fe059400700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe03c06c680 0x7fe03c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.847 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.857+0000 7fe059400700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe03c06c680 0x7fe03c06eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe048006fd0 tx=0x7fe048008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:27.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:27.861+0000 7fe052000700 1 -- 172.21.15.23:0/1406985039 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe0400bf720 con 0x7fe0540ff2a0 2024-02-28T16:21:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:27 smithi153 ceph-mon[35341]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:27 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1305607421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:21:27.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:27 smithi153 ceph-mon[35341]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-28T16:21:28.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.148+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0541086a0 con 0x7fe03c06c680 2024-02-28T16:21:28.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.150+0000 7fe052000700 1 -- 172.21.15.23:0/1406985039 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fe0541086a0 con 0x7fe03c06c680 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [], 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "", 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 image", 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:21:28.141 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:21:28.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe03c06c680 msgr2=0x7fe03c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:28.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe03c06c680 0x7fe03c06eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe048006fd0 tx=0x7fe048008040 comp rx=0 tx=0).stop 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 msgr2=0x7fe054197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe054197fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe040005b40 tx=0x7fe04000be20 comp rx=0 tx=0).stop 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 shutdown_connections 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fe03c06c680 0x7fe03c06eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0540fe950 0x7fe054197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 --2- 172.21.15.23:0/1406985039 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe0540ff2a0 0x7fe054197fe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 >> 172.21.15.23:0/1406985039 conn(0x7fe0540fa520 msgr2=0x7fe054106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 shutdown_connections 2024-02-28T16:21:28.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.153+0000 7fe05a800700 1 -- 172.21.15.23:0/1406985039 wait complete. 2024-02-28T16:21:28.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.336+0000 7f2434e00700 1 -- 172.21.15.23:0/3996596330 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 msgr2=0x7f2430073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.336+0000 7f2434e00700 1 --2- 172.21.15.23:0/3996596330 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430073180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2420009910 tx=0x7f2420009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.336+0000 7f2434e00700 1 -- 172.21.15.23:0/3996596330 shutdown_connections 2024-02-28T16:21:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.336+0000 7f2434e00700 1 --2- 172.21.15.23:0/3996596330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2430073750 0x7f2430073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.336+0000 7f2434e00700 1 --2- 172.21.15.23:0/3996596330 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430073180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.336+0000 7f2434e00700 1 -- 172.21.15.23:0/3996596330 >> 172.21.15.23:0/3996596330 conn(0x7f24300fb5b0 msgr2=0x7f24300fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.337+0000 7f2434e00700 1 -- 172.21.15.23:0/3996596330 shutdown_connections 2024-02-28T16:21:28.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.337+0000 7f2434e00700 1 -- 172.21.15.23:0/3996596330 wait complete. 2024-02-28T16:21:28.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.338+0000 7f2434e00700 1 Processor -- start 2024-02-28T16:21:28.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.338+0000 7f2434e00700 1 -- start start 2024-02-28T16:21:28.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.338+0000 7f2434e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2430073750 0x7f2430197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:28.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.338+0000 7f2434e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:28.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.338+0000 7f2434e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2430198560 con 0x7f2430074d20 2024-02-28T16:21:28.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.338+0000 7f2434e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24301986a0 con 0x7f2430073750 2024-02-28T16:21:28.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.339+0000 7f242ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:28.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.339+0000 7f242ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35122/0 (socket says 172.21.15.23:35122) 2024-02-28T16:21:28.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.339+0000 7f242ea00700 1 -- 172.21.15.23:0/2891203145 learned_addr learned my addr 172.21.15.23:0/2891203145 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:28.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.339+0000 7f242ea00700 1 -- 172.21.15.23:0/2891203145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2430073750 msgr2=0x7f2430197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:28.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.339+0000 7f242ea00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2430073750 0x7f2430197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.339+0000 7f242ea00700 1 -- 172.21.15.23:0/2891203145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200095f0 con 0x7f2430074d20 2024-02-28T16:21:28.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.340+0000 7f242ea00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430197f40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c8a0 tx=0x7f241c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:28.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.340+0000 7f2427e00700 1 -- 172.21.15.23:0/2891203145 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f241c00cea0 con 0x7f2430074d20 2024-02-28T16:21:28.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.340+0000 7f2427e00700 1 -- 172.21.15.23:0/2891203145 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f241c004830 con 0x7f2430074d20 2024-02-28T16:21:28.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.340+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243019d150 con 0x7f2430074d20 2024-02-28T16:21:28.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.340+0000 7f2427e00700 1 -- 172.21.15.23:0/2891203145 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f241c0055b0 con 0x7f2430074d20 2024-02-28T16:21:28.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.341+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243019d6a0 con 0x7f2430074d20 2024-02-28T16:21:28.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.343+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243010ad80 con 0x7f2430074d20 2024-02-28T16:21:28.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.344+0000 7f2427e00700 1 -- 172.21.15.23:0/2891203145 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f241c007ad0 con 0x7f2430074d20 2024-02-28T16:21:28.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.345+0000 7f2427e00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f241406c680 0x7f241406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:28.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.345+0000 7f2427e00700 1 -- 172.21.15.23:0/2891203145 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f241c08cc30 con 0x7f2430074d20 2024-02-28T16:21:28.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.346+0000 7f242f400700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f241406c680 0x7f241406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:28.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.347+0000 7f242f400700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f241406c680 0x7f241406eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f242000b5c0 tx=0x7f2420005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:28.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.350+0000 7f2427e00700 1 -- 172.21.15.23:0/2891203145 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f241c048720 con 0x7f2430074d20 2024-02-28T16:21:28.729 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.738+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f243010afa0 con 0x7f2430074d20 2024-02-28T16:21:28.729 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:28 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/693445909' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:21:28.729 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:28 smithi023 ceph-mon[29137]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:28.730 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.739+0000 7f2427e00700 1 -- 172.21.15.23:0/2891203145 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f241c090060 con 0x7f2430074d20 2024-02-28T16:21:28.730 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:21:28.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.742+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f241406c680 msgr2=0x7f241406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:28.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.742+0000 7f2434e00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f241406c680 0x7f241406eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f242000b5c0 tx=0x7f2420005fd0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.742+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 msgr2=0x7f2430197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:28.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.742+0000 7f2434e00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430197f40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c8a0 tx=0x7f241c00cc60 comp rx=0 tx=0).stop 2024-02-28T16:21:28.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.742+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 shutdown_connections 2024-02-28T16:21:28.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.742+0000 7f2434e00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f241406c680 0x7f241406eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.742+0000 7f2434e00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2430073750 0x7f2430197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.743+0000 7f2434e00700 1 --2- 172.21.15.23:0/2891203145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2430074d20 0x7f2430197f40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:28.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.743+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 >> 172.21.15.23:0/2891203145 conn(0x7f24300fb5b0 msgr2=0x7f2430105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:28.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.743+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 shutdown_connections 2024-02-28T16:21:28.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:28.743+0000 7f2434e00700 1 -- 172.21.15.23:0/2891203145 wait complete. 2024-02-28T16:21:28.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:28 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/693445909' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:21:28.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:28 smithi153 ceph-mon[35341]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:21:29.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:29 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2891203145' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:21:29.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:29 smithi153 ceph-mon[35341]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:29.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:29 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2891203145' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:21:29.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:29 smithi023 ceph-mon[29137]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:32 smithi153 ceph-mon[35341]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:32 smithi023 ceph-mon[29137]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:34.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:34 smithi153 ceph-mon[35341]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:34.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:34 smithi023 ceph-mon[29137]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:35.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:35 smithi153 ceph-mon[35341]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:35.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:35 smithi023 ceph-mon[29137]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:38.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:38 smithi153 ceph-mon[35341]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:38 smithi023 ceph-mon[29137]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:40.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:40 smithi153 ceph-mon[35341]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:40.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:40 smithi023 ceph-mon[29137]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:42.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:42 smithi023 ceph-mon[29137]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:42.412 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:42 smithi153 ceph-mon[35341]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:44.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:44 smithi153 ceph-mon[35341]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:44.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:44 smithi023 ceph-mon[29137]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:45.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:45 smithi153 ceph-mon[35341]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:45.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:45 smithi023 ceph-mon[29137]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:48.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:48 smithi153 ceph-mon[35341]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:48.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:48 smithi023 ceph-mon[29137]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:50.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:50 smithi153 ceph-mon[35341]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:50.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:50 smithi023 ceph-mon[29137]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:52 smithi153 ceph-mon[35341]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:52 smithi023 ceph-mon[29137]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:54.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:54 smithi153 ceph-mon[35341]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:54.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:54 smithi023 ceph-mon[29137]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:55.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:55.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:55 smithi153 ceph-mon[35341]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:55 smithi023 ceph-mon[29137]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:58.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:21:58 smithi153 ceph-mon[35341]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:58.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:21:58 smithi023 ceph-mon[29137]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:21:58.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 -- 172.21.15.23:0/4161643179 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c100ab0 msgr2=0x7f3b3c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:58.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 --2- 172.21.15.23:0/4161643179 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c102e90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009910 tx=0x7f3b2c009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:58.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 -- 172.21.15.23:0/4161643179 shutdown_connections 2024-02-28T16:21:58.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 --2- 172.21.15.23:0/4161643179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c1033d0 0x7f3b3c1057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:58.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 --2- 172.21.15.23:0/4161643179 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c102e90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:58.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 -- 172.21.15.23:0/4161643179 >> 172.21.15.23:0/4161643179 conn(0x7f3b3c0fa4d0 msgr2=0x7f3b3c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:58.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 -- 172.21.15.23:0/4161643179 shutdown_connections 2024-02-28T16:21:58.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.940+0000 7f3b3be00700 1 -- 172.21.15.23:0/4161643179 wait complete. 2024-02-28T16:21:58.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.942+0000 7f3b3be00700 1 Processor -- start 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.942+0000 7f3b3be00700 1 -- start start 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.942+0000 7f3b3be00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.942+0000 7f3b3be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c1033d0 0x7f3b3c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.942+0000 7f3b3be00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c198570 con 0x7f3b3c1033d0 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.942+0000 7f3b3be00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1986b0 con 0x7f3b3c100ab0 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.943+0000 7f3b3aa00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.943+0000 7f3b3a000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c1033d0 0x7f3b3c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.943+0000 7f3b3aa00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:49952/0 (socket says 172.21.15.23:49952) 2024-02-28T16:21:58.933 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.943+0000 7f3b3aa00700 1 -- 172.21.15.23:0/3954928274 learned_addr learned my addr 172.21.15.23:0/3954928274 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:58.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.943+0000 7f3b3aa00700 1 -- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c1033d0 msgr2=0x7f3b3c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:58.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.943+0000 7f3b3aa00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c1033d0 0x7f3b3c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:58.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.943+0000 7f3b3aa00700 1 -- 172.21.15.23:0/3954928274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0095f0 con 0x7f3b3c100ab0 2024-02-28T16:21:58.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.944+0000 7f3b3aa00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c197a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0092e0 tx=0x7f3b2c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:58.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.944+0000 7f3b40a00700 1 -- 172.21.15.23:0/3954928274 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2c01d070 con 0x7f3b3c100ab0 2024-02-28T16:21:58.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.944+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c19d100 con 0x7f3b3c100ab0 2024-02-28T16:21:58.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.944+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c19d5f0 con 0x7f3b3c100ab0 2024-02-28T16:21:58.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.945+0000 7f3b40a00700 1 -- 172.21.15.23:0/3954928274 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b2c005dc0 con 0x7f3b3c100ab0 2024-02-28T16:21:58.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.945+0000 7f3b40a00700 1 -- 172.21.15.23:0/3954928274 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2c017630 con 0x7f3b3c100ab0 2024-02-28T16:21:58.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.946+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c005320 con 0x7f3b3c100ab0 2024-02-28T16:21:58.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.948+0000 7f3b40a00700 1 -- 172.21.15.23:0/3954928274 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3b2c00faf0 con 0x7f3b3c100ab0 2024-02-28T16:21:58.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.950+0000 7f3b40a00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3b2006c680 0x7f3b2006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:58.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.950+0000 7f3b40a00700 1 -- 172.21.15.23:0/3954928274 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3b2c003e40 con 0x7f3b3c100ab0 2024-02-28T16:21:58.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.950+0000 7f3b3a000700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3b2006c680 0x7f3b2006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:58.941 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.951+0000 7f3b3a000700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3b2006c680 0x7f3b2006eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009c60 tx=0x7f3b28009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:58.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:58.962+0000 7f3b40a00700 1 -- 172.21.15.23:0/3954928274 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3b2c05b010 con 0x7f3b3c100ab0 2024-02-28T16:21:59.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.276+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b1c000bf0 con 0x7f3b2006c680 2024-02-28T16:21:59.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.278+0000 7f3b40a00700 1 -- 172.21.15.23:0/3954928274 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f3b1c000bf0 con 0x7f3b2006c680 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3b2006c680 msgr2=0x7f3b2006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3b2006c680 0x7f3b2006eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009c60 tx=0x7f3b28009260 comp rx=0 tx=0).stop 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c100ab0 msgr2=0x7f3b3c197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c197a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0092e0 tx=0x7f3b2c00f690 comp rx=0 tx=0).stop 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 shutdown_connections 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f3b2006c680 0x7f3b2006eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b3c100ab0 0x7f3b3c197a10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 --2- 172.21.15.23:0/3954928274 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3b3c1033d0 0x7f3b3c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.272 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 >> 172.21.15.23:0/3954928274 conn(0x7f3b3c0fa4d0 msgr2=0x7f3b3c104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:59.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 shutdown_connections 2024-02-28T16:21:59.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.282+0000 7f3b3be00700 1 -- 172.21.15.23:0/3954928274 wait complete. 2024-02-28T16:21:59.287 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:21:59.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 -- 172.21.15.23:0/2512808367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de01033d0 msgr2=0x7f7de01057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 --2- 172.21.15.23:0/2512808367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de01033d0 0x7f7de01057b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009910 tx=0x7f7dcc009c20 comp rx=0 tx=0).stop 2024-02-28T16:21:59.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 -- 172.21.15.23:0/2512808367 shutdown_connections 2024-02-28T16:21:59.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 --2- 172.21.15.23:0/2512808367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de01033d0 0x7f7de01057b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 --2- 172.21.15.23:0/2512808367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7de0100ab0 0x7f7de0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 -- 172.21.15.23:0/2512808367 >> 172.21.15.23:0/2512808367 conn(0x7f7de00fa4d0 msgr2=0x7f7de00fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:59.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 -- 172.21.15.23:0/2512808367 shutdown_connections 2024-02-28T16:21:59.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.449+0000 7f7de5200700 1 -- 172.21.15.23:0/2512808367 wait complete. 2024-02-28T16:21:59.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.451+0000 7f7de5200700 1 Processor -- start 2024-02-28T16:21:59.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.451+0000 7f7de5200700 1 -- start start 2024-02-28T16:21:59.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.451+0000 7f7de5200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de0100ab0 0x7f7de0197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:59.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.451+0000 7f7de5200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7de01033d0 0x7f7de0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.451+0000 7f7de5200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0198590 con 0x7f7de0100ab0 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.451+0000 7f7de5200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de01986d0 con 0x7f7de01033d0 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.451+0000 7f7ddf400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de0100ab0 0x7f7de0197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.452+0000 7f7ddf400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de0100ab0 0x7f7de0197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:34984/0 (socket says 172.21.15.23:34984) 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.452+0000 7f7ddf400700 1 -- 172.21.15.23:0/965834540 learned_addr learned my addr 172.21.15.23:0/965834540 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.452+0000 7f7ddf400700 1 -- 172.21.15.23:0/965834540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7de01033d0 msgr2=0x7f7de0197f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.452+0000 7f7ddf400700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7de01033d0 0x7f7de0197f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.452+0000 7f7ddf400700 1 -- 172.21.15.23:0/965834540 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0095f0 con 0x7f7de0100ab0 2024-02-28T16:21:59.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.453+0000 7f7ddf400700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de0100ab0 0x7f7de0197a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000e920 tx=0x7f7dd000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:59.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.453+0000 7f7dd7e00700 1 -- 172.21.15.23:0/965834540 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd0009790 con 0x7f7de0100ab0 2024-02-28T16:21:59.444 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.453+0000 7f7dd7e00700 1 -- 172.21.15.23:0/965834540 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7dd000cba0 con 0x7f7de0100ab0 2024-02-28T16:21:59.444 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.453+0000 7f7dd7e00700 1 -- 172.21.15.23:0/965834540 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd0018630 con 0x7f7de0100ab0 2024-02-28T16:21:59.444 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.453+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de019d180 con 0x7f7de0100ab0 2024-02-28T16:21:59.444 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.454+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de019d6d0 con 0x7f7de0100ab0 2024-02-28T16:21:59.445 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.455+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de00fc090 con 0x7f7de0100ab0 2024-02-28T16:21:59.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.457+0000 7f7dd7e00700 1 -- 172.21.15.23:0/965834540 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7dd000cd10 con 0x7f7de0100ab0 2024-02-28T16:21:59.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.458+0000 7f7dd7e00700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7dc406c680 0x7f7dc406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:59.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.458+0000 7f7dd7e00700 1 -- 172.21.15.23:0/965834540 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7dd0014070 con 0x7f7de0100ab0 2024-02-28T16:21:59.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.459+0000 7f7ddea00700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7dc406c680 0x7f7dc406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:59.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.461+0000 7f7ddea00700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7dc406c680 0x7f7dc406eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006010 tx=0x7f7dcc009f70 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:59.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.466+0000 7f7dd7e00700 1 -- 172.21.15.23:0/965834540 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7dd0051720 con 0x7f7de0100ab0 2024-02-28T16:21:59.847 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.857+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7de0061190 con 0x7f7dc406c680 2024-02-28T16:21:59.848 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.858+0000 7f7dd7e00700 1 -- 172.21.15.23:0/965834540 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7de0061190 con 0x7f7dc406c680 2024-02-28T16:21:59.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7dc406c680 msgr2=0x7f7dc406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7dc406c680 0x7f7dc406eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006010 tx=0x7f7dcc009f70 comp rx=0 tx=0).stop 2024-02-28T16:21:59.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de0100ab0 msgr2=0x7f7de0197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de0100ab0 0x7f7de0197a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000e920 tx=0x7f7dd000ece0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 shutdown_connections 2024-02-28T16:21:59.852 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7dc406c680 0x7f7dc406eb30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.852 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7de0100ab0 0x7f7de0197a30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.852 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 --2- 172.21.15.23:0/965834540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7de01033d0 0x7f7de0197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.852 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.861+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 >> 172.21.15.23:0/965834540 conn(0x7f7de00fa4d0 msgr2=0x7f7de0104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:59.852 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.862+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 shutdown_connections 2024-02-28T16:21:59.852 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:21:59.862+0000 7f7de5200700 1 -- 172.21.15.23:0/965834540 wait complete. 2024-02-28T16:22:00.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.089+0000 7f7ab7e00700 1 -- 172.21.15.23:0/2975628863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 msgr2=0x7f7ab81057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.089+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/2975628863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 0x7f7ab81057b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009910 tx=0x7f7aa4009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.090+0000 7f7ab7e00700 1 -- 172.21.15.23:0/2975628863 shutdown_connections 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.090+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/2975628863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 0x7f7ab81057b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.090+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/2975628863 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 0x7f7ab8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.090+0000 7f7ab7e00700 1 -- 172.21.15.23:0/2975628863 >> 172.21.15.23:0/2975628863 conn(0x7f7ab80fa4d0 msgr2=0x7f7ab80fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.091+0000 7f7ab7e00700 1 -- 172.21.15.23:0/2975628863 shutdown_connections 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.091+0000 7f7ab7e00700 1 -- 172.21.15.23:0/2975628863 wait complete. 2024-02-28T16:22:00.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.092+0000 7f7ab7e00700 1 Processor -- start 2024-02-28T16:22:00.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.092+0000 7f7ab7e00700 1 -- start start 2024-02-28T16:22:00.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.093+0000 7f7ab7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 0x7f7ab819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:00.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.093+0000 7f7ab7e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 0x7f7ab819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:00.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.093+0000 7f7ab7e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab819c990 con 0x7f7ab8100ab0 2024-02-28T16:22:00.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.093+0000 7f7ab7e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab819cad0 con 0x7f7ab81033d0 2024-02-28T16:22:00.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.093+0000 7f7ab6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 0x7f7ab819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:00.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.093+0000 7f7ab6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 0x7f7ab819be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48926/0 (socket says 172.21.15.23:48926) 2024-02-28T16:22:00.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.093+0000 7f7ab6a00700 1 -- 172.21.15.23:0/389727221 learned_addr learned my addr 172.21.15.23:0/389727221 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:00.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.094+0000 7f7ab6000700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 0x7f7ab819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:00.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.094+0000 7f7ab6a00700 1 -- 172.21.15.23:0/389727221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 msgr2=0x7f7ab819c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:00.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.094+0000 7f7ab6a00700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 0x7f7ab819c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.094+0000 7f7ab6a00700 1 -- 172.21.15.23:0/389727221 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40095f0 con 0x7f7ab8100ab0 2024-02-28T16:22:00.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.094+0000 7f7ab6000700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 0x7f7ab819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:22:00.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.095+0000 7f7ab6a00700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 0x7f7ab819be30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800e920 tx=0x7f7aa800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:00.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.095+0000 7f7aaf400700 1 -- 172.21.15.23:0/389727221 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa8009790 con 0x7f7ab8100ab0 2024-02-28T16:22:00.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.095+0000 7f7aaf400700 1 -- 172.21.15.23:0/389727221 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7aa800cba0 con 0x7f7ab8100ab0 2024-02-28T16:22:00.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.095+0000 7f7aaf400700 1 -- 172.21.15.23:0/389727221 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa8018630 con 0x7f7ab8100ab0 2024-02-28T16:22:00.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.096+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab81a1580 con 0x7f7ab8100ab0 2024-02-28T16:22:00.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.096+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab81a1ad0 con 0x7f7ab8100ab0 2024-02-28T16:22:00.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.098+0000 7f7aaf400700 1 -- 172.21.15.23:0/389727221 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7aa800cd10 con 0x7f7ab8100ab0 2024-02-28T16:22:00.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.098+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab8108b80 con 0x7f7ab8100ab0 2024-02-28T16:22:00.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.100+0000 7f7aaf400700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7a9c06c680 0x7f7a9c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:00.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.100+0000 7f7aaf400700 1 -- 172.21.15.23:0/389727221 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7aa8014070 con 0x7f7ab8100ab0 2024-02-28T16:22:00.090 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.100+0000 7f7ab6000700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7a9c06c680 0x7f7a9c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:00.091 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.101+0000 7f7ab6000700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7a9c06c680 0x7f7a9c06eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009fd0 tx=0x7f7aa4005fb0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:00.094 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.104+0000 7f7aaf400700 1 -- 172.21.15.23:0/389727221 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7aa805a000 con 0x7f7ab8100ab0 2024-02-28T16:22:00.319 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:00 smithi023 ceph-mon[29137]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:00.319 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:00 smithi023 ceph-mon[29137]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:00.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.485+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ab8061190 con 0x7f7a9c06c680 2024-02-28T16:22:00.486 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.497+0000 7f7aaf400700 1 -- 172.21.15.23:0/389727221 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f7ab8061190 con 0x7f7a9c06c680 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (6m) 73s ago 8m 13.5M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (9m) 73s ago 9m 7490k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (7m) 79s ago 7m 7201k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (9m) 73s ago 9m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (7m) 79s ago 7m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (6m) 73s ago 8m 74.3M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (98s) 73s ago 97s 14.1M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (107s) 73s ago 106s 11.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:22:00.487 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (94s) 79s ago 94s 11.5M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (103s) 79s ago 103s 11.7M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:9283,8765,8443 running (10m) 73s ago 10m 488M - 18.2.0 dc2bc1663786 b278ec72c436 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (7m) 79s ago 7m 437M - 18.2.0 dc2bc1663786 cbabf8088ddf 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (10m) 73s ago 10m 45.3M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (7m) 79s ago 7m 33.8M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (9m) 73s ago 9m 7818k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (7m) 79s ago 7m 7926k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (6m) 73s ago 6m 46.7M 3947M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (5m) 73s ago 5m 46.6M 3947M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (5m) 73s ago 5m 45.8M 3947M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (4m) 79s ago 4m 45.3M 4971M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:22:00.488 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (4m) 79s ago 4m 42.6M 4971M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:22:00.489 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (3m) 79s ago 3m 42.0M 4971M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:22:00.489 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (6m) 73s ago 8m 53.0M - 2.43.0 a07b618ecd1d 8297ca033a9b 2024-02-28T16:22:00.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7a9c06c680 msgr2=0x7f7a9c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:00.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7a9c06c680 0x7f7a9c06eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009fd0 tx=0x7f7aa4005fb0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 msgr2=0x7f7ab819be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:00.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 0x7f7ab819be30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800e920 tx=0x7f7aa800ece0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 shutdown_connections 2024-02-28T16:22:00.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7a9c06c680 0x7f7a9c06eb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7ab8100ab0 0x7f7ab819be30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 --2- 172.21.15.23:0/389727221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab81033d0 0x7f7ab819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.500+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 >> 172.21.15.23:0/389727221 conn(0x7f7ab80fa4d0 msgr2=0x7f7ab80fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:00.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.501+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 shutdown_connections 2024-02-28T16:22:00.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.501+0000 7f7ab7e00700 1 -- 172.21.15.23:0/389727221 wait complete. 2024-02-28T16:22:00.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:00 smithi153 ceph-mon[35341]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:00.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:00 smithi153 ceph-mon[35341]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:00.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 -- 172.21.15.23:0/1762473174 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc7041033d0 msgr2=0x7fc7041057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:00.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 --2- 172.21.15.23:0/1762473174 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc7041033d0 0x7fc7041057b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009910 tx=0x7fc6f0009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:00.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 -- 172.21.15.23:0/1762473174 shutdown_connections 2024-02-28T16:22:00.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 --2- 172.21.15.23:0/1762473174 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc7041033d0 0x7fc7041057b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 --2- 172.21.15.23:0/1762473174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc704100ab0 0x7fc704102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 -- 172.21.15.23:0/1762473174 >> 172.21.15.23:0/1762473174 conn(0x7fc7040fa4d0 msgr2=0x7fc7040fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:00.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 -- 172.21.15.23:0/1762473174 shutdown_connections 2024-02-28T16:22:00.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.680+0000 7fc703200700 1 -- 172.21.15.23:0/1762473174 wait complete. 2024-02-28T16:22:00.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.682+0000 7fc703200700 1 Processor -- start 2024-02-28T16:22:00.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.682+0000 7fc703200700 1 -- start start 2024-02-28T16:22:00.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.682+0000 7fc703200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc704100ab0 0x7fc7041979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:00.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.682+0000 7fc703200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7041033d0 0x7fc704197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:00.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.682+0000 7fc703200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc704198550 con 0x7fc704100ab0 2024-02-28T16:22:00.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.682+0000 7fc703200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc704198690 con 0x7fc7041033d0 2024-02-28T16:22:00.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.683+0000 7fc701e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc704100ab0 0x7fc7041979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:00.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.683+0000 7fc701e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc704100ab0 0x7fc7041979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48952/0 (socket says 172.21.15.23:48952) 2024-02-28T16:22:00.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.683+0000 7fc701e00700 1 -- 172.21.15.23:0/501559621 learned_addr learned my addr 172.21.15.23:0/501559621 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:00.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.683+0000 7fc701400700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7041033d0 0x7fc704197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:00.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.683+0000 7fc701e00700 1 -- 172.21.15.23:0/501559621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7041033d0 msgr2=0x7fc704197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:00.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.683+0000 7fc701e00700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7041033d0 0x7fc704197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:00.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.683+0000 7fc701e00700 1 -- 172.21.15.23:0/501559621 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00095f0 con 0x7fc704100ab0 2024-02-28T16:22:00.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.684+0000 7fc701e00700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc704100ab0 0x7fc7041979f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400c8a0 tx=0x7fc6f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:00.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.684+0000 7fc6faa00700 1 -- 172.21.15.23:0/501559621 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f400cea0 con 0x7fc704100ab0 2024-02-28T16:22:00.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.684+0000 7fc6faa00700 1 -- 172.21.15.23:0/501559621 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6f4004830 con 0x7fc704100ab0 2024-02-28T16:22:00.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.684+0000 7fc6faa00700 1 -- 172.21.15.23:0/501559621 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f40055b0 con 0x7fc704100ab0 2024-02-28T16:22:00.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.684+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70419d140 con 0x7fc704100ab0 2024-02-28T16:22:00.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.685+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70419d690 con 0x7fc704100ab0 2024-02-28T16:22:00.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.686+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7040fc090 con 0x7fc704100ab0 2024-02-28T16:22:00.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.688+0000 7fc6faa00700 1 -- 172.21.15.23:0/501559621 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc6f4007ad0 con 0x7fc704100ab0 2024-02-28T16:22:00.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.690+0000 7fc6faa00700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc6e806c6d0 0x7fc6e806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:00.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.690+0000 7fc6faa00700 1 -- 172.21.15.23:0/501559621 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc6f408b630 con 0x7fc704100ab0 2024-02-28T16:22:00.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.690+0000 7fc701400700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc6e806c6d0 0x7fc6e806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:00.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.691+0000 7fc701400700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc6e806c6d0 0x7fc6e806eb80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0006010 tx=0x7fc6f000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:00.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:00.694+0000 7fc6faa00700 1 -- 172.21.15.23:0/501559621 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc6f4059720 con 0x7fc704100ab0 2024-02-28T16:22:01.107 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.117+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc70402cc30 con 0x7fc704100ab0 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:22:01.108 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:22:01.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.118+0000 7fc6faa00700 1 -- 172.21.15.23:0/501559621 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fc6f40592b0 con 0x7fc704100ab0 2024-02-28T16:22:01.111 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc6e806c6d0 msgr2=0x7fc6e806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:01.111 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc6e806c6d0 0x7fc6e806eb80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0006010 tx=0x7fc6f000b540 comp rx=0 tx=0).stop 2024-02-28T16:22:01.111 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc704100ab0 msgr2=0x7fc7041979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc704100ab0 0x7fc7041979f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400c8a0 tx=0x7fc6f400cc60 comp rx=0 tx=0).stop 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 shutdown_connections 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fc6e806c6d0 0x7fc6e806eb80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc704100ab0 0x7fc7041979f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 --2- 172.21.15.23:0/501559621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7041033d0 0x7fc704197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.121+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 >> 172.21.15.23:0/501559621 conn(0x7fc7040fa4d0 msgr2=0x7fc704100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.122+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 shutdown_connections 2024-02-28T16:22:01.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.122+0000 7fc703200700 1 -- 172.21.15.23:0/501559621 wait complete. 2024-02-28T16:22:01.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 -- 172.21.15.23:0/1912095257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54100d60 msgr2=0x7fcc54103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:01.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 --2- 172.21.15.23:0/1912095257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54100d60 0x7fcc54103140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009910 tx=0x7fcc44009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:01.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 -- 172.21.15.23:0/1912095257 shutdown_connections 2024-02-28T16:22:01.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 --2- 172.21.15.23:0/1912095257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc54103680 0x7fcc54105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 --2- 172.21.15.23:0/1912095257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54100d60 0x7fcc54103140 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 -- 172.21.15.23:0/1912095257 >> 172.21.15.23:0/1912095257 conn(0x7fcc540fa780 msgr2=0x7fcc540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:01.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 -- 172.21.15.23:0/1912095257 shutdown_connections 2024-02-28T16:22:01.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.283+0000 7fcc59400700 1 -- 172.21.15.23:0/1912095257 wait complete. 2024-02-28T16:22:01.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.284+0000 7fcc59400700 1 Processor -- start 2024-02-28T16:22:01.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.285+0000 7fcc59400700 1 -- start start 2024-02-28T16:22:01.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.285+0000 7fcc59400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc54100d60 0x7fcc541006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:01.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.285+0000 7fcc59400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54103680 0x7fcc540fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:01.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.285+0000 7fcc59400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540ff250 con 0x7fcc54103680 2024-02-28T16:22:01.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.285+0000 7fcc59400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540ff390 con 0x7fcc54100d60 2024-02-28T16:22:01.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.286+0000 7fcc51e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54103680 0x7fcc540fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:01.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.286+0000 7fcc51e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54103680 0x7fcc540fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48970/0 (socket says 172.21.15.23:48970) 2024-02-28T16:22:01.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.286+0000 7fcc51e00700 1 -- 172.21.15.23:0/3316140592 learned_addr learned my addr 172.21.15.23:0/3316140592 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:01.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.286+0000 7fcc52800700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc54100d60 0x7fcc541006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:01.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.286+0000 7fcc51e00700 1 -- 172.21.15.23:0/3316140592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc54100d60 msgr2=0x7fcc541006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:01.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.286+0000 7fcc51e00700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc54100d60 0x7fcc541006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.286+0000 7fcc51e00700 1 -- 172.21.15.23:0/3316140592 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440095f0 con 0x7fcc54103680 2024-02-28T16:22:01.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.287+0000 7fcc51e00700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54103680 0x7fcc540fed10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000d8d0 tx=0x7fcc4000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:01.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.287+0000 7fcc4b400700 1 -- 172.21.15.23:0/3316140592 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc400098a0 con 0x7fcc54103680 2024-02-28T16:22:01.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.287+0000 7fcc4b400700 1 -- 172.21.15.23:0/3316140592 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc40010460 con 0x7fcc54103680 2024-02-28T16:22:01.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.287+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc540ff670 con 0x7fcc54103680 2024-02-28T16:22:01.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.288+0000 7fcc4b400700 1 -- 172.21.15.23:0/3316140592 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc4000f5f0 con 0x7fcc54103680 2024-02-28T16:22:01.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.288+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5419db10 con 0x7fcc54103680 2024-02-28T16:22:01.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.289+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5418fbc0 con 0x7fcc54103680 2024-02-28T16:22:01.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.291+0000 7fcc4b400700 1 -- 172.21.15.23:0/3316140592 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcc40009a00 con 0x7fcc54103680 2024-02-28T16:22:01.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.293+0000 7fcc4b400700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc3806c6d0 0x7fcc3806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:01.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.293+0000 7fcc4b400700 1 -- 172.21.15.23:0/3316140592 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcc4008b7a0 con 0x7fcc54103680 2024-02-28T16:22:01.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.293+0000 7fcc52800700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc3806c6d0 0x7fcc3806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:01.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.295+0000 7fcc52800700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc3806c6d0 0x7fcc3806eb80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc44006010 tx=0x7fcc4400b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:01.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.295+0000 7fcc4b400700 1 -- 172.21.15.23:0/3316140592 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcc400599c0 con 0x7fcc54103680 2024-02-28T16:22:01.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:01 smithi023 ceph-mon[29137]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:01.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:01 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/501559621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:22:01.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.635+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc5402cc30 con 0x7fcc54103680 2024-02-28T16:22:01.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.636+0000 7fcc4b400700 1 -- 172.21.15.23:0/3316140592 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7fcc40059550 con 0x7fcc54103680 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:22:01.626 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:22:01.627 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:01.628 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:01.629 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:01.629 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:01.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.638+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc3806c6d0 msgr2=0x7fcc3806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:01.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.638+0000 7fcc59400700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc3806c6d0 0x7fcc3806eb80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc44006010 tx=0x7fcc4400b560 comp rx=0 tx=0).stop 2024-02-28T16:22:01.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.638+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54103680 msgr2=0x7fcc540fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.638+0000 7fcc59400700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54103680 0x7fcc540fed10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000d8d0 tx=0x7fcc4000dbe0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.639+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 shutdown_connections 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.639+0000 7fcc59400700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fcc3806c6d0 0x7fcc3806eb80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.639+0000 7fcc59400700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc54100d60 0x7fcc541006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.639+0000 7fcc59400700 1 --2- 172.21.15.23:0/3316140592 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcc54103680 0x7fcc540fed10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.639+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 >> 172.21.15.23:0/3316140592 conn(0x7fcc540fa780 msgr2=0x7fcc540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.639+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 shutdown_connections 2024-02-28T16:22:01.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.639+0000 7fcc59400700 1 -- 172.21.15.23:0/3316140592 wait complete. 2024-02-28T16:22:01.631 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:22:01.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:01 smithi153 ceph-mon[35341]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:01.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:01 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/501559621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.822+0000 7efe40e00700 1 -- 172.21.15.23:0/2196241079 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 msgr2=0x7efe3c073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.822+0000 7efe40e00700 1 --2- 172.21.15.23:0/2196241079 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c073c20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efe28009940 tx=0x7efe28009c50 comp rx=0 tx=0).stop 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.822+0000 7efe40e00700 1 -- 172.21.15.23:0/2196241079 shutdown_connections 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.822+0000 7efe40e00700 1 --2- 172.21.15.23:0/2196241079 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c073c20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.822+0000 7efe40e00700 1 --2- 172.21.15.23:0/2196241079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c074d80 0x7efe3c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.823+0000 7efe40e00700 1 -- 172.21.15.23:0/2196241079 >> 172.21.15.23:0/2196241079 conn(0x7efe3c0fb7f0 msgr2=0x7efe3c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.823+0000 7efe40e00700 1 -- 172.21.15.23:0/2196241079 shutdown_connections 2024-02-28T16:22:01.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.823+0000 7efe40e00700 1 -- 172.21.15.23:0/2196241079 wait complete. 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.824+0000 7efe40e00700 1 Processor -- start 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.824+0000 7efe40e00700 1 -- start start 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.824+0000 7efe40e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe40e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c074d80 0x7efe3c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe40e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1987e0 con 0x7efe3c0737b0 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe40e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c198950 con 0x7efe3c074d80 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe39e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe39e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:49002/0 (socket says 172.21.15.23:49002) 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe39e00700 1 -- 172.21.15.23:0/1726799933 learned_addr learned my addr 172.21.15.23:0/1726799933 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:01.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe39e00700 1 -- 172.21.15.23:0/1726799933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c074d80 msgr2=0x7efe3c1981e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-28T16:22:01.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe39e00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c074d80 0x7efe3c1981e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:01.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.825+0000 7efe39e00700 1 -- 172.21.15.23:0/1726799933 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe280095f0 con 0x7efe3c0737b0 2024-02-28T16:22:01.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.826+0000 7efe39e00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c197ca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00d8d0 tx=0x7efe2c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:01.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.826+0000 7efe32a00700 1 -- 172.21.15.23:0/1726799933 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c009940 con 0x7efe3c0737b0 2024-02-28T16:22:01.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.826+0000 7efe32a00700 1 -- 172.21.15.23:0/1726799933 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efe2c010460 con 0x7efe3c0737b0 2024-02-28T16:22:01.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.826+0000 7efe32a00700 1 -- 172.21.15.23:0/1726799933 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c00f5f0 con 0x7efe3c0737b0 2024-02-28T16:22:01.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.826+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c19d3e0 con 0x7efe3c0737b0 2024-02-28T16:22:01.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.826+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c19d930 con 0x7efe3c0737b0 2024-02-28T16:22:01.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.827+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c10af80 con 0x7efe3c0737b0 2024-02-28T16:22:01.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.828+0000 7efe32a00700 1 -- 172.21.15.23:0/1726799933 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efe2c0105d0 con 0x7efe3c0737b0 2024-02-28T16:22:01.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.829+0000 7efe32a00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efe2006c680 0x7efe2006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:01.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.829+0000 7efe32a00700 1 -- 172.21.15.23:0/1726799933 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7efe2c08b260 con 0x7efe3c0737b0 2024-02-28T16:22:01.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.829+0000 7efe39400700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efe2006c680 0x7efe2006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:01.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.830+0000 7efe39400700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efe2006c680 0x7efe2006eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe2800b580 tx=0x7efe28005e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:01.823 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:01.834+0000 7efe32a00700 1 -- 172.21.15.23:0/1726799933 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efe2c055960 con 0x7efe3c0737b0 2024-02-28T16:22:02.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.140+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe3c107740 con 0x7efe2006c680 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.142+0000 7efe32a00700 1 -- 172.21.15.23:0/1726799933 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7efe3c107740 con 0x7efe2006c680 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [], 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "", 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 image", 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:22:02.132 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efe2006c680 msgr2=0x7efe2006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efe2006c680 0x7efe2006eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe2800b580 tx=0x7efe28005e40 comp rx=0 tx=0).stop 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 msgr2=0x7efe3c197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c197ca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00d8d0 tx=0x7efe2c00dc90 comp rx=0 tx=0).stop 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 shutdown_connections 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7efe2006c680 0x7efe2006eb30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efe3c0737b0 0x7efe3c197ca0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 --2- 172.21.15.23:0/1726799933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c074d80 0x7efe3c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.136 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 >> 172.21.15.23:0/1726799933 conn(0x7efe3c0fb7f0 msgr2=0x7efe3c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:02.136 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 shutdown_connections 2024-02-28T16:22:02.136 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.145+0000 7efe40e00700 1 -- 172.21.15.23:0/1726799933 wait complete. 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.319+0000 7f94a2800700 1 -- 172.21.15.23:0/1321726709 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c1003d0 msgr2=0x7f949c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.319+0000 7f94a2800700 1 --2- 172.21.15.23:0/1321726709 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c1003d0 0x7f949c100840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9488009910 tx=0x7f9488009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.320+0000 7f94a2800700 1 -- 172.21.15.23:0/1321726709 shutdown_connections 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.320+0000 7f94a2800700 1 --2- 172.21.15.23:0/1321726709 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c1003d0 0x7f949c100840 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.320+0000 7f94a2800700 1 --2- 172.21.15.23:0/1321726709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f949c0ff130 0x7f949c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.320+0000 7f94a2800700 1 -- 172.21.15.23:0/1321726709 >> 172.21.15.23:0/1321726709 conn(0x7f949c0fa780 msgr2=0x7f949c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.320+0000 7f94a2800700 1 -- 172.21.15.23:0/1321726709 shutdown_connections 2024-02-28T16:22:02.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.320+0000 7f94a2800700 1 -- 172.21.15.23:0/1321726709 wait complete. 2024-02-28T16:22:02.311 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.321+0000 7f94a2800700 1 Processor -- start 2024-02-28T16:22:02.311 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.322+0000 7f94a2800700 1 -- start start 2024-02-28T16:22:02.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.322+0000 7f94a2800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c0ff130 0x7f949c195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:02.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.322+0000 7f94a2800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f949c1003d0 0x7f949c195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:02.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.322+0000 7f94a2800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1965e0 con 0x7f949c0ff130 2024-02-28T16:22:02.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.322+0000 7f94a2800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c196720 con 0x7f949c1003d0 2024-02-28T16:22:02.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.322+0000 7f949aa00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f949c1003d0 0x7f949c195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:02.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.323+0000 7f949aa00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f949c1003d0 0x7f949c195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:43678/0 (socket says 172.21.15.23:43678) 2024-02-28T16:22:02.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.323+0000 7f949aa00700 1 -- 172.21.15.23:0/2687946661 learned_addr learned my addr 172.21.15.23:0/2687946661 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:02.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.323+0000 7f949b400700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c0ff130 0x7f949c195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:02.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.323+0000 7f949b400700 1 -- 172.21.15.23:0/2687946661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f949c1003d0 msgr2=0x7f949c195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:02.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.323+0000 7f949b400700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f949c1003d0 0x7f949c195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.323+0000 7f949b400700 1 -- 172.21.15.23:0/2687946661 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880095f0 con 0x7f949c0ff130 2024-02-28T16:22:02.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.324+0000 7f949b400700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c0ff130 0x7f949c195a80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f948c00d8d0 tx=0x7f948c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:02.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.324+0000 7f9493e00700 1 -- 172.21.15.23:0/2687946661 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c00f860 con 0x7f949c0ff130 2024-02-28T16:22:02.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.324+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c19b1d0 con 0x7f949c0ff130 2024-02-28T16:22:02.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.325+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c19b720 con 0x7f949c0ff130 2024-02-28T16:22:02.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.326+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c107c10 con 0x7f949c0ff130 2024-02-28T16:22:02.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.326+0000 7f9493e00700 1 -- 172.21.15.23:0/2687946661 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f948c00fe70 con 0x7f949c0ff130 2024-02-28T16:22:02.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.326+0000 7f9493e00700 1 -- 172.21.15.23:0/2687946661 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c00e5e0 con 0x7f949c0ff130 2024-02-28T16:22:02.319 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.329+0000 7f9493e00700 1 -- 172.21.15.23:0/2687946661 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f948c0108b0 con 0x7f949c0ff130 2024-02-28T16:22:02.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.329+0000 7f9493e00700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f948006c6d0 0x7f948006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:02.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.330+0000 7f9493e00700 1 -- 172.21.15.23:0/2687946661 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f948c08b840 con 0x7f949c0ff130 2024-02-28T16:22:02.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.330+0000 7f949aa00700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f948006c6d0 0x7f948006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:02.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.331+0000 7f949aa00700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f948006c6d0 0x7f948006eb80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f948800b5c0 tx=0x7f9488005fb0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:02.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.336+0000 7f9493e00700 1 -- 172.21.15.23:0/2687946661 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f948c059720 con 0x7f949c0ff130 2024-02-28T16:22:02.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:02 smithi153 ceph-mon[35341]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:02.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:02 smithi153 ceph-mon[35341]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:02.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:02 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3316140592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:02 smithi023 ceph-mon[29137]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:02 smithi023 ceph-mon[29137]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:02 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3316140592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:02.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.793+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f949c107e00 con 0x7f949c0ff130 2024-02-28T16:22:02.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.793+0000 7f9493e00700 1 -- 172.21.15.23:0/2687946661 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f948c059540 con 0x7f949c0ff130 2024-02-28T16:22:02.783 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:22:02.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.795+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f948006c6d0 msgr2=0x7f948006eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:02.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.795+0000 7f94a2800700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f948006c6d0 0x7f948006eb80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f948800b5c0 tx=0x7f9488005fb0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.795+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c0ff130 msgr2=0x7f949c195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:02.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.795+0000 7f94a2800700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c0ff130 0x7f949c195a80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f948c00d8d0 tx=0x7f948c00dbe0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.796+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 shutdown_connections 2024-02-28T16:22:02.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.796+0000 7f94a2800700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f948006c6d0 0x7f948006eb80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.796+0000 7f94a2800700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f949c0ff130 0x7f949c195a80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.796+0000 7f94a2800700 1 --2- 172.21.15.23:0/2687946661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f949c1003d0 0x7f949c195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:02.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.796+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 >> 172.21.15.23:0/2687946661 conn(0x7f949c0fa780 msgr2=0x7f949c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:02.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.796+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 shutdown_connections 2024-02-28T16:22:02.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:02.796+0000 7f94a2800700 1 -- 172.21.15.23:0/2687946661 wait complete. 2024-02-28T16:22:03.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:03 smithi153 ceph-mon[35341]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:03.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:03.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:03.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:03.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:03 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2687946661' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:22:03.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:03 smithi023 ceph-mon[29137]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:03.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:03.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:03.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:03.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:03 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2687946661' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:22:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:04 smithi153 ceph-mon[35341]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T16:22:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:04 smithi153 ceph-mon[35341]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T16:22:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:04 smithi153 ceph-mon[35341]: Upgrade: Need to upgrade myself (mgr.smithi023.bbebnt) 2024-02-28T16:22:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:04 smithi153 ceph-mon[35341]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi153 2024-02-28T16:22:04.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:04 smithi153 ceph-mon[35341]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:04.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:04 smithi023 ceph-mon[29137]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T16:22:04.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:04 smithi023 ceph-mon[29137]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T16:22:04.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:04 smithi023 ceph-mon[29137]: Upgrade: Need to upgrade myself (mgr.smithi023.bbebnt) 2024-02-28T16:22:04.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:04 smithi023 ceph-mon[29137]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi153 2024-02-28T16:22:04.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:04 smithi023 ceph-mon[29137]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:05.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:05 smithi153 ceph-mon[35341]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:05.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:05 smithi023 ceph-mon[29137]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:08.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:08 smithi153 ceph-mon[35341]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:08.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:08 smithi023 ceph-mon[29137]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:10.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:10 smithi153 ceph-mon[35341]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:10.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:10 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:10 smithi023 ceph-mon[29137]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:10 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:12.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:12 smithi153 ceph-mon[35341]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:12.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:12 smithi023 ceph-mon[29137]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:14.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:14 smithi153 ceph-mon[35341]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:14 smithi023 ceph-mon[29137]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:15 smithi153 ceph-mon[35341]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:15.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:15 smithi023 ceph-mon[29137]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:18.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:18 smithi153 ceph-mon[35341]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:18.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:18 smithi023 ceph-mon[29137]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:20.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:20 smithi153 ceph-mon[35341]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:20.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:20 smithi023 ceph-mon[29137]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:22.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:22 smithi153 ceph-mon[35341]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:22.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:22 smithi023 ceph-mon[29137]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:24.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:24 smithi153 ceph-mon[35341]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:24.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:24 smithi023 ceph-mon[29137]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:25.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:25 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:25.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:25 smithi153 ceph-mon[35341]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:25.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:25 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:25.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:25 smithi023 ceph-mon[29137]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:28.325 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:28 smithi153 ceph-mon[35341]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:28 smithi023 ceph-mon[29137]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:30.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:30 smithi153 ceph-mon[35341]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:30.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:30 smithi023 ceph-mon[29137]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:31.883 INFO:tasks.workunit.client.0.smithi023.stderr:Updating files: 59% (7298/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 97% (11995/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T16:22:32.465 INFO:tasks.workunit.client.0.smithi023.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T16:22:32.465 INFO:tasks.workunit.client.0.smithi023.stderr: 2024-02-28T16:22:32.465 INFO:tasks.workunit.client.0.smithi023.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T16:22:32.465 INFO:tasks.workunit.client.0.smithi023.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T16:22:32.465 INFO:tasks.workunit.client.0.smithi023.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T16:22:32.465 INFO:tasks.workunit.client.0.smithi023.stderr: 2024-02-28T16:22:32.465 INFO:tasks.workunit.client.0.smithi023.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr: 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr: git switch -c 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr: 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr:Or undo this operation with: 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr: 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr: git switch - 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr: 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr: 2024-02-28T16:22:32.466 INFO:tasks.workunit.client.0.smithi023.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T16:22:32.469 DEBUG:teuthology.orchestra.run.smithi023:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-28T16:22:32.531 INFO:tasks.workunit.client.0.smithi023.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T16:22:32.539 INFO:tasks.workunit.client.0.smithi023.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T16:22:32.539 INFO:tasks.workunit.client.0.smithi023.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T16:22:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:32 smithi153 ceph-mon[35341]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:32 smithi023 ceph-mon[29137]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:32.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.977+0000 7f832f200700 1 -- 172.21.15.23:0/3145711706 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 msgr2=0x7f8330105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:32.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.977+0000 7f832f200700 1 --2- 172.21.15.23:0/3145711706 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330105800 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f831c009910 tx=0x7f831c009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:32.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.978+0000 7f832f200700 1 -- 172.21.15.23:0/3145711706 shutdown_connections 2024-02-28T16:22:32.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.978+0000 7f832f200700 1 --2- 172.21.15.23:0/3145711706 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330105800 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:32.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.978+0000 7f832f200700 1 --2- 172.21.15.23:0/3145711706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8330100b00 0x7f8330102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:32.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.978+0000 7f832f200700 1 -- 172.21.15.23:0/3145711706 >> 172.21.15.23:0/3145711706 conn(0x7f83300fa520 msgr2=0x7f83300fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:32.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.978+0000 7f832f200700 1 -- 172.21.15.23:0/3145711706 shutdown_connections 2024-02-28T16:22:32.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.978+0000 7f832f200700 1 -- 172.21.15.23:0/3145711706 wait complete. 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.979+0000 7f832f200700 1 Processor -- start 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.979+0000 7f832f200700 1 -- start start 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.979+0000 7f832f200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8330100b00 0x7f8330197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.979+0000 7f832f200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.979+0000 7f832f200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8330198580 con 0x7f8330103420 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.979+0000 7f832f200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83301986c0 con 0x7f8330100b00 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832de00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8330100b00 0x7f8330197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:46986/0 (socket says 172.21.15.23:46986) 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832d400700 1 -- 172.21.15.23:0/3936679188 learned_addr learned my addr 172.21.15.23:0/3936679188 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:32.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832de00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8330100b00 0x7f8330197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:51884/0 (socket says 172.21.15.23:51884) 2024-02-28T16:22:32.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832d400700 1 -- 172.21.15.23:0/3936679188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8330100b00 msgr2=0x7f8330197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:32.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832d400700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8330100b00 0x7f8330197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:32.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.980+0000 7f832d400700 1 -- 172.21.15.23:0/3936679188 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0095f0 con 0x7f8330103420 2024-02-28T16:22:32.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.981+0000 7f832d400700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330197f60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f831c0092e0 tx=0x7f831c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:32.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.981+0000 7f8326a00700 1 -- 172.21.15.23:0/3936679188 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f831c01d070 con 0x7f8330103420 2024-02-28T16:22:32.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.981+0000 7f8326a00700 1 -- 172.21.15.23:0/3936679188 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f831c005dc0 con 0x7f8330103420 2024-02-28T16:22:32.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.981+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833019d110 con 0x7f8330103420 2024-02-28T16:22:32.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.981+0000 7f8326a00700 1 -- 172.21.15.23:0/3936679188 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f831c017630 con 0x7f8330103420 2024-02-28T16:22:32.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.981+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833019d600 con 0x7f8330103420 2024-02-28T16:22:32.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.982+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83300fc0e0 con 0x7f8330103420 2024-02-28T16:22:32.973 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.984+0000 7f8326a00700 1 -- 172.21.15.23:0/3936679188 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f831c003680 con 0x7f8330103420 2024-02-28T16:22:32.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.984+0000 7f8326a00700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f831406c680 0x7f831406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:32.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.985+0000 7f8326a00700 1 -- 172.21.15.23:0/3936679188 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f831c08cd60 con 0x7f8330103420 2024-02-28T16:22:32.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.985+0000 7f832de00700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f831406c680 0x7f831406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:32.975 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.986+0000 7f832de00700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f831406c680 0x7f831406eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8320009c60 tx=0x7f8320009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:32.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:32.990+0000 7f8326a00700 1 -- 172.21.15.23:0/3936679188 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f831c091070 con 0x7f8330103420 2024-02-28T16:22:33.212 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.222+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8330061190 con 0x7f831406c680 2024-02-28T16:22:33.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.223+0000 7f8326a00700 1 -- 172.21.15.23:0/3936679188 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f8330061190 con 0x7f831406c680 2024-02-28T16:22:33.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f831406c680 msgr2=0x7f831406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f831406c680 0x7f831406eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8320009c60 tx=0x7f8320009260 comp rx=0 tx=0).stop 2024-02-28T16:22:33.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 msgr2=0x7f8330197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330197f60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f831c0092e0 tx=0x7f831c00f690 comp rx=0 tx=0).stop 2024-02-28T16:22:33.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 shutdown_connections 2024-02-28T16:22:33.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f831406c680 0x7f831406eb30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8330100b00 0x7f8330197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 --2- 172.21.15.23:0/3936679188 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8330103420 0x7f8330197f60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 >> 172.21.15.23:0/3936679188 conn(0x7f83300fa520 msgr2=0x7f83300ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:33.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 shutdown_connections 2024-02-28T16:22:33.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.226+0000 7f832f200700 1 -- 172.21.15.23:0/3936679188 wait complete. 2024-02-28T16:22:33.230 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 -- 172.21.15.23:0/102497455 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 msgr2=0x7f62fc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 --2- 172.21.15.23:0/102497455 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc100650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009910 tx=0x7f62ec009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 -- 172.21.15.23:0/102497455 shutdown_connections 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 --2- 172.21.15.23:0/102497455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc101440 0x7f62fc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 --2- 172.21.15.23:0/102497455 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc100650 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 -- 172.21.15.23:0/102497455 >> 172.21.15.23:0/102497455 conn(0x7f62fc0fb7f0 msgr2=0x7f62fc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 -- 172.21.15.23:0/102497455 shutdown_connections 2024-02-28T16:22:33.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.381+0000 7f6301a00700 1 -- 172.21.15.23:0/102497455 wait complete. 2024-02-28T16:22:33.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.382+0000 7f6301a00700 1 Processor -- start 2024-02-28T16:22:33.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.382+0000 7f6301a00700 1 -- start start 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.382+0000 7f6301a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.382+0000 7f6301a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc101440 0x7f62fc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.382+0000 7f6301a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc073680 con 0x7f62fc100240 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.382+0000 7f6301a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0737c0 con 0x7f62fc101440 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62faa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62faa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47004/0 (socket says 172.21.15.23:47004) 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62faa00700 1 -- 172.21.15.23:0/2463642627 learned_addr learned my addr 172.21.15.23:0/2463642627 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62fa000700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc101440 0x7f62fc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62faa00700 1 -- 172.21.15.23:0/2463642627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc101440 msgr2=0x7f62fc073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62faa00700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc101440 0x7f62fc073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62faa00700 1 -- 172.21.15.23:0/2463642627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0095f0 con 0x7f62fc100240 2024-02-28T16:22:33.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.383+0000 7f62faa00700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc074af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00bd70 tx=0x7f62ec00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:33.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.384+0000 7f62f3400700 1 -- 172.21.15.23:0/2463642627 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ec01d070 con 0x7f62fc100240 2024-02-28T16:22:33.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.384+0000 7f62f3400700 1 -- 172.21.15.23:0/2463642627 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62ec005dc0 con 0x7f62fc100240 2024-02-28T16:22:33.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.384+0000 7f62f3400700 1 -- 172.21.15.23:0/2463642627 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ec021410 con 0x7f62fc100240 2024-02-28T16:22:33.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.384+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc073a40 con 0x7f62fc100240 2024-02-28T16:22:33.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.384+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc073ee0 con 0x7f62fc100240 2024-02-28T16:22:33.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.385+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc108d90 con 0x7f62fc100240 2024-02-28T16:22:33.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.386+0000 7f62f3400700 1 -- 172.21.15.23:0/2463642627 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f62ec00f7f0 con 0x7f62fc100240 2024-02-28T16:22:33.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.387+0000 7f62f3400700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f62e006c680 0x7f62e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.387+0000 7f62f3400700 1 -- 172.21.15.23:0/2463642627 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f62ec08cc50 con 0x7f62fc100240 2024-02-28T16:22:33.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.387+0000 7f62fa000700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f62e006c680 0x7f62e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.388+0000 7f62fa000700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f62e006c680 0x7f62e006eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62e8005950 tx=0x7f62e800b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:33.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.392+0000 7f62f3400700 1 -- 172.21.15.23:0/2463642627 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f62ec05acc0 con 0x7f62fc100240 2024-02-28T16:22:33.403 INFO:tasks.workunit.client.0.smithi023.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T16:22:33.515 INFO:tasks.workunit.client.0.smithi023.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T16:22:33.593 INFO:tasks.workunit.client.0.smithi023.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T16:22:33.598 INFO:tasks.workunit.client.0.smithi023.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T16:22:33.598 INFO:tasks.workunit.client.0.smithi023.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T16:22:33.626 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.636+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62fc19df50 con 0x7f62e006c680 2024-02-28T16:22:33.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.637+0000 7f62f3400700 1 -- 172.21.15.23:0/2463642627 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f62fc19df50 con 0x7f62e006c680 2024-02-28T16:22:33.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.641+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f62e006c680 msgr2=0x7f62e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.641+0000 7f6301a00700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f62e006c680 0x7f62e006eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62e8005950 tx=0x7f62e800b410 comp rx=0 tx=0).stop 2024-02-28T16:22:33.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.641+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 msgr2=0x7f62fc074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.641+0000 7f6301a00700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc074af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00bd70 tx=0x7f62ec00bda0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.642+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 shutdown_connections 2024-02-28T16:22:33.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.642+0000 7f6301a00700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f62e006c680 0x7f62e006eb30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.642+0000 7f6301a00700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62fc100240 0x7f62fc074af0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.642+0000 7f6301a00700 1 --2- 172.21.15.23:0/2463642627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc101440 0x7f62fc073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.642+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 >> 172.21.15.23:0/2463642627 conn(0x7f62fc0fb7f0 msgr2=0x7f62fc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:33.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.642+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 shutdown_connections 2024-02-28T16:22:33.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.642+0000 7f6301a00700 1 -- 172.21.15.23:0/2463642627 wait complete. 2024-02-28T16:22:33.672 INFO:tasks.workunit.client.0.smithi023.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T16:22:33.680 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:22:33.680 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-28T16:22:33.724 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-28T16:22:33.727 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T16:22:33.727 DEBUG:teuthology.orchestra.run.smithi023:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 -- 172.21.15.23:0/2539574039 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f87580737b0 msgr2=0x7f8758073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 --2- 172.21.15.23:0/2539574039 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f87580737b0 0x7f8758073c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8744009910 tx=0x7f8744009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 -- 172.21.15.23:0/2539574039 shutdown_connections 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 --2- 172.21.15.23:0/2539574039 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f87580737b0 0x7f8758073c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 --2- 172.21.15.23:0/2539574039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8758074d80 0x7f87580731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 -- 172.21.15.23:0/2539574039 >> 172.21.15.23:0/2539574039 conn(0x7f87580fb7f0 msgr2=0x7f87580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 -- 172.21.15.23:0/2539574039 shutdown_connections 2024-02-28T16:22:33.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.796+0000 7f875f200700 1 -- 172.21.15.23:0/2539574039 wait complete. 2024-02-28T16:22:33.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.797+0000 7f875f200700 1 Processor -- start 2024-02-28T16:22:33.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.797+0000 7f875f200700 1 -- start start 2024-02-28T16:22:33.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f875f200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87580737b0 0x7f875819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f875f200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8758074d80 0x7f875819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f875f200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875819cbd0 con 0x7f8758074d80 2024-02-28T16:22:33.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f875f200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875819cd10 con 0x7f87580737b0 2024-02-28T16:22:33.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f8757400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8758074d80 0x7f875819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f8757400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8758074d80 0x7f875819c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47018/0 (socket says 172.21.15.23:47018) 2024-02-28T16:22:33.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f8757400700 1 -- 172.21.15.23:0/3527579145 learned_addr learned my addr 172.21.15.23:0/3527579145 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:33.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f8757400700 1 -- 172.21.15.23:0/3527579145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87580737b0 msgr2=0x7f875819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f8757400700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87580737b0 0x7f875819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.798+0000 7f8757400700 1 -- 172.21.15.23:0/3527579145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440095f0 con 0x7f8758074d80 2024-02-28T16:22:33.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.799+0000 7f8757400700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8758074d80 0x7f875819c5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8744005b40 tx=0x7f874400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:33.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.799+0000 7f8754c00700 1 -- 172.21.15.23:0/3527579145 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874401d070 con 0x7f8758074d80 2024-02-28T16:22:33.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.799+0000 7f8754c00700 1 -- 172.21.15.23:0/3527579145 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f874400f460 con 0x7f8758074d80 2024-02-28T16:22:33.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.799+0000 7f8754c00700 1 -- 172.21.15.23:0/3527579145 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8744021640 con 0x7f8758074d80 2024-02-28T16:22:33.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.799+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87581a1760 con 0x7f8758074d80 2024-02-28T16:22:33.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.799+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87581a1c50 con 0x7f8758074d80 2024-02-28T16:22:33.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.801+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875810f380 con 0x7f8758074d80 2024-02-28T16:22:33.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.802+0000 7f8754c00700 1 -- 172.21.15.23:0/3527579145 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f874400fa90 con 0x7f8758074d80 2024-02-28T16:22:33.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.803+0000 7f8754c00700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f873c06c680 0x7f873c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.803+0000 7f8754c00700 1 -- 172.21.15.23:0/3527579145 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f874408cc20 con 0x7f8758074d80 2024-02-28T16:22:33.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.803+0000 7f8757e00700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f873c06c680 0x7f873c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.804+0000 7f8757e00700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f873c06c680 0x7f873c06eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8748005950 tx=0x7f87480058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:33.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:33.808+0000 7f8754c00700 1 -- 172.21.15.23:0/3527579145 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f874405ad10 con 0x7f8758074d80 2024-02-28T16:22:33.829 INFO:tasks.workunit.client.0.smithi023.stderr:+ mkdir -p fsstress 2024-02-28T16:22:33.834 INFO:tasks.workunit.client.0.smithi023.stderr:+ pushd fsstress 2024-02-28T16:22:33.837 INFO:tasks.workunit.client.0.smithi023.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:22:33.837 INFO:tasks.workunit.client.0.smithi023.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T16:22:34.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.041+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f87581031e0 con 0x7f873c06c680 2024-02-28T16:22:34.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.073+0000 7f8754c00700 1 -- 172.21.15.23:0/3527579145 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f87581031e0 con 0x7f873c06c680 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (7m) 107s ago 9m 13.5M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (9m) 107s ago 9m 7490k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (8m) 113s ago 8m 7201k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (9m) 107s ago 9m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (8m) 113s ago 8m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (7m) 107s ago 9m 74.3M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (2m) 107s ago 2m 14.1M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (2m) 107s ago 2m 11.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:22:34.064 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (2m) 113s ago 2m 11.5M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (2m) 113s ago 2m 11.7M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:9283,8765,8443 running (11m) 107s ago 11m 488M - 18.2.0 dc2bc1663786 b278ec72c436 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (8m) 113s ago 8m 437M - 18.2.0 dc2bc1663786 cbabf8088ddf 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (11m) 107s ago 11m 45.3M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (8m) 113s ago 8m 33.8M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (9m) 107s ago 9m 7818k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (8m) 113s ago 8m 7926k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (7m) 107s ago 7m 46.7M 3947M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (6m) 107s ago 6m 46.6M 3947M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (5m) 107s ago 5m 45.8M 3947M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (5m) 113s ago 5m 45.3M 4971M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (4m) 113s ago 4m 42.6M 4971M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:22:34.065 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (4m) 113s ago 4m 42.0M 4971M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:22:34.066 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (7m) 107s ago 8m 53.0M - 2.43.0 a07b618ecd1d 8297ca033a9b 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.076+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f873c06c680 msgr2=0x7f873c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.076+0000 7f875f200700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f873c06c680 0x7f873c06eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8748005950 tx=0x7f87480058e0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.076+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8758074d80 msgr2=0x7f875819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.076+0000 7f875f200700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8758074d80 0x7f875819c5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8744005b40 tx=0x7f874400be20 comp rx=0 tx=0).stop 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.077+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 shutdown_connections 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.077+0000 7f875f200700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f873c06c680 0x7f873c06eb30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.077+0000 7f875f200700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87580737b0 0x7f875819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.077+0000 7f875f200700 1 --2- 172.21.15.23:0/3527579145 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8758074d80 0x7f875819c5b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.077+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 >> 172.21.15.23:0/3527579145 conn(0x7f87580fb7f0 msgr2=0x7f8758101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:34.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.077+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 shutdown_connections 2024-02-28T16:22:34.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.077+0000 7f875f200700 1 -- 172.21.15.23:0/3527579145 wait complete. 2024-02-28T16:22:34.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 -- 172.21.15.23:0/2651979650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 msgr2=0x7f7bdc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 --2- 172.21.15.23:0/2651979650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 0x7f7bdc100650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009910 tx=0x7f7bcc009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:34.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 -- 172.21.15.23:0/2651979650 shutdown_connections 2024-02-28T16:22:34.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 --2- 172.21.15.23:0/2651979650 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 0x7f7bdc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 --2- 172.21.15.23:0/2651979650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 0x7f7bdc100650 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 -- 172.21.15.23:0/2651979650 >> 172.21.15.23:0/2651979650 conn(0x7f7bdc0fb7f0 msgr2=0x7f7bdc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:34.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 -- 172.21.15.23:0/2651979650 shutdown_connections 2024-02-28T16:22:34.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.238+0000 7f7be0e00700 1 -- 172.21.15.23:0/2651979650 wait complete. 2024-02-28T16:22:34.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.239+0000 7f7be0e00700 1 Processor -- start 2024-02-28T16:22:34.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7be0e00700 1 -- start start 2024-02-28T16:22:34.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7be0e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 0x7f7bdc197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:34.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7be0e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 0x7f7bdc198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:34.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7be0e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc198860 con 0x7f7bdc101440 2024-02-28T16:22:34.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7be0e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc19d270 con 0x7f7bdc100240 2024-02-28T16:22:34.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7bd9400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 0x7f7bdc198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:34.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7bd9400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 0x7f7bdc198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47026/0 (socket says 172.21.15.23:47026) 2024-02-28T16:22:34.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7bd9400700 1 -- 172.21.15.23:0/1344551289 learned_addr learned my addr 172.21.15.23:0/1344551289 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:34.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.240+0000 7f7bd9e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 0x7f7bdc197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.241+0000 7f7bd9400700 1 -- 172.21.15.23:0/1344551289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 msgr2=0x7f7bdc197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.241+0000 7f7bd9400700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 0x7f7bdc197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.241+0000 7f7bd9400700 1 -- 172.21.15.23:0/1344551289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0095f0 con 0x7f7bdc101440 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.241+0000 7f7bd9400700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 0x7f7bdc198240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e920 tx=0x7f7bc800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.241+0000 7f7bd2a00700 1 -- 172.21.15.23:0/1344551289 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc800c9d0 con 0x7f7bdc101440 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.242+0000 7f7bd2a00700 1 -- 172.21.15.23:0/1344551289 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7bc8010430 con 0x7f7bdc101440 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.242+0000 7f7bd2a00700 1 -- 172.21.15.23:0/1344551289 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc8018650 con 0x7f7bdc101440 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.242+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc19d470 con 0x7f7bdc101440 2024-02-28T16:22:34.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.242+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc19d990 con 0x7f7bdc101440 2024-02-28T16:22:34.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.243+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc105520 con 0x7f7bdc101440 2024-02-28T16:22:34.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.245+0000 7f7bd2a00700 1 -- 172.21.15.23:0/1344551289 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7bc80105a0 con 0x7f7bdc101440 2024-02-28T16:22:34.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.246+0000 7f7bd2a00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7bc006c680 0x7f7bc006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:34.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.246+0000 7f7bd2a00700 1 -- 172.21.15.23:0/1344551289 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7bc8014070 con 0x7f7bdc101440 2024-02-28T16:22:34.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.246+0000 7f7bd9e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7bc006c680 0x7f7bc006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:34.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.247+0000 7f7bd9e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7bc006c680 0x7f7bc006eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009fd0 tx=0x7f7bcc005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:34.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.250+0000 7f7bd2a00700 1 -- 172.21.15.23:0/1344551289 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7bc8051720 con 0x7f7bdc101440 2024-02-28T16:22:34.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.590+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7bdc02cc30 con 0x7f7bdc101440 2024-02-28T16:22:34.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.591+0000 7f7bd2a00700 1 -- 172.21.15.23:0/1344551289 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f7bc8056330 con 0x7f7bdc101440 2024-02-28T16:22:34.581 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:22:34.581 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:22:34.581 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:22:34.582 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-02-28T16:22:34.583 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:22:34.583 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7bc006c680 msgr2=0x7f7bc006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7bc006c680 0x7f7bc006eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009fd0 tx=0x7f7bcc005fd0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 msgr2=0x7f7bdc198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 0x7f7bdc198240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e920 tx=0x7f7bc800ec30 comp rx=0 tx=0).stop 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 shutdown_connections 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f7bc006c680 0x7f7bc006eb30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc100240 0x7f7bdc197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 --2- 172.21.15.23:0/1344551289 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7bdc101440 0x7f7bdc198240 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 >> 172.21.15.23:0/1344551289 conn(0x7f7bdc0fb7f0 msgr2=0x7f7bdc102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:34.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 shutdown_connections 2024-02-28T16:22:34.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.594+0000 7f7be0e00700 1 -- 172.21.15.23:0/1344551289 wait complete. 2024-02-28T16:22:34.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:34 smithi153 ceph-mon[35341]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:34.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:34 smithi153 ceph-mon[35341]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:34.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:34 smithi023 ceph-mon[29137]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:34.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:34 smithi023 ceph-mon[29137]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 -- 172.21.15.23:0/3997751204 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 msgr2=0x7f266c1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 --2- 172.21.15.23:0/3997751204 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c1018e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2658009910 tx=0x7f2658009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 -- 172.21.15.23:0/3997751204 shutdown_connections 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 --2- 172.21.15.23:0/3997751204 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c1018e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 --2- 172.21.15.23:0/3997751204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f266c100290 0x7f266c1006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 -- 172.21.15.23:0/3997751204 >> 172.21.15.23:0/3997751204 conn(0x7f266c0fb860 msgr2=0x7f266c0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 -- 172.21.15.23:0/3997751204 shutdown_connections 2024-02-28T16:22:34.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.776+0000 7f2672e00700 1 -- 172.21.15.23:0/3997751204 wait complete. 2024-02-28T16:22:34.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.777+0000 7f2672e00700 1 Processor -- start 2024-02-28T16:22:34.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.777+0000 7f2672e00700 1 -- start start 2024-02-28T16:22:34.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.778+0000 7f2672e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f266c100290 0x7f266c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:34.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.778+0000 7f2672e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:34.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.778+0000 7f2672e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c073680 con 0x7f266c101490 2024-02-28T16:22:34.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.778+0000 7f2672e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0737c0 con 0x7f266c100290 2024-02-28T16:22:34.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.778+0000 7f2671000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:34.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.778+0000 7f2671000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47042/0 (socket says 172.21.15.23:47042) 2024-02-28T16:22:34.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.778+0000 7f2671000700 1 -- 172.21.15.23:0/4290562358 learned_addr learned my addr 172.21.15.23:0/4290562358 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:34.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.779+0000 7f2671a00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f266c100290 0x7f266c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:34.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.779+0000 7f2671000700 1 -- 172.21.15.23:0/4290562358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f266c100290 msgr2=0x7f266c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.779+0000 7f2671000700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f266c100290 0x7f266c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.779+0000 7f2671000700 1 -- 172.21.15.23:0/4290562358 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580095f0 con 0x7f266c101490 2024-02-28T16:22:34.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.779+0000 7f2671000700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c073140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f265800b5c0 tx=0x7f265800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:34.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.780+0000 7f266a000700 1 -- 172.21.15.23:0/4290562358 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f265801d070 con 0x7f266c101490 2024-02-28T16:22:34.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.780+0000 7f266a000700 1 -- 172.21.15.23:0/4290562358 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f265800f460 con 0x7f266c101490 2024-02-28T16:22:34.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.780+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c073a40 con 0x7f266c101490 2024-02-28T16:22:34.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.780+0000 7f266a000700 1 -- 172.21.15.23:0/4290562358 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2658021640 con 0x7f266c101490 2024-02-28T16:22:34.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.780+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c073f30 con 0x7f266c101490 2024-02-28T16:22:34.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.781+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c06a550 con 0x7f266c101490 2024-02-28T16:22:34.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.783+0000 7f266a000700 1 -- 172.21.15.23:0/4290562358 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f265800fa60 con 0x7f266c101490 2024-02-28T16:22:34.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.783+0000 7f266a000700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f265406c680 0x7f265406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:34.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.784+0000 7f266a000700 1 -- 172.21.15.23:0/4290562358 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f265808cba0 con 0x7f266c101490 2024-02-28T16:22:34.774 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.784+0000 7f2671a00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f265406c680 0x7f265406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:34.774 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.785+0000 7f2671a00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f265406c680 0x7f265406eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f266c1012f0 tx=0x7f266000b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:34.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:34.791+0000 7f266a000700 1 -- 172.21.15.23:0/4290562358 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f265805acb0 con 0x7f266c101490 2024-02-28T16:22:35.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.068+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f266c19dac0 con 0x7f266c101490 2024-02-28T16:22:35.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.069+0000 7f266a000700 1 -- 172.21.15.23:0/4290562358 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7f2658026740 con 0x7f266c101490 2024-02-28T16:22:35.059 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:22:35.059 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:22:35.059 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:35.059 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:22:35.060 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:22:35.061 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:35.062 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.072+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f265406c680 msgr2=0x7f265406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.072+0000 7f2672e00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f265406c680 0x7f265406eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f266c1012f0 tx=0x7f266000b410 comp rx=0 tx=0).stop 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.072+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 msgr2=0x7f266c073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.072+0000 7f2672e00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c073140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f265800b5c0 tx=0x7f265800bd70 comp rx=0 tx=0).stop 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.073+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 shutdown_connections 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.073+0000 7f2672e00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f265406c680 0x7f265406eb30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.073+0000 7f2672e00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f266c100290 0x7f266c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.073+0000 7f2672e00700 1 --2- 172.21.15.23:0/4290562358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f266c101490 0x7f266c073140 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.073+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 >> 172.21.15.23:0/4290562358 conn(0x7f266c0fb860 msgr2=0x7f266c1046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:35.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.073+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 shutdown_connections 2024-02-28T16:22:35.064 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.073+0000 7f2672e00700 1 -- 172.21.15.23:0/4290562358 wait complete. 2024-02-28T16:22:35.064 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:22:35.180 INFO:tasks.workunit.client.0.smithi023.stderr:+ tar xzf ltp-full.tgz 2024-02-28T16:22:35.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 -- 172.21.15.23:0/1714303685 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 msgr2=0x7f9450073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 --2- 172.21.15.23:0/1714303685 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450073bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f943c009910 tx=0x7f943c009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:35.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 -- 172.21.15.23:0/1714303685 shutdown_connections 2024-02-28T16:22:35.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 --2- 172.21.15.23:0/1714303685 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450073bc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 --2- 172.21.15.23:0/1714303685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9450074d20 0x7f9450073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 -- 172.21.15.23:0/1714303685 >> 172.21.15.23:0/1714303685 conn(0x7f94500fb7f0 msgr2=0x7f94500fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:35.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 -- 172.21.15.23:0/1714303685 shutdown_connections 2024-02-28T16:22:35.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.245+0000 7f9457400700 1 -- 172.21.15.23:0/1714303685 wait complete. 2024-02-28T16:22:35.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.247+0000 7f9457400700 1 Processor -- start 2024-02-28T16:22:35.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.247+0000 7f9457400700 1 -- start start 2024-02-28T16:22:35.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.247+0000 7f9457400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.247+0000 7f9457400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9450074d20 0x7f94501981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.247+0000 7f9457400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501987b0 con 0x7f9450073750 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.247+0000 7f9457400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9450198920 con 0x7f9450074d20 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.248+0000 7f9454a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.248+0000 7f9454a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:47064/0 (socket says 172.21.15.23:47064) 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.248+0000 7f9454a00700 1 -- 172.21.15.23:0/2902201752 learned_addr learned my addr 172.21.15.23:0/2902201752 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.248+0000 7f944fe00700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9450074d20 0x7f94501981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:35.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.248+0000 7f9454a00700 1 -- 172.21.15.23:0/2902201752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9450074d20 msgr2=0x7f94501981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.248+0000 7f9454a00700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9450074d20 0x7f94501981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.248+0000 7f9454a00700 1 -- 172.21.15.23:0/2902201752 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0095f0 con 0x7f9450073750 2024-02-28T16:22:35.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.249+0000 7f9454a00700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450197c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f944400e920 tx=0x7f944400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:35.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.249+0000 7f944d600700 1 -- 172.21.15.23:0/2902201752 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f944400c9d0 con 0x7f9450073750 2024-02-28T16:22:35.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.249+0000 7f944d600700 1 -- 172.21.15.23:0/2902201752 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9444010430 con 0x7f9450073750 2024-02-28T16:22:35.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.249+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945019d3b0 con 0x7f9450073750 2024-02-28T16:22:35.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.249+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945019d900 con 0x7f9450073750 2024-02-28T16:22:35.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.250+0000 7f944d600700 1 -- 172.21.15.23:0/2902201752 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94440185f0 con 0x7f9450073750 2024-02-28T16:22:35.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.251+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945010af80 con 0x7f9450073750 2024-02-28T16:22:35.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.253+0000 7f944d600700 1 -- 172.21.15.23:0/2902201752 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f94440105a0 con 0x7f9450073750 2024-02-28T16:22:35.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.254+0000 7f944d600700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f943806c6d0 0x7f943806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:35.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.254+0000 7f944d600700 1 -- 172.21.15.23:0/2902201752 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9444014070 con 0x7f9450073750 2024-02-28T16:22:35.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.255+0000 7f944fe00700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f943806c6d0 0x7f943806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:35.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.256+0000 7f944fe00700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f943806c6d0 0x7f943806eb80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9450199180 tx=0x7f943c005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:35.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.260+0000 7f944d600700 1 -- 172.21.15.23:0/2902201752 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9444051720 con 0x7f9450073750 2024-02-28T16:22:35.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.571+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 --> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94501077a0 con 0x7f943806c6d0 2024-02-28T16:22:35.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.573+0000 7f944d600700 1 -- 172.21.15.23:0/2902201752 <== mgr.14213 v2:172.21.15.23:6800/3957078359 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f94501077a0 con 0x7f943806c6d0 2024-02-28T16:22:35.563 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:22:35.563 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:22:35.563 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:22:35.563 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:22:35.564 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [], 2024-02-28T16:22:35.564 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "0/23 daemons upgraded", 2024-02-28T16:22:35.564 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc image on host smithi153", 2024-02-28T16:22:35.564 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:22:35.564 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:22:35.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f943806c6d0 msgr2=0x7f943806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f943806c6d0 0x7f943806eb80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9450199180 tx=0x7f943c005fd0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 msgr2=0x7f9450197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450197c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f944400e920 tx=0x7f944400ec30 comp rx=0 tx=0).stop 2024-02-28T16:22:35.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 shutdown_connections 2024-02-28T16:22:35.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7f943806c6d0 0x7f943806eb80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9450073750 0x7f9450197c70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 --2- 172.21.15.23:0/2902201752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9450074d20 0x7f94501981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.576+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 >> 172.21.15.23:0/2902201752 conn(0x7f94500fb7f0 msgr2=0x7f9450106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:35.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.577+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 shutdown_connections 2024-02-28T16:22:35.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.577+0000 7f9457400700 1 -- 172.21.15.23:0/2902201752 wait complete. 2024-02-28T16:22:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:35 smithi153 ceph-mon[35341]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:35 smithi153 ceph-mon[35341]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:35 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1344551289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:22:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:35 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/4290562358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:35.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:35 smithi023 ceph-mon[29137]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:35.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:35 smithi023 ceph-mon[29137]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:35.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:35 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1344551289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:22:35.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:35 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/4290562358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:35.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.748+0000 7fbe63e00700 1 -- 172.21.15.23:0/2786681200 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 msgr2=0x7fbe5c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.748+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2786681200 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 0x7fbe5c100650 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009910 tx=0x7fbe50009c20 comp rx=0 tx=0).stop 2024-02-28T16:22:35.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.749+0000 7fbe63e00700 1 -- 172.21.15.23:0/2786681200 shutdown_connections 2024-02-28T16:22:35.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.749+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2786681200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 0x7fbe5c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.749+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2786681200 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 0x7fbe5c100650 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.749+0000 7fbe63e00700 1 -- 172.21.15.23:0/2786681200 >> 172.21.15.23:0/2786681200 conn(0x7fbe5c0fb7f0 msgr2=0x7fbe5c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:35.740 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.749+0000 7fbe63e00700 1 -- 172.21.15.23:0/2786681200 shutdown_connections 2024-02-28T16:22:35.740 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.749+0000 7fbe63e00700 1 -- 172.21.15.23:0/2786681200 wait complete. 2024-02-28T16:22:35.740 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.750+0000 7fbe63e00700 1 Processor -- start 2024-02-28T16:22:35.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe63e00700 1 -- start start 2024-02-28T16:22:35.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe63e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 0x7fbe5c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:35.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe63e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 0x7fbe5c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:35.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe63e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1987f0 con 0x7fbe5c100240 2024-02-28T16:22:35.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe63e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c198960 con 0x7fbe5c101440 2024-02-28T16:22:35.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe60a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 0x7fbe5c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:35.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe60a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 0x7fbe5c1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:51998/0 (socket says 172.21.15.23:51998) 2024-02-28T16:22:35.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.751+0000 7fbe60a00700 1 -- 172.21.15.23:0/2010043098 learned_addr learned my addr 172.21.15.23:0/2010043098 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:22:35.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.752+0000 7fbe61400700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 0x7fbe5c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:35.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.752+0000 7fbe60a00700 1 -- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 msgr2=0x7fbe5c197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:35.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.752+0000 7fbe60a00700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 0x7fbe5c197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:35.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.752+0000 7fbe60a00700 1 -- 172.21.15.23:0/2010043098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500095f0 con 0x7fbe5c101440 2024-02-28T16:22:35.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.753+0000 7fbe60a00700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 0x7fbe5c1981f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800d8d0 tx=0x7fbe4800dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:35.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.753+0000 7fbe5a000700 1 -- 172.21.15.23:0/2010043098 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe480098a0 con 0x7fbe5c101440 2024-02-28T16:22:35.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.753+0000 7fbe5a000700 1 -- 172.21.15.23:0/2010043098 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbe48010460 con 0x7fbe5c101440 2024-02-28T16:22:35.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.753+0000 7fbe5a000700 1 -- 172.21.15.23:0/2010043098 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe4800f5f0 con 0x7fbe5c101440 2024-02-28T16:22:35.744 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.753+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c19d3f0 con 0x7fbe5c101440 2024-02-28T16:22:35.744 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.753+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c19d940 con 0x7fbe5c101440 2024-02-28T16:22:35.744 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.754+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c105520 con 0x7fbe5c101440 2024-02-28T16:22:35.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.756+0000 7fbe5a000700 1 -- 172.21.15.23:0/2010043098 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbe48009a00 con 0x7fbe5c101440 2024-02-28T16:22:35.746 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.756+0000 7fbe5a000700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe4406c680 0x7fbe4406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:35.746 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.757+0000 7fbe5a000700 1 -- 172.21.15.23:0/2010043098 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbe4808b7b0 con 0x7fbe5c101440 2024-02-28T16:22:35.747 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.757+0000 7fbe61400700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe4406c680 0x7fbe4406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:35.747 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.758+0000 7fbe61400700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe4406c680 0x7fbe4406eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe50005090 tx=0x7fbe50005ec0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:35.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:35.763+0000 7fbe5a000700 1 -- 172.21.15.23:0/2010043098 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbe48055e10 con 0x7fbe5c101440 2024-02-28T16:22:36.136 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.146+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbe5c02cc30 con 0x7fbe5c101440 2024-02-28T16:22:36.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.147+0000 7fbe5a000700 1 -- 172.21.15.23:0/2010043098 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbe48059430 con 0x7fbe5c101440 2024-02-28T16:22:36.138 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:22:36.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe4406c680 msgr2=0x7fbe4406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:36.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe4406c680 0x7fbe4406eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe50005090 tx=0x7fbe50005ec0 comp rx=0 tx=0).stop 2024-02-28T16:22:36.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 msgr2=0x7fbe5c1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:36.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 0x7fbe5c1981f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800d8d0 tx=0x7fbe4800dbe0 comp rx=0 tx=0).stop 2024-02-28T16:22:36.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 shutdown_connections 2024-02-28T16:22:36.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:6800/3957078359,v1:172.21.15.23:6801/3957078359] conn(0x7fbe4406c680 0x7fbe4406eb30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:36.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe5c100240 0x7fbe5c197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:36.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 --2- 172.21.15.23:0/2010043098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5c101440 0x7fbe5c1981f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:36.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.151+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 >> 172.21.15.23:0/2010043098 conn(0x7fbe5c0fb7f0 msgr2=0x7fbe5c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:36.142 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.152+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 shutdown_connections 2024-02-28T16:22:36.142 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:22:36.152+0000 7fbe63e00700 1 -- 172.21.15.23:0/2010043098 wait complete. 2024-02-28T16:22:36.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:36 smithi023 ceph-mon[29137]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:36.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:36 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2010043098' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:22:36.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:36 smithi153 ceph-mon[35341]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:22:36.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:36 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2010043098' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:22:37.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:37 smithi153 ceph-mon[35341]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:37.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:37 smithi023 ceph-mon[29137]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:38.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:38 smithi153 ceph-mon[35341]: pgmap v296: 65 pgs: 65 active+clean; 5.1 MiB data, 178 MiB used, 536 GiB / 536 GiB avail; 392 KiB/s wr, 8 op/s 2024-02-28T16:22:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:38 smithi023 ceph-mon[29137]: pgmap v296: 65 pgs: 65 active+clean; 5.1 MiB data, 178 MiB used, 536 GiB / 536 GiB avail; 392 KiB/s wr, 8 op/s 2024-02-28T16:22:39.100 INFO:tasks.workunit.client.1.smithi153.stderr:Updating files: 57% (7078/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 92% (11362/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T16:22:39.256 INFO:tasks.workunit.client.1.smithi153.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T16:22:39.256 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: git switch -c 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr:Or undo this operation with: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: git switch - 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T16:22:39.257 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-02-28T16:22:39.258 INFO:tasks.workunit.client.1.smithi153.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T16:22:39.258 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-28T16:22:39.311 INFO:tasks.workunit.client.1.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T16:22:39.316 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T16:22:39.316 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T16:22:40.510 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:40 smithi153 ceph-mon[35341]: Upgrade: Updating mgr.smithi153.qlkchp 2024-02-28T16:22:40.511 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:40.511 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:22:40.511 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:22:40.511 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:40 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:40.511 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:40 smithi153 ceph-mon[35341]: Deploying daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:22:40.511 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:40 smithi153 ceph-mon[35341]: pgmap v297: 65 pgs: 65 active+clean; 8.6 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 696 KiB/s wr, 17 op/s 2024-02-28T16:22:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:40 smithi023 ceph-mon[29137]: Upgrade: Updating mgr.smithi153.qlkchp 2024-02-28T16:22:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:22:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:22:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:40 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:40 smithi023 ceph-mon[29137]: Deploying daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:22:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:40 smithi023 ceph-mon[29137]: pgmap v297: 65 pgs: 65 active+clean; 8.6 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 696 KiB/s wr, 17 op/s 2024-02-28T16:22:41.342 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T16:22:41.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:41 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:41.488 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T16:22:41.565 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T16:22:41.570 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T16:22:41.570 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T16:22:41.646 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T16:22:41.654 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-02-28T16:22:41.654 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-28T16:22:41.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:41 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:41.700 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-28T16:22:41.702 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T16:22:41.702 DEBUG:teuthology.orchestra.run.smithi153:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-28T16:22:41.818 INFO:tasks.workunit.client.1.smithi153.stderr:+ mkdir -p fsstress 2024-02-28T16:22:41.825 INFO:tasks.workunit.client.1.smithi153.stderr:+ pushd fsstress 2024-02-28T16:22:41.828 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:22:41.828 INFO:tasks.workunit.client.1.smithi153.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T16:22:42.390 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:42 smithi153 ceph-mon[35341]: pgmap v298: 65 pgs: 65 active+clean; 13 MiB data, 201 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 38 op/s 2024-02-28T16:22:42.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:42 smithi023 ceph-mon[29137]: pgmap v298: 65 pgs: 65 active+clean; 13 MiB data, 201 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 38 op/s 2024-02-28T16:22:43.185 INFO:tasks.workunit.client.1.smithi153.stderr:+ tar xzf ltp-full.tgz 2024-02-28T16:22:44.591 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:44 smithi153 ceph-mon[35341]: pgmap v299: 65 pgs: 65 active+clean; 14 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 47 op/s 2024-02-28T16:22:44.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:44 smithi023 ceph-mon[29137]: pgmap v299: 65 pgs: 65 active+clean; 14 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 47 op/s 2024-02-28T16:22:45.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:45 smithi153 ceph-mon[35341]: pgmap v300: 65 pgs: 65 active+clean; 17 MiB data, 219 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s wr, 73 op/s 2024-02-28T16:22:45.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:45 smithi023 ceph-mon[29137]: pgmap v300: 65 pgs: 65 active+clean; 17 MiB data, 219 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s wr, 73 op/s 2024-02-28T16:22:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:46 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:46 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:47.632 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:47 smithi153 ceph-mon[35341]: pgmap v301: 65 pgs: 65 active+clean; 28 MiB data, 248 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 107 op/s 2024-02-28T16:22:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:47 smithi023 ceph-mon[29137]: pgmap v301: 65 pgs: 65 active+clean; 28 MiB data, 248 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 107 op/s 2024-02-28T16:22:50.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:50 smithi153 ceph-mon[35341]: pgmap v302: 65 pgs: 65 active+clean; 31 MiB data, 276 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 131 op/s 2024-02-28T16:22:50.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:50 smithi023 ceph-mon[29137]: pgmap v302: 65 pgs: 65 active+clean; 31 MiB data, 276 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 131 op/s 2024-02-28T16:22:52.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:52.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:52 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:52.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:52 smithi023 ceph-mon[29137]: pgmap v303: 65 pgs: 65 active+clean; 34 MiB data, 306 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 191 op/s 2024-02-28T16:22:52.447 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:52.448 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:52 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:52.448 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:52 smithi153 ceph-mon[35341]: pgmap v303: 65 pgs: 65 active+clean; 34 MiB data, 306 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 191 op/s 2024-02-28T16:22:54.142 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:53 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:54.142 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:53 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:54.142 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:53 smithi153 ceph-mon[35341]: pgmap v304: 65 pgs: 65 active+clean; 39 MiB data, 326 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 204 op/s 2024-02-28T16:22:54.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:53 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:54.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:53 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:22:54.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:53 smithi023 ceph-mon[29137]: pgmap v304: 65 pgs: 65 active+clean; 39 MiB data, 326 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 204 op/s 2024-02-28T16:22:55.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:55 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:55.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:55 smithi153 ceph-mon[35341]: pgmap v305: 65 pgs: 65 active+clean; 46 MiB data, 348 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 248 op/s 2024-02-28T16:22:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:55 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:55.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:55 smithi023 ceph-mon[29137]: pgmap v305: 65 pgs: 65 active+clean; 46 MiB data, 348 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 248 op/s 2024-02-28T16:22:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:56 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp restarted 2024-02-28T16:22:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:56 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:22:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:56 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:22:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:56 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:22:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:56 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:22:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:56 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:22:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:56 smithi023 ceph-mon[29137]: Standby manager daemon smithi153.qlkchp restarted 2024-02-28T16:22:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:56 smithi023 ceph-mon[29137]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:22:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:56 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:22:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:56 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:22:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:56 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:22:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:56 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:22:58.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:57 smithi153 ceph-mon[35341]: mgrmap e20: smithi023.bbebnt(active, since 9m), standbys: smithi153.qlkchp 2024-02-28T16:22:58.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:22:57 smithi153 ceph-mon[35341]: pgmap v306: 65 pgs: 65 active+clean; 48 MiB data, 364 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 259 op/s 2024-02-28T16:22:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:57 smithi023 ceph-mon[29137]: mgrmap e20: smithi023.bbebnt(active, since 9m), standbys: smithi153.qlkchp 2024-02-28T16:22:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:22:57 smithi023 ceph-mon[29137]: pgmap v306: 65 pgs: 65 active+clean; 48 MiB data, 364 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 259 op/s 2024-02-28T16:23:00.584 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:00 smithi153 ceph-mon[35341]: pgmap v307: 65 pgs: 65 active+clean; 52 MiB data, 387 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 258 op/s 2024-02-28T16:23:00.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:00 smithi023 ceph-mon[29137]: pgmap v307: 65 pgs: 65 active+clean; 52 MiB data, 387 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 258 op/s 2024-02-28T16:23:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:02 smithi153 ceph-mon[35341]: pgmap v308: 65 pgs: 65 active+clean; 59 MiB data, 411 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 296 op/s 2024-02-28T16:23:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:02 smithi023 ceph-mon[29137]: pgmap v308: 65 pgs: 65 active+clean; 59 MiB data, 411 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 296 op/s 2024-02-28T16:23:03.351 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:23:03.351 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:23:03.351 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:03.351 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:23:03.351 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:23:03.351 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr fail", "who": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "mgr fail", "who": "smithi023.bbebnt"}]': finished 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: mgrmap e21: smithi153.qlkchp(active, starting, since 0.0123801s) 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:23:03.352 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: Manager daemon smithi153.qlkchp is now available 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/trash_purge_schedule"}]: dispatch 2024-02-28T16:23:03.353 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:03 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/trash_purge_schedule"}]: dispatch 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr fail", "who": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:23:03.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.14213 172.21.15.23:0/2665490743' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "mgr fail", "who": "smithi023.bbebnt"}]': finished 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: mgrmap e21: smithi153.qlkchp(active, starting, since 0.0123801s) 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:23:03.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: Manager daemon smithi153.qlkchp is now available 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/trash_purge_schedule"}]: dispatch 2024-02-28T16:23:03.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:03 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.qlkchp/trash_purge_schedule"}]: dispatch 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: [28/Feb/2024:16:23:03] ENGINE Bus STARTING 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: Deploying cephadm binary to smithi153 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: mgrmap e22: smithi153.qlkchp(active, since 1.01259s) 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: pgmap v3: 65 pgs: 65 active+clean; 74 MiB data, 486 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: Deploying cephadm binary to smithi023 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: [28/Feb/2024:16:23:03] ENGINE Serving on https://172.21.15.153:7150 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: [28/Feb/2024:16:23:03] ENGINE Serving on http://172.21.15.153:8765 2024-02-28T16:23:04.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:04 smithi153 ceph-mon[35341]: [28/Feb/2024:16:23:03] ENGINE Bus STARTED 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: [28/Feb/2024:16:23:03] ENGINE Bus STARTING 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: Deploying cephadm binary to smithi153 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: mgrmap e22: smithi153.qlkchp(active, since 1.01259s) 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: pgmap v3: 65 pgs: 65 active+clean; 74 MiB data, 486 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: Deploying cephadm binary to smithi023 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: [28/Feb/2024:16:23:03] ENGINE Serving on https://172.21.15.153:7150 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: [28/Feb/2024:16:23:03] ENGINE Serving on http://172.21.15.153:8765 2024-02-28T16:23:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:04 smithi023 ceph-mon[29137]: [28/Feb/2024:16:23:03] ENGINE Bus STARTED 2024-02-28T16:23:05.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:05 smithi153 ceph-mon[35341]: pgmap v4: 65 pgs: 65 active+clean; 74 MiB data, 486 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:23:05.910 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:05 smithi023 ceph-mon[29137]: pgmap v4: 65 pgs: 65 active+clean; 74 MiB data, 486 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:23:06.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.358+0000 7f8dcf000700 1 -- 172.21.15.23:0/54263633 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8100d60 msgr2=0x7f8dc8103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.358+0000 7f8dcf000700 1 --2- 172.21.15.23:0/54263633 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8100d60 0x7f8dc8103140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009910 tx=0x7f8db8009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.358+0000 7f8dcf000700 1 -- 172.21.15.23:0/54263633 shutdown_connections 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.358+0000 7f8dcf000700 1 --2- 172.21.15.23:0/54263633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8103680 0x7f8dc8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.358+0000 7f8dcf000700 1 --2- 172.21.15.23:0/54263633 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8100d60 0x7f8dc8103140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.358+0000 7f8dcf000700 1 -- 172.21.15.23:0/54263633 >> 172.21.15.23:0/54263633 conn(0x7f8dc80fa780 msgr2=0x7f8dc80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.359+0000 7f8dcf000700 1 -- 172.21.15.23:0/54263633 shutdown_connections 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.359+0000 7f8dcf000700 1 -- 172.21.15.23:0/54263633 wait complete. 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.360+0000 7f8dcf000700 1 Processor -- start 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.360+0000 7f8dcf000700 1 -- start start 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.361+0000 7f8dcf000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8100d60 0x7f8dc81938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:06.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.361+0000 7f8dcf000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8103680 0x7f8dc8193de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:06.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.361+0000 7f8dcf000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8194400 con 0x7f8dc8103680 2024-02-28T16:23:06.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.362+0000 7f8dc7e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8100d60 0x7f8dc81938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:06.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.362+0000 7f8dc7e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8100d60 0x7f8dc81938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:42686/0 (socket says 172.21.15.23:42686) 2024-02-28T16:23:06.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.362+0000 7f8dc7e00700 1 -- 172.21.15.23:0/2305471561 learned_addr learned my addr 172.21.15.23:0/2305471561 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:06.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.362+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8194540 con 0x7f8dc8100d60 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.362+0000 7f8dc7400700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8103680 0x7f8dc8193de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.363+0000 7f8dc7e00700 1 -- 172.21.15.23:0/2305471561 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8103680 msgr2=0x7f8dc8193de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.363+0000 7f8dc7e00700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8103680 0x7f8dc8193de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.363+0000 7f8dc7e00700 1 -- 172.21.15.23:0/2305471561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80095f0 con 0x7f8dc8100d60 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.363+0000 7f8dc7e00700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8100d60 0x7f8dc81938a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db800f690 tx=0x7f8db800f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.364+0000 7f8dc4c00700 1 -- 172.21.15.23:0/2305471561 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db801d070 con 0x7f8dc8100d60 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.364+0000 7f8dc4c00700 1 -- 172.21.15.23:0/2305471561 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8db8005dc0 con 0x7f8dc8100d60 2024-02-28T16:23:06.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.364+0000 7f8dc4c00700 1 -- 172.21.15.23:0/2305471561 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db8017630 con 0x7f8dc8100d60 2024-02-28T16:23:06.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.364+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc8198f90 con 0x7f8dc8100d60 2024-02-28T16:23:06.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.364+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc8199480 con 0x7f8dc8100d60 2024-02-28T16:23:06.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.366+0000 7f8dc4c00700 1 -- 172.21.15.23:0/2305471561 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 23) v1 ==== 46013+0+0 (secure 0 0 0) 0x7f8db8003910 con 0x7f8dc8100d60 2024-02-28T16:23:06.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.366+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc8108ce0 con 0x7f8dc8100d60 2024-02-28T16:23:06.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.367+0000 7f8dc4c00700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8dac038e30 0x7f8dac03b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:06.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.367+0000 7f8dc4c00700 1 -- 172.21.15.23:0/2305471561 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8db804e280 con 0x7f8dc8100d60 2024-02-28T16:23:06.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.368+0000 7f8dc7400700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8dac038e30 0x7f8dac03b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:06.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.369+0000 7f8dc7400700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8dac038e30 0x7f8dac03b2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009c60 tx=0x7f8db4009260 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:06.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.379+0000 7f8dc4c00700 1 -- 172.21.15.23:0/2305471561 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f8db80052a0 con 0x7f8dc8100d60 2024-02-28T16:23:06.752 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.762+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dc80fbd90 con 0x7f8dac038e30 2024-02-28T16:23:06.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.775+0000 7f8dc4c00700 1 -- 172.21.15.23:0/2305471561 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8dc80fbd90 con 0x7f8dac038e30 2024-02-28T16:23:06.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8dac038e30 msgr2=0x7f8dac03b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8dac038e30 0x7f8dac03b2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009c60 tx=0x7f8db4009260 comp rx=0 tx=0).stop 2024-02-28T16:23:06.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8100d60 msgr2=0x7f8dc81938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8100d60 0x7f8dc81938a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db800f690 tx=0x7f8db800f6c0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 shutdown_connections 2024-02-28T16:23:06.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc8100d60 0x7f8dc81938a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8dac038e30 0x7f8dac03b2e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 --2- 172.21.15.23:0/2305471561 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8dc8103680 0x7f8dc8193de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 >> 172.21.15.23:0/2305471561 conn(0x7f8dc80fa780 msgr2=0x7f8dc80ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:06.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 shutdown_connections 2024-02-28T16:23:06.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:06.780+0000 7f8dcf000700 1 -- 172.21.15.23:0/2305471561 wait complete. 2024-02-28T16:23:06.794 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:23:06.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:06 smithi153 ceph-mon[35341]: mgrmap e23: smithi153.qlkchp(active, since 3s) 2024-02-28T16:23:06.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:06 smithi023 ceph-mon[29137]: mgrmap e23: smithi153.qlkchp(active, since 3s) 2024-02-28T16:23:06.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.005+0000 7fced8400700 1 -- 172.21.15.23:0/153838247 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0073730 msgr2=0x7fced0073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.005+0000 7fced8400700 1 --2- 172.21.15.23:0/153838247 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0073730 0x7fced0073ba0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009910 tx=0x7fcebc009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:06.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.005+0000 7fced8400700 1 -- 172.21.15.23:0/153838247 shutdown_connections 2024-02-28T16:23:06.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.005+0000 7fced8400700 1 --2- 172.21.15.23:0/153838247 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0073730 0x7fced0073ba0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.005+0000 7fced8400700 1 --2- 172.21.15.23:0/153838247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced0074d00 0x7fced0073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.005+0000 7fced8400700 1 -- 172.21.15.23:0/153838247 >> 172.21.15.23:0/153838247 conn(0x7fced00fb7f0 msgr2=0x7fced00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:06.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.006+0000 7fced8400700 1 -- 172.21.15.23:0/153838247 shutdown_connections 2024-02-28T16:23:06.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.006+0000 7fced8400700 1 -- 172.21.15.23:0/153838247 wait complete. 2024-02-28T16:23:06.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.007+0000 7fced8400700 1 Processor -- start 2024-02-28T16:23:06.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.007+0000 7fced8400700 1 -- start start 2024-02-28T16:23:06.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.008+0000 7fced8400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0074d00 0x7fced0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:06.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.008+0000 7fced8400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced0198420 0x7fced019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:06.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.008+0000 7fced8400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced0198920 con 0x7fced0074d00 2024-02-28T16:23:06.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.008+0000 7fced8400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced0198a90 con 0x7fced0198420 2024-02-28T16:23:06.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.008+0000 7fced5a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0074d00 0x7fced0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:06.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.008+0000 7fced5a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0074d00 0x7fced0197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56988/0 (socket says 172.21.15.23:56988) 2024-02-28T16:23:06.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.008+0000 7fced5a00700 1 -- 172.21.15.23:0/3509634429 learned_addr learned my addr 172.21.15.23:0/3509634429 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:06.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.009+0000 7fced5000700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced0198420 0x7fced019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:06.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.009+0000 7fced5a00700 1 -- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced0198420 msgr2=0x7fced019d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.009+0000 7fced5a00700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced0198420 0x7fced019d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.009+0000 7fced5a00700 1 -- 172.21.15.23:0/3509634429 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0095f0 con 0x7fced0074d00 2024-02-28T16:23:06.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.009+0000 7fced5a00700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0074d00 0x7fced0197ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcec400d8d0 tx=0x7fcec400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:07.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.010+0000 7fcece000700 1 -- 172.21.15.23:0/3509634429 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec4009940 con 0x7fced0074d00 2024-02-28T16:23:07.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.010+0000 7fcece000700 1 -- 172.21.15.23:0/3509634429 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcec4010460 con 0x7fced0074d00 2024-02-28T16:23:07.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.010+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced019da30 con 0x7fced0074d00 2024-02-28T16:23:07.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.010+0000 7fcece000700 1 -- 172.21.15.23:0/3509634429 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec400f5f0 con 0x7fced0074d00 2024-02-28T16:23:07.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.010+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced019df50 con 0x7fced0074d00 2024-02-28T16:23:07.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.012+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced010af70 con 0x7fced0074d00 2024-02-28T16:23:07.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.012+0000 7fcece000700 1 -- 172.21.15.23:0/3509634429 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 23) v1 ==== 46013+0+0 (secure 0 0 0) 0x7fcec40105d0 con 0x7fced0074d00 2024-02-28T16:23:07.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.013+0000 7fcece000700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fceb8038e30 0x7fceb803b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:07.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.013+0000 7fcece000700 1 -- 172.21.15.23:0/3509634429 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcec404cea0 con 0x7fced0074d00 2024-02-28T16:23:07.004 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.015+0000 7fced5000700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fceb8038e30 0x7fceb803b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:07.008 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.019+0000 7fced5000700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fceb8038e30 0x7fceb803b2e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcebc005090 tx=0x7fcebc00b540 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:07.011 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.021+0000 7fcece000700 1 -- 172.21.15.23:0/3509634429 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fcec401a730 con 0x7fced0074d00 2024-02-28T16:23:07.399 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.409+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fced01077c0 con 0x7fceb8038e30 2024-02-28T16:23:07.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.422+0000 7fcece000700 1 -- 172.21.15.23:0/3509634429 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fced01077c0 con 0x7fceb8038e30 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fceb8038e30 msgr2=0x7fceb803b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fceb8038e30 0x7fceb803b2e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcebc005090 tx=0x7fcebc00b540 comp rx=0 tx=0).stop 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0074d00 msgr2=0x7fced0197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0074d00 0x7fced0197ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcec400d8d0 tx=0x7fcec400dc90 comp rx=0 tx=0).stop 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 shutdown_connections 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fceb8038e30 0x7fceb803b2e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fced0074d00 0x7fced0197ee0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 --2- 172.21.15.23:0/3509634429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced0198420 0x7fced019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 >> 172.21.15.23:0/3509634429 conn(0x7fced00fb7f0 msgr2=0x7fced01060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:07.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 shutdown_connections 2024-02-28T16:23:07.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.426+0000 7fced8400700 1 -- 172.21.15.23:0/3509634429 wait complete. 2024-02-28T16:23:07.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.633+0000 7fd381200700 1 -- 172.21.15.23:0/901427224 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 msgr2=0x7fd37c071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:07.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.633+0000 7fd381200700 1 --2- 172.21.15.23:0/901427224 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 0x7fd37c071e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009910 tx=0x7fd36c009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:07.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.633+0000 7fd381200700 1 -- 172.21.15.23:0/901427224 shutdown_connections 2024-02-28T16:23:07.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.633+0000 7fd381200700 1 --2- 172.21.15.23:0/901427224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c0723e0 0x7fd37c10be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:07.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.634+0000 7fd381200700 1 --2- 172.21.15.23:0/901427224 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 0x7fd37c071e10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:07.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.634+0000 7fd381200700 1 -- 172.21.15.23:0/901427224 >> 172.21.15.23:0/901427224 conn(0x7fd37c06d110 msgr2=0x7fd37c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:07.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.635+0000 7fd381200700 1 -- 172.21.15.23:0/901427224 shutdown_connections 2024-02-28T16:23:07.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.635+0000 7fd381200700 1 -- 172.21.15.23:0/901427224 wait complete. 2024-02-28T16:23:07.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.636+0000 7fd381200700 1 Processor -- start 2024-02-28T16:23:07.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.637+0000 7fd381200700 1 -- start start 2024-02-28T16:23:07.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.637+0000 7fd381200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 0x7fd37c1a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:07.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.637+0000 7fd381200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c0723e0 0x7fd37c1a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:07.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.637+0000 7fd381200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1a53d0 con 0x7fd37c071a00 2024-02-28T16:23:07.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.637+0000 7fd381200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1a5510 con 0x7fd37c0723e0 2024-02-28T16:23:07.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.638+0000 7fd379400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c0723e0 0x7fd37c1a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:07.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.638+0000 7fd379400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c0723e0 0x7fd37c1a4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:42722/0 (socket says 172.21.15.23:42722) 2024-02-28T16:23:07.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.638+0000 7fd379400700 1 -- 172.21.15.23:0/2346556186 learned_addr learned my addr 172.21.15.23:0/2346556186 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:07.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.638+0000 7fd379e00700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 0x7fd37c1a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:07.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.639+0000 7fd379e00700 1 -- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c0723e0 msgr2=0x7fd37c1a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:07.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.639+0000 7fd379e00700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c0723e0 0x7fd37c1a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:07.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.639+0000 7fd379e00700 1 -- 172.21.15.23:0/2346556186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0095f0 con 0x7fd37c071a00 2024-02-28T16:23:07.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.639+0000 7fd379e00700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 0x7fd37c1a4870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd36c000c00 tx=0x7fd36c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:07.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.640+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c01d070 con 0x7fd37c071a00 2024-02-28T16:23:07.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.640+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c10f5c0 con 0x7fd37c071a00 2024-02-28T16:23:07.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.640+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd36c022470 con 0x7fd37c071a00 2024-02-28T16:23:07.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.640+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c00f690 con 0x7fd37c071a00 2024-02-28T16:23:07.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.640+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c10fa60 con 0x7fd37c071a00 2024-02-28T16:23:07.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.642+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c19ea80 con 0x7fd37c071a00 2024-02-28T16:23:07.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.642+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 23) v1 ==== 46013+0+0 (secure 0 0 0) 0x7fd36c0225e0 con 0x7fd37c071a00 2024-02-28T16:23:07.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.643+0000 7fd372a00700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fd360038e30 0x7fd36003b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:07.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.643+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd36c0163b0 con 0x7fd37c071a00 2024-02-28T16:23:07.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.644+0000 7fd379400700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fd360038e30 0x7fd36003b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:07.635 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.646+0000 7fd379400700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fd360038e30 0x7fd36003b2e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd368005fd0 tx=0x7fd368005e70 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:07.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.650+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fd36c02be20 con 0x7fd37c071a00 2024-02-28T16:23:07.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:07.667+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mgrmap(e 24) v1 ==== 46069+0+0 (secure 0 0 0) 0x7fd36c004af0 con 0x7fd37c071a00 2024-02-28T16:23:07.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:07 smithi023 ceph-mon[29137]: pgmap v5: 65 pgs: 65 active+clean; 74 MiB data, 486 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:23:07.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:07 smithi023 ceph-mon[29137]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:07.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:07 smithi023 ceph-mon[29137]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:08.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.036+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd37c0620d0 con 0x7fd360038e30 2024-02-28T16:23:08.079 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.089+0000 7fd372a00700 1 -- 172.21.15.23:0/2346556186 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd37c0620d0 con 0x7fd360038e30 2024-02-28T16:23:08.079 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:23:08.079 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (8m) 2m ago 9m 13.5M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:23:08.079 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (10m) 2m ago 10m 7490k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:23:08.079 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (8m) 16s ago 8m 7369k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:23:08.079 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (10m) 2m ago 10m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:23:08.079 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (8m) 16s ago 8m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (7m) 2m ago 9m 74.3M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (2m) 2m ago 2m 14.1M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (2m) 2m ago 2m 11.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (2m) 16s ago 2m 12.7M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (2m) 16s ago 2m 12.7M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:9283,8765,8443 running (11m) 2m ago 11m 488M - 18.2.0 dc2bc1663786 b278ec72c436 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (23s) 16s ago 8m 52.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1b0f874317ec 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (11m) 2m ago 11m 45.3M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (8m) 16s ago 8m 35.0M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (10m) 2m ago 10m 7818k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (8m) 16s ago 8m 8242k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (7m) 2m ago 7m 46.7M 3947M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (7m) 2m ago 6m 46.6M 3947M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (6m) 2m ago 6m 45.8M 3947M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:23:08.080 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (5m) 16s ago 5m 60.1M 4971M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:23:08.081 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (5m) 16s ago 5m 57.9M 4971M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:23:08.081 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (4m) 16s ago 4m 55.5M 4971M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:23:08.081 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (7m) 2m ago 9m 53.0M - 2.43.0 a07b618ecd1d 8297ca033a9b 2024-02-28T16:23:08.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.092+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fd360038e30 msgr2=0x7fd36003b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:08.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.092+0000 7fd381200700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fd360038e30 0x7fd36003b2e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd368005fd0 tx=0x7fd368005e70 comp rx=0 tx=0).stop 2024-02-28T16:23:08.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.092+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 msgr2=0x7fd37c1a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:08.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.092+0000 7fd381200700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 0x7fd37c1a4870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd36c000c00 tx=0x7fd36c00be20 comp rx=0 tx=0).stop 2024-02-28T16:23:08.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.094+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 shutdown_connections 2024-02-28T16:23:08.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.094+0000 7fd381200700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fd360038e30 0x7fd36003b2e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.094+0000 7fd381200700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd37c071a00 0x7fd37c1a4870 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.094+0000 7fd381200700 1 --2- 172.21.15.23:0/2346556186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c0723e0 0x7fd37c1a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.094+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 >> 172.21.15.23:0/2346556186 conn(0x7fd37c06d110 msgr2=0x7fd37c10b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:08.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.094+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 shutdown_connections 2024-02-28T16:23:08.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.094+0000 7fd381200700 1 -- 172.21.15.23:0/2346556186 wait complete. 2024-02-28T16:23:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:07 smithi153 ceph-mon[35341]: pgmap v5: 65 pgs: 65 active+clean; 74 MiB data, 486 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:23:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:07 smithi153 ceph-mon[35341]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:07 smithi153 ceph-mon[35341]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:08.292 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.301+0000 7fc3dde00700 1 -- 172.21.15.23:0/370381762 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 msgr2=0x7fc3d8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:08.292 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.301+0000 7fc3dde00700 1 --2- 172.21.15.23:0/370381762 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8101890 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009870 tx=0x7fc3c4009b80 comp rx=0 tx=0).stop 2024-02-28T16:23:08.294 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.303+0000 7fc3dde00700 1 -- 172.21.15.23:0/370381762 shutdown_connections 2024-02-28T16:23:08.294 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.303+0000 7fc3dde00700 1 --2- 172.21.15.23:0/370381762 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8101890 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.294 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.303+0000 7fc3dde00700 1 --2- 172.21.15.23:0/370381762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3d8100240 0x7fc3d8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.294 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.303+0000 7fc3dde00700 1 -- 172.21.15.23:0/370381762 >> 172.21.15.23:0/370381762 conn(0x7fc3d80fb7f0 msgr2=0x7fc3d80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.305+0000 7fc3dde00700 1 -- 172.21.15.23:0/370381762 shutdown_connections 2024-02-28T16:23:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.305+0000 7fc3dde00700 1 -- 172.21.15.23:0/370381762 wait complete. 2024-02-28T16:23:08.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.306+0000 7fc3dde00700 1 Processor -- start 2024-02-28T16:23:08.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.309+0000 7fc3dde00700 1 -- start start 2024-02-28T16:23:08.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.309+0000 7fc3dde00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3d8100240 0x7fc3d8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:08.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.309+0000 7fc3dde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:08.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.309+0000 7fc3dde00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8196610 con 0x7fc3d8101440 2024-02-28T16:23:08.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.309+0000 7fc3dde00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8196750 con 0x7fc3d8100240 2024-02-28T16:23:08.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.309+0000 7fc3d6000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:08.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.310+0000 7fc3d6000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57026/0 (socket says 172.21.15.23:57026) 2024-02-28T16:23:08.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.310+0000 7fc3d6000700 1 -- 172.21.15.23:0/1719960853 learned_addr learned my addr 172.21.15.23:0/1719960853 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:08.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.310+0000 7fc3d6a00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3d8100240 0x7fc3d8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:08.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.310+0000 7fc3d6000700 1 -- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3d8100240 msgr2=0x7fc3d8195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:08.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.310+0000 7fc3d6000700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3d8100240 0x7fc3d8195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.310+0000 7fc3d6000700 1 -- 172.21.15.23:0/1719960853 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4009520 con 0x7fc3d8101440 2024-02-28T16:23:08.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.310+0000 7fc3d6000700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8195ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009f50 tx=0x7fc3c400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:08.301 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.311+0000 7fc3dca00700 1 -- 172.21.15.23:0/1719960853 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c401c070 con 0x7fc3d8101440 2024-02-28T16:23:08.301 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.311+0000 7fc3dca00700 1 -- 172.21.15.23:0/1719960853 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3c400be80 con 0x7fc3d8101440 2024-02-28T16:23:08.301 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.311+0000 7fc3dca00700 1 -- 172.21.15.23:0/1719960853 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c4022e00 con 0x7fc3d8101440 2024-02-28T16:23:08.302 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.311+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d80730c0 con 0x7fc3d8101440 2024-02-28T16:23:08.302 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.311+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d8073560 con 0x7fc3d8101440 2024-02-28T16:23:08.302 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.313+0000 7fc3dca00700 1 -- 172.21.15.23:0/1719960853 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 24) v1 ==== 46069+0+0 (secure 0 0 0) 0x7fc3c4020070 con 0x7fc3d8101440 2024-02-28T16:23:08.303 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.314+0000 7fc3dca00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fc3bc038eb0 0x7fc3bc03b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:08.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.314+0000 7fc3dca00700 1 -- 172.21.15.23:0/1719960853 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc3c404e130 con 0x7fc3d8101440 2024-02-28T16:23:08.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.315+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d8108d90 con 0x7fc3d8101440 2024-02-28T16:23:08.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.315+0000 7fc3d6a00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fc3bc038eb0 0x7fc3bc03b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:08.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.316+0000 7fc3d6a00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fc3bc038eb0 0x7fc3bc03b360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc3d81012a0 tx=0x7fc3c8009310 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:08.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.322+0000 7fc3dca00700 1 -- 172.21.15.23:0/1719960853 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc3c4027020 con 0x7fc3d8101440 2024-02-28T16:23:08.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.824+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3d8073cb0 con 0x7fc3d8101440 2024-02-28T16:23:08.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.825+0000 7fc3dca00700 1 -- 172.21.15.23:0/1719960853 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fc3c400fb30 con 0x7fc3d8101440 2024-02-28T16:23:08.818 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:23:08.818 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:23:08.819 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:23:08.820 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fc3bc038eb0 msgr2=0x7fc3bc03b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:08.820 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fc3bc038eb0 0x7fc3bc03b360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc3d81012a0 tx=0x7fc3c8009310 comp rx=0 tx=0).stop 2024-02-28T16:23:08.820 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 msgr2=0x7fc3d8195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:08.820 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8195ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009f50 tx=0x7fc3c400f740 comp rx=0 tx=0).stop 2024-02-28T16:23:08.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 shutdown_connections 2024-02-28T16:23:08.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3d8100240 0x7fc3d8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fc3bc038eb0 0x7fc3bc03b360 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 --2- 172.21.15.23:0/1719960853 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3d8101440 0x7fc3d8195ff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:08.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.829+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 >> 172.21.15.23:0/1719960853 conn(0x7fc3d80fb7f0 msgr2=0x7fc3d8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:08.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.830+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 shutdown_connections 2024-02-28T16:23:08.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:08.830+0000 7fc3dde00700 1 -- 172.21.15.23:0/1719960853 wait complete. 2024-02-28T16:23:08.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:08 smithi153 ceph-mon[35341]: mgrmap e24: smithi153.qlkchp(active, since 5s) 2024-02-28T16:23:08.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:08 smithi153 ceph-mon[35341]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:08.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:08 smithi023 ceph-mon[29137]: mgrmap e24: smithi153.qlkchp(active, since 5s) 2024-02-28T16:23:08.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:08 smithi023 ceph-mon[29137]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:09.024 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 -- 172.21.15.23:0/27668728 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4618101440 msgr2=0x7f4618101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:09.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 --2- 172.21.15.23:0/27668728 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4618101440 0x7f4618101890 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4604009910 tx=0x7f4604009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:09.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 -- 172.21.15.23:0/27668728 shutdown_connections 2024-02-28T16:23:09.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 --2- 172.21.15.23:0/27668728 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4618101440 0x7f4618101890 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 --2- 172.21.15.23:0/27668728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618100240 0x7f4618100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 -- 172.21.15.23:0/27668728 >> 172.21.15.23:0/27668728 conn(0x7f46180fb7f0 msgr2=0x7f46180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:09.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 -- 172.21.15.23:0/27668728 shutdown_connections 2024-02-28T16:23:09.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.035+0000 7f461d200700 1 -- 172.21.15.23:0/27668728 wait complete. 2024-02-28T16:23:09.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.036+0000 7f461d200700 1 Processor -- start 2024-02-28T16:23:09.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.037+0000 7f461d200700 1 -- start start 2024-02-28T16:23:09.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.037+0000 7f461d200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4618100240 0x7f4618197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:09.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.037+0000 7f461d200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618101440 0x7f46181981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:09.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.037+0000 7f461d200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46181987d0 con 0x7f4618100240 2024-02-28T16:23:09.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.037+0000 7f461d200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4618198940 con 0x7f4618101440 2024-02-28T16:23:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.038+0000 7f4615400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618101440 0x7f46181981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.038+0000 7f4615400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618101440 0x7f46181981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:42762/0 (socket says 172.21.15.23:42762) 2024-02-28T16:23:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.038+0000 7f4615400700 1 -- 172.21.15.23:0/1243636810 learned_addr learned my addr 172.21.15.23:0/1243636810 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.038+0000 7f4615400700 1 -- 172.21.15.23:0/1243636810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4618100240 msgr2=0x7f4618197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:09.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.038+0000 7f4615400700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4618100240 0x7f4618197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.038+0000 7f4615400700 1 -- 172.21.15.23:0/1243636810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040095f0 con 0x7f4618101440 2024-02-28T16:23:09.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.039+0000 7f4615400700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618101440 0x7f46181981d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f460400b5c0 tx=0x7f460400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:09.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.040+0000 7f460ea00700 1 -- 172.21.15.23:0/1243636810 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f460401d070 con 0x7f4618101440 2024-02-28T16:23:09.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.040+0000 7f460ea00700 1 -- 172.21.15.23:0/1243636810 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f460400f460 con 0x7f4618101440 2024-02-28T16:23:09.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.040+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461819d370 con 0x7f4618101440 2024-02-28T16:23:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.040+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461819d860 con 0x7f4618101440 2024-02-28T16:23:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.040+0000 7f460ea00700 1 -- 172.21.15.23:0/1243636810 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4604021640 con 0x7f4618101440 2024-02-28T16:23:09.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.041+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f8005320 con 0x7f4618101440 2024-02-28T16:23:09.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.041+0000 7f460ea00700 1 -- 172.21.15.23:0/1243636810 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 46069+0+0 (secure 0 0 0) 0x7f460402b440 con 0x7f4618101440 2024-02-28T16:23:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.042+0000 7f460ea00700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f45fc038eb0 0x7f45fc03b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.042+0000 7f460ea00700 1 -- 172.21.15.23:0/1243636810 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f460404e2e0 con 0x7f4618101440 2024-02-28T16:23:09.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.043+0000 7f4615e00700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f45fc038eb0 0x7f45fc03b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:09.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.043+0000 7f4615e00700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f45fc038eb0 0x7f45fc03b360 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4618198b70 tx=0x7f4608009470 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:09.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.051+0000 7f460ea00700 1 -- 172.21.15.23:0/1243636810 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4604029930 con 0x7f4618101440 2024-02-28T16:23:09.459 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.469+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45f8005cc0 con 0x7f4618101440 2024-02-28T16:23:09.459 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.470+0000 7f460ea00700 1 -- 172.21.15.23:0/1243636810 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7f4604026020 con 0x7f4618101440 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:23:09.460 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:23:09.461 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:09.462 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:09.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.472+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f45fc038eb0 msgr2=0x7f45fc03b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:09.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.472+0000 7f461d200700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f45fc038eb0 0x7f45fc03b360 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4618198b70 tx=0x7f4608009470 comp rx=0 tx=0).stop 2024-02-28T16:23:09.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.472+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618101440 msgr2=0x7f46181981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:09.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.472+0000 7f461d200700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618101440 0x7f46181981d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f460400b5c0 tx=0x7f460400be20 comp rx=0 tx=0).stop 2024-02-28T16:23:09.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.473+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 shutdown_connections 2024-02-28T16:23:09.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.473+0000 7f461d200700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f45fc038eb0 0x7f45fc03b360 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.473+0000 7f461d200700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4618100240 0x7f4618197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.473+0000 7f461d200700 1 --2- 172.21.15.23:0/1243636810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4618101440 0x7f46181981d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.473+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 >> 172.21.15.23:0/1243636810 conn(0x7f46180fb7f0 msgr2=0x7f4618102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:09.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.473+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 shutdown_connections 2024-02-28T16:23:09.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.473+0000 7f461d200700 1 -- 172.21.15.23:0/1243636810 wait complete. 2024-02-28T16:23:09.466 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:23:09.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.670+0000 7f8895600700 1 -- 172.21.15.23:0/1956773811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 msgr2=0x7f8890100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:09.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.670+0000 7f8895600700 1 --2- 172.21.15.23:0/1956773811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890100650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8880009910 tx=0x7f8880009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:09.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.670+0000 7f8895600700 1 -- 172.21.15.23:0/1956773811 shutdown_connections 2024-02-28T16:23:09.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.670+0000 7f8895600700 1 --2- 172.21.15.23:0/1956773811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8890101440 0x7f8890101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.670+0000 7f8895600700 1 --2- 172.21.15.23:0/1956773811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890100650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.670+0000 7f8895600700 1 -- 172.21.15.23:0/1956773811 >> 172.21.15.23:0/1956773811 conn(0x7f88900fb7f0 msgr2=0x7f88900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:09.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.671+0000 7f8895600700 1 -- 172.21.15.23:0/1956773811 shutdown_connections 2024-02-28T16:23:09.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.671+0000 7f8895600700 1 -- 172.21.15.23:0/1956773811 wait complete. 2024-02-28T16:23:09.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.672+0000 7f8895600700 1 Processor -- start 2024-02-28T16:23:09.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.673+0000 7f8895600700 1 -- start start 2024-02-28T16:23:09.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.673+0000 7f8895600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:09.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.673+0000 7f8895600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8890101440 0x7f88900722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:09.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.673+0000 7f8895600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8890072900 con 0x7f8890100240 2024-02-28T16:23:09.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.673+0000 7f8895600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88901a3900 con 0x7f8890101440 2024-02-28T16:23:09.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.674+0000 7f888ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:09.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.674+0000 7f888ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54572/0 (socket says 172.21.15.23:54572) 2024-02-28T16:23:09.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.674+0000 7f888ea00700 1 -- 172.21.15.23:0/3509462454 learned_addr learned my addr 172.21.15.23:0/3509462454 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:09.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.674+0000 7f888e000700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8890101440 0x7f88900722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:09.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.675+0000 7f888ea00700 1 -- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8890101440 msgr2=0x7f88900722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:09.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.675+0000 7f888ea00700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8890101440 0x7f88900722e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:09.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.675+0000 7f888ea00700 1 -- 172.21.15.23:0/3509462454 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800095f0 con 0x7f8890100240 2024-02-28T16:23:09.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.675+0000 7f888ea00700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890071da0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8880000c00 tx=0x7f888000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:09.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.677+0000 7f8887400700 1 -- 172.21.15.23:0/3509462454 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f888001d070 con 0x7f8890100240 2024-02-28T16:23:09.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.678+0000 7f8887400700 1 -- 172.21.15.23:0/3509462454 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8880022470 con 0x7f8890100240 2024-02-28T16:23:09.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.678+0000 7f8887400700 1 -- 172.21.15.23:0/3509462454 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f888000f670 con 0x7f8890100240 2024-02-28T16:23:09.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.678+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8890072f80 con 0x7f8890100240 2024-02-28T16:23:09.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.678+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88900733d0 con 0x7f8890100240 2024-02-28T16:23:09.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.679+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8890108e10 con 0x7f8890100240 2024-02-28T16:23:09.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.680+0000 7f8887400700 1 -- 172.21.15.23:0/3509462454 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 24) v1 ==== 46069+0+0 (secure 0 0 0) 0x7f88800225e0 con 0x7f8890100240 2024-02-28T16:23:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.681+0000 7f8887400700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8874038f00 0x7f887403b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.681+0000 7f8887400700 1 -- 172.21.15.23:0/3509462454 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f888004ec20 con 0x7f8890100240 2024-02-28T16:23:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.682+0000 7f888e000700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8874038f00 0x7f887403b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:09.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.683+0000 7f888e000700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8874038f00 0x7f887403b3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f887c006fd0 tx=0x7f887c008040 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:09.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:09.691+0000 7f8887400700 1 -- 172.21.15.23:0/3509462454 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f888000f890 con 0x7f8890100240 2024-02-28T16:23:09.864 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:09 smithi023 ceph-mon[29137]: pgmap v6: 65 pgs: 65 active+clean; 86 MiB data, 499 MiB used, 536 GiB / 536 GiB avail; 41 KiB/s rd, 2.6 MiB/s wr, 231 op/s 2024-02-28T16:23:09.864 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:09 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1719960853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:23:09.864 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:09 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1243636810' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:23:10.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.040+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8890105d90 con 0x7f8874038f00 2024-02-28T16:23:10.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.051+0000 7f8887400700 1 -- 172.21.15.23:0/3509462454 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8890105d90 con 0x7f8874038f00 2024-02-28T16:23:10.041 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:23:10.041 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:23:10.041 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:23:10.041 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:23:10.042 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [], 2024-02-28T16:23:10.042 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "1/23 daemons upgraded", 2024-02-28T16:23:10.042 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "", 2024-02-28T16:23:10.042 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:23:10.042 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:23:10.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8874038f00 msgr2=0x7f887403b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:10.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8874038f00 0x7f887403b3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f887c006fd0 tx=0x7f887c008040 comp rx=0 tx=0).stop 2024-02-28T16:23:10.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 msgr2=0x7f8890071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:10.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890071da0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8880000c00 tx=0x7f888000be20 comp rx=0 tx=0).stop 2024-02-28T16:23:10.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 shutdown_connections 2024-02-28T16:23:10.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8874038f00 0x7f887403b3b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8890100240 0x7f8890071da0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 --2- 172.21.15.23:0/3509462454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8890101440 0x7f88900722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.054+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 >> 172.21.15.23:0/3509462454 conn(0x7f88900fb7f0 msgr2=0x7f8890104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:10.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.055+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 shutdown_connections 2024-02-28T16:23:10.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.055+0000 7f8895600700 1 -- 172.21.15.23:0/3509462454 wait complete. 2024-02-28T16:23:10.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:09 smithi153 ceph-mon[35341]: pgmap v6: 65 pgs: 65 active+clean; 86 MiB data, 499 MiB used, 536 GiB / 536 GiB avail; 41 KiB/s rd, 2.6 MiB/s wr, 231 op/s 2024-02-28T16:23:10.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:09 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1719960853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:23:10.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:09 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1243636810' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:23:10.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.257+0000 7feb64000700 1 -- 172.21.15.23:0/955291775 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 msgr2=0x7feb5c103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:10.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.257+0000 7feb64000700 1 --2- 172.21.15.23:0/955291775 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c103140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb50009910 tx=0x7feb50009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:10.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.258+0000 7feb64000700 1 -- 172.21.15.23:0/955291775 shutdown_connections 2024-02-28T16:23:10.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.258+0000 7feb64000700 1 --2- 172.21.15.23:0/955291775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb5c103680 0x7feb5c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.258+0000 7feb64000700 1 --2- 172.21.15.23:0/955291775 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c103140 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.258+0000 7feb64000700 1 -- 172.21.15.23:0/955291775 >> 172.21.15.23:0/955291775 conn(0x7feb5c0fa780 msgr2=0x7feb5c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:10.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.259+0000 7feb64000700 1 -- 172.21.15.23:0/955291775 shutdown_connections 2024-02-28T16:23:10.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.259+0000 7feb64000700 1 -- 172.21.15.23:0/955291775 wait complete. 2024-02-28T16:23:10.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.260+0000 7feb64000700 1 Processor -- start 2024-02-28T16:23:10.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb64000700 1 -- start start 2024-02-28T16:23:10.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb64000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c19c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:10.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb64000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb5c103680 0x7feb5c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:10.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb64000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c19cc00 con 0x7feb5c100d60 2024-02-28T16:23:10.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb64000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c19cd40 con 0x7feb5c103680 2024-02-28T16:23:10.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb61600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c19c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:10.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb61600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c19c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54582/0 (socket says 172.21.15.23:54582) 2024-02-28T16:23:10.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.261+0000 7feb61600700 1 -- 172.21.15.23:0/3995749125 learned_addr learned my addr 172.21.15.23:0/3995749125 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:10.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.262+0000 7feb60c00700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb5c103680 0x7feb5c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:10.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.262+0000 7feb61600700 1 -- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb5c103680 msgr2=0x7feb5c19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:10.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.262+0000 7feb61600700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb5c103680 0x7feb5c19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.262+0000 7feb61600700 1 -- 172.21.15.23:0/3995749125 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500095f0 con 0x7feb5c100d60 2024-02-28T16:23:10.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.263+0000 7feb61600700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c19c0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb5000bda0 tx=0x7feb5000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:10.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.263+0000 7feb5a000700 1 -- 172.21.15.23:0/3995749125 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5001d070 con 0x7feb5c100d60 2024-02-28T16:23:10.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.263+0000 7feb5a000700 1 -- 172.21.15.23:0/3995749125 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb5000f460 con 0x7feb5c100d60 2024-02-28T16:23:10.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.263+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c1a1790 con 0x7feb5c100d60 2024-02-28T16:23:10.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.263+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c1a1c80 con 0x7feb5c100d60 2024-02-28T16:23:10.254 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.264+0000 7feb5a000700 1 -- 172.21.15.23:0/3995749125 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb50021640 con 0x7feb5c100d60 2024-02-28T16:23:10.257 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.267+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c005320 con 0x7feb5c100d60 2024-02-28T16:23:10.257 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.267+0000 7feb5a000700 1 -- 172.21.15.23:0/3995749125 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 24) v1 ==== 46069+0+0 (secure 0 0 0) 0x7feb5002b440 con 0x7feb5c100d60 2024-02-28T16:23:10.258 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.268+0000 7feb5a000700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7feb44038f00 0x7feb4403b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:10.258 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.268+0000 7feb5a000700 1 -- 172.21.15.23:0/3995749125 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7feb5004e200 con 0x7feb5c100d60 2024-02-28T16:23:10.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.269+0000 7feb60c00700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7feb44038f00 0x7feb4403b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:10.261 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.271+0000 7feb60c00700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7feb44038f00 0x7feb4403b3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb48005950 tx=0x7feb480058e0 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:10.270 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.279+0000 7feb5a000700 1 -- 172.21.15.23:0/3995749125 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7feb50026070 con 0x7feb5c100d60 2024-02-28T16:23:10.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.827+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feb3c005190 con 0x7feb5c100d60 2024-02-28T16:23:10.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.828+0000 7feb5a000700 1 -- 172.21.15.23:0/3995749125 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7feb50029930 con 0x7feb5c100d60 2024-02-28T16:23:10.818 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:23:10.823 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.832+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7feb44038f00 msgr2=0x7feb4403b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:10.823 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.832+0000 7feb64000700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7feb44038f00 0x7feb4403b3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb48005950 tx=0x7feb480058e0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.824 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.833+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 msgr2=0x7feb5c19c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:10.824 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.833+0000 7feb64000700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c19c0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb5000bda0 tx=0x7feb5000be80 comp rx=0 tx=0).stop 2024-02-28T16:23:10.824 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.833+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 shutdown_connections 2024-02-28T16:23:10.824 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.833+0000 7feb64000700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7feb44038f00 0x7feb4403b3b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.824 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.833+0000 7feb64000700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb5c100d60 0x7feb5c19c0a0 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb5000bda0 tx=0x7feb5000be80 comp rx=0 tx=0).stop 2024-02-28T16:23:10.825 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.833+0000 7feb64000700 1 --2- 172.21.15.23:0/3995749125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb5c103680 0x7feb5c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:10.825 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.833+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 >> 172.21.15.23:0/3995749125 conn(0x7feb5c0fa780 msgr2=0x7feb5c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:10.826 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.835+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 shutdown_connections 2024-02-28T16:23:10.826 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:10.835+0000 7feb64000700 1 -- 172.21.15.23:0/3995749125 wait complete. 2024-02-28T16:23:10.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:10 smithi023 ceph-mon[29137]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:11.047 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:10 smithi153 ceph-mon[35341]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:11.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:11 smithi023 ceph-mon[29137]: pgmap v7: 65 pgs: 65 active+clean; 89 MiB data, 508 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2024-02-28T16:23:11.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:11 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/3995749125' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:23:12.068 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:11 smithi153 ceph-mon[35341]: pgmap v7: 65 pgs: 65 active+clean; 89 MiB data, 508 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2024-02-28T16:23:12.068 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:11 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/3995749125' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:23:13.904 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:13 smithi023 ceph-mon[29137]: pgmap v8: 65 pgs: 65 active+clean; 89 MiB data, 508 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 1.8 MiB/s wr, 189 op/s 2024-02-28T16:23:13.937 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:13 smithi153 ceph-mon[35341]: pgmap v8: 65 pgs: 65 active+clean; 89 MiB data, 508 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 1.8 MiB/s wr, 189 op/s 2024-02-28T16:23:15.595 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:15 smithi023 ceph-mon[29137]: pgmap v9: 65 pgs: 65 active+clean; 103 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2024-02-28T16:23:15.595 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:15 smithi023 ceph-mon[29137]: Standby manager daemon smithi023.bbebnt started 2024-02-28T16:23:15.595 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:15 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/crt"}]: dispatch 2024-02-28T16:23:15.595 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:15 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:23:15.595 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:15 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/key"}]: dispatch 2024-02-28T16:23:15.595 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:15 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:23:15.595 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:15 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:15 smithi153 ceph-mon[35341]: pgmap v9: 65 pgs: 65 active+clean; 103 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2024-02-28T16:23:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:15 smithi153 ceph-mon[35341]: Standby manager daemon smithi023.bbebnt started 2024-02-28T16:23:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:15 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/crt"}]: dispatch 2024-02-28T16:23:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:15 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:23:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:15 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/key"}]: dispatch 2024-02-28T16:23:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:15 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1617153122' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:23:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:15 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:16.788 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:16 smithi023 ceph-mon[29137]: mgrmap e25: smithi153.qlkchp(active, since 12s), standbys: smithi023.bbebnt 2024-02-28T16:23:16.788 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:16 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:16.788 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:16 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:23:16.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:16 smithi153 ceph-mon[35341]: mgrmap e25: smithi153.qlkchp(active, since 12s), standbys: smithi023.bbebnt 2024-02-28T16:23:16.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:16 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:16.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:16 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:23:17.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:17 smithi153 ceph-mon[35341]: pgmap v10: 65 pgs: 65 active+clean; 103 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 261 op/s 2024-02-28T16:23:17.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:17 smithi023 ceph-mon[29137]: pgmap v10: 65 pgs: 65 active+clean; 103 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 261 op/s 2024-02-28T16:23:18.776 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:18 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:18.776 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:18 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:18.777 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:18 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:18.862 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:18 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:18.863 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:18 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:18.863 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:18 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:19.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:19 smithi153 ceph-mon[35341]: pgmap v11: 65 pgs: 65 active+clean; 109 MiB data, 593 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 362 op/s 2024-02-28T16:23:19.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:19 smithi023 ceph-mon[29137]: pgmap v11: 65 pgs: 65 active+clean; 109 MiB data, 593 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 362 op/s 2024-02-28T16:23:20.636 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:20 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:20.637 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:20 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:20.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:20 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:20.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:20 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:21.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:21 smithi153 ceph-mon[35341]: pgmap v12: 65 pgs: 65 active+clean; 112 MiB data, 602 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 302 op/s 2024-02-28T16:23:21.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:21 smithi023 ceph-mon[29137]: pgmap v12: 65 pgs: 65 active+clean; 112 MiB data, 602 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 302 op/s 2024-02-28T16:23:22.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:22.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:22.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi023 to 1217M 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:22.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:22.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:22.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:22 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:23:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi023 to 1217M 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:23:23.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:23.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:23.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:22 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:23:24.050 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:23 smithi023 ceph-mon[29137]: pgmap v13: 65 pgs: 65 active+clean; 112 MiB data, 602 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 257 op/s 2024-02-28T16:23:24.051 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:23 smithi023 ceph-mon[29137]: Adjusting osd_memory_target on smithi153 to 2241M 2024-02-28T16:23:24.051 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:23 smithi023 ceph-mon[29137]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:23:24.051 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:23 smithi023 ceph-mon[29137]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:23:24.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:23 smithi153 ceph-mon[35341]: pgmap v13: 65 pgs: 65 active+clean; 112 MiB data, 602 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 257 op/s 2024-02-28T16:23:24.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:23 smithi153 ceph-mon[35341]: Adjusting osd_memory_target on smithi153 to 2241M 2024-02-28T16:23:24.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:23 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:23:24.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:23 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:23:25.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:24 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:23:25.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:24 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:23:25.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:24 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:23:25.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:24 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:23:25.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:24 smithi023 ceph-mon[29137]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:23:25.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:24 smithi023 ceph-mon[29137]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:23:25.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:24 smithi023 ceph-mon[29137]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:23:25.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:24 smithi023 ceph-mon[29137]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:23:26.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: pgmap v14: 65 pgs: 65 active+clean; 122 MiB data, 656 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 374 op/s 2024-02-28T16:23:26.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:23:26.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:23:26.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:25 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: pgmap v14: 65 pgs: 65 active+clean; 122 MiB data, 656 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 374 op/s 2024-02-28T16:23:26.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:23:26.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:23:26.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:26.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:25 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:26 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:26 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:26 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:26 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:26 smithi153 ceph-mon[35341]: Reconfiguring prometheus.smithi023 (dependencies changed)... 2024-02-28T16:23:27.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:26 smithi153 ceph-mon[35341]: Reconfiguring daemon prometheus.smithi023 on smithi023 2024-02-28T16:23:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:26 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:26 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:26 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:26 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:26 smithi023 ceph-mon[29137]: Reconfiguring prometheus.smithi023 (dependencies changed)... 2024-02-28T16:23:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:26 smithi023 ceph-mon[29137]: Reconfiguring daemon prometheus.smithi023 on smithi023 2024-02-28T16:23:28.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:27 smithi153 ceph-mon[35341]: pgmap v15: 65 pgs: 65 active+clean; 122 MiB data, 656 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s wr, 254 op/s 2024-02-28T16:23:28.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:27 smithi023 ceph-mon[29137]: pgmap v15: 65 pgs: 65 active+clean; 122 MiB data, 656 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s wr, 254 op/s 2024-02-28T16:23:29.997 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:29 smithi023 ceph-mon[29137]: pgmap v16: 65 pgs: 65 active+clean; 130 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 337 op/s 2024-02-28T16:23:30.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:29 smithi153 ceph-mon[35341]: pgmap v16: 65 pgs: 65 active+clean; 130 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 337 op/s 2024-02-28T16:23:32.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:31 smithi153 ceph-mon[35341]: pgmap v17: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 267 op/s 2024-02-28T16:23:32.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:31 smithi023 ceph-mon[29137]: pgmap v17: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 267 op/s 2024-02-28T16:23:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:32 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:33.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:32 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:33.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:33 smithi023 ceph-mon[29137]: pgmap v18: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s wr, 230 op/s 2024-02-28T16:23:34.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:33 smithi153 ceph-mon[35341]: pgmap v18: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s wr, 230 op/s 2024-02-28T16:23:35.539 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:35 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:35.539 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:35 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:35.539 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:35 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:23:35.539 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:35 smithi023 ceph-mon[29137]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:23:35.539 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:35 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:35.540 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:35 smithi023 ceph-mon[29137]: Upgrade: Need to upgrade myself (mgr.smithi153.qlkchp) 2024-02-28T16:23:35.540 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:35 smithi023 ceph-mon[29137]: Upgrade: Need to upgrade myself (mgr.smithi153.qlkchp) 2024-02-28T16:23:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:35 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:35.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:35 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:35 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:23:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:35 smithi153 ceph-mon[35341]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:23:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:35 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:35 smithi153 ceph-mon[35341]: Upgrade: Need to upgrade myself (mgr.smithi153.qlkchp) 2024-02-28T16:23:35.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:35 smithi153 ceph-mon[35341]: Upgrade: Need to upgrade myself (mgr.smithi153.qlkchp) 2024-02-28T16:23:36.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:36 smithi153 ceph-mon[35341]: pgmap v19: 65 pgs: 65 active+clean; 145 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 332 op/s 2024-02-28T16:23:36.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:36 smithi023 ceph-mon[29137]: pgmap v19: 65 pgs: 65 active+clean; 145 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 332 op/s 2024-02-28T16:23:38.017 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: pgmap v20: 65 pgs: 65 active+clean; 145 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 215 op/s 2024-02-28T16:23:38.018 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: Upgrade: Updating mgr.smithi023.bbebnt 2024-02-28T16:23:38.018 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:38.018 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:23:38.018 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:23:38.018 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:23:38.018 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:38.018 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:37 smithi023 ceph-mon[29137]: Deploying daemon mgr.smithi023.bbebnt on smithi023 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: pgmap v20: 65 pgs: 65 active+clean; 145 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 215 op/s 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: Upgrade: Updating mgr.smithi023.bbebnt 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:38.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:37 smithi153 ceph-mon[35341]: Deploying daemon mgr.smithi023.bbebnt on smithi023 2024-02-28T16:23:40.089 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:39 smithi023 ceph-mon[29137]: pgmap v21: 65 pgs: 65 active+clean; 155 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 315 op/s 2024-02-28T16:23:40.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:39 smithi153 ceph-mon[35341]: pgmap v21: 65 pgs: 65 active+clean; 155 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 315 op/s 2024-02-28T16:23:41.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.079+0000 7fb340c00700 1 -- 172.21.15.23:0/83600962 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 msgr2=0x7fb33c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:41.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.079+0000 7fb340c00700 1 --2- 172.21.15.23:0/83600962 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c073180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009910 tx=0x7fb32c009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:41.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.080+0000 7fb340c00700 1 -- 172.21.15.23:0/83600962 shutdown_connections 2024-02-28T16:23:41.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.080+0000 7fb340c00700 1 --2- 172.21.15.23:0/83600962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb33c073750 0x7fb33c073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.080+0000 7fb340c00700 1 --2- 172.21.15.23:0/83600962 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c073180 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.080+0000 7fb340c00700 1 -- 172.21.15.23:0/83600962 >> 172.21.15.23:0/83600962 conn(0x7fb33c0fb7f0 msgr2=0x7fb33c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:41.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.081+0000 7fb340c00700 1 -- 172.21.15.23:0/83600962 shutdown_connections 2024-02-28T16:23:41.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.081+0000 7fb340c00700 1 -- 172.21.15.23:0/83600962 wait complete. 2024-02-28T16:23:41.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.082+0000 7fb340c00700 1 Processor -- start 2024-02-28T16:23:41.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.083+0000 7fb340c00700 1 -- start start 2024-02-28T16:23:41.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.084+0000 7fb340c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb33c073750 0x7fb33c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:41.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.084+0000 7fb340c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:41.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.084+0000 7fb340c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0728e0 con 0x7fb33c074d20 2024-02-28T16:23:41.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.084+0000 7fb340c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c1a5a50 con 0x7fb33c073750 2024-02-28T16:23:41.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.084+0000 7fb339400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:41.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.084+0000 7fb339400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c0722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52306/0 (socket says 172.21.15.23:52306) 2024-02-28T16:23:41.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.085+0000 7fb339400700 1 -- 172.21.15.23:0/4092896722 learned_addr learned my addr 172.21.15.23:0/4092896722 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:41.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.085+0000 7fb339e00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb33c073750 0x7fb33c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:41.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.086+0000 7fb339400700 1 -- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb33c073750 msgr2=0x7fb33c071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:41.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.086+0000 7fb339400700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb33c073750 0x7fb33c071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.086+0000 7fb339400700 1 -- 172.21.15.23:0/4092896722 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c0095f0 con 0x7fb33c074d20 2024-02-28T16:23:41.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.087+0000 7fb339400700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c0722c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb32800d8d0 tx=0x7fb32800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:41.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.087+0000 7fb332a00700 1 -- 172.21.15.23:0/4092896722 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3280098a0 con 0x7fb33c074d20 2024-02-28T16:23:41.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.087+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c1a5c50 con 0x7fb33c074d20 2024-02-28T16:23:41.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.087+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c1a6150 con 0x7fb33c074d20 2024-02-28T16:23:41.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.087+0000 7fb332a00700 1 -- 172.21.15.23:0/4092896722 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb328010460 con 0x7fb33c074d20 2024-02-28T16:23:41.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.087+0000 7fb332a00700 1 -- 172.21.15.23:0/4092896722 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32800f5f0 con 0x7fb33c074d20 2024-02-28T16:23:41.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.089+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c005320 con 0x7fb33c074d20 2024-02-28T16:23:41.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.091+0000 7fb332a00700 1 -- 172.21.15.23:0/4092896722 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 25) v1 ==== 90730+0+0 (secure 0 0 0) 0x7fb328009a00 con 0x7fb33c074d20 2024-02-28T16:23:41.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.092+0000 7fb332a00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb32006cf00 0x7fb32006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:41.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.092+0000 7fb332a00700 1 -- 172.21.15.23:0/4092896722 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb32808c420 con 0x7fb33c074d20 2024-02-28T16:23:41.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.093+0000 7fb339e00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb32006cf00 0x7fb32006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:41.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.095+0000 7fb339e00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb32006cf00 0x7fb32006f3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb32c006010 tx=0x7fb32c00b560 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:41.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.099+0000 7fb332a00700 1 -- 172.21.15.23:0/4092896722 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb328059be0 con 0x7fb33c074d20 2024-02-28T16:23:41.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.474+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb31c000bf0 con 0x7fb32006cf00 2024-02-28T16:23:41.468 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.478+0000 7fb332a00700 1 -- 172.21.15.23:0/4092896722 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fb31c000bf0 con 0x7fb32006cf00 2024-02-28T16:23:41.471 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb32006cf00 msgr2=0x7fb32006f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:41.472 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb32006cf00 0x7fb32006f3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb32c006010 tx=0x7fb32c00b560 comp rx=0 tx=0).stop 2024-02-28T16:23:41.472 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 msgr2=0x7fb33c0722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:41.472 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c0722c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb32800d8d0 tx=0x7fb32800dbe0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.472 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 shutdown_connections 2024-02-28T16:23:41.472 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb33c073750 0x7fb33c071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.472 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb32006cf00 0x7fb32006f3b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.473 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 --2- 172.21.15.23:0/4092896722 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb33c074d20 0x7fb33c0722c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.473 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.481+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 >> 172.21.15.23:0/4092896722 conn(0x7fb33c0fb7f0 msgr2=0x7fb33c106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:41.473 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.482+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 shutdown_connections 2024-02-28T16:23:41.473 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.482+0000 7fb340c00700 1 -- 172.21.15.23:0/4092896722 wait complete. 2024-02-28T16:23:41.495 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.708+0000 7fe1ec000700 1 -- 172.21.15.23:0/2969754873 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 msgr2=0x7fe1e4105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.708+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2969754873 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4105a60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009910 tx=0x7fe1d0009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.709+0000 7fe1ec000700 1 -- 172.21.15.23:0/2969754873 shutdown_connections 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.709+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2969754873 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4105a60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.709+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2969754873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1e4100d60 0x7fe1e4103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.709+0000 7fe1ec000700 1 -- 172.21.15.23:0/2969754873 >> 172.21.15.23:0/2969754873 conn(0x7fe1e40fa780 msgr2=0x7fe1e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.709+0000 7fe1ec000700 1 -- 172.21.15.23:0/2969754873 shutdown_connections 2024-02-28T16:23:41.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.709+0000 7fe1ec000700 1 -- 172.21.15.23:0/2969754873 wait complete. 2024-02-28T16:23:41.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.710+0000 7fe1ec000700 1 Processor -- start 2024-02-28T16:23:41.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.711+0000 7fe1ec000700 1 -- start start 2024-02-28T16:23:41.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.711+0000 7fe1ec000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1e4100d60 0x7fe1e40719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:41.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.711+0000 7fe1ec000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:41.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.711+0000 7fe1ec000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4072550 con 0x7fe1e4103680 2024-02-28T16:23:41.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.711+0000 7fe1ec000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4072690 con 0x7fe1e4100d60 2024-02-28T16:23:41.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.711+0000 7fe1e8c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:41.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.712+0000 7fe1e8c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4071f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52328/0 (socket says 172.21.15.23:52328) 2024-02-28T16:23:41.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.712+0000 7fe1e8c00700 1 -- 172.21.15.23:0/2977741676 learned_addr learned my addr 172.21.15.23:0/2977741676 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:41.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.712+0000 7fe1e9600700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1e4100d60 0x7fe1e40719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:41.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.712+0000 7fe1e9600700 1 -- 172.21.15.23:0/2977741676 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 msgr2=0x7fe1e4071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:41.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.713+0000 7fe1e9600700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:41.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.713+0000 7fe1e9600700 1 -- 172.21.15.23:0/2977741676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d00095f0 con 0x7fe1e4100d60 2024-02-28T16:23:41.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.713+0000 7fe1e8c00700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:23:41.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.713+0000 7fe1e9600700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1e4100d60 0x7fe1e40719f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4069000 tx=0x7fe1d800dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:41.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.714+0000 7fe1e2000700 1 -- 172.21.15.23:0/2977741676 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d800f860 con 0x7fe1e4100d60 2024-02-28T16:23:41.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.714+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e41a5c40 con 0x7fe1e4100d60 2024-02-28T16:23:41.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.714+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e41a6190 con 0x7fe1e4100d60 2024-02-28T16:23:41.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.714+0000 7fe1e2000700 1 -- 172.21.15.23:0/2977741676 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1d800fe70 con 0x7fe1e4100d60 2024-02-28T16:23:41.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.714+0000 7fe1e2000700 1 -- 172.21.15.23:0/2977741676 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d800e5e0 con 0x7fe1e4100d60 2024-02-28T16:23:41.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.716+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c4005320 con 0x7fe1e4100d60 2024-02-28T16:23:41.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.718+0000 7fe1e2000700 1 -- 172.21.15.23:0/2977741676 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) v1 ==== 90730+0+0 (secure 0 0 0) 0x7fe1d8010460 con 0x7fe1e4100d60 2024-02-28T16:23:41.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.719+0000 7fe1e2000700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe1cc06cf00 0x7fe1cc06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:41.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.719+0000 7fe1e2000700 1 -- 172.21.15.23:0/2977741676 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe1d808c3c0 con 0x7fe1e4100d60 2024-02-28T16:23:41.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.720+0000 7fe1e8c00700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe1cc06cf00 0x7fe1cc06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:41.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.724+0000 7fe1e8c00700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe1cc06cf00 0x7fe1cc06f3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0005850 tx=0x7fe1d0005ab0 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:41.728 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:41.736+0000 7fe1e2000700 1 -- 172.21.15.23:0/2977741676 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fe1d8059ae0 con 0x7fe1e4100d60 2024-02-28T16:23:42.132 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.142+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1c4000bf0 con 0x7fe1cc06cf00 2024-02-28T16:23:42.133 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:41 smithi023 ceph-mon[29137]: pgmap v22: 65 pgs: 65 active+clean; 155 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 233 op/s 2024-02-28T16:23:42.136 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.145+0000 7fe1e2000700 1 -- 172.21.15.23:0/2977741676 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe1c4000bf0 con 0x7fe1cc06cf00 2024-02-28T16:23:42.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe1cc06cf00 msgr2=0x7fe1cc06f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe1cc06cf00 0x7fe1cc06f3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0005850 tx=0x7fe1d0005ab0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1e4100d60 msgr2=0x7fe1e40719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1e4100d60 0x7fe1e40719f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4069000 tx=0x7fe1d800dbb0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 shutdown_connections 2024-02-28T16:23:42.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1e4100d60 0x7fe1e40719f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe1cc06cf00 0x7fe1cc06f3b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 --2- 172.21.15.23:0/2977741676 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe1e4103680 0x7fe1e4071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.148+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 >> 172.21.15.23:0/2977741676 conn(0x7fe1e40fa780 msgr2=0x7fe1e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:42.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.149+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 shutdown_connections 2024-02-28T16:23:42.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.149+0000 7fe1ec000700 1 -- 172.21.15.23:0/2977741676 wait complete. 2024-02-28T16:23:42.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:41 smithi153 ceph-mon[35341]: pgmap v22: 65 pgs: 65 active+clean; 155 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 233 op/s 2024-02-28T16:23:42.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.362+0000 7f69e0200700 1 -- 172.21.15.23:0/868276094 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8102490 msgr2=0x7f69d81028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.362+0000 7f69e0200700 1 --2- 172.21.15.23:0/868276094 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8102490 0x7f69d81028a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009870 tx=0x7f69cc009b80 comp rx=0 tx=0).stop 2024-02-28T16:23:42.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.362+0000 7f69e0200700 1 -- 172.21.15.23:0/868276094 shutdown_connections 2024-02-28T16:23:42.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.362+0000 7f69e0200700 1 --2- 172.21.15.23:0/868276094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d8103640 0x7f69d8103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.362+0000 7f69e0200700 1 --2- 172.21.15.23:0/868276094 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8102490 0x7f69d81028a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.362+0000 7f69e0200700 1 -- 172.21.15.23:0/868276094 >> 172.21.15.23:0/868276094 conn(0x7f69d80fda60 msgr2=0x7f69d80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:42.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.363+0000 7f69e0200700 1 -- 172.21.15.23:0/868276094 shutdown_connections 2024-02-28T16:23:42.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.363+0000 7f69e0200700 1 -- 172.21.15.23:0/868276094 wait complete. 2024-02-28T16:23:42.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.364+0000 7f69e0200700 1 Processor -- start 2024-02-28T16:23:42.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.364+0000 7f69e0200700 1 -- start start 2024-02-28T16:23:42.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.364+0000 7f69e0200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d8102490 0x7f69d8197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:42.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.364+0000 7f69e0200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8103640 0x7f69d8198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:42.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.364+0000 7f69e0200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8198850 con 0x7f69d8103640 2024-02-28T16:23:42.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.364+0000 7f69e0200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d819d260 con 0x7f69d8102490 2024-02-28T16:23:42.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.365+0000 7f69dce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8103640 0x7f69d8198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:42.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.365+0000 7f69dce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8103640 0x7f69d8198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52344/0 (socket says 172.21.15.23:52344) 2024-02-28T16:23:42.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.365+0000 7f69dce00700 1 -- 172.21.15.23:0/2852234926 learned_addr learned my addr 172.21.15.23:0/2852234926 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:42.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.365+0000 7f69dce00700 1 -- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d8102490 msgr2=0x7f69d8197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.365+0000 7f69dce00700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d8102490 0x7f69d8197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.365+0000 7f69dce00700 1 -- 172.21.15.23:0/2852234926 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40095f0 con 0x7f69d8103640 2024-02-28T16:23:42.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.366+0000 7f69dce00700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8103640 0x7f69d8198230 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f69c400eb90 tx=0x7f69c400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:42.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.366+0000 7f69d6000700 1 -- 172.21.15.23:0/2852234926 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c400cd70 con 0x7f69d8103640 2024-02-28T16:23:42.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.366+0000 7f69d6000700 1 -- 172.21.15.23:0/2852234926 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69c40044d0 con 0x7f69d8103640 2024-02-28T16:23:42.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.366+0000 7f69d6000700 1 -- 172.21.15.23:0/2852234926 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c4010660 con 0x7f69d8103640 2024-02-28T16:23:42.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.366+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc009520 con 0x7f69d8103640 2024-02-28T16:23:42.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.366+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d819d7f0 con 0x7f69d8103640 2024-02-28T16:23:42.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.367+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d810af90 con 0x7f69d8103640 2024-02-28T16:23:42.361 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.369+0000 7f69d6000700 1 -- 172.21.15.23:0/2852234926 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 25) v1 ==== 90730+0+0 (secure 0 0 0) 0x7f69c4003f60 con 0x7f69d8103640 2024-02-28T16:23:42.361 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.370+0000 7f69d6000700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f69c006cf00 0x7f69c006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:42.361 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.370+0000 7f69d6000700 1 -- 172.21.15.23:0/2852234926 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f69c4014070 con 0x7f69d8103640 2024-02-28T16:23:42.361 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.371+0000 7f69dd800700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f69c006cf00 0x7f69c006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:42.363 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.373+0000 7f69dd800700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f69c006cf00 0x7f69c006f3b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005e90 tx=0x7f69cc005d00 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:42.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.376+0000 7f69d6000700 1 -- 172.21.15.23:0/2852234926 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f69c4056ac0 con 0x7f69d8103640 2024-02-28T16:23:42.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.699+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f69d8107f90 con 0x7f69c006cf00 2024-02-28T16:23:42.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.719+0000 7f69d6000700 1 -- 172.21.15.23:0/2852234926 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f69d8107f90 con 0x7f69c006cf00 2024-02-28T16:23:42.710 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:23:42.710 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (8m) 23s ago 10m 14.0M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:23:42.710 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (10m) 23s ago 10m 7721k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:23:42.710 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (9m) 27s ago 9m 7402k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (10m) 23s ago 10m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (9m) 27s ago 9m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (8m) 23s ago 10m 75.4M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (3m) 23s ago 3m 91.6M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (3m) 23s ago 3m 13.2M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (3m) 27s ago 3m 13.4M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (3m) 27s ago 3m 13.4M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:9283,8765,8443 running (12m) 23s ago 12m 315M - 18.2.0 dc2bc1663786 b278ec72c436 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (57s) 27s ago 9m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1b0f874317ec 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (12m) 23s ago 12m 50.1M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (9m) 27s ago 9m 38.2M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (10m) 23s ago 10m 7763k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (9m) 27s ago 9m 7801k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:23:42.711 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (8m) 23s ago 8m 86.7M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:23:42.712 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (7m) 23s ago 7m 86.0M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:23:42.712 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (6m) 23s ago 6m 77.9M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:23:42.712 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (6m) 27s ago 6m 92.1M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:23:42.712 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (5m) 27s ago 5m 85.6M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:23:42.712 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (5m) 27s ago 5m 83.0M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:23:42.712 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 starting - - - - 2024-02-28T16:23:42.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f69c006cf00 msgr2=0x7f69c006f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f69c006cf00 0x7f69c006f3b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005e90 tx=0x7f69cc005d00 comp rx=0 tx=0).stop 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8103640 msgr2=0x7f69d8198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8103640 0x7f69d8198230 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f69c400eb90 tx=0x7f69c400ef50 comp rx=0 tx=0).stop 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 shutdown_connections 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d8102490 0x7f69d8197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f69c006cf00 0x7f69c006f3b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 --2- 172.21.15.23:0/2852234926 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f69d8103640 0x7f69d8198230 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 >> 172.21.15.23:0/2852234926 conn(0x7f69d80fda60 msgr2=0x7f69d8106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:42.714 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.722+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 shutdown_connections 2024-02-28T16:23:42.714 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.723+0000 7f69e0200700 1 -- 172.21.15.23:0/2852234926 wait complete. 2024-02-28T16:23:42.787 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:42 smithi023 ceph-mon[29137]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:42.788 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:42 smithi023 ceph-mon[29137]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:42.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.930+0000 7f8f3b200700 1 -- 172.21.15.23:0/2166203679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34103640 msgr2=0x7f8f34103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.930+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2166203679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34103640 0x7f8f34103a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009910 tx=0x7f8f20009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:42.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.930+0000 7f8f3b200700 1 -- 172.21.15.23:0/2166203679 shutdown_connections 2024-02-28T16:23:42.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.930+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2166203679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34103640 0x7f8f34103a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.930+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2166203679 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34102490 0x7f8f341028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.930+0000 7f8f3b200700 1 -- 172.21.15.23:0/2166203679 >> 172.21.15.23:0/2166203679 conn(0x7f8f340fda60 msgr2=0x7f8f340ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:42.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.931+0000 7f8f3b200700 1 -- 172.21.15.23:0/2166203679 shutdown_connections 2024-02-28T16:23:42.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.931+0000 7f8f3b200700 1 -- 172.21.15.23:0/2166203679 wait complete. 2024-02-28T16:23:42.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.932+0000 7f8f3b200700 1 Processor -- start 2024-02-28T16:23:42.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.932+0000 7f8f3b200700 1 -- start start 2024-02-28T16:23:42.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.933+0000 7f8f3b200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34102490 0x7f8f34071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:42.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.933+0000 7f8f3b200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34103640 0x7f8f340722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:42.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.933+0000 7f8f3b200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340728c0 con 0x7f8f34103640 2024-02-28T16:23:42.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.933+0000 7f8f3b200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f341a5a70 con 0x7f8f34102490 2024-02-28T16:23:42.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.934+0000 7f8f33400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34103640 0x7f8f340722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:42.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.934+0000 7f8f33400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34103640 0x7f8f340722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52354/0 (socket says 172.21.15.23:52354) 2024-02-28T16:23:42.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.934+0000 7f8f33400700 1 -- 172.21.15.23:0/2646530548 learned_addr learned my addr 172.21.15.23:0/2646530548 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:42.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.934+0000 7f8f33e00700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34102490 0x7f8f34071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:42.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.934+0000 7f8f33400700 1 -- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34102490 msgr2=0x7f8f34071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:42.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.934+0000 7f8f33400700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34102490 0x7f8f34071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:42.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.934+0000 7f8f33400700 1 -- 172.21.15.23:0/2646530548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200095f0 con 0x7f8f34103640 2024-02-28T16:23:42.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.935+0000 7f8f33400700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34103640 0x7f8f340722a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8f20005b40 tx=0x7f8f2000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:42.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.935+0000 7f8f30c00700 1 -- 172.21.15.23:0/2646530548 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2001d070 con 0x7f8f34103640 2024-02-28T16:23:42.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.935+0000 7f8f30c00700 1 -- 172.21.15.23:0/2646530548 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f2000f460 con 0x7f8f34103640 2024-02-28T16:23:42.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.935+0000 7f8f30c00700 1 -- 172.21.15.23:0/2646530548 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f20021640 con 0x7f8f34103640 2024-02-28T16:23:42.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.936+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f341a5c10 con 0x7f8f34103640 2024-02-28T16:23:42.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.936+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f341a6080 con 0x7f8f34103640 2024-02-28T16:23:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.938+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3410af90 con 0x7f8f34103640 2024-02-28T16:23:42.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.939+0000 7f8f30c00700 1 -- 172.21.15.23:0/2646530548 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 25) v1 ==== 90730+0+0 (secure 0 0 0) 0x7f8f2000fa90 con 0x7f8f34103640 2024-02-28T16:23:42.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.940+0000 7f8f30c00700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8f1806cf00 0x7f8f1806f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:42.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.940+0000 7f8f30c00700 1 -- 172.21.15.23:0/2646530548 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8f2008d570 con 0x7f8f34103640 2024-02-28T16:23:42.932 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.941+0000 7f8f33e00700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8f1806cf00 0x7f8f1806f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:42.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.943+0000 7f8f33e00700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8f1806cf00 0x7f8f1806f3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f24005950 tx=0x7f8f240058e0 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:42.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:42.946+0000 7f8f30c00700 1 -- 172.21.15.23:0/2646530548 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f8f2005ac90 con 0x7f8f34103640 2024-02-28T16:23:43.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:42 smithi153 ceph-mon[35341]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:43.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:42 smithi153 ceph-mon[35341]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:43.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.455+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f3410b180 con 0x7f8f34103640 2024-02-28T16:23:43.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.456+0000 7f8f30c00700 1 -- 172.21.15.23:0/2646530548 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f8f2005a820 con 0x7f8f34103640 2024-02-28T16:23:43.447 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:23:43.447 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:23:43.448 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:23:43.449 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-02-28T16:23:43.449 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:23:43.449 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:23:43.449 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8f1806cf00 msgr2=0x7f8f1806f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8f1806cf00 0x7f8f1806f3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f24005950 tx=0x7f8f240058e0 comp rx=0 tx=0).stop 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34103640 msgr2=0x7f8f340722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34103640 0x7f8f340722a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8f20005b40 tx=0x7f8f2000be20 comp rx=0 tx=0).stop 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 shutdown_connections 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f34102490 0x7f8f34071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f8f1806cf00 0x7f8f1806f3b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 --2- 172.21.15.23:0/2646530548 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8f34103640 0x7f8f340722a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 >> 172.21.15.23:0/2646530548 conn(0x7f8f340fda60 msgr2=0x7f8f34106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 shutdown_connections 2024-02-28T16:23:43.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.460+0000 7f8f3b200700 1 -- 172.21.15.23:0/2646530548 wait complete. 2024-02-28T16:23:43.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.654+0000 7fdec0c00700 1 -- 172.21.15.23:0/1856761564 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc100d60 msgr2=0x7fdebc103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:43.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.654+0000 7fdec0c00700 1 --2- 172.21.15.23:0/1856761564 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc100d60 0x7fdebc103140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009910 tx=0x7fdeac009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:43.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.654+0000 7fdec0c00700 1 -- 172.21.15.23:0/1856761564 shutdown_connections 2024-02-28T16:23:43.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.654+0000 7fdec0c00700 1 --2- 172.21.15.23:0/1856761564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc103680 0x7fdebc105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:43.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.654+0000 7fdec0c00700 1 --2- 172.21.15.23:0/1856761564 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc100d60 0x7fdebc103140 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:43.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.654+0000 7fdec0c00700 1 -- 172.21.15.23:0/1856761564 >> 172.21.15.23:0/1856761564 conn(0x7fdebc0fa780 msgr2=0x7fdebc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:43.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.655+0000 7fdec0c00700 1 -- 172.21.15.23:0/1856761564 shutdown_connections 2024-02-28T16:23:43.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.655+0000 7fdec0c00700 1 -- 172.21.15.23:0/1856761564 wait complete. 2024-02-28T16:23:43.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.656+0000 7fdec0c00700 1 Processor -- start 2024-02-28T16:23:43.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.657+0000 7fdec0c00700 1 -- start start 2024-02-28T16:23:43.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.657+0000 7fdec0c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc100d60 0x7fdebc195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:43.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.657+0000 7fdec0c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc103680 0x7fdebc195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:43.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.657+0000 7fdec0c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc196600 con 0x7fdebc103680 2024-02-28T16:23:43.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.657+0000 7fdec0c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc196740 con 0x7fdebc100d60 2024-02-28T16:23:43.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.658+0000 7fdeb9e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc100d60 0x7fdebc195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:43.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.658+0000 7fdeb9e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc100d60 0x7fdebc195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:41766/0 (socket says 172.21.15.23:41766) 2024-02-28T16:23:43.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.658+0000 7fdeb9e00700 1 -- 172.21.15.23:0/2415788166 learned_addr learned my addr 172.21.15.23:0/2415788166 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:43.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.658+0000 7fdeb9400700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc103680 0x7fdebc195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:43.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.659+0000 7fdeb9e00700 1 -- 172.21.15.23:0/2415788166 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc103680 msgr2=0x7fdebc195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:43.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.659+0000 7fdeb9e00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc103680 0x7fdebc195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:43.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.659+0000 7fdeb9e00700 1 -- 172.21.15.23:0/2415788166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0095f0 con 0x7fdebc100d60 2024-02-28T16:23:43.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.659+0000 7fdeb9400700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc103680 0x7fdebc195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:23:43.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.659+0000 7fdeb9e00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc100d60 0x7fdebc195aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdeac000c00 tx=0x7fdeac00fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:43.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.660+0000 7fdeb2a00700 1 -- 172.21.15.23:0/2415788166 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeac01d070 con 0x7fdebc100d60 2024-02-28T16:23:43.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.660+0000 7fdeb2a00700 1 -- 172.21.15.23:0/2415788166 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdeac00fe90 con 0x7fdebc100d60 2024-02-28T16:23:43.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.660+0000 7fdeb2a00700 1 -- 172.21.15.23:0/2415788166 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeac017630 con 0x7fdebc100d60 2024-02-28T16:23:43.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.660+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc19b190 con 0x7fdebc100d60 2024-02-28T16:23:43.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.661+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc19b630 con 0x7fdebc100d60 2024-02-28T16:23:43.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.662+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc18fbc0 con 0x7fdebc100d60 2024-02-28T16:23:43.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.664+0000 7fdeb2a00700 1 -- 172.21.15.23:0/2415788166 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) v1 ==== 90730+0+0 (secure 0 0 0) 0x7fdeac003680 con 0x7fdebc100d60 2024-02-28T16:23:43.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.665+0000 7fdeb2a00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fdea006cf50 0x7fdea006f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:43.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.665+0000 7fdeb2a00700 1 -- 172.21.15.23:0/2415788166 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdeac08dda0 con 0x7fdebc100d60 2024-02-28T16:23:43.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.666+0000 7fdeb9400700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fdea006cf50 0x7fdea006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:43.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.667+0000 7fdeb9400700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fdea006cf50 0x7fdea006f400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009cb0 tx=0x7fdea8009260 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:43.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:43.673+0000 7fdeb2a00700 1 -- 172.21.15.23:0/2415788166 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fdeac05b4c0 con 0x7fdebc100d60 2024-02-28T16:23:44.108 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:43 smithi023 ceph-mon[29137]: pgmap v23: 65 pgs: 65 active+clean; 155 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s wr, 202 op/s 2024-02-28T16:23:44.109 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:43 smithi023 ceph-mon[29137]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:44.109 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:43 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2646530548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:23:44.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.117+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdebc02cc30 con 0x7fdebc100d60 2024-02-28T16:23:44.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.118+0000 7fdeb2a00700 1 -- 172.21.15.23:0/2415788166 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7fdeac003e60 con 0x7fdebc100d60 2024-02-28T16:23:44.109 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:23:44.109 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:23:44.110 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:23:44.111 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:44.112 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fdea006cf50 msgr2=0x7fdea006f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fdea006cf50 0x7fdea006f400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009cb0 tx=0x7fdea8009260 comp rx=0 tx=0).stop 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc100d60 msgr2=0x7fdebc195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc100d60 0x7fdebc195aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdeac000c00 tx=0x7fdeac00fab0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 shutdown_connections 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdebc100d60 0x7fdebc195aa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fdea006cf50 0x7fdea006f400 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 --2- 172.21.15.23:0/2415788166 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdebc103680 0x7fdebc195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 >> 172.21.15.23:0/2415788166 conn(0x7fdebc0fa780 msgr2=0x7fdebc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:44.114 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 shutdown_connections 2024-02-28T16:23:44.114 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.122+0000 7fdec0c00700 1 -- 172.21.15.23:0/2415788166 wait complete. 2024-02-28T16:23:44.117 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:23:44.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:43 smithi153 ceph-mon[35341]: pgmap v23: 65 pgs: 65 active+clean; 155 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s wr, 202 op/s 2024-02-28T16:23:44.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:43 smithi153 ceph-mon[35341]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:44.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:43 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2646530548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 -- 172.21.15.23:0/2927699198 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 msgr2=0x7fb404105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 --2- 172.21.15.23:0/2927699198 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404105790 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009910 tx=0x7fb3f0009c20 comp rx=0 tx=0).stop 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 -- 172.21.15.23:0/2927699198 shutdown_connections 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 --2- 172.21.15.23:0/2927699198 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404105790 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 --2- 172.21.15.23:0/2927699198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb404069230 0x7fb404102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 -- 172.21.15.23:0/2927699198 >> 172.21.15.23:0/2927699198 conn(0x7fb4040fa780 msgr2=0x7fb4040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 -- 172.21.15.23:0/2927699198 shutdown_connections 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.314+0000 7fb40c400700 1 -- 172.21.15.23:0/2927699198 wait complete. 2024-02-28T16:23:44.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.315+0000 7fb40c400700 1 Processor -- start 2024-02-28T16:23:44.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.315+0000 7fb40c400700 1 -- start start 2024-02-28T16:23:44.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb40c400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb404069230 0x7fb404195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:44.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb40c400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:44.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb40c400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb404196630 con 0x7fb404103350 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb40c400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb404196770 con 0x7fb404069230 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb409000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb409000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52392/0 (socket says 172.21.15.23:52392) 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb409000700 1 -- 172.21.15.23:0/2756767141 learned_addr learned my addr 172.21.15.23:0/2756767141 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.316+0000 7fb409a00700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb404069230 0x7fb404195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.317+0000 7fb409000700 1 -- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb404069230 msgr2=0x7fb404195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.317+0000 7fb409000700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb404069230 0x7fb404195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.317+0000 7fb409000700 1 -- 172.21.15.23:0/2756767141 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00095f0 con 0x7fb404103350 2024-02-28T16:23:44.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.317+0000 7fb409000700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404196010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0005b40 tx=0x7fb3f000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:44.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.317+0000 7fb402000700 1 -- 172.21.15.23:0/2756767141 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f001d070 con 0x7fb404103350 2024-02-28T16:23:44.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.317+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40419b1c0 con 0x7fb404103350 2024-02-28T16:23:44.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.317+0000 7fb402000700 1 -- 172.21.15.23:0/2756767141 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb3f000f460 con 0x7fb404103350 2024-02-28T16:23:44.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.318+0000 7fb402000700 1 -- 172.21.15.23:0/2756767141 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f0021620 con 0x7fb404103350 2024-02-28T16:23:44.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.318+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40419b6b0 con 0x7fb404103350 2024-02-28T16:23:44.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.319+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e4005320 con 0x7fb404103350 2024-02-28T16:23:44.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.320+0000 7fb402000700 1 -- 172.21.15.23:0/2756767141 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 25) v1 ==== 90730+0+0 (secure 0 0 0) 0x7fb3f0003a60 con 0x7fb404103350 2024-02-28T16:23:44.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.321+0000 7fb402000700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb3ec06cf00 0x7fb3ec06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:44.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.321+0000 7fb402000700 1 -- 172.21.15.23:0/2756767141 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb3f008d640 con 0x7fb404103350 2024-02-28T16:23:44.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.322+0000 7fb409a00700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb3ec06cf00 0x7fb3ec06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:44.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.323+0000 7fb409a00700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb3ec06cf00 0x7fb3ec06f3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb404068f60 tx=0x7fb3f800b410 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:44.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.328+0000 7fb402000700 1 -- 172.21.15.23:0/2756767141 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb3f005ae00 con 0x7fb404103350 2024-02-28T16:23:44.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.677+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3e4000bf0 con 0x7fb3ec06cf00 2024-02-28T16:23:44.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.679+0000 7fb402000700 1 -- 172.21.15.23:0/2756767141 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fb3e4000bf0 con 0x7fb3ec06cf00 2024-02-28T16:23:44.672 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:23:44.672 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:23:44.672 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:23:44.672 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:23:44.673 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [], 2024-02-28T16:23:44.673 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "1/23 daemons upgraded", 2024-02-28T16:23:44.673 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:23:44.673 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:23:44.673 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:23:44.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb3ec06cf00 msgr2=0x7fb3ec06f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb3ec06cf00 0x7fb3ec06f3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb404068f60 tx=0x7fb3f800b410 comp rx=0 tx=0).stop 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 msgr2=0x7fb404196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404196010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0005b40 tx=0x7fb3f000bd70 comp rx=0 tx=0).stop 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 shutdown_connections 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb404069230 0x7fb404195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fb3ec06cf00 0x7fb3ec06f3b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 --2- 172.21.15.23:0/2756767141 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb404103350 0x7fb404196010 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 >> 172.21.15.23:0/2756767141 conn(0x7fb4040fa780 msgr2=0x7fb4040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 shutdown_connections 2024-02-28T16:23:44.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.683+0000 7fb40c400700 1 -- 172.21.15.23:0/2756767141 wait complete. 2024-02-28T16:23:44.900 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:44 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2415788166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.909+0000 7f92b7600700 1 -- 172.21.15.23:0/2472229346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 msgr2=0x7f92b0076d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.909+0000 7f92b7600700 1 --2- 172.21.15.23:0/2472229346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 0x7f92b0076d70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f929c009870 tx=0x7f929c009b80 comp rx=0 tx=0).stop 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.909+0000 7f92b7600700 1 -- 172.21.15.23:0/2472229346 shutdown_connections 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.909+0000 7f92b7600700 1 --2- 172.21.15.23:0/2472229346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 0x7f92b0076d70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.909+0000 7f92b7600700 1 --2- 172.21.15.23:0/2472229346 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f92b0075700 0x7f92b0075b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.909+0000 7f92b7600700 1 -- 172.21.15.23:0/2472229346 >> 172.21.15.23:0/2472229346 conn(0x7f92b00fda60 msgr2=0x7f92b00ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.910+0000 7f92b7600700 1 -- 172.21.15.23:0/2472229346 shutdown_connections 2024-02-28T16:23:44.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.910+0000 7f92b7600700 1 -- 172.21.15.23:0/2472229346 wait complete. 2024-02-28T16:23:44.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.912+0000 7f92b7600700 1 Processor -- start 2024-02-28T16:23:44.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.912+0000 7f92b7600700 1 -- start start 2024-02-28T16:23:44.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.913+0000 7f92b7600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f92b0075700 0x7f92b019c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:44.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.913+0000 7f92b7600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 0x7f92b019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:44.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.913+0000 7f92b7600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b019cba0 con 0x7f92b0075700 2024-02-28T16:23:44.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.913+0000 7f92b7600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b019cce0 con 0x7f92b0076900 2024-02-28T16:23:44.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.914+0000 7f92b4c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f92b0075700 0x7f92b019c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:44.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.914+0000 7f92afe00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 0x7f92b019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:44.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.914+0000 7f92afe00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 0x7f92b019c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:41814/0 (socket says 172.21.15.23:41814) 2024-02-28T16:23:44.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.914+0000 7f92afe00700 1 -- 172.21.15.23:0/1989010711 learned_addr learned my addr 172.21.15.23:0/1989010711 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:23:44.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.915+0000 7f92b4c00700 1 -- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 msgr2=0x7f92b019c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:44.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.915+0000 7f92b4c00700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 0x7f92b019c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:44.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.915+0000 7f92b4c00700 1 -- 172.21.15.23:0/1989010711 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c009520 con 0x7f92b0075700 2024-02-28T16:23:44.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.916+0000 7f92b4c00700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f92b0075700 0x7f92b019c040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92a400e940 tx=0x7f92a400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:44.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.917+0000 7f92ad600700 1 -- 172.21.15.23:0/1989010711 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a400c990 con 0x7f92b0075700 2024-02-28T16:23:44.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.917+0000 7f92ad600700 1 -- 172.21.15.23:0/1989010711 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92a4010430 con 0x7f92b0075700 2024-02-28T16:23:44.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.917+0000 7f92ad600700 1 -- 172.21.15.23:0/1989010711 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a4018610 con 0x7f92b0075700 2024-02-28T16:23:44.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.917+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0102070 con 0x7f92b0075700 2024-02-28T16:23:44.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.917+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b01025c0 con 0x7f92b0075700 2024-02-28T16:23:44.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.919+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b010f380 con 0x7f92b0075700 2024-02-28T16:23:44.912 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.921+0000 7f92ad600700 1 -- 172.21.15.23:0/1989010711 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 25) v1 ==== 90730+0+0 (secure 0 0 0) 0x7f92a4018770 con 0x7f92b0075700 2024-02-28T16:23:44.913 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.923+0000 7f92ad600700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f929806cf40 0x7f929806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:44.914 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.923+0000 7f92ad600700 1 -- 172.21.15.23:0/1989010711 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f92a4014070 con 0x7f92b0075700 2024-02-28T16:23:44.914 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.923+0000 7f92afe00700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f929806cf40 0x7f929806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:44.914 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.924+0000 7f92afe00700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f929806cf40 0x7f929806f3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f929c00b5b0 tx=0x7f929c019040 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:44.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:44.931+0000 7f92ad600700 1 -- 172.21.15.23:0/1989010711 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f92a4052a50 con 0x7f92b0075700 2024-02-28T16:23:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:44 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2415788166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:23:45.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.429+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f92b010f5a0 con 0x7f92b0075700 2024-02-28T16:23:45.420 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:23:45.421 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.430+0000 7f92ad600700 1 -- 172.21.15.23:0/1989010711 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f92a405a010 con 0x7f92b0075700 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f929806cf40 msgr2=0x7f929806f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f929806cf40 0x7f929806f3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f929c00b5b0 tx=0x7f929c019040 comp rx=0 tx=0).stop 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f92b0075700 msgr2=0x7f92b019c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f92b0075700 0x7f92b019c040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92a400e940 tx=0x7f92a400ec50 comp rx=0 tx=0).stop 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 shutdown_connections 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f929806cf40 0x7f929806f3f0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f929c00b5b0 tx=0x7f929c019040 comp rx=0 tx=0).stop 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f92b0075700 0x7f92b019c040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:45.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 --2- 172.21.15.23:0/1989010711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b0076900 0x7f92b019c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:45.425 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.433+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 >> 172.21.15.23:0/1989010711 conn(0x7f92b00fda60 msgr2=0x7f92b010c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:45.425 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.434+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 shutdown_connections 2024-02-28T16:23:45.425 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:23:45.434+0000 7f92b7600700 1 -- 172.21.15.23:0/1989010711 wait complete. 2024-02-28T16:23:46.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:45 smithi153 ceph-mon[35341]: pgmap v24: 65 pgs: 65 active+clean; 168 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 300 op/s 2024-02-28T16:23:46.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:45 smithi153 ceph-mon[35341]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:46.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:45 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:46.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:45 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:46.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:45 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:46.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:45 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1989010711' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:23:46.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:45 smithi023 ceph-mon[29137]: pgmap v24: 65 pgs: 65 active+clean; 168 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 300 op/s 2024-02-28T16:23:46.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:45 smithi023 ceph-mon[29137]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:46.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:45 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:46.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:45 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:23:46.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:45 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:23:46.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:45 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1989010711' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:23:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:47 smithi023 ceph-mon[29137]: pgmap v25: 65 pgs: 65 active+clean; 168 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s wr, 197 op/s 2024-02-28T16:23:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:47 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:48.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:47 smithi153 ceph-mon[35341]: pgmap v25: 65 pgs: 65 active+clean; 168 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s wr, 197 op/s 2024-02-28T16:23:48.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:47 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:50.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:49 smithi153 ceph-mon[35341]: pgmap v26: 65 pgs: 65 active+clean; 185 MiB data, 860 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 302 op/s 2024-02-28T16:23:50.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:49 smithi023 ceph-mon[29137]: pgmap v26: 65 pgs: 65 active+clean; 185 MiB data, 860 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 302 op/s 2024-02-28T16:23:50.400 INFO:tasks.workunit.client.0.smithi023.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T16:23:50.413 INFO:tasks.workunit.client.0.smithi023.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:23:50.413 INFO:tasks.workunit.client.0.smithi023.stderr:+ make 2024-02-28T16:23:50.867 INFO:tasks.workunit.client.0.smithi023.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T16:23:52.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:51 smithi153 ceph-mon[35341]: pgmap v27: 65 pgs: 65 active+clean; 185 MiB data, 860 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 202 op/s 2024-02-28T16:23:52.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:51 smithi023 ceph-mon[29137]: pgmap v27: 65 pgs: 65 active+clean; 185 MiB data, 860 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 202 op/s 2024-02-28T16:23:53.578 INFO:tasks.workunit.client.0.smithi023.stderr:++ readlink -f fsstress 2024-02-28T16:23:53.584 INFO:tasks.workunit.client.0.smithi023.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T16:23:53.584 INFO:tasks.workunit.client.0.smithi023.stderr:+ popd 2024-02-28T16:23:53.589 INFO:tasks.workunit.client.0.smithi023.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:23:53.589 INFO:tasks.workunit.client.0.smithi023.stderr:+ popd 2024-02-28T16:23:53.593 INFO:tasks.workunit.client.0.smithi023.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:23:53.594 INFO:tasks.workunit.client.0.smithi023.stderr:++ mktemp -d -p . 2024-02-28T16:23:53.629 INFO:tasks.workunit.client.0.smithi023.stderr:+ T=./tmp.gAGHJj6wpM 2024-02-28T16:23:53.629 INFO:tasks.workunit.client.0.smithi023.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gAGHJj6wpM -l 1 -n 1000 -p 10 -v 2024-02-28T16:23:53.637 INFO:tasks.workunit.client.0.smithi023.stdout:seed = 1708570864 2024-02-28T16:23:53.645 INFO:tasks.workunit.client.0.smithi023.stdout:0/0: dwrite - no filename 2024-02-28T16:23:53.645 INFO:tasks.workunit.client.0.smithi023.stdout:0/1: readlink - no filename 2024-02-28T16:23:53.646 INFO:tasks.workunit.client.0.smithi023.stdout:0/2: write - no filename 2024-02-28T16:23:53.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/0: write - no filename 2024-02-28T16:23:53.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/1: dwrite - no filename 2024-02-28T16:23:53.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/2: write - no filename 2024-02-28T16:23:53.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/3: stat - no entries 2024-02-28T16:23:53.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/4: dwrite - no filename 2024-02-28T16:23:53.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/5: write - no filename 2024-02-28T16:23:53.649 INFO:tasks.workunit.client.0.smithi023.stdout:2/6: dwrite - no filename 2024-02-28T16:23:53.651 INFO:tasks.workunit.client.0.smithi023.stdout:3/0: dwrite - no filename 2024-02-28T16:23:53.651 INFO:tasks.workunit.client.0.smithi023.stdout:3/1: dread - no filename 2024-02-28T16:23:53.651 INFO:tasks.workunit.client.0.smithi023.stdout:0/3: getdents . 0 2024-02-28T16:23:53.651 INFO:tasks.workunit.client.0.smithi023.stdout:0/4: read - no filename 2024-02-28T16:23:53.652 INFO:tasks.workunit.client.0.smithi023.stdout:0/5: readlink - no filename 2024-02-28T16:23:53.652 INFO:tasks.workunit.client.0.smithi023.stdout:0/6: unlink - no file 2024-02-28T16:23:53.665 INFO:tasks.workunit.client.0.smithi023.stdout:2/7: creat f0 x:0 0 0 2024-02-28T16:23:53.673 INFO:tasks.workunit.client.0.smithi023.stdout:2/8: chown f0 0 1 2024-02-28T16:23:53.673 INFO:tasks.workunit.client.0.smithi023.stdout:2/9: read - f0 zero size 2024-02-28T16:23:53.673 INFO:tasks.workunit.client.0.smithi023.stdout:5/0: write - no filename 2024-02-28T16:23:53.673 INFO:tasks.workunit.client.0.smithi023.stdout:0/7: creat f0 x:0 0 0 2024-02-28T16:23:53.673 INFO:tasks.workunit.client.0.smithi023.stdout:4/0: creat f0 x:0 0 0 2024-02-28T16:23:53.674 INFO:tasks.workunit.client.0.smithi023.stdout:1/0: rename - no filename 2024-02-28T16:23:53.674 INFO:tasks.workunit.client.0.smithi023.stdout:1/1: dread - no filename 2024-02-28T16:23:53.678 INFO:tasks.workunit.client.0.smithi023.stdout:2/10: symlink l1 0 2024-02-28T16:23:53.681 INFO:tasks.workunit.client.0.smithi023.stdout:0/8: rename f0 to f1 0 2024-02-28T16:23:53.682 INFO:tasks.workunit.client.0.smithi023.stdout:4/1: mknod c1 0 2024-02-28T16:23:53.682 INFO:tasks.workunit.client.0.smithi023.stdout:4/2: dread - f0 zero size 2024-02-28T16:23:53.685 INFO:tasks.workunit.client.0.smithi023.stdout:5/1: creat f0 x:0 0 0 2024-02-28T16:23:53.690 INFO:tasks.workunit.client.0.smithi023.stdout:4/3: rename f0 to f2 0 2024-02-28T16:23:53.692 INFO:tasks.workunit.client.0.smithi023.stdout:1/2: creat f0 x:0 0 0 2024-02-28T16:23:53.692 INFO:tasks.workunit.client.0.smithi023.stdout:4/4: chown c1 204504613 1 2024-02-28T16:23:53.694 INFO:tasks.workunit.client.0.smithi023.stdout:1/3: chown f0 58 1 2024-02-28T16:23:53.694 INFO:tasks.workunit.client.0.smithi023.stdout:5/2: mkdir d1 0 2024-02-28T16:23:53.695 INFO:tasks.workunit.client.0.smithi023.stdout:5/3: chown d1 106850 1 2024-02-28T16:23:53.698 INFO:tasks.workunit.client.0.smithi023.stdout:8/0: readlink - no filename 2024-02-28T16:23:53.700 INFO:tasks.workunit.client.0.smithi023.stdout:6/0: mknod c0 0 2024-02-28T16:23:53.700 INFO:tasks.workunit.client.0.smithi023.stdout:6/1: dread - no filename 2024-02-28T16:23:53.700 INFO:tasks.workunit.client.0.smithi023.stdout:6/2: write - no filename 2024-02-28T16:23:53.700 INFO:tasks.workunit.client.0.smithi023.stdout:6/3: write - no filename 2024-02-28T16:23:53.702 INFO:tasks.workunit.client.0.smithi023.stdout:6/4: chown c0 32864839 1 2024-02-28T16:23:53.705 INFO:tasks.workunit.client.0.smithi023.stdout:5/4: unlink f0 0 2024-02-28T16:23:53.705 INFO:tasks.workunit.client.0.smithi023.stdout:5/5: dwrite - no filename 2024-02-28T16:23:53.705 INFO:tasks.workunit.client.0.smithi023.stdout:5/6: truncate - no filename 2024-02-28T16:23:53.705 INFO:tasks.workunit.client.0.smithi023.stdout:5/7: readlink - no filename 2024-02-28T16:23:53.711 INFO:tasks.workunit.client.0.smithi023.stdout:7/0: symlink l0 0 2024-02-28T16:23:53.716 INFO:tasks.workunit.client.0.smithi023.stdout:7/1: chown l0 372040 1 2024-02-28T16:23:53.716 INFO:tasks.workunit.client.0.smithi023.stdout:7/2: write - no filename 2024-02-28T16:23:53.716 INFO:tasks.workunit.client.0.smithi023.stdout:7/3: fdatasync - no filename 2024-02-28T16:23:53.717 INFO:tasks.workunit.client.0.smithi023.stdout:6/5: mkdir d1 0 2024-02-28T16:23:53.722 INFO:tasks.workunit.client.0.smithi023.stdout:8/1: mkdir d0 0 2024-02-28T16:23:53.722 INFO:tasks.workunit.client.0.smithi023.stdout:8/2: write - no filename 2024-02-28T16:23:53.725 INFO:tasks.workunit.client.0.smithi023.stdout:8/3: stat d0 0 2024-02-28T16:23:53.725 INFO:tasks.workunit.client.0.smithi023.stdout:8/4: dread - no filename 2024-02-28T16:23:53.726 INFO:tasks.workunit.client.0.smithi023.stdout:8/5: rename d0 to d0/d1 22 2024-02-28T16:23:53.727 INFO:tasks.workunit.client.0.smithi023.stdout:5/8: creat d1/f2 x:0 0 0 2024-02-28T16:23:53.727 INFO:tasks.workunit.client.0.smithi023.stdout:5/9: readlink - no filename 2024-02-28T16:23:53.731 INFO:tasks.workunit.client.0.smithi023.stdout:7/4: rename l0 to l1 0 2024-02-28T16:23:53.732 INFO:tasks.workunit.client.0.smithi023.stdout:9/0: getdents . 0 2024-02-28T16:23:53.732 INFO:tasks.workunit.client.0.smithi023.stdout:9/1: write - no filename 2024-02-28T16:23:53.732 INFO:tasks.workunit.client.0.smithi023.stdout:9/2: dwrite - no filename 2024-02-28T16:23:53.743 INFO:tasks.workunit.client.0.smithi023.stdout:1/4: dwrite f0 [0,4194304] 0 2024-02-28T16:23:53.743 INFO:tasks.workunit.client.0.smithi023.stdout:6/6: getdents d1 0 2024-02-28T16:23:53.747 INFO:tasks.workunit.client.0.smithi023.stdout:8/6: creat d0/f2 x:0 0 0 2024-02-28T16:23:53.750 INFO:tasks.workunit.client.0.smithi023.stdout:4/5: dwrite f2 [0,4194304] 0 2024-02-28T16:23:53.755 INFO:tasks.workunit.client.0.smithi023.stdout:6/7: symlink d1/l2 0 2024-02-28T16:23:53.755 INFO:tasks.workunit.client.0.smithi023.stdout:6/8: dread - no filename 2024-02-28T16:23:53.757 INFO:tasks.workunit.client.0.smithi023.stdout:1/5: link f0 f1 0 2024-02-28T16:23:53.757 INFO:tasks.workunit.client.0.smithi023.stdout:1/6: rmdir - no directory 2024-02-28T16:23:53.763 INFO:tasks.workunit.client.0.smithi023.stdout:6/9: symlink d1/l3 0 2024-02-28T16:23:53.763 INFO:tasks.workunit.client.0.smithi023.stdout:6/10: write - no filename 2024-02-28T16:23:53.770 INFO:tasks.workunit.client.0.smithi023.stdout:6/11: creat d1/f4 x:0 0 0 2024-02-28T16:23:53.774 INFO:tasks.workunit.client.0.smithi023.stdout:5/10: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:23:53.780 INFO:tasks.workunit.client.0.smithi023.stdout:6/12: mknod d1/c5 0 2024-02-28T16:23:53.783 INFO:tasks.workunit.client.0.smithi023.stdout:5/11: unlink d1/f2 0 2024-02-28T16:23:53.786 INFO:tasks.workunit.client.0.smithi023.stdout:6/13: dread - d1/f4 zero size 2024-02-28T16:23:53.790 INFO:tasks.workunit.client.0.smithi023.stdout:6/14: chown d1/l3 937 1 2024-02-28T16:23:53.798 INFO:tasks.workunit.client.0.smithi023.stdout:8/7: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:23:53.798 INFO:tasks.workunit.client.0.smithi023.stdout:5/12: symlink d1/l3 0 2024-02-28T16:23:53.798 INFO:tasks.workunit.client.0.smithi023.stdout:5/13: write - no filename 2024-02-28T16:23:53.800 INFO:tasks.workunit.client.0.smithi023.stdout:5/14: rename d1 to d1/d4 22 2024-02-28T16:23:53.800 INFO:tasks.workunit.client.0.smithi023.stdout:5/15: fsync - no filename 2024-02-28T16:23:53.801 INFO:tasks.workunit.client.0.smithi023.stdout:5/16: fdatasync - no filename 2024-02-28T16:23:53.802 INFO:tasks.workunit.client.0.smithi023.stdout:8/8: write d0/f2 [2326763,46501] 0 2024-02-28T16:23:53.803 INFO:tasks.workunit.client.0.smithi023.stdout:8/9: chown d0 57 1 2024-02-28T16:23:53.813 INFO:tasks.workunit.client.0.smithi023.stdout:5/17: creat d1/f5 x:0 0 0 2024-02-28T16:23:53.814 INFO:tasks.workunit.client.0.smithi023.stdout:6/15: link d1/c5 d1/c6 0 2024-02-28T16:23:53.816 INFO:tasks.workunit.client.0.smithi023.stdout:6/16: dread - d1/f4 zero size 2024-02-28T16:23:53.825 INFO:tasks.workunit.client.0.smithi023.stdout:5/18: unlink d1/f5 0 2024-02-28T16:23:53.827 INFO:tasks.workunit.client.0.smithi023.stdout:6/17: creat d1/f7 x:0 0 0 2024-02-28T16:23:53.828 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:53 smithi023 ceph-mon[29137]: pgmap v28: 65 pgs: 65 active+clean; 185 MiB data, 860 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 202 op/s 2024-02-28T16:23:53.834 INFO:tasks.workunit.client.0.smithi023.stdout:8/10: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:23:54.100 INFO:tasks.workunit.client.0.smithi023.stdout:5/19: creat d1/f6 x:0 0 0 2024-02-28T16:23:54.102 INFO:tasks.workunit.client.0.smithi023.stdout:5/20: readlink d1/l3 0 2024-02-28T16:23:54.104 INFO:tasks.workunit.client.0.smithi023.stdout:5/21: readlink d1/l3 0 2024-02-28T16:23:54.115 INFO:tasks.workunit.client.0.smithi023.stdout:6/18: symlink d1/l8 0 2024-02-28T16:23:54.118 INFO:tasks.workunit.client.0.smithi023.stdout:5/22: mknod d1/c7 0 2024-02-28T16:23:54.124 INFO:tasks.workunit.client.0.smithi023.stdout:5/23: unlink d1/c7 0 2024-02-28T16:23:54.124 INFO:tasks.workunit.client.0.smithi023.stdout:5/24: chown d1 2058664 1 2024-02-28T16:23:54.126 INFO:tasks.workunit.client.0.smithi023.stdout:5/25: truncate d1/f6 563282 0 2024-02-28T16:23:54.127 INFO:tasks.workunit.client.0.smithi023.stdout:6/19: rename d1/c5 to d1/c9 0 2024-02-28T16:23:54.130 INFO:tasks.workunit.client.0.smithi023.stdout:0/9: fsync f1 0 2024-02-28T16:23:54.131 INFO:tasks.workunit.client.0.smithi023.stdout:0/10: rmdir - no directory 2024-02-28T16:23:54.131 INFO:tasks.workunit.client.0.smithi023.stdout:5/26: symlink d1/l8 0 2024-02-28T16:23:54.134 INFO:tasks.workunit.client.0.smithi023.stdout:6/20: creat d1/fa x:0 0 0 2024-02-28T16:23:54.136 INFO:tasks.workunit.client.0.smithi023.stdout:6/21: dread - d1/f7 zero size 2024-02-28T16:23:54.136 INFO:tasks.workunit.client.0.smithi023.stdout:5/27: dread d1/f6 [0,4194304] 0 2024-02-28T16:23:54.137 INFO:tasks.workunit.client.0.smithi023.stdout:6/22: read - d1/f4 zero size 2024-02-28T16:23:54.137 INFO:tasks.workunit.client.0.smithi023.stdout:5/28: chown d1/l3 877448 1 2024-02-28T16:23:54.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/11: unlink f1 0 2024-02-28T16:23:54.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/12: unlink - no file 2024-02-28T16:23:54.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/13: link - no file 2024-02-28T16:23:54.139 INFO:tasks.workunit.client.0.smithi023.stdout:6/23: dread - d1/f4 zero size 2024-02-28T16:23:54.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/14: fdatasync - no filename 2024-02-28T16:23:54.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/15: write - no filename 2024-02-28T16:23:54.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/16: write - no filename 2024-02-28T16:23:54.140 INFO:tasks.workunit.client.0.smithi023.stdout:5/29: read d1/f6 [123258,92355] 0 2024-02-28T16:23:54.140 INFO:tasks.workunit.client.0.smithi023.stdout:6/24: read - d1/fa zero size 2024-02-28T16:23:54.141 INFO:tasks.workunit.client.0.smithi023.stdout:5/30: write d1/f6 [136662,36481] 0 2024-02-28T16:23:54.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:53 smithi153 ceph-mon[35341]: pgmap v28: 65 pgs: 65 active+clean; 185 MiB data, 860 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 202 op/s 2024-02-28T16:23:54.149 INFO:tasks.workunit.client.0.smithi023.stdout:5/31: write d1/f6 [789784,29601] 0 2024-02-28T16:23:54.152 INFO:tasks.workunit.client.0.smithi023.stdout:5/32: write d1/f6 [1355673,75131] 0 2024-02-28T16:23:54.156 INFO:tasks.workunit.client.0.smithi023.stdout:5/33: write d1/f6 [1550336,4157] 0 2024-02-28T16:23:54.162 INFO:tasks.workunit.client.0.smithi023.stdout:6/25: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:23:54.164 INFO:tasks.workunit.client.0.smithi023.stdout:4/6: write f2 [4461224,63622] 0 2024-02-28T16:23:54.170 INFO:tasks.workunit.client.0.smithi023.stdout:7/5: chown l1 9 1 2024-02-28T16:23:54.173 INFO:tasks.workunit.client.0.smithi023.stdout:6/26: creat d1/fb x:0 0 0 2024-02-28T16:23:54.174 INFO:tasks.workunit.client.0.smithi023.stdout:1/7: fsync f0 0 2024-02-28T16:23:54.178 INFO:tasks.workunit.client.0.smithi023.stdout:4/7: rename c1 to c3 0 2024-02-28T16:23:54.180 INFO:tasks.workunit.client.0.smithi023.stdout:6/27: write d1/f4 [1767859,115230] 0 2024-02-28T16:23:54.181 INFO:tasks.workunit.client.0.smithi023.stdout:4/8: chown f2 486354704 1 2024-02-28T16:23:54.184 INFO:tasks.workunit.client.0.smithi023.stdout:7/6: rename l1 to l2 0 2024-02-28T16:23:54.184 INFO:tasks.workunit.client.0.smithi023.stdout:7/7: truncate - no filename 2024-02-28T16:23:54.184 INFO:tasks.workunit.client.0.smithi023.stdout:7/8: rmdir - no directory 2024-02-28T16:23:54.184 INFO:tasks.workunit.client.0.smithi023.stdout:7/9: rmdir - no directory 2024-02-28T16:23:54.189 INFO:tasks.workunit.client.0.smithi023.stdout:6/28: write d1/f7 [806230,28235] 0 2024-02-28T16:23:54.193 INFO:tasks.workunit.client.0.smithi023.stdout:6/29: dread - d1/fa zero size 2024-02-28T16:23:54.194 INFO:tasks.workunit.client.0.smithi023.stdout:5/34: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:23:54.196 INFO:tasks.workunit.client.0.smithi023.stdout:6/30: chown d1/f7 1786 1 2024-02-28T16:23:54.209 INFO:tasks.workunit.client.0.smithi023.stdout:6/31: creat d1/fc x:0 0 0 2024-02-28T16:23:54.211 INFO:tasks.workunit.client.0.smithi023.stdout:6/32: read - d1/fc zero size 2024-02-28T16:23:54.212 INFO:tasks.workunit.client.0.smithi023.stdout:1/8: truncate f0 1522813 0 2024-02-28T16:23:54.221 INFO:tasks.workunit.client.0.smithi023.stdout:6/33: creat d1/fd x:0 0 0 2024-02-28T16:23:54.224 INFO:tasks.workunit.client.0.smithi023.stdout:8/11: truncate d0/f2 2822592 0 2024-02-28T16:23:54.224 INFO:tasks.workunit.client.0.smithi023.stdout:6/34: truncate d1/fd 816549 0 2024-02-28T16:23:54.226 INFO:tasks.workunit.client.0.smithi023.stdout:6/35: readlink d1/l3 0 2024-02-28T16:23:54.228 INFO:tasks.workunit.client.0.smithi023.stdout:5/35: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:23:54.240 INFO:tasks.workunit.client.0.smithi023.stdout:8/12: chown d0/f2 260985309 1 2024-02-28T16:23:54.254 INFO:tasks.workunit.client.0.smithi023.stdout:6/36: dwrite d1/fd [0,4194304] 0 2024-02-28T16:23:54.258 INFO:tasks.workunit.client.0.smithi023.stdout:5/36: fsync d1/f6 0 2024-02-28T16:23:54.263 INFO:tasks.workunit.client.0.smithi023.stdout:6/37: link d1/fb d1/fe 0 2024-02-28T16:23:54.273 INFO:tasks.workunit.client.0.smithi023.stdout:4/9: stat c3 0 2024-02-28T16:23:54.277 INFO:tasks.workunit.client.0.smithi023.stdout:4/10: write f2 [2728378,19884] 0 2024-02-28T16:23:54.286 INFO:tasks.workunit.client.0.smithi023.stdout:8/13: rmdir d0 39 2024-02-28T16:23:54.288 INFO:tasks.workunit.client.0.smithi023.stdout:5/37: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:23:54.290 INFO:tasks.workunit.client.0.smithi023.stdout:1/9: dread f1 [0,4194304] 0 2024-02-28T16:23:54.296 INFO:tasks.workunit.client.0.smithi023.stdout:5/38: read d1/f6 [935714,18930] 0 2024-02-28T16:23:54.300 INFO:tasks.workunit.client.0.smithi023.stdout:1/10: rename f1 to f2 0 2024-02-28T16:23:54.302 INFO:tasks.workunit.client.0.smithi023.stdout:6/38: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:23:54.316 INFO:tasks.workunit.client.0.smithi023.stdout:4/11: dwrite f2 [4194304,4194304] 0 2024-02-28T16:23:54.327 INFO:tasks.workunit.client.0.smithi023.stdout:6/39: dread d1/f4 [0,4194304] 0 2024-02-28T16:23:54.330 INFO:tasks.workunit.client.0.smithi023.stdout:6/40: write d1/fc [839269,14979] 0 2024-02-28T16:23:54.330 INFO:tasks.workunit.client.0.smithi023.stdout:5/39: link d1/l3 d1/l9 0 2024-02-28T16:23:54.342 INFO:tasks.workunit.client.0.smithi023.stdout:5/40: fsync d1/f6 0 2024-02-28T16:23:54.345 INFO:tasks.workunit.client.0.smithi023.stdout:1/11: write f2 [1853179,129091] 0 2024-02-28T16:23:54.353 INFO:tasks.workunit.client.0.smithi023.stdout:6/41: dread d1/fc [0,4194304] 0 2024-02-28T16:23:54.355 INFO:tasks.workunit.client.0.smithi023.stdout:4/12: dwrite f2 [8388608,4194304] 0 2024-02-28T16:23:54.356 INFO:tasks.workunit.client.0.smithi023.stdout:5/41: chown d1/l3 83009623 1 2024-02-28T16:23:54.356 INFO:tasks.workunit.client.0.smithi023.stdout:1/12: creat f3 x:0 0 0 2024-02-28T16:23:54.361 INFO:tasks.workunit.client.0.smithi023.stdout:6/42: mknod d1/cf 0 2024-02-28T16:23:54.362 INFO:tasks.workunit.client.0.smithi023.stdout:8/14: dread d0/f2 [0,4194304] 0 2024-02-28T16:23:54.366 INFO:tasks.workunit.client.0.smithi023.stdout:5/42: mknod d1/ca 0 2024-02-28T16:23:54.369 INFO:tasks.workunit.client.0.smithi023.stdout:6/43: write d1/fc [1453008,74467] 0 2024-02-28T16:23:54.376 INFO:tasks.workunit.client.0.smithi023.stdout:8/15: dread d0/f2 [0,4194304] 0 2024-02-28T16:23:54.378 INFO:tasks.workunit.client.0.smithi023.stdout:8/16: stat d0 0 2024-02-28T16:23:54.378 INFO:tasks.workunit.client.0.smithi023.stdout:4/13: dread f2 [0,4194304] 0 2024-02-28T16:23:54.379 INFO:tasks.workunit.client.0.smithi023.stdout:5/43: link d1/ca d1/cb 0 2024-02-28T16:23:54.385 INFO:tasks.workunit.client.0.smithi023.stdout:1/13: getdents . 0 2024-02-28T16:23:54.388 INFO:tasks.workunit.client.0.smithi023.stdout:1/14: write f3 [770236,61206] 0 2024-02-28T16:23:54.388 INFO:tasks.workunit.client.0.smithi023.stdout:4/14: creat f4 x:0 0 0 2024-02-28T16:23:54.388 INFO:tasks.workunit.client.0.smithi023.stdout:5/44: mknod d1/cc 0 2024-02-28T16:23:54.391 INFO:tasks.workunit.client.0.smithi023.stdout:8/17: truncate d0/f2 3562991 0 2024-02-28T16:23:54.393 INFO:tasks.workunit.client.0.smithi023.stdout:8/18: rename d0 to d0/d3 22 2024-02-28T16:23:54.394 INFO:tasks.workunit.client.0.smithi023.stdout:4/15: chown f2 45 1 2024-02-28T16:23:54.395 INFO:tasks.workunit.client.0.smithi023.stdout:4/16: stat f4 0 2024-02-28T16:23:54.400 INFO:tasks.workunit.client.0.smithi023.stdout:1/15: unlink f0 0 2024-02-28T16:23:54.403 INFO:tasks.workunit.client.0.smithi023.stdout:6/44: dwrite d1/fa [0,4194304] 0 2024-02-28T16:23:54.415 INFO:tasks.workunit.client.0.smithi023.stdout:5/45: rmdir d1 39 2024-02-28T16:23:54.422 INFO:tasks.workunit.client.0.smithi023.stdout:1/16: fdatasync f2 0 2024-02-28T16:23:54.426 INFO:tasks.workunit.client.0.smithi023.stdout:4/17: dwrite f4 [0,4194304] 0 2024-02-28T16:23:54.430 INFO:tasks.workunit.client.0.smithi023.stdout:8/19: truncate d0/f2 286023 0 2024-02-28T16:23:54.434 INFO:tasks.workunit.client.0.smithi023.stdout:6/45: write d1/fb [325977,86515] 0 2024-02-28T16:23:54.440 INFO:tasks.workunit.client.0.smithi023.stdout:5/46: rename d1/cb to d1/cd 0 2024-02-28T16:23:54.442 INFO:tasks.workunit.client.0.smithi023.stdout:5/47: chown d1/cc 497308796 1 2024-02-28T16:23:54.443 INFO:tasks.workunit.client.0.smithi023.stdout:5/48: fdatasync d1/f6 0 2024-02-28T16:23:54.451 INFO:tasks.workunit.client.0.smithi023.stdout:8/20: mknod d0/c4 0 2024-02-28T16:23:54.454 INFO:tasks.workunit.client.0.smithi023.stdout:1/17: dwrite f2 [0,4194304] 0 2024-02-28T16:23:54.497 INFO:tasks.workunit.client.0.smithi023.stdout:5/49: creat d1/fe x:0 0 0 2024-02-28T16:23:54.502 INFO:tasks.workunit.client.0.smithi023.stdout:8/21: mkdir d0/d5 0 2024-02-28T16:23:54.509 INFO:tasks.workunit.client.0.smithi023.stdout:5/50: mkdir d1/df 0 2024-02-28T16:23:54.511 INFO:tasks.workunit.client.0.smithi023.stdout:4/18: getdents . 0 2024-02-28T16:23:54.512 INFO:tasks.workunit.client.0.smithi023.stdout:5/51: write d1/f6 [1479985,101158] 0 2024-02-28T16:23:54.512 INFO:tasks.workunit.client.0.smithi023.stdout:4/19: chown f4 11027445 1 2024-02-28T16:23:54.513 INFO:tasks.workunit.client.0.smithi023.stdout:5/52: chown d1 62925693 1 2024-02-28T16:23:54.513 INFO:tasks.workunit.client.0.smithi023.stdout:4/20: chown f2 133715774 1 2024-02-28T16:23:54.514 INFO:tasks.workunit.client.0.smithi023.stdout:6/46: link d1/c9 d1/c10 0 2024-02-28T16:23:54.517 INFO:tasks.workunit.client.0.smithi023.stdout:1/18: creat f4 x:0 0 0 2024-02-28T16:23:54.519 INFO:tasks.workunit.client.0.smithi023.stdout:6/47: creat d1/f11 x:0 0 0 2024-02-28T16:23:54.520 INFO:tasks.workunit.client.0.smithi023.stdout:4/21: creat f5 x:0 0 0 2024-02-28T16:23:54.521 INFO:tasks.workunit.client.0.smithi023.stdout:6/48: write d1/fe [63822,41650] 0 2024-02-28T16:23:54.526 INFO:tasks.workunit.client.0.smithi023.stdout:1/19: stat f3 0 2024-02-28T16:23:54.547 INFO:tasks.workunit.client.0.smithi023.stdout:5/53: mknod d1/df/c10 0 2024-02-28T16:23:54.548 INFO:tasks.workunit.client.0.smithi023.stdout:8/22: truncate d0/f2 222459 0 2024-02-28T16:23:54.558 INFO:tasks.workunit.client.0.smithi023.stdout:4/22: dwrite f4 [0,4194304] 0 2024-02-28T16:23:54.562 INFO:tasks.workunit.client.0.smithi023.stdout:4/23: chown c3 44 1 2024-02-28T16:23:54.574 INFO:tasks.workunit.client.0.smithi023.stdout:5/54: dwrite d1/fe [0,4194304] 0 2024-02-28T16:23:54.603 INFO:tasks.workunit.client.0.smithi023.stdout:5/55: dwrite d1/fe [0,4194304] 0 2024-02-28T16:23:54.626 INFO:tasks.workunit.client.0.smithi023.stdout:5/56: dwrite d1/fe [0,4194304] 0 2024-02-28T16:23:54.649 INFO:tasks.workunit.client.0.smithi023.stdout:5/57: fsync d1/fe 0 2024-02-28T16:23:54.731 INFO:tasks.workunit.client.0.smithi023.stdout:6/49: link d1/f11 d1/f12 0 2024-02-28T16:23:54.731 INFO:tasks.workunit.client.0.smithi023.stdout:1/20: mknod c5 0 2024-02-28T16:23:54.733 INFO:tasks.workunit.client.0.smithi023.stdout:8/23: creat d0/f6 x:0 0 0 2024-02-28T16:23:54.734 INFO:tasks.workunit.client.0.smithi023.stdout:4/24: rename f4 to f6 0 2024-02-28T16:23:54.742 INFO:tasks.workunit.client.0.smithi023.stdout:6/50: symlink d1/l13 0 2024-02-28T16:23:54.742 INFO:tasks.workunit.client.0.smithi023.stdout:4/25: fdatasync f6 0 2024-02-28T16:23:54.743 INFO:tasks.workunit.client.0.smithi023.stdout:4/26: readlink - no filename 2024-02-28T16:23:54.747 INFO:tasks.workunit.client.0.smithi023.stdout:8/24: creat d0/d5/f7 x:0 0 0 2024-02-28T16:23:54.750 INFO:tasks.workunit.client.0.smithi023.stdout:4/27: creat f7 x:0 0 0 2024-02-28T16:23:54.753 INFO:tasks.workunit.client.0.smithi023.stdout:6/51: rename d1/fa to d1/f14 0 2024-02-28T16:23:54.755 INFO:tasks.workunit.client.0.smithi023.stdout:1/21: dread f2 [0,4194304] 0 2024-02-28T16:23:54.761 INFO:tasks.workunit.client.0.smithi023.stdout:6/52: creat d1/f15 x:0 0 0 2024-02-28T16:23:54.763 INFO:tasks.workunit.client.0.smithi023.stdout:4/28: link f5 f8 0 2024-02-28T16:23:54.766 INFO:tasks.workunit.client.0.smithi023.stdout:6/53: creat d1/f16 x:0 0 0 2024-02-28T16:23:54.767 INFO:tasks.workunit.client.0.smithi023.stdout:1/22: symlink l6 0 2024-02-28T16:23:54.771 INFO:tasks.workunit.client.0.smithi023.stdout:4/29: link f7 f9 0 2024-02-28T16:23:54.774 INFO:tasks.workunit.client.0.smithi023.stdout:4/30: mkdir da 0 2024-02-28T16:23:54.780 INFO:tasks.workunit.client.0.smithi023.stdout:1/23: dread f2 [0,4194304] 0 2024-02-28T16:23:54.785 INFO:tasks.workunit.client.0.smithi023.stdout:1/24: mknod c7 0 2024-02-28T16:23:54.785 INFO:tasks.workunit.client.0.smithi023.stdout:1/25: fsync f4 0 2024-02-28T16:23:54.786 INFO:tasks.workunit.client.0.smithi023.stdout:1/26: dread - f4 zero size 2024-02-28T16:23:54.786 INFO:tasks.workunit.client.0.smithi023.stdout:4/31: dread f6 [0,4194304] 0 2024-02-28T16:23:54.792 INFO:tasks.workunit.client.0.smithi023.stdout:1/27: creat f8 x:0 0 0 2024-02-28T16:23:54.792 INFO:tasks.workunit.client.0.smithi023.stdout:1/28: stat f8 0 2024-02-28T16:23:54.799 INFO:tasks.workunit.client.0.smithi023.stdout:1/29: dread f3 [0,4194304] 0 2024-02-28T16:23:54.803 INFO:tasks.workunit.client.0.smithi023.stdout:1/30: write f2 [2108717,81738] 0 2024-02-28T16:23:54.807 INFO:tasks.workunit.client.0.smithi023.stdout:4/32: dwrite f7 [0,4194304] 0 2024-02-28T16:23:54.808 INFO:tasks.workunit.client.0.smithi023.stdout:4/33: chown f5 87 1 2024-02-28T16:23:54.831 INFO:tasks.workunit.client.0.smithi023.stdout:4/34: dwrite f2 [4194304,4194304] 0 2024-02-28T16:23:54.850 INFO:tasks.workunit.client.0.smithi023.stdout:4/35: dwrite f6 [0,4194304] 0 2024-02-28T16:23:54.861 INFO:tasks.workunit.client.0.smithi023.stdout:4/36: rmdir da 0 2024-02-28T16:23:54.861 INFO:tasks.workunit.client.0.smithi023.stdout:4/37: readlink - no filename 2024-02-28T16:23:54.870 INFO:tasks.workunit.client.0.smithi023.stdout:4/38: link f9 fb 0 2024-02-28T16:23:54.875 INFO:tasks.workunit.client.0.smithi023.stdout:4/39: rename c3 to cc 0 2024-02-28T16:23:54.875 INFO:tasks.workunit.client.0.smithi023.stdout:4/40: stat f8 0 2024-02-28T16:23:54.878 INFO:tasks.workunit.client.0.smithi023.stdout:4/41: symlink ld 0 2024-02-28T16:23:54.965 INFO:tasks.workunit.client.0.smithi023.stdout:5/58: truncate d1/f6 2804378 0 2024-02-28T16:23:54.968 INFO:tasks.workunit.client.0.smithi023.stdout:5/59: creat d1/f11 x:0 0 0 2024-02-28T16:23:54.974 INFO:tasks.workunit.client.0.smithi023.stdout:5/60: symlink d1/l12 0 2024-02-28T16:23:54.977 INFO:tasks.workunit.client.0.smithi023.stdout:1/31: dwrite f2 [4194304,4194304] 0 2024-02-28T16:23:54.978 INFO:tasks.workunit.client.0.smithi023.stdout:1/32: chown f2 51207454 1 2024-02-28T16:23:54.979 INFO:tasks.workunit.client.0.smithi023.stdout:5/61: symlink d1/df/l13 0 2024-02-28T16:23:54.984 INFO:tasks.workunit.client.0.smithi023.stdout:1/33: mknod c9 0 2024-02-28T16:23:54.984 INFO:tasks.workunit.client.0.smithi023.stdout:1/34: stat f3 0 2024-02-28T16:23:54.989 INFO:tasks.workunit.client.0.smithi023.stdout:1/35: dread f3 [0,4194304] 0 2024-02-28T16:23:54.990 INFO:tasks.workunit.client.0.smithi023.stdout:1/36: readlink l6 0 2024-02-28T16:23:54.997 INFO:tasks.workunit.client.0.smithi023.stdout:5/62: dwrite d1/fe [0,4194304] 0 2024-02-28T16:23:55.001 INFO:tasks.workunit.client.0.smithi023.stdout:5/63: creat d1/df/f14 x:0 0 0 2024-02-28T16:23:55.005 INFO:tasks.workunit.client.0.smithi023.stdout:5/64: unlink d1/fe 0 2024-02-28T16:23:55.084 INFO:tasks.workunit.client.0.smithi023.stdout:5/65: rmdir d1 39 2024-02-28T16:23:55.115 INFO:tasks.workunit.client.0.smithi023.stdout:5/66: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:23:55.126 INFO:tasks.workunit.client.0.smithi023.stdout:5/67: dread d1/f6 [0,4194304] 0 2024-02-28T16:23:55.137 INFO:tasks.workunit.client.0.smithi023.stdout:5/68: dread d1/f6 [0,4194304] 0 2024-02-28T16:23:55.139 INFO:tasks.workunit.client.0.smithi023.stdout:5/69: write d1/df/f14 [734136,53940] 0 2024-02-28T16:23:55.140 INFO:tasks.workunit.client.0.smithi023.stdout:5/70: stat d1/l12 0 2024-02-28T16:23:55.143 INFO:tasks.workunit.client.0.smithi023.stdout:5/71: write d1/df/f14 [398845,100598] 0 2024-02-28T16:23:55.149 INFO:tasks.workunit.client.0.smithi023.stdout:5/72: link d1/df/l13 d1/df/l15 0 2024-02-28T16:23:55.156 INFO:tasks.workunit.client.0.smithi023.stdout:5/73: dread d1/df/f14 [0,4194304] 0 2024-02-28T16:23:55.159 INFO:tasks.workunit.client.0.smithi023.stdout:5/74: mknod d1/df/c16 0 2024-02-28T16:23:55.160 INFO:tasks.workunit.client.0.smithi023.stdout:5/75: chown d1/f6 10 1 2024-02-28T16:23:55.162 INFO:tasks.workunit.client.0.smithi023.stdout:5/76: mknod d1/c17 0 2024-02-28T16:23:55.181 INFO:tasks.workunit.client.0.smithi023.stdout:5/77: dwrite d1/df/f14 [0,4194304] 0 2024-02-28T16:23:55.185 INFO:tasks.workunit.client.0.smithi023.stdout:5/78: creat d1/df/f18 x:0 0 0 2024-02-28T16:23:55.186 INFO:tasks.workunit.client.0.smithi023.stdout:5/79: dread - d1/df/f18 zero size 2024-02-28T16:23:55.190 INFO:tasks.workunit.client.0.smithi023.stdout:5/80: creat d1/f19 x:0 0 0 2024-02-28T16:23:55.191 INFO:tasks.workunit.client.0.smithi023.stdout:5/81: dread - d1/f11 zero size 2024-02-28T16:23:55.193 INFO:tasks.workunit.client.0.smithi023.stdout:5/82: stat d1/df 0 2024-02-28T16:23:55.197 INFO:tasks.workunit.client.0.smithi023.stdout:5/83: write d1/f6 [4905584,118311] 0 2024-02-28T16:23:55.200 INFO:tasks.workunit.client.0.smithi023.stdout:5/84: symlink d1/df/l1a 0 2024-02-28T16:23:55.203 INFO:tasks.workunit.client.0.smithi023.stdout:5/85: chown d1/cd 99 1 2024-02-28T16:23:55.205 INFO:tasks.workunit.client.0.smithi023.stdout:5/86: creat d1/f1b x:0 0 0 2024-02-28T16:23:55.209 INFO:tasks.workunit.client.0.smithi023.stdout:5/87: rename d1/l8 to d1/l1c 0 2024-02-28T16:23:55.212 INFO:tasks.workunit.client.0.smithi023.stdout:5/88: mknod d1/df/c1d 0 2024-02-28T16:23:55.230 INFO:tasks.workunit.client.0.smithi023.stdout:5/89: dwrite d1/df/f14 [0,4194304] 0 2024-02-28T16:23:55.234 INFO:tasks.workunit.client.0.smithi023.stdout:5/90: mknod d1/df/c1e 0 2024-02-28T16:23:55.250 INFO:tasks.workunit.client.0.smithi023.stdout:5/91: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:23:55.252 INFO:tasks.workunit.client.0.smithi023.stdout:5/92: chown d1/df/l1a 197915987 1 2024-02-28T16:23:55.253 INFO:tasks.workunit.client.0.smithi023.stdout:5/93: dread - d1/df/f18 zero size 2024-02-28T16:23:55.270 INFO:tasks.workunit.client.0.smithi023.stdout:5/94: dread d1/f6 [0,4194304] 0 2024-02-28T16:23:55.274 INFO:tasks.workunit.client.0.smithi023.stdout:5/95: rename d1/df/c16 to d1/df/c1f 0 2024-02-28T16:23:55.276 INFO:tasks.workunit.client.0.smithi023.stdout:5/96: chown d1/l1c 17 1 2024-02-28T16:23:55.291 INFO:tasks.workunit.client.0.smithi023.stdout:5/97: dwrite d1/f19 [0,4194304] 0 2024-02-28T16:23:55.293 INFO:tasks.workunit.client.0.smithi023.stdout:5/98: dread - d1/df/f18 zero size 2024-02-28T16:23:55.296 INFO:tasks.workunit.client.0.smithi023.stdout:5/99: unlink d1/f6 0 2024-02-28T16:23:55.318 INFO:tasks.workunit.client.0.smithi023.stdout:5/100: dwrite d1/f19 [4194304,4194304] 0 2024-02-28T16:23:55.321 INFO:tasks.workunit.client.0.smithi023.stdout:5/101: creat d1/f20 x:0 0 0 2024-02-28T16:23:55.322 INFO:tasks.workunit.client.0.smithi023.stdout:5/102: stat d1 0 2024-02-28T16:23:55.325 INFO:tasks.workunit.client.0.smithi023.stdout:5/103: mknod d1/df/c21 0 2024-02-28T16:23:55.327 INFO:tasks.workunit.client.0.smithi023.stdout:5/104: truncate d1/f1b 718684 0 2024-02-28T16:23:55.343 INFO:tasks.workunit.client.0.smithi023.stdout:5/105: getdents d1 0 2024-02-28T16:23:55.344 INFO:tasks.workunit.client.0.smithi023.stdout:5/106: readlink d1/l12 0 2024-02-28T16:23:55.364 INFO:tasks.workunit.client.0.smithi023.stdout:5/107: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:23:55.368 INFO:tasks.workunit.client.0.smithi023.stdout:5/108: write d1/df/f14 [513843,85467] 0 2024-02-28T16:23:55.371 INFO:tasks.workunit.client.0.smithi023.stdout:5/109: write d1/f11 [3383619,106279] 0 2024-02-28T16:23:55.373 INFO:tasks.workunit.client.0.smithi023.stdout:5/110: write d1/f11 [2698485,57215] 0 2024-02-28T16:23:55.374 INFO:tasks.workunit.client.0.smithi023.stdout:5/111: write d1/f20 [33080,125930] 0 2024-02-28T16:23:55.377 INFO:tasks.workunit.client.0.smithi023.stdout:5/112: chown d1/df/l13 3 1 2024-02-28T16:23:55.379 INFO:tasks.workunit.client.0.smithi023.stdout:5/113: mknod d1/c22 0 2024-02-28T16:23:55.383 INFO:tasks.workunit.client.0.smithi023.stdout:5/114: mknod d1/df/c23 0 2024-02-28T16:23:55.387 INFO:tasks.workunit.client.0.smithi023.stdout:5/115: unlink d1/df/f18 0 2024-02-28T16:23:55.389 INFO:tasks.workunit.client.0.smithi023.stdout:5/116: creat d1/df/f24 x:0 0 0 2024-02-28T16:23:55.403 INFO:tasks.workunit.client.0.smithi023.stdout:5/117: dwrite d1/df/f14 [0,4194304] 0 2024-02-28T16:23:55.410 INFO:tasks.workunit.client.0.smithi023.stdout:5/118: read d1/f20 [32214,54273] 0 2024-02-28T16:23:55.415 INFO:tasks.workunit.client.0.smithi023.stdout:5/119: rename d1/f1b to d1/df/f25 0 2024-02-28T16:23:55.417 INFO:tasks.workunit.client.0.smithi023.stdout:5/120: creat d1/df/f26 x:0 0 0 2024-02-28T16:23:55.433 INFO:tasks.workunit.client.0.smithi023.stdout:5/121: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:23:55.449 INFO:tasks.workunit.client.0.smithi023.stdout:5/122: truncate d1/f11 3135270 0 2024-02-28T16:23:55.452 INFO:tasks.workunit.client.0.smithi023.stdout:5/123: rmdir d1 39 2024-02-28T16:23:55.455 INFO:tasks.workunit.client.0.smithi023.stdout:5/124: dread d1/f20 [0,4194304] 0 2024-02-28T16:23:55.458 INFO:tasks.workunit.client.0.smithi023.stdout:5/125: mknod d1/df/c27 0 2024-02-28T16:23:55.465 INFO:tasks.workunit.client.0.smithi023.stdout:5/126: write d1/f11 [2201489,15476] 0 2024-02-28T16:23:55.467 INFO:tasks.workunit.client.0.smithi023.stdout:5/127: rmdir d1 39 2024-02-28T16:23:55.470 INFO:tasks.workunit.client.0.smithi023.stdout:5/128: dread - d1/df/f26 zero size 2024-02-28T16:23:55.473 INFO:tasks.workunit.client.0.smithi023.stdout:5/129: unlink d1/f20 0 2024-02-28T16:23:55.481 INFO:tasks.workunit.client.0.smithi023.stdout:5/130: dread d1/f11 [0,4194304] 0 2024-02-28T16:23:55.483 INFO:tasks.workunit.client.0.smithi023.stdout:5/131: mknod d1/c28 0 2024-02-28T16:23:55.485 INFO:tasks.workunit.client.0.smithi023.stdout:5/132: creat d1/df/f29 x:0 0 0 2024-02-28T16:23:55.497 INFO:tasks.workunit.client.0.smithi023.stdout:5/133: dread d1/df/f14 [0,4194304] 0 2024-02-28T16:23:55.500 INFO:tasks.workunit.client.0.smithi023.stdout:5/134: mkdir d1/d2a 0 2024-02-28T16:23:55.516 INFO:tasks.workunit.client.0.smithi023.stdout:5/135: dwrite d1/df/f25 [0,4194304] 0 2024-02-28T16:23:55.519 INFO:tasks.workunit.client.0.smithi023.stdout:5/136: creat d1/f2b x:0 0 0 2024-02-28T16:23:55.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:55 smithi023 ceph-mon[29137]: pgmap v29: 65 pgs: 65 active+clean; 195 MiB data, 905 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 273 op/s 2024-02-28T16:23:55.821 INFO:tasks.workunit.client.0.smithi023.stdout:5/137: symlink d1/d2a/l2c 0 2024-02-28T16:23:55.824 INFO:tasks.workunit.client.0.smithi023.stdout:5/138: mknod d1/d2a/c2d 0 2024-02-28T16:23:55.884 INFO:tasks.workunit.client.0.smithi023.stdout:3/2: sync 2024-02-28T16:23:55.884 INFO:tasks.workunit.client.0.smithi023.stdout:3/3: truncate - no filename 2024-02-28T16:23:55.884 INFO:tasks.workunit.client.0.smithi023.stdout:3/4: write - no filename 2024-02-28T16:23:55.884 INFO:tasks.workunit.client.0.smithi023.stdout:2/11: sync 2024-02-28T16:23:55.884 INFO:tasks.workunit.client.0.smithi023.stdout:3/5: stat - no entries 2024-02-28T16:23:55.884 INFO:tasks.workunit.client.0.smithi023.stdout:3/6: read - no filename 2024-02-28T16:23:55.884 INFO:tasks.workunit.client.0.smithi023.stdout:3/7: rmdir - no directory 2024-02-28T16:23:55.885 INFO:tasks.workunit.client.0.smithi023.stdout:3/8: dwrite - no filename 2024-02-28T16:23:55.892 INFO:tasks.workunit.client.0.smithi023.stdout:2/12: rename l1 to l2 0 2024-02-28T16:23:55.893 INFO:tasks.workunit.client.0.smithi023.stdout:2/13: read - f0 zero size 2024-02-28T16:23:55.894 INFO:tasks.workunit.client.0.smithi023.stdout:3/9: mknod c0 0 2024-02-28T16:23:55.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:55 smithi153 ceph-mon[35341]: pgmap v29: 65 pgs: 65 active+clean; 195 MiB data, 905 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 273 op/s 2024-02-28T16:23:55.947 INFO:tasks.workunit.client.0.smithi023.stdout:9/3: sync 2024-02-28T16:23:55.947 INFO:tasks.workunit.client.0.smithi023.stdout:0/17: sync 2024-02-28T16:23:55.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/18: stat - no entries 2024-02-28T16:23:55.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/19: chown . 569056 1 2024-02-28T16:23:55.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/20: stat - no entries 2024-02-28T16:23:55.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/21: dread - no filename 2024-02-28T16:23:55.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/22: write - no filename 2024-02-28T16:23:55.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/23: fdatasync - no filename 2024-02-28T16:23:55.951 INFO:tasks.workunit.client.0.smithi023.stdout:0/24: mknod c2 0 2024-02-28T16:23:55.954 INFO:tasks.workunit.client.0.smithi023.stdout:9/4: mkdir d0 0 2024-02-28T16:23:55.955 INFO:tasks.workunit.client.0.smithi023.stdout:9/5: dread - no filename 2024-02-28T16:23:55.955 INFO:tasks.workunit.client.0.smithi023.stdout:9/6: chown d0 1 1 2024-02-28T16:23:55.957 INFO:tasks.workunit.client.0.smithi023.stdout:9/7: rename d0 to d0/d1 22 2024-02-28T16:23:55.958 INFO:tasks.workunit.client.0.smithi023.stdout:0/25: rename c2 to c3 0 2024-02-28T16:23:55.958 INFO:tasks.workunit.client.0.smithi023.stdout:0/26: dread - no filename 2024-02-28T16:23:55.964 INFO:tasks.workunit.client.0.smithi023.stdout:9/8: symlink d0/l2 0 2024-02-28T16:23:55.965 INFO:tasks.workunit.client.0.smithi023.stdout:9/9: fsync - no filename 2024-02-28T16:23:55.965 INFO:tasks.workunit.client.0.smithi023.stdout:9/10: stat d0/l2 0 2024-02-28T16:23:55.966 INFO:tasks.workunit.client.0.smithi023.stdout:9/11: truncate - no filename 2024-02-28T16:23:56.025 INFO:tasks.workunit.client.0.smithi023.stdout:5/139: truncate d1/f19 7989599 0 2024-02-28T16:23:56.029 INFO:tasks.workunit.client.0.smithi023.stdout:5/140: creat d1/df/f2e x:0 0 0 2024-02-28T16:23:56.031 INFO:tasks.workunit.client.0.smithi023.stdout:5/141: chown d1/cc 198366 1 2024-02-28T16:23:56.034 INFO:tasks.workunit.client.0.smithi023.stdout:5/142: mknod d1/c2f 0 2024-02-28T16:23:56.037 INFO:tasks.workunit.client.0.smithi023.stdout:5/143: truncate d1/df/f2e 21680 0 2024-02-28T16:23:56.043 INFO:tasks.workunit.client.0.smithi023.stdout:5/144: link d1/df/c1d d1/df/c30 0 2024-02-28T16:23:56.047 INFO:tasks.workunit.client.0.smithi023.stdout:5/145: symlink d1/d2a/l31 0 2024-02-28T16:23:56.048 INFO:tasks.workunit.client.0.smithi023.stdout:5/146: stat d1/f11 0 2024-02-28T16:23:56.052 INFO:tasks.workunit.client.0.smithi023.stdout:5/147: mkdir d1/d2a/d32 0 2024-02-28T16:23:56.056 INFO:tasks.workunit.client.0.smithi023.stdout:3/10: getdents . 0 2024-02-28T16:23:56.056 INFO:tasks.workunit.client.0.smithi023.stdout:3/11: read - no filename 2024-02-28T16:23:56.056 INFO:tasks.workunit.client.0.smithi023.stdout:2/14: stat l2 0 2024-02-28T16:23:56.060 INFO:tasks.workunit.client.0.smithi023.stdout:5/148: unlink d1/df/f26 0 2024-02-28T16:23:56.064 INFO:tasks.workunit.client.0.smithi023.stdout:3/12: mkdir d1 0 2024-02-28T16:23:56.065 INFO:tasks.workunit.client.0.smithi023.stdout:3/13: rename d1 to d1/d2 22 2024-02-28T16:23:56.070 INFO:tasks.workunit.client.0.smithi023.stdout:3/14: creat d1/f3 x:0 0 0 2024-02-28T16:23:56.071 INFO:tasks.workunit.client.0.smithi023.stdout:3/15: readlink - no filename 2024-02-28T16:23:56.074 INFO:tasks.workunit.client.0.smithi023.stdout:3/16: creat d1/f4 x:0 0 0 2024-02-28T16:23:56.076 INFO:tasks.workunit.client.0.smithi023.stdout:2/15: dwrite f0 [0,4194304] 0 2024-02-28T16:23:56.083 INFO:tasks.workunit.client.0.smithi023.stdout:5/149: dwrite d1/df/f14 [0,4194304] 0 2024-02-28T16:23:56.090 INFO:tasks.workunit.client.0.smithi023.stdout:0/27: stat c3 0 2024-02-28T16:23:56.090 INFO:tasks.workunit.client.0.smithi023.stdout:5/150: dread d1/df/f2e [0,4194304] 0 2024-02-28T16:23:56.095 INFO:tasks.workunit.client.0.smithi023.stdout:0/28: creat f4 x:0 0 0 2024-02-28T16:23:56.096 INFO:tasks.workunit.client.0.smithi023.stdout:5/151: mknod d1/d2a/c33 0 2024-02-28T16:23:56.097 INFO:tasks.workunit.client.0.smithi023.stdout:0/29: mknod c5 0 2024-02-28T16:23:56.099 INFO:tasks.workunit.client.0.smithi023.stdout:8/25: sync 2024-02-28T16:23:56.099 INFO:tasks.workunit.client.0.smithi023.stdout:7/10: sync 2024-02-28T16:23:56.099 INFO:tasks.workunit.client.0.smithi023.stdout:1/37: sync 2024-02-28T16:23:56.100 INFO:tasks.workunit.client.0.smithi023.stdout:6/54: sync 2024-02-28T16:23:56.100 INFO:tasks.workunit.client.0.smithi023.stdout:4/42: sync 2024-02-28T16:23:56.106 INFO:tasks.workunit.client.0.smithi023.stdout:1/38: fdatasync f4 0 2024-02-28T16:23:56.106 INFO:tasks.workunit.client.0.smithi023.stdout:1/39: rmdir - no directory 2024-02-28T16:23:56.106 INFO:tasks.workunit.client.0.smithi023.stdout:0/30: mkdir d6 0 2024-02-28T16:23:56.108 INFO:tasks.workunit.client.0.smithi023.stdout:1/40: chown l6 314542 1 2024-02-28T16:23:56.109 INFO:tasks.workunit.client.0.smithi023.stdout:0/31: truncate f4 947708 0 2024-02-28T16:23:56.109 INFO:tasks.workunit.client.0.smithi023.stdout:7/11: chown l2 1811113 1 2024-02-28T16:23:56.110 INFO:tasks.workunit.client.0.smithi023.stdout:6/55: write d1/f14 [1955607,53013] 0 2024-02-28T16:23:56.118 INFO:tasks.workunit.client.0.smithi023.stdout:1/41: symlink la 0 2024-02-28T16:23:56.122 INFO:tasks.workunit.client.0.smithi023.stdout:6/56: write d1/fd [1467009,37561] 0 2024-02-28T16:23:56.128 INFO:tasks.workunit.client.0.smithi023.stdout:7/12: getdents . 0 2024-02-28T16:23:56.129 INFO:tasks.workunit.client.0.smithi023.stdout:0/32: dread f4 [0,4194304] 0 2024-02-28T16:23:56.130 INFO:tasks.workunit.client.0.smithi023.stdout:1/42: unlink f8 0 2024-02-28T16:23:56.131 INFO:tasks.workunit.client.0.smithi023.stdout:0/33: chown d6 1521 1 2024-02-28T16:23:56.133 INFO:tasks.workunit.client.0.smithi023.stdout:5/152: dwrite d1/f2b [0,4194304] 0 2024-02-28T16:23:56.134 INFO:tasks.workunit.client.0.smithi023.stdout:2/16: fdatasync f0 0 2024-02-28T16:23:56.134 INFO:tasks.workunit.client.0.smithi023.stdout:0/34: rename d6 to d6/d7 22 2024-02-28T16:23:56.139 INFO:tasks.workunit.client.0.smithi023.stdout:7/13: creat f3 x:0 0 0 2024-02-28T16:23:56.140 INFO:tasks.workunit.client.0.smithi023.stdout:4/43: dwrite f2 [4194304,4194304] 0 2024-02-28T16:23:56.142 INFO:tasks.workunit.client.0.smithi023.stdout:0/35: write f4 [1445972,34894] 0 2024-02-28T16:23:56.143 INFO:tasks.workunit.client.0.smithi023.stdout:2/17: creat f3 x:0 0 0 2024-02-28T16:23:56.145 INFO:tasks.workunit.client.0.smithi023.stdout:0/36: chown d6 358302 1 2024-02-28T16:23:56.147 INFO:tasks.workunit.client.0.smithi023.stdout:1/43: symlink lb 0 2024-02-28T16:23:56.149 INFO:tasks.workunit.client.0.smithi023.stdout:7/14: creat f4 x:0 0 0 2024-02-28T16:23:56.152 INFO:tasks.workunit.client.0.smithi023.stdout:9/12: sync 2024-02-28T16:23:56.152 INFO:tasks.workunit.client.0.smithi023.stdout:5/153: unlink d1/f11 0 2024-02-28T16:23:56.155 INFO:tasks.workunit.client.0.smithi023.stdout:4/44: creat fe x:0 0 0 2024-02-28T16:23:56.159 INFO:tasks.workunit.client.0.smithi023.stdout:2/18: creat f4 x:0 0 0 2024-02-28T16:23:56.159 INFO:tasks.workunit.client.0.smithi023.stdout:6/57: dwrite d1/f16 [0,4194304] 0 2024-02-28T16:23:56.161 INFO:tasks.workunit.client.0.smithi023.stdout:2/19: readlink l2 0 2024-02-28T16:23:56.161 INFO:tasks.workunit.client.0.smithi023.stdout:0/37: rename c3 to d6/c8 0 2024-02-28T16:23:56.163 INFO:tasks.workunit.client.0.smithi023.stdout:0/38: stat d6 0 2024-02-28T16:23:56.163 INFO:tasks.workunit.client.0.smithi023.stdout:0/39: chown d6 5956 1 2024-02-28T16:23:56.164 INFO:tasks.workunit.client.0.smithi023.stdout:3/17: rmdir d1 39 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/13: rmdir d0 39 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/14: fdatasync - no filename 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/15: read - no filename 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/16: write - no filename 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/17: fdatasync - no filename 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/18: dwrite - no filename 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/19: write - no filename 2024-02-28T16:23:56.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/20: fsync - no filename 2024-02-28T16:23:56.170 INFO:tasks.workunit.client.0.smithi023.stdout:7/15: symlink l5 0 2024-02-28T16:23:56.170 INFO:tasks.workunit.client.0.smithi023.stdout:7/16: fdatasync f4 0 2024-02-28T16:23:56.176 INFO:tasks.workunit.client.0.smithi023.stdout:5/154: mknod d1/d2a/c34 0 2024-02-28T16:23:56.182 INFO:tasks.workunit.client.0.smithi023.stdout:6/58: fdatasync d1/f11 0 2024-02-28T16:23:56.185 INFO:tasks.workunit.client.0.smithi023.stdout:1/44: symlink lc 0 2024-02-28T16:23:56.188 INFO:tasks.workunit.client.0.smithi023.stdout:2/20: mkdir d5 0 2024-02-28T16:23:56.188 INFO:tasks.workunit.client.0.smithi023.stdout:1/45: read f3 [354916,71511] 0 2024-02-28T16:23:56.190 INFO:tasks.workunit.client.0.smithi023.stdout:0/40: symlink d6/l9 0 2024-02-28T16:23:56.199 INFO:tasks.workunit.client.0.smithi023.stdout:9/21: stat d0/l2 0 2024-02-28T16:23:56.199 INFO:tasks.workunit.client.0.smithi023.stdout:9/22: dwrite - no filename 2024-02-28T16:23:56.200 INFO:tasks.workunit.client.0.smithi023.stdout:5/155: symlink d1/d2a/l35 0 2024-02-28T16:23:56.206 INFO:tasks.workunit.client.0.smithi023.stdout:7/17: dwrite f3 [0,4194304] 0 2024-02-28T16:23:56.207 INFO:tasks.workunit.client.0.smithi023.stdout:6/59: mkdir d1/d17 0 2024-02-28T16:23:56.214 INFO:tasks.workunit.client.0.smithi023.stdout:8/26: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:23:56.218 INFO:tasks.workunit.client.0.smithi023.stdout:7/18: write f3 [3044943,70681] 0 2024-02-28T16:23:56.225 INFO:tasks.workunit.client.0.smithi023.stdout:3/18: creat d1/f5 x:0 0 0 2024-02-28T16:23:56.228 INFO:tasks.workunit.client.0.smithi023.stdout:9/23: mknod d0/c3 0 2024-02-28T16:23:56.230 INFO:tasks.workunit.client.0.smithi023.stdout:5/156: fsync d1/df/f2e 0 2024-02-28T16:23:56.236 INFO:tasks.workunit.client.0.smithi023.stdout:2/21: creat d5/f6 x:0 0 0 2024-02-28T16:23:56.236 INFO:tasks.workunit.client.0.smithi023.stdout:9/24: stat d0 0 2024-02-28T16:23:56.239 INFO:tasks.workunit.client.0.smithi023.stdout:8/27: symlink d0/l8 0 2024-02-28T16:23:56.244 INFO:tasks.workunit.client.0.smithi023.stdout:1/46: dwrite f2 [0,4194304] 0 2024-02-28T16:23:56.244 INFO:tasks.workunit.client.0.smithi023.stdout:5/157: dread d1/df/f2e [0,4194304] 0 2024-02-28T16:23:56.246 INFO:tasks.workunit.client.0.smithi023.stdout:2/22: read - d5/f6 zero size 2024-02-28T16:23:56.246 INFO:tasks.workunit.client.0.smithi023.stdout:8/28: readlink d0/l8 0 2024-02-28T16:23:56.248 INFO:tasks.workunit.client.0.smithi023.stdout:0/41: dwrite f4 [0,4194304] 0 2024-02-28T16:23:56.249 INFO:tasks.workunit.client.0.smithi023.stdout:3/19: write d1/f4 [127765,11560] 0 2024-02-28T16:23:56.249 INFO:tasks.workunit.client.0.smithi023.stdout:3/20: readlink - no filename 2024-02-28T16:23:56.252 INFO:tasks.workunit.client.0.smithi023.stdout:5/158: read d1/df/f14 [1402291,106054] 0 2024-02-28T16:23:56.256 INFO:tasks.workunit.client.0.smithi023.stdout:4/45: truncate f2 1144000 0 2024-02-28T16:23:56.257 INFO:tasks.workunit.client.0.smithi023.stdout:3/21: dread - d1/f3 zero size 2024-02-28T16:23:56.265 INFO:tasks.workunit.client.0.smithi023.stdout:9/25: creat d0/f4 x:0 0 0 2024-02-28T16:23:56.266 INFO:tasks.workunit.client.0.smithi023.stdout:8/29: mkdir d0/d5/d9 0 2024-02-28T16:23:56.267 INFO:tasks.workunit.client.0.smithi023.stdout:3/22: fdatasync d1/f4 0 2024-02-28T16:23:56.269 INFO:tasks.workunit.client.0.smithi023.stdout:2/23: unlink f3 0 2024-02-28T16:23:56.273 INFO:tasks.workunit.client.0.smithi023.stdout:6/60: dwrite d1/f16 [0,4194304] 0 2024-02-28T16:23:56.273 INFO:tasks.workunit.client.0.smithi023.stdout:7/19: link l5 l6 0 2024-02-28T16:23:56.273 INFO:tasks.workunit.client.0.smithi023.stdout:2/24: readlink l2 0 2024-02-28T16:23:56.273 INFO:tasks.workunit.client.0.smithi023.stdout:8/30: fsync d0/f2 0 2024-02-28T16:23:56.273 INFO:tasks.workunit.client.0.smithi023.stdout:0/42: mknod d6/ca 0 2024-02-28T16:23:56.274 INFO:tasks.workunit.client.0.smithi023.stdout:8/31: fdatasync d0/d5/f7 0 2024-02-28T16:23:56.275 INFO:tasks.workunit.client.0.smithi023.stdout:2/25: write f4 [790450,49440] 0 2024-02-28T16:23:56.275 INFO:tasks.workunit.client.0.smithi023.stdout:0/43: truncate f4 4243534 0 2024-02-28T16:23:56.277 INFO:tasks.workunit.client.0.smithi023.stdout:2/26: fsync d5/f6 0 2024-02-28T16:23:56.280 INFO:tasks.workunit.client.0.smithi023.stdout:8/32: truncate d0/f6 735859 0 2024-02-28T16:23:56.284 INFO:tasks.workunit.client.0.smithi023.stdout:8/33: dread - d0/d5/f7 zero size 2024-02-28T16:23:56.287 INFO:tasks.workunit.client.0.smithi023.stdout:6/61: fdatasync d1/fc 0 2024-02-28T16:23:56.288 INFO:tasks.workunit.client.0.smithi023.stdout:4/46: symlink lf 0 2024-02-28T16:23:56.289 INFO:tasks.workunit.client.0.smithi023.stdout:8/34: chown d0/d5/f7 1167 1 2024-02-28T16:23:56.294 INFO:tasks.workunit.client.0.smithi023.stdout:5/159: dwrite d1/df/f2e [0,4194304] 0 2024-02-28T16:23:56.294 INFO:tasks.workunit.client.0.smithi023.stdout:3/23: mknod d1/c6 0 2024-02-28T16:23:56.295 INFO:tasks.workunit.client.0.smithi023.stdout:9/26: creat d0/f5 x:0 0 0 2024-02-28T16:23:56.300 INFO:tasks.workunit.client.0.smithi023.stdout:1/47: rename c5 to cd 0 2024-02-28T16:23:56.304 INFO:tasks.workunit.client.0.smithi023.stdout:6/62: mkdir d1/d18 0 2024-02-28T16:23:56.308 INFO:tasks.workunit.client.0.smithi023.stdout:2/27: dread f4 [0,4194304] 0 2024-02-28T16:23:56.310 INFO:tasks.workunit.client.0.smithi023.stdout:2/28: fsync f0 0 2024-02-28T16:23:56.316 INFO:tasks.workunit.client.0.smithi023.stdout:4/47: dread f2 [0,4194304] 0 2024-02-28T16:23:56.318 INFO:tasks.workunit.client.0.smithi023.stdout:9/27: mknod d0/c6 0 2024-02-28T16:23:56.322 INFO:tasks.workunit.client.0.smithi023.stdout:7/20: dwrite f4 [0,4194304] 0 2024-02-28T16:23:56.328 INFO:tasks.workunit.client.0.smithi023.stdout:9/28: write d0/f5 [209165,78943] 0 2024-02-28T16:23:56.334 INFO:tasks.workunit.client.0.smithi023.stdout:5/160: mkdir d1/d2a/d32/d36 0 2024-02-28T16:23:56.342 INFO:tasks.workunit.client.0.smithi023.stdout:9/29: dread - d0/f4 zero size 2024-02-28T16:23:56.343 INFO:tasks.workunit.client.0.smithi023.stdout:3/24: dwrite d1/f5 [0,4194304] 0 2024-02-28T16:23:56.356 INFO:tasks.workunit.client.0.smithi023.stdout:1/48: creat fe x:0 0 0 2024-02-28T16:23:56.359 INFO:tasks.workunit.client.0.smithi023.stdout:9/30: dread d0/f5 [0,4194304] 0 2024-02-28T16:23:56.362 INFO:tasks.workunit.client.0.smithi023.stdout:8/35: rmdir d0/d5/d9 0 2024-02-28T16:23:56.364 INFO:tasks.workunit.client.0.smithi023.stdout:8/36: chown d0 115 1 2024-02-28T16:23:56.364 INFO:tasks.workunit.client.0.smithi023.stdout:4/48: write fb [1539584,11817] 0 2024-02-28T16:23:56.366 INFO:tasks.workunit.client.0.smithi023.stdout:5/161: mkdir d1/d2a/d32/d37 0 2024-02-28T16:23:56.367 INFO:tasks.workunit.client.0.smithi023.stdout:7/21: dwrite f4 [0,4194304] 0 2024-02-28T16:23:56.369 INFO:tasks.workunit.client.0.smithi023.stdout:8/37: chown d0/d5 64 1 2024-02-28T16:23:56.370 INFO:tasks.workunit.client.0.smithi023.stdout:3/25: creat d1/f7 x:0 0 0 2024-02-28T16:23:56.372 INFO:tasks.workunit.client.0.smithi023.stdout:6/63: link d1/f12 d1/d17/f19 0 2024-02-28T16:23:56.376 INFO:tasks.workunit.client.0.smithi023.stdout:9/31: mkdir d0/d7 0 2024-02-28T16:23:56.377 INFO:tasks.workunit.client.0.smithi023.stdout:1/49: fdatasync f3 0 2024-02-28T16:23:56.377 INFO:tasks.workunit.client.0.smithi023.stdout:2/29: dwrite f4 [0,4194304] 0 2024-02-28T16:23:56.377 INFO:tasks.workunit.client.0.smithi023.stdout:4/49: creat f10 x:0 0 0 2024-02-28T16:23:56.380 INFO:tasks.workunit.client.0.smithi023.stdout:8/38: unlink d0/f2 0 2024-02-28T16:23:56.382 INFO:tasks.workunit.client.0.smithi023.stdout:7/22: readlink l6 0 2024-02-28T16:23:56.385 INFO:tasks.workunit.client.0.smithi023.stdout:8/39: dread - d0/d5/f7 zero size 2024-02-28T16:23:56.388 INFO:tasks.workunit.client.0.smithi023.stdout:9/32: rename d0/c6 to d0/d7/c8 0 2024-02-28T16:23:56.389 INFO:tasks.workunit.client.0.smithi023.stdout:2/30: symlink d5/l7 0 2024-02-28T16:23:56.395 INFO:tasks.workunit.client.0.smithi023.stdout:4/50: mknod c11 0 2024-02-28T16:23:56.395 INFO:tasks.workunit.client.0.smithi023.stdout:4/51: rmdir - no directory 2024-02-28T16:23:56.398 INFO:tasks.workunit.client.0.smithi023.stdout:7/23: symlink l7 0 2024-02-28T16:23:56.402 INFO:tasks.workunit.client.0.smithi023.stdout:8/40: symlink d0/la 0 2024-02-28T16:23:56.404 INFO:tasks.workunit.client.0.smithi023.stdout:8/41: dread - d0/d5/f7 zero size 2024-02-28T16:23:56.405 INFO:tasks.workunit.client.0.smithi023.stdout:5/162: creat d1/d2a/d32/d37/f38 x:0 0 0 2024-02-28T16:23:56.406 INFO:tasks.workunit.client.0.smithi023.stdout:1/50: mkdir df 0 2024-02-28T16:23:56.408 INFO:tasks.workunit.client.0.smithi023.stdout:9/33: creat d0/d7/f9 x:0 0 0 2024-02-28T16:23:56.409 INFO:tasks.workunit.client.0.smithi023.stdout:2/31: symlink d5/l8 0 2024-02-28T16:23:56.410 INFO:tasks.workunit.client.0.smithi023.stdout:2/32: chown d5/f6 0 1 2024-02-28T16:23:56.411 INFO:tasks.workunit.client.0.smithi023.stdout:4/52: mknod c12 0 2024-02-28T16:23:56.412 INFO:tasks.workunit.client.0.smithi023.stdout:4/53: dread - f10 zero size 2024-02-28T16:23:56.412 INFO:tasks.workunit.client.0.smithi023.stdout:7/24: creat f8 x:0 0 0 2024-02-28T16:23:56.414 INFO:tasks.workunit.client.0.smithi023.stdout:8/42: mkdir d0/d5/db 0 2024-02-28T16:23:56.416 INFO:tasks.workunit.client.0.smithi023.stdout:8/43: fsync d0/d5/f7 0 2024-02-28T16:23:56.416 INFO:tasks.workunit.client.0.smithi023.stdout:5/163: creat d1/f39 x:0 0 0 2024-02-28T16:23:56.416 INFO:tasks.workunit.client.0.smithi023.stdout:9/34: mkdir d0/d7/da 0 2024-02-28T16:23:56.419 INFO:tasks.workunit.client.0.smithi023.stdout:7/25: mknod c9 0 2024-02-28T16:23:56.422 INFO:tasks.workunit.client.0.smithi023.stdout:6/64: getdents d1/d17 0 2024-02-28T16:23:56.423 INFO:tasks.workunit.client.0.smithi023.stdout:8/44: dread d0/f6 [0,4194304] 0 2024-02-28T16:23:56.425 INFO:tasks.workunit.client.0.smithi023.stdout:5/164: mkdir d1/d2a/d32/d37/d3a 0 2024-02-28T16:23:56.425 INFO:tasks.workunit.client.0.smithi023.stdout:2/33: dread f4 [0,4194304] 0 2024-02-28T16:23:56.428 INFO:tasks.workunit.client.0.smithi023.stdout:9/35: chown d0/d7/c8 0 1 2024-02-28T16:23:56.428 INFO:tasks.workunit.client.0.smithi023.stdout:2/34: dread - d5/f6 zero size 2024-02-28T16:23:56.431 INFO:tasks.workunit.client.0.smithi023.stdout:7/26: rename f3 to fa 0 2024-02-28T16:23:56.432 INFO:tasks.workunit.client.0.smithi023.stdout:6/65: creat d1/f1a x:0 0 0 2024-02-28T16:23:56.432 INFO:tasks.workunit.client.0.smithi023.stdout:7/27: chown c9 2 1 2024-02-28T16:23:56.434 INFO:tasks.workunit.client.0.smithi023.stdout:7/28: write f4 [2767861,124952] 0 2024-02-28T16:23:56.435 INFO:tasks.workunit.client.0.smithi023.stdout:8/45: rename d0/d5/f7 to d0/fc 0 2024-02-28T16:23:56.441 INFO:tasks.workunit.client.0.smithi023.stdout:2/35: symlink d5/l9 0 2024-02-28T16:23:56.442 INFO:tasks.workunit.client.0.smithi023.stdout:2/36: dread - d5/f6 zero size 2024-02-28T16:23:56.442 INFO:tasks.workunit.client.0.smithi023.stdout:2/37: readlink l2 0 2024-02-28T16:23:56.443 INFO:tasks.workunit.client.0.smithi023.stdout:2/38: fdatasync f0 0 2024-02-28T16:23:56.445 INFO:tasks.workunit.client.0.smithi023.stdout:6/66: rename d1/f1a to d1/f1b 0 2024-02-28T16:23:56.447 INFO:tasks.workunit.client.0.smithi023.stdout:5/165: creat d1/d2a/d32/d36/f3b x:0 0 0 2024-02-28T16:23:56.448 INFO:tasks.workunit.client.0.smithi023.stdout:7/29: mknod cb 0 2024-02-28T16:23:56.450 INFO:tasks.workunit.client.0.smithi023.stdout:5/166: write d1/df/f29 [515155,20471] 0 2024-02-28T16:23:56.450 INFO:tasks.workunit.client.0.smithi023.stdout:8/46: creat d0/d5/fd x:0 0 0 2024-02-28T16:23:56.452 INFO:tasks.workunit.client.0.smithi023.stdout:5/167: chown d1/df/f14 24037 1 2024-02-28T16:23:56.453 INFO:tasks.workunit.client.0.smithi023.stdout:2/39: mkdir d5/da 0 2024-02-28T16:23:56.459 INFO:tasks.workunit.client.0.smithi023.stdout:6/67: creat d1/f1c x:0 0 0 2024-02-28T16:23:56.462 INFO:tasks.workunit.client.0.smithi023.stdout:8/47: dread d0/f6 [0,4194304] 0 2024-02-28T16:23:56.472 INFO:tasks.workunit.client.0.smithi023.stdout:8/48: write d0/f6 [326494,92499] 0 2024-02-28T16:23:56.472 INFO:tasks.workunit.client.0.smithi023.stdout:2/40: getdents d5/da 0 2024-02-28T16:23:56.473 INFO:tasks.workunit.client.0.smithi023.stdout:7/30: dread f4 [0,4194304] 0 2024-02-28T16:23:56.477 INFO:tasks.workunit.client.0.smithi023.stdout:6/68: link d1/f1c d1/d18/f1d 0 2024-02-28T16:23:56.485 INFO:tasks.workunit.client.0.smithi023.stdout:5/168: dwrite d1/f2b [0,4194304] 0 2024-02-28T16:23:56.486 INFO:tasks.workunit.client.0.smithi023.stdout:4/54: dwrite f5 [0,4194304] 0 2024-02-28T16:23:56.491 INFO:tasks.workunit.client.0.smithi023.stdout:7/31: write f8 [748965,98423] 0 2024-02-28T16:23:56.491 INFO:tasks.workunit.client.0.smithi023.stdout:8/49: rename d0/l8 to d0/d5/le 0 2024-02-28T16:23:56.492 INFO:tasks.workunit.client.0.smithi023.stdout:6/69: fdatasync d1/f1c 0 2024-02-28T16:23:56.494 INFO:tasks.workunit.client.0.smithi023.stdout:2/41: mkdir d5/da/db 0 2024-02-28T16:23:56.495 INFO:tasks.workunit.client.0.smithi023.stdout:4/55: write fe [464026,33941] 0 2024-02-28T16:23:56.497 INFO:tasks.workunit.client.0.smithi023.stdout:9/36: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:23:56.497 INFO:tasks.workunit.client.0.smithi023.stdout:2/42: truncate f0 4461345 0 2024-02-28T16:23:56.500 INFO:tasks.workunit.client.0.smithi023.stdout:7/32: read f8 [345640,103002] 0 2024-02-28T16:23:56.502 INFO:tasks.workunit.client.0.smithi023.stdout:6/70: mkdir d1/d17/d1e 0 2024-02-28T16:23:56.503 INFO:tasks.workunit.client.0.smithi023.stdout:4/56: write f2 [1016906,121944] 0 2024-02-28T16:23:56.507 INFO:tasks.workunit.client.0.smithi023.stdout:9/37: mkdir d0/d7/db 0 2024-02-28T16:23:56.509 INFO:tasks.workunit.client.0.smithi023.stdout:8/50: creat d0/d5/db/ff x:0 0 0 2024-02-28T16:23:56.516 INFO:tasks.workunit.client.0.smithi023.stdout:7/33: link fa fc 0 2024-02-28T16:23:56.516 INFO:tasks.workunit.client.0.smithi023.stdout:8/51: truncate d0/d5/fd 263662 0 2024-02-28T16:23:56.520 INFO:tasks.workunit.client.0.smithi023.stdout:9/38: link d0/d7/f9 d0/d7/db/fc 0 2024-02-28T16:23:56.521 INFO:tasks.workunit.client.0.smithi023.stdout:7/34: chown l5 31 1 2024-02-28T16:23:56.524 INFO:tasks.workunit.client.0.smithi023.stdout:8/52: chown d0/f6 0 1 2024-02-28T16:23:56.529 INFO:tasks.workunit.client.0.smithi023.stdout:7/35: chown l5 4 1 2024-02-28T16:23:56.536 INFO:tasks.workunit.client.0.smithi023.stdout:9/39: symlink d0/d7/ld 0 2024-02-28T16:23:56.538 INFO:tasks.workunit.client.0.smithi023.stdout:6/71: getdents d1/d17 0 2024-02-28T16:23:56.540 INFO:tasks.workunit.client.0.smithi023.stdout:2/43: dwrite f4 [0,4194304] 0 2024-02-28T16:23:56.543 INFO:tasks.workunit.client.0.smithi023.stdout:8/53: rmdir d0/d5 39 2024-02-28T16:23:56.546 INFO:tasks.workunit.client.0.smithi023.stdout:5/169: dwrite d1/df/f14 [4194304,4194304] 0 2024-02-28T16:23:56.546 INFO:tasks.workunit.client.0.smithi023.stdout:7/36: mknod cd 0 2024-02-28T16:23:56.550 INFO:tasks.workunit.client.0.smithi023.stdout:5/170: dread - d1/f39 zero size 2024-02-28T16:23:56.551 INFO:tasks.workunit.client.0.smithi023.stdout:4/57: dwrite f2 [0,4194304] 0 2024-02-28T16:23:56.552 INFO:tasks.workunit.client.0.smithi023.stdout:4/58: fsync fb 0 2024-02-28T16:23:56.552 INFO:tasks.workunit.client.0.smithi023.stdout:5/171: stat d1/df/f25 0 2024-02-28T16:23:56.555 INFO:tasks.workunit.client.0.smithi023.stdout:8/54: truncate d0/d5/db/ff 99577 0 2024-02-28T16:23:56.556 INFO:tasks.workunit.client.0.smithi023.stdout:5/172: write d1/d2a/d32/d37/f38 [153614,80841] 0 2024-02-28T16:23:56.561 INFO:tasks.workunit.client.0.smithi023.stdout:7/37: mkdir de 0 2024-02-28T16:23:56.565 INFO:tasks.workunit.client.0.smithi023.stdout:4/59: mkdir d13 0 2024-02-28T16:23:56.565 INFO:tasks.workunit.client.0.smithi023.stdout:6/72: mknod d1/d17/d1e/c1f 0 2024-02-28T16:23:56.566 INFO:tasks.workunit.client.0.smithi023.stdout:5/173: creat d1/df/f3c x:0 0 0 2024-02-28T16:23:56.567 INFO:tasks.workunit.client.0.smithi023.stdout:9/40: rmdir d0/d7/da 0 2024-02-28T16:23:56.569 INFO:tasks.workunit.client.0.smithi023.stdout:4/60: chown f5 47 1 2024-02-28T16:23:56.569 INFO:tasks.workunit.client.0.smithi023.stdout:8/55: link d0/d5/fd d0/d5/db/f10 0 2024-02-28T16:23:56.571 INFO:tasks.workunit.client.0.smithi023.stdout:2/44: fdatasync f4 0 2024-02-28T16:23:56.573 INFO:tasks.workunit.client.0.smithi023.stdout:7/38: creat de/ff x:0 0 0 2024-02-28T16:23:56.576 INFO:tasks.workunit.client.0.smithi023.stdout:6/73: unlink d1/f7 0 2024-02-28T16:23:56.577 INFO:tasks.workunit.client.0.smithi023.stdout:5/174: symlink d1/l3d 0 2024-02-28T16:23:56.578 INFO:tasks.workunit.client.0.smithi023.stdout:9/41: mkdir d0/d7/de 0 2024-02-28T16:23:56.580 INFO:tasks.workunit.client.0.smithi023.stdout:4/61: rename c12 to d13/c14 0 2024-02-28T16:23:56.582 INFO:tasks.workunit.client.0.smithi023.stdout:4/62: write f7 [538377,73371] 0 2024-02-28T16:23:56.584 INFO:tasks.workunit.client.0.smithi023.stdout:8/56: symlink d0/d5/l11 0 2024-02-28T16:23:56.588 INFO:tasks.workunit.client.0.smithi023.stdout:5/175: dread d1/df/f29 [0,4194304] 0 2024-02-28T16:23:56.591 INFO:tasks.workunit.client.0.smithi023.stdout:5/176: chown d1/c22 0 1 2024-02-28T16:23:56.591 INFO:tasks.workunit.client.0.smithi023.stdout:8/57: unlink d0/f6 0 2024-02-28T16:23:56.592 INFO:tasks.workunit.client.0.smithi023.stdout:2/45: dread f4 [0,4194304] 0 2024-02-28T16:23:56.601 INFO:tasks.workunit.client.0.smithi023.stdout:2/46: mkdir d5/dc 0 2024-02-28T16:23:56.603 INFO:tasks.workunit.client.0.smithi023.stdout:2/47: chown d5/l7 3647780 1 2024-02-28T16:23:56.603 INFO:tasks.workunit.client.0.smithi023.stdout:6/74: getdents d1/d18 0 2024-02-28T16:23:56.604 INFO:tasks.workunit.client.0.smithi023.stdout:5/177: symlink d1/d2a/d32/d37/d3a/l3e 0 2024-02-28T16:23:56.605 INFO:tasks.workunit.client.0.smithi023.stdout:4/63: dwrite f9 [0,4194304] 0 2024-02-28T16:23:56.605 INFO:tasks.workunit.client.0.smithi023.stdout:6/75: dread - d1/f1b zero size 2024-02-28T16:23:56.605 INFO:tasks.workunit.client.0.smithi023.stdout:4/64: stat fb 0 2024-02-28T16:23:56.606 INFO:tasks.workunit.client.0.smithi023.stdout:2/48: write f4 [2793636,14244] 0 2024-02-28T16:23:56.610 INFO:tasks.workunit.client.0.smithi023.stdout:4/65: write f6 [3917886,103269] 0 2024-02-28T16:23:56.610 INFO:tasks.workunit.client.0.smithi023.stdout:7/39: rmdir de 39 2024-02-28T16:23:56.611 INFO:tasks.workunit.client.0.smithi023.stdout:7/40: chown l6 264764208 1 2024-02-28T16:23:56.613 INFO:tasks.workunit.client.0.smithi023.stdout:7/41: chown c9 71248403 1 2024-02-28T16:23:56.613 INFO:tasks.workunit.client.0.smithi023.stdout:4/66: write fb [3959196,53239] 0 2024-02-28T16:23:56.614 INFO:tasks.workunit.client.0.smithi023.stdout:2/49: fsync f4 0 2024-02-28T16:23:56.614 INFO:tasks.workunit.client.0.smithi023.stdout:6/76: rmdir d1/d17 39 2024-02-28T16:23:56.618 INFO:tasks.workunit.client.0.smithi023.stdout:2/50: truncate d5/f6 200348 0 2024-02-28T16:23:56.618 INFO:tasks.workunit.client.0.smithi023.stdout:9/42: write d0/d7/f9 [618975,8711] 0 2024-02-28T16:23:56.619 INFO:tasks.workunit.client.0.smithi023.stdout:2/51: stat d5/l8 0 2024-02-28T16:23:56.625 INFO:tasks.workunit.client.0.smithi023.stdout:4/67: rename f10 to d13/f15 0 2024-02-28T16:23:56.629 INFO:tasks.workunit.client.0.smithi023.stdout:2/52: symlink d5/ld 0 2024-02-28T16:23:56.632 INFO:tasks.workunit.client.0.smithi023.stdout:9/43: rename d0/d7/f9 to d0/d7/ff 0 2024-02-28T16:23:56.633 INFO:tasks.workunit.client.0.smithi023.stdout:7/42: mknod de/c10 0 2024-02-28T16:23:56.636 INFO:tasks.workunit.client.0.smithi023.stdout:4/68: mknod d13/c16 0 2024-02-28T16:23:56.636 INFO:tasks.workunit.client.0.smithi023.stdout:8/58: dwrite d0/d5/fd [0,4194304] 0 2024-02-28T16:23:56.636 INFO:tasks.workunit.client.0.smithi023.stdout:7/43: truncate de/ff 1039871 0 2024-02-28T16:23:56.637 INFO:tasks.workunit.client.0.smithi023.stdout:6/77: fdatasync d1/f11 0 2024-02-28T16:23:56.644 INFO:tasks.workunit.client.0.smithi023.stdout:9/44: unlink d0/d7/ld 0 2024-02-28T16:23:56.645 INFO:tasks.workunit.client.0.smithi023.stdout:2/53: getdents d5/dc 0 2024-02-28T16:23:56.646 INFO:tasks.workunit.client.0.smithi023.stdout:6/78: truncate d1/d18/f1d 916265 0 2024-02-28T16:23:56.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/54: write f4 [850442,57529] 0 2024-02-28T16:23:56.652 INFO:tasks.workunit.client.0.smithi023.stdout:8/59: symlink d0/d5/db/l12 0 2024-02-28T16:23:56.657 INFO:tasks.workunit.client.0.smithi023.stdout:9/45: unlink d0/d7/c8 0 2024-02-28T16:23:56.660 INFO:tasks.workunit.client.0.smithi023.stdout:2/55: symlink d5/le 0 2024-02-28T16:23:56.666 INFO:tasks.workunit.client.0.smithi023.stdout:4/69: link fb d13/f17 0 2024-02-28T16:23:56.672 INFO:tasks.workunit.client.0.smithi023.stdout:6/79: stat d1/f1c 0 2024-02-28T16:23:56.679 INFO:tasks.workunit.client.0.smithi023.stdout:8/60: dwrite d0/d5/db/ff [0,4194304] 0 2024-02-28T16:23:56.687 INFO:tasks.workunit.client.0.smithi023.stdout:7/44: truncate de/ff 91803 0 2024-02-28T16:23:56.694 INFO:tasks.workunit.client.0.smithi023.stdout:8/61: creat d0/d5/db/f13 x:0 0 0 2024-02-28T16:23:56.695 INFO:tasks.workunit.client.0.smithi023.stdout:2/56: dwrite d5/f6 [0,4194304] 0 2024-02-28T16:23:56.698 INFO:tasks.workunit.client.0.smithi023.stdout:4/70: dread f8 [0,4194304] 0 2024-02-28T16:23:56.704 INFO:tasks.workunit.client.0.smithi023.stdout:7/45: rename c9 to de/c11 0 2024-02-28T16:23:56.706 INFO:tasks.workunit.client.0.smithi023.stdout:4/71: fsync f8 0 2024-02-28T16:23:56.707 INFO:tasks.workunit.client.0.smithi023.stdout:8/62: write d0/d5/db/ff [345018,99966] 0 2024-02-28T16:23:56.710 INFO:tasks.workunit.client.0.smithi023.stdout:7/46: fsync f8 0 2024-02-28T16:23:56.713 INFO:tasks.workunit.client.0.smithi023.stdout:9/46: dwrite d0/d7/db/fc [0,4194304] 0 2024-02-28T16:23:56.716 INFO:tasks.workunit.client.0.smithi023.stdout:4/72: chown d13/f17 717596362 1 2024-02-28T16:23:56.719 INFO:tasks.workunit.client.0.smithi023.stdout:4/73: write f5 [4467053,3048] 0 2024-02-28T16:23:56.725 INFO:tasks.workunit.client.0.smithi023.stdout:7/47: unlink l7 0 2024-02-28T16:23:56.727 INFO:tasks.workunit.client.0.smithi023.stdout:2/57: truncate f0 257342 0 2024-02-28T16:23:56.729 INFO:tasks.workunit.client.0.smithi023.stdout:4/74: dread fe [0,4194304] 0 2024-02-28T16:23:56.731 INFO:tasks.workunit.client.0.smithi023.stdout:8/63: mknod d0/c14 0 2024-02-28T16:23:56.731 INFO:tasks.workunit.client.0.smithi023.stdout:7/48: rmdir de 39 2024-02-28T16:23:56.732 INFO:tasks.workunit.client.0.smithi023.stdout:8/64: chown d0/d5/db/f10 2200085 1 2024-02-28T16:23:56.733 INFO:tasks.workunit.client.0.smithi023.stdout:2/58: creat d5/ff x:0 0 0 2024-02-28T16:23:56.733 INFO:tasks.workunit.client.0.smithi023.stdout:6/80: dwrite d1/d17/f19 [0,4194304] 0 2024-02-28T16:23:56.738 INFO:tasks.workunit.client.0.smithi023.stdout:9/47: mknod d0/d7/de/c10 0 2024-02-28T16:23:56.745 INFO:tasks.workunit.client.0.smithi023.stdout:2/59: dread f4 [0,4194304] 0 2024-02-28T16:23:56.746 INFO:tasks.workunit.client.0.smithi023.stdout:6/81: rmdir d1/d17 39 2024-02-28T16:23:56.747 INFO:tasks.workunit.client.0.smithi023.stdout:4/75: dread f6 [0,4194304] 0 2024-02-28T16:23:56.749 INFO:tasks.workunit.client.0.smithi023.stdout:8/65: mknod d0/d5/db/c15 0 2024-02-28T16:23:56.754 INFO:tasks.workunit.client.0.smithi023.stdout:9/48: symlink d0/d7/db/l11 0 2024-02-28T16:23:56.757 INFO:tasks.workunit.client.0.smithi023.stdout:5/178: sync 2024-02-28T16:23:56.758 INFO:tasks.workunit.client.0.smithi023.stdout:0/44: sync 2024-02-28T16:23:56.758 INFO:tasks.workunit.client.0.smithi023.stdout:1/51: sync 2024-02-28T16:23:56.758 INFO:tasks.workunit.client.0.smithi023.stdout:3/26: sync 2024-02-28T16:23:56.760 INFO:tasks.workunit.client.0.smithi023.stdout:8/66: symlink d0/d5/db/l16 0 2024-02-28T16:23:56.767 INFO:tasks.workunit.client.0.smithi023.stdout:0/45: mkdir d6/db 0 2024-02-28T16:23:56.768 INFO:tasks.workunit.client.0.smithi023.stdout:5/179: write d1/df/f14 [8507076,128504] 0 2024-02-28T16:23:56.771 INFO:tasks.workunit.client.0.smithi023.stdout:4/76: dread f2 [0,4194304] 0 2024-02-28T16:23:56.771 INFO:tasks.workunit.client.0.smithi023.stdout:8/67: truncate d0/d5/db/f13 376566 0 2024-02-28T16:23:56.777 INFO:tasks.workunit.client.0.smithi023.stdout:2/60: dwrite f4 [0,4194304] 0 2024-02-28T16:23:56.783 INFO:tasks.workunit.client.0.smithi023.stdout:0/46: rmdir d6 39 2024-02-28T16:23:56.788 INFO:tasks.workunit.client.0.smithi023.stdout:5/180: creat d1/d2a/f3f x:0 0 0 2024-02-28T16:23:56.791 INFO:tasks.workunit.client.0.smithi023.stdout:8/68: mknod d0/d5/db/c17 0 2024-02-28T16:23:56.792 INFO:tasks.workunit.client.0.smithi023.stdout:9/49: truncate d0/f5 178789 0 2024-02-28T16:23:56.799 INFO:tasks.workunit.client.0.smithi023.stdout:7/49: dwrite de/ff [0,4194304] 0 2024-02-28T16:23:56.803 INFO:tasks.workunit.client.0.smithi023.stdout:5/181: creat d1/f40 x:0 0 0 2024-02-28T16:23:56.805 INFO:tasks.workunit.client.0.smithi023.stdout:9/50: symlink d0/d7/de/l12 0 2024-02-28T16:23:56.805 INFO:tasks.workunit.client.0.smithi023.stdout:1/52: link cd df/c10 0 2024-02-28T16:23:56.806 INFO:tasks.workunit.client.0.smithi023.stdout:5/182: chown d1/f2b 65239288 1 2024-02-28T16:23:56.808 INFO:tasks.workunit.client.0.smithi023.stdout:2/61: dwrite d5/f6 [4194304,4194304] 0 2024-02-28T16:23:56.809 INFO:tasks.workunit.client.0.smithi023.stdout:1/53: stat lb 0 2024-02-28T16:23:56.809 INFO:tasks.workunit.client.0.smithi023.stdout:9/51: chown d0/d7 16447 1 2024-02-28T16:23:56.812 INFO:tasks.workunit.client.0.smithi023.stdout:9/52: read d0/d7/db/fc [3175338,114573] 0 2024-02-28T16:23:56.812 INFO:tasks.workunit.client.0.smithi023.stdout:5/183: write d1/d2a/d32/d36/f3b [304609,53845] 0 2024-02-28T16:23:56.814 INFO:tasks.workunit.client.0.smithi023.stdout:3/27: getdents d1 0 2024-02-28T16:23:56.821 INFO:tasks.workunit.client.0.smithi023.stdout:4/77: getdents d13 0 2024-02-28T16:23:56.823 INFO:tasks.workunit.client.0.smithi023.stdout:3/28: creat d1/f8 x:0 0 0 2024-02-28T16:23:56.825 INFO:tasks.workunit.client.0.smithi023.stdout:1/54: mkdir df/d11 0 2024-02-28T16:23:56.827 INFO:tasks.workunit.client.0.smithi023.stdout:2/62: getdents d5/da/db 0 2024-02-28T16:23:56.832 INFO:tasks.workunit.client.0.smithi023.stdout:2/63: readlink d5/ld 0 2024-02-28T16:23:56.840 INFO:tasks.workunit.client.0.smithi023.stdout:9/53: fdatasync d0/f5 0 2024-02-28T16:23:56.844 INFO:tasks.workunit.client.0.smithi023.stdout:4/78: write f2 [232902,77249] 0 2024-02-28T16:23:56.850 INFO:tasks.workunit.client.0.smithi023.stdout:1/55: rename fe to df/d11/f12 0 2024-02-28T16:23:56.852 INFO:tasks.workunit.client.0.smithi023.stdout:8/69: dwrite d0/fc [0,4194304] 0 2024-02-28T16:23:56.864 INFO:tasks.workunit.client.0.smithi023.stdout:4/79: truncate f9 2421643 0 2024-02-28T16:23:56.867 INFO:tasks.workunit.client.0.smithi023.stdout:8/70: write d0/d5/db/ff [4018853,80186] 0 2024-02-28T16:23:56.868 INFO:tasks.workunit.client.0.smithi023.stdout:5/184: dwrite d1/df/f2e [0,4194304] 0 2024-02-28T16:23:56.871 INFO:tasks.workunit.client.0.smithi023.stdout:1/56: write df/d11/f12 [34749,108702] 0 2024-02-28T16:23:56.875 INFO:tasks.workunit.client.0.smithi023.stdout:8/71: write d0/d5/db/f13 [59053,114123] 0 2024-02-28T16:23:56.880 INFO:tasks.workunit.client.0.smithi023.stdout:8/72: chown d0/la 9137976 1 2024-02-28T16:23:56.882 INFO:tasks.workunit.client.0.smithi023.stdout:3/29: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:23:56.882 INFO:tasks.workunit.client.0.smithi023.stdout:7/50: dwrite f4 [0,4194304] 0 2024-02-28T16:23:56.887 INFO:tasks.workunit.client.0.smithi023.stdout:2/64: truncate d5/f6 1806148 0 2024-02-28T16:23:56.888 INFO:tasks.workunit.client.0.smithi023.stdout:4/80: write f6 [5166556,117664] 0 2024-02-28T16:23:56.891 INFO:tasks.workunit.client.0.smithi023.stdout:5/185: mknod d1/d2a/d32/d37/c41 0 2024-02-28T16:23:56.893 INFO:tasks.workunit.client.0.smithi023.stdout:9/54: dread d0/d7/db/fc [0,4194304] 0 2024-02-28T16:23:56.903 INFO:tasks.workunit.client.0.smithi023.stdout:7/51: creat de/f12 x:0 0 0 2024-02-28T16:23:56.905 INFO:tasks.workunit.client.0.smithi023.stdout:1/57: dwrite f3 [0,4194304] 0 2024-02-28T16:23:56.906 INFO:tasks.workunit.client.0.smithi023.stdout:2/65: dread f0 [0,4194304] 0 2024-02-28T16:23:56.909 INFO:tasks.workunit.client.0.smithi023.stdout:1/58: truncate f4 952261 0 2024-02-28T16:23:56.910 INFO:tasks.workunit.client.0.smithi023.stdout:7/52: write f8 [1098300,22024] 0 2024-02-28T16:23:56.918 INFO:tasks.workunit.client.0.smithi023.stdout:3/30: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:23:56.918 INFO:tasks.workunit.client.0.smithi023.stdout:9/55: fsync d0/d7/db/fc 0 2024-02-28T16:23:56.941 INFO:tasks.workunit.client.0.smithi023.stdout:7/53: mkdir de/d13 0 2024-02-28T16:23:56.942 INFO:tasks.workunit.client.0.smithi023.stdout:5/186: dwrite d1/df/f24 [0,4194304] 0 2024-02-28T16:23:56.943 INFO:tasks.workunit.client.0.smithi023.stdout:1/59: dread f3 [0,4194304] 0 2024-02-28T16:23:56.947 INFO:tasks.workunit.client.0.smithi023.stdout:8/73: rename d0/d5/db/f10 to d0/f18 0 2024-02-28T16:23:56.952 INFO:tasks.workunit.client.0.smithi023.stdout:9/56: mknod d0/d7/de/c13 0 2024-02-28T16:23:56.955 INFO:tasks.workunit.client.0.smithi023.stdout:4/81: fdatasync f7 0 2024-02-28T16:23:56.958 INFO:tasks.workunit.client.0.smithi023.stdout:3/31: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:23:56.961 INFO:tasks.workunit.client.0.smithi023.stdout:4/82: write f7 [2722774,86580] 0 2024-02-28T16:23:56.965 INFO:tasks.workunit.client.0.smithi023.stdout:4/83: write f6 [24462,112793] 0 2024-02-28T16:23:56.970 INFO:tasks.workunit.client.0.smithi023.stdout:8/74: creat d0/d5/db/f19 x:0 0 0 2024-02-28T16:23:56.971 INFO:tasks.workunit.client.0.smithi023.stdout:7/54: dwrite de/ff [0,4194304] 0 2024-02-28T16:23:56.983 INFO:tasks.workunit.client.0.smithi023.stdout:9/57: dread d0/d7/db/fc [0,4194304] 0 2024-02-28T16:23:56.988 INFO:tasks.workunit.client.0.smithi023.stdout:4/84: symlink d13/l18 0 2024-02-28T16:23:56.990 INFO:tasks.workunit.client.0.smithi023.stdout:7/55: dread f8 [0,4194304] 0 2024-02-28T16:23:56.991 INFO:tasks.workunit.client.0.smithi023.stdout:8/75: dread d0/d5/db/f13 [0,4194304] 0 2024-02-28T16:23:56.993 INFO:tasks.workunit.client.0.smithi023.stdout:1/60: dwrite f3 [0,4194304] 0 2024-02-28T16:23:56.993 INFO:tasks.workunit.client.0.smithi023.stdout:7/56: readlink l2 0 2024-02-28T16:23:56.995 INFO:tasks.workunit.client.0.smithi023.stdout:8/76: chown d0/la 4298099 1 2024-02-28T16:23:56.998 INFO:tasks.workunit.client.0.smithi023.stdout:1/61: chown c9 548 1 2024-02-28T16:23:57.001 INFO:tasks.workunit.client.0.smithi023.stdout:1/62: chown df/d11/f12 15488257 1 2024-02-28T16:23:57.006 INFO:tasks.workunit.client.0.smithi023.stdout:9/58: truncate d0/f5 39562 0 2024-02-28T16:23:57.006 INFO:tasks.workunit.client.0.smithi023.stdout:4/85: dread d13/f17 [0,4194304] 0 2024-02-28T16:23:57.006 INFO:tasks.workunit.client.0.smithi023.stdout:3/32: fdatasync d1/f7 0 2024-02-28T16:23:57.007 INFO:tasks.workunit.client.0.smithi023.stdout:3/33: fsync d1/f7 0 2024-02-28T16:23:57.008 INFO:tasks.workunit.client.0.smithi023.stdout:3/34: fsync d1/f7 0 2024-02-28T16:23:57.020 INFO:tasks.workunit.client.0.smithi023.stdout:5/187: write d1/f19 [3549408,8633] 0 2024-02-28T16:23:57.023 INFO:tasks.workunit.client.0.smithi023.stdout:7/57: creat de/f14 x:0 0 0 2024-02-28T16:23:57.024 INFO:tasks.workunit.client.0.smithi023.stdout:5/188: fsync d1/d2a/f3f 0 2024-02-28T16:23:57.024 INFO:tasks.workunit.client.0.smithi023.stdout:1/63: mkdir df/d11/d13 0 2024-02-28T16:23:57.026 INFO:tasks.workunit.client.0.smithi023.stdout:8/77: dwrite d0/d5/db/f19 [0,4194304] 0 2024-02-28T16:23:57.027 INFO:tasks.workunit.client.0.smithi023.stdout:1/64: write f4 [552904,123647] 0 2024-02-28T16:23:57.031 INFO:tasks.workunit.client.0.smithi023.stdout:3/35: dread d1/f5 [0,4194304] 0 2024-02-28T16:23:57.032 INFO:tasks.workunit.client.0.smithi023.stdout:4/86: symlink d13/l19 0 2024-02-28T16:23:57.040 INFO:tasks.workunit.client.0.smithi023.stdout:7/58: rename de/c10 to de/c15 0 2024-02-28T16:23:57.045 INFO:tasks.workunit.client.0.smithi023.stdout:8/78: mkdir d0/d5/d1a 0 2024-02-28T16:23:57.046 INFO:tasks.workunit.client.0.smithi023.stdout:8/79: chown d0/d5/d1a 31112239 1 2024-02-28T16:23:57.050 INFO:tasks.workunit.client.0.smithi023.stdout:3/36: write d1/f5 [2251249,52288] 0 2024-02-28T16:23:57.053 INFO:tasks.workunit.client.0.smithi023.stdout:4/87: symlink d13/l1a 0 2024-02-28T16:23:57.054 INFO:tasks.workunit.client.0.smithi023.stdout:5/189: dwrite d1/f40 [0,4194304] 0 2024-02-28T16:23:57.055 INFO:tasks.workunit.client.0.smithi023.stdout:7/59: rename cd to de/c16 0 2024-02-28T16:23:57.057 INFO:tasks.workunit.client.0.smithi023.stdout:5/190: readlink d1/l3d 0 2024-02-28T16:23:57.057 INFO:tasks.workunit.client.0.smithi023.stdout:8/80: chown d0/d5/db/c17 60 1 2024-02-28T16:23:57.058 INFO:tasks.workunit.client.0.smithi023.stdout:8/81: chown d0/d5 106796 1 2024-02-28T16:23:57.059 INFO:tasks.workunit.client.0.smithi023.stdout:1/65: creat df/d11/d13/f14 x:0 0 0 2024-02-28T16:23:57.061 INFO:tasks.workunit.client.0.smithi023.stdout:1/66: write f3 [1834970,60718] 0 2024-02-28T16:23:57.063 INFO:tasks.workunit.client.0.smithi023.stdout:3/37: rename d1/f3 to d1/f9 0 2024-02-28T16:23:57.068 INFO:tasks.workunit.client.0.smithi023.stdout:4/88: rename f8 to d13/f1b 0 2024-02-28T16:23:57.071 INFO:tasks.workunit.client.0.smithi023.stdout:5/191: mknod d1/d2a/d32/d36/c42 0 2024-02-28T16:23:57.075 INFO:tasks.workunit.client.0.smithi023.stdout:8/82: rename d0/d5/db to d0/d5/d1b 0 2024-02-28T16:23:57.083 INFO:tasks.workunit.client.0.smithi023.stdout:1/67: dwrite f4 [0,4194304] 0 2024-02-28T16:23:57.085 INFO:tasks.workunit.client.0.smithi023.stdout:3/38: mknod d1/ca 0 2024-02-28T16:23:57.088 INFO:tasks.workunit.client.0.smithi023.stdout:4/89: read d13/f17 [654531,71871] 0 2024-02-28T16:23:57.091 INFO:tasks.workunit.client.0.smithi023.stdout:4/90: chown c11 0 1 2024-02-28T16:23:57.094 INFO:tasks.workunit.client.0.smithi023.stdout:8/83: write d0/d5/fd [4963691,102736] 0 2024-02-28T16:23:57.096 INFO:tasks.workunit.client.0.smithi023.stdout:3/39: mknod d1/cb 0 2024-02-28T16:23:57.102 INFO:tasks.workunit.client.0.smithi023.stdout:5/192: dwrite d1/f19 [0,4194304] 0 2024-02-28T16:23:57.102 INFO:tasks.workunit.client.0.smithi023.stdout:3/40: write d1/f5 [745686,2602] 0 2024-02-28T16:23:57.110 INFO:tasks.workunit.client.0.smithi023.stdout:1/68: dwrite f2 [4194304,4194304] 0 2024-02-28T16:23:57.110 INFO:tasks.workunit.client.0.smithi023.stdout:4/91: write d13/f1b [4505166,25356] 0 2024-02-28T16:23:57.113 INFO:tasks.workunit.client.0.smithi023.stdout:8/84: write d0/d5/d1b/f13 [194933,128118] 0 2024-02-28T16:23:57.113 INFO:tasks.workunit.client.0.smithi023.stdout:3/41: mkdir d1/dc 0 2024-02-28T16:23:57.119 INFO:tasks.workunit.client.0.smithi023.stdout:7/60: link de/c16 de/c17 0 2024-02-28T16:23:57.119 INFO:tasks.workunit.client.0.smithi023.stdout:7/61: readlink l6 0 2024-02-28T16:23:57.121 INFO:tasks.workunit.client.0.smithi023.stdout:5/193: link d1/df/f2e d1/d2a/d32/d36/f43 0 2024-02-28T16:23:57.122 INFO:tasks.workunit.client.0.smithi023.stdout:5/194: chown d1/l1c 50 1 2024-02-28T16:23:57.124 INFO:tasks.workunit.client.0.smithi023.stdout:7/62: mknod de/c18 0 2024-02-28T16:23:57.125 INFO:tasks.workunit.client.0.smithi023.stdout:7/63: chown l5 217473383 1 2024-02-28T16:23:57.129 INFO:tasks.workunit.client.0.smithi023.stdout:3/42: dread d1/f4 [0,4194304] 0 2024-02-28T16:23:57.129 INFO:tasks.workunit.client.0.smithi023.stdout:1/69: dread f4 [0,4194304] 0 2024-02-28T16:23:57.129 INFO:tasks.workunit.client.0.smithi023.stdout:5/195: creat d1/d2a/f44 x:0 0 0 2024-02-28T16:23:57.134 INFO:tasks.workunit.client.0.smithi023.stdout:3/43: write d1/f7 [795403,68102] 0 2024-02-28T16:23:57.135 INFO:tasks.workunit.client.0.smithi023.stdout:5/196: write d1/f2b [2513755,49526] 0 2024-02-28T16:23:57.139 INFO:tasks.workunit.client.0.smithi023.stdout:5/197: dread - d1/d2a/f3f zero size 2024-02-28T16:23:57.141 INFO:tasks.workunit.client.0.smithi023.stdout:1/70: creat df/d11/d13/f15 x:0 0 0 2024-02-28T16:23:57.143 INFO:tasks.workunit.client.0.smithi023.stdout:5/198: truncate d1/df/f29 1199676 0 2024-02-28T16:23:57.145 INFO:tasks.workunit.client.0.smithi023.stdout:8/85: dwrite d0/fc [0,4194304] 0 2024-02-28T16:23:57.153 INFO:tasks.workunit.client.0.smithi023.stdout:4/92: write fe [1167329,31951] 0 2024-02-28T16:23:57.157 INFO:tasks.workunit.client.0.smithi023.stdout:4/93: write f2 [1531025,42771] 0 2024-02-28T16:23:57.162 INFO:tasks.workunit.client.0.smithi023.stdout:3/44: dread d1/f7 [0,4194304] 0 2024-02-28T16:23:57.164 INFO:tasks.workunit.client.0.smithi023.stdout:8/86: getdents d0/d5/d1b 0 2024-02-28T16:23:57.167 INFO:tasks.workunit.client.0.smithi023.stdout:4/94: symlink d13/l1c 0 2024-02-28T16:23:57.169 INFO:tasks.workunit.client.0.smithi023.stdout:3/45: unlink d1/f7 0 2024-02-28T16:23:57.170 INFO:tasks.workunit.client.0.smithi023.stdout:1/71: dread f2 [0,4194304] 0 2024-02-28T16:23:57.176 INFO:tasks.workunit.client.0.smithi023.stdout:5/199: dwrite d1/df/f25 [0,4194304] 0 2024-02-28T16:23:57.182 INFO:tasks.workunit.client.0.smithi023.stdout:8/87: symlink d0/l1c 0 2024-02-28T16:23:57.184 INFO:tasks.workunit.client.0.smithi023.stdout:1/72: creat df/f16 x:0 0 0 2024-02-28T16:23:57.186 INFO:tasks.workunit.client.0.smithi023.stdout:3/46: rename d1/ca to d1/dc/cd 0 2024-02-28T16:23:57.189 INFO:tasks.workunit.client.0.smithi023.stdout:1/73: write df/f16 [784202,103003] 0 2024-02-28T16:23:57.189 INFO:tasks.workunit.client.0.smithi023.stdout:5/200: unlink d1/cc 0 2024-02-28T16:23:57.190 INFO:tasks.workunit.client.0.smithi023.stdout:5/201: stat d1/cd 0 2024-02-28T16:23:57.193 INFO:tasks.workunit.client.0.smithi023.stdout:8/88: symlink d0/d5/l1d 0 2024-02-28T16:23:57.196 INFO:tasks.workunit.client.0.smithi023.stdout:1/74: rmdir df/d11 39 2024-02-28T16:23:57.198 INFO:tasks.workunit.client.0.smithi023.stdout:5/202: rmdir d1/d2a/d32 39 2024-02-28T16:23:57.209 INFO:tasks.workunit.client.0.smithi023.stdout:8/89: creat d0/d5/d1b/f1e x:0 0 0 2024-02-28T16:23:57.212 INFO:tasks.workunit.client.0.smithi023.stdout:3/47: dread d1/f9 [0,4194304] 0 2024-02-28T16:23:57.216 INFO:tasks.workunit.client.0.smithi023.stdout:5/203: symlink d1/d2a/l45 0 2024-02-28T16:23:57.216 INFO:tasks.workunit.client.0.smithi023.stdout:1/75: rmdir df 39 2024-02-28T16:23:57.217 INFO:tasks.workunit.client.0.smithi023.stdout:3/48: fsync d1/f4 0 2024-02-28T16:23:57.221 INFO:tasks.workunit.client.0.smithi023.stdout:5/204: truncate d1/d2a/f44 455289 0 2024-02-28T16:23:57.223 INFO:tasks.workunit.client.0.smithi023.stdout:4/95: dwrite f7 [0,4194304] 0 2024-02-28T16:23:57.225 INFO:tasks.workunit.client.0.smithi023.stdout:4/96: write f6 [5950063,88612] 0 2024-02-28T16:23:57.249 INFO:tasks.workunit.client.0.smithi023.stdout:5/205: mkdir d1/d2a/d32/d37/d3a/d46 0 2024-02-28T16:23:57.250 INFO:tasks.workunit.client.0.smithi023.stdout:1/76: rmdir df/d11 39 2024-02-28T16:23:57.250 INFO:tasks.workunit.client.0.smithi023.stdout:4/97: chown f7 13903620 1 2024-02-28T16:23:57.254 INFO:tasks.workunit.client.0.smithi023.stdout:1/77: truncate df/f16 1573903 0 2024-02-28T16:23:57.254 INFO:tasks.workunit.client.0.smithi023.stdout:4/98: mkdir d13/d1d 0 2024-02-28T16:23:57.256 INFO:tasks.workunit.client.0.smithi023.stdout:5/206: unlink d1/df/c30 0 2024-02-28T16:23:57.259 INFO:tasks.workunit.client.0.smithi023.stdout:4/99: mkdir d13/d1e 0 2024-02-28T16:23:57.260 INFO:tasks.workunit.client.0.smithi023.stdout:1/78: mknod df/d11/d13/c17 0 2024-02-28T16:23:57.263 INFO:tasks.workunit.client.0.smithi023.stdout:5/207: rename d1/df/c27 to d1/d2a/d32/d36/c47 0 2024-02-28T16:23:57.264 INFO:tasks.workunit.client.0.smithi023.stdout:5/208: read - d1/f39 zero size 2024-02-28T16:23:57.264 INFO:tasks.workunit.client.0.smithi023.stdout:3/49: dread d1/f9 [0,4194304] 0 2024-02-28T16:23:57.269 INFO:tasks.workunit.client.0.smithi023.stdout:5/209: write d1/df/f24 [1011514,30633] 0 2024-02-28T16:23:57.272 INFO:tasks.workunit.client.0.smithi023.stdout:5/210: stat d1/d2a/f44 0 2024-02-28T16:23:57.276 INFO:tasks.workunit.client.0.smithi023.stdout:5/211: dread - d1/d2a/f3f zero size 2024-02-28T16:23:57.282 INFO:tasks.workunit.client.0.smithi023.stdout:1/79: dwrite f3 [0,4194304] 0 2024-02-28T16:23:57.288 INFO:tasks.workunit.client.0.smithi023.stdout:4/100: dwrite d13/f15 [0,4194304] 0 2024-02-28T16:23:57.292 INFO:tasks.workunit.client.0.smithi023.stdout:4/101: write f7 [101928,27580] 0 2024-02-28T16:23:57.293 INFO:tasks.workunit.client.0.smithi023.stdout:3/50: dread d1/f5 [0,4194304] 0 2024-02-28T16:23:57.294 INFO:tasks.workunit.client.0.smithi023.stdout:1/80: write df/d11/d13/f15 [727588,86789] 0 2024-02-28T16:23:57.294 INFO:tasks.workunit.client.0.smithi023.stdout:4/102: chown ld 72343 1 2024-02-28T16:23:57.296 INFO:tasks.workunit.client.0.smithi023.stdout:3/51: dread d1/f4 [0,4194304] 0 2024-02-28T16:23:57.298 INFO:tasks.workunit.client.0.smithi023.stdout:1/81: truncate df/d11/f12 553584 0 2024-02-28T16:23:57.299 INFO:tasks.workunit.client.0.smithi023.stdout:3/52: read d1/f5 [2315101,65639] 0 2024-02-28T16:23:57.300 INFO:tasks.workunit.client.0.smithi023.stdout:3/53: fsync d1/f4 0 2024-02-28T16:23:57.302 INFO:tasks.workunit.client.0.smithi023.stdout:1/82: mknod df/d11/d13/c18 0 2024-02-28T16:23:57.303 INFO:tasks.workunit.client.0.smithi023.stdout:3/54: symlink d1/le 0 2024-02-28T16:23:57.304 INFO:tasks.workunit.client.0.smithi023.stdout:3/55: chown d1 73 1 2024-02-28T16:23:57.304 INFO:tasks.workunit.client.0.smithi023.stdout:5/212: read d1/d2a/d32/d37/f38 [76558,118525] 0 2024-02-28T16:23:57.306 INFO:tasks.workunit.client.0.smithi023.stdout:5/213: stat d1/d2a/l35 0 2024-02-28T16:23:57.308 INFO:tasks.workunit.client.0.smithi023.stdout:4/103: truncate d13/f1b 2672967 0 2024-02-28T16:23:57.309 INFO:tasks.workunit.client.0.smithi023.stdout:5/214: write d1/df/f24 [4854257,125901] 0 2024-02-28T16:23:57.312 INFO:tasks.workunit.client.0.smithi023.stdout:3/56: fdatasync d1/f9 0 2024-02-28T16:23:57.316 INFO:tasks.workunit.client.0.smithi023.stdout:1/83: dread f3 [0,4194304] 0 2024-02-28T16:23:57.318 INFO:tasks.workunit.client.0.smithi023.stdout:5/215: creat d1/d2a/d32/d37/d3a/f48 x:0 0 0 2024-02-28T16:23:57.319 INFO:tasks.workunit.client.0.smithi023.stdout:1/84: write df/d11/d13/f15 [999185,19380] 0 2024-02-28T16:23:57.320 INFO:tasks.workunit.client.0.smithi023.stdout:3/57: mkdir d1/df 0 2024-02-28T16:23:57.322 INFO:tasks.workunit.client.0.smithi023.stdout:1/85: truncate df/d11/d13/f15 1201107 0 2024-02-28T16:23:57.325 INFO:tasks.workunit.client.0.smithi023.stdout:3/58: rename d1/le to d1/df/l10 0 2024-02-28T16:23:57.327 INFO:tasks.workunit.client.0.smithi023.stdout:1/86: mknod df/d11/c19 0 2024-02-28T16:23:57.328 INFO:tasks.workunit.client.0.smithi023.stdout:5/216: link d1/df/c21 d1/d2a/d32/d36/c49 0 2024-02-28T16:23:57.328 INFO:tasks.workunit.client.0.smithi023.stdout:1/87: stat df/d11/c19 0 2024-02-28T16:23:57.331 INFO:tasks.workunit.client.0.smithi023.stdout:4/104: write f5 [1808658,122067] 0 2024-02-28T16:23:57.333 INFO:tasks.workunit.client.0.smithi023.stdout:5/217: unlink d1/d2a/d32/d37/d3a/l3e 0 2024-02-28T16:23:57.335 INFO:tasks.workunit.client.0.smithi023.stdout:1/88: mknod df/d11/d13/c1a 0 2024-02-28T16:23:57.337 INFO:tasks.workunit.client.0.smithi023.stdout:1/89: write df/d11/f12 [50561,77895] 0 2024-02-28T16:23:57.338 INFO:tasks.workunit.client.0.smithi023.stdout:4/105: getdents d13/d1d 0 2024-02-28T16:23:57.340 INFO:tasks.workunit.client.0.smithi023.stdout:3/59: readlink d1/df/l10 0 2024-02-28T16:23:57.341 INFO:tasks.workunit.client.0.smithi023.stdout:4/106: write f6 [5372010,114478] 0 2024-02-28T16:23:57.343 INFO:tasks.workunit.client.0.smithi023.stdout:5/218: rename d1/l9 to d1/d2a/d32/d36/l4a 0 2024-02-28T16:23:57.344 INFO:tasks.workunit.client.0.smithi023.stdout:1/90: rmdir df/d11 39 2024-02-28T16:23:57.347 INFO:tasks.workunit.client.0.smithi023.stdout:3/60: rename d1/f5 to d1/f11 0 2024-02-28T16:23:57.350 INFO:tasks.workunit.client.0.smithi023.stdout:4/107: mknod d13/d1e/c1f 0 2024-02-28T16:23:57.351 INFO:tasks.workunit.client.0.smithi023.stdout:4/108: stat d13/f15 0 2024-02-28T16:23:57.353 INFO:tasks.workunit.client.0.smithi023.stdout:1/91: mkdir df/d11/d13/d1b 0 2024-02-28T16:23:57.358 INFO:tasks.workunit.client.0.smithi023.stdout:4/109: rmdir d13/d1e 39 2024-02-28T16:23:57.358 INFO:tasks.workunit.client.0.smithi023.stdout:2/66: sync 2024-02-28T16:23:57.358 INFO:tasks.workunit.client.0.smithi023.stdout:6/82: sync 2024-02-28T16:23:57.358 INFO:tasks.workunit.client.0.smithi023.stdout:9/59: sync 2024-02-28T16:23:57.358 INFO:tasks.workunit.client.0.smithi023.stdout:0/47: sync 2024-02-28T16:23:57.359 INFO:tasks.workunit.client.0.smithi023.stdout:3/61: truncate d1/f9 346060 0 2024-02-28T16:23:57.361 INFO:tasks.workunit.client.0.smithi023.stdout:6/83: dread - d1/f1b zero size 2024-02-28T16:23:57.362 INFO:tasks.workunit.client.0.smithi023.stdout:3/62: chown d1/f11 6 1 2024-02-28T16:23:57.363 INFO:tasks.workunit.client.0.smithi023.stdout:6/84: stat d1/f11 0 2024-02-28T16:23:57.365 INFO:tasks.workunit.client.0.smithi023.stdout:5/219: dwrite d1/d2a/f44 [0,4194304] 0 2024-02-28T16:23:57.377 INFO:tasks.workunit.client.0.smithi023.stdout:4/110: dread fb [0,4194304] 0 2024-02-28T16:23:57.377 INFO:tasks.workunit.client.0.smithi023.stdout:0/48: rename c5 to d6/db/cc 0 2024-02-28T16:23:57.381 INFO:tasks.workunit.client.0.smithi023.stdout:2/67: truncate d5/f6 1337099 0 2024-02-28T16:23:57.384 INFO:tasks.workunit.client.0.smithi023.stdout:6/85: mknod d1/d17/c20 0 2024-02-28T16:23:57.385 INFO:tasks.workunit.client.0.smithi023.stdout:1/92: getdents df/d11/d13 0 2024-02-28T16:23:57.388 INFO:tasks.workunit.client.0.smithi023.stdout:0/49: creat d6/db/fd x:0 0 0 2024-02-28T16:23:57.391 INFO:tasks.workunit.client.0.smithi023.stdout:2/68: fsync d5/ff 0 2024-02-28T16:23:57.394 INFO:tasks.workunit.client.0.smithi023.stdout:3/63: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:23:57.396 INFO:tasks.workunit.client.0.smithi023.stdout:6/86: unlink d1/l2 0 2024-02-28T16:23:57.399 INFO:tasks.workunit.client.0.smithi023.stdout:1/93: symlink df/l1c 0 2024-02-28T16:23:57.403 INFO:tasks.workunit.client.0.smithi023.stdout:3/64: stat d1/df 0 2024-02-28T16:23:57.403 INFO:tasks.workunit.client.0.smithi023.stdout:6/87: fdatasync d1/f12 0 2024-02-28T16:23:57.406 INFO:tasks.workunit.client.0.smithi023.stdout:0/50: mknod d6/ce 0 2024-02-28T16:23:57.408 INFO:tasks.workunit.client.0.smithi023.stdout:6/88: fdatasync d1/f15 0 2024-02-28T16:23:57.413 INFO:tasks.workunit.client.0.smithi023.stdout:2/69: link f4 d5/da/f10 0 2024-02-28T16:23:57.413 INFO:tasks.workunit.client.0.smithi023.stdout:5/220: dwrite d1/d2a/d32/d37/d3a/f48 [0,4194304] 0 2024-02-28T16:23:57.416 INFO:tasks.workunit.client.0.smithi023.stdout:4/111: dread f2 [0,4194304] 0 2024-02-28T16:23:57.416 INFO:tasks.workunit.client.0.smithi023.stdout:9/60: dwrite d0/d7/db/fc [4194304,4194304] 0 2024-02-28T16:23:57.418 INFO:tasks.workunit.client.0.smithi023.stdout:2/70: fsync d5/ff 0 2024-02-28T16:23:57.420 INFO:tasks.workunit.client.0.smithi023.stdout:6/89: symlink d1/d17/d1e/l21 0 2024-02-28T16:23:57.421 INFO:tasks.workunit.client.0.smithi023.stdout:4/112: chown d13/c14 9674659 1 2024-02-28T16:23:57.423 INFO:tasks.workunit.client.0.smithi023.stdout:7/64: sync 2024-02-28T16:23:57.424 INFO:tasks.workunit.client.0.smithi023.stdout:5/221: truncate d1/f2b 4809390 0 2024-02-28T16:23:57.424 INFO:tasks.workunit.client.0.smithi023.stdout:1/94: getdents df/d11/d13/d1b 0 2024-02-28T16:23:57.427 INFO:tasks.workunit.client.0.smithi023.stdout:9/61: chown d0/d7/db/l11 507382740 1 2024-02-28T16:23:57.430 INFO:tasks.workunit.client.0.smithi023.stdout:7/65: read fa [3078980,111940] 0 2024-02-28T16:23:57.430 INFO:tasks.workunit.client.0.smithi023.stdout:2/71: dread - d5/ff zero size 2024-02-28T16:23:57.433 INFO:tasks.workunit.client.0.smithi023.stdout:3/65: getdents d1/df 0 2024-02-28T16:23:57.435 INFO:tasks.workunit.client.0.smithi023.stdout:4/113: creat d13/d1d/f20 x:0 0 0 2024-02-28T16:23:57.436 INFO:tasks.workunit.client.0.smithi023.stdout:5/222: symlink d1/d2a/d32/l4b 0 2024-02-28T16:23:57.438 INFO:tasks.workunit.client.0.smithi023.stdout:9/62: rmdir d0/d7 39 2024-02-28T16:23:57.438 INFO:tasks.workunit.client.0.smithi023.stdout:4/114: stat f2 0 2024-02-28T16:23:57.439 INFO:tasks.workunit.client.0.smithi023.stdout:7/66: write de/f12 [259919,59379] 0 2024-02-28T16:23:57.442 INFO:tasks.workunit.client.0.smithi023.stdout:1/95: rename c7 to df/d11/d13/d1b/c1d 0 2024-02-28T16:23:57.442 INFO:tasks.workunit.client.0.smithi023.stdout:9/63: dread - d0/f4 zero size 2024-02-28T16:23:57.444 INFO:tasks.workunit.client.0.smithi023.stdout:0/51: dwrite f4 [0,4194304] 0 2024-02-28T16:23:57.449 INFO:tasks.workunit.client.0.smithi023.stdout:5/223: mkdir d1/d2a/d32/d37/d3a/d4c 0 2024-02-28T16:23:57.452 INFO:tasks.workunit.client.0.smithi023.stdout:6/90: dread d1/f14 [0,4194304] 0 2024-02-28T16:23:57.453 INFO:tasks.workunit.client.0.smithi023.stdout:9/64: rmdir d0 39 2024-02-28T16:23:57.458 INFO:tasks.workunit.client.0.smithi023.stdout:4/115: mknod d13/c21 0 2024-02-28T16:23:57.459 INFO:tasks.workunit.client.0.smithi023.stdout:1/96: symlink df/l1e 0 2024-02-28T16:23:57.461 INFO:tasks.workunit.client.0.smithi023.stdout:5/224: fdatasync d1/d2a/d32/d37/f38 0 2024-02-28T16:23:57.461 INFO:tasks.workunit.client.0.smithi023.stdout:4/116: fdatasync f6 0 2024-02-28T16:23:57.466 INFO:tasks.workunit.client.0.smithi023.stdout:3/66: write d1/f9 [715254,35378] 0 2024-02-28T16:23:57.468 INFO:tasks.workunit.client.0.smithi023.stdout:0/52: link d6/l9 d6/db/lf 0 2024-02-28T16:23:57.475 INFO:tasks.workunit.client.0.smithi023.stdout:1/97: stat df/c10 0 2024-02-28T16:23:57.475 INFO:tasks.workunit.client.0.smithi023.stdout:9/65: rmdir d0 39 2024-02-28T16:23:57.476 INFO:tasks.workunit.client.0.smithi023.stdout:5/225: rmdir d1/d2a/d32/d37 39 2024-02-28T16:23:57.481 INFO:tasks.workunit.client.0.smithi023.stdout:5/226: chown d1/d2a/c33 7291287 1 2024-02-28T16:23:57.484 INFO:tasks.workunit.client.0.smithi023.stdout:7/67: dwrite de/ff [0,4194304] 0 2024-02-28T16:23:57.488 INFO:tasks.workunit.client.0.smithi023.stdout:1/98: mknod df/d11/c1f 0 2024-02-28T16:23:57.488 INFO:tasks.workunit.client.0.smithi023.stdout:4/117: mknod d13/d1e/c22 0 2024-02-28T16:23:57.490 INFO:tasks.workunit.client.0.smithi023.stdout:6/91: rename d1/fc to d1/f22 0 2024-02-28T16:23:57.491 INFO:tasks.workunit.client.0.smithi023.stdout:2/72: dwrite f0 [0,4194304] 0 2024-02-28T16:23:57.492 INFO:tasks.workunit.client.0.smithi023.stdout:4/118: write fe [1803568,33944] 0 2024-02-28T16:23:57.496 INFO:tasks.workunit.client.0.smithi023.stdout:6/92: write d1/f11 [4275864,5883] 0 2024-02-28T16:23:57.500 INFO:tasks.workunit.client.0.smithi023.stdout:0/53: truncate f4 2584009 0 2024-02-28T16:23:57.505 INFO:tasks.workunit.client.0.smithi023.stdout:6/93: read d1/fe [222727,8796] 0 2024-02-28T16:23:57.505 INFO:tasks.workunit.client.0.smithi023.stdout:4/119: symlink d13/d1e/l23 0 2024-02-28T16:23:57.509 INFO:tasks.workunit.client.0.smithi023.stdout:3/67: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:23:57.510 INFO:tasks.workunit.client.0.smithi023.stdout:5/227: dread d1/d2a/d32/d37/f38 [0,4194304] 0 2024-02-28T16:23:57.510 INFO:tasks.workunit.client.0.smithi023.stdout:6/94: read d1/f22 [200455,25697] 0 2024-02-28T16:23:57.516 INFO:tasks.workunit.client.0.smithi023.stdout:0/54: creat d6/f10 x:0 0 0 2024-02-28T16:23:57.520 INFO:tasks.workunit.client.0.smithi023.stdout:8/90: sync 2024-02-28T16:23:57.523 INFO:tasks.workunit.client.0.smithi023.stdout:7/68: dread de/ff [0,4194304] 0 2024-02-28T16:23:57.524 INFO:tasks.workunit.client.0.smithi023.stdout:6/95: creat d1/d17/d1e/f23 x:0 0 0 2024-02-28T16:23:57.527 INFO:tasks.workunit.client.0.smithi023.stdout:7/69: chown f8 95800 1 2024-02-28T16:23:57.527 INFO:tasks.workunit.client.0.smithi023.stdout:6/96: dread - d1/f15 zero size 2024-02-28T16:23:57.529 INFO:tasks.workunit.client.0.smithi023.stdout:3/68: rename d1/c6 to d1/dc/c12 0 2024-02-28T16:23:57.530 INFO:tasks.workunit.client.0.smithi023.stdout:2/73: dread d5/da/f10 [0,4194304] 0 2024-02-28T16:23:57.531 INFO:tasks.workunit.client.0.smithi023.stdout:8/91: dread d0/d5/d1b/f13 [0,4194304] 0 2024-02-28T16:23:57.534 INFO:tasks.workunit.client.0.smithi023.stdout:1/99: dwrite f3 [4194304,4194304] 0 2024-02-28T16:23:57.536 INFO:tasks.workunit.client.0.smithi023.stdout:9/66: link d0/f5 d0/d7/de/f14 0 2024-02-28T16:23:57.537 INFO:tasks.workunit.client.0.smithi023.stdout:5/228: mknod d1/d2a/d32/d37/d3a/d4c/c4d 0 2024-02-28T16:23:57.541 INFO:tasks.workunit.client.0.smithi023.stdout:5/229: dread - d1/df/f3c zero size 2024-02-28T16:23:57.541 INFO:tasks.workunit.client.0.smithi023.stdout:4/120: getdents d13/d1e 0 2024-02-28T16:23:57.541 INFO:tasks.workunit.client.0.smithi023.stdout:9/67: fdatasync d0/d7/ff 0 2024-02-28T16:23:57.544 INFO:tasks.workunit.client.0.smithi023.stdout:7/70: rename l5 to de/l19 0 2024-02-28T16:23:57.554 INFO:tasks.workunit.client.0.smithi023.stdout:6/97: dread d1/f12 [0,4194304] 0 2024-02-28T16:23:57.556 INFO:tasks.workunit.client.0.smithi023.stdout:3/69: dread d1/f11 [0,4194304] 0 2024-02-28T16:23:57.556 INFO:tasks.workunit.client.0.smithi023.stdout:1/100: symlink df/l20 0 2024-02-28T16:23:57.557 INFO:tasks.workunit.client.0.smithi023.stdout:2/74: rename d5/da/f10 to d5/f11 0 2024-02-28T16:23:57.557 INFO:tasks.workunit.client.0.smithi023.stdout:1/101: chown df/d11 68947886 1 2024-02-28T16:23:57.564 INFO:tasks.workunit.client.0.smithi023.stdout:0/55: getdents d6 0 2024-02-28T16:23:57.565 INFO:tasks.workunit.client.0.smithi023.stdout:7/71: getdents de/d13 0 2024-02-28T16:23:57.566 INFO:tasks.workunit.client.0.smithi023.stdout:5/230: dread d1/f2b [0,4194304] 0 2024-02-28T16:23:57.566 INFO:tasks.workunit.client.0.smithi023.stdout:3/70: fsync d1/f11 0 2024-02-28T16:23:57.567 INFO:tasks.workunit.client.0.smithi023.stdout:2/75: write d5/f11 [1625124,102894] 0 2024-02-28T16:23:57.569 INFO:tasks.workunit.client.0.smithi023.stdout:1/102: write f4 [3761337,21650] 0 2024-02-28T16:23:57.570 INFO:tasks.workunit.client.0.smithi023.stdout:0/56: truncate d6/f10 1018955 0 2024-02-28T16:23:57.571 INFO:tasks.workunit.client.0.smithi023.stdout:4/121: getdents d13 0 2024-02-28T16:23:57.571 INFO:tasks.workunit.client.0.smithi023.stdout:5/231: chown d1/d2a/d32/l4b 632539943 1 2024-02-28T16:23:57.572 INFO:tasks.workunit.client.0.smithi023.stdout:9/68: getdents d0 0 2024-02-28T16:23:57.576 INFO:tasks.workunit.client.0.smithi023.stdout:6/98: dread d1/d18/f1d [0,4194304] 0 2024-02-28T16:23:57.576 INFO:tasks.workunit.client.0.smithi023.stdout:4/122: mknod d13/d1d/c24 0 2024-02-28T16:23:57.580 INFO:tasks.workunit.client.0.smithi023.stdout:5/232: rmdir d1/d2a/d32/d37/d3a 39 2024-02-28T16:23:57.580 INFO:tasks.workunit.client.0.smithi023.stdout:4/123: read d13/f17 [576166,25543] 0 2024-02-28T16:23:57.581 INFO:tasks.workunit.client.0.smithi023.stdout:6/99: symlink d1/d17/l24 0 2024-02-28T16:23:57.581 INFO:tasks.workunit.client.0.smithi023.stdout:9/69: dread d0/d7/de/f14 [0,4194304] 0 2024-02-28T16:23:57.583 INFO:tasks.workunit.client.0.smithi023.stdout:7/72: dread f8 [0,4194304] 0 2024-02-28T16:23:57.585 INFO:tasks.workunit.client.0.smithi023.stdout:5/233: readlink d1/d2a/l35 0 2024-02-28T16:23:57.587 INFO:tasks.workunit.client.0.smithi023.stdout:9/70: fsync d0/d7/ff 0 2024-02-28T16:23:57.588 INFO:tasks.workunit.client.0.smithi023.stdout:8/92: dwrite d0/d5/d1b/f13 [0,4194304] 0 2024-02-28T16:23:57.589 INFO:tasks.workunit.client.0.smithi023.stdout:0/57: link d6/ca d6/db/c11 0 2024-02-28T16:23:57.598 INFO:tasks.workunit.client.0.smithi023.stdout:6/100: rename d1/l8 to d1/l25 0 2024-02-28T16:23:57.602 INFO:tasks.workunit.client.0.smithi023.stdout:5/234: dread d1/df/f29 [0,4194304] 0 2024-02-28T16:23:57.604 INFO:tasks.workunit.client.0.smithi023.stdout:0/58: mknod d6/db/c12 0 2024-02-28T16:23:57.605 INFO:tasks.workunit.client.0.smithi023.stdout:6/101: mkdir d1/d18/d26 0 2024-02-28T16:23:57.606 INFO:tasks.workunit.client.0.smithi023.stdout:7/73: dwrite de/ff [0,4194304] 0 2024-02-28T16:23:57.608 INFO:tasks.workunit.client.0.smithi023.stdout:7/74: readlink l2 0 2024-02-28T16:23:57.610 INFO:tasks.workunit.client.0.smithi023.stdout:1/103: truncate df/f16 626486 0 2024-02-28T16:23:57.611 INFO:tasks.workunit.client.0.smithi023.stdout:0/59: mkdir d6/d13 0 2024-02-28T16:23:57.618 INFO:tasks.workunit.client.0.smithi023.stdout:5/235: mkdir d1/d2a/d32/d37/d4e 0 2024-02-28T16:23:57.618 INFO:tasks.workunit.client.0.smithi023.stdout:1/104: fdatasync df/d11/d13/f14 0 2024-02-28T16:23:57.640 INFO:tasks.workunit.client.0.smithi023.stdout:1/105: dread df/d11/d13/f15 [0,4194304] 0 2024-02-28T16:23:57.645 INFO:tasks.workunit.client.0.smithi023.stdout:6/102: dwrite d1/f1b [0,4194304] 0 2024-02-28T16:23:57.649 INFO:tasks.workunit.client.0.smithi023.stdout:9/71: dwrite d0/d7/de/f14 [0,4194304] 0 2024-02-28T16:23:57.658 INFO:tasks.workunit.client.0.smithi023.stdout:7/75: creat de/d13/f1a x:0 0 0 2024-02-28T16:23:57.661 INFO:tasks.workunit.client.0.smithi023.stdout:0/60: dwrite d6/f10 [0,4194304] 0 2024-02-28T16:23:57.661 INFO:tasks.workunit.client.0.smithi023.stdout:5/236: creat d1/f4f x:0 0 0 2024-02-28T16:23:57.667 INFO:tasks.workunit.client.0.smithi023.stdout:5/237: dread - d1/d2a/f3f zero size 2024-02-28T16:23:57.672 INFO:tasks.workunit.client.0.smithi023.stdout:1/106: creat df/d11/f21 x:0 0 0 2024-02-28T16:23:57.673 INFO:tasks.workunit.client.0.smithi023.stdout:5/238: readlink d1/d2a/l35 0 2024-02-28T16:23:57.675 INFO:tasks.workunit.client.0.smithi023.stdout:9/72: creat d0/d7/db/f15 x:0 0 0 2024-02-28T16:23:57.678 INFO:tasks.workunit.client.0.smithi023.stdout:6/103: dwrite d1/fd [0,4194304] 0 2024-02-28T16:23:57.681 INFO:tasks.workunit.client.0.smithi023.stdout:7/76: mkdir de/d13/d1b 0 2024-02-28T16:23:57.690 INFO:tasks.workunit.client.0.smithi023.stdout:0/61: unlink d6/ce 0 2024-02-28T16:23:57.700 INFO:tasks.workunit.client.0.smithi023.stdout:6/104: symlink d1/l27 0 2024-02-28T16:23:57.702 INFO:tasks.workunit.client.0.smithi023.stdout:5/239: creat d1/d2a/d32/d37/d3a/f50 x:0 0 0 2024-02-28T16:23:57.708 INFO:tasks.workunit.client.0.smithi023.stdout:5/240: dread - d1/df/f3c zero size 2024-02-28T16:23:57.712 INFO:tasks.workunit.client.0.smithi023.stdout:6/105: write d1/f11 [1363129,65854] 0 2024-02-28T16:23:57.712 INFO:tasks.workunit.client.0.smithi023.stdout:1/107: dwrite df/d11/d13/f14 [0,4194304] 0 2024-02-28T16:23:57.716 INFO:tasks.workunit.client.0.smithi023.stdout:9/73: dwrite d0/d7/db/fc [0,4194304] 0 2024-02-28T16:23:57.716 INFO:tasks.workunit.client.0.smithi023.stdout:7/77: dwrite f4 [0,4194304] 0 2024-02-28T16:23:57.720 INFO:tasks.workunit.client.0.smithi023.stdout:1/108: fsync f2 0 2024-02-28T16:23:57.722 INFO:tasks.workunit.client.0.smithi023.stdout:9/74: read d0/d7/de/f14 [4180589,99865] 0 2024-02-28T16:23:57.728 INFO:tasks.workunit.client.0.smithi023.stdout:7/78: mkdir de/d1c 0 2024-02-28T16:23:57.732 INFO:tasks.workunit.client.0.smithi023.stdout:1/109: unlink lc 0 2024-02-28T16:23:57.733 INFO:tasks.workunit.client.0.smithi023.stdout:1/110: readlink l6 0 2024-02-28T16:23:57.735 INFO:tasks.workunit.client.0.smithi023.stdout:9/75: mknod d0/d7/db/c16 0 2024-02-28T16:23:57.737 INFO:tasks.workunit.client.0.smithi023.stdout:5/241: creat d1/d2a/d32/d37/f51 x:0 0 0 2024-02-28T16:23:57.737 INFO:tasks.workunit.client.0.smithi023.stdout:1/111: write df/d11/f12 [47819,122345] 0 2024-02-28T16:23:57.743 INFO:tasks.workunit.client.0.smithi023.stdout:6/106: dwrite d1/fd [0,4194304] 0 2024-02-28T16:23:57.746 INFO:tasks.workunit.client.0.smithi023.stdout:6/107: readlink d1/l3 0 2024-02-28T16:23:57.749 INFO:tasks.workunit.client.0.smithi023.stdout:5/242: truncate d1/d2a/d32/d37/f38 661984 0 2024-02-28T16:23:57.751 INFO:tasks.workunit.client.0.smithi023.stdout:5/243: read d1/f19 [238776,55149] 0 2024-02-28T16:23:57.751 INFO:tasks.workunit.client.0.smithi023.stdout:9/76: fdatasync d0/d7/de/f14 0 2024-02-28T16:23:57.755 INFO:tasks.workunit.client.0.smithi023.stdout:9/77: stat d0/d7/db/fc 0 2024-02-28T16:23:57.756 INFO:tasks.workunit.client.0.smithi023.stdout:9/78: fdatasync d0/f4 0 2024-02-28T16:23:57.761 INFO:tasks.workunit.client.0.smithi023.stdout:1/112: rename cd to df/d11/c22 0 2024-02-28T16:23:57.761 INFO:tasks.workunit.client.0.smithi023.stdout:7/79: dwrite f4 [4194304,4194304] 0 2024-02-28T16:23:57.769 INFO:tasks.workunit.client.0.smithi023.stdout:9/79: mknod d0/c17 0 2024-02-28T16:23:57.771 INFO:tasks.workunit.client.0.smithi023.stdout:7/80: readlink l6 0 2024-02-28T16:23:57.780 INFO:tasks.workunit.client.0.smithi023.stdout:6/108: rename d1/d17 to d1/d28 0 2024-02-28T16:23:57.782 INFO:tasks.workunit.client.0.smithi023.stdout:0/62: truncate d6/f10 3175186 0 2024-02-28T16:23:57.785 INFO:tasks.workunit.client.0.smithi023.stdout:0/63: chown d6/c8 1770 1 2024-02-28T16:23:57.786 INFO:tasks.workunit.client.0.smithi023.stdout:7/81: mknod de/d13/d1b/c1d 0 2024-02-28T16:23:57.789 INFO:tasks.workunit.client.0.smithi023.stdout:5/244: dwrite d1/d2a/d32/d37/d3a/f50 [0,4194304] 0 2024-02-28T16:23:57.789 INFO:tasks.workunit.client.0.smithi023.stdout:6/109: creat d1/d18/d26/f29 x:0 0 0 2024-02-28T16:23:57.790 INFO:tasks.workunit.client.0.smithi023.stdout:5/245: stat d1/d2a/l31 0 2024-02-28T16:23:57.792 INFO:tasks.workunit.client.0.smithi023.stdout:0/64: unlink d6/db/c12 0 2024-02-28T16:23:57.793 INFO:tasks.workunit.client.0.smithi023.stdout:7/82: symlink de/d13/d1b/l1e 0 2024-02-28T16:23:57.795 INFO:tasks.workunit.client.0.smithi023.stdout:5/246: truncate d1/d2a/d32/d36/f3b 909444 0 2024-02-28T16:23:57.796 INFO:tasks.workunit.client.0.smithi023.stdout:6/110: mknod d1/d28/c2a 0 2024-02-28T16:23:57.798 INFO:tasks.workunit.client.0.smithi023.stdout:7/83: creat de/d13/f1f x:0 0 0 2024-02-28T16:23:57.805 INFO:tasks.workunit.client.0.smithi023.stdout:5/247: symlink d1/d2a/d32/d37/d3a/d46/l52 0 2024-02-28T16:23:57.809 INFO:tasks.workunit.client.0.smithi023.stdout:5/248: fdatasync d1/df/f3c 0 2024-02-28T16:23:57.818 INFO:tasks.workunit.client.0.smithi023.stdout:5/249: stat d1/d2a/d32/d37/f51 0 2024-02-28T16:23:57.826 INFO:tasks.workunit.client.0.smithi023.stdout:9/80: write d0/f5 [4039193,11338] 0 2024-02-28T16:23:57.833 INFO:tasks.workunit.client.0.smithi023.stdout:6/111: write d1/d18/f1d [1652026,73855] 0 2024-02-28T16:23:57.836 INFO:tasks.workunit.client.0.smithi023.stdout:0/65: dwrite f4 [0,4194304] 0 2024-02-28T16:23:57.843 INFO:tasks.workunit.client.0.smithi023.stdout:9/81: mkdir d0/d7/db/d18 0 2024-02-28T16:23:57.844 INFO:tasks.workunit.client.0.smithi023.stdout:7/84: dwrite de/f14 [0,4194304] 0 2024-02-28T16:23:57.844 INFO:tasks.workunit.client.0.smithi023.stdout:6/112: read d1/d18/f1d [98138,77956] 0 2024-02-28T16:23:57.845 INFO:tasks.workunit.client.0.smithi023.stdout:1/113: dwrite df/d11/d13/f15 [0,4194304] 0 2024-02-28T16:23:57.853 INFO:tasks.workunit.client.0.smithi023.stdout:9/82: symlink d0/d7/l19 0 2024-02-28T16:23:57.855 INFO:tasks.workunit.client.0.smithi023.stdout:7/85: fdatasync de/d13/f1f 0 2024-02-28T16:23:57.856 INFO:tasks.workunit.client.0.smithi023.stdout:1/114: symlink df/d11/l23 0 2024-02-28T16:23:57.859 INFO:tasks.workunit.client.0.smithi023.stdout:0/66: mknod d6/d13/c14 0 2024-02-28T16:23:57.866 INFO:tasks.workunit.client.0.smithi023.stdout:9/83: write d0/d7/db/f15 [577284,19135] 0 2024-02-28T16:23:57.868 INFO:tasks.workunit.client.0.smithi023.stdout:9/84: chown d0/d7/ff 1822 1 2024-02-28T16:23:57.870 INFO:tasks.workunit.client.0.smithi023.stdout:7/86: rename fa to de/d1c/f20 0 2024-02-28T16:23:57.872 INFO:tasks.workunit.client.0.smithi023.stdout:1/115: creat df/d11/d13/d1b/f24 x:0 0 0 2024-02-28T16:23:57.875 INFO:tasks.workunit.client.0.smithi023.stdout:5/250: dwrite d1/d2a/f3f [0,4194304] 0 2024-02-28T16:23:57.877 INFO:tasks.workunit.client.0.smithi023.stdout:7/87: write de/d13/f1f [193190,116162] 0 2024-02-28T16:23:57.885 INFO:tasks.workunit.client.0.smithi023.stdout:6/113: dread d1/fd [0,4194304] 0 2024-02-28T16:23:57.886 INFO:tasks.workunit.client.0.smithi023.stdout:5/251: rename d1/l3d to d1/df/l53 0 2024-02-28T16:23:57.887 INFO:tasks.workunit.client.0.smithi023.stdout:9/85: creat d0/f1a x:0 0 0 2024-02-28T16:23:57.890 INFO:tasks.workunit.client.0.smithi023.stdout:7/88: symlink de/d1c/l21 0 2024-02-28T16:23:57.891 INFO:tasks.workunit.client.0.smithi023.stdout:6/114: mkdir d1/d28/d1e/d2b 0 2024-02-28T16:23:57.897 INFO:tasks.workunit.client.0.smithi023.stdout:0/67: dwrite f4 [4194304,4194304] 0 2024-02-28T16:23:57.900 INFO:tasks.workunit.client.0.smithi023.stdout:1/116: getdents df/d11 0 2024-02-28T16:23:57.908 INFO:tasks.workunit.client.0.smithi023.stdout:9/86: symlink d0/l1b 0 2024-02-28T16:23:57.909 INFO:tasks.workunit.client.0.smithi023.stdout:6/115: dread d1/f11 [0,4194304] 0 2024-02-28T16:23:57.909 INFO:tasks.workunit.client.0.smithi023.stdout:5/252: dread d1/d2a/d32/d37/d3a/f50 [0,4194304] 0 2024-02-28T16:23:57.919 INFO:tasks.workunit.client.0.smithi023.stdout:6/116: creat d1/d18/d26/f2c x:0 0 0 2024-02-28T16:23:57.919 INFO:tasks.workunit.client.0.smithi023.stdout:7/89: rmdir de 39 2024-02-28T16:23:57.922 INFO:tasks.workunit.client.0.smithi023.stdout:5/253: unlink d1/df/l13 0 2024-02-28T16:23:57.924 INFO:tasks.workunit.client.0.smithi023.stdout:1/117: rename df/d11/c22 to df/d11/c25 0 2024-02-28T16:23:57.925 INFO:tasks.workunit.client.0.smithi023.stdout:5/254: truncate d1/d2a/d32/d37/f51 381292 0 2024-02-28T16:23:57.926 INFO:tasks.workunit.client.0.smithi023.stdout:9/87: rmdir d0/d7/de 39 2024-02-28T16:23:57.932 INFO:tasks.workunit.client.0.smithi023.stdout:6/117: write d1/f11 [2983781,96338] 0 2024-02-28T16:23:57.932 INFO:tasks.workunit.client.0.smithi023.stdout:6/118: chown d1/d28/d1e 6 1 2024-02-28T16:23:57.935 INFO:tasks.workunit.client.0.smithi023.stdout:1/118: mkdir df/d26 0 2024-02-28T16:23:57.939 INFO:tasks.workunit.client.0.smithi023.stdout:9/88: creat d0/d7/de/f1c x:0 0 0 2024-02-28T16:23:57.941 INFO:tasks.workunit.client.0.smithi023.stdout:1/119: mkdir df/d11/d13/d27 0 2024-02-28T16:23:57.943 INFO:tasks.workunit.client.0.smithi023.stdout:5/255: dwrite d1/df/f24 [0,4194304] 0 2024-02-28T16:23:57.945 INFO:tasks.workunit.client.0.smithi023.stdout:6/119: rename d1/c9 to d1/d18/d26/c2d 0 2024-02-28T16:23:57.948 INFO:tasks.workunit.client.0.smithi023.stdout:6/120: write d1/d18/d26/f2c [125170,81319] 0 2024-02-28T16:23:57.954 INFO:tasks.workunit.client.0.smithi023.stdout:5/256: rmdir d1/d2a/d32/d37 39 2024-02-28T16:23:57.955 INFO:tasks.workunit.client.0.smithi023.stdout:9/89: dread d0/d7/db/fc [0,4194304] 0 2024-02-28T16:23:57.956 INFO:tasks.workunit.client.0.smithi023.stdout:5/257: read d1/df/f2e [1423025,102168] 0 2024-02-28T16:23:57.957 INFO:tasks.workunit.client.0.smithi023.stdout:7/90: getdents de 0 2024-02-28T16:23:57.958 INFO:tasks.workunit.client.0.smithi023.stdout:5/258: chown d1/df/c10 5 1 2024-02-28T16:23:57.958 INFO:tasks.workunit.client.0.smithi023.stdout:7/91: chown de/d13/d1b/c1d 507303171 1 2024-02-28T16:23:57.962 INFO:tasks.workunit.client.0.smithi023.stdout:6/121: creat d1/d18/d26/f2e x:0 0 0 2024-02-28T16:23:57.965 INFO:tasks.workunit.client.0.smithi023.stdout:1/120: symlink df/d11/d13/d27/l28 0 2024-02-28T16:23:57.971 INFO:tasks.workunit.client.0.smithi023.stdout:9/90: fsync d0/f4 0 2024-02-28T16:23:57.973 INFO:tasks.workunit.client.0.smithi023.stdout:7/92: dwrite f4 [4194304,4194304] 0 2024-02-28T16:23:57.977 INFO:tasks.workunit.client.0.smithi023.stdout:5/259: rename d1/c22 to d1/d2a/d32/d36/c54 0 2024-02-28T16:23:57.982 INFO:tasks.workunit.client.0.smithi023.stdout:1/121: symlink df/d11/d13/d1b/l29 0 2024-02-28T16:23:57.987 INFO:tasks.workunit.client.0.smithi023.stdout:7/93: creat de/d13/f22 x:0 0 0 2024-02-28T16:23:57.988 INFO:tasks.workunit.client.0.smithi023.stdout:9/91: dwrite d0/d7/de/f1c [0,4194304] 0 2024-02-28T16:23:57.990 INFO:tasks.workunit.client.0.smithi023.stdout:5/260: creat d1/f55 x:0 0 0 2024-02-28T16:23:57.993 INFO:tasks.workunit.client.0.smithi023.stdout:5/261: chown d1/d2a 0 1 2024-02-28T16:23:57.994 INFO:tasks.workunit.client.0.smithi023.stdout:5/262: readlink d1/d2a/l2c 0 2024-02-28T16:23:57.999 INFO:tasks.workunit.client.0.smithi023.stdout:7/94: rename de/c18 to de/c23 0 2024-02-28T16:23:58.004 INFO:tasks.workunit.client.0.smithi023.stdout:1/122: creat df/d26/f2a x:0 0 0 2024-02-28T16:23:58.006 INFO:tasks.workunit.client.0.smithi023.stdout:9/92: dwrite d0/d7/de/f14 [4194304,4194304] 0 2024-02-28T16:23:58.008 INFO:tasks.workunit.client.0.smithi023.stdout:6/122: rename d1/d18/d26/f29 to d1/f2f 0 2024-02-28T16:23:58.009 INFO:tasks.workunit.client.0.smithi023.stdout:7/95: creat de/d13/d1b/f24 x:0 0 0 2024-02-28T16:23:58.010 INFO:tasks.workunit.client.0.smithi023.stdout:7/96: dread - de/d13/d1b/f24 zero size 2024-02-28T16:23:58.015 INFO:tasks.workunit.client.0.smithi023.stdout:1/123: rename df/d26/f2a to df/d11/d13/d1b/f2b 0 2024-02-28T16:23:58.017 INFO:tasks.workunit.client.0.smithi023.stdout:5/263: creat d1/d2a/f56 x:0 0 0 2024-02-28T16:23:58.020 INFO:tasks.workunit.client.0.smithi023.stdout:6/123: unlink d1/d18/d26/f2c 0 2024-02-28T16:23:58.025 INFO:tasks.workunit.client.0.smithi023.stdout:9/93: creat d0/d7/db/d18/f1d x:0 0 0 2024-02-28T16:23:58.028 INFO:tasks.workunit.client.0.smithi023.stdout:1/124: creat df/d11/d13/f2c x:0 0 0 2024-02-28T16:23:58.032 INFO:tasks.workunit.client.0.smithi023.stdout:9/94: symlink d0/d7/db/l1e 0 2024-02-28T16:23:58.036 INFO:tasks.workunit.client.0.smithi023.stdout:5/264: chown d1/df/l15 153007 1 2024-02-28T16:23:58.038 INFO:tasks.workunit.client.0.smithi023.stdout:1/125: creat df/f2d x:0 0 0 2024-02-28T16:23:58.041 INFO:tasks.workunit.client.0.smithi023.stdout:5/265: chown d1/d2a/d32/d37/d3a/d46/l52 6766067 1 2024-02-28T16:23:58.043 INFO:tasks.workunit.client.0.smithi023.stdout:1/126: write df/d11/d13/d1b/f2b [248487,55762] 0 2024-02-28T16:23:58.044 INFO:tasks.workunit.client.0.smithi023.stdout:7/97: unlink de/c23 0 2024-02-28T16:23:58.046 INFO:tasks.workunit.client.0.smithi023.stdout:9/95: rename d0/d7/de/f1c to d0/f1f 0 2024-02-28T16:23:58.047 INFO:tasks.workunit.client.0.smithi023.stdout:9/96: dread - d0/f4 zero size 2024-02-28T16:23:58.049 INFO:tasks.workunit.client.0.smithi023.stdout:7/98: creat de/d13/f25 x:0 0 0 2024-02-28T16:23:58.060 INFO:tasks.workunit.client.0.smithi023.stdout:5/266: dread d1/f19 [0,4194304] 0 2024-02-28T16:23:58.062 INFO:tasks.workunit.client.0.smithi023.stdout:1/127: dwrite df/d11/d13/f2c [0,4194304] 0 2024-02-28T16:23:58.066 INFO:tasks.workunit.client.0.smithi023.stdout:6/124: write d1/f1c [2071399,123059] 0 2024-02-28T16:23:58.076 INFO:tasks.workunit.client.0.smithi023.stdout:6/125: creat d1/d18/f30 x:0 0 0 2024-02-28T16:23:58.076 INFO:tasks.workunit.client.0.smithi023.stdout:9/97: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:23:58.078 INFO:tasks.workunit.client.0.smithi023.stdout:6/126: fsync d1/f22 0 2024-02-28T16:23:58.080 INFO:tasks.workunit.client.0.smithi023.stdout:9/98: symlink d0/d7/db/d18/l20 0 2024-02-28T16:23:58.082 INFO:tasks.workunit.client.0.smithi023.stdout:6/127: dread - d1/d28/d1e/f23 zero size 2024-02-28T16:23:58.083 INFO:tasks.workunit.client.0.smithi023.stdout:5/267: dwrite d1/f55 [0,4194304] 0 2024-02-28T16:23:58.083 INFO:tasks.workunit.client.0.smithi023.stdout:9/99: fsync d0/d7/db/f15 0 2024-02-28T16:23:58.089 INFO:tasks.workunit.client.0.smithi023.stdout:5/268: fdatasync d1/df/f2e 0 2024-02-28T16:23:58.089 INFO:tasks.workunit.client.0.smithi023.stdout:9/100: creat d0/d7/db/f21 x:0 0 0 2024-02-28T16:23:58.090 INFO:tasks.workunit.client.0.smithi023.stdout:6/128: mknod d1/d28/d1e/c31 0 2024-02-28T16:23:58.091 INFO:tasks.workunit.client.0.smithi023.stdout:1/128: dwrite f2 [4194304,4194304] 0 2024-02-28T16:23:58.093 INFO:tasks.workunit.client.0.smithi023.stdout:6/129: write d1/d28/d1e/f23 [192796,32974] 0 2024-02-28T16:23:58.094 INFO:tasks.workunit.client.0.smithi023.stdout:6/130: stat d1/fd 0 2024-02-28T16:23:58.096 INFO:tasks.workunit.client.0.smithi023.stdout:6/131: dread - d1/d18/f30 zero size 2024-02-28T16:23:58.099 INFO:tasks.workunit.client.0.smithi023.stdout:1/129: mkdir df/d11/d13/d1b/d2e 0 2024-02-28T16:23:58.101 INFO:tasks.workunit.client.0.smithi023.stdout:9/101: link d0/f1f d0/d7/db/d18/f22 0 2024-02-28T16:23:58.104 INFO:tasks.workunit.client.0.smithi023.stdout:6/132: rename d1/d28/l24 to d1/d18/d26/l32 0 2024-02-28T16:23:58.105 INFO:tasks.workunit.client.0.smithi023.stdout:5/269: dread d1/d2a/d32/d36/f43 [0,4194304] 0 2024-02-28T16:23:58.106 INFO:tasks.workunit.client.0.smithi023.stdout:1/130: creat df/d11/d13/d1b/f2f x:0 0 0 2024-02-28T16:23:58.110 INFO:tasks.workunit.client.0.smithi023.stdout:5/270: rmdir d1/d2a/d32/d37 39 2024-02-28T16:23:58.110 INFO:tasks.workunit.client.0.smithi023.stdout:6/133: symlink d1/d28/d1e/l33 0 2024-02-28T16:23:58.112 INFO:tasks.workunit.client.0.smithi023.stdout:1/131: mkdir df/d11/d13/d1b/d30 0 2024-02-28T16:23:58.114 INFO:tasks.workunit.client.0.smithi023.stdout:6/134: symlink d1/d18/l34 0 2024-02-28T16:23:58.116 INFO:tasks.workunit.client.0.smithi023.stdout:1/132: dread - df/d11/d13/d1b/f2f zero size 2024-02-28T16:23:58.118 INFO:tasks.workunit.client.0.smithi023.stdout:1/133: chown df/l20 196528 1 2024-02-28T16:23:58.119 INFO:tasks.workunit.client.0.smithi023.stdout:5/271: rename d1/f4f to d1/d2a/d32/d37/d4e/f57 0 2024-02-28T16:23:58.120 INFO:tasks.workunit.client.0.smithi023.stdout:9/102: dread d0/d7/db/d18/f22 [0,4194304] 0 2024-02-28T16:23:58.123 INFO:tasks.workunit.client.0.smithi023.stdout:1/134: symlink df/d11/d13/l31 0 2024-02-28T16:23:58.124 INFO:tasks.workunit.client.0.smithi023.stdout:1/135: dread - df/d11/f21 zero size 2024-02-28T16:23:58.125 INFO:tasks.workunit.client.0.smithi023.stdout:9/103: mkdir d0/d7/db/d18/d23 0 2024-02-28T16:23:58.125 INFO:tasks.workunit.client.0.smithi023.stdout:6/135: link d1/l13 d1/d18/d26/l35 0 2024-02-28T16:23:58.129 INFO:tasks.workunit.client.0.smithi023.stdout:9/104: creat d0/d7/db/f24 x:0 0 0 2024-02-28T16:23:58.132 INFO:tasks.workunit.client.0.smithi023.stdout:6/136: creat d1/d28/d1e/d2b/f36 x:0 0 0 2024-02-28T16:23:58.133 INFO:tasks.workunit.client.0.smithi023.stdout:9/105: write d0/d7/de/f14 [4161975,32713] 0 2024-02-28T16:23:58.136 INFO:tasks.workunit.client.0.smithi023.stdout:6/137: symlink d1/l37 0 2024-02-28T16:23:58.139 INFO:tasks.workunit.client.0.smithi023.stdout:6/138: rmdir d1/d28 39 2024-02-28T16:23:58.139 INFO:tasks.workunit.client.0.smithi023.stdout:1/136: dread f3 [0,4194304] 0 2024-02-28T16:23:58.141 INFO:tasks.workunit.client.0.smithi023.stdout:1/137: fdatasync df/d11/d13/f2c 0 2024-02-28T16:23:58.141 INFO:tasks.workunit.client.0.smithi023.stdout:6/139: creat d1/d18/d26/f38 x:0 0 0 2024-02-28T16:23:58.142 INFO:tasks.workunit.client.0.smithi023.stdout:6/140: fsync d1/f11 0 2024-02-28T16:23:58.145 INFO:tasks.workunit.client.0.smithi023.stdout:1/138: truncate df/d11/d13/d1b/f2f 499061 0 2024-02-28T16:23:58.147 INFO:tasks.workunit.client.0.smithi023.stdout:6/141: stat d1/d28/d1e/l33 0 2024-02-28T16:23:58.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:57 smithi153 ceph-mon[35341]: pgmap v30: 65 pgs: 65 active+clean; 195 MiB data, 905 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 176 op/s 2024-02-28T16:23:58.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:57 smithi153 ceph-mon[35341]: Standby manager daemon smithi023.bbebnt restarted 2024-02-28T16:23:58.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:57 smithi153 ceph-mon[35341]: Standby manager daemon smithi023.bbebnt started 2024-02-28T16:23:58.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:57 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/crt"}]: dispatch 2024-02-28T16:23:58.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:57 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:23:58.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:57 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/key"}]: dispatch 2024-02-28T16:23:58.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:57 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:23:58.149 INFO:tasks.workunit.client.0.smithi023.stdout:1/139: symlink df/d11/d13/l32 0 2024-02-28T16:23:58.155 INFO:tasks.workunit.client.0.smithi023.stdout:9/106: truncate d0/d7/db/d18/f22 3160990 0 2024-02-28T16:23:58.161 INFO:tasks.workunit.client.0.smithi023.stdout:1/140: dread f3 [0,4194304] 0 2024-02-28T16:23:58.162 INFO:tasks.workunit.client.0.smithi023.stdout:9/107: rename d0/f5 to d0/d7/db/d18/f25 0 2024-02-28T16:23:58.163 INFO:tasks.workunit.client.0.smithi023.stdout:6/142: dwrite d1/d18/d26/f38 [0,4194304] 0 2024-02-28T16:23:58.166 INFO:tasks.workunit.client.0.smithi023.stdout:9/108: creat d0/d7/de/f26 x:0 0 0 2024-02-28T16:23:58.167 INFO:tasks.workunit.client.0.smithi023.stdout:1/141: rename df/d11/d13/c18 to df/d26/c33 0 2024-02-28T16:23:58.168 INFO:tasks.workunit.client.0.smithi023.stdout:9/109: fsync d0/d7/db/f21 0 2024-02-28T16:23:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:57 smithi023 ceph-mon[29137]: pgmap v30: 65 pgs: 65 active+clean; 195 MiB data, 905 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 176 op/s 2024-02-28T16:23:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:57 smithi023 ceph-mon[29137]: Standby manager daemon smithi023.bbebnt restarted 2024-02-28T16:23:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:57 smithi023 ceph-mon[29137]: Standby manager daemon smithi023.bbebnt started 2024-02-28T16:23:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:57 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/crt"}]: dispatch 2024-02-28T16:23:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:57 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:23:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:57 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi023.bbebnt/key"}]: dispatch 2024-02-28T16:23:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:57 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:23:58.175 INFO:tasks.workunit.client.0.smithi023.stdout:1/142: rename df/d11/d13/d27/l28 to df/d26/l34 0 2024-02-28T16:23:58.179 INFO:tasks.workunit.client.0.smithi023.stdout:6/143: dread d1/fd [0,4194304] 0 2024-02-28T16:23:58.186 INFO:tasks.workunit.client.0.smithi023.stdout:1/143: dread df/d11/d13/f2c [0,4194304] 0 2024-02-28T16:23:58.188 INFO:tasks.workunit.client.0.smithi023.stdout:1/144: creat df/d26/f35 x:0 0 0 2024-02-28T16:23:58.190 INFO:tasks.workunit.client.0.smithi023.stdout:1/145: truncate df/d11/d13/d1b/f2b 310642 0 2024-02-28T16:23:58.202 INFO:tasks.workunit.client.0.smithi023.stdout:1/146: dwrite df/d11/d13/d1b/f24 [0,4194304] 0 2024-02-28T16:23:58.207 INFO:tasks.workunit.client.0.smithi023.stdout:1/147: truncate df/f16 495553 0 2024-02-28T16:23:58.210 INFO:tasks.workunit.client.0.smithi023.stdout:1/148: symlink df/d11/d13/d27/l36 0 2024-02-28T16:23:58.213 INFO:tasks.workunit.client.0.smithi023.stdout:1/149: write df/d11/d13/f14 [4355717,121165] 0 2024-02-28T16:23:58.215 INFO:tasks.workunit.client.0.smithi023.stdout:1/150: write df/d11/d13/f2c [353371,109687] 0 2024-02-28T16:23:58.218 INFO:tasks.workunit.client.0.smithi023.stdout:1/151: rename df/d11/d13/l31 to df/d26/l37 0 2024-02-28T16:23:58.223 INFO:tasks.workunit.client.0.smithi023.stdout:1/152: link df/d11/c25 df/d11/d13/c38 0 2024-02-28T16:23:58.243 INFO:tasks.workunit.client.0.smithi023.stdout:6/144: dread d1/fe [0,4194304] 0 2024-02-28T16:23:58.247 INFO:tasks.workunit.client.0.smithi023.stdout:1/153: fdatasync df/d11/d13/d1b/f24 0 2024-02-28T16:23:58.248 INFO:tasks.workunit.client.0.smithi023.stdout:6/145: rmdir d1/d28 39 2024-02-28T16:23:58.251 INFO:tasks.workunit.client.0.smithi023.stdout:1/154: unlink df/l1e 0 2024-02-28T16:23:58.253 INFO:tasks.workunit.client.0.smithi023.stdout:6/146: symlink d1/d18/d26/l39 0 2024-02-28T16:23:58.255 INFO:tasks.workunit.client.0.smithi023.stdout:1/155: creat df/d11/d13/d1b/f39 x:0 0 0 2024-02-28T16:23:58.257 INFO:tasks.workunit.client.0.smithi023.stdout:6/147: mkdir d1/d18/d26/d3a 0 2024-02-28T16:23:58.259 INFO:tasks.workunit.client.0.smithi023.stdout:1/156: symlink df/d11/d13/l3a 0 2024-02-28T16:23:58.261 INFO:tasks.workunit.client.0.smithi023.stdout:6/148: rename d1/l37 to d1/d18/d26/d3a/l3b 0 2024-02-28T16:23:58.265 INFO:tasks.workunit.client.0.smithi023.stdout:1/157: mknod df/d11/d13/d1b/d30/c3b 0 2024-02-28T16:23:58.267 INFO:tasks.workunit.client.0.smithi023.stdout:6/149: symlink d1/d28/d1e/d2b/l3c 0 2024-02-28T16:23:58.268 INFO:tasks.workunit.client.0.smithi023.stdout:1/158: creat df/d26/f3c x:0 0 0 2024-02-28T16:23:58.273 INFO:tasks.workunit.client.0.smithi023.stdout:6/150: mkdir d1/d3d 0 2024-02-28T16:23:58.277 INFO:tasks.workunit.client.0.smithi023.stdout:6/151: creat d1/d28/f3e x:0 0 0 2024-02-28T16:23:58.280 INFO:tasks.workunit.client.0.smithi023.stdout:9/110: write d0/d7/db/d18/f22 [2121109,31620] 0 2024-02-28T16:23:58.282 INFO:tasks.workunit.client.0.smithi023.stdout:9/111: truncate d0/f4 529911 0 2024-02-28T16:23:58.283 INFO:tasks.workunit.client.0.smithi023.stdout:6/152: rename d1/d18/f1d to d1/d18/d26/d3a/f3f 0 2024-02-28T16:23:58.286 INFO:tasks.workunit.client.0.smithi023.stdout:9/112: creat d0/d7/db/f27 x:0 0 0 2024-02-28T16:23:58.287 INFO:tasks.workunit.client.0.smithi023.stdout:9/113: dread - d0/d7/db/f21 zero size 2024-02-28T16:23:58.290 INFO:tasks.workunit.client.0.smithi023.stdout:6/153: creat d1/f40 x:0 0 0 2024-02-28T16:23:58.292 INFO:tasks.workunit.client.0.smithi023.stdout:6/154: chown d1/d18/d26/d3a/f3f 3861 1 2024-02-28T16:23:58.294 INFO:tasks.workunit.client.0.smithi023.stdout:6/155: write d1/d28/f3e [153924,28969] 0 2024-02-28T16:23:58.303 INFO:tasks.workunit.client.0.smithi023.stdout:9/114: dwrite d0/d7/db/f15 [0,4194304] 0 2024-02-28T16:23:58.308 INFO:tasks.workunit.client.0.smithi023.stdout:6/156: getdents d1 0 2024-02-28T16:23:58.310 INFO:tasks.workunit.client.0.smithi023.stdout:6/157: symlink d1/l41 0 2024-02-28T16:23:58.312 INFO:tasks.workunit.client.0.smithi023.stdout:6/158: dread - d1/f40 zero size 2024-02-28T16:23:58.320 INFO:tasks.workunit.client.0.smithi023.stdout:9/115: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:23:58.327 INFO:tasks.workunit.client.0.smithi023.stdout:9/116: getdents d0/d7/de 0 2024-02-28T16:23:58.330 INFO:tasks.workunit.client.0.smithi023.stdout:9/117: fdatasync d0/d7/db/f21 0 2024-02-28T16:23:58.331 INFO:tasks.workunit.client.0.smithi023.stdout:9/118: chown d0/l1b 26 1 2024-02-28T16:23:58.335 INFO:tasks.workunit.client.0.smithi023.stdout:9/119: getdents d0/d7/de 0 2024-02-28T16:23:58.338 INFO:tasks.workunit.client.0.smithi023.stdout:9/120: write d0/f1f [176603,25972] 0 2024-02-28T16:23:58.338 INFO:tasks.workunit.client.0.smithi023.stdout:6/159: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:23:58.341 INFO:tasks.workunit.client.0.smithi023.stdout:6/160: stat d1/d18/d26/l39 0 2024-02-28T16:23:58.341 INFO:tasks.workunit.client.0.smithi023.stdout:9/121: truncate d0/d7/de/f26 545648 0 2024-02-28T16:23:58.342 INFO:tasks.workunit.client.0.smithi023.stdout:6/161: fdatasync d1/d18/f30 0 2024-02-28T16:23:58.346 INFO:tasks.workunit.client.0.smithi023.stdout:6/162: mkdir d1/d18/d26/d3a/d42 0 2024-02-28T16:23:58.347 INFO:tasks.workunit.client.0.smithi023.stdout:9/122: mkdir d0/d7/db/d18/d23/d28 0 2024-02-28T16:23:58.350 INFO:tasks.workunit.client.0.smithi023.stdout:9/123: chown d0/d7/db/d18/f1d 0 1 2024-02-28T16:23:58.352 INFO:tasks.workunit.client.0.smithi023.stdout:6/163: creat d1/d28/d1e/d2b/f43 x:0 0 0 2024-02-28T16:23:58.354 INFO:tasks.workunit.client.0.smithi023.stdout:6/164: write d1/d18/f30 [967221,54934] 0 2024-02-28T16:23:58.359 INFO:tasks.workunit.client.0.smithi023.stdout:9/124: rmdir d0/d7/db/d18 39 2024-02-28T16:23:58.365 INFO:tasks.workunit.client.0.smithi023.stdout:6/165: truncate d1/f12 3578774 0 2024-02-28T16:23:58.365 INFO:tasks.workunit.client.0.smithi023.stdout:9/125: getdents d0/d7/de 0 2024-02-28T16:23:58.366 INFO:tasks.workunit.client.0.smithi023.stdout:9/126: chown d0/d7 1372 1 2024-02-28T16:23:58.368 INFO:tasks.workunit.client.0.smithi023.stdout:9/127: write d0/d7/ff [4203746,62992] 0 2024-02-28T16:23:58.373 INFO:tasks.workunit.client.0.smithi023.stdout:9/128: fdatasync d0/d7/db/d18/f25 0 2024-02-28T16:23:58.380 INFO:tasks.workunit.client.0.smithi023.stdout:6/166: dwrite d1/d18/f30 [0,4194304] 0 2024-02-28T16:23:58.383 INFO:tasks.workunit.client.0.smithi023.stdout:6/167: stat d1/cf 0 2024-02-28T16:23:58.390 INFO:tasks.workunit.client.0.smithi023.stdout:9/129: dwrite d0/d7/db/f27 [0,4194304] 0 2024-02-28T16:23:58.395 INFO:tasks.workunit.client.0.smithi023.stdout:9/130: write d0/d7/db/f27 [653908,80037] 0 2024-02-28T16:23:58.397 INFO:tasks.workunit.client.0.smithi023.stdout:6/168: dread d1/d18/d26/f38 [0,4194304] 0 2024-02-28T16:23:58.397 INFO:tasks.workunit.client.0.smithi023.stdout:9/131: readlink d0/d7/db/l1e 0 2024-02-28T16:23:58.405 INFO:tasks.workunit.client.0.smithi023.stdout:6/169: rename d1/d18/d26/d3a/d42 to d1/d28/d1e/d2b/d44 0 2024-02-28T16:23:58.407 INFO:tasks.workunit.client.0.smithi023.stdout:9/132: getdents d0/d7 0 2024-02-28T16:23:58.409 INFO:tasks.workunit.client.0.smithi023.stdout:9/133: chown d0/c17 478486 1 2024-02-28T16:23:58.411 INFO:tasks.workunit.client.0.smithi023.stdout:9/134: write d0/f1a [557076,46327] 0 2024-02-28T16:23:58.412 INFO:tasks.workunit.client.0.smithi023.stdout:6/170: rename d1/d28/d1e/f23 to d1/d3d/f45 0 2024-02-28T16:23:58.417 INFO:tasks.workunit.client.0.smithi023.stdout:6/171: unlink d1/f14 0 2024-02-28T16:23:58.418 INFO:tasks.workunit.client.0.smithi023.stdout:9/135: mknod d0/d7/db/c29 0 2024-02-28T16:23:58.420 INFO:tasks.workunit.client.0.smithi023.stdout:6/172: write d1/f16 [3241065,57754] 0 2024-02-28T16:23:58.422 INFO:tasks.workunit.client.0.smithi023.stdout:9/136: mkdir d0/d7/de/d2a 0 2024-02-28T16:23:58.435 INFO:tasks.workunit.client.0.smithi023.stdout:9/137: getdents d0/d7/db 0 2024-02-28T16:23:58.439 INFO:tasks.workunit.client.0.smithi023.stdout:6/173: dwrite d1/f1b [0,4194304] 0 2024-02-28T16:23:58.439 INFO:tasks.workunit.client.0.smithi023.stdout:9/138: symlink d0/d7/db/d18/d23/d28/l2b 0 2024-02-28T16:23:58.452 INFO:tasks.workunit.client.0.smithi023.stdout:9/139: truncate d0/f4 657776 0 2024-02-28T16:23:58.453 INFO:tasks.workunit.client.0.smithi023.stdout:9/140: chown d0/f4 44297 1 2024-02-28T16:23:58.457 INFO:tasks.workunit.client.0.smithi023.stdout:6/174: dwrite d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:23:58.460 INFO:tasks.workunit.client.0.smithi023.stdout:6/175: fdatasync d1/d18/d26/f38 0 2024-02-28T16:23:58.466 INFO:tasks.workunit.client.0.smithi023.stdout:3/71: sync 2024-02-28T16:23:58.468 INFO:tasks.workunit.client.0.smithi023.stdout:6/176: link d1/d28/f3e d1/d28/f46 0 2024-02-28T16:23:58.469 INFO:tasks.workunit.client.0.smithi023.stdout:3/72: mknod d1/df/c13 0 2024-02-28T16:23:58.472 INFO:tasks.workunit.client.0.smithi023.stdout:6/177: chown d1/c10 17 1 2024-02-28T16:23:58.474 INFO:tasks.workunit.client.0.smithi023.stdout:9/141: dwrite d0/d7/db/f15 [0,4194304] 0 2024-02-28T16:23:58.488 INFO:tasks.workunit.client.0.smithi023.stdout:3/73: truncate d1/f4 823621 0 2024-02-28T16:23:58.490 INFO:tasks.workunit.client.0.smithi023.stdout:6/178: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:23:58.492 INFO:tasks.workunit.client.0.smithi023.stdout:3/74: creat d1/dc/f14 x:0 0 0 2024-02-28T16:23:58.495 INFO:tasks.workunit.client.0.smithi023.stdout:6/179: write d1/f1c [19190,32878] 0 2024-02-28T16:23:58.497 INFO:tasks.workunit.client.0.smithi023.stdout:6/180: stat d1/f1c 0 2024-02-28T16:23:58.504 INFO:tasks.workunit.client.0.smithi023.stdout:3/75: dread d1/f9 [0,4194304] 0 2024-02-28T16:23:58.506 INFO:tasks.workunit.client.0.smithi023.stdout:9/142: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:23:58.506 INFO:tasks.workunit.client.0.smithi023.stdout:6/181: symlink d1/d18/d26/d3a/l47 0 2024-02-28T16:23:58.506 INFO:tasks.workunit.client.0.smithi023.stdout:3/76: chown d1/f9 103494 1 2024-02-28T16:23:58.506 INFO:tasks.workunit.client.0.smithi023.stdout:8/93: sync 2024-02-28T16:23:58.506 INFO:tasks.workunit.client.0.smithi023.stdout:2/76: sync 2024-02-28T16:23:58.506 INFO:tasks.workunit.client.0.smithi023.stdout:1/159: sync 2024-02-28T16:23:58.507 INFO:tasks.workunit.client.0.smithi023.stdout:0/68: sync 2024-02-28T16:23:58.507 INFO:tasks.workunit.client.0.smithi023.stdout:4/124: sync 2024-02-28T16:23:58.507 INFO:tasks.workunit.client.0.smithi023.stdout:7/99: sync 2024-02-28T16:23:58.507 INFO:tasks.workunit.client.0.smithi023.stdout:5/272: sync 2024-02-28T16:23:58.508 INFO:tasks.workunit.client.0.smithi023.stdout:6/182: fdatasync d1/f1c 0 2024-02-28T16:23:58.511 INFO:tasks.workunit.client.0.smithi023.stdout:1/160: chown df/d11/c19 145 1 2024-02-28T16:23:58.511 INFO:tasks.workunit.client.0.smithi023.stdout:0/69: write f4 [1364409,35763] 0 2024-02-28T16:23:58.512 INFO:tasks.workunit.client.0.smithi023.stdout:8/94: dread - d0/d5/d1b/f1e zero size 2024-02-28T16:23:58.518 INFO:tasks.workunit.client.0.smithi023.stdout:3/77: write d1/f9 [521924,69929] 0 2024-02-28T16:23:58.527 INFO:tasks.workunit.client.0.smithi023.stdout:6/183: unlink d1/d28/d1e/d2b/l3c 0 2024-02-28T16:23:58.530 INFO:tasks.workunit.client.0.smithi023.stdout:4/125: dread fe [0,4194304] 0 2024-02-28T16:23:58.532 INFO:tasks.workunit.client.0.smithi023.stdout:1/161: mkdir df/d11/d13/d1b/d30/d3d 0 2024-02-28T16:23:58.533 INFO:tasks.workunit.client.0.smithi023.stdout:9/143: dwrite d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:23:58.534 INFO:tasks.workunit.client.0.smithi023.stdout:3/78: read d1/f4 [102484,19152] 0 2024-02-28T16:23:58.534 INFO:tasks.workunit.client.0.smithi023.stdout:1/162: dread - df/f2d zero size 2024-02-28T16:23:58.537 INFO:tasks.workunit.client.0.smithi023.stdout:0/70: mknod d6/db/c15 0 2024-02-28T16:23:58.538 INFO:tasks.workunit.client.0.smithi023.stdout:5/273: mkdir d1/d2a/d32/d58 0 2024-02-28T16:23:58.539 INFO:tasks.workunit.client.0.smithi023.stdout:0/71: read - d6/db/fd zero size 2024-02-28T16:23:58.539 INFO:tasks.workunit.client.0.smithi023.stdout:2/77: write d5/f6 [2247116,97582] 0 2024-02-28T16:23:58.542 INFO:tasks.workunit.client.0.smithi023.stdout:6/184: mknod d1/d28/d1e/d2b/c48 0 2024-02-28T16:23:58.543 INFO:tasks.workunit.client.0.smithi023.stdout:9/144: mkdir d0/d7/d2c 0 2024-02-28T16:23:58.546 INFO:tasks.workunit.client.0.smithi023.stdout:6/185: stat d1/d28/d1e/d2b/d44 0 2024-02-28T16:23:58.548 INFO:tasks.workunit.client.0.smithi023.stdout:6/186: write d1/f16 [714796,41855] 0 2024-02-28T16:23:58.550 INFO:tasks.workunit.client.0.smithi023.stdout:1/163: creat df/d11/d13/d1b/d30/f3e x:0 0 0 2024-02-28T16:23:58.551 INFO:tasks.workunit.client.0.smithi023.stdout:7/100: dwrite fc [0,4194304] 0 2024-02-28T16:23:58.551 INFO:tasks.workunit.client.0.smithi023.stdout:8/95: creat d0/f1f x:0 0 0 2024-02-28T16:23:58.553 INFO:tasks.workunit.client.0.smithi023.stdout:0/72: chown d6/ca 31 1 2024-02-28T16:23:58.555 INFO:tasks.workunit.client.0.smithi023.stdout:4/126: dread f7 [0,4194304] 0 2024-02-28T16:23:58.557 INFO:tasks.workunit.client.0.smithi023.stdout:0/73: truncate f4 8929324 0 2024-02-28T16:23:58.558 INFO:tasks.workunit.client.0.smithi023.stdout:3/79: link d1/f9 d1/f15 0 2024-02-28T16:23:58.559 INFO:tasks.workunit.client.0.smithi023.stdout:9/145: symlink d0/d7/db/d18/d23/d28/l2d 0 2024-02-28T16:23:58.561 INFO:tasks.workunit.client.0.smithi023.stdout:0/74: write d6/db/fd [970422,2320] 0 2024-02-28T16:23:58.563 INFO:tasks.workunit.client.0.smithi023.stdout:6/187: fdatasync d1/d28/f3e 0 2024-02-28T16:23:58.567 INFO:tasks.workunit.client.0.smithi023.stdout:2/78: symlink d5/da/db/l12 0 2024-02-28T16:23:58.574 INFO:tasks.workunit.client.0.smithi023.stdout:1/164: rename df/d11/d13/d1b/f24 to df/d26/f3f 0 2024-02-28T16:23:58.575 INFO:tasks.workunit.client.0.smithi023.stdout:2/79: write f0 [4825185,92584] 0 2024-02-28T16:23:58.576 INFO:tasks.workunit.client.0.smithi023.stdout:4/127: creat d13/d1d/f25 x:0 0 0 2024-02-28T16:23:58.579 INFO:tasks.workunit.client.0.smithi023.stdout:9/146: mkdir d0/d7/de/d2e 0 2024-02-28T16:23:58.581 INFO:tasks.workunit.client.0.smithi023.stdout:5/274: creat d1/d2a/d32/d37/f59 x:0 0 0 2024-02-28T16:23:58.581 INFO:tasks.workunit.client.0.smithi023.stdout:4/128: chown d13/d1d/f20 17343554 1 2024-02-28T16:23:58.586 INFO:tasks.workunit.client.0.smithi023.stdout:5/275: stat d1/d2a/f44 0 2024-02-28T16:23:58.592 INFO:tasks.workunit.client.0.smithi023.stdout:3/80: dwrite d1/dc/f14 [0,4194304] 0 2024-02-28T16:23:58.593 INFO:tasks.workunit.client.0.smithi023.stdout:1/165: creat df/d11/d13/d1b/f40 x:0 0 0 2024-02-28T16:23:58.594 INFO:tasks.workunit.client.0.smithi023.stdout:5/276: chown d1/c28 7561 1 2024-02-28T16:23:58.596 INFO:tasks.workunit.client.0.smithi023.stdout:7/101: link f8 de/d1c/f26 0 2024-02-28T16:23:58.598 INFO:tasks.workunit.client.0.smithi023.stdout:0/75: dwrite d6/db/fd [0,4194304] 0 2024-02-28T16:23:58.601 INFO:tasks.workunit.client.0.smithi023.stdout:7/102: chown de/d13/d1b 236 1 2024-02-28T16:23:58.603 INFO:tasks.workunit.client.0.smithi023.stdout:1/166: dread - df/d26/f3c zero size 2024-02-28T16:23:58.604 INFO:tasks.workunit.client.0.smithi023.stdout:6/188: dwrite d1/f16 [4194304,4194304] 0 2024-02-28T16:23:58.605 INFO:tasks.workunit.client.0.smithi023.stdout:4/129: fsync d13/d1d/f25 0 2024-02-28T16:23:58.607 INFO:tasks.workunit.client.0.smithi023.stdout:2/80: dread f0 [0,4194304] 0 2024-02-28T16:23:58.610 INFO:tasks.workunit.client.0.smithi023.stdout:6/189: read d1/d28/f46 [173850,91124] 0 2024-02-28T16:23:58.610 INFO:tasks.workunit.client.0.smithi023.stdout:2/81: chown d5 264064017 1 2024-02-28T16:23:58.612 INFO:tasks.workunit.client.0.smithi023.stdout:4/130: write d13/d1d/f20 [676365,94078] 0 2024-02-28T16:23:58.612 INFO:tasks.workunit.client.0.smithi023.stdout:8/96: dread d0/d5/d1b/f19 [0,4194304] 0 2024-02-28T16:23:58.618 INFO:tasks.workunit.client.0.smithi023.stdout:2/82: write d5/ff [405268,114222] 0 2024-02-28T16:23:58.623 INFO:tasks.workunit.client.0.smithi023.stdout:9/147: dread d0/f4 [0,4194304] 0 2024-02-28T16:23:58.624 INFO:tasks.workunit.client.0.smithi023.stdout:3/81: rmdir d1/dc 39 2024-02-28T16:23:58.626 INFO:tasks.workunit.client.0.smithi023.stdout:1/167: creat df/d11/d13/d1b/d30/f41 x:0 0 0 2024-02-28T16:23:58.626 INFO:tasks.workunit.client.0.smithi023.stdout:5/277: truncate d1/df/f3c 72734 0 2024-02-28T16:23:58.626 INFO:tasks.workunit.client.0.smithi023.stdout:0/76: creat d6/db/f16 x:0 0 0 2024-02-28T16:23:58.629 INFO:tasks.workunit.client.0.smithi023.stdout:9/148: fdatasync d0/d7/db/d18/f1d 0 2024-02-28T16:23:58.629 INFO:tasks.workunit.client.0.smithi023.stdout:0/77: chown d6/db 69805252 1 2024-02-28T16:23:58.631 INFO:tasks.workunit.client.0.smithi023.stdout:4/131: mknod d13/d1d/c26 0 2024-02-28T16:23:58.632 INFO:tasks.workunit.client.0.smithi023.stdout:5/278: write d1/f39 [587683,83635] 0 2024-02-28T16:23:58.634 INFO:tasks.workunit.client.0.smithi023.stdout:4/132: readlink d13/l18 0 2024-02-28T16:23:58.634 INFO:tasks.workunit.client.0.smithi023.stdout:3/82: creat d1/df/f16 x:0 0 0 2024-02-28T16:23:58.635 INFO:tasks.workunit.client.0.smithi023.stdout:7/103: dread f4 [4194304,4194304] 0 2024-02-28T16:23:58.641 INFO:tasks.workunit.client.0.smithi023.stdout:1/168: rename df/d11/d13/c17 to df/d26/c42 0 2024-02-28T16:23:58.646 INFO:tasks.workunit.client.0.smithi023.stdout:6/190: dwrite d1/f1c [0,4194304] 0 2024-02-28T16:23:58.650 INFO:tasks.workunit.client.0.smithi023.stdout:6/191: write d1/d28/d1e/d2b/f36 [681391,13628] 0 2024-02-28T16:23:58.653 INFO:tasks.workunit.client.0.smithi023.stdout:0/78: fdatasync d6/f10 0 2024-02-28T16:23:58.656 INFO:tasks.workunit.client.0.smithi023.stdout:1/169: creat df/d11/d13/d1b/d30/f43 x:0 0 0 2024-02-28T16:23:58.656 INFO:tasks.workunit.client.0.smithi023.stdout:0/79: write d6/db/f16 [293576,109422] 0 2024-02-28T16:23:58.659 INFO:tasks.workunit.client.0.smithi023.stdout:4/133: dread d13/f17 [0,4194304] 0 2024-02-28T16:23:58.659 INFO:tasks.workunit.client.0.smithi023.stdout:0/80: read f4 [6830471,18379] 0 2024-02-28T16:23:58.661 INFO:tasks.workunit.client.0.smithi023.stdout:0/81: rename d6 to d6/db/d17 22 2024-02-28T16:23:58.665 INFO:tasks.workunit.client.0.smithi023.stdout:7/104: dwrite de/f14 [0,4194304] 0 2024-02-28T16:23:58.672 INFO:tasks.workunit.client.0.smithi023.stdout:9/149: mkdir d0/d7/de/d2e/d2f 0 2024-02-28T16:23:58.672 INFO:tasks.workunit.client.0.smithi023.stdout:6/192: symlink d1/d3d/l49 0 2024-02-28T16:23:58.672 INFO:tasks.workunit.client.0.smithi023.stdout:2/83: truncate f0 2310306 0 2024-02-28T16:23:58.676 INFO:tasks.workunit.client.0.smithi023.stdout:9/150: chown d0/c17 586764 1 2024-02-28T16:23:58.679 INFO:tasks.workunit.client.0.smithi023.stdout:4/134: creat d13/d1d/f27 x:0 0 0 2024-02-28T16:23:58.681 INFO:tasks.workunit.client.0.smithi023.stdout:7/105: creat de/d1c/f27 x:0 0 0 2024-02-28T16:23:58.681 INFO:tasks.workunit.client.0.smithi023.stdout:8/97: dread d0/fc [0,4194304] 0 2024-02-28T16:23:58.683 INFO:tasks.workunit.client.0.smithi023.stdout:7/106: readlink l6 0 2024-02-28T16:23:58.687 INFO:tasks.workunit.client.0.smithi023.stdout:2/84: read d5/ff [317791,126055] 0 2024-02-28T16:23:58.690 INFO:tasks.workunit.client.0.smithi023.stdout:1/170: dwrite df/d11/d13/d1b/d30/f43 [0,4194304] 0 2024-02-28T16:23:58.692 INFO:tasks.workunit.client.0.smithi023.stdout:0/82: dwrite d6/db/f16 [0,4194304] 0 2024-02-28T16:23:58.693 INFO:tasks.workunit.client.0.smithi023.stdout:8/98: fsync d0/d5/d1b/f1e 0 2024-02-28T16:23:58.697 INFO:tasks.workunit.client.0.smithi023.stdout:2/85: truncate d5/f11 4378890 0 2024-02-28T16:23:58.697 INFO:tasks.workunit.client.0.smithi023.stdout:9/151: mknod d0/d7/db/d18/d23/d28/c30 0 2024-02-28T16:23:58.698 INFO:tasks.workunit.client.0.smithi023.stdout:4/135: symlink d13/d1d/l28 0 2024-02-28T16:23:58.703 INFO:tasks.workunit.client.0.smithi023.stdout:9/152: readlink d0/d7/db/d18/d23/d28/l2b 0 2024-02-28T16:23:58.706 INFO:tasks.workunit.client.0.smithi023.stdout:9/153: stat d0/d7/db/d18/d23/d28 0 2024-02-28T16:23:58.707 INFO:tasks.workunit.client.0.smithi023.stdout:5/279: link d1/l1c d1/df/l5a 0 2024-02-28T16:23:58.708 INFO:tasks.workunit.client.0.smithi023.stdout:9/154: stat d0/d7/l19 0 2024-02-28T16:23:58.764 INFO:tasks.workunit.client.0.smithi023.stdout:0/83: readlink d6/db/lf 0 2024-02-28T16:23:58.765 INFO:tasks.workunit.client.0.smithi023.stdout:3/83: getdents d1/dc 0 2024-02-28T16:23:58.766 INFO:tasks.workunit.client.0.smithi023.stdout:2/86: mknod d5/da/c13 0 2024-02-28T16:23:58.767 INFO:tasks.workunit.client.0.smithi023.stdout:4/136: unlink f2 0 2024-02-28T16:23:58.771 INFO:tasks.workunit.client.0.smithi023.stdout:6/193: getdents d1/d3d 0 2024-02-28T16:23:58.775 INFO:tasks.workunit.client.0.smithi023.stdout:1/171: dwrite df/d11/d13/d1b/f2b [0,4194304] 0 2024-02-28T16:23:58.786 INFO:tasks.workunit.client.0.smithi023.stdout:6/194: creat d1/d18/d26/d3a/f4a x:0 0 0 2024-02-28T16:23:58.786 INFO:tasks.workunit.client.0.smithi023.stdout:9/155: mknod d0/c31 0 2024-02-28T16:23:58.786 INFO:tasks.workunit.client.0.smithi023.stdout:1/172: write df/d11/d13/f2c [4913952,98746] 0 2024-02-28T16:23:58.786 INFO:tasks.workunit.client.0.smithi023.stdout:2/87: rmdir d5 39 2024-02-28T16:23:58.786 INFO:tasks.workunit.client.0.smithi023.stdout:5/280: getdents d1/d2a 0 2024-02-28T16:23:58.791 INFO:tasks.workunit.client.0.smithi023.stdout:2/88: chown d5/da/db 247128938 1 2024-02-28T16:23:58.792 INFO:tasks.workunit.client.0.smithi023.stdout:0/84: dread f4 [0,4194304] 0 2024-02-28T16:23:58.802 INFO:tasks.workunit.client.0.smithi023.stdout:5/281: symlink d1/d2a/d32/d37/l5b 0 2024-02-28T16:23:58.803 INFO:tasks.workunit.client.0.smithi023.stdout:2/89: rename d5/l7 to d5/da/db/l14 0 2024-02-28T16:23:58.806 INFO:tasks.workunit.client.0.smithi023.stdout:4/137: truncate d13/f15 2430488 0 2024-02-28T16:23:58.813 INFO:tasks.workunit.client.0.smithi023.stdout:4/138: mknod d13/d1e/c29 0 2024-02-28T16:23:58.813 INFO:tasks.workunit.client.0.smithi023.stdout:5/282: symlink d1/d2a/d32/d37/l5c 0 2024-02-28T16:23:58.816 INFO:tasks.workunit.client.0.smithi023.stdout:9/156: dread d0/d7/db/f15 [0,4194304] 0 2024-02-28T16:23:58.816 INFO:tasks.workunit.client.0.smithi023.stdout:8/99: dread d0/d5/d1b/ff [0,4194304] 0 2024-02-28T16:23:58.817 INFO:tasks.workunit.client.0.smithi023.stdout:6/195: dwrite d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:23:58.818 INFO:tasks.workunit.client.0.smithi023.stdout:4/139: chown d13/d1d/c24 0 1 2024-02-28T16:23:58.820 INFO:tasks.workunit.client.0.smithi023.stdout:8/100: readlink d0/d5/l11 0 2024-02-28T16:23:58.820 INFO:tasks.workunit.client.0.smithi023.stdout:6/196: dread - d1/d18/d26/f2e zero size 2024-02-28T16:23:58.820 INFO:tasks.workunit.client.0.smithi023.stdout:5/283: symlink d1/d2a/l5d 0 2024-02-28T16:23:58.821 INFO:tasks.workunit.client.0.smithi023.stdout:4/140: stat fb 0 2024-02-28T16:23:58.831 INFO:tasks.workunit.client.0.smithi023.stdout:4/141: write f7 [4974117,37871] 0 2024-02-28T16:23:58.835 INFO:tasks.workunit.client.0.smithi023.stdout:8/101: write d0/d5/d1b/f1e [256445,5531] 0 2024-02-28T16:23:58.835 INFO:tasks.workunit.client.0.smithi023.stdout:2/90: dread f0 [0,4194304] 0 2024-02-28T16:23:58.839 INFO:tasks.workunit.client.0.smithi023.stdout:4/142: mknod d13/d1e/c2a 0 2024-02-28T16:23:58.839 INFO:tasks.workunit.client.0.smithi023.stdout:2/91: stat d5/ff 0 2024-02-28T16:23:58.844 INFO:tasks.workunit.client.0.smithi023.stdout:8/102: creat d0/d5/d1b/f20 x:0 0 0 2024-02-28T16:23:58.845 INFO:tasks.workunit.client.0.smithi023.stdout:0/85: dwrite f4 [4194304,4194304] 0 2024-02-28T16:23:58.846 INFO:tasks.workunit.client.0.smithi023.stdout:2/92: creat d5/da/f15 x:0 0 0 2024-02-28T16:23:58.853 INFO:tasks.workunit.client.0.smithi023.stdout:0/86: fsync d6/f10 0 2024-02-28T16:23:58.859 INFO:tasks.workunit.client.0.smithi023.stdout:0/87: read d6/db/fd [2402882,18543] 0 2024-02-28T16:23:58.859 INFO:tasks.workunit.client.0.smithi023.stdout:6/197: write d1/fb [777494,110413] 0 2024-02-28T16:23:58.862 INFO:tasks.workunit.client.0.smithi023.stdout:9/157: dwrite d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:23:58.871 INFO:tasks.workunit.client.0.smithi023.stdout:8/103: dwrite d0/d5/fd [4194304,4194304] 0 2024-02-28T16:23:58.874 INFO:tasks.workunit.client.0.smithi023.stdout:6/198: symlink d1/d18/d26/l4b 0 2024-02-28T16:23:58.876 INFO:tasks.workunit.client.0.smithi023.stdout:2/93: getdents d5/da 0 2024-02-28T16:23:58.877 INFO:tasks.workunit.client.0.smithi023.stdout:6/199: write d1/fb [560290,80021] 0 2024-02-28T16:23:58.884 INFO:tasks.workunit.client.0.smithi023.stdout:6/200: write d1/f4 [2933000,64504] 0 2024-02-28T16:23:58.886 INFO:tasks.workunit.client.0.smithi023.stdout:9/158: mkdir d0/d7/db/d18/d23/d28/d32 0 2024-02-28T16:23:58.892 INFO:tasks.workunit.client.0.smithi023.stdout:0/88: dwrite d6/db/f16 [0,4194304] 0 2024-02-28T16:23:58.894 INFO:tasks.workunit.client.0.smithi023.stdout:9/159: write d0/d7/db/d18/f1d [2597473,99796] 0 2024-02-28T16:23:58.897 INFO:tasks.workunit.client.0.smithi023.stdout:0/89: write d6/db/f16 [5063737,19804] 0 2024-02-28T16:23:58.900 INFO:tasks.workunit.client.0.smithi023.stdout:8/104: dread d0/d5/d1b/ff [0,4194304] 0 2024-02-28T16:23:58.907 INFO:tasks.workunit.client.0.smithi023.stdout:5/284: rename d1/df/l15 to d1/d2a/d32/d37/l5e 0 2024-02-28T16:23:58.913 INFO:tasks.workunit.client.0.smithi023.stdout:5/285: read d1/f40 [2604532,1820] 0 2024-02-28T16:23:58.918 INFO:tasks.workunit.client.0.smithi023.stdout:2/94: dread d5/f6 [0,4194304] 0 2024-02-28T16:23:58.920 INFO:tasks.workunit.client.0.smithi023.stdout:0/90: dwrite d6/db/f16 [0,4194304] 0 2024-02-28T16:23:58.931 INFO:tasks.workunit.client.0.smithi023.stdout:5/286: symlink d1/d2a/d32/d37/d3a/l5f 0 2024-02-28T16:23:58.933 INFO:tasks.workunit.client.0.smithi023.stdout:2/95: symlink d5/da/l16 0 2024-02-28T16:23:58.948 INFO:tasks.workunit.client.0.smithi023.stdout:2/96: mkdir d5/da/db/d17 0 2024-02-28T16:23:58.951 INFO:tasks.workunit.client.0.smithi023.stdout:6/201: link d1/d18/d26/l35 d1/d18/d26/d3a/l4c 0 2024-02-28T16:23:58.954 INFO:tasks.workunit.client.0.smithi023.stdout:8/105: truncate d0/d5/d1b/f19 1450602 0 2024-02-28T16:23:58.954 INFO:tasks.workunit.client.0.smithi023.stdout:6/202: write d1/f40 [199476,79483] 0 2024-02-28T16:23:58.957 INFO:tasks.workunit.client.0.smithi023.stdout:2/97: symlink d5/da/l18 0 2024-02-28T16:23:58.959 INFO:tasks.workunit.client.0.smithi023.stdout:5/287: dread d1/d2a/f3f [0,4194304] 0 2024-02-28T16:23:58.963 INFO:tasks.workunit.client.0.smithi023.stdout:0/91: dwrite d6/f10 [0,4194304] 0 2024-02-28T16:23:58.969 INFO:tasks.workunit.client.0.smithi023.stdout:6/203: symlink d1/l4d 0 2024-02-28T16:23:58.973 INFO:tasks.workunit.client.0.smithi023.stdout:6/204: write d1/d28/d1e/d2b/f36 [1555762,59983] 0 2024-02-28T16:23:58.980 INFO:tasks.workunit.client.0.smithi023.stdout:2/98: link d5/da/db/l12 d5/da/l19 0 2024-02-28T16:23:58.982 INFO:tasks.workunit.client.0.smithi023.stdout:0/92: dread d6/db/f16 [0,4194304] 0 2024-02-28T16:23:58.984 INFO:tasks.workunit.client.0.smithi023.stdout:6/205: rename d1/f16 to d1/d28/d1e/f4e 0 2024-02-28T16:23:58.986 INFO:tasks.workunit.client.0.smithi023.stdout:7/107: sync 2024-02-28T16:23:58.988 INFO:tasks.workunit.client.0.smithi023.stdout:0/93: mknod d6/c18 0 2024-02-28T16:23:58.993 INFO:tasks.workunit.client.0.smithi023.stdout:2/99: rename l2 to d5/da/db/l1a 0 2024-02-28T16:23:58.998 INFO:tasks.workunit.client.0.smithi023.stdout:8/106: dread d0/d5/fd [0,4194304] 0 2024-02-28T16:23:58.999 INFO:tasks.workunit.client.0.smithi023.stdout:6/206: mkdir d1/d4f 0 2024-02-28T16:23:59.001 INFO:tasks.workunit.client.0.smithi023.stdout:6/207: dread - d1/d18/d26/f2e zero size 2024-02-28T16:23:59.003 INFO:tasks.workunit.client.0.smithi023.stdout:6/208: chown d1/cf 14299 1 2024-02-28T16:23:59.009 INFO:tasks.workunit.client.0.smithi023.stdout:7/108: dwrite de/d1c/f20 [0,4194304] 0 2024-02-28T16:23:59.016 INFO:tasks.workunit.client.0.smithi023.stdout:0/94: link d6/c8 d6/db/c19 0 2024-02-28T16:23:59.019 INFO:tasks.workunit.client.0.smithi023.stdout:0/95: chown d6/db/fd 21415 1 2024-02-28T16:23:59.021 INFO:tasks.workunit.client.0.smithi023.stdout:8/107: mknod d0/d5/d1a/c21 0 2024-02-28T16:23:59.027 INFO:tasks.workunit.client.0.smithi023.stdout:6/209: dwrite d1/d18/d26/f2e [0,4194304] 0 2024-02-28T16:23:59.030 INFO:tasks.workunit.client.0.smithi023.stdout:8/108: rename d0/d5/d1a/c21 to d0/d5/d1a/c22 0 2024-02-28T16:23:59.033 INFO:tasks.workunit.client.0.smithi023.stdout:6/210: mknod d1/d18/d26/d3a/c50 0 2024-02-28T16:23:59.034 INFO:tasks.workunit.client.0.smithi023.stdout:6/211: dread - d1/d18/d26/d3a/f4a zero size 2024-02-28T16:23:59.035 INFO:tasks.workunit.client.0.smithi023.stdout:0/96: dread d6/db/f16 [0,4194304] 0 2024-02-28T16:23:59.037 INFO:tasks.workunit.client.0.smithi023.stdout:6/212: rename d1 to d1/d51 22 2024-02-28T16:23:59.042 INFO:tasks.workunit.client.0.smithi023.stdout:6/213: fdatasync d1/f22 0 2024-02-28T16:23:59.046 INFO:tasks.workunit.client.0.smithi023.stdout:6/214: write d1/d28/d1e/d2b/f43 [253500,4786] 0 2024-02-28T16:23:59.047 INFO:tasks.workunit.client.0.smithi023.stdout:2/100: write d5/ff [966131,21806] 0 2024-02-28T16:23:59.048 INFO:tasks.workunit.client.0.smithi023.stdout:8/109: dwrite d0/d5/d1b/f20 [0,4194304] 0 2024-02-28T16:23:59.051 INFO:tasks.workunit.client.0.smithi023.stdout:6/215: write d1/d18/d26/f2e [4015943,109011] 0 2024-02-28T16:23:59.056 INFO:tasks.workunit.client.0.smithi023.stdout:2/101: mkdir d5/da/d1b 0 2024-02-28T16:23:59.058 INFO:tasks.workunit.client.0.smithi023.stdout:0/97: dwrite d6/db/fd [0,4194304] 0 2024-02-28T16:23:59.061 INFO:tasks.workunit.client.0.smithi023.stdout:6/216: mkdir d1/d28/d1e/d52 0 2024-02-28T16:23:59.066 INFO:tasks.workunit.client.0.smithi023.stdout:8/110: symlink d0/l23 0 2024-02-28T16:23:59.069 INFO:tasks.workunit.client.0.smithi023.stdout:6/217: creat d1/d28/d1e/d2b/d44/f53 x:0 0 0 2024-02-28T16:23:59.077 INFO:tasks.workunit.client.0.smithi023.stdout:6/218: creat d1/d28/d1e/d2b/f54 x:0 0 0 2024-02-28T16:23:59.078 INFO:tasks.workunit.client.0.smithi023.stdout:2/102: dwrite f4 [0,4194304] 0 2024-02-28T16:23:59.081 INFO:tasks.workunit.client.0.smithi023.stdout:8/111: link d0/d5/d1b/f13 d0/d5/d1b/f24 0 2024-02-28T16:23:59.083 INFO:tasks.workunit.client.0.smithi023.stdout:6/219: unlink d1/d28/d1e/d2b/f36 0 2024-02-28T16:23:59.084 INFO:tasks.workunit.client.0.smithi023.stdout:6/220: stat d1 0 2024-02-28T16:23:59.085 INFO:tasks.workunit.client.0.smithi023.stdout:0/98: fsync d6/db/fd 0 2024-02-28T16:23:59.085 INFO:tasks.workunit.client.0.smithi023.stdout:8/112: mknod d0/d5/c25 0 2024-02-28T16:23:59.086 INFO:tasks.workunit.client.0.smithi023.stdout:0/99: chown d6/db 0 1 2024-02-28T16:23:59.087 INFO:tasks.workunit.client.0.smithi023.stdout:2/103: creat d5/f1c x:0 0 0 2024-02-28T16:23:59.088 INFO:tasks.workunit.client.0.smithi023.stdout:8/113: chown d0/l23 136832 1 2024-02-28T16:23:59.090 INFO:tasks.workunit.client.0.smithi023.stdout:0/100: mkdir d6/db/d1a 0 2024-02-28T16:23:59.093 INFO:tasks.workunit.client.0.smithi023.stdout:8/114: write d0/d5/d1b/f24 [3502348,36245] 0 2024-02-28T16:23:59.100 INFO:tasks.workunit.client.0.smithi023.stdout:8/115: creat d0/d5/f26 x:0 0 0 2024-02-28T16:23:59.102 INFO:tasks.workunit.client.0.smithi023.stdout:8/116: chown d0/f1f 2089 1 2024-02-28T16:23:59.103 INFO:tasks.workunit.client.0.smithi023.stdout:0/101: dread d6/db/f16 [0,4194304] 0 2024-02-28T16:23:59.106 INFO:tasks.workunit.client.0.smithi023.stdout:0/102: read d6/f10 [583321,89317] 0 2024-02-28T16:23:59.113 INFO:tasks.workunit.client.0.smithi023.stdout:6/221: dwrite d1/fe [0,4194304] 0 2024-02-28T16:23:59.123 INFO:tasks.workunit.client.0.smithi023.stdout:0/103: dread f4 [4194304,4194304] 0 2024-02-28T16:23:59.125 INFO:tasks.workunit.client.0.smithi023.stdout:2/104: dread d5/ff [0,4194304] 0 2024-02-28T16:23:59.126 INFO:tasks.workunit.client.0.smithi023.stdout:6/222: link d1/d28/d1e/d2b/f54 d1/d3d/f55 0 2024-02-28T16:23:59.128 INFO:tasks.workunit.client.0.smithi023.stdout:8/117: dwrite d0/f18 [8388608,4194304] 0 2024-02-28T16:23:59.132 INFO:tasks.workunit.client.0.smithi023.stdout:0/104: mkdir d6/db/d1a/d1b 0 2024-02-28T16:23:59.133 INFO:tasks.workunit.client.0.smithi023.stdout:0/105: stat d6/d13/c14 0 2024-02-28T16:23:59.135 INFO:tasks.workunit.client.0.smithi023.stdout:8/118: creat d0/d5/f27 x:0 0 0 2024-02-28T16:23:59.138 INFO:tasks.workunit.client.0.smithi023.stdout:6/223: getdents d1 0 2024-02-28T16:23:59.143 INFO:tasks.workunit.client.0.smithi023.stdout:0/106: getdents d6 0 2024-02-28T16:23:59.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:58 smithi153 ceph-mon[35341]: mgrmap e26: smithi153.qlkchp(active, since 55s), standbys: smithi023.bbebnt 2024-02-28T16:23:59.147 INFO:tasks.workunit.client.0.smithi023.stdout:8/119: link d0/d5/d1b/f24 d0/d5/f28 0 2024-02-28T16:23:59.148 INFO:tasks.workunit.client.0.smithi023.stdout:2/105: dwrite d5/f6 [0,4194304] 0 2024-02-28T16:23:59.150 INFO:tasks.workunit.client.0.smithi023.stdout:2/106: read f4 [1117132,15815] 0 2024-02-28T16:23:59.152 INFO:tasks.workunit.client.0.smithi023.stdout:2/107: stat d5/l8 0 2024-02-28T16:23:59.155 INFO:tasks.workunit.client.0.smithi023.stdout:8/120: rename d0/d5/d1b/c15 to d0/d5/d1b/c29 0 2024-02-28T16:23:59.156 INFO:tasks.workunit.client.0.smithi023.stdout:2/108: mknod d5/da/db/c1d 0 2024-02-28T16:23:59.159 INFO:tasks.workunit.client.0.smithi023.stdout:8/121: fsync d0/d5/f27 0 2024-02-28T16:23:59.159 INFO:tasks.workunit.client.0.smithi023.stdout:2/109: chown d5/f6 115901049 1 2024-02-28T16:23:59.161 INFO:tasks.workunit.client.0.smithi023.stdout:8/122: write d0/f18 [11803957,69768] 0 2024-02-28T16:23:59.161 INFO:tasks.workunit.client.0.smithi023.stdout:2/110: chown d5/f1c 61059666 1 2024-02-28T16:23:59.163 INFO:tasks.workunit.client.0.smithi023.stdout:8/123: chown d0/d5/f28 296517 1 2024-02-28T16:23:59.164 INFO:tasks.workunit.client.0.smithi023.stdout:0/107: dread f4 [0,4194304] 0 2024-02-28T16:23:59.168 INFO:tasks.workunit.client.0.smithi023.stdout:6/224: dwrite d1/f2f [0,4194304] 0 2024-02-28T16:23:59.168 INFO:tasks.workunit.client.0.smithi023.stdout:2/111: readlink d5/da/db/l12 0 2024-02-28T16:23:59.169 INFO:tasks.workunit.client.0.smithi023.stdout:2/112: dread - d5/f1c zero size 2024-02-28T16:23:59.169 INFO:tasks.workunit.client.0.smithi023.stdout:8/124: rename d0/d5/l11 to d0/d5/l2a 0 2024-02-28T16:23:59.172 INFO:tasks.workunit.client.0.smithi023.stdout:0/108: getdents d6/db/d1a/d1b 0 2024-02-28T16:23:59.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:58 smithi023 ceph-mon[29137]: mgrmap e26: smithi153.qlkchp(active, since 55s), standbys: smithi023.bbebnt 2024-02-28T16:23:59.173 INFO:tasks.workunit.client.0.smithi023.stdout:0/109: chown d6/l9 1664690951 1 2024-02-28T16:23:59.174 INFO:tasks.workunit.client.0.smithi023.stdout:6/225: symlink d1/d28/d1e/l56 0 2024-02-28T16:23:59.177 INFO:tasks.workunit.client.0.smithi023.stdout:8/125: rmdir d0/d5/d1b 39 2024-02-28T16:23:59.178 INFO:tasks.workunit.client.0.smithi023.stdout:6/226: write d1/f2f [5143068,95334] 0 2024-02-28T16:23:59.179 INFO:tasks.workunit.client.0.smithi023.stdout:0/110: mknod d6/c1c 0 2024-02-28T16:23:59.179 INFO:tasks.workunit.client.0.smithi023.stdout:0/111: readlink d6/l9 0 2024-02-28T16:23:59.182 INFO:tasks.workunit.client.0.smithi023.stdout:2/113: creat d5/da/d1b/f1e x:0 0 0 2024-02-28T16:23:59.184 INFO:tasks.workunit.client.0.smithi023.stdout:2/114: dread - d5/f1c zero size 2024-02-28T16:23:59.187 INFO:tasks.workunit.client.0.smithi023.stdout:8/126: chown d0/d5/d1b/l16 1 1 2024-02-28T16:23:59.188 INFO:tasks.workunit.client.0.smithi023.stdout:2/115: truncate d5/da/d1b/f1e 204378 0 2024-02-28T16:23:59.190 INFO:tasks.workunit.client.0.smithi023.stdout:2/116: chown d5/da 3568 1 2024-02-28T16:23:59.192 INFO:tasks.workunit.client.0.smithi023.stdout:0/112: truncate d6/db/fd 3797100 0 2024-02-28T16:23:59.194 INFO:tasks.workunit.client.0.smithi023.stdout:2/117: read d5/f11 [3498059,27181] 0 2024-02-28T16:23:59.194 INFO:tasks.workunit.client.0.smithi023.stdout:6/227: dread d1/fd [0,4194304] 0 2024-02-28T16:23:59.194 INFO:tasks.workunit.client.0.smithi023.stdout:0/113: fdatasync d6/db/f16 0 2024-02-28T16:23:59.196 INFO:tasks.workunit.client.0.smithi023.stdout:6/228: readlink d1/d3d/l49 0 2024-02-28T16:23:59.196 INFO:tasks.workunit.client.0.smithi023.stdout:0/114: chown d6/db/f16 38084291 1 2024-02-28T16:23:59.197 INFO:tasks.workunit.client.0.smithi023.stdout:2/118: dread f4 [4194304,4194304] 0 2024-02-28T16:23:59.201 INFO:tasks.workunit.client.0.smithi023.stdout:2/119: creat d5/f1f x:0 0 0 2024-02-28T16:23:59.203 INFO:tasks.workunit.client.0.smithi023.stdout:6/229: rename d1/d18/d26/d3a/c50 to d1/d28/d1e/c57 0 2024-02-28T16:23:59.205 INFO:tasks.workunit.client.0.smithi023.stdout:0/115: creat d6/db/d1a/d1b/f1d x:0 0 0 2024-02-28T16:23:59.207 INFO:tasks.workunit.client.0.smithi023.stdout:0/116: chown d6/f10 155709123 1 2024-02-28T16:23:59.207 INFO:tasks.workunit.client.0.smithi023.stdout:2/120: mkdir d5/d20 0 2024-02-28T16:23:59.207 INFO:tasks.workunit.client.0.smithi023.stdout:1/173: sync 2024-02-28T16:23:59.207 INFO:tasks.workunit.client.0.smithi023.stdout:3/84: sync 2024-02-28T16:23:59.208 INFO:tasks.workunit.client.0.smithi023.stdout:3/85: fdatasync d1/f8 0 2024-02-28T16:23:59.208 INFO:tasks.workunit.client.0.smithi023.stdout:2/121: stat d5/da/db/c1d 0 2024-02-28T16:23:59.211 INFO:tasks.workunit.client.0.smithi023.stdout:3/86: write d1/df/f16 [114813,45819] 0 2024-02-28T16:23:59.211 INFO:tasks.workunit.client.0.smithi023.stdout:1/174: unlink df/d11/d13/l3a 0 2024-02-28T16:23:59.213 INFO:tasks.workunit.client.0.smithi023.stdout:0/117: truncate d6/f10 4470289 0 2024-02-28T16:23:59.214 INFO:tasks.workunit.client.0.smithi023.stdout:3/87: truncate d1/f8 988533 0 2024-02-28T16:23:59.215 INFO:tasks.workunit.client.0.smithi023.stdout:3/88: fsync d1/f11 0 2024-02-28T16:23:59.218 INFO:tasks.workunit.client.0.smithi023.stdout:6/230: dread d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:23:59.218 INFO:tasks.workunit.client.0.smithi023.stdout:2/122: rename f0 to d5/dc/f21 0 2024-02-28T16:23:59.219 INFO:tasks.workunit.client.0.smithi023.stdout:1/175: creat df/d11/d13/d1b/f44 x:0 0 0 2024-02-28T16:23:59.224 INFO:tasks.workunit.client.0.smithi023.stdout:8/127: dread d0/d5/d1b/f24 [0,4194304] 0 2024-02-28T16:23:59.224 INFO:tasks.workunit.client.0.smithi023.stdout:0/118: unlink d6/db/cc 0 2024-02-28T16:23:59.227 INFO:tasks.workunit.client.0.smithi023.stdout:3/89: getdents d1 0 2024-02-28T16:23:59.229 INFO:tasks.workunit.client.0.smithi023.stdout:2/123: getdents d5/da/d1b 0 2024-02-28T16:23:59.231 INFO:tasks.workunit.client.0.smithi023.stdout:0/119: symlink d6/d13/l1e 0 2024-02-28T16:23:59.232 INFO:tasks.workunit.client.0.smithi023.stdout:8/128: write d0/d5/f28 [385511,45499] 0 2024-02-28T16:23:59.232 INFO:tasks.workunit.client.0.smithi023.stdout:2/124: read - d5/da/f15 zero size 2024-02-28T16:23:59.235 INFO:tasks.workunit.client.0.smithi023.stdout:3/90: dread d1/f8 [0,4194304] 0 2024-02-28T16:23:59.238 INFO:tasks.workunit.client.0.smithi023.stdout:3/91: read d1/f4 [749653,126257] 0 2024-02-28T16:23:59.242 INFO:tasks.workunit.client.0.smithi023.stdout:8/129: mknod d0/c2b 0 2024-02-28T16:23:59.243 INFO:tasks.workunit.client.0.smithi023.stdout:6/231: dwrite d1/d3d/f45 [0,4194304] 0 2024-02-28T16:23:59.248 INFO:tasks.workunit.client.0.smithi023.stdout:6/232: dread d1/d28/f3e [0,4194304] 0 2024-02-28T16:23:59.249 INFO:tasks.workunit.client.0.smithi023.stdout:0/120: truncate d6/db/fd 3385662 0 2024-02-28T16:23:59.249 INFO:tasks.workunit.client.0.smithi023.stdout:3/92: rename d1/dc/cd to d1/dc/c17 0 2024-02-28T16:23:59.250 INFO:tasks.workunit.client.0.smithi023.stdout:3/93: read d1/f8 [169256,763] 0 2024-02-28T16:23:59.255 INFO:tasks.workunit.client.0.smithi023.stdout:1/176: truncate df/d11/d13/d1b/d30/f43 1906617 0 2024-02-28T16:23:59.256 INFO:tasks.workunit.client.0.smithi023.stdout:1/177: write df/f2d [445586,117129] 0 2024-02-28T16:23:59.264 INFO:tasks.workunit.client.0.smithi023.stdout:2/125: rmdir d5/d20 0 2024-02-28T16:23:59.264 INFO:tasks.workunit.client.0.smithi023.stdout:5/288: sync 2024-02-28T16:23:59.264 INFO:tasks.workunit.client.0.smithi023.stdout:7/109: sync 2024-02-28T16:23:59.264 INFO:tasks.workunit.client.0.smithi023.stdout:4/143: sync 2024-02-28T16:23:59.264 INFO:tasks.workunit.client.0.smithi023.stdout:9/160: sync 2024-02-28T16:23:59.264 INFO:tasks.workunit.client.0.smithi023.stdout:0/121: mkdir d6/d13/d1f 0 2024-02-28T16:23:59.266 INFO:tasks.workunit.client.0.smithi023.stdout:2/126: fsync d5/f1f 0 2024-02-28T16:23:59.267 INFO:tasks.workunit.client.0.smithi023.stdout:1/178: read df/d11/d13/d1b/f2b [3755861,10493] 0 2024-02-28T16:23:59.268 INFO:tasks.workunit.client.0.smithi023.stdout:9/161: write d0/f1f [4186703,102573] 0 2024-02-28T16:23:59.270 INFO:tasks.workunit.client.0.smithi023.stdout:8/130: dwrite d0/d5/d1b/f1e [0,4194304] 0 2024-02-28T16:23:59.272 INFO:tasks.workunit.client.0.smithi023.stdout:7/110: creat de/f28 x:0 0 0 2024-02-28T16:23:59.275 INFO:tasks.workunit.client.0.smithi023.stdout:1/179: fdatasync df/d11/d13/f14 0 2024-02-28T16:23:59.278 INFO:tasks.workunit.client.0.smithi023.stdout:2/127: truncate d5/f1c 252753 0 2024-02-28T16:23:59.281 INFO:tasks.workunit.client.0.smithi023.stdout:7/111: write de/d13/f1a [979341,42574] 0 2024-02-28T16:23:59.284 INFO:tasks.workunit.client.0.smithi023.stdout:7/112: write de/d13/f22 [324685,30424] 0 2024-02-28T16:23:59.293 INFO:tasks.workunit.client.0.smithi023.stdout:4/144: dread d13/f17 [0,4194304] 0 2024-02-28T16:23:59.295 INFO:tasks.workunit.client.0.smithi023.stdout:0/122: rename d6/db/c15 to d6/d13/c20 0 2024-02-28T16:23:59.297 INFO:tasks.workunit.client.0.smithi023.stdout:9/162: symlink d0/d7/db/d18/d23/d28/l33 0 2024-02-28T16:23:59.299 INFO:tasks.workunit.client.0.smithi023.stdout:1/180: stat df/d26/l34 0 2024-02-28T16:23:59.299 INFO:tasks.workunit.client.0.smithi023.stdout:2/128: symlink d5/da/db/l22 0 2024-02-28T16:23:59.302 INFO:tasks.workunit.client.0.smithi023.stdout:7/113: symlink de/l29 0 2024-02-28T16:23:59.302 INFO:tasks.workunit.client.0.smithi023.stdout:5/289: dwrite d1/d2a/f56 [0,4194304] 0 2024-02-28T16:23:59.305 INFO:tasks.workunit.client.0.smithi023.stdout:0/123: creat d6/f21 x:0 0 0 2024-02-28T16:23:59.306 INFO:tasks.workunit.client.0.smithi023.stdout:7/114: write de/f14 [3601638,17455] 0 2024-02-28T16:23:59.307 INFO:tasks.workunit.client.0.smithi023.stdout:4/145: write fb [2559447,58919] 0 2024-02-28T16:23:59.308 INFO:tasks.workunit.client.0.smithi023.stdout:9/163: mkdir d0/d7/de/d34 0 2024-02-28T16:23:59.309 INFO:tasks.workunit.client.0.smithi023.stdout:7/115: read fc [467670,59412] 0 2024-02-28T16:23:59.311 INFO:tasks.workunit.client.0.smithi023.stdout:8/131: creat d0/f2c x:0 0 0 2024-02-28T16:23:59.313 INFO:tasks.workunit.client.0.smithi023.stdout:8/132: chown d0/d5/l1d 16 1 2024-02-28T16:23:59.317 INFO:tasks.workunit.client.0.smithi023.stdout:6/233: dread d1/f12 [0,4194304] 0 2024-02-28T16:23:59.318 INFO:tasks.workunit.client.0.smithi023.stdout:4/146: mkdir d13/d2b 0 2024-02-28T16:23:59.321 INFO:tasks.workunit.client.0.smithi023.stdout:7/116: mknod de/d13/d1b/c2a 0 2024-02-28T16:23:59.324 INFO:tasks.workunit.client.0.smithi023.stdout:8/133: mkdir d0/d5/d1a/d2d 0 2024-02-28T16:23:59.325 INFO:tasks.workunit.client.0.smithi023.stdout:5/290: mkdir d1/d2a/d32/d58/d60 0 2024-02-28T16:23:59.329 INFO:tasks.workunit.client.0.smithi023.stdout:9/164: creat d0/d7/de/d34/f35 x:0 0 0 2024-02-28T16:23:59.331 INFO:tasks.workunit.client.0.smithi023.stdout:7/117: creat de/d13/f2b x:0 0 0 2024-02-28T16:23:59.333 INFO:tasks.workunit.client.0.smithi023.stdout:8/134: creat d0/d5/d1a/f2e x:0 0 0 2024-02-28T16:23:59.334 INFO:tasks.workunit.client.0.smithi023.stdout:8/135: stat d0/f1f 0 2024-02-28T16:23:59.335 INFO:tasks.workunit.client.0.smithi023.stdout:8/136: stat d0/d5/f28 0 2024-02-28T16:23:59.337 INFO:tasks.workunit.client.0.smithi023.stdout:7/118: rmdir de/d1c 39 2024-02-28T16:23:59.339 INFO:tasks.workunit.client.0.smithi023.stdout:9/165: creat d0/d7/db/d18/d23/f36 x:0 0 0 2024-02-28T16:23:59.344 INFO:tasks.workunit.client.0.smithi023.stdout:8/137: unlink d0/d5/l2a 0 2024-02-28T16:23:59.346 INFO:tasks.workunit.client.0.smithi023.stdout:8/138: read d0/d5/f28 [753507,107056] 0 2024-02-28T16:23:59.348 INFO:tasks.workunit.client.0.smithi023.stdout:4/147: chown d13/f1b 1142304 1 2024-02-28T16:23:59.348 INFO:tasks.workunit.client.0.smithi023.stdout:1/181: truncate df/d26/f3f 2318045 0 2024-02-28T16:23:59.348 INFO:tasks.workunit.client.0.smithi023.stdout:8/139: chown d0/d5 1 1 2024-02-28T16:23:59.354 INFO:tasks.workunit.client.0.smithi023.stdout:8/140: read d0/d5/d1b/ff [3853136,74634] 0 2024-02-28T16:23:59.354 INFO:tasks.workunit.client.0.smithi023.stdout:6/234: write d1/d28/d1e/d2b/f54 [457801,19028] 0 2024-02-28T16:23:59.355 INFO:tasks.workunit.client.0.smithi023.stdout:1/182: write df/d11/d13/d1b/d30/f41 [759798,23279] 0 2024-02-28T16:23:59.358 INFO:tasks.workunit.client.0.smithi023.stdout:7/119: dwrite de/f28 [0,4194304] 0 2024-02-28T16:23:59.359 INFO:tasks.workunit.client.0.smithi023.stdout:0/124: truncate d6/db/fd 982121 0 2024-02-28T16:23:59.363 INFO:tasks.workunit.client.0.smithi023.stdout:9/166: dread d0/d7/db/f15 [0,4194304] 0 2024-02-28T16:23:59.366 INFO:tasks.workunit.client.0.smithi023.stdout:0/125: symlink d6/d13/l22 0 2024-02-28T16:23:59.367 INFO:tasks.workunit.client.0.smithi023.stdout:8/141: creat d0/d5/d1a/f2f x:0 0 0 2024-02-28T16:23:59.369 INFO:tasks.workunit.client.0.smithi023.stdout:1/183: unlink df/d11/d13/d1b/d30/f3e 0 2024-02-28T16:23:59.369 INFO:tasks.workunit.client.0.smithi023.stdout:4/148: getdents d13/d1e 0 2024-02-28T16:23:59.373 INFO:tasks.workunit.client.0.smithi023.stdout:8/142: stat d0/d5/d1b/c17 0 2024-02-28T16:23:59.373 INFO:tasks.workunit.client.0.smithi023.stdout:1/184: write f2 [4413218,118305] 0 2024-02-28T16:23:59.376 INFO:tasks.workunit.client.0.smithi023.stdout:1/185: stat df/d11/d13/d1b/d30/d3d 0 2024-02-28T16:23:59.380 INFO:tasks.workunit.client.0.smithi023.stdout:0/126: symlink d6/db/d1a/d1b/l23 0 2024-02-28T16:23:59.381 INFO:tasks.workunit.client.0.smithi023.stdout:5/291: dwrite d1/f19 [4194304,4194304] 0 2024-02-28T16:23:59.383 INFO:tasks.workunit.client.0.smithi023.stdout:7/120: truncate de/d1c/f20 3847076 0 2024-02-28T16:23:59.385 INFO:tasks.workunit.client.0.smithi023.stdout:1/186: truncate df/d11/d13/d1b/f40 634665 0 2024-02-28T16:23:59.386 INFO:tasks.workunit.client.0.smithi023.stdout:1/187: readlink lb 0 2024-02-28T16:23:59.389 INFO:tasks.workunit.client.0.smithi023.stdout:6/235: link d1/d3d/f55 d1/d18/d26/f58 0 2024-02-28T16:23:59.392 INFO:tasks.workunit.client.0.smithi023.stdout:4/149: dwrite f6 [0,4194304] 0 2024-02-28T16:23:59.394 INFO:tasks.workunit.client.0.smithi023.stdout:0/127: mkdir d6/db/d24 0 2024-02-28T16:23:59.396 INFO:tasks.workunit.client.0.smithi023.stdout:5/292: unlink d1/d2a/d32/d37/d3a/d4c/c4d 0 2024-02-28T16:23:59.397 INFO:tasks.workunit.client.0.smithi023.stdout:8/143: mkdir d0/d5/d1a/d2d/d30 0 2024-02-28T16:23:59.399 INFO:tasks.workunit.client.0.smithi023.stdout:8/144: read - d0/d5/f26 zero size 2024-02-28T16:23:59.399 INFO:tasks.workunit.client.0.smithi023.stdout:1/188: creat df/d11/f45 x:0 0 0 2024-02-28T16:23:59.403 INFO:tasks.workunit.client.0.smithi023.stdout:9/167: link d0/d7/db/l1e d0/d7/db/d18/d23/d28/l37 0 2024-02-28T16:23:59.404 INFO:tasks.workunit.client.0.smithi023.stdout:0/128: unlink d6/d13/l22 0 2024-02-28T16:23:59.405 INFO:tasks.workunit.client.0.smithi023.stdout:9/168: write d0/f1a [651188,106830] 0 2024-02-28T16:23:59.408 INFO:tasks.workunit.client.0.smithi023.stdout:4/150: mkdir d13/d2b/d2c 0 2024-02-28T16:23:59.410 INFO:tasks.workunit.client.0.smithi023.stdout:8/145: rename d0/d5/d1b/f24 to d0/d5/d1a/d2d/f31 0 2024-02-28T16:23:59.414 INFO:tasks.workunit.client.0.smithi023.stdout:0/129: creat d6/f25 x:0 0 0 2024-02-28T16:23:59.414 INFO:tasks.workunit.client.0.smithi023.stdout:8/146: fdatasync d0/fc 0 2024-02-28T16:23:59.416 INFO:tasks.workunit.client.0.smithi023.stdout:4/151: chown d13/l1a 1783188 1 2024-02-28T16:23:59.417 INFO:tasks.workunit.client.0.smithi023.stdout:9/169: rename d0/d7/db/f21 to d0/d7/de/d2a/f38 0 2024-02-28T16:23:59.419 INFO:tasks.workunit.client.0.smithi023.stdout:4/152: readlink d13/d1e/l23 0 2024-02-28T16:23:59.421 INFO:tasks.workunit.client.0.smithi023.stdout:8/147: write d0/d5/f27 [698922,33454] 0 2024-02-28T16:23:59.422 INFO:tasks.workunit.client.0.smithi023.stdout:7/121: read de/d1c/f20 [706391,121513] 0 2024-02-28T16:23:59.423 INFO:tasks.workunit.client.0.smithi023.stdout:4/153: read f5 [737183,57488] 0 2024-02-28T16:23:59.429 INFO:tasks.workunit.client.0.smithi023.stdout:1/189: dwrite df/d11/f21 [0,4194304] 0 2024-02-28T16:23:59.434 INFO:tasks.workunit.client.0.smithi023.stdout:0/130: dread d6/db/f16 [0,4194304] 0 2024-02-28T16:23:59.442 INFO:tasks.workunit.client.0.smithi023.stdout:1/190: rename df/d11/c19 to df/d11/d13/c46 0 2024-02-28T16:23:59.443 INFO:tasks.workunit.client.0.smithi023.stdout:6/236: truncate d1/d3d/f45 1254459 0 2024-02-28T16:23:59.443 INFO:tasks.workunit.client.0.smithi023.stdout:8/148: mknod d0/d5/d1a/d2d/d30/c32 0 2024-02-28T16:23:59.448 INFO:tasks.workunit.client.0.smithi023.stdout:0/131: mkdir d6/db/d1a/d26 0 2024-02-28T16:23:59.448 INFO:tasks.workunit.client.0.smithi023.stdout:4/154: dwrite f9 [0,4194304] 0 2024-02-28T16:23:59.455 INFO:tasks.workunit.client.0.smithi023.stdout:5/293: truncate d1/df/f24 2332517 0 2024-02-28T16:23:59.456 INFO:tasks.workunit.client.0.smithi023.stdout:6/237: dread d1/f4 [0,4194304] 0 2024-02-28T16:23:59.457 INFO:tasks.workunit.client.0.smithi023.stdout:8/149: creat d0/d5/d1b/f33 x:0 0 0 2024-02-28T16:23:59.459 INFO:tasks.workunit.client.0.smithi023.stdout:6/238: fdatasync d1/d18/d26/f2e 0 2024-02-28T16:23:59.459 INFO:tasks.workunit.client.0.smithi023.stdout:8/150: rename d0/d5 to d0/d5/d1a/d2d/d34 22 2024-02-28T16:23:59.461 INFO:tasks.workunit.client.0.smithi023.stdout:4/155: write d13/d1d/f27 [804588,6534] 0 2024-02-28T16:23:59.466 INFO:tasks.workunit.client.0.smithi023.stdout:5/294: symlink d1/d2a/d32/d37/d3a/d4c/l61 0 2024-02-28T16:23:59.467 INFO:tasks.workunit.client.0.smithi023.stdout:7/122: write f8 [473172,98247] 0 2024-02-28T16:23:59.470 INFO:tasks.workunit.client.0.smithi023.stdout:4/156: mkdir d13/d1d/d2d 0 2024-02-28T16:23:59.472 INFO:tasks.workunit.client.0.smithi023.stdout:9/170: mknod d0/d7/db/d18/c39 0 2024-02-28T16:23:59.472 INFO:tasks.workunit.client.0.smithi023.stdout:5/295: dread d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:23:59.473 INFO:tasks.workunit.client.0.smithi023.stdout:9/171: readlink d0/l1b 0 2024-02-28T16:23:59.474 INFO:tasks.workunit.client.0.smithi023.stdout:5/296: write d1/f55 [5162144,65797] 0 2024-02-28T16:23:59.479 INFO:tasks.workunit.client.0.smithi023.stdout:6/239: symlink d1/d4f/l59 0 2024-02-28T16:23:59.479 INFO:tasks.workunit.client.0.smithi023.stdout:5/297: dread - d1/d2a/d32/d37/f59 zero size 2024-02-28T16:23:59.481 INFO:tasks.workunit.client.0.smithi023.stdout:4/157: mkdir d13/d1d/d2e 0 2024-02-28T16:23:59.483 INFO:tasks.workunit.client.0.smithi023.stdout:1/191: getdents df/d11/d13/d1b 0 2024-02-28T16:23:59.486 INFO:tasks.workunit.client.0.smithi023.stdout:9/172: stat d0/d7/db/d18/d23/d28/l37 0 2024-02-28T16:23:59.493 INFO:tasks.workunit.client.0.smithi023.stdout:5/298: unlink d1/d2a/f56 0 2024-02-28T16:23:59.495 INFO:tasks.workunit.client.0.smithi023.stdout:5/299: write d1/df/f3c [252424,98551] 0 2024-02-28T16:23:59.498 INFO:tasks.workunit.client.0.smithi023.stdout:7/123: write fc [1509658,42074] 0 2024-02-28T16:23:59.501 INFO:tasks.workunit.client.0.smithi023.stdout:0/132: dwrite d6/f10 [4194304,4194304] 0 2024-02-28T16:23:59.502 INFO:tasks.workunit.client.0.smithi023.stdout:8/151: write d0/d5/d1b/f19 [951505,109423] 0 2024-02-28T16:23:59.503 INFO:tasks.workunit.client.0.smithi023.stdout:4/158: creat d13/d2b/d2c/f2f x:0 0 0 2024-02-28T16:23:59.503 INFO:tasks.workunit.client.0.smithi023.stdout:7/124: write de/d13/f22 [540345,103331] 0 2024-02-28T16:23:59.505 INFO:tasks.workunit.client.0.smithi023.stdout:7/125: dread - de/d13/f2b zero size 2024-02-28T16:23:59.509 INFO:tasks.workunit.client.0.smithi023.stdout:1/192: creat df/d11/d13/d1b/d30/d3d/f47 x:0 0 0 2024-02-28T16:23:59.516 INFO:tasks.workunit.client.0.smithi023.stdout:7/126: unlink de/d1c/f27 0 2024-02-28T16:23:59.517 INFO:tasks.workunit.client.0.smithi023.stdout:4/159: chown d13/l19 45483 1 2024-02-28T16:23:59.518 INFO:tasks.workunit.client.0.smithi023.stdout:9/173: link d0/c31 d0/d7/de/d2e/c3a 0 2024-02-28T16:23:59.520 INFO:tasks.workunit.client.0.smithi023.stdout:0/133: rename d6/f25 to d6/db/d1a/d1b/f27 0 2024-02-28T16:23:59.522 INFO:tasks.workunit.client.0.smithi023.stdout:6/240: getdents d1/d28/d1e 0 2024-02-28T16:23:59.524 INFO:tasks.workunit.client.0.smithi023.stdout:5/300: chown d1/d2a/d32/d36/l4a 6 1 2024-02-28T16:23:59.525 INFO:tasks.workunit.client.0.smithi023.stdout:0/134: dread - d6/db/d1a/d1b/f27 zero size 2024-02-28T16:23:59.527 INFO:tasks.workunit.client.0.smithi023.stdout:6/241: dread d1/d28/f3e [0,4194304] 0 2024-02-28T16:23:59.527 INFO:tasks.workunit.client.0.smithi023.stdout:4/160: readlink d13/l1c 0 2024-02-28T16:23:59.527 INFO:tasks.workunit.client.0.smithi023.stdout:8/152: dwrite d0/d5/d1b/f19 [0,4194304] 0 2024-02-28T16:23:59.527 INFO:tasks.workunit.client.0.smithi023.stdout:9/174: rmdir d0/d7/de/d2e 39 2024-02-28T16:23:59.530 INFO:tasks.workunit.client.0.smithi023.stdout:5/301: fsync d1/d2a/d32/d36/f3b 0 2024-02-28T16:23:59.532 INFO:tasks.workunit.client.0.smithi023.stdout:1/193: dwrite df/d11/d13/f2c [4194304,4194304] 0 2024-02-28T16:23:59.534 INFO:tasks.workunit.client.0.smithi023.stdout:3/94: sync 2024-02-28T16:23:59.536 INFO:tasks.workunit.client.0.smithi023.stdout:6/242: mknod d1/d28/c5a 0 2024-02-28T16:23:59.536 INFO:tasks.workunit.client.0.smithi023.stdout:3/95: chown d1/f4 883803833 1 2024-02-28T16:23:59.544 INFO:tasks.workunit.client.0.smithi023.stdout:5/302: stat d1/d2a/f3f 0 2024-02-28T16:23:59.544 INFO:tasks.workunit.client.0.smithi023.stdout:7/127: getdents de 0 2024-02-28T16:23:59.544 INFO:tasks.workunit.client.0.smithi023.stdout:1/194: write df/d26/f3c [409793,59308] 0 2024-02-28T16:23:59.544 INFO:tasks.workunit.client.0.smithi023.stdout:9/175: rename d0/f1a to d0/d7/de/d34/f3b 0 2024-02-28T16:23:59.558 INFO:tasks.workunit.client.0.smithi023.stdout:0/135: dread d6/f10 [4194304,4194304] 0 2024-02-28T16:23:59.558 INFO:tasks.workunit.client.0.smithi023.stdout:7/128: symlink de/d13/l2c 0 2024-02-28T16:23:59.561 INFO:tasks.workunit.client.0.smithi023.stdout:1/195: mkdir df/d26/d48 0 2024-02-28T16:23:59.568 INFO:tasks.workunit.client.0.smithi023.stdout:7/129: unlink de/f28 0 2024-02-28T16:23:59.569 INFO:tasks.workunit.client.0.smithi023.stdout:0/136: write d6/db/f16 [5976710,13694] 0 2024-02-28T16:23:59.569 INFO:tasks.workunit.client.0.smithi023.stdout:9/176: mkdir d0/d7/db/d18/d23/d28/d32/d3c 0 2024-02-28T16:23:59.570 INFO:tasks.workunit.client.0.smithi023.stdout:4/161: dwrite f5 [0,4194304] 0 2024-02-28T16:23:59.571 INFO:tasks.workunit.client.0.smithi023.stdout:3/96: dread d1/dc/f14 [0,4194304] 0 2024-02-28T16:23:59.571 INFO:tasks.workunit.client.0.smithi023.stdout:8/153: dread d0/d5/d1b/f19 [0,4194304] 0 2024-02-28T16:23:59.576 INFO:tasks.workunit.client.0.smithi023.stdout:6/243: dwrite d1/fd [0,4194304] 0 2024-02-28T16:23:59.578 INFO:tasks.workunit.client.0.smithi023.stdout:1/196: symlink df/d11/d13/d1b/d30/l49 0 2024-02-28T16:23:59.578 INFO:tasks.workunit.client.0.smithi023.stdout:3/97: dread d1/f4 [0,4194304] 0 2024-02-28T16:23:59.583 INFO:tasks.workunit.client.0.smithi023.stdout:4/162: creat d13/d2b/d2c/f30 x:0 0 0 2024-02-28T16:23:59.585 INFO:tasks.workunit.client.0.smithi023.stdout:5/303: write d1/d2a/d32/d37/f51 [1155556,20438] 0 2024-02-28T16:23:59.591 INFO:tasks.workunit.client.0.smithi023.stdout:2/129: sync 2024-02-28T16:23:59.592 INFO:tasks.workunit.client.0.smithi023.stdout:3/98: rename d1/df/c13 to d1/df/c18 0 2024-02-28T16:23:59.592 INFO:tasks.workunit.client.0.smithi023.stdout:0/137: write d6/db/d1a/d1b/f27 [325051,43471] 0 2024-02-28T16:23:59.596 INFO:tasks.workunit.client.0.smithi023.stdout:4/163: stat d13/f15 0 2024-02-28T16:23:59.601 INFO:tasks.workunit.client.0.smithi023.stdout:9/177: creat d0/f3d x:0 0 0 2024-02-28T16:23:59.605 INFO:tasks.workunit.client.0.smithi023.stdout:2/130: write d5/ff [703244,39911] 0 2024-02-28T16:23:59.606 INFO:tasks.workunit.client.0.smithi023.stdout:3/99: rename d1/f15 to d1/df/f19 0 2024-02-28T16:23:59.609 INFO:tasks.workunit.client.0.smithi023.stdout:1/197: dwrite df/d11/d13/d1b/f39 [0,4194304] 0 2024-02-28T16:23:59.612 INFO:tasks.workunit.client.0.smithi023.stdout:2/131: creat d5/da/db/f23 x:0 0 0 2024-02-28T16:23:59.624 INFO:tasks.workunit.client.0.smithi023.stdout:6/244: dread d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:23:59.638 INFO:tasks.workunit.client.0.smithi023.stdout:1/198: symlink df/d26/d48/l4a 0 2024-02-28T16:23:59.644 INFO:tasks.workunit.client.0.smithi023.stdout:0/138: dwrite d6/db/d1a/d1b/f27 [0,4194304] 0 2024-02-28T16:23:59.648 INFO:tasks.workunit.client.0.smithi023.stdout:4/164: dwrite d13/d2b/d2c/f2f [0,4194304] 0 2024-02-28T16:23:59.649 INFO:tasks.workunit.client.0.smithi023.stdout:8/154: dwrite d0/d5/d1a/d2d/f31 [4194304,4194304] 0 2024-02-28T16:23:59.651 INFO:tasks.workunit.client.0.smithi023.stdout:1/199: stat df/d11/d13/f14 0 2024-02-28T16:23:59.656 INFO:tasks.workunit.client.0.smithi023.stdout:5/304: dwrite d1/d2a/d32/d36/f43 [0,4194304] 0 2024-02-28T16:23:59.661 INFO:tasks.workunit.client.0.smithi023.stdout:3/100: truncate d1/dc/f14 5218419 0 2024-02-28T16:23:59.666 INFO:tasks.workunit.client.0.smithi023.stdout:0/139: creat d6/d13/f28 x:0 0 0 2024-02-28T16:23:59.674 INFO:tasks.workunit.client.0.smithi023.stdout:8/155: rmdir d0/d5/d1a/d2d 39 2024-02-28T16:23:59.675 INFO:tasks.workunit.client.0.smithi023.stdout:9/178: dread d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:23:59.677 INFO:tasks.workunit.client.0.smithi023.stdout:4/165: mkdir d13/d2b/d2c/d31 0 2024-02-28T16:23:59.677 INFO:tasks.workunit.client.0.smithi023.stdout:0/140: write d6/db/d1a/d1b/f1d [945246,99128] 0 2024-02-28T16:23:59.681 INFO:tasks.workunit.client.0.smithi023.stdout:2/132: dread d5/dc/f21 [0,4194304] 0 2024-02-28T16:23:59.683 INFO:tasks.workunit.client.0.smithi023.stdout:1/200: creat df/d11/d13/d1b/d30/f4b x:0 0 0 2024-02-28T16:23:59.684 INFO:tasks.workunit.client.0.smithi023.stdout:6/245: dwrite d1/f15 [0,4194304] 0 2024-02-28T16:23:59.684 INFO:tasks.workunit.client.0.smithi023.stdout:2/133: stat d5/da/c13 0 2024-02-28T16:23:59.691 INFO:tasks.workunit.client.0.smithi023.stdout:9/179: rmdir d0/d7/de/d2a 39 2024-02-28T16:23:59.692 INFO:tasks.workunit.client.0.smithi023.stdout:7/130: dread de/ff [0,4194304] 0 2024-02-28T16:23:59.695 INFO:tasks.workunit.client.0.smithi023.stdout:0/141: mknod d6/d13/c29 0 2024-02-28T16:23:59.695 INFO:tasks.workunit.client.0.smithi023.stdout:4/166: dread d13/d1d/f27 [0,4194304] 0 2024-02-28T16:23:59.696 INFO:tasks.workunit.client.0.smithi023.stdout:9/180: stat d0/d7/db/d18/f25 0 2024-02-28T16:23:59.701 INFO:tasks.workunit.client.0.smithi023.stdout:0/142: write d6/d13/f28 [651304,78209] 0 2024-02-28T16:23:59.702 INFO:tasks.workunit.client.0.smithi023.stdout:9/181: rename d0/d7/db/d18 to d0/d7/db/d18/d23/d3e 22 2024-02-28T16:23:59.702 INFO:tasks.workunit.client.0.smithi023.stdout:3/101: write d1/df/f19 [1699496,13784] 0 2024-02-28T16:23:59.706 INFO:tasks.workunit.client.0.smithi023.stdout:9/182: write d0/f1f [4322014,72031] 0 2024-02-28T16:23:59.708 INFO:tasks.workunit.client.0.smithi023.stdout:7/131: chown de/c16 56 1 2024-02-28T16:23:59.708 INFO:tasks.workunit.client.0.smithi023.stdout:5/305: dwrite d1/df/f25 [0,4194304] 0 2024-02-28T16:23:59.710 INFO:tasks.workunit.client.0.smithi023.stdout:1/201: link f3 df/d26/d48/f4c 0 2024-02-28T16:23:59.710 INFO:tasks.workunit.client.0.smithi023.stdout:6/246: dread d1/f12 [0,4194304] 0 2024-02-28T16:23:59.713 INFO:tasks.workunit.client.0.smithi023.stdout:1/202: write df/d11/d13/d1b/f39 [3708581,44652] 0 2024-02-28T16:23:59.715 INFO:tasks.workunit.client.0.smithi023.stdout:2/134: getdents d5/da/d1b 0 2024-02-28T16:23:59.722 INFO:tasks.workunit.client.0.smithi023.stdout:0/143: rename d6/l9 to d6/d13/d1f/l2a 0 2024-02-28T16:23:59.723 INFO:tasks.workunit.client.0.smithi023.stdout:8/156: truncate d0/d5/fd 5522167 0 2024-02-28T16:23:59.727 INFO:tasks.workunit.client.0.smithi023.stdout:7/132: write de/d1c/f20 [2010436,21422] 0 2024-02-28T16:23:59.738 INFO:tasks.workunit.client.0.smithi023.stdout:2/135: dwrite d5/da/f15 [0,4194304] 0 2024-02-28T16:23:59.747 INFO:tasks.workunit.client.0.smithi023.stdout:6/247: rename d1/d18/d26/f2e to d1/d28/d1e/d52/f5b 0 2024-02-28T16:23:59.753 INFO:tasks.workunit.client.0.smithi023.stdout:3/102: write d1/f8 [59423,65258] 0 2024-02-28T16:23:59.754 INFO:tasks.workunit.client.0.smithi023.stdout:6/248: chown d1/f22 3706258 1 2024-02-28T16:23:59.754 INFO:tasks.workunit.client.0.smithi023.stdout:4/167: link ld d13/d1d/d2d/l32 0 2024-02-28T16:23:59.758 INFO:tasks.workunit.client.0.smithi023.stdout:5/306: mkdir d1/df/d62 0 2024-02-28T16:23:59.760 INFO:tasks.workunit.client.0.smithi023.stdout:9/183: write d0/d7/de/d2a/f38 [840666,127360] 0 2024-02-28T16:23:59.760 INFO:tasks.workunit.client.0.smithi023.stdout:1/203: getdents df/d11/d13/d1b/d2e 0 2024-02-28T16:23:59.766 INFO:tasks.workunit.client.0.smithi023.stdout:2/136: creat d5/dc/f24 x:0 0 0 2024-02-28T16:23:59.767 INFO:tasks.workunit.client.0.smithi023.stdout:6/249: write d1/fd [1748342,56726] 0 2024-02-28T16:23:59.772 INFO:tasks.workunit.client.0.smithi023.stdout:8/157: dwrite d0/d5/d1a/d2d/f31 [4194304,4194304] 0 2024-02-28T16:23:59.774 INFO:tasks.workunit.client.0.smithi023.stdout:3/103: truncate d1/df/f16 255489 0 2024-02-28T16:23:59.778 INFO:tasks.workunit.client.0.smithi023.stdout:0/144: dwrite f4 [0,4194304] 0 2024-02-28T16:23:59.778 INFO:tasks.workunit.client.0.smithi023.stdout:5/307: dread d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:23:59.782 INFO:tasks.workunit.client.0.smithi023.stdout:5/308: stat d1/d2a/d32 0 2024-02-28T16:23:59.782 INFO:tasks.workunit.client.0.smithi023.stdout:2/137: write d5/f1f [669512,6369] 0 2024-02-28T16:23:59.785 INFO:tasks.workunit.client.0.smithi023.stdout:6/250: mknod d1/d18/d26/c5c 0 2024-02-28T16:23:59.791 INFO:tasks.workunit.client.0.smithi023.stdout:1/204: mknod df/d11/d13/d1b/d2e/c4d 0 2024-02-28T16:23:59.792 INFO:tasks.workunit.client.0.smithi023.stdout:4/168: dread f5 [0,4194304] 0 2024-02-28T16:23:59.792 INFO:tasks.workunit.client.0.smithi023.stdout:5/309: fsync d1/d2a/d32/d36/f43 0 2024-02-28T16:23:59.793 INFO:tasks.workunit.client.0.smithi023.stdout:4/169: stat d13/d1d 0 2024-02-28T16:23:59.795 INFO:tasks.workunit.client.0.smithi023.stdout:7/133: dwrite de/d13/f1a [0,4194304] 0 2024-02-28T16:23:59.796 INFO:tasks.workunit.client.0.smithi023.stdout:3/104: mknod d1/c1a 0 2024-02-28T16:23:59.800 INFO:tasks.workunit.client.0.smithi023.stdout:8/158: mkdir d0/d5/d35 0 2024-02-28T16:23:59.801 INFO:tasks.workunit.client.0.smithi023.stdout:5/310: dread - d1/d2a/d32/d37/d4e/f57 zero size 2024-02-28T16:23:59.802 INFO:tasks.workunit.client.0.smithi023.stdout:3/105: stat d1/f9 0 2024-02-28T16:23:59.804 INFO:tasks.workunit.client.0.smithi023.stdout:9/184: dread d0/d7/de/d34/f3b [0,4194304] 0 2024-02-28T16:23:59.809 INFO:tasks.workunit.client.0.smithi023.stdout:1/205: creat df/d11/d13/d1b/d30/d3d/f4e x:0 0 0 2024-02-28T16:23:59.809 INFO:tasks.workunit.client.0.smithi023.stdout:7/134: chown de/d13/f1f 17 1 2024-02-28T16:23:59.809 INFO:tasks.workunit.client.0.smithi023.stdout:5/311: stat d1/d2a/l31 0 2024-02-28T16:23:59.815 INFO:tasks.workunit.client.0.smithi023.stdout:8/159: mkdir d0/d5/d1b/d36 0 2024-02-28T16:23:59.819 INFO:tasks.workunit.client.0.smithi023.stdout:8/160: fsync d0/f1f 0 2024-02-28T16:23:59.824 INFO:tasks.workunit.client.0.smithi023.stdout:0/145: dread d6/db/d1a/d1b/f27 [0,4194304] 0 2024-02-28T16:23:59.825 INFO:tasks.workunit.client.0.smithi023.stdout:9/185: unlink d0/d7/db/d18/d23/f36 0 2024-02-28T16:23:59.828 INFO:tasks.workunit.client.0.smithi023.stdout:2/138: dwrite d5/da/d1b/f1e [0,4194304] 0 2024-02-28T16:23:59.830 INFO:tasks.workunit.client.0.smithi023.stdout:3/106: dread d1/f4 [0,4194304] 0 2024-02-28T16:23:59.835 INFO:tasks.workunit.client.0.smithi023.stdout:1/206: symlink df/d11/d13/d1b/d2e/l4f 0 2024-02-28T16:23:59.840 INFO:tasks.workunit.client.0.smithi023.stdout:6/251: dwrite d1/fe [0,4194304] 0 2024-02-28T16:23:59.840 INFO:tasks.workunit.client.0.smithi023.stdout:1/207: read f4 [624752,69431] 0 2024-02-28T16:23:59.840 INFO:tasks.workunit.client.0.smithi023.stdout:5/312: symlink d1/d2a/d32/l63 0 2024-02-28T16:23:59.848 INFO:tasks.workunit.client.0.smithi023.stdout:6/252: chown d1/fd 590 1 2024-02-28T16:23:59.858 INFO:tasks.workunit.client.0.smithi023.stdout:8/161: rename d0/c14 to d0/d5/c37 0 2024-02-28T16:23:59.859 INFO:tasks.workunit.client.0.smithi023.stdout:1/208: unlink df/d26/d48/l4a 0 2024-02-28T16:23:59.863 INFO:tasks.workunit.client.0.smithi023.stdout:4/170: truncate d13/f1b 2816248 0 2024-02-28T16:23:59.866 INFO:tasks.workunit.client.0.smithi023.stdout:7/135: dwrite de/ff [0,4194304] 0 2024-02-28T16:23:59.866 INFO:tasks.workunit.client.0.smithi023.stdout:6/253: dread - d1/d28/d1e/d2b/d44/f53 zero size 2024-02-28T16:23:59.870 INFO:tasks.workunit.client.0.smithi023.stdout:9/186: rename d0/f3d to d0/d7/db/d18/d23/d28/d32/f3f 0 2024-02-28T16:23:59.872 INFO:tasks.workunit.client.0.smithi023.stdout:0/146: dread f4 [0,4194304] 0 2024-02-28T16:23:59.874 INFO:tasks.workunit.client.0.smithi023.stdout:2/139: dread d5/f11 [0,4194304] 0 2024-02-28T16:23:59.876 INFO:tasks.workunit.client.0.smithi023.stdout:5/313: dread d1/d2a/d32/d36/f3b [0,4194304] 0 2024-02-28T16:23:59.876 INFO:tasks.workunit.client.0.smithi023.stdout:9/187: stat d0/d7/db/d18/d23/d28/c30 0 2024-02-28T16:23:59.878 INFO:tasks.workunit.client.0.smithi023.stdout:2/140: fdatasync d5/da/db/f23 0 2024-02-28T16:23:59.883 INFO:tasks.workunit.client.0.smithi023.stdout:6/254: unlink d1/d28/c2a 0 2024-02-28T16:23:59.883 INFO:tasks.workunit.client.0.smithi023.stdout:3/107: dwrite d1/df/f19 [0,4194304] 0 2024-02-28T16:23:59.886 INFO:tasks.workunit.client.0.smithi023.stdout:5/314: mknod d1/d2a/d32/d36/c64 0 2024-02-28T16:23:59.887 INFO:tasks.workunit.client.0.smithi023.stdout:2/141: rmdir d5 39 2024-02-28T16:23:59.890 INFO:tasks.workunit.client.0.smithi023.stdout:0/147: mknod d6/d13/d1f/c2b 0 2024-02-28T16:23:59.890 INFO:tasks.workunit.client.0.smithi023.stdout:1/209: dread df/d11/f12 [0,4194304] 0 2024-02-28T16:23:59.890 INFO:tasks.workunit.client.0.smithi023.stdout:6/255: mknod d1/d18/c5d 0 2024-02-28T16:23:59.892 INFO:tasks.workunit.client.0.smithi023.stdout:3/108: fdatasync d1/f11 0 2024-02-28T16:23:59.900 INFO:tasks.workunit.client.0.smithi023.stdout:5/315: read d1/d2a/d32/d37/d3a/f48 [1824027,4562] 0 2024-02-28T16:23:59.901 INFO:tasks.workunit.client.0.smithi023.stdout:0/148: mknod d6/d13/c2c 0 2024-02-28T16:23:59.921 INFO:tasks.workunit.client.0.smithi023.stdout:3/109: dwrite d1/df/f16 [0,4194304] 0 2024-02-28T16:23:59.922 INFO:tasks.workunit.client.0.smithi023.stdout:2/142: rename d5/da/db/l12 to d5/dc/l25 0 2024-02-28T16:23:59.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:23:59 smithi023 ceph-mon[29137]: pgmap v31: 65 pgs: 65 active+clean; 478 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 48 MiB/s wr, 263 op/s 2024-02-28T16:23:59.927 INFO:tasks.workunit.client.0.smithi023.stdout:3/110: read d1/f11 [3439535,5645] 0 2024-02-28T16:23:59.930 INFO:tasks.workunit.client.0.smithi023.stdout:8/162: write d0/f18 [5227923,51295] 0 2024-02-28T16:23:59.933 INFO:tasks.workunit.client.0.smithi023.stdout:9/188: dread d0/d7/de/f14 [0,4194304] 0 2024-02-28T16:23:59.935 INFO:tasks.workunit.client.0.smithi023.stdout:8/163: truncate d0/d5/d1a/f2f 189013 0 2024-02-28T16:23:59.935 INFO:tasks.workunit.client.0.smithi023.stdout:9/189: fdatasync d0/f1f 0 2024-02-28T16:23:59.944 INFO:tasks.workunit.client.0.smithi023.stdout:5/316: mknod d1/d2a/d32/d37/d3a/d4c/c65 0 2024-02-28T16:23:59.947 INFO:tasks.workunit.client.0.smithi023.stdout:2/143: creat d5/da/d1b/f26 x:0 0 0 2024-02-28T16:23:59.948 INFO:tasks.workunit.client.0.smithi023.stdout:2/144: dread - d5/da/db/f23 zero size 2024-02-28T16:23:59.950 INFO:tasks.workunit.client.0.smithi023.stdout:2/145: chown f4 9 1 2024-02-28T16:23:59.952 INFO:tasks.workunit.client.0.smithi023.stdout:6/256: write d1/d28/f3e [731792,19681] 0 2024-02-28T16:23:59.956 INFO:tasks.workunit.client.0.smithi023.stdout:9/190: mknod d0/d7/de/d34/c40 0 2024-02-28T16:23:59.957 INFO:tasks.workunit.client.0.smithi023.stdout:0/149: dwrite f4 [0,4194304] 0 2024-02-28T16:23:59.959 INFO:tasks.workunit.client.0.smithi023.stdout:9/191: write d0/d7/db/d18/f22 [4233598,36537] 0 2024-02-28T16:23:59.961 INFO:tasks.workunit.client.0.smithi023.stdout:5/317: creat d1/d2a/d32/d36/f66 x:0 0 0 2024-02-28T16:23:59.961 INFO:tasks.workunit.client.0.smithi023.stdout:9/192: chown d0/d7/d2c 1 1 2024-02-28T16:23:59.962 INFO:tasks.workunit.client.0.smithi023.stdout:5/318: fdatasync d1/d2a/d32/d37/f38 0 2024-02-28T16:23:59.968 INFO:tasks.workunit.client.0.smithi023.stdout:6/257: unlink d1/f15 0 2024-02-28T16:23:59.969 INFO:tasks.workunit.client.0.smithi023.stdout:6/258: stat d1/d28/f46 0 2024-02-28T16:23:59.974 INFO:tasks.workunit.client.0.smithi023.stdout:0/150: creat d6/db/f2d x:0 0 0 2024-02-28T16:23:59.975 INFO:tasks.workunit.client.0.smithi023.stdout:1/210: getdents df/d11/d13/d1b/d2e 0 2024-02-28T16:23:59.985 INFO:tasks.workunit.client.0.smithi023.stdout:6/259: creat d1/d18/d26/d3a/f5e x:0 0 0 2024-02-28T16:23:59.987 INFO:tasks.workunit.client.0.smithi023.stdout:9/193: dread d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:23:59.987 INFO:tasks.workunit.client.0.smithi023.stdout:6/260: truncate d1/f40 1214124 0 2024-02-28T16:23:59.989 INFO:tasks.workunit.client.0.smithi023.stdout:0/151: rmdir d6/d13/d1f 39 2024-02-28T16:23:59.990 INFO:tasks.workunit.client.0.smithi023.stdout:1/211: fsync f3 0 2024-02-28T16:23:59.993 INFO:tasks.workunit.client.0.smithi023.stdout:0/152: chown d6/c1c 3098 1 2024-02-28T16:23:59.993 INFO:tasks.workunit.client.0.smithi023.stdout:9/194: fdatasync d0/d7/db/d18/f22 0 2024-02-28T16:23:59.993 INFO:tasks.workunit.client.0.smithi023.stdout:5/319: dwrite d1/f55 [0,4194304] 0 2024-02-28T16:23:59.993 INFO:tasks.workunit.client.0.smithi023.stdout:2/146: write f4 [1156667,5799] 0 2024-02-28T16:23:59.995 INFO:tasks.workunit.client.0.smithi023.stdout:8/164: getdents d0/d5/d1a/d2d 0 2024-02-28T16:23:59.997 INFO:tasks.workunit.client.0.smithi023.stdout:3/111: truncate d1/df/f16 1199086 0 2024-02-28T16:24:00.000 INFO:tasks.workunit.client.0.smithi023.stdout:6/261: creat d1/d28/f5f x:0 0 0 2024-02-28T16:24:00.001 INFO:tasks.workunit.client.0.smithi023.stdout:8/165: write d0/d5/d1a/f2e [747634,84111] 0 2024-02-28T16:24:00.004 INFO:tasks.workunit.client.0.smithi023.stdout:8/166: write d0/fc [1973152,121017] 0 2024-02-28T16:24:00.012 INFO:tasks.workunit.client.0.smithi023.stdout:2/147: dread f4 [0,4194304] 0 2024-02-28T16:24:00.013 INFO:tasks.workunit.client.0.smithi023.stdout:0/153: mkdir d6/db/d1a/d2e 0 2024-02-28T16:24:00.015 INFO:tasks.workunit.client.0.smithi023.stdout:0/154: write d6/d13/f28 [520293,79819] 0 2024-02-28T16:24:00.017 INFO:tasks.workunit.client.0.smithi023.stdout:1/212: creat df/d11/d13/d1b/d30/d3d/f50 x:0 0 0 2024-02-28T16:24:00.019 INFO:tasks.workunit.client.0.smithi023.stdout:5/320: unlink d1/d2a/d32/d36/f3b 0 2024-02-28T16:24:00.020 INFO:tasks.workunit.client.0.smithi023.stdout:5/321: read d1/f39 [590289,69492] 0 2024-02-28T16:24:00.028 INFO:tasks.workunit.client.0.smithi023.stdout:6/262: symlink d1/d28/l60 0 2024-02-28T16:24:00.042 INFO:tasks.workunit.client.0.smithi023.stdout:3/112: rename d1/f9 to d1/dc/f1b 0 2024-02-28T16:24:00.043 INFO:tasks.workunit.client.0.smithi023.stdout:5/322: write d1/d2a/d32/d37/f51 [1641168,75615] 0 2024-02-28T16:24:00.046 INFO:tasks.workunit.client.0.smithi023.stdout:5/323: read d1/d2a/d32/d36/f43 [1575295,95044] 0 2024-02-28T16:24:00.047 INFO:tasks.workunit.client.0.smithi023.stdout:6/263: symlink d1/d18/l61 0 2024-02-28T16:24:00.049 INFO:tasks.workunit.client.0.smithi023.stdout:2/148: creat d5/da/db/d17/f27 x:0 0 0 2024-02-28T16:24:00.050 INFO:tasks.workunit.client.0.smithi023.stdout:0/155: creat d6/db/d1a/d2e/f2f x:0 0 0 2024-02-28T16:24:00.052 INFO:tasks.workunit.client.0.smithi023.stdout:0/156: write d6/d13/f28 [1205329,61801] 0 2024-02-28T16:24:00.059 INFO:tasks.workunit.client.0.smithi023.stdout:6/264: creat d1/d28/f62 x:0 0 0 2024-02-28T16:24:00.062 INFO:tasks.workunit.client.0.smithi023.stdout:1/213: link df/d26/l34 df/d11/d13/l51 0 2024-02-28T16:24:00.063 INFO:tasks.workunit.client.0.smithi023.stdout:1/214: chown df/d26/f35 20 1 2024-02-28T16:24:00.064 INFO:tasks.workunit.client.0.smithi023.stdout:5/324: dread d1/f39 [0,4194304] 0 2024-02-28T16:24:00.066 INFO:tasks.workunit.client.0.smithi023.stdout:9/195: getdents d0/d7/db/d18/d23/d28/d32 0 2024-02-28T16:24:00.068 INFO:tasks.workunit.client.0.smithi023.stdout:5/325: chown d1/d2a/d32/d37/l5b 1993 1 2024-02-28T16:24:00.070 INFO:tasks.workunit.client.0.smithi023.stdout:5/326: fdatasync d1/d2a/d32/d37/f59 0 2024-02-28T16:24:00.070 INFO:tasks.workunit.client.0.smithi023.stdout:0/157: symlink d6/d13/l30 0 2024-02-28T16:24:00.073 INFO:tasks.workunit.client.0.smithi023.stdout:3/113: creat d1/f1c x:0 0 0 2024-02-28T16:24:00.076 INFO:tasks.workunit.client.0.smithi023.stdout:3/114: write d1/f1c [402232,119724] 0 2024-02-28T16:24:00.076 INFO:tasks.workunit.client.0.smithi023.stdout:9/196: dread d0/d7/de/d2a/f38 [0,4194304] 0 2024-02-28T16:24:00.078 INFO:tasks.workunit.client.0.smithi023.stdout:1/215: rename df/d11/d13/d1b/c1d to df/d11/c52 0 2024-02-28T16:24:00.082 INFO:tasks.workunit.client.0.smithi023.stdout:9/197: dread d0/d7/de/d34/f3b [0,4194304] 0 2024-02-28T16:24:00.082 INFO:tasks.workunit.client.0.smithi023.stdout:5/327: symlink d1/d2a/d32/d36/l67 0 2024-02-28T16:24:00.085 INFO:tasks.workunit.client.0.smithi023.stdout:9/198: write d0/d7/ff [4418085,12670] 0 2024-02-28T16:24:00.087 INFO:tasks.workunit.client.0.smithi023.stdout:2/149: getdents d5/dc 0 2024-02-28T16:24:00.088 INFO:tasks.workunit.client.0.smithi023.stdout:6/265: dwrite d1/f1c [0,4194304] 0 2024-02-28T16:24:00.088 INFO:tasks.workunit.client.0.smithi023.stdout:2/150: fdatasync d5/f6 0 2024-02-28T16:24:00.091 INFO:tasks.workunit.client.0.smithi023.stdout:1/216: creat df/d11/d13/d27/f53 x:0 0 0 2024-02-28T16:24:00.098 INFO:tasks.workunit.client.0.smithi023.stdout:8/167: truncate d0/d5/d1b/f19 3384792 0 2024-02-28T16:24:00.100 INFO:tasks.workunit.client.0.smithi023.stdout:5/328: rename d1/d2a/d32/d37/d3a/d46 to d1/df/d62/d68 0 2024-02-28T16:24:00.102 INFO:tasks.workunit.client.0.smithi023.stdout:6/266: mkdir d1/d4f/d63 0 2024-02-28T16:24:00.108 INFO:tasks.workunit.client.0.smithi023.stdout:8/168: write d0/d5/d1a/f2f [664753,90936] 0 2024-02-28T16:24:00.111 INFO:tasks.workunit.client.0.smithi023.stdout:2/151: dwrite d5/ff [0,4194304] 0 2024-02-28T16:24:00.111 INFO:tasks.workunit.client.0.smithi023.stdout:6/267: unlink d1/d18/l61 0 2024-02-28T16:24:00.113 INFO:tasks.workunit.client.0.smithi023.stdout:6/268: read d1/f12 [953276,14618] 0 2024-02-28T16:24:00.114 INFO:tasks.workunit.client.0.smithi023.stdout:2/152: read f4 [2220105,112369] 0 2024-02-28T16:24:00.115 INFO:tasks.workunit.client.0.smithi023.stdout:5/329: write d1/df/f29 [81972,75465] 0 2024-02-28T16:24:00.116 INFO:tasks.workunit.client.0.smithi023.stdout:8/169: fdatasync d0/d5/d1a/f2f 0 2024-02-28T16:24:00.117 INFO:tasks.workunit.client.0.smithi023.stdout:2/153: chown d5/dc/f24 296 1 2024-02-28T16:24:00.120 INFO:tasks.workunit.client.0.smithi023.stdout:6/269: mknod d1/d28/d1e/d52/c64 0 2024-02-28T16:24:00.121 INFO:tasks.workunit.client.0.smithi023.stdout:5/330: chown d1/d2a/d32/d37/f59 331643 1 2024-02-28T16:24:00.123 INFO:tasks.workunit.client.0.smithi023.stdout:8/170: write d0/d5/f27 [1121439,114948] 0 2024-02-28T16:24:00.124 INFO:tasks.workunit.client.0.smithi023.stdout:2/154: write d5/dc/f24 [957299,110452] 0 2024-02-28T16:24:00.126 INFO:tasks.workunit.client.0.smithi023.stdout:6/270: fdatasync d1/d28/f19 0 2024-02-28T16:24:00.128 INFO:tasks.workunit.client.0.smithi023.stdout:9/199: dwrite d0/d7/db/f24 [0,4194304] 0 2024-02-28T16:24:00.135 INFO:tasks.workunit.client.0.smithi023.stdout:0/158: truncate d6/db/d1a/d1b/f1d 710596 0 2024-02-28T16:24:00.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/159: dread - d6/f21 zero size 2024-02-28T16:24:00.139 INFO:tasks.workunit.client.0.smithi023.stdout:6/271: rename d1/d3d/l49 to d1/d28/d1e/d2b/l65 0 2024-02-28T16:24:00.142 INFO:tasks.workunit.client.0.smithi023.stdout:3/115: truncate d1/dc/f14 2983153 0 2024-02-28T16:24:00.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:23:59 smithi153 ceph-mon[35341]: pgmap v31: 65 pgs: 65 active+clean; 478 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 48 MiB/s wr, 263 op/s 2024-02-28T16:24:00.148 INFO:tasks.workunit.client.0.smithi023.stdout:9/200: rename d0/d7/db/d18/d23/d28/l2b to d0/d7/db/d18/d23/d28/d32/l41 0 2024-02-28T16:24:00.150 INFO:tasks.workunit.client.0.smithi023.stdout:8/171: dread d0/d5/f28 [0,4194304] 0 2024-02-28T16:24:00.151 INFO:tasks.workunit.client.0.smithi023.stdout:6/272: symlink d1/l66 0 2024-02-28T16:24:00.153 INFO:tasks.workunit.client.0.smithi023.stdout:8/172: fdatasync d0/fc 0 2024-02-28T16:24:00.155 INFO:tasks.workunit.client.0.smithi023.stdout:3/116: creat d1/dc/f1d x:0 0 0 2024-02-28T16:24:00.158 INFO:tasks.workunit.client.0.smithi023.stdout:5/331: dwrite d1/d2a/d32/d37/f59 [0,4194304] 0 2024-02-28T16:24:00.168 INFO:tasks.workunit.client.0.smithi023.stdout:0/160: mkdir d6/db/d1a/d26/d31 0 2024-02-28T16:24:00.177 INFO:tasks.workunit.client.0.smithi023.stdout:2/155: write d5/dc/f21 [3040409,35780] 0 2024-02-28T16:24:00.178 INFO:tasks.workunit.client.0.smithi023.stdout:6/273: symlink d1/d4f/l67 0 2024-02-28T16:24:00.184 INFO:tasks.workunit.client.0.smithi023.stdout:1/217: dread f2 [4194304,4194304] 0 2024-02-28T16:24:00.190 INFO:tasks.workunit.client.0.smithi023.stdout:5/332: dwrite d1/df/f29 [0,4194304] 0 2024-02-28T16:24:00.192 INFO:tasks.workunit.client.0.smithi023.stdout:9/201: link d0/d7/de/f14 d0/d7/de/d34/f42 0 2024-02-28T16:24:00.193 INFO:tasks.workunit.client.0.smithi023.stdout:1/218: write df/d11/d13/f2c [5231696,83358] 0 2024-02-28T16:24:00.198 INFO:tasks.workunit.client.0.smithi023.stdout:6/274: mkdir d1/d18/d26/d3a/d68 0 2024-02-28T16:24:00.200 INFO:tasks.workunit.client.0.smithi023.stdout:8/173: dwrite d0/d5/d1b/f20 [0,4194304] 0 2024-02-28T16:24:00.201 INFO:tasks.workunit.client.0.smithi023.stdout:5/333: truncate d1/d2a/d32/d37/d3a/f50 4292396 0 2024-02-28T16:24:00.202 INFO:tasks.workunit.client.0.smithi023.stdout:0/161: dread f4 [4194304,4194304] 0 2024-02-28T16:24:00.204 INFO:tasks.workunit.client.0.smithi023.stdout:2/156: rename d5/f6 to d5/da/f28 0 2024-02-28T16:24:00.218 INFO:tasks.workunit.client.0.smithi023.stdout:1/219: unlink df/d11/d13/d1b/d30/l49 0 2024-02-28T16:24:00.219 INFO:tasks.workunit.client.0.smithi023.stdout:6/275: creat d1/f69 x:0 0 0 2024-02-28T16:24:00.219 INFO:tasks.workunit.client.0.smithi023.stdout:5/334: mknod d1/d2a/d32/d36/c69 0 2024-02-28T16:24:00.220 INFO:tasks.workunit.client.0.smithi023.stdout:3/117: link d1/df/f16 d1/df/f1e 0 2024-02-28T16:24:00.223 INFO:tasks.workunit.client.0.smithi023.stdout:3/118: read - d1/dc/f1d zero size 2024-02-28T16:24:00.224 INFO:tasks.workunit.client.0.smithi023.stdout:1/220: creat df/d11/f54 x:0 0 0 2024-02-28T16:24:00.225 INFO:tasks.workunit.client.0.smithi023.stdout:5/335: chown d1/d2a/l5d 256315582 1 2024-02-28T16:24:00.225 INFO:tasks.workunit.client.0.smithi023.stdout:9/202: dread d0/d7/de/f14 [4194304,4194304] 0 2024-02-28T16:24:00.227 INFO:tasks.workunit.client.0.smithi023.stdout:8/174: creat d0/d5/d1a/f38 x:0 0 0 2024-02-28T16:24:00.227 INFO:tasks.workunit.client.0.smithi023.stdout:6/276: mkdir d1/d18/d26/d6a 0 2024-02-28T16:24:00.229 INFO:tasks.workunit.client.0.smithi023.stdout:1/221: dread - df/d11/d13/d1b/d30/d3d/f50 zero size 2024-02-28T16:24:00.231 INFO:tasks.workunit.client.0.smithi023.stdout:0/162: dread d6/d13/f28 [0,4194304] 0 2024-02-28T16:24:00.236 INFO:tasks.workunit.client.0.smithi023.stdout:6/277: rmdir d1/d28/d1e 39 2024-02-28T16:24:00.237 INFO:tasks.workunit.client.0.smithi023.stdout:8/175: mkdir d0/d5/d1a/d2d/d30/d39 0 2024-02-28T16:24:00.241 INFO:tasks.workunit.client.0.smithi023.stdout:7/136: sync 2024-02-28T16:24:00.242 INFO:tasks.workunit.client.0.smithi023.stdout:4/171: sync 2024-02-28T16:24:00.244 INFO:tasks.workunit.client.0.smithi023.stdout:5/336: creat d1/d2a/d32/d37/d3a/f6a x:0 0 0 2024-02-28T16:24:00.249 INFO:tasks.workunit.client.0.smithi023.stdout:8/176: dread d0/d5/d1a/f2f [0,4194304] 0 2024-02-28T16:24:00.250 INFO:tasks.workunit.client.0.smithi023.stdout:4/172: creat d13/d1d/f33 x:0 0 0 2024-02-28T16:24:00.251 INFO:tasks.workunit.client.0.smithi023.stdout:5/337: fdatasync d1/df/f25 0 2024-02-28T16:24:00.251 INFO:tasks.workunit.client.0.smithi023.stdout:3/119: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:24:00.254 INFO:tasks.workunit.client.0.smithi023.stdout:7/137: truncate de/d13/f25 876054 0 2024-02-28T16:24:00.255 INFO:tasks.workunit.client.0.smithi023.stdout:0/163: creat d6/d13/d1f/f32 x:0 0 0 2024-02-28T16:24:00.255 INFO:tasks.workunit.client.0.smithi023.stdout:6/278: mknod d1/d28/d1e/c6b 0 2024-02-28T16:24:00.256 INFO:tasks.workunit.client.0.smithi023.stdout:5/338: dread - d1/d2a/d32/d36/f66 zero size 2024-02-28T16:24:00.260 INFO:tasks.workunit.client.0.smithi023.stdout:7/138: chown de/d1c/f20 1 1 2024-02-28T16:24:00.273 INFO:tasks.workunit.client.0.smithi023.stdout:8/177: read d0/d5/d1a/f2e [394494,105452] 0 2024-02-28T16:24:00.273 INFO:tasks.workunit.client.0.smithi023.stdout:4/173: rename d13/c16 to d13/d1d/d2e/c34 0 2024-02-28T16:24:00.273 INFO:tasks.workunit.client.0.smithi023.stdout:9/203: dwrite d0/d7/db/f27 [0,4194304] 0 2024-02-28T16:24:00.277 INFO:tasks.workunit.client.0.smithi023.stdout:4/174: chown f7 418 1 2024-02-28T16:24:00.278 INFO:tasks.workunit.client.0.smithi023.stdout:7/139: symlink de/l2d 0 2024-02-28T16:24:00.280 INFO:tasks.workunit.client.0.smithi023.stdout:1/222: dread f4 [0,4194304] 0 2024-02-28T16:24:00.280 INFO:tasks.workunit.client.0.smithi023.stdout:6/279: rmdir d1/d18/d26/d3a/d68 0 2024-02-28T16:24:00.282 INFO:tasks.workunit.client.0.smithi023.stdout:6/280: write d1/fb [2128866,88712] 0 2024-02-28T16:24:00.284 INFO:tasks.workunit.client.0.smithi023.stdout:6/281: stat d1/d4f 0 2024-02-28T16:24:00.285 INFO:tasks.workunit.client.0.smithi023.stdout:0/164: dread d6/db/d1a/d1b/f1d [0,4194304] 0 2024-02-28T16:24:00.285 INFO:tasks.workunit.client.0.smithi023.stdout:8/178: rename d0/d5/fd to d0/d5/d1b/f3a 0 2024-02-28T16:24:00.288 INFO:tasks.workunit.client.0.smithi023.stdout:7/140: fsync de/d1c/f26 0 2024-02-28T16:24:00.290 INFO:tasks.workunit.client.0.smithi023.stdout:5/339: getdents d1/d2a/d32/d37/d4e 0 2024-02-28T16:24:00.305 INFO:tasks.workunit.client.0.smithi023.stdout:9/204: creat d0/f43 x:0 0 0 2024-02-28T16:24:00.308 INFO:tasks.workunit.client.0.smithi023.stdout:9/205: dread - d0/d7/de/d34/f35 zero size 2024-02-28T16:24:00.308 INFO:tasks.workunit.client.0.smithi023.stdout:3/120: dread d1/f11 [0,4194304] 0 2024-02-28T16:24:00.310 INFO:tasks.workunit.client.0.smithi023.stdout:9/206: chown d0/d7/l19 7 1 2024-02-28T16:24:00.312 INFO:tasks.workunit.client.0.smithi023.stdout:8/179: link d0/d5/d1b/f1e d0/d5/d1a/d2d/d30/d39/f3b 0 2024-02-28T16:24:00.313 INFO:tasks.workunit.client.0.smithi023.stdout:6/282: creat d1/d28/f6c x:0 0 0 2024-02-28T16:24:00.318 INFO:tasks.workunit.client.0.smithi023.stdout:7/141: link de/d13/f1f de/d13/d1b/f2e 0 2024-02-28T16:24:00.319 INFO:tasks.workunit.client.0.smithi023.stdout:0/165: rmdir d6 39 2024-02-28T16:24:00.322 INFO:tasks.workunit.client.0.smithi023.stdout:7/142: write de/d13/f2b [391107,21444] 0 2024-02-28T16:24:00.322 INFO:tasks.workunit.client.0.smithi023.stdout:5/340: truncate d1/df/f25 2738986 0 2024-02-28T16:24:00.325 INFO:tasks.workunit.client.0.smithi023.stdout:6/283: mkdir d1/d28/d1e/d2b/d6d 0 2024-02-28T16:24:00.330 INFO:tasks.workunit.client.0.smithi023.stdout:1/223: dread df/d11/d13/f14 [0,4194304] 0 2024-02-28T16:24:00.330 INFO:tasks.workunit.client.0.smithi023.stdout:5/341: stat d1/d2a/d32/d36/c47 0 2024-02-28T16:24:00.333 INFO:tasks.workunit.client.0.smithi023.stdout:9/207: mkdir d0/d7/de/d2e/d2f/d44 0 2024-02-28T16:24:00.333 INFO:tasks.workunit.client.0.smithi023.stdout:1/224: read - df/d11/d13/d1b/d30/f4b zero size 2024-02-28T16:24:00.333 INFO:tasks.workunit.client.0.smithi023.stdout:7/143: dread de/d13/f1f [0,4194304] 0 2024-02-28T16:24:00.334 INFO:tasks.workunit.client.0.smithi023.stdout:5/342: write d1/df/f3c [1204850,68429] 0 2024-02-28T16:24:00.336 INFO:tasks.workunit.client.0.smithi023.stdout:5/343: stat d1/c28 0 2024-02-28T16:24:00.337 INFO:tasks.workunit.client.0.smithi023.stdout:8/180: rename d0/d5/d1b/f13 to d0/d5/f3c 0 2024-02-28T16:24:00.339 INFO:tasks.workunit.client.0.smithi023.stdout:4/175: creat d13/d2b/d2c/f35 x:0 0 0 2024-02-28T16:24:00.341 INFO:tasks.workunit.client.0.smithi023.stdout:1/225: write df/d11/d13/d1b/d30/d3d/f4e [613771,86555] 0 2024-02-28T16:24:00.345 INFO:tasks.workunit.client.0.smithi023.stdout:1/226: fdatasync df/d11/d13/f14 0 2024-02-28T16:24:00.345 INFO:tasks.workunit.client.0.smithi023.stdout:5/344: creat d1/df/d62/f6b x:0 0 0 2024-02-28T16:24:00.349 INFO:tasks.workunit.client.0.smithi023.stdout:1/227: fsync df/d26/f35 0 2024-02-28T16:24:00.350 INFO:tasks.workunit.client.0.smithi023.stdout:9/208: rename d0/d7/de/d34/f42 to d0/d7/d2c/f45 0 2024-02-28T16:24:00.351 INFO:tasks.workunit.client.0.smithi023.stdout:6/284: dwrite d1/d18/d26/d3a/f5e [0,4194304] 0 2024-02-28T16:24:00.352 INFO:tasks.workunit.client.0.smithi023.stdout:6/285: chown d1/f1b 13958 1 2024-02-28T16:24:00.353 INFO:tasks.workunit.client.0.smithi023.stdout:6/286: stat d1/c10 0 2024-02-28T16:24:00.357 INFO:tasks.workunit.client.0.smithi023.stdout:3/121: write d1/f4 [1745842,92736] 0 2024-02-28T16:24:00.361 INFO:tasks.workunit.client.0.smithi023.stdout:8/181: mkdir d0/d5/d1a/d2d/d30/d39/d3d 0 2024-02-28T16:24:00.361 INFO:tasks.workunit.client.0.smithi023.stdout:3/122: write d1/f8 [575802,103566] 0 2024-02-28T16:24:00.364 INFO:tasks.workunit.client.0.smithi023.stdout:8/182: read d0/d5/f28 [6786182,19453] 0 2024-02-28T16:24:00.364 INFO:tasks.workunit.client.0.smithi023.stdout:6/287: readlink d1/l13 0 2024-02-28T16:24:00.366 INFO:tasks.workunit.client.0.smithi023.stdout:0/166: getdents d6/db/d1a 0 2024-02-28T16:24:00.368 INFO:tasks.workunit.client.0.smithi023.stdout:6/288: write d1/f1b [3190219,7921] 0 2024-02-28T16:24:00.373 INFO:tasks.workunit.client.0.smithi023.stdout:5/345: unlink d1/d2a/d32/d37/l5e 0 2024-02-28T16:24:00.374 INFO:tasks.workunit.client.0.smithi023.stdout:4/176: fsync d13/d2b/d2c/f35 0 2024-02-28T16:24:00.378 INFO:tasks.workunit.client.0.smithi023.stdout:1/228: dwrite df/d26/f35 [0,4194304] 0 2024-02-28T16:24:00.379 INFO:tasks.workunit.client.0.smithi023.stdout:4/177: write d13/d2b/d2c/f30 [443283,65332] 0 2024-02-28T16:24:00.383 INFO:tasks.workunit.client.0.smithi023.stdout:7/144: dread f4 [4194304,4194304] 0 2024-02-28T16:24:00.385 INFO:tasks.workunit.client.0.smithi023.stdout:5/346: creat d1/df/d62/d68/f6c x:0 0 0 2024-02-28T16:24:00.386 INFO:tasks.workunit.client.0.smithi023.stdout:3/123: fsync d1/df/f16 0 2024-02-28T16:24:00.388 INFO:tasks.workunit.client.0.smithi023.stdout:3/124: readlink d1/df/l10 0 2024-02-28T16:24:00.388 INFO:tasks.workunit.client.0.smithi023.stdout:8/183: mkdir d0/d5/d1a/d2d/d30/d39/d3d/d3e 0 2024-02-28T16:24:00.389 INFO:tasks.workunit.client.0.smithi023.stdout:5/347: fsync d1/d2a/d32/d37/f51 0 2024-02-28T16:24:00.390 INFO:tasks.workunit.client.0.smithi023.stdout:4/178: stat d13/f17 0 2024-02-28T16:24:00.390 INFO:tasks.workunit.client.0.smithi023.stdout:0/167: mkdir d6/db/d1a/d26/d31/d33 0 2024-02-28T16:24:00.392 INFO:tasks.workunit.client.0.smithi023.stdout:1/229: creat df/d11/d13/d1b/f55 x:0 0 0 2024-02-28T16:24:00.393 INFO:tasks.workunit.client.0.smithi023.stdout:1/230: readlink la 0 2024-02-28T16:24:00.394 INFO:tasks.workunit.client.0.smithi023.stdout:6/289: dwrite d1/d18/d26/f38 [4194304,4194304] 0 2024-02-28T16:24:00.394 INFO:tasks.workunit.client.0.smithi023.stdout:0/168: chown d6/d13/c29 21354853 1 2024-02-28T16:24:00.397 INFO:tasks.workunit.client.0.smithi023.stdout:8/184: chown d0/d5/d1a/d2d/d30/d39/f3b 5 1 2024-02-28T16:24:00.398 INFO:tasks.workunit.client.0.smithi023.stdout:1/231: write df/d26/f3c [460641,6642] 0 2024-02-28T16:24:00.402 INFO:tasks.workunit.client.0.smithi023.stdout:7/145: mkdir de/d2f 0 2024-02-28T16:24:00.403 INFO:tasks.workunit.client.0.smithi023.stdout:3/125: fsync d1/dc/f14 0 2024-02-28T16:24:00.408 INFO:tasks.workunit.client.0.smithi023.stdout:1/232: truncate df/d11/d13/d1b/d30/f4b 504432 0 2024-02-28T16:24:00.409 INFO:tasks.workunit.client.0.smithi023.stdout:5/348: creat d1/d2a/d32/d37/d3a/f6d x:0 0 0 2024-02-28T16:24:00.410 INFO:tasks.workunit.client.0.smithi023.stdout:7/146: write de/d13/f2b [1005967,17047] 0 2024-02-28T16:24:00.413 INFO:tasks.workunit.client.0.smithi023.stdout:1/233: symlink df/l56 0 2024-02-28T16:24:00.415 INFO:tasks.workunit.client.0.smithi023.stdout:6/290: getdents d1/d4f 0 2024-02-28T16:24:00.416 INFO:tasks.workunit.client.0.smithi023.stdout:7/147: mknod de/d1c/c30 0 2024-02-28T16:24:00.417 INFO:tasks.workunit.client.0.smithi023.stdout:1/234: chown df/d11/d13/c1a 2 1 2024-02-28T16:24:00.418 INFO:tasks.workunit.client.0.smithi023.stdout:1/235: chown lb 12168 1 2024-02-28T16:24:00.422 INFO:tasks.workunit.client.0.smithi023.stdout:4/179: write d13/f15 [1773778,63790] 0 2024-02-28T16:24:00.423 INFO:tasks.workunit.client.0.smithi023.stdout:8/185: dread d0/d5/f3c [4194304,4194304] 0 2024-02-28T16:24:00.425 INFO:tasks.workunit.client.0.smithi023.stdout:6/291: symlink d1/d28/d1e/d2b/d44/l6e 0 2024-02-28T16:24:00.427 INFO:tasks.workunit.client.0.smithi023.stdout:1/236: mkdir df/d11/d13/d1b/d30/d57 0 2024-02-28T16:24:00.428 INFO:tasks.workunit.client.0.smithi023.stdout:6/292: read d1/f12 [1362703,7323] 0 2024-02-28T16:24:00.430 INFO:tasks.workunit.client.0.smithi023.stdout:7/148: rename de/l2d to de/l31 0 2024-02-28T16:24:00.431 INFO:tasks.workunit.client.0.smithi023.stdout:1/237: stat df/d11/c25 0 2024-02-28T16:24:00.432 INFO:tasks.workunit.client.0.smithi023.stdout:3/126: dwrite d1/f1c [0,4194304] 0 2024-02-28T16:24:00.433 INFO:tasks.workunit.client.0.smithi023.stdout:8/186: getdents d0/d5/d1b/d36 0 2024-02-28T16:24:00.434 INFO:tasks.workunit.client.0.smithi023.stdout:1/238: chown df/d11 1528193 1 2024-02-28T16:24:00.435 INFO:tasks.workunit.client.0.smithi023.stdout:1/239: chown df/d11/f54 108 1 2024-02-28T16:24:00.438 INFO:tasks.workunit.client.0.smithi023.stdout:5/349: dwrite d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:24:00.439 INFO:tasks.workunit.client.0.smithi023.stdout:6/293: creat d1/d28/d1e/d52/f6f x:0 0 0 2024-02-28T16:24:00.439 INFO:tasks.workunit.client.0.smithi023.stdout:1/240: chown df/d11/d13/d1b/d30/f4b 0 1 2024-02-28T16:24:00.440 INFO:tasks.workunit.client.0.smithi023.stdout:5/350: chown d1/d2a/l31 31756 1 2024-02-28T16:24:00.441 INFO:tasks.workunit.client.0.smithi023.stdout:4/180: creat d13/d1d/d2d/f36 x:0 0 0 2024-02-28T16:24:00.442 INFO:tasks.workunit.client.0.smithi023.stdout:3/127: symlink d1/df/l1f 0 2024-02-28T16:24:00.449 INFO:tasks.workunit.client.0.smithi023.stdout:1/241: dread df/d11/f12 [0,4194304] 0 2024-02-28T16:24:00.452 INFO:tasks.workunit.client.0.smithi023.stdout:7/149: rmdir de/d1c 39 2024-02-28T16:24:00.457 INFO:tasks.workunit.client.0.smithi023.stdout:8/187: dread d0/d5/d1b/f19 [0,4194304] 0 2024-02-28T16:24:00.461 INFO:tasks.workunit.client.0.smithi023.stdout:5/351: mkdir d1/d2a/d32/d6e 0 2024-02-28T16:24:00.462 INFO:tasks.workunit.client.0.smithi023.stdout:1/242: mknod df/d26/c58 0 2024-02-28T16:24:00.463 INFO:tasks.workunit.client.0.smithi023.stdout:1/243: chown f3 2 1 2024-02-28T16:24:00.465 INFO:tasks.workunit.client.0.smithi023.stdout:6/294: rename d1/d28/f6c to d1/d28/f70 0 2024-02-28T16:24:00.468 INFO:tasks.workunit.client.0.smithi023.stdout:7/150: symlink de/d2f/l32 0 2024-02-28T16:24:00.468 INFO:tasks.workunit.client.0.smithi023.stdout:1/244: rmdir df/d11/d13/d1b/d2e 39 2024-02-28T16:24:00.470 INFO:tasks.workunit.client.0.smithi023.stdout:8/188: unlink d0/d5/d1a/c22 0 2024-02-28T16:24:00.470 INFO:tasks.workunit.client.0.smithi023.stdout:3/128: rmdir d1 39 2024-02-28T16:24:00.472 INFO:tasks.workunit.client.0.smithi023.stdout:6/295: symlink d1/d18/l71 0 2024-02-28T16:24:00.473 INFO:tasks.workunit.client.0.smithi023.stdout:8/189: write d0/d5/d1b/f33 [753540,42784] 0 2024-02-28T16:24:00.473 INFO:tasks.workunit.client.0.smithi023.stdout:5/352: mknod d1/d2a/c6f 0 2024-02-28T16:24:00.474 INFO:tasks.workunit.client.0.smithi023.stdout:6/296: chown d1/d18/d26/c2d 192949456 1 2024-02-28T16:24:00.476 INFO:tasks.workunit.client.0.smithi023.stdout:4/181: write f5 [1911619,15860] 0 2024-02-28T16:24:00.476 INFO:tasks.workunit.client.0.smithi023.stdout:7/151: fsync de/d13/d1b/f2e 0 2024-02-28T16:24:00.477 INFO:tasks.workunit.client.0.smithi023.stdout:1/245: symlink df/d26/l59 0 2024-02-28T16:24:00.478 INFO:tasks.workunit.client.0.smithi023.stdout:5/353: write d1/d2a/d32/d37/f59 [1184077,1696] 0 2024-02-28T16:24:00.480 INFO:tasks.workunit.client.0.smithi023.stdout:5/354: chown d1 88870 1 2024-02-28T16:24:00.481 INFO:tasks.workunit.client.0.smithi023.stdout:6/297: symlink d1/l72 0 2024-02-28T16:24:00.482 INFO:tasks.workunit.client.0.smithi023.stdout:6/298: stat d1/d28/d1e/l33 0 2024-02-28T16:24:00.487 INFO:tasks.workunit.client.0.smithi023.stdout:3/129: stat d1/df/c18 0 2024-02-28T16:24:00.488 INFO:tasks.workunit.client.0.smithi023.stdout:3/130: write d1/f8 [3752987,15840] 0 2024-02-28T16:24:00.490 INFO:tasks.workunit.client.0.smithi023.stdout:3/131: write d1/f8 [210550,3497] 0 2024-02-28T16:24:00.492 INFO:tasks.workunit.client.0.smithi023.stdout:1/246: unlink df/d11/f45 0 2024-02-28T16:24:00.493 INFO:tasks.workunit.client.0.smithi023.stdout:5/355: creat d1/d2a/d32/d37/d4e/f70 x:0 0 0 2024-02-28T16:24:00.501 INFO:tasks.workunit.client.0.smithi023.stdout:8/190: rename d0/d5/c37 to d0/d5/d1a/d2d/d30/c3f 0 2024-02-28T16:24:00.505 INFO:tasks.workunit.client.0.smithi023.stdout:3/132: dread d1/f8 [0,4194304] 0 2024-02-28T16:24:00.508 INFO:tasks.workunit.client.0.smithi023.stdout:4/182: link c11 d13/d1e/c37 0 2024-02-28T16:24:00.508 INFO:tasks.workunit.client.0.smithi023.stdout:7/152: link l6 de/l33 0 2024-02-28T16:24:00.508 INFO:tasks.workunit.client.0.smithi023.stdout:8/191: write d0/d5/d1b/ff [1357209,122740] 0 2024-02-28T16:24:00.512 INFO:tasks.workunit.client.0.smithi023.stdout:5/356: dwrite d1/d2a/d32/d36/f66 [0,4194304] 0 2024-02-28T16:24:00.515 INFO:tasks.workunit.client.0.smithi023.stdout:5/357: fdatasync d1/df/f3c 0 2024-02-28T16:24:00.518 INFO:tasks.workunit.client.0.smithi023.stdout:4/183: unlink f6 0 2024-02-28T16:24:00.519 INFO:tasks.workunit.client.0.smithi023.stdout:3/133: creat d1/f20 x:0 0 0 2024-02-28T16:24:00.520 INFO:tasks.workunit.client.0.smithi023.stdout:7/153: creat de/d13/d1b/f34 x:0 0 0 2024-02-28T16:24:00.526 INFO:tasks.workunit.client.0.smithi023.stdout:6/299: dread d1/f2f [0,4194304] 0 2024-02-28T16:24:00.528 INFO:tasks.workunit.client.0.smithi023.stdout:4/184: mknod d13/d1d/d2d/c38 0 2024-02-28T16:24:00.531 INFO:tasks.workunit.client.0.smithi023.stdout:6/300: creat d1/d18/f73 x:0 0 0 2024-02-28T16:24:00.531 INFO:tasks.workunit.client.0.smithi023.stdout:1/247: write df/f16 [1542514,20776] 0 2024-02-28T16:24:00.532 INFO:tasks.workunit.client.0.smithi023.stdout:6/301: chown d1/l41 14712 1 2024-02-28T16:24:00.534 INFO:tasks.workunit.client.0.smithi023.stdout:7/154: symlink de/l35 0 2024-02-28T16:24:00.536 INFO:tasks.workunit.client.0.smithi023.stdout:8/192: dread d0/f18 [0,4194304] 0 2024-02-28T16:24:00.536 INFO:tasks.workunit.client.0.smithi023.stdout:4/185: chown cc 399865 1 2024-02-28T16:24:00.541 INFO:tasks.workunit.client.0.smithi023.stdout:5/358: getdents d1/d2a/d32/d37/d4e 0 2024-02-28T16:24:00.541 INFO:tasks.workunit.client.0.smithi023.stdout:3/134: getdents d1/dc 0 2024-02-28T16:24:00.542 INFO:tasks.workunit.client.0.smithi023.stdout:1/248: mkdir df/d11/d13/d1b/d30/d57/d5a 0 2024-02-28T16:24:00.542 INFO:tasks.workunit.client.0.smithi023.stdout:4/186: rmdir d13/d2b/d2c 39 2024-02-28T16:24:00.546 INFO:tasks.workunit.client.0.smithi023.stdout:5/359: dread d1/f39 [0,4194304] 0 2024-02-28T16:24:00.547 INFO:tasks.workunit.client.0.smithi023.stdout:3/135: mknod d1/df/c21 0 2024-02-28T16:24:00.548 INFO:tasks.workunit.client.0.smithi023.stdout:3/136: readlink d1/df/l10 0 2024-02-28T16:24:00.550 INFO:tasks.workunit.client.0.smithi023.stdout:1/249: creat df/d26/f5b x:0 0 0 2024-02-28T16:24:00.551 INFO:tasks.workunit.client.0.smithi023.stdout:4/187: mkdir d13/d1e/d39 0 2024-02-28T16:24:00.553 INFO:tasks.workunit.client.0.smithi023.stdout:5/360: dread d1/f39 [0,4194304] 0 2024-02-28T16:24:00.555 INFO:tasks.workunit.client.0.smithi023.stdout:1/250: write df/d11/d13/f15 [4272321,84181] 0 2024-02-28T16:24:00.555 INFO:tasks.workunit.client.0.smithi023.stdout:3/137: rename d1/dc to d1/df/d22 0 2024-02-28T16:24:00.559 INFO:tasks.workunit.client.0.smithi023.stdout:4/188: chown d13/d2b/d2c 100662499 1 2024-02-28T16:24:00.560 INFO:tasks.workunit.client.0.smithi023.stdout:1/251: fdatasync f4 0 2024-02-28T16:24:00.561 INFO:tasks.workunit.client.0.smithi023.stdout:4/189: chown ld 31269888 1 2024-02-28T16:24:00.563 INFO:tasks.workunit.client.0.smithi023.stdout:6/302: dwrite d1/d28/d1e/f4e [0,4194304] 0 2024-02-28T16:24:00.568 INFO:tasks.workunit.client.0.smithi023.stdout:5/361: rename d1/d2a/c6f to d1/d2a/d32/d37/c71 0 2024-02-28T16:24:00.568 INFO:tasks.workunit.client.0.smithi023.stdout:8/193: dwrite d0/d5/d1b/f3a [4194304,4194304] 0 2024-02-28T16:24:00.574 INFO:tasks.workunit.client.0.smithi023.stdout:3/138: link d1/f20 d1/f23 0 2024-02-28T16:24:00.575 INFO:tasks.workunit.client.0.smithi023.stdout:5/362: creat d1/df/d62/f72 x:0 0 0 2024-02-28T16:24:00.579 INFO:tasks.workunit.client.0.smithi023.stdout:5/363: readlink d1/d2a/l5d 0 2024-02-28T16:24:00.581 INFO:tasks.workunit.client.0.smithi023.stdout:5/364: chown d1/l3 13635 1 2024-02-28T16:24:00.581 INFO:tasks.workunit.client.0.smithi023.stdout:6/303: dread d1/f12 [0,4194304] 0 2024-02-28T16:24:00.582 INFO:tasks.workunit.client.0.smithi023.stdout:6/304: stat d1/l13 0 2024-02-28T16:24:00.587 INFO:tasks.workunit.client.0.smithi023.stdout:4/190: getdents d13 0 2024-02-28T16:24:00.589 INFO:tasks.workunit.client.0.smithi023.stdout:5/365: read d1/df/f24 [148297,41296] 0 2024-02-28T16:24:00.590 INFO:tasks.workunit.client.0.smithi023.stdout:1/252: dwrite df/d26/f35 [0,4194304] 0 2024-02-28T16:24:00.590 INFO:tasks.workunit.client.0.smithi023.stdout:8/194: dread d0/d5/d1a/d2d/f31 [0,4194304] 0 2024-02-28T16:24:00.594 INFO:tasks.workunit.client.0.smithi023.stdout:1/253: write df/d11/f21 [153652,15245] 0 2024-02-28T16:24:00.597 INFO:tasks.workunit.client.0.smithi023.stdout:6/305: getdents d1/d28/d1e/d2b/d6d 0 2024-02-28T16:24:00.599 INFO:tasks.workunit.client.0.smithi023.stdout:3/139: dread d1/f8 [0,4194304] 0 2024-02-28T16:24:00.600 INFO:tasks.workunit.client.0.smithi023.stdout:6/306: chown d1/d28/d1e/d52/f6f 5 1 2024-02-28T16:24:00.600 INFO:tasks.workunit.client.0.smithi023.stdout:3/140: chown c0 2120141 1 2024-02-28T16:24:00.603 INFO:tasks.workunit.client.0.smithi023.stdout:3/141: mknod d1/df/d22/c24 0 2024-02-28T16:24:00.604 INFO:tasks.workunit.client.0.smithi023.stdout:8/195: creat d0/d5/f40 x:0 0 0 2024-02-28T16:24:00.606 INFO:tasks.workunit.client.0.smithi023.stdout:1/254: mkdir df/d11/d13/d1b/d2e/d5c 0 2024-02-28T16:24:00.607 INFO:tasks.workunit.client.0.smithi023.stdout:6/307: rename d1/d28/l60 to d1/d18/d26/d3a/l74 0 2024-02-28T16:24:00.608 INFO:tasks.workunit.client.0.smithi023.stdout:3/142: mkdir d1/df/d25 0 2024-02-28T16:24:00.609 INFO:tasks.workunit.client.0.smithi023.stdout:8/196: fsync d0/d5/f28 0 2024-02-28T16:24:00.609 INFO:tasks.workunit.client.0.smithi023.stdout:3/143: stat d1/df 0 2024-02-28T16:24:00.615 INFO:tasks.workunit.client.0.smithi023.stdout:1/255: rename df/d11/d13/d27/l36 to df/d11/d13/d1b/d2e/d5c/l5d 0 2024-02-28T16:24:00.619 INFO:tasks.workunit.client.0.smithi023.stdout:8/197: creat d0/d5/f41 x:0 0 0 2024-02-28T16:24:00.625 INFO:tasks.workunit.client.0.smithi023.stdout:5/366: dwrite d1/df/f24 [0,4194304] 0 2024-02-28T16:24:00.626 INFO:tasks.workunit.client.0.smithi023.stdout:8/198: symlink d0/d5/d1a/d2d/d30/d39/d3d/l42 0 2024-02-28T16:24:00.626 INFO:tasks.workunit.client.0.smithi023.stdout:6/308: dwrite d1/d28/d1e/d52/f6f [0,4194304] 0 2024-02-28T16:24:00.636 INFO:tasks.workunit.client.0.smithi023.stdout:8/199: creat d0/d5/d1b/f43 x:0 0 0 2024-02-28T16:24:00.636 INFO:tasks.workunit.client.0.smithi023.stdout:1/256: dwrite df/d11/d13/d1b/d30/f41 [0,4194304] 0 2024-02-28T16:24:00.641 INFO:tasks.workunit.client.0.smithi023.stdout:3/144: write d1/f23 [910464,100565] 0 2024-02-28T16:24:00.643 INFO:tasks.workunit.client.0.smithi023.stdout:5/367: rename d1/d2a/d32/d37/d3a/d4c to d1/d2a/d32/d58/d73 0 2024-02-28T16:24:00.646 INFO:tasks.workunit.client.0.smithi023.stdout:5/368: read - d1/df/d62/f6b zero size 2024-02-28T16:24:00.651 INFO:tasks.workunit.client.0.smithi023.stdout:8/200: mkdir d0/d5/d1a/d44 0 2024-02-28T16:24:00.657 INFO:tasks.workunit.client.0.smithi023.stdout:3/145: symlink d1/l26 0 2024-02-28T16:24:00.658 INFO:tasks.workunit.client.0.smithi023.stdout:5/369: write d1/d2a/d32/d37/d4e/f57 [929541,118998] 0 2024-02-28T16:24:00.658 INFO:tasks.workunit.client.0.smithi023.stdout:8/201: symlink d0/d5/d1a/d2d/d30/d39/l45 0 2024-02-28T16:24:00.659 INFO:tasks.workunit.client.0.smithi023.stdout:6/309: truncate d1/d18/d26/d3a/f3f 3687489 0 2024-02-28T16:24:00.660 INFO:tasks.workunit.client.0.smithi023.stdout:8/202: stat d0/f18 0 2024-02-28T16:24:00.665 INFO:tasks.workunit.client.0.smithi023.stdout:5/370: chown d1/df/l53 143096 1 2024-02-28T16:24:00.666 INFO:tasks.workunit.client.0.smithi023.stdout:8/203: creat d0/d5/d1a/d2d/d30/f46 x:0 0 0 2024-02-28T16:24:00.667 INFO:tasks.workunit.client.0.smithi023.stdout:1/257: dwrite df/d11/f12 [0,4194304] 0 2024-02-28T16:24:00.668 INFO:tasks.workunit.client.0.smithi023.stdout:1/258: stat l6 0 2024-02-28T16:24:00.670 INFO:tasks.workunit.client.0.smithi023.stdout:3/146: creat d1/f27 x:0 0 0 2024-02-28T16:24:00.672 INFO:tasks.workunit.client.0.smithi023.stdout:5/371: write d1/d2a/d32/d37/d3a/f50 [411185,21413] 0 2024-02-28T16:24:00.675 INFO:tasks.workunit.client.0.smithi023.stdout:5/372: read d1/df/f3c [608264,74761] 0 2024-02-28T16:24:00.677 INFO:tasks.workunit.client.0.smithi023.stdout:5/373: fsync d1/d2a/d32/d37/f51 0 2024-02-28T16:24:00.677 INFO:tasks.workunit.client.0.smithi023.stdout:1/259: unlink df/c10 0 2024-02-28T16:24:00.681 INFO:tasks.workunit.client.0.smithi023.stdout:8/204: symlink d0/d5/d1b/d36/l47 0 2024-02-28T16:24:00.684 INFO:tasks.workunit.client.0.smithi023.stdout:1/260: truncate df/d11/d13/d1b/f40 853043 0 2024-02-28T16:24:00.692 INFO:tasks.workunit.client.0.smithi023.stdout:3/147: write d1/df/f1e [1143516,59536] 0 2024-02-28T16:24:00.694 INFO:tasks.workunit.client.0.smithi023.stdout:5/374: dread d1/df/f3c [0,4194304] 0 2024-02-28T16:24:00.696 INFO:tasks.workunit.client.0.smithi023.stdout:8/205: dread d0/d5/d1b/f3a [4194304,4194304] 0 2024-02-28T16:24:00.698 INFO:tasks.workunit.client.0.smithi023.stdout:5/375: chown d1/d2a/d32/d36/l4a 296 1 2024-02-28T16:24:00.698 INFO:tasks.workunit.client.0.smithi023.stdout:3/148: creat d1/df/d25/f28 x:0 0 0 2024-02-28T16:24:00.700 INFO:tasks.workunit.client.0.smithi023.stdout:5/376: write d1/df/d62/f6b [475508,27796] 0 2024-02-28T16:24:00.701 INFO:tasks.workunit.client.0.smithi023.stdout:3/149: creat d1/df/f29 x:0 0 0 2024-02-28T16:24:00.703 INFO:tasks.workunit.client.0.smithi023.stdout:1/261: truncate df/d11/d13/d1b/d30/f4b 484889 0 2024-02-28T16:24:00.703 INFO:tasks.workunit.client.0.smithi023.stdout:3/150: chown d1/f8 6945705 1 2024-02-28T16:24:00.704 INFO:tasks.workunit.client.0.smithi023.stdout:8/206: rename d0/f2c to d0/d5/d1a/d2d/d30/d39/d3d/d3e/f48 0 2024-02-28T16:24:00.705 INFO:tasks.workunit.client.0.smithi023.stdout:5/377: creat d1/d2a/d32/d36/f74 x:0 0 0 2024-02-28T16:24:00.709 INFO:tasks.workunit.client.0.smithi023.stdout:1/262: mknod df/d11/c5e 0 2024-02-28T16:24:00.710 INFO:tasks.workunit.client.0.smithi023.stdout:8/207: symlink d0/d5/d1b/l49 0 2024-02-28T16:24:00.711 INFO:tasks.workunit.client.0.smithi023.stdout:5/378: stat d1/d2a/l2c 0 2024-02-28T16:24:00.713 INFO:tasks.workunit.client.0.smithi023.stdout:5/379: readlink d1/d2a/d32/d36/l4a 0 2024-02-28T16:24:00.714 INFO:tasks.workunit.client.0.smithi023.stdout:8/208: symlink d0/d5/d1b/l4a 0 2024-02-28T16:24:00.721 INFO:tasks.workunit.client.0.smithi023.stdout:8/209: dread d0/d5/d1a/f2e [0,4194304] 0 2024-02-28T16:24:00.722 INFO:tasks.workunit.client.0.smithi023.stdout:5/380: link d1/d2a/d32/d36/c64 d1/d2a/d32/d37/d3a/c75 0 2024-02-28T16:24:00.723 INFO:tasks.workunit.client.0.smithi023.stdout:3/151: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:24:00.724 INFO:tasks.workunit.client.0.smithi023.stdout:1/263: dread df/d11/d13/d1b/d30/f41 [0,4194304] 0 2024-02-28T16:24:00.726 INFO:tasks.workunit.client.0.smithi023.stdout:1/264: chown df/d26/f5b 91392969 1 2024-02-28T16:24:00.726 INFO:tasks.workunit.client.0.smithi023.stdout:8/210: creat d0/d5/d1a/f4b x:0 0 0 2024-02-28T16:24:00.728 INFO:tasks.workunit.client.0.smithi023.stdout:1/265: dread - df/d11/f54 zero size 2024-02-28T16:24:00.730 INFO:tasks.workunit.client.0.smithi023.stdout:5/381: getdents d1/d2a/d32/d58/d73 0 2024-02-28T16:24:00.732 INFO:tasks.workunit.client.0.smithi023.stdout:1/266: chown df/d11/d13/f2c 9320919 1 2024-02-28T16:24:00.734 INFO:tasks.workunit.client.0.smithi023.stdout:5/382: creat d1/df/d62/f76 x:0 0 0 2024-02-28T16:24:00.735 INFO:tasks.workunit.client.0.smithi023.stdout:1/267: write df/d11/d13/d1b/f39 [1310636,107097] 0 2024-02-28T16:24:00.736 INFO:tasks.workunit.client.0.smithi023.stdout:1/268: readlink df/d11/l23 0 2024-02-28T16:24:00.738 INFO:tasks.workunit.client.0.smithi023.stdout:5/383: fdatasync d1/d2a/f44 0 2024-02-28T16:24:00.739 INFO:tasks.workunit.client.0.smithi023.stdout:3/152: dread d1/df/f19 [0,4194304] 0 2024-02-28T16:24:00.740 INFO:tasks.workunit.client.0.smithi023.stdout:3/153: rename d1 to d1/df/d25/d2a 22 2024-02-28T16:24:00.745 INFO:tasks.workunit.client.0.smithi023.stdout:8/211: dwrite d0/d5/f41 [0,4194304] 0 2024-02-28T16:24:00.746 INFO:tasks.workunit.client.0.smithi023.stdout:3/154: creat d1/f2b x:0 0 0 2024-02-28T16:24:00.746 INFO:tasks.workunit.client.0.smithi023.stdout:5/384: getdents d1/d2a/d32/d58 0 2024-02-28T16:24:00.747 INFO:tasks.workunit.client.0.smithi023.stdout:8/212: readlink d0/d5/le 0 2024-02-28T16:24:00.749 INFO:tasks.workunit.client.0.smithi023.stdout:3/155: write d1/df/f16 [1184237,56343] 0 2024-02-28T16:24:00.749 INFO:tasks.workunit.client.0.smithi023.stdout:8/213: dread - d0/d5/f26 zero size 2024-02-28T16:24:00.751 INFO:tasks.workunit.client.0.smithi023.stdout:3/156: write d1/f2b [505695,41411] 0 2024-02-28T16:24:00.761 INFO:tasks.workunit.client.0.smithi023.stdout:3/157: creat d1/f2c x:0 0 0 2024-02-28T16:24:00.766 INFO:tasks.workunit.client.0.smithi023.stdout:3/158: mkdir d1/df/d2d 0 2024-02-28T16:24:00.767 INFO:tasks.workunit.client.0.smithi023.stdout:2/157: sync 2024-02-28T16:24:00.768 INFO:tasks.workunit.client.0.smithi023.stdout:8/214: dwrite d0/d5/d1a/f4b [0,4194304] 0 2024-02-28T16:24:00.770 INFO:tasks.workunit.client.0.smithi023.stdout:2/158: chown d5/da/l16 9447 1 2024-02-28T16:24:00.772 INFO:tasks.workunit.client.0.smithi023.stdout:2/159: chown d5/l9 72593960 1 2024-02-28T16:24:00.772 INFO:tasks.workunit.client.0.smithi023.stdout:3/159: mknod d1/df/d25/c2e 0 2024-02-28T16:24:00.773 INFO:tasks.workunit.client.0.smithi023.stdout:2/160: chown d5/dc 1534157211 1 2024-02-28T16:24:00.774 INFO:tasks.workunit.client.0.smithi023.stdout:3/160: stat d1/df/f19 0 2024-02-28T16:24:00.786 INFO:tasks.workunit.client.0.smithi023.stdout:1/269: dread f2 [0,4194304] 0 2024-02-28T16:24:00.793 INFO:tasks.workunit.client.0.smithi023.stdout:2/161: dread d5/da/d1b/f1e [0,4194304] 0 2024-02-28T16:24:00.794 INFO:tasks.workunit.client.0.smithi023.stdout:2/162: chown d5/da/db/d17 93356659 1 2024-02-28T16:24:00.795 INFO:tasks.workunit.client.0.smithi023.stdout:1/270: link df/d11/d13/d1b/d30/f41 df/d11/d13/d27/f5f 0 2024-02-28T16:24:00.798 INFO:tasks.workunit.client.0.smithi023.stdout:2/163: symlink d5/da/l29 0 2024-02-28T16:24:00.805 INFO:tasks.workunit.client.0.smithi023.stdout:1/271: dread df/f16 [0,4194304] 0 2024-02-28T16:24:00.806 INFO:tasks.workunit.client.0.smithi023.stdout:3/161: getdents d1/df 0 2024-02-28T16:24:00.809 INFO:tasks.workunit.client.0.smithi023.stdout:2/164: getdents d5/da/db/d17 0 2024-02-28T16:24:00.811 INFO:tasks.workunit.client.0.smithi023.stdout:1/272: creat df/d11/d13/d1b/d30/f60 x:0 0 0 2024-02-28T16:24:00.812 INFO:tasks.workunit.client.0.smithi023.stdout:5/385: dwrite d1/d2a/d32/d37/d3a/f48 [0,4194304] 0 2024-02-28T16:24:00.814 INFO:tasks.workunit.client.0.smithi023.stdout:3/162: symlink d1/l2f 0 2024-02-28T16:24:00.816 INFO:tasks.workunit.client.0.smithi023.stdout:2/165: creat d5/da/db/d17/f2a x:0 0 0 2024-02-28T16:24:00.819 INFO:tasks.workunit.client.0.smithi023.stdout:3/163: dread d1/df/f1e [0,4194304] 0 2024-02-28T16:24:00.820 INFO:tasks.workunit.client.0.smithi023.stdout:8/215: truncate d0/d5/d1b/f33 581915 0 2024-02-28T16:24:00.824 INFO:tasks.workunit.client.0.smithi023.stdout:3/164: creat d1/df/f30 x:0 0 0 2024-02-28T16:24:00.907 INFO:tasks.workunit.client.0.smithi023.stdout:8/216: creat d0/d5/d1a/d2d/d30/d39/f4c x:0 0 0 2024-02-28T16:24:00.916 INFO:tasks.workunit.client.0.smithi023.stdout:5/386: dwrite d1/df/f24 [0,4194304] 0 2024-02-28T16:24:00.917 INFO:tasks.workunit.client.0.smithi023.stdout:8/217: creat d0/d5/d1b/f4d x:0 0 0 2024-02-28T16:24:00.920 INFO:tasks.workunit.client.0.smithi023.stdout:2/166: dwrite d5/da/db/d17/f27 [0,4194304] 0 2024-02-28T16:24:00.927 INFO:tasks.workunit.client.0.smithi023.stdout:3/165: dread d1/f8 [0,4194304] 0 2024-02-28T16:24:00.929 INFO:tasks.workunit.client.0.smithi023.stdout:8/218: symlink d0/d5/d35/l4e 0 2024-02-28T16:24:00.931 INFO:tasks.workunit.client.0.smithi023.stdout:8/219: dread - d0/d5/d1b/f43 zero size 2024-02-28T16:24:00.934 INFO:tasks.workunit.client.0.smithi023.stdout:8/220: write d0/d5/f28 [8629528,59227] 0 2024-02-28T16:24:00.934 INFO:tasks.workunit.client.0.smithi023.stdout:5/387: rename d1/d2a/l31 to d1/d2a/l77 0 2024-02-28T16:24:00.937 INFO:tasks.workunit.client.0.smithi023.stdout:5/388: write d1/d2a/d32/d36/f43 [1078745,8905] 0 2024-02-28T16:24:00.938 INFO:tasks.workunit.client.0.smithi023.stdout:8/221: write d0/d5/d1a/d2d/d30/d39/f4c [695859,86030] 0 2024-02-28T16:24:00.943 INFO:tasks.workunit.client.0.smithi023.stdout:5/389: dread d1/f39 [0,4194304] 0 2024-02-28T16:24:00.944 INFO:tasks.workunit.client.0.smithi023.stdout:3/166: dread d1/f1c [0,4194304] 0 2024-02-28T16:24:00.952 INFO:tasks.workunit.client.0.smithi023.stdout:5/390: chown d1/d2a/l35 0 1 2024-02-28T16:24:00.956 INFO:tasks.workunit.client.0.smithi023.stdout:5/391: mkdir d1/d2a/d32/d58/d73/d78 0 2024-02-28T16:24:00.958 INFO:tasks.workunit.client.0.smithi023.stdout:5/392: dread - d1/df/d62/f72 zero size 2024-02-28T16:24:00.962 INFO:tasks.workunit.client.0.smithi023.stdout:8/222: getdents d0/d5 0 2024-02-28T16:24:00.966 INFO:tasks.workunit.client.0.smithi023.stdout:5/393: read d1/df/f14 [3164001,69305] 0 2024-02-28T16:24:00.968 INFO:tasks.workunit.client.0.smithi023.stdout:3/167: dwrite d1/f1c [0,4194304] 0 2024-02-28T16:24:00.982 INFO:tasks.workunit.client.0.smithi023.stdout:5/394: dread d1/d2a/d32/d36/f66 [0,4194304] 0 2024-02-28T16:24:00.985 INFO:tasks.workunit.client.0.smithi023.stdout:9/209: sync 2024-02-28T16:24:00.987 INFO:tasks.workunit.client.0.smithi023.stdout:9/210: readlink d0/d7/de/l12 0 2024-02-28T16:24:00.990 INFO:tasks.workunit.client.0.smithi023.stdout:9/211: fdatasync d0/d7/ff 0 2024-02-28T16:24:00.990 INFO:tasks.workunit.client.0.smithi023.stdout:3/168: dwrite d1/df/d22/f1d [0,4194304] 0 2024-02-28T16:24:00.991 INFO:tasks.workunit.client.0.smithi023.stdout:5/395: unlink d1/d2a/d32/d58/d73/c65 0 2024-02-28T16:24:00.992 INFO:tasks.workunit.client.0.smithi023.stdout:3/169: readlink d1/l2f 0 2024-02-28T16:24:01.001 INFO:tasks.workunit.client.0.smithi023.stdout:3/170: creat d1/df/d2d/f31 x:0 0 0 2024-02-28T16:24:01.002 INFO:tasks.workunit.client.0.smithi023.stdout:3/171: chown d1/f20 4850 1 2024-02-28T16:24:01.005 INFO:tasks.workunit.client.0.smithi023.stdout:5/396: dread d1/d2a/d32/d36/f43 [0,4194304] 0 2024-02-28T16:24:01.011 INFO:tasks.workunit.client.0.smithi023.stdout:2/167: truncate d5/da/f15 3187800 0 2024-02-28T16:24:01.016 INFO:tasks.workunit.client.0.smithi023.stdout:5/397: getdents d1/d2a/d32/d37 0 2024-02-28T16:24:01.020 INFO:tasks.workunit.client.0.smithi023.stdout:5/398: getdents d1/d2a/d32/d58/d73/d78 0 2024-02-28T16:24:01.023 INFO:tasks.workunit.client.0.smithi023.stdout:0/169: sync 2024-02-28T16:24:01.024 INFO:tasks.workunit.client.0.smithi023.stdout:5/399: mkdir d1/d2a/d32/d58/d79 0 2024-02-28T16:24:01.025 INFO:tasks.workunit.client.0.smithi023.stdout:0/170: readlink d6/d13/l30 0 2024-02-28T16:24:01.029 INFO:tasks.workunit.client.0.smithi023.stdout:5/400: write d1/d2a/d32/d37/d3a/f50 [2418479,81458] 0 2024-02-28T16:24:01.032 INFO:tasks.workunit.client.0.smithi023.stdout:8/223: dwrite d0/d5/d1b/f19 [4194304,4194304] 0 2024-02-28T16:24:01.034 INFO:tasks.workunit.client.0.smithi023.stdout:8/224: fdatasync d0/d5/d1a/f4b 0 2024-02-28T16:24:01.037 INFO:tasks.workunit.client.0.smithi023.stdout:8/225: dread - d0/d5/d1b/f43 zero size 2024-02-28T16:24:01.039 INFO:tasks.workunit.client.0.smithi023.stdout:8/226: chown d0/d5/d1a/f2f 9 1 2024-02-28T16:24:01.041 INFO:tasks.workunit.client.0.smithi023.stdout:0/171: getdents d6/db/d1a/d1b 0 2024-02-28T16:24:01.043 INFO:tasks.workunit.client.0.smithi023.stdout:3/172: getdents d1/df/d2d 0 2024-02-28T16:24:01.047 INFO:tasks.workunit.client.0.smithi023.stdout:8/227: rename d0/d5/d1b/f3a to d0/d5/d1a/d44/f4f 0 2024-02-28T16:24:01.050 INFO:tasks.workunit.client.0.smithi023.stdout:8/228: dread - d0/d5/f26 zero size 2024-02-28T16:24:01.056 INFO:tasks.workunit.client.0.smithi023.stdout:9/212: dread d0/d7/ff [4194304,4194304] 0 2024-02-28T16:24:01.061 INFO:tasks.workunit.client.0.smithi023.stdout:9/213: mkdir d0/d7/db/d18/d23/d28/d32/d46 0 2024-02-28T16:24:01.070 INFO:tasks.workunit.client.0.smithi023.stdout:9/214: truncate d0/d7/db/f15 5202202 0 2024-02-28T16:24:01.072 INFO:tasks.workunit.client.0.smithi023.stdout:3/173: dwrite d1/df/d22/f1b [0,4194304] 0 2024-02-28T16:24:01.072 INFO:tasks.workunit.client.0.smithi023.stdout:5/401: dwrite d1/f39 [0,4194304] 0 2024-02-28T16:24:01.075 INFO:tasks.workunit.client.0.smithi023.stdout:8/229: dwrite d0/d5/d1b/f20 [0,4194304] 0 2024-02-28T16:24:01.076 INFO:tasks.workunit.client.0.smithi023.stdout:3/174: dread - d1/df/f29 zero size 2024-02-28T16:24:01.083 INFO:tasks.workunit.client.0.smithi023.stdout:5/402: truncate d1/d2a/d32/d37/d3a/f6d 154502 0 2024-02-28T16:24:01.083 INFO:tasks.workunit.client.0.smithi023.stdout:9/215: mknod d0/d7/db/d18/d23/d28/d32/c47 0 2024-02-28T16:24:01.084 INFO:tasks.workunit.client.0.smithi023.stdout:8/230: write d0/d5/f28 [7550603,123908] 0 2024-02-28T16:24:01.089 INFO:tasks.workunit.client.0.smithi023.stdout:0/172: dread d6/db/f16 [0,4194304] 0 2024-02-28T16:24:01.096 INFO:tasks.workunit.client.0.smithi023.stdout:8/231: mknod d0/c50 0 2024-02-28T16:24:01.096 INFO:tasks.workunit.client.0.smithi023.stdout:5/403: truncate d1/df/f25 1877399 0 2024-02-28T16:24:01.103 INFO:tasks.workunit.client.0.smithi023.stdout:8/232: chown d0/d5/d1a/d2d/d30/f46 1623587 1 2024-02-28T16:24:01.103 INFO:tasks.workunit.client.0.smithi023.stdout:3/175: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:24:01.106 INFO:tasks.workunit.client.0.smithi023.stdout:5/404: stat d1/df/c1e 0 2024-02-28T16:24:01.107 INFO:tasks.workunit.client.0.smithi023.stdout:9/216: dwrite d0/d7/de/f26 [0,4194304] 0 2024-02-28T16:24:01.110 INFO:tasks.workunit.client.0.smithi023.stdout:8/233: mknod d0/d5/d1b/c51 0 2024-02-28T16:24:01.110 INFO:tasks.workunit.client.0.smithi023.stdout:9/217: fdatasync d0/d7/ff 0 2024-02-28T16:24:01.114 INFO:tasks.workunit.client.0.smithi023.stdout:3/176: truncate d1/df/f1e 370808 0 2024-02-28T16:24:01.120 INFO:tasks.workunit.client.0.smithi023.stdout:5/405: mknod d1/d2a/d32/d58/d73/c7a 0 2024-02-28T16:24:01.121 INFO:tasks.workunit.client.0.smithi023.stdout:9/218: write d0/d7/de/f26 [4211858,76244] 0 2024-02-28T16:24:01.122 INFO:tasks.workunit.client.0.smithi023.stdout:8/234: symlink d0/d5/d1a/d2d/d30/d39/d3d/d3e/l52 0 2024-02-28T16:24:01.124 INFO:tasks.workunit.client.0.smithi023.stdout:8/235: stat d0/la 0 2024-02-28T16:24:01.128 INFO:tasks.workunit.client.0.smithi023.stdout:8/236: readlink d0/d5/d1b/d36/l47 0 2024-02-28T16:24:01.133 INFO:tasks.workunit.client.0.smithi023.stdout:8/237: fsync d0/d5/d1a/d44/f4f 0 2024-02-28T16:24:01.136 INFO:tasks.workunit.client.0.smithi023.stdout:9/219: mknod d0/c48 0 2024-02-28T16:24:01.139 INFO:tasks.workunit.client.0.smithi023.stdout:5/406: getdents d1/d2a 0 2024-02-28T16:24:01.142 INFO:tasks.workunit.client.0.smithi023.stdout:5/407: dread - d1/df/d62/f72 zero size 2024-02-28T16:24:01.143 INFO:tasks.workunit.client.0.smithi023.stdout:9/220: unlink d0/d7/de/d34/c40 0 2024-02-28T16:24:01.148 INFO:tasks.workunit.client.0.smithi023.stdout:0/173: dread d6/f10 [4194304,4194304] 0 2024-02-28T16:24:01.153 INFO:tasks.workunit.client.0.smithi023.stdout:0/174: rename d6/c1c to d6/d13/d1f/c34 0 2024-02-28T16:24:01.155 INFO:tasks.workunit.client.0.smithi023.stdout:8/238: dwrite d0/d5/f3c [8388608,4194304] 0 2024-02-28T16:24:01.181 INFO:tasks.workunit.client.0.smithi023.stdout:1/273: sync 2024-02-28T16:24:01.181 INFO:tasks.workunit.client.0.smithi023.stdout:7/155: sync 2024-02-28T16:24:01.181 INFO:tasks.workunit.client.0.smithi023.stdout:4/191: sync 2024-02-28T16:24:01.182 INFO:tasks.workunit.client.0.smithi023.stdout:6/310: sync 2024-02-28T16:24:01.196 INFO:tasks.workunit.client.0.smithi023.stdout:0/175: readlink d6/d13/d1f/l2a 0 2024-02-28T16:24:01.198 INFO:tasks.workunit.client.0.smithi023.stdout:3/177: dread d1/df/d22/f14 [0,4194304] 0 2024-02-28T16:24:01.199 INFO:tasks.workunit.client.0.smithi023.stdout:8/239: unlink d0/f1f 0 2024-02-28T16:24:01.201 INFO:tasks.workunit.client.0.smithi023.stdout:4/192: write d13/d1d/f20 [1094302,60192] 0 2024-02-28T16:24:01.203 INFO:tasks.workunit.client.0.smithi023.stdout:4/193: readlink ld 0 2024-02-28T16:24:01.207 INFO:tasks.workunit.client.0.smithi023.stdout:5/408: dwrite d1/d2a/d32/d37/d3a/f6a [0,4194304] 0 2024-02-28T16:24:01.207 INFO:tasks.workunit.client.0.smithi023.stdout:7/156: mknod de/d1c/c36 0 2024-02-28T16:24:01.209 INFO:tasks.workunit.client.0.smithi023.stdout:6/311: symlink d1/d28/d1e/d2b/d6d/l75 0 2024-02-28T16:24:01.210 INFO:tasks.workunit.client.0.smithi023.stdout:7/157: fsync de/d13/f1a 0 2024-02-28T16:24:01.215 INFO:tasks.workunit.client.0.smithi023.stdout:0/176: dread d6/f10 [4194304,4194304] 0 2024-02-28T16:24:01.215 INFO:tasks.workunit.client.0.smithi023.stdout:6/312: mkdir d1/d28/d1e/d2b/d76 0 2024-02-28T16:24:01.217 INFO:tasks.workunit.client.0.smithi023.stdout:7/158: creat de/d2f/f37 x:0 0 0 2024-02-28T16:24:01.222 INFO:tasks.workunit.client.0.smithi023.stdout:7/159: truncate de/d13/f22 1646477 0 2024-02-28T16:24:01.223 INFO:tasks.workunit.client.0.smithi023.stdout:0/177: mkdir d6/db/d1a/d35 0 2024-02-28T16:24:01.225 INFO:tasks.workunit.client.0.smithi023.stdout:8/240: link d0/d5/d1b/c51 d0/d5/d1a/d2d/d30/d39/d3d/d3e/c53 0 2024-02-28T16:24:01.230 INFO:tasks.workunit.client.0.smithi023.stdout:0/178: creat d6/f36 x:0 0 0 2024-02-28T16:24:01.231 INFO:tasks.workunit.client.0.smithi023.stdout:5/409: dwrite d1/f55 [0,4194304] 0 2024-02-28T16:24:01.234 INFO:tasks.workunit.client.0.smithi023.stdout:8/241: mkdir d0/d5/d54 0 2024-02-28T16:24:01.241 INFO:tasks.workunit.client.0.smithi023.stdout:5/410: mkdir d1/df/d62/d7b 0 2024-02-28T16:24:01.242 INFO:tasks.workunit.client.0.smithi023.stdout:1/274: write df/d26/f3f [303334,92216] 0 2024-02-28T16:24:01.251 INFO:tasks.workunit.client.0.smithi023.stdout:7/160: dwrite de/f12 [0,4194304] 0 2024-02-28T16:24:01.252 INFO:tasks.workunit.client.0.smithi023.stdout:5/411: dread d1/df/f3c [0,4194304] 0 2024-02-28T16:24:01.254 INFO:tasks.workunit.client.0.smithi023.stdout:5/412: chown d1/d2a/d32/d37 86 1 2024-02-28T16:24:01.257 INFO:tasks.workunit.client.0.smithi023.stdout:0/179: dwrite d6/d13/f28 [0,4194304] 0 2024-02-28T16:24:01.258 INFO:tasks.workunit.client.0.smithi023.stdout:5/413: read - d1/d2a/d32/d37/d4e/f70 zero size 2024-02-28T16:24:01.266 INFO:tasks.workunit.client.0.smithi023.stdout:6/313: dread d1/fd [0,4194304] 0 2024-02-28T16:24:01.271 INFO:tasks.workunit.client.0.smithi023.stdout:1/275: dwrite df/d11/d13/d1b/d30/d3d/f47 [0,4194304] 0 2024-02-28T16:24:01.278 INFO:tasks.workunit.client.0.smithi023.stdout:0/180: mkdir d6/db/d1a/d26/d31/d33/d37 0 2024-02-28T16:24:01.281 INFO:tasks.workunit.client.0.smithi023.stdout:5/414: dwrite d1/f19 [4194304,4194304] 0 2024-02-28T16:24:01.281 INFO:tasks.workunit.client.0.smithi023.stdout:1/276: symlink df/d11/d13/d1b/d30/l61 0 2024-02-28T16:24:01.285 INFO:tasks.workunit.client.0.smithi023.stdout:5/415: readlink d1/d2a/d32/d37/l5c 0 2024-02-28T16:24:01.287 INFO:tasks.workunit.client.0.smithi023.stdout:0/181: write d6/f36 [548475,90002] 0 2024-02-28T16:24:01.287 INFO:tasks.workunit.client.0.smithi023.stdout:1/277: fdatasync df/d11/d13/d1b/d30/d3d/f50 0 2024-02-28T16:24:01.292 INFO:tasks.workunit.client.0.smithi023.stdout:6/314: rename d1/d28/d1e/d52/f6f to d1/d28/f77 0 2024-02-28T16:24:01.294 INFO:tasks.workunit.client.0.smithi023.stdout:1/278: unlink df/f2d 0 2024-02-28T16:24:01.303 INFO:tasks.workunit.client.0.smithi023.stdout:0/182: rename d6/d13/d1f/f32 to d6/db/d1a/d26/f38 0 2024-02-28T16:24:01.305 INFO:tasks.workunit.client.0.smithi023.stdout:0/183: readlink d6/db/lf 0 2024-02-28T16:24:01.310 INFO:tasks.workunit.client.0.smithi023.stdout:1/279: rename df/d26/f3f to df/d11/d13/f62 0 2024-02-28T16:24:01.311 INFO:tasks.workunit.client.0.smithi023.stdout:5/416: getdents d1 0 2024-02-28T16:24:01.314 INFO:tasks.workunit.client.0.smithi023.stdout:5/417: truncate d1/df/f2e 4334765 0 2024-02-28T16:24:01.315 INFO:tasks.workunit.client.0.smithi023.stdout:5/418: chown d1/d2a/d32/d6e 517865 1 2024-02-28T16:24:01.316 INFO:tasks.workunit.client.0.smithi023.stdout:1/280: symlink df/d11/d13/d1b/d30/d57/d5a/l63 0 2024-02-28T16:24:01.320 INFO:tasks.workunit.client.0.smithi023.stdout:5/419: dread d1/d2a/d32/d37/d3a/f6d [0,4194304] 0 2024-02-28T16:24:01.323 INFO:tasks.workunit.client.0.smithi023.stdout:0/184: dread d6/f10 [4194304,4194304] 0 2024-02-28T16:24:01.324 INFO:tasks.workunit.client.0.smithi023.stdout:0/185: write d6/f21 [296329,53695] 0 2024-02-28T16:24:01.325 INFO:tasks.workunit.client.0.smithi023.stdout:1/281: creat df/d11/d13/d1b/d30/d57/d5a/f64 x:0 0 0 2024-02-28T16:24:01.328 INFO:tasks.workunit.client.0.smithi023.stdout:6/315: rmdir d1/d28/d1e/d52 39 2024-02-28T16:24:01.332 INFO:tasks.workunit.client.0.smithi023.stdout:1/282: creat df/d11/d13/d27/f65 x:0 0 0 2024-02-28T16:24:01.332 INFO:tasks.workunit.client.0.smithi023.stdout:6/316: dread - d1/d28/d1e/d2b/d44/f53 zero size 2024-02-28T16:24:01.334 INFO:tasks.workunit.client.0.smithi023.stdout:8/242: dwrite d0/d5/d1a/d2d/d30/d39/d3d/d3e/f48 [0,4194304] 0 2024-02-28T16:24:01.334 INFO:tasks.workunit.client.0.smithi023.stdout:0/186: fsync d6/db/d1a/d1b/f1d 0 2024-02-28T16:24:01.336 INFO:tasks.workunit.client.0.smithi023.stdout:0/187: read d6/d13/f28 [1612849,31318] 0 2024-02-28T16:24:01.336 INFO:tasks.workunit.client.0.smithi023.stdout:6/317: dread - d1/d28/d1e/d2b/d44/f53 zero size 2024-02-28T16:24:01.337 INFO:tasks.workunit.client.0.smithi023.stdout:5/420: dread d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:24:01.340 INFO:tasks.workunit.client.0.smithi023.stdout:0/188: chown d6/db/f16 4070474 1 2024-02-28T16:24:01.340 INFO:tasks.workunit.client.0.smithi023.stdout:8/243: chown d0/d5/d1b/l16 216393901 1 2024-02-28T16:24:01.340 INFO:tasks.workunit.client.0.smithi023.stdout:6/318: write d1/d28/f5f [582258,86167] 0 2024-02-28T16:24:01.341 INFO:tasks.workunit.client.0.smithi023.stdout:5/421: write d1/d2a/d32/d37/d4e/f70 [288097,74374] 0 2024-02-28T16:24:01.342 INFO:tasks.workunit.client.0.smithi023.stdout:6/319: stat d1/d28/f62 0 2024-02-28T16:24:01.346 INFO:tasks.workunit.client.0.smithi023.stdout:0/189: write d6/db/d1a/d2e/f2f [244728,92563] 0 2024-02-28T16:24:01.348 INFO:tasks.workunit.client.0.smithi023.stdout:5/422: creat d1/f7c x:0 0 0 2024-02-28T16:24:01.348 INFO:tasks.workunit.client.0.smithi023.stdout:0/190: chown d6/d13/f28 24925252 1 2024-02-28T16:24:01.352 INFO:tasks.workunit.client.0.smithi023.stdout:6/320: mknod d1/d28/d1e/d2b/d76/c78 0 2024-02-28T16:24:01.354 INFO:tasks.workunit.client.0.smithi023.stdout:0/191: creat d6/db/f39 x:0 0 0 2024-02-28T16:24:01.357 INFO:tasks.workunit.client.0.smithi023.stdout:0/192: write f4 [3554103,81024] 0 2024-02-28T16:24:01.359 INFO:tasks.workunit.client.0.smithi023.stdout:6/321: fsync d1/d18/d26/d3a/f3f 0 2024-02-28T16:24:01.361 INFO:tasks.workunit.client.0.smithi023.stdout:8/244: dread d0/d5/f28 [0,4194304] 0 2024-02-28T16:24:01.365 INFO:tasks.workunit.client.0.smithi023.stdout:5/423: dread d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:24:01.367 INFO:tasks.workunit.client.0.smithi023.stdout:6/322: rename d1/d18/d26/c5c to d1/d3d/c79 0 2024-02-28T16:24:01.369 INFO:tasks.workunit.client.0.smithi023.stdout:5/424: mknod d1/df/c7d 0 2024-02-28T16:24:01.370 INFO:tasks.workunit.client.0.smithi023.stdout:2/168: sync 2024-02-28T16:24:01.370 INFO:tasks.workunit.client.0.smithi023.stdout:6/323: symlink d1/d28/d1e/d2b/l7a 0 2024-02-28T16:24:01.372 INFO:tasks.workunit.client.0.smithi023.stdout:6/324: chown d1/f22 118 1 2024-02-28T16:24:01.376 INFO:tasks.workunit.client.0.smithi023.stdout:2/169: link f4 d5/dc/f2b 0 2024-02-28T16:24:01.376 INFO:tasks.workunit.client.0.smithi023.stdout:5/425: creat d1/d2a/d32/d37/d3a/f7e x:0 0 0 2024-02-28T16:24:01.377 INFO:tasks.workunit.client.0.smithi023.stdout:8/245: dread d0/d5/f28 [8388608,4194304] 0 2024-02-28T16:24:01.377 INFO:tasks.workunit.client.0.smithi023.stdout:6/325: mkdir d1/d28/d1e/d2b/d6d/d7b 0 2024-02-28T16:24:01.379 INFO:tasks.workunit.client.0.smithi023.stdout:8/246: chown d0/f18 97 1 2024-02-28T16:24:01.379 INFO:tasks.workunit.client.0.smithi023.stdout:2/170: write d5/f1f [334516,63978] 0 2024-02-28T16:24:01.382 INFO:tasks.workunit.client.0.smithi023.stdout:6/326: mknod d1/d28/d1e/d2b/d6d/c7c 0 2024-02-28T16:24:01.386 INFO:tasks.workunit.client.0.smithi023.stdout:6/327: chown d1/d28/d1e/l33 1 1 2024-02-28T16:24:01.388 INFO:tasks.workunit.client.0.smithi023.stdout:6/328: truncate d1/f40 1809725 0 2024-02-28T16:24:01.389 INFO:tasks.workunit.client.0.smithi023.stdout:8/247: dread d0/d5/d1a/f2f [0,4194304] 0 2024-02-28T16:24:01.394 INFO:tasks.workunit.client.0.smithi023.stdout:0/193: dread f4 [0,4194304] 0 2024-02-28T16:24:01.401 INFO:tasks.workunit.client.0.smithi023.stdout:0/194: rmdir d6/d13 39 2024-02-28T16:24:01.404 INFO:tasks.workunit.client.0.smithi023.stdout:2/171: dwrite d5/dc/f21 [0,4194304] 0 2024-02-28T16:24:01.408 INFO:tasks.workunit.client.0.smithi023.stdout:0/195: stat d6/db/c19 0 2024-02-28T16:24:01.410 INFO:tasks.workunit.client.0.smithi023.stdout:8/248: dwrite d0/d5/f41 [0,4194304] 0 2024-02-28T16:24:01.410 INFO:tasks.workunit.client.0.smithi023.stdout:5/426: dread d1/d2a/f44 [0,4194304] 0 2024-02-28T16:24:01.416 INFO:tasks.workunit.client.0.smithi023.stdout:5/427: rmdir d1/df/d62/d68 39 2024-02-28T16:24:01.418 INFO:tasks.workunit.client.0.smithi023.stdout:8/249: rmdir d0/d5/d1a/d2d/d30/d39/d3d 39 2024-02-28T16:24:01.422 INFO:tasks.workunit.client.0.smithi023.stdout:8/250: write d0/d5/d1a/f4b [3541710,9176] 0 2024-02-28T16:24:01.429 INFO:tasks.workunit.client.0.smithi023.stdout:5/428: rename d1/df to d1/d2a/d32/d37/d3a/d7f 0 2024-02-28T16:24:01.430 INFO:tasks.workunit.client.0.smithi023.stdout:0/196: dread d6/db/fd [0,4194304] 0 2024-02-28T16:24:01.434 INFO:tasks.workunit.client.0.smithi023.stdout:5/429: read d1/d2a/d32/d37/d3a/d7f/d62/f6b [86477,31179] 0 2024-02-28T16:24:01.435 INFO:tasks.workunit.client.0.smithi023.stdout:0/197: rename d6/db/d1a to d6/db/d1a/d35/d3a 22 2024-02-28T16:24:01.435 INFO:tasks.workunit.client.0.smithi023.stdout:8/251: symlink d0/d5/d1a/d2d/d30/d39/d3d/l55 0 2024-02-28T16:24:01.438 INFO:tasks.workunit.client.0.smithi023.stdout:5/430: mknod d1/d2a/d32/d37/c80 0 2024-02-28T16:24:01.440 INFO:tasks.workunit.client.0.smithi023.stdout:8/252: mknod d0/d5/d1b/d36/c56 0 2024-02-28T16:24:01.442 INFO:tasks.workunit.client.0.smithi023.stdout:2/172: dread d5/f11 [0,4194304] 0 2024-02-28T16:24:01.443 INFO:tasks.workunit.client.0.smithi023.stdout:5/431: mkdir d1/d2a/d32/d58/d60/d81 0 2024-02-28T16:24:01.443 INFO:tasks.workunit.client.0.smithi023.stdout:5/432: chown d1 0 1 2024-02-28T16:24:01.445 INFO:tasks.workunit.client.0.smithi023.stdout:2/173: read d5/da/f28 [4095796,18389] 0 2024-02-28T16:24:01.445 INFO:tasks.workunit.client.0.smithi023.stdout:8/253: read d0/fc [2046034,81545] 0 2024-02-28T16:24:01.446 INFO:tasks.workunit.client.0.smithi023.stdout:5/433: write d1/d2a/f44 [4574440,122372] 0 2024-02-28T16:24:01.449 INFO:tasks.workunit.client.0.smithi023.stdout:8/254: unlink d0/c50 0 2024-02-28T16:24:01.452 INFO:tasks.workunit.client.0.smithi023.stdout:5/434: unlink d1/cd 0 2024-02-28T16:24:01.453 INFO:tasks.workunit.client.0.smithi023.stdout:0/198: dwrite d6/db/f2d [0,4194304] 0 2024-02-28T16:24:01.454 INFO:tasks.workunit.client.0.smithi023.stdout:5/435: chown d1/d2a/d32/d58 25220269 1 2024-02-28T16:24:01.457 INFO:tasks.workunit.client.0.smithi023.stdout:8/255: mknod d0/d5/d1a/d44/c57 0 2024-02-28T16:24:01.458 INFO:tasks.workunit.client.0.smithi023.stdout:2/174: dread d5/dc/f24 [0,4194304] 0 2024-02-28T16:24:01.465 INFO:tasks.workunit.client.0.smithi023.stdout:0/199: rename d6/d13 to d6/db/d3b 0 2024-02-28T16:24:01.467 INFO:tasks.workunit.client.0.smithi023.stdout:2/175: creat d5/da/d1b/f2c x:0 0 0 2024-02-28T16:24:01.470 INFO:tasks.workunit.client.0.smithi023.stdout:0/200: rmdir d6/db/d3b/d1f 39 2024-02-28T16:24:01.473 INFO:tasks.workunit.client.0.smithi023.stdout:2/176: symlink d5/da/l2d 0 2024-02-28T16:24:01.474 INFO:tasks.workunit.client.0.smithi023.stdout:5/436: dread d1/d2a/d32/d37/d3a/d7f/f3c [0,4194304] 0 2024-02-28T16:24:01.477 INFO:tasks.workunit.client.0.smithi023.stdout:5/437: chown d1/d2a/c33 189665064 1 2024-02-28T16:24:01.477 INFO:tasks.workunit.client.0.smithi023.stdout:8/256: dwrite d0/d5/d1a/d44/f4f [0,4194304] 0 2024-02-28T16:24:01.481 INFO:tasks.workunit.client.0.smithi023.stdout:0/201: symlink d6/db/d3b/l3c 0 2024-02-28T16:24:01.481 INFO:tasks.workunit.client.0.smithi023.stdout:2/177: symlink d5/da/d1b/l2e 0 2024-02-28T16:24:01.481 INFO:tasks.workunit.client.0.smithi023.stdout:2/178: dread - d5/da/db/f23 zero size 2024-02-28T16:24:01.482 INFO:tasks.workunit.client.0.smithi023.stdout:0/202: fdatasync d6/db/d1a/d2e/f2f 0 2024-02-28T16:24:01.484 INFO:tasks.workunit.client.0.smithi023.stdout:8/257: readlink d0/d5/d35/l4e 0 2024-02-28T16:24:01.486 INFO:tasks.workunit.client.0.smithi023.stdout:5/438: rmdir d1/d2a/d32/d58/d73/d78 0 2024-02-28T16:24:01.487 INFO:tasks.workunit.client.0.smithi023.stdout:0/203: write d6/db/f16 [3595622,36588] 0 2024-02-28T16:24:01.488 INFO:tasks.workunit.client.0.smithi023.stdout:8/258: chown d0/d5/d1b/f19 1698 1 2024-02-28T16:24:01.489 INFO:tasks.workunit.client.0.smithi023.stdout:2/179: dread d5/dc/f24 [0,4194304] 0 2024-02-28T16:24:01.492 INFO:tasks.workunit.client.0.smithi023.stdout:5/439: mkdir d1/d2a/d32/d58/d60/d82 0 2024-02-28T16:24:01.494 INFO:tasks.workunit.client.0.smithi023.stdout:2/180: creat d5/f2f x:0 0 0 2024-02-28T16:24:01.496 INFO:tasks.workunit.client.0.smithi023.stdout:0/204: getdents d6/db/d24 0 2024-02-28T16:24:01.497 INFO:tasks.workunit.client.0.smithi023.stdout:2/181: rmdir d5/da 39 2024-02-28T16:24:01.500 INFO:tasks.workunit.client.0.smithi023.stdout:0/205: mkdir d6/db/d3d 0 2024-02-28T16:24:01.501 INFO:tasks.workunit.client.0.smithi023.stdout:2/182: truncate d5/f11 4959863 0 2024-02-28T16:24:01.504 INFO:tasks.workunit.client.0.smithi023.stdout:8/259: dread d0/f18 [0,4194304] 0 2024-02-28T16:24:01.506 INFO:tasks.workunit.client.0.smithi023.stdout:0/206: dread d6/db/d1a/d2e/f2f [0,4194304] 0 2024-02-28T16:24:01.506 INFO:tasks.workunit.client.0.smithi023.stdout:8/260: fdatasync d0/d5/d1a/f4b 0 2024-02-28T16:24:01.506 INFO:tasks.workunit.client.0.smithi023.stdout:5/440: dread d1/f19 [4194304,4194304] 0 2024-02-28T16:24:01.507 INFO:tasks.workunit.client.0.smithi023.stdout:2/183: link d5/dc/f21 d5/dc/f30 0 2024-02-28T16:24:01.511 INFO:tasks.workunit.client.0.smithi023.stdout:5/441: symlink d1/d2a/d32/d37/d3a/l83 0 2024-02-28T16:24:01.515 INFO:tasks.workunit.client.0.smithi023.stdout:2/184: getdents d5/da/db 0 2024-02-28T16:24:01.518 INFO:tasks.workunit.client.0.smithi023.stdout:2/185: symlink d5/da/l31 0 2024-02-28T16:24:01.533 INFO:tasks.workunit.client.0.smithi023.stdout:0/207: dread d6/db/d1a/d1b/f27 [0,4194304] 0 2024-02-28T16:24:01.533 INFO:tasks.workunit.client.0.smithi023.stdout:2/186: truncate d5/dc/f24 309340 0 2024-02-28T16:24:01.535 INFO:tasks.workunit.client.0.smithi023.stdout:9/221: sync 2024-02-28T16:24:01.535 INFO:tasks.workunit.client.0.smithi023.stdout:0/208: fsync d6/f10 0 2024-02-28T16:24:01.536 INFO:tasks.workunit.client.0.smithi023.stdout:9/222: write d0/d7/ff [7295017,128127] 0 2024-02-28T16:24:01.538 INFO:tasks.workunit.client.0.smithi023.stdout:2/187: rename d5/f2f to d5/da/f32 0 2024-02-28T16:24:01.538 INFO:tasks.workunit.client.0.smithi023.stdout:0/209: chown d6/db/d1a/d26/f38 399 1 2024-02-28T16:24:01.540 INFO:tasks.workunit.client.0.smithi023.stdout:9/223: write d0/d7/db/fc [8960692,58681] 0 2024-02-28T16:24:01.542 INFO:tasks.workunit.client.0.smithi023.stdout:8/261: dread d0/d5/d1a/d2d/d30/d39/f3b [0,4194304] 0 2024-02-28T16:24:01.543 INFO:tasks.workunit.client.0.smithi023.stdout:9/224: rmdir d0/d7/db/d18 39 2024-02-28T16:24:01.546 INFO:tasks.workunit.client.0.smithi023.stdout:0/210: getdents d6/db/d1a 0 2024-02-28T16:24:01.547 INFO:tasks.workunit.client.0.smithi023.stdout:9/225: write d0/f4 [4217475,14644] 0 2024-02-28T16:24:01.548 INFO:tasks.workunit.client.0.smithi023.stdout:8/262: symlink d0/d5/l58 0 2024-02-28T16:24:01.551 INFO:tasks.workunit.client.0.smithi023.stdout:2/188: unlink d5/da/f32 0 2024-02-28T16:24:01.556 INFO:tasks.workunit.client.0.smithi023.stdout:0/211: symlink d6/db/d1a/d26/d31/d33/d37/l3e 0 2024-02-28T16:24:01.558 INFO:tasks.workunit.client.0.smithi023.stdout:0/212: stat d6/db/d1a/d2e/f2f 0 2024-02-28T16:24:01.560 INFO:tasks.workunit.client.0.smithi023.stdout:8/263: unlink d0/d5/d1a/d2d/d30/d39/d3d/d3e/c53 0 2024-02-28T16:24:01.562 INFO:tasks.workunit.client.0.smithi023.stdout:0/213: rmdir d6/db/d1a/d2e 39 2024-02-28T16:24:01.564 INFO:tasks.workunit.client.0.smithi023.stdout:9/226: link d0/d7/db/f24 d0/d7/db/d18/f49 0 2024-02-28T16:24:01.567 INFO:tasks.workunit.client.0.smithi023.stdout:2/189: dwrite d5/da/db/d17/f2a [0,4194304] 0 2024-02-28T16:24:01.567 INFO:tasks.workunit.client.0.smithi023.stdout:0/214: symlink d6/db/d1a/l3f 0 2024-02-28T16:24:01.573 INFO:tasks.workunit.client.0.smithi023.stdout:2/190: creat d5/da/f33 x:0 0 0 2024-02-28T16:24:01.577 INFO:tasks.workunit.client.0.smithi023.stdout:2/191: write d5/da/f28 [1215870,124486] 0 2024-02-28T16:24:01.581 INFO:tasks.workunit.client.0.smithi023.stdout:9/227: getdents d0/d7/db/d18 0 2024-02-28T16:24:01.584 INFO:tasks.workunit.client.0.smithi023.stdout:2/192: rename d5/dc/f2b to d5/dc/f34 0 2024-02-28T16:24:01.584 INFO:tasks.workunit.client.0.smithi023.stdout:0/215: dwrite d6/db/f39 [0,4194304] 0 2024-02-28T16:24:01.587 INFO:tasks.workunit.client.0.smithi023.stdout:0/216: readlink d6/db/d3b/l3c 0 2024-02-28T16:24:01.591 INFO:tasks.workunit.client.0.smithi023.stdout:8/264: truncate d0/d5/d1a/d44/f4f 3823173 0 2024-02-28T16:24:01.592 INFO:tasks.workunit.client.0.smithi023.stdout:8/265: chown d0/d5/d1a/d44 178808 1 2024-02-28T16:24:01.592 INFO:tasks.workunit.client.0.smithi023.stdout:0/217: mknod d6/db/d1a/d26/d31/d33/c40 0 2024-02-28T16:24:01.592 INFO:tasks.workunit.client.0.smithi023.stdout:2/193: creat d5/da/d1b/f35 x:0 0 0 2024-02-28T16:24:01.597 INFO:tasks.workunit.client.0.smithi023.stdout:0/218: mknod d6/db/d1a/d26/d31/c41 0 2024-02-28T16:24:01.599 INFO:tasks.workunit.client.0.smithi023.stdout:2/194: rename d5/f1c to d5/da/d1b/f36 0 2024-02-28T16:24:01.600 INFO:tasks.workunit.client.0.smithi023.stdout:8/266: mknod d0/d5/d1b/c59 0 2024-02-28T16:24:01.600 INFO:tasks.workunit.client.0.smithi023.stdout:0/219: read - d6/db/d1a/d26/f38 zero size 2024-02-28T16:24:01.602 INFO:tasks.workunit.client.0.smithi023.stdout:2/195: chown d5/da/d1b/f36 1151916699 1 2024-02-28T16:24:01.605 INFO:tasks.workunit.client.0.smithi023.stdout:8/267: dread - d0/d5/f40 zero size 2024-02-28T16:24:01.606 INFO:tasks.workunit.client.0.smithi023.stdout:0/220: rmdir d6/db/d1a/d26/d31/d33/d37 39 2024-02-28T16:24:01.606 INFO:tasks.workunit.client.0.smithi023.stdout:9/228: dwrite d0/d7/db/d18/d23/d28/d32/f3f [0,4194304] 0 2024-02-28T16:24:01.607 INFO:tasks.workunit.client.0.smithi023.stdout:0/221: stat d6/db/d3d 0 2024-02-28T16:24:01.615 INFO:tasks.workunit.client.0.smithi023.stdout:9/229: mkdir d0/d7/d2c/d4a 0 2024-02-28T16:24:01.616 INFO:tasks.workunit.client.0.smithi023.stdout:2/196: truncate d5/dc/f30 191367 0 2024-02-28T16:24:01.620 INFO:tasks.workunit.client.0.smithi023.stdout:8/268: symlink d0/d5/d1a/l5a 0 2024-02-28T16:24:01.620 INFO:tasks.workunit.client.0.smithi023.stdout:0/222: mkdir d6/db/d3b/d1f/d42 0 2024-02-28T16:24:01.629 INFO:tasks.workunit.client.0.smithi023.stdout:8/269: symlink d0/l5b 0 2024-02-28T16:24:01.636 INFO:tasks.workunit.client.0.smithi023.stdout:9/230: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:24:01.638 INFO:tasks.workunit.client.0.smithi023.stdout:2/197: dread d5/da/db/d17/f27 [0,4194304] 0 2024-02-28T16:24:01.639 INFO:tasks.workunit.client.0.smithi023.stdout:8/270: creat d0/d5/d1a/d2d/f5c x:0 0 0 2024-02-28T16:24:01.647 INFO:tasks.workunit.client.0.smithi023.stdout:9/231: creat d0/d7/db/d18/d23/d28/d32/d46/f4b x:0 0 0 2024-02-28T16:24:01.650 INFO:tasks.workunit.client.0.smithi023.stdout:8/271: getdents d0/d5/d1a 0 2024-02-28T16:24:01.651 INFO:tasks.workunit.client.0.smithi023.stdout:9/232: mknod d0/d7/db/d18/d23/c4c 0 2024-02-28T16:24:01.654 INFO:tasks.workunit.client.0.smithi023.stdout:8/272: read d0/d5/d1a/f2f [440067,11876] 0 2024-02-28T16:24:01.659 INFO:tasks.workunit.client.0.smithi023.stdout:8/273: write d0/d5/d1a/f2f [337655,82770] 0 2024-02-28T16:24:01.659 INFO:tasks.workunit.client.0.smithi023.stdout:2/198: dwrite d5/da/d1b/f2c [0,4194304] 0 2024-02-28T16:24:01.661 INFO:tasks.workunit.client.0.smithi023.stdout:8/274: stat d0/d5/d1b/l49 0 2024-02-28T16:24:01.664 INFO:tasks.workunit.client.0.smithi023.stdout:9/233: rename d0/d7/db/d18/d23/d28/d32/d46 to d0/d7/de/d2e/d2f/d4d 0 2024-02-28T16:24:01.671 INFO:tasks.workunit.client.0.smithi023.stdout:8/275: rename d0/d5/d1b/f1e to d0/d5/d35/f5d 0 2024-02-28T16:24:01.672 INFO:tasks.workunit.client.0.smithi023.stdout:2/199: link d5/da/db/l1a d5/da/l37 0 2024-02-28T16:24:01.676 INFO:tasks.workunit.client.0.smithi023.stdout:8/276: chown d0/d5/d1a/d2d/d30/c3f 23861360 1 2024-02-28T16:24:01.683 INFO:tasks.workunit.client.0.smithi023.stdout:9/234: dwrite d0/f43 [0,4194304] 0 2024-02-28T16:24:01.683 INFO:tasks.workunit.client.0.smithi023.stdout:8/277: write d0/d5/d1a/d2d/d30/d39/f4c [656199,32799] 0 2024-02-28T16:24:01.691 INFO:tasks.workunit.client.0.smithi023.stdout:2/200: write d5/da/f15 [2936814,31095] 0 2024-02-28T16:24:01.738 INFO:tasks.workunit.client.0.smithi023.stdout:3/178: sync 2024-02-28T16:24:01.738 INFO:tasks.workunit.client.0.smithi023.stdout:3/179: stat d1/f1c 0 2024-02-28T16:24:01.750 INFO:tasks.workunit.client.0.smithi023.stdout:8/278: rename d0/d5/f28 to d0/d5/f5e 0 2024-02-28T16:24:01.753 INFO:tasks.workunit.client.0.smithi023.stdout:3/180: mkdir d1/df/d2d/d32 0 2024-02-28T16:24:01.754 INFO:tasks.workunit.client.0.smithi023.stdout:3/181: chown d1/df/d2d/d32 2053652128 1 2024-02-28T16:24:01.759 INFO:tasks.workunit.client.0.smithi023.stdout:8/279: link d0/d5/d1a/f38 d0/d5/d35/f5f 0 2024-02-28T16:24:01.760 INFO:tasks.workunit.client.0.smithi023.stdout:3/182: unlink d1/df/d22/f1d 0 2024-02-28T16:24:01.761 INFO:tasks.workunit.client.0.smithi023.stdout:3/183: fdatasync d1/f27 0 2024-02-28T16:24:01.767 INFO:tasks.workunit.client.0.smithi023.stdout:3/184: truncate d1/df/d22/f14 2467751 0 2024-02-28T16:24:01.769 INFO:tasks.workunit.client.0.smithi023.stdout:2/201: dwrite d5/da/db/d17/f27 [0,4194304] 0 2024-02-28T16:24:01.771 INFO:tasks.workunit.client.0.smithi023.stdout:3/185: dread d1/df/f16 [0,4194304] 0 2024-02-28T16:24:01.774 INFO:tasks.workunit.client.0.smithi023.stdout:8/280: dread d0/d5/d1a/d44/f4f [0,4194304] 0 2024-02-28T16:24:01.777 INFO:tasks.workunit.client.0.smithi023.stdout:3/186: rename d1/df/d25 to d1/df/d33 0 2024-02-28T16:24:01.780 INFO:tasks.workunit.client.0.smithi023.stdout:8/281: symlink d0/d5/d1a/d2d/d30/l60 0 2024-02-28T16:24:01.781 INFO:tasks.workunit.client.0.smithi023.stdout:3/187: mknod d1/df/d2d/d32/c34 0 2024-02-28T16:24:01.784 INFO:tasks.workunit.client.0.smithi023.stdout:8/282: creat d0/d5/d1a/d2d/f61 x:0 0 0 2024-02-28T16:24:01.785 INFO:tasks.workunit.client.0.smithi023.stdout:3/188: symlink d1/df/d2d/d32/l35 0 2024-02-28T16:24:01.787 INFO:tasks.workunit.client.0.smithi023.stdout:8/283: dread - d0/d5/d35/f5f zero size 2024-02-28T16:24:01.790 INFO:tasks.workunit.client.0.smithi023.stdout:3/189: mknod d1/df/d2d/c36 0 2024-02-28T16:24:01.791 INFO:tasks.workunit.client.0.smithi023.stdout:3/190: fsync d1/df/d2d/f31 0 2024-02-28T16:24:01.796 INFO:tasks.workunit.client.0.smithi023.stdout:3/191: unlink d1/df/d33/f28 0 2024-02-28T16:24:01.799 INFO:tasks.workunit.client.0.smithi023.stdout:8/284: rmdir d0/d5/d54 0 2024-02-28T16:24:01.802 INFO:tasks.workunit.client.0.smithi023.stdout:8/285: write d0/d5/d1a/f2e [1130223,39012] 0 2024-02-28T16:24:01.812 INFO:tasks.workunit.client.0.smithi023.stdout:3/192: dwrite d1/df/f19 [0,4194304] 0 2024-02-28T16:24:01.812 INFO:tasks.workunit.client.0.smithi023.stdout:2/202: dread d5/ff [0,4194304] 0 2024-02-28T16:24:01.814 INFO:tasks.workunit.client.0.smithi023.stdout:2/203: chown d5/da/db/l14 15239026 1 2024-02-28T16:24:01.815 INFO:tasks.workunit.client.0.smithi023.stdout:3/193: mkdir d1/df/d37 0 2024-02-28T16:24:01.816 INFO:tasks.workunit.client.0.smithi023.stdout:3/194: dread - d1/df/f30 zero size 2024-02-28T16:24:01.818 INFO:tasks.workunit.client.0.smithi023.stdout:2/204: creat d5/da/f38 x:0 0 0 2024-02-28T16:24:01.826 INFO:tasks.workunit.client.0.smithi023.stdout:8/286: truncate d0/d5/d1a/d2d/d30/d39/f3b 2258548 0 2024-02-28T16:24:01.826 INFO:tasks.workunit.client.0.smithi023.stdout:2/205: mkdir d5/da/db/d17/d39 0 2024-02-28T16:24:01.827 INFO:tasks.workunit.client.0.smithi023.stdout:3/195: getdents d1/df/d37 0 2024-02-28T16:24:01.829 INFO:tasks.workunit.client.0.smithi023.stdout:8/287: read d0/d5/d1a/f4b [1602652,38450] 0 2024-02-28T16:24:01.829 INFO:tasks.workunit.client.0.smithi023.stdout:2/206: creat d5/da/db/d17/f3a x:0 0 0 2024-02-28T16:24:01.830 INFO:tasks.workunit.client.0.smithi023.stdout:3/196: dread d1/df/f16 [0,4194304] 0 2024-02-28T16:24:01.833 INFO:tasks.workunit.client.0.smithi023.stdout:3/197: write d1/f11 [1651522,91749] 0 2024-02-28T16:24:01.836 INFO:tasks.workunit.client.0.smithi023.stdout:3/198: write d1/df/d22/f1b [108274,46927] 0 2024-02-28T16:24:01.838 INFO:tasks.workunit.client.0.smithi023.stdout:3/199: dread - d1/f27 zero size 2024-02-28T16:24:01.841 INFO:tasks.workunit.client.0.smithi023.stdout:2/207: getdents d5/da/d1b 0 2024-02-28T16:24:01.844 INFO:tasks.workunit.client.0.smithi023.stdout:3/200: mkdir d1/df/d33/d38 0 2024-02-28T16:24:01.845 INFO:tasks.workunit.client.0.smithi023.stdout:2/208: truncate d5/da/d1b/f35 713984 0 2024-02-28T16:24:01.847 INFO:tasks.workunit.client.0.smithi023.stdout:2/209: read d5/da/d1b/f1e [1325001,48517] 0 2024-02-28T16:24:01.850 INFO:tasks.workunit.client.0.smithi023.stdout:2/210: chown d5/da/d1b/l2e 6143704 1 2024-02-28T16:24:01.851 INFO:tasks.workunit.client.0.smithi023.stdout:8/288: dwrite d0/d5/d1b/f4d [0,4194304] 0 2024-02-28T16:24:01.860 INFO:tasks.workunit.client.0.smithi023.stdout:2/211: dread d5/da/d1b/f35 [0,4194304] 0 2024-02-28T16:24:01.866 INFO:tasks.workunit.client.0.smithi023.stdout:2/212: symlink d5/da/db/l3b 0 2024-02-28T16:24:01.866 INFO:tasks.workunit.client.0.smithi023.stdout:3/201: dwrite d1/f20 [0,4194304] 0 2024-02-28T16:24:01.870 INFO:tasks.workunit.client.0.smithi023.stdout:2/213: truncate d5/da/f33 431693 0 2024-02-28T16:24:01.871 INFO:tasks.workunit.client.0.smithi023.stdout:3/202: mknod d1/df/d22/c39 0 2024-02-28T16:24:01.876 INFO:tasks.workunit.client.0.smithi023.stdout:2/214: chown d5/da/db/l14 972720 1 2024-02-28T16:24:01.876 INFO:tasks.workunit.client.0.smithi023.stdout:3/203: stat d1/cb 0 2024-02-28T16:24:01.878 INFO:tasks.workunit.client.0.smithi023.stdout:2/215: write d5/da/d1b/f26 [593179,21356] 0 2024-02-28T16:24:01.879 INFO:tasks.workunit.client.0.smithi023.stdout:3/204: truncate d1/df/f16 974054 0 2024-02-28T16:24:01.880 INFO:tasks.workunit.client.0.smithi023.stdout:8/289: dwrite d0/d5/d1b/f20 [0,4194304] 0 2024-02-28T16:24:01.881 INFO:tasks.workunit.client.0.smithi023.stdout:2/216: chown d5/da/d1b/f2c 378 1 2024-02-28T16:24:01.883 INFO:tasks.workunit.client.0.smithi023.stdout:2/217: readlink d5/da/db/l3b 0 2024-02-28T16:24:01.883 INFO:tasks.workunit.client.0.smithi023.stdout:3/205: mknod d1/c3a 0 2024-02-28T16:24:01.886 INFO:tasks.workunit.client.0.smithi023.stdout:2/218: mkdir d5/da/db/d17/d3c 0 2024-02-28T16:24:01.889 INFO:tasks.workunit.client.0.smithi023.stdout:7/161: sync 2024-02-28T16:24:01.889 INFO:tasks.workunit.client.0.smithi023.stdout:4/194: sync 2024-02-28T16:24:01.891 INFO:tasks.workunit.client.0.smithi023.stdout:3/206: link d1/f11 d1/df/f3b 0 2024-02-28T16:24:01.897 INFO:tasks.workunit.client.0.smithi023.stdout:4/195: write fe [2354774,110833] 0 2024-02-28T16:24:01.898 INFO:tasks.workunit.client.0.smithi023.stdout:2/219: getdents d5/dc 0 2024-02-28T16:24:01.910 INFO:tasks.workunit.client.0.smithi023.stdout:7/162: link de/d13/d1b/f34 de/f38 0 2024-02-28T16:24:01.911 INFO:tasks.workunit.client.0.smithi023.stdout:8/290: dwrite d0/d5/d1b/f33 [0,4194304] 0 2024-02-28T16:24:01.919 INFO:tasks.workunit.client.0.smithi023.stdout:4/196: dwrite d13/d2b/d2c/f2f [4194304,4194304] 0 2024-02-28T16:24:01.921 INFO:tasks.workunit.client.0.smithi023.stdout:7/163: symlink de/d13/l39 0 2024-02-28T16:24:01.923 INFO:tasks.workunit.client.0.smithi023.stdout:2/220: dwrite d5/da/f28 [0,4194304] 0 2024-02-28T16:24:01.924 INFO:tasks.workunit.client.0.smithi023.stdout:2/221: dread - d5/da/db/f23 zero size 2024-02-28T16:24:01.925 INFO:tasks.workunit.client.0.smithi023.stdout:8/291: mkdir d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62 0 2024-02-28T16:24:01.925 INFO:tasks.workunit.client.0.smithi023.stdout:4/197: read d13/f17 [4914252,128636] 0 2024-02-28T16:24:01.931 INFO:tasks.workunit.client.0.smithi023.stdout:7/164: chown de/l29 11497667 1 2024-02-28T16:24:01.938 INFO:tasks.workunit.client.0.smithi023.stdout:8/292: mkdir d0/d5/d1a/d63 0 2024-02-28T16:24:01.939 INFO:tasks.workunit.client.0.smithi023.stdout:7/165: rename de/d13/d1b/c1d to de/d13/d1b/c3a 0 2024-02-28T16:24:01.941 INFO:tasks.workunit.client.0.smithi023.stdout:7/166: read de/d13/f2b [907141,94243] 0 2024-02-28T16:24:01.949 INFO:tasks.workunit.client.0.smithi023.stdout:7/167: mknod de/d1c/c3b 0 2024-02-28T16:24:01.951 INFO:tasks.workunit.client.0.smithi023.stdout:4/198: link d13/d1d/d2d/l32 d13/d1d/l3a 0 2024-02-28T16:24:01.951 INFO:tasks.workunit.client.0.smithi023.stdout:4/199: readlink d13/l1c 0 2024-02-28T16:24:01.956 INFO:tasks.workunit.client.0.smithi023.stdout:2/222: write d5/dc/f24 [7748,56437] 0 2024-02-28T16:24:01.958 INFO:tasks.workunit.client.0.smithi023.stdout:7/168: unlink de/f14 0 2024-02-28T16:24:01.960 INFO:tasks.workunit.client.0.smithi023.stdout:7/169: write f8 [378547,65091] 0 2024-02-28T16:24:01.962 INFO:tasks.workunit.client.0.smithi023.stdout:4/200: symlink d13/d2b/l3b 0 2024-02-28T16:24:01.967 INFO:tasks.workunit.client.0.smithi023.stdout:8/293: chown d0/d5/d1a/d2d/d30/d39 7712 1 2024-02-28T16:24:01.969 INFO:tasks.workunit.client.0.smithi023.stdout:8/294: fsync d0/d5/d1b/f19 0 2024-02-28T16:24:01.969 INFO:tasks.workunit.client.0.smithi023.stdout:7/170: creat de/d2f/f3c x:0 0 0 2024-02-28T16:24:01.973 INFO:tasks.workunit.client.0.smithi023.stdout:2/223: creat d5/da/db/d17/d3c/f3d x:0 0 0 2024-02-28T16:24:01.973 INFO:tasks.workunit.client.0.smithi023.stdout:7/171: dread de/d13/f1f [0,4194304] 0 2024-02-28T16:24:01.975 INFO:tasks.workunit.client.0.smithi023.stdout:7/172: fsync de/d2f/f37 0 2024-02-28T16:24:01.982 INFO:tasks.workunit.client.0.smithi023.stdout:2/224: rmdir d5/da/d1b 39 2024-02-28T16:24:01.991 INFO:tasks.workunit.client.0.smithi023.stdout:4/201: dread d13/d2b/d2c/f2f [0,4194304] 0 2024-02-28T16:24:01.991 INFO:tasks.workunit.client.0.smithi023.stdout:7/173: dwrite de/d2f/f37 [0,4194304] 0 2024-02-28T16:24:01.994 INFO:tasks.workunit.client.0.smithi023.stdout:8/295: dwrite d0/d5/d1a/d2d/f31 [8388608,4194304] 0 2024-02-28T16:24:01.998 INFO:tasks.workunit.client.0.smithi023.stdout:8/296: readlink d0/d5/d1a/d2d/d30/d39/d3d/l42 0 2024-02-28T16:24:02.000 INFO:tasks.workunit.client.0.smithi023.stdout:2/225: dwrite d5/da/f28 [0,4194304] 0 2024-02-28T16:24:02.000 INFO:tasks.workunit.client.0.smithi023.stdout:4/202: creat d13/f3c x:0 0 0 2024-02-28T16:24:02.020 INFO:tasks.workunit.client.0.smithi023.stdout:2/226: symlink d5/da/db/d17/d39/l3e 0 2024-02-28T16:24:02.024 INFO:tasks.workunit.client.0.smithi023.stdout:4/203: dread f5 [0,4194304] 0 2024-02-28T16:24:02.032 INFO:tasks.workunit.client.0.smithi023.stdout:2/227: dread d5/da/db/d17/f27 [0,4194304] 0 2024-02-28T16:24:02.036 INFO:tasks.workunit.client.0.smithi023.stdout:2/228: mkdir d5/da/d1b/d3f 0 2024-02-28T16:24:02.038 INFO:tasks.workunit.client.0.smithi023.stdout:5/442: sync 2024-02-28T16:24:02.038 INFO:tasks.workunit.client.0.smithi023.stdout:6/329: sync 2024-02-28T16:24:02.038 INFO:tasks.workunit.client.0.smithi023.stdout:1/283: sync 2024-02-28T16:24:02.038 INFO:tasks.workunit.client.0.smithi023.stdout:0/223: sync 2024-02-28T16:24:02.038 INFO:tasks.workunit.client.0.smithi023.stdout:9/235: sync 2024-02-28T16:24:02.042 INFO:tasks.workunit.client.0.smithi023.stdout:0/224: write d6/db/d1a/d1b/f27 [3142120,69086] 0 2024-02-28T16:24:02.043 INFO:tasks.workunit.client.0.smithi023.stdout:2/229: getdents d5 0 2024-02-28T16:24:02.045 INFO:tasks.workunit.client.0.smithi023.stdout:5/443: creat d1/d2a/d32/d58/d73/f84 x:0 0 0 2024-02-28T16:24:02.047 INFO:tasks.workunit.client.0.smithi023.stdout:0/225: stat d6/db/d1a/d2e/f2f 0 2024-02-28T16:24:02.047 INFO:tasks.workunit.client.0.smithi023.stdout:2/230: creat d5/f40 x:0 0 0 2024-02-28T16:24:02.048 INFO:tasks.workunit.client.0.smithi023.stdout:0/226: fdatasync d6/f36 0 2024-02-28T16:24:02.053 INFO:tasks.workunit.client.0.smithi023.stdout:9/236: dread d0/d7/ff [4194304,4194304] 0 2024-02-28T16:24:02.053 INFO:tasks.workunit.client.0.smithi023.stdout:0/227: readlink d6/db/d1a/d26/d31/d33/d37/l3e 0 2024-02-28T16:24:02.055 INFO:tasks.workunit.client.0.smithi023.stdout:9/237: readlink d0/l2 0 2024-02-28T16:24:02.056 INFO:tasks.workunit.client.0.smithi023.stdout:5/444: dread d1/d2a/d32/d37/f38 [0,4194304] 0 2024-02-28T16:24:02.057 INFO:tasks.workunit.client.0.smithi023.stdout:0/228: write d6/db/d1a/d26/f38 [280968,62153] 0 2024-02-28T16:24:02.064 INFO:tasks.workunit.client.0.smithi023.stdout:5/445: rename d1/d2a/d32/d37/d3a/d7f/f2e to d1/d2a/d32/d6e/f85 0 2024-02-28T16:24:02.065 INFO:tasks.workunit.client.0.smithi023.stdout:0/229: fsync d6/db/d1a/d1b/f27 0 2024-02-28T16:24:02.066 INFO:tasks.workunit.client.0.smithi023.stdout:5/446: write d1/d2a/d32/d37/f38 [1487016,57220] 0 2024-02-28T16:24:02.068 INFO:tasks.workunit.client.0.smithi023.stdout:4/204: truncate d13/f3c 1043763 0 2024-02-28T16:24:02.069 INFO:tasks.workunit.client.0.smithi023.stdout:9/238: link d0/d7/db/c16 d0/d7/de/d2e/d2f/c4e 0 2024-02-28T16:24:02.071 INFO:tasks.workunit.client.0.smithi023.stdout:4/205: write d13/d2b/d2c/f30 [746032,97983] 0 2024-02-28T16:24:02.072 INFO:tasks.workunit.client.0.smithi023.stdout:5/447: readlink d1/d2a/d32/d37/d3a/d7f/d62/d68/l52 0 2024-02-28T16:24:02.073 INFO:tasks.workunit.client.0.smithi023.stdout:9/239: write d0/d7/db/d18/f22 [2419140,121341] 0 2024-02-28T16:24:02.074 INFO:tasks.workunit.client.0.smithi023.stdout:0/230: symlink d6/db/d24/l43 0 2024-02-28T16:24:02.077 INFO:tasks.workunit.client.0.smithi023.stdout:4/206: truncate d13/d2b/d2c/f35 948656 0 2024-02-28T16:24:02.077 INFO:tasks.workunit.client.0.smithi023.stdout:7/174: truncate de/d1c/f26 732079 0 2024-02-28T16:24:02.079 INFO:tasks.workunit.client.0.smithi023.stdout:9/240: symlink d0/l4f 0 2024-02-28T16:24:02.081 INFO:tasks.workunit.client.0.smithi023.stdout:0/231: creat d6/db/d1a/d2e/f44 x:0 0 0 2024-02-28T16:24:02.084 INFO:tasks.workunit.client.0.smithi023.stdout:4/207: chown d13/d1e/l23 19 1 2024-02-28T16:24:02.085 INFO:tasks.workunit.client.0.smithi023.stdout:5/448: creat d1/d2a/d32/d58/d60/d81/f86 x:0 0 0 2024-02-28T16:24:02.087 INFO:tasks.workunit.client.0.smithi023.stdout:0/232: creat d6/db/d1a/d26/f45 x:0 0 0 2024-02-28T16:24:02.087 INFO:tasks.workunit.client.0.smithi023.stdout:5/449: write d1/f55 [2949050,127141] 0 2024-02-28T16:24:02.093 INFO:tasks.workunit.client.0.smithi023.stdout:4/208: symlink d13/d1d/d2e/l3d 0 2024-02-28T16:24:02.096 INFO:tasks.workunit.client.0.smithi023.stdout:0/233: creat d6/db/d1a/d26/d31/f46 x:0 0 0 2024-02-28T16:24:02.098 INFO:tasks.workunit.client.0.smithi023.stdout:0/234: readlink d6/db/d1a/l3f 0 2024-02-28T16:24:02.099 INFO:tasks.workunit.client.0.smithi023.stdout:4/209: read d13/f15 [1695908,62115] 0 2024-02-28T16:24:02.104 INFO:tasks.workunit.client.0.smithi023.stdout:4/210: symlink d13/d2b/d2c/d31/l3e 0 2024-02-28T16:24:02.108 INFO:tasks.workunit.client.0.smithi023.stdout:4/211: readlink d13/l1c 0 2024-02-28T16:24:02.115 INFO:tasks.workunit.client.0.smithi023.stdout:7/175: dread de/ff [0,4194304] 0 2024-02-28T16:24:02.116 INFO:tasks.workunit.client.0.smithi023.stdout:1/284: dwrite f3 [8388608,4194304] 0 2024-02-28T16:24:02.119 INFO:tasks.workunit.client.0.smithi023.stdout:5/450: dread d1/d2a/f3f [0,4194304] 0 2024-02-28T16:24:02.121 INFO:tasks.workunit.client.0.smithi023.stdout:0/235: dwrite d6/db/d1a/d2e/f44 [0,4194304] 0 2024-02-28T16:24:02.122 INFO:tasks.workunit.client.0.smithi023.stdout:1/285: dread - df/d11/d13/d1b/d30/d57/d5a/f64 zero size 2024-02-28T16:24:02.123 INFO:tasks.workunit.client.0.smithi023.stdout:7/176: mkdir de/d13/d1b/d3d 0 2024-02-28T16:24:02.123 INFO:tasks.workunit.client.0.smithi023.stdout:4/212: link d13/l1c d13/l3f 0 2024-02-28T16:24:02.125 INFO:tasks.workunit.client.0.smithi023.stdout:0/236: read d6/db/d1a/d2e/f44 [655403,65877] 0 2024-02-28T16:24:02.126 INFO:tasks.workunit.client.0.smithi023.stdout:7/177: chown de/d13/d1b/f34 1480374175 1 2024-02-28T16:24:02.126 INFO:tasks.workunit.client.0.smithi023.stdout:2/231: link d5/da/db/l14 d5/da/db/d17/d3c/l41 0 2024-02-28T16:24:02.128 INFO:tasks.workunit.client.0.smithi023.stdout:7/178: dread - de/d2f/f3c zero size 2024-02-28T16:24:02.129 INFO:tasks.workunit.client.0.smithi023.stdout:0/237: chown d6/db/d1a/d1b/f27 66 1 2024-02-28T16:24:02.132 INFO:tasks.workunit.client.0.smithi023.stdout:0/238: readlink d6/db/d3b/d1f/l2a 0 2024-02-28T16:24:02.136 INFO:tasks.workunit.client.0.smithi023.stdout:1/286: symlink df/d26/l66 0 2024-02-28T16:24:02.138 INFO:tasks.workunit.client.0.smithi023.stdout:0/239: write d6/f21 [194826,83092] 0 2024-02-28T16:24:02.141 INFO:tasks.workunit.client.0.smithi023.stdout:1/287: write f3 [10437066,101246] 0 2024-02-28T16:24:02.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:01 smithi153 ceph-mon[35341]: pgmap v32: 65 pgs: 65 active+clean; 478 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 47 MiB/s wr, 158 op/s 2024-02-28T16:24:02.146 INFO:tasks.workunit.client.0.smithi023.stdout:4/213: mknod d13/d2b/c40 0 2024-02-28T16:24:02.152 INFO:tasks.workunit.client.0.smithi023.stdout:2/232: dwrite d5/da/db/d17/d3c/f3d [0,4194304] 0 2024-02-28T16:24:02.156 INFO:tasks.workunit.client.0.smithi023.stdout:5/451: dwrite d1/d2a/d32/d6e/f85 [0,4194304] 0 2024-02-28T16:24:02.156 INFO:tasks.workunit.client.0.smithi023.stdout:1/288: creat df/d11/f67 x:0 0 0 2024-02-28T16:24:02.161 INFO:tasks.workunit.client.0.smithi023.stdout:5/452: write d1/d2a/d32/d58/d73/f84 [329363,94711] 0 2024-02-28T16:24:02.167 INFO:tasks.workunit.client.0.smithi023.stdout:4/214: creat d13/d1d/f41 x:0 0 0 2024-02-28T16:24:02.169 INFO:tasks.workunit.client.0.smithi023.stdout:7/179: rename de/d1c/c36 to de/c3e 0 2024-02-28T16:24:02.171 INFO:tasks.workunit.client.0.smithi023.stdout:0/240: link d6/db/d3b/c14 d6/db/d3d/c47 0 2024-02-28T16:24:02.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:01 smithi023 ceph-mon[29137]: pgmap v32: 65 pgs: 65 active+clean; 478 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 47 MiB/s wr, 158 op/s 2024-02-28T16:24:02.174 INFO:tasks.workunit.client.0.smithi023.stdout:7/180: mkdir de/d13/d1b/d3f 0 2024-02-28T16:24:02.177 INFO:tasks.workunit.client.0.smithi023.stdout:7/181: dread - de/d13/d1b/f34 zero size 2024-02-28T16:24:02.178 INFO:tasks.workunit.client.0.smithi023.stdout:2/233: dread d5/dc/f34 [0,4194304] 0 2024-02-28T16:24:02.180 INFO:tasks.workunit.client.0.smithi023.stdout:2/234: chown d5/da/d1b 1681 1 2024-02-28T16:24:02.184 INFO:tasks.workunit.client.0.smithi023.stdout:0/241: mknod d6/db/d3b/d1f/d42/c48 0 2024-02-28T16:24:02.185 INFO:tasks.workunit.client.0.smithi023.stdout:7/182: mkdir de/d13/d1b/d40 0 2024-02-28T16:24:02.185 INFO:tasks.workunit.client.0.smithi023.stdout:7/183: readlink l2 0 2024-02-28T16:24:02.189 INFO:tasks.workunit.client.0.smithi023.stdout:3/207: sync 2024-02-28T16:24:02.191 INFO:tasks.workunit.client.0.smithi023.stdout:3/208: chown d1/c3a 383289864 1 2024-02-28T16:24:02.194 INFO:tasks.workunit.client.0.smithi023.stdout:7/184: creat de/d13/d1b/d3d/f41 x:0 0 0 2024-02-28T16:24:02.200 INFO:tasks.workunit.client.0.smithi023.stdout:7/185: mknod de/d2f/c42 0 2024-02-28T16:24:02.202 INFO:tasks.workunit.client.0.smithi023.stdout:2/235: dwrite d5/da/db/d17/d3c/f3d [0,4194304] 0 2024-02-28T16:24:02.204 INFO:tasks.workunit.client.0.smithi023.stdout:7/186: readlink de/l31 0 2024-02-28T16:24:02.209 INFO:tasks.workunit.client.0.smithi023.stdout:0/242: dread d6/db/d3b/f28 [0,4194304] 0 2024-02-28T16:24:02.211 INFO:tasks.workunit.client.0.smithi023.stdout:3/209: dwrite d1/df/f19 [0,4194304] 0 2024-02-28T16:24:02.217 INFO:tasks.workunit.client.0.smithi023.stdout:7/187: unlink de/c17 0 2024-02-28T16:24:02.220 INFO:tasks.workunit.client.0.smithi023.stdout:3/210: creat d1/f3c x:0 0 0 2024-02-28T16:24:02.221 INFO:tasks.workunit.client.0.smithi023.stdout:4/215: dread d13/f17 [0,4194304] 0 2024-02-28T16:24:02.221 INFO:tasks.workunit.client.0.smithi023.stdout:0/243: link d6/f21 d6/db/d1a/d26/d31/d33/d37/f49 0 2024-02-28T16:24:02.222 INFO:tasks.workunit.client.0.smithi023.stdout:1/289: dread df/d11/f12 [0,4194304] 0 2024-02-28T16:24:02.223 INFO:tasks.workunit.client.0.smithi023.stdout:7/188: fdatasync de/d13/d1b/f24 0 2024-02-28T16:24:02.224 INFO:tasks.workunit.client.0.smithi023.stdout:7/189: readlink de/l31 0 2024-02-28T16:24:02.226 INFO:tasks.workunit.client.0.smithi023.stdout:0/244: chown d6/db/d1a/d2e/f2f 15 1 2024-02-28T16:24:02.226 INFO:tasks.workunit.client.0.smithi023.stdout:4/216: chown d13/d1d/f25 26 1 2024-02-28T16:24:02.229 INFO:tasks.workunit.client.0.smithi023.stdout:4/217: chown d13/d2b/d2c/f30 747151 1 2024-02-28T16:24:02.235 INFO:tasks.workunit.client.0.smithi023.stdout:2/236: write d5/dc/f30 [859402,49537] 0 2024-02-28T16:24:02.306 INFO:tasks.workunit.client.0.smithi023.stdout:1/290: mkdir df/d11/d13/d1b/d30/d57/d5a/d68 0 2024-02-28T16:24:02.307 INFO:tasks.workunit.client.0.smithi023.stdout:3/211: getdents d1/df/d22 0 2024-02-28T16:24:02.310 INFO:tasks.workunit.client.0.smithi023.stdout:2/237: rename f4 to d5/dc/f42 0 2024-02-28T16:24:02.313 INFO:tasks.workunit.client.0.smithi023.stdout:2/238: chown d5/dc/f34 2 1 2024-02-28T16:24:02.315 INFO:tasks.workunit.client.0.smithi023.stdout:1/291: rename df/d11/d13/d1b/f2b to df/d11/d13/d1b/d30/f69 0 2024-02-28T16:24:02.318 INFO:tasks.workunit.client.0.smithi023.stdout:2/239: truncate d5/da/db/d17/f3a 462298 0 2024-02-28T16:24:02.322 INFO:tasks.workunit.client.0.smithi023.stdout:7/190: dwrite de/d13/f1f [0,4194304] 0 2024-02-28T16:24:02.322 INFO:tasks.workunit.client.0.smithi023.stdout:1/292: symlink df/d11/d13/d1b/d30/d57/d5a/l6a 0 2024-02-28T16:24:02.324 INFO:tasks.workunit.client.0.smithi023.stdout:2/240: fsync d5/da/db/d17/f27 0 2024-02-28T16:24:02.324 INFO:tasks.workunit.client.0.smithi023.stdout:1/293: stat df/d11/d13/l32 0 2024-02-28T16:24:02.328 INFO:tasks.workunit.client.0.smithi023.stdout:2/241: write d5/f40 [33949,50967] 0 2024-02-28T16:24:02.330 INFO:tasks.workunit.client.0.smithi023.stdout:1/294: mkdir df/d11/d13/d1b/d2e/d5c/d6b 0 2024-02-28T16:24:02.331 INFO:tasks.workunit.client.0.smithi023.stdout:2/242: mknod d5/dc/c43 0 2024-02-28T16:24:02.335 INFO:tasks.workunit.client.0.smithi023.stdout:3/212: dwrite d1/df/d22/f14 [0,4194304] 0 2024-02-28T16:24:02.335 INFO:tasks.workunit.client.0.smithi023.stdout:7/191: write de/f38 [769815,16038] 0 2024-02-28T16:24:02.343 INFO:tasks.workunit.client.0.smithi023.stdout:3/213: mkdir d1/df/d3d 0 2024-02-28T16:24:02.354 INFO:tasks.workunit.client.0.smithi023.stdout:7/192: dread de/d1c/f26 [0,4194304] 0 2024-02-28T16:24:02.354 INFO:tasks.workunit.client.0.smithi023.stdout:1/295: dwrite df/d11/d13/d1b/d30/d3d/f50 [0,4194304] 0 2024-02-28T16:24:02.357 INFO:tasks.workunit.client.0.smithi023.stdout:1/296: chown df/d11/d13/d1b/d2e/c4d 12 1 2024-02-28T16:24:02.358 INFO:tasks.workunit.client.0.smithi023.stdout:7/193: creat de/f43 x:0 0 0 2024-02-28T16:24:02.360 INFO:tasks.workunit.client.0.smithi023.stdout:1/297: truncate df/d11/f67 76453 0 2024-02-28T16:24:02.364 INFO:tasks.workunit.client.0.smithi023.stdout:7/194: rename de/d13/d1b/d3d/f41 to de/d13/d1b/d40/f44 0 2024-02-28T16:24:02.366 INFO:tasks.workunit.client.0.smithi023.stdout:3/214: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:24:02.366 INFO:tasks.workunit.client.0.smithi023.stdout:7/195: write de/d2f/f3c [40920,62922] 0 2024-02-28T16:24:02.368 INFO:tasks.workunit.client.0.smithi023.stdout:7/196: write de/f12 [3772691,51537] 0 2024-02-28T16:24:02.372 INFO:tasks.workunit.client.0.smithi023.stdout:3/215: link d1/f1c d1/df/f3e 0 2024-02-28T16:24:02.374 INFO:tasks.workunit.client.0.smithi023.stdout:7/197: dread de/d1c/f26 [0,4194304] 0 2024-02-28T16:24:02.375 INFO:tasks.workunit.client.0.smithi023.stdout:7/198: stat cb 0 2024-02-28T16:24:02.381 INFO:tasks.workunit.client.0.smithi023.stdout:8/297: sync 2024-02-28T16:24:02.382 INFO:tasks.workunit.client.0.smithi023.stdout:2/243: truncate d5/da/db/d17/f2a 770144 0 2024-02-28T16:24:02.389 INFO:tasks.workunit.client.0.smithi023.stdout:7/199: getdents de 0 2024-02-28T16:24:02.392 INFO:tasks.workunit.client.0.smithi023.stdout:2/244: symlink d5/da/db/d17/l44 0 2024-02-28T16:24:02.394 INFO:tasks.workunit.client.0.smithi023.stdout:2/245: fsync d5/da/d1b/f2c 0 2024-02-28T16:24:02.397 INFO:tasks.workunit.client.0.smithi023.stdout:8/298: link d0/d5/d1a/d2d/d30/c32 d0/d5/c64 0 2024-02-28T16:24:02.399 INFO:tasks.workunit.client.0.smithi023.stdout:8/299: read - d0/d5/f40 zero size 2024-02-28T16:24:02.400 INFO:tasks.workunit.client.0.smithi023.stdout:2/246: write d5/da/d1b/f1e [4059431,27702] 0 2024-02-28T16:24:02.402 INFO:tasks.workunit.client.0.smithi023.stdout:8/300: read - d0/d5/d1b/f43 zero size 2024-02-28T16:24:02.404 INFO:tasks.workunit.client.0.smithi023.stdout:2/247: write d5/da/db/d17/f3a [1443380,105206] 0 2024-02-28T16:24:02.409 INFO:tasks.workunit.client.0.smithi023.stdout:3/216: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:24:02.412 INFO:tasks.workunit.client.0.smithi023.stdout:8/301: symlink d0/d5/l65 0 2024-02-28T16:24:02.416 INFO:tasks.workunit.client.0.smithi023.stdout:3/217: dread - d1/df/d2d/f31 zero size 2024-02-28T16:24:02.417 INFO:tasks.workunit.client.0.smithi023.stdout:1/298: dread df/d11/d13/d1b/f39 [0,4194304] 0 2024-02-28T16:24:02.417 INFO:tasks.workunit.client.0.smithi023.stdout:2/248: mkdir d5/da/d45 0 2024-02-28T16:24:02.419 INFO:tasks.workunit.client.0.smithi023.stdout:1/299: chown df/d11/d13/d27 1608823 1 2024-02-28T16:24:02.419 INFO:tasks.workunit.client.0.smithi023.stdout:3/218: mkdir d1/df/d2d/d32/d3f 0 2024-02-28T16:24:02.421 INFO:tasks.workunit.client.0.smithi023.stdout:8/302: symlink d0/d5/d1a/d44/l66 0 2024-02-28T16:24:02.423 INFO:tasks.workunit.client.0.smithi023.stdout:2/249: rmdir d5/da/d1b 39 2024-02-28T16:24:02.424 INFO:tasks.workunit.client.0.smithi023.stdout:8/303: fsync d0/d5/d1b/f4d 0 2024-02-28T16:24:02.424 INFO:tasks.workunit.client.0.smithi023.stdout:3/219: creat d1/df/d2d/f40 x:0 0 0 2024-02-28T16:24:02.426 INFO:tasks.workunit.client.0.smithi023.stdout:1/300: mkdir df/d11/d13/d1b/d30/d3d/d6c 0 2024-02-28T16:24:02.429 INFO:tasks.workunit.client.0.smithi023.stdout:2/250: creat d5/da/db/d17/d3c/f46 x:0 0 0 2024-02-28T16:24:02.430 INFO:tasks.workunit.client.0.smithi023.stdout:1/301: write df/d11/f21 [1727360,12962] 0 2024-02-28T16:24:02.430 INFO:tasks.workunit.client.0.smithi023.stdout:8/304: read d0/d5/d1a/d2d/f31 [10161264,118775] 0 2024-02-28T16:24:02.432 INFO:tasks.workunit.client.0.smithi023.stdout:2/251: write d5/da/f28 [3993330,5373] 0 2024-02-28T16:24:02.435 INFO:tasks.workunit.client.0.smithi023.stdout:1/302: creat df/d11/d13/d1b/d2e/f6d x:0 0 0 2024-02-28T16:24:02.439 INFO:tasks.workunit.client.0.smithi023.stdout:8/305: rmdir d0/d5/d1a/d44 39 2024-02-28T16:24:02.441 INFO:tasks.workunit.client.0.smithi023.stdout:2/252: fsync d5/da/d1b/f26 0 2024-02-28T16:24:02.441 INFO:tasks.workunit.client.0.smithi023.stdout:1/303: creat df/d11/d13/d1b/d30/d3d/f6e x:0 0 0 2024-02-28T16:24:02.444 INFO:tasks.workunit.client.0.smithi023.stdout:2/253: write d5/da/db/d17/d3c/f3d [4268395,40002] 0 2024-02-28T16:24:02.444 INFO:tasks.workunit.client.0.smithi023.stdout:1/304: write df/d11/d13/d1b/d2e/f6d [931850,70764] 0 2024-02-28T16:24:02.447 INFO:tasks.workunit.client.0.smithi023.stdout:7/200: dread de/d13/f1a [0,4194304] 0 2024-02-28T16:24:02.447 INFO:tasks.workunit.client.0.smithi023.stdout:2/254: read d5/dc/f34 [2303803,85672] 0 2024-02-28T16:24:02.448 INFO:tasks.workunit.client.0.smithi023.stdout:8/306: chown d0/d5/d1a/d2d/d30/d39 32939886 1 2024-02-28T16:24:02.453 INFO:tasks.workunit.client.0.smithi023.stdout:8/307: mkdir d0/d5/d1a/d2d/d67 0 2024-02-28T16:24:02.454 INFO:tasks.workunit.client.0.smithi023.stdout:2/255: dread d5/dc/f21 [0,4194304] 0 2024-02-28T16:24:02.456 INFO:tasks.workunit.client.0.smithi023.stdout:3/220: truncate d1/f11 1231492 0 2024-02-28T16:24:02.458 INFO:tasks.workunit.client.0.smithi023.stdout:2/256: symlink d5/da/db/d17/l47 0 2024-02-28T16:24:02.459 INFO:tasks.workunit.client.0.smithi023.stdout:8/308: creat d0/d5/d1a/d2d/d30/d39/d3d/f68 x:0 0 0 2024-02-28T16:24:02.462 INFO:tasks.workunit.client.0.smithi023.stdout:7/201: link de/l19 de/d13/d1b/d40/l45 0 2024-02-28T16:24:02.463 INFO:tasks.workunit.client.0.smithi023.stdout:2/257: write d5/dc/f21 [356195,62731] 0 2024-02-28T16:24:02.465 INFO:tasks.workunit.client.0.smithi023.stdout:3/221: rename d1/f1c to d1/f41 0 2024-02-28T16:24:02.467 INFO:tasks.workunit.client.0.smithi023.stdout:8/309: mkdir d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69 0 2024-02-28T16:24:02.468 INFO:tasks.workunit.client.0.smithi023.stdout:1/305: dwrite df/d11/d13/f15 [0,4194304] 0 2024-02-28T16:24:02.470 INFO:tasks.workunit.client.0.smithi023.stdout:7/202: dread de/f38 [0,4194304] 0 2024-02-28T16:24:02.471 INFO:tasks.workunit.client.0.smithi023.stdout:8/310: chown d0/d5/d1a/d2d/d30/d39/d3d 21180 1 2024-02-28T16:24:02.472 INFO:tasks.workunit.client.0.smithi023.stdout:3/222: rmdir d1/df/d22 39 2024-02-28T16:24:02.473 INFO:tasks.workunit.client.0.smithi023.stdout:2/258: creat d5/da/d1b/d3f/f48 x:0 0 0 2024-02-28T16:24:02.474 INFO:tasks.workunit.client.0.smithi023.stdout:3/223: dread - d1/df/f29 zero size 2024-02-28T16:24:02.478 INFO:tasks.workunit.client.0.smithi023.stdout:7/203: unlink de/d13/d1b/f24 0 2024-02-28T16:24:02.479 INFO:tasks.workunit.client.0.smithi023.stdout:8/311: mknod d0/d5/d1a/d2d/d30/d39/d3d/c6a 0 2024-02-28T16:24:02.481 INFO:tasks.workunit.client.0.smithi023.stdout:8/312: chown d0/d5/f40 37945168 1 2024-02-28T16:24:02.482 INFO:tasks.workunit.client.0.smithi023.stdout:8/313: chown d0/d5/d1a/d63 18676 1 2024-02-28T16:24:02.495 INFO:tasks.workunit.client.0.smithi023.stdout:1/306: dwrite df/d11/d13/d1b/d30/d57/d5a/f64 [0,4194304] 0 2024-02-28T16:24:02.501 INFO:tasks.workunit.client.0.smithi023.stdout:6/330: sync 2024-02-28T16:24:02.501 INFO:tasks.workunit.client.0.smithi023.stdout:9/241: sync 2024-02-28T16:24:02.505 INFO:tasks.workunit.client.0.smithi023.stdout:8/314: dwrite d0/d5/d1a/d2d/d30/d39/d3d/d3e/f48 [4194304,4194304] 0 2024-02-28T16:24:02.505 INFO:tasks.workunit.client.0.smithi023.stdout:1/307: mkdir df/d11/d13/d1b/d30/d57/d5a/d68/d6f 0 2024-02-28T16:24:02.509 INFO:tasks.workunit.client.0.smithi023.stdout:1/308: chown df/d11/d13 2663730 1 2024-02-28T16:24:02.509 INFO:tasks.workunit.client.0.smithi023.stdout:6/331: mkdir d1/d3d/d7d 0 2024-02-28T16:24:02.520 INFO:tasks.workunit.client.0.smithi023.stdout:9/242: unlink d0/d7/db/f27 0 2024-02-28T16:24:02.521 INFO:tasks.workunit.client.0.smithi023.stdout:2/259: truncate d5/dc/f21 812017 0 2024-02-28T16:24:02.525 INFO:tasks.workunit.client.0.smithi023.stdout:7/204: dwrite de/d1c/f26 [0,4194304] 0 2024-02-28T16:24:02.526 INFO:tasks.workunit.client.0.smithi023.stdout:2/260: dread d5/dc/f24 [0,4194304] 0 2024-02-28T16:24:02.528 INFO:tasks.workunit.client.0.smithi023.stdout:2/261: stat d5/da/db/l22 0 2024-02-28T16:24:02.529 INFO:tasks.workunit.client.0.smithi023.stdout:9/243: write d0/d7/db/d18/f1d [4452280,13838] 0 2024-02-28T16:24:02.532 INFO:tasks.workunit.client.0.smithi023.stdout:9/244: write d0/d7/de/f26 [5010171,87043] 0 2024-02-28T16:24:02.537 INFO:tasks.workunit.client.0.smithi023.stdout:1/309: write df/d11/d13/d27/f5f [4380293,94899] 0 2024-02-28T16:24:02.541 INFO:tasks.workunit.client.0.smithi023.stdout:8/315: link d0/d5/f3c d0/d5/d1a/d2d/d30/d39/d3d/d3e/f6b 0 2024-02-28T16:24:02.543 INFO:tasks.workunit.client.0.smithi023.stdout:2/262: creat d5/da/db/f49 x:0 0 0 2024-02-28T16:24:02.546 INFO:tasks.workunit.client.0.smithi023.stdout:6/332: link d1/d28/d1e/d2b/d6d/c7c d1/d28/d1e/d52/c7e 0 2024-02-28T16:24:02.551 INFO:tasks.workunit.client.0.smithi023.stdout:8/316: write d0/d5/f26 [722199,87839] 0 2024-02-28T16:24:02.555 INFO:tasks.workunit.client.0.smithi023.stdout:7/205: dwrite de/d13/d1b/d40/f44 [0,4194304] 0 2024-02-28T16:24:02.555 INFO:tasks.workunit.client.0.smithi023.stdout:6/333: creat d1/d28/d1e/d52/f7f x:0 0 0 2024-02-28T16:24:02.558 INFO:tasks.workunit.client.0.smithi023.stdout:7/206: symlink de/l46 0 2024-02-28T16:24:02.560 INFO:tasks.workunit.client.0.smithi023.stdout:2/263: dwrite d5/da/d1b/f2c [0,4194304] 0 2024-02-28T16:24:02.561 INFO:tasks.workunit.client.0.smithi023.stdout:8/317: mkdir d0/d5/d1a/d2d/d30/d39/d3d/d6c 0 2024-02-28T16:24:02.564 INFO:tasks.workunit.client.0.smithi023.stdout:9/245: link d0/d7/db/d18/f49 d0/f50 0 2024-02-28T16:24:02.566 INFO:tasks.workunit.client.0.smithi023.stdout:9/246: chown d0/d7/d2c/d4a 112109 1 2024-02-28T16:24:02.568 INFO:tasks.workunit.client.0.smithi023.stdout:9/247: fdatasync d0/d7/db/d18/f1d 0 2024-02-28T16:24:02.570 INFO:tasks.workunit.client.0.smithi023.stdout:8/318: stat d0/d5/d1a/l5a 0 2024-02-28T16:24:02.576 INFO:tasks.workunit.client.0.smithi023.stdout:6/334: mkdir d1/d28/d1e/d80 0 2024-02-28T16:24:02.578 INFO:tasks.workunit.client.0.smithi023.stdout:7/207: rename l2 to de/d13/d1b/l47 0 2024-02-28T16:24:02.583 INFO:tasks.workunit.client.0.smithi023.stdout:7/208: mknod de/d13/c48 0 2024-02-28T16:24:02.583 INFO:tasks.workunit.client.0.smithi023.stdout:2/264: link d5/le d5/da/db/d17/d3c/l4a 0 2024-02-28T16:24:02.585 INFO:tasks.workunit.client.0.smithi023.stdout:2/265: write d5/da/f38 [78007,44030] 0 2024-02-28T16:24:02.586 INFO:tasks.workunit.client.0.smithi023.stdout:8/319: creat d0/d5/d1a/f6d x:0 0 0 2024-02-28T16:24:02.589 INFO:tasks.workunit.client.0.smithi023.stdout:9/248: getdents d0/d7/db 0 2024-02-28T16:24:02.590 INFO:tasks.workunit.client.0.smithi023.stdout:2/266: creat d5/da/d1b/f4b x:0 0 0 2024-02-28T16:24:02.591 INFO:tasks.workunit.client.0.smithi023.stdout:8/320: write d0/d5/d1a/d2d/d30/d39/d3d/d3e/f48 [4075517,15344] 0 2024-02-28T16:24:02.591 INFO:tasks.workunit.client.0.smithi023.stdout:7/209: write de/f38 [1744816,108550] 0 2024-02-28T16:24:02.595 INFO:tasks.workunit.client.0.smithi023.stdout:2/267: write d5/dc/f42 [4432224,60246] 0 2024-02-28T16:24:02.595 INFO:tasks.workunit.client.0.smithi023.stdout:9/249: unlink d0/d7/db/d18/c39 0 2024-02-28T16:24:02.598 INFO:tasks.workunit.client.0.smithi023.stdout:2/268: fsync d5/da/f33 0 2024-02-28T16:24:02.603 INFO:tasks.workunit.client.0.smithi023.stdout:2/269: write d5/da/d1b/f36 [739061,118735] 0 2024-02-28T16:24:02.605 INFO:tasks.workunit.client.0.smithi023.stdout:2/270: stat d5/da/f15 0 2024-02-28T16:24:02.605 INFO:tasks.workunit.client.0.smithi023.stdout:8/321: mkdir d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/d6e 0 2024-02-28T16:24:02.608 INFO:tasks.workunit.client.0.smithi023.stdout:6/335: write d1/f11 [62158,127615] 0 2024-02-28T16:24:02.611 INFO:tasks.workunit.client.0.smithi023.stdout:7/210: dwrite de/d13/d1b/d40/f44 [0,4194304] 0 2024-02-28T16:24:02.614 INFO:tasks.workunit.client.0.smithi023.stdout:2/271: creat d5/da/db/d17/d3c/f4c x:0 0 0 2024-02-28T16:24:02.621 INFO:tasks.workunit.client.0.smithi023.stdout:7/211: unlink de/c15 0 2024-02-28T16:24:02.623 INFO:tasks.workunit.client.0.smithi023.stdout:7/212: truncate de/f38 2464944 0 2024-02-28T16:24:02.631 INFO:tasks.workunit.client.0.smithi023.stdout:6/336: dwrite d1/d18/f30 [0,4194304] 0 2024-02-28T16:24:02.643 INFO:tasks.workunit.client.0.smithi023.stdout:8/322: rename d0/d5/d1a/d44/f4f to d0/d5/d1a/d2d/d30/d39/d3d/d3e/f6f 0 2024-02-28T16:24:02.658 INFO:tasks.workunit.client.0.smithi023.stdout:2/272: truncate d5/dc/f21 506481 0 2024-02-28T16:24:02.660 INFO:tasks.workunit.client.0.smithi023.stdout:2/273: readlink d5/da/db/d17/l44 0 2024-02-28T16:24:02.661 INFO:tasks.workunit.client.0.smithi023.stdout:7/213: creat de/d13/d1b/f49 x:0 0 0 2024-02-28T16:24:02.663 INFO:tasks.workunit.client.0.smithi023.stdout:9/250: truncate d0/d7/ff 4973336 0 2024-02-28T16:24:02.664 INFO:tasks.workunit.client.0.smithi023.stdout:2/274: read d5/da/f38 [91848,119017] 0 2024-02-28T16:24:02.669 INFO:tasks.workunit.client.0.smithi023.stdout:7/214: symlink de/d13/l4a 0 2024-02-28T16:24:02.672 INFO:tasks.workunit.client.0.smithi023.stdout:2/275: symlink d5/da/d1b/d3f/l4d 0 2024-02-28T16:24:02.675 INFO:tasks.workunit.client.0.smithi023.stdout:5/453: sync 2024-02-28T16:24:02.675 INFO:tasks.workunit.client.0.smithi023.stdout:4/218: sync 2024-02-28T16:24:02.675 INFO:tasks.workunit.client.0.smithi023.stdout:0/245: sync 2024-02-28T16:24:02.678 INFO:tasks.workunit.client.0.smithi023.stdout:0/246: write d6/f36 [19528,10079] 0 2024-02-28T16:24:02.680 INFO:tasks.workunit.client.0.smithi023.stdout:7/215: mknod de/d13/c4b 0 2024-02-28T16:24:02.682 INFO:tasks.workunit.client.0.smithi023.stdout:9/251: creat d0/d7/db/d18/d23/d28/d32/d3c/f51 x:0 0 0 2024-02-28T16:24:02.688 INFO:tasks.workunit.client.0.smithi023.stdout:0/247: dread d6/db/d1a/d1b/f1d [0,4194304] 0 2024-02-28T16:24:02.691 INFO:tasks.workunit.client.0.smithi023.stdout:0/248: write d6/db/f16 [2514903,679] 0 2024-02-28T16:24:02.696 INFO:tasks.workunit.client.0.smithi023.stdout:7/216: dread de/d13/f1f [0,4194304] 0 2024-02-28T16:24:02.697 INFO:tasks.workunit.client.0.smithi023.stdout:5/454: dwrite d1/d2a/d32/d58/d60/d81/f86 [0,4194304] 0 2024-02-28T16:24:02.706 INFO:tasks.workunit.client.0.smithi023.stdout:4/219: link lf d13/d2b/l42 0 2024-02-28T16:24:02.706 INFO:tasks.workunit.client.0.smithi023.stdout:7/217: stat de/f43 0 2024-02-28T16:24:02.707 INFO:tasks.workunit.client.0.smithi023.stdout:5/455: rmdir d1/d2a/d32/d37/d3a/d7f/d62/d68 39 2024-02-28T16:24:02.713 INFO:tasks.workunit.client.0.smithi023.stdout:7/218: creat de/d13/d1b/f4c x:0 0 0 2024-02-28T16:24:02.715 INFO:tasks.workunit.client.0.smithi023.stdout:5/456: mknod d1/d2a/d32/d36/c87 0 2024-02-28T16:24:02.718 INFO:tasks.workunit.client.0.smithi023.stdout:0/249: dwrite d6/db/d1a/d1b/f27 [0,4194304] 0 2024-02-28T16:24:02.721 INFO:tasks.workunit.client.0.smithi023.stdout:7/219: creat de/d13/f4d x:0 0 0 2024-02-28T16:24:02.727 INFO:tasks.workunit.client.0.smithi023.stdout:4/220: link d13/d1d/d2e/l3d d13/d1d/l43 0 2024-02-28T16:24:02.728 INFO:tasks.workunit.client.0.smithi023.stdout:3/224: sync 2024-02-28T16:24:02.735 INFO:tasks.workunit.client.0.smithi023.stdout:4/221: mknod d13/d1d/d2d/c44 0 2024-02-28T16:24:02.744 INFO:tasks.workunit.client.0.smithi023.stdout:5/457: dwrite d1/d2a/f44 [0,4194304] 0 2024-02-28T16:24:02.746 INFO:tasks.workunit.client.0.smithi023.stdout:7/220: getdents de/d13/d1b/d40 0 2024-02-28T16:24:02.756 INFO:tasks.workunit.client.0.smithi023.stdout:0/250: dread d6/db/f16 [0,4194304] 0 2024-02-28T16:24:02.758 INFO:tasks.workunit.client.0.smithi023.stdout:3/225: dwrite d1/f27 [0,4194304] 0 2024-02-28T16:24:02.764 INFO:tasks.workunit.client.0.smithi023.stdout:8/323: dwrite d0/f18 [0,4194304] 0 2024-02-28T16:24:02.765 INFO:tasks.workunit.client.0.smithi023.stdout:0/251: rmdir d6/db/d3b/d1f/d42 39 2024-02-28T16:24:02.768 INFO:tasks.workunit.client.0.smithi023.stdout:0/252: readlink d6/db/d1a/d1b/l23 0 2024-02-28T16:24:02.768 INFO:tasks.workunit.client.0.smithi023.stdout:7/221: symlink de/d1c/l4e 0 2024-02-28T16:24:02.771 INFO:tasks.workunit.client.0.smithi023.stdout:8/324: creat d0/d5/d1b/f70 x:0 0 0 2024-02-28T16:24:02.771 INFO:tasks.workunit.client.0.smithi023.stdout:3/226: truncate d1/df/f3e 925347 0 2024-02-28T16:24:02.771 INFO:tasks.workunit.client.0.smithi023.stdout:7/222: chown de/d1c/l4e 1770903 1 2024-02-28T16:24:02.778 INFO:tasks.workunit.client.0.smithi023.stdout:8/325: write d0/d5/f27 [712128,60994] 0 2024-02-28T16:24:02.781 INFO:tasks.workunit.client.0.smithi023.stdout:1/310: sync 2024-02-28T16:24:02.790 INFO:tasks.workunit.client.0.smithi023.stdout:7/223: mknod de/d2f/c4f 0 2024-02-28T16:24:02.790 INFO:tasks.workunit.client.0.smithi023.stdout:0/253: dwrite d6/db/f39 [4194304,4194304] 0 2024-02-28T16:24:02.791 INFO:tasks.workunit.client.0.smithi023.stdout:8/326: unlink d0/d5/d1a/d2d/d30/d39/d3d/c6a 0 2024-02-28T16:24:02.794 INFO:tasks.workunit.client.0.smithi023.stdout:1/311: creat df/d26/d48/f70 x:0 0 0 2024-02-28T16:24:02.796 INFO:tasks.workunit.client.0.smithi023.stdout:0/254: chown d6/db/d1a/d26/f38 297 1 2024-02-28T16:24:02.797 INFO:tasks.workunit.client.0.smithi023.stdout:8/327: chown d0/d5/d1a/l5a 1 1 2024-02-28T16:24:02.800 INFO:tasks.workunit.client.0.smithi023.stdout:6/337: unlink d1/d28/f46 0 2024-02-28T16:24:02.803 INFO:tasks.workunit.client.0.smithi023.stdout:1/312: chown df/d11/d13/d1b/d30/d3d/f50 583828 1 2024-02-28T16:24:02.805 INFO:tasks.workunit.client.0.smithi023.stdout:2/276: symlink d5/l4e 0 2024-02-28T16:24:02.808 INFO:tasks.workunit.client.0.smithi023.stdout:9/252: symlink d0/l52 0 2024-02-28T16:24:02.811 INFO:tasks.workunit.client.0.smithi023.stdout:1/313: fdatasync df/d26/f3c 0 2024-02-28T16:24:02.812 INFO:tasks.workunit.client.0.smithi023.stdout:7/224: dread de/f38 [0,4194304] 0 2024-02-28T16:24:02.814 INFO:tasks.workunit.client.0.smithi023.stdout:0/255: rename d6/db/f16 to d6/db/d3b/d1f/d42/f4a 0 2024-02-28T16:24:02.816 INFO:tasks.workunit.client.0.smithi023.stdout:3/227: dwrite d1/df/d22/f14 [0,4194304] 0 2024-02-28T16:24:02.819 INFO:tasks.workunit.client.0.smithi023.stdout:7/225: dread - de/f43 zero size 2024-02-28T16:24:02.826 INFO:tasks.workunit.client.0.smithi023.stdout:2/277: write d5/ff [5145299,28512] 0 2024-02-28T16:24:02.828 INFO:tasks.workunit.client.0.smithi023.stdout:9/253: write d0/d7/de/d34/f3b [821555,10165] 0 2024-02-28T16:24:02.830 INFO:tasks.workunit.client.0.smithi023.stdout:7/226: stat de/l35 0 2024-02-28T16:24:02.835 INFO:tasks.workunit.client.0.smithi023.stdout:8/328: dread d0/d5/f3c [8388608,4194304] 0 2024-02-28T16:24:02.838 INFO:tasks.workunit.client.0.smithi023.stdout:5/458: dwrite d1/d2a/d32/d37/d3a/d7f/f25 [0,4194304] 0 2024-02-28T16:24:02.838 INFO:tasks.workunit.client.0.smithi023.stdout:6/338: dread d1/d18/f30 [0,4194304] 0 2024-02-28T16:24:02.843 INFO:tasks.workunit.client.0.smithi023.stdout:9/254: symlink d0/d7/de/d34/l53 0 2024-02-28T16:24:02.845 INFO:tasks.workunit.client.0.smithi023.stdout:2/278: write d5/da/f15 [1322230,124004] 0 2024-02-28T16:24:02.846 INFO:tasks.workunit.client.0.smithi023.stdout:9/255: write d0/d7/db/d18/f1d [3010032,50516] 0 2024-02-28T16:24:02.852 INFO:tasks.workunit.client.0.smithi023.stdout:7/227: read de/f12 [1700633,59527] 0 2024-02-28T16:24:02.855 INFO:tasks.workunit.client.0.smithi023.stdout:7/228: write fc [3009909,5482] 0 2024-02-28T16:24:02.859 INFO:tasks.workunit.client.0.smithi023.stdout:1/314: truncate df/d11/f67 54106 0 2024-02-28T16:24:02.862 INFO:tasks.workunit.client.0.smithi023.stdout:6/339: fdatasync d1/d18/d26/f58 0 2024-02-28T16:24:02.869 INFO:tasks.workunit.client.0.smithi023.stdout:2/279: mknod d5/da/d1b/d3f/c4f 0 2024-02-28T16:24:02.874 INFO:tasks.workunit.client.0.smithi023.stdout:5/459: write d1/d2a/d32/d37/d3a/d7f/f25 [4528244,6018] 0 2024-02-28T16:24:02.877 INFO:tasks.workunit.client.0.smithi023.stdout:7/229: dread de/d2f/f37 [0,4194304] 0 2024-02-28T16:24:02.880 INFO:tasks.workunit.client.0.smithi023.stdout:3/228: dwrite d1/df/f1e [0,4194304] 0 2024-02-28T16:24:02.880 INFO:tasks.workunit.client.0.smithi023.stdout:0/256: rename d6/db/f2d to d6/db/d3b/d1f/f4b 0 2024-02-28T16:24:02.881 INFO:tasks.workunit.client.0.smithi023.stdout:5/460: fsync d1/d2a/d32/d37/d3a/f6a 0 2024-02-28T16:24:02.884 INFO:tasks.workunit.client.0.smithi023.stdout:8/329: dwrite d0/d5/d1a/f2f [0,4194304] 0 2024-02-28T16:24:02.884 INFO:tasks.workunit.client.0.smithi023.stdout:3/229: chown d1/df/f16 435485 1 2024-02-28T16:24:02.885 INFO:tasks.workunit.client.0.smithi023.stdout:0/257: read d6/db/f39 [7979782,98714] 0 2024-02-28T16:24:02.886 INFO:tasks.workunit.client.0.smithi023.stdout:3/230: chown d1/f11 40547036 1 2024-02-28T16:24:02.888 INFO:tasks.workunit.client.0.smithi023.stdout:3/231: chown d1/f2b 62 1 2024-02-28T16:24:02.888 INFO:tasks.workunit.client.0.smithi023.stdout:8/330: write d0/d5/d1a/d2d/d30/f46 [439340,4443] 0 2024-02-28T16:24:02.889 INFO:tasks.workunit.client.0.smithi023.stdout:1/315: rmdir df/d11/d13 39 2024-02-28T16:24:02.890 INFO:tasks.workunit.client.0.smithi023.stdout:3/232: chown d1/df/f1e 18367 1 2024-02-28T16:24:02.892 INFO:tasks.workunit.client.0.smithi023.stdout:3/233: dread - d1/df/d2d/f40 zero size 2024-02-28T16:24:02.893 INFO:tasks.workunit.client.0.smithi023.stdout:6/340: readlink d1/d18/d26/d3a/l74 0 2024-02-28T16:24:02.895 INFO:tasks.workunit.client.0.smithi023.stdout:6/341: write d1/f11 [3856274,97169] 0 2024-02-28T16:24:02.900 INFO:tasks.workunit.client.0.smithi023.stdout:6/342: truncate d1/d28/d1e/d52/f7f 951512 0 2024-02-28T16:24:02.904 INFO:tasks.workunit.client.0.smithi023.stdout:7/230: rmdir de/d2f 39 2024-02-28T16:24:02.914 INFO:tasks.workunit.client.0.smithi023.stdout:3/234: chown d1/df/f3e 32259 1 2024-02-28T16:24:02.918 INFO:tasks.workunit.client.0.smithi023.stdout:6/343: rename d1/l66 to d1/d18/d26/d6a/l81 0 2024-02-28T16:24:02.919 INFO:tasks.workunit.client.0.smithi023.stdout:6/344: chown d1/d28/d1e/d52/f5b 30 1 2024-02-28T16:24:02.920 INFO:tasks.workunit.client.0.smithi023.stdout:9/256: rmdir d0/d7/d2c/d4a 0 2024-02-28T16:24:02.922 INFO:tasks.workunit.client.0.smithi023.stdout:0/258: write d6/db/d1a/d1b/f1d [517719,124906] 0 2024-02-28T16:24:02.923 INFO:tasks.workunit.client.0.smithi023.stdout:2/280: creat d5/da/d45/f50 x:0 0 0 2024-02-28T16:24:02.924 INFO:tasks.workunit.client.0.smithi023.stdout:2/281: fdatasync d5/da/d1b/f26 0 2024-02-28T16:24:02.925 INFO:tasks.workunit.client.0.smithi023.stdout:7/231: rmdir de/d13/d1b 39 2024-02-28T16:24:02.926 INFO:tasks.workunit.client.0.smithi023.stdout:6/345: truncate d1/d28/d1e/d2b/f43 292820 0 2024-02-28T16:24:02.929 INFO:tasks.workunit.client.0.smithi023.stdout:0/259: dread d6/db/d1a/d1b/f1d [0,4194304] 0 2024-02-28T16:24:02.932 INFO:tasks.workunit.client.0.smithi023.stdout:8/331: mkdir d0/d5/d1a/d2d/d67/d71 0 2024-02-28T16:24:02.937 INFO:tasks.workunit.client.0.smithi023.stdout:8/332: chown d0/d5/d1a/d2d/d30/d39/d3d/l55 45 1 2024-02-28T16:24:02.938 INFO:tasks.workunit.client.0.smithi023.stdout:9/257: dwrite d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:24:02.941 INFO:tasks.workunit.client.0.smithi023.stdout:1/316: rename df/l1c to df/d11/d13/d1b/d30/d3d/d6c/l71 0 2024-02-28T16:24:02.945 INFO:tasks.workunit.client.0.smithi023.stdout:2/282: dwrite d5/da/db/f23 [0,4194304] 0 2024-02-28T16:24:02.948 INFO:tasks.workunit.client.0.smithi023.stdout:5/461: truncate d1/d2a/f44 2329153 0 2024-02-28T16:24:02.951 INFO:tasks.workunit.client.0.smithi023.stdout:7/232: dread - de/d13/d1b/f49 zero size 2024-02-28T16:24:02.954 INFO:tasks.workunit.client.0.smithi023.stdout:3/235: symlink d1/df/l42 0 2024-02-28T16:24:02.956 INFO:tasks.workunit.client.0.smithi023.stdout:3/236: chown d1/c3a 0 1 2024-02-28T16:24:02.958 INFO:tasks.workunit.client.0.smithi023.stdout:4/222: sync 2024-02-28T16:24:02.959 INFO:tasks.workunit.client.0.smithi023.stdout:6/346: rename d1/d28/d1e/c1f to d1/d28/d1e/d80/c82 0 2024-02-28T16:24:02.964 INFO:tasks.workunit.client.0.smithi023.stdout:9/258: dwrite d0/d7/db/d18/d23/d28/d32/f3f [0,4194304] 0 2024-02-28T16:24:02.966 INFO:tasks.workunit.client.0.smithi023.stdout:9/259: write d0/d7/de/f26 [1339171,51223] 0 2024-02-28T16:24:02.967 INFO:tasks.workunit.client.0.smithi023.stdout:1/317: mkdir df/d26/d48/d72 0 2024-02-28T16:24:02.972 INFO:tasks.workunit.client.0.smithi023.stdout:1/318: write df/d11/d13/d1b/d30/f60 [429983,10231] 0 2024-02-28T16:24:02.972 INFO:tasks.workunit.client.0.smithi023.stdout:0/260: dwrite d6/db/d3b/d1f/f4b [0,4194304] 0 2024-02-28T16:24:02.983 INFO:tasks.workunit.client.0.smithi023.stdout:7/233: write de/d2f/f3c [462844,79542] 0 2024-02-28T16:24:02.990 INFO:tasks.workunit.client.0.smithi023.stdout:6/347: dwrite d1/d18/f73 [0,4194304] 0 2024-02-28T16:24:02.993 INFO:tasks.workunit.client.0.smithi023.stdout:6/348: chown d1/l27 99465 1 2024-02-28T16:24:02.996 INFO:tasks.workunit.client.0.smithi023.stdout:6/349: write d1/f22 [1053941,43776] 0 2024-02-28T16:24:02.996 INFO:tasks.workunit.client.0.smithi023.stdout:5/462: dread d1/f39 [0,4194304] 0 2024-02-28T16:24:03.008 INFO:tasks.workunit.client.0.smithi023.stdout:1/319: mkdir df/d11/d13/d73 0 2024-02-28T16:24:03.016 INFO:tasks.workunit.client.0.smithi023.stdout:9/260: dread d0/d7/de/d2a/f38 [0,4194304] 0 2024-02-28T16:24:03.018 INFO:tasks.workunit.client.0.smithi023.stdout:8/333: link d0/d5/d1a/d2d/d30/d39/d3d/d3e/l52 d0/d5/d35/l72 0 2024-02-28T16:24:03.020 INFO:tasks.workunit.client.0.smithi023.stdout:8/334: chown d0/la 7833589 1 2024-02-28T16:24:03.022 INFO:tasks.workunit.client.0.smithi023.stdout:3/237: creat d1/df/d33/d38/f43 x:0 0 0 2024-02-28T16:24:03.025 INFO:tasks.workunit.client.0.smithi023.stdout:7/234: creat de/d13/d1b/d40/f50 x:0 0 0 2024-02-28T16:24:03.029 INFO:tasks.workunit.client.0.smithi023.stdout:0/261: dwrite d6/db/d1a/d2e/f44 [0,4194304] 0 2024-02-28T16:24:03.029 INFO:tasks.workunit.client.0.smithi023.stdout:5/463: mkdir d1/d2a/d32/d58/d60/d88 0 2024-02-28T16:24:03.032 INFO:tasks.workunit.client.0.smithi023.stdout:6/350: symlink d1/d28/d1e/d2b/d6d/l83 0 2024-02-28T16:24:03.034 INFO:tasks.workunit.client.0.smithi023.stdout:9/261: dwrite d0/d7/db/d18/f22 [4194304,4194304] 0 2024-02-28T16:24:03.040 INFO:tasks.workunit.client.0.smithi023.stdout:1/320: mknod df/d11/d13/d1b/d30/d3d/d6c/c74 0 2024-02-28T16:24:03.043 INFO:tasks.workunit.client.0.smithi023.stdout:3/238: creat d1/df/d2d/d32/f44 x:0 0 0 2024-02-28T16:24:03.050 INFO:tasks.workunit.client.0.smithi023.stdout:4/223: creat d13/d1e/d39/f45 x:0 0 0 2024-02-28T16:24:03.053 INFO:tasks.workunit.client.0.smithi023.stdout:0/262: unlink d6/db/d1a/d26/f45 0 2024-02-28T16:24:03.055 INFO:tasks.workunit.client.0.smithi023.stdout:6/351: fdatasync d1/d18/d26/f58 0 2024-02-28T16:24:03.058 INFO:tasks.workunit.client.0.smithi023.stdout:8/335: mknod d0/d5/d1a/c73 0 2024-02-28T16:24:03.063 INFO:tasks.workunit.client.0.smithi023.stdout:2/283: link d5/dc/f21 d5/da/db/f51 0 2024-02-28T16:24:03.064 INFO:tasks.workunit.client.0.smithi023.stdout:0/263: stat d6/db/d3b/c20 0 2024-02-28T16:24:03.066 INFO:tasks.workunit.client.0.smithi023.stdout:3/239: dwrite d1/df/f1e [0,4194304] 0 2024-02-28T16:24:03.067 INFO:tasks.workunit.client.0.smithi023.stdout:9/262: fsync d0/d7/d2c/f45 0 2024-02-28T16:24:03.068 INFO:tasks.workunit.client.0.smithi023.stdout:1/321: dread df/d11/f67 [0,4194304] 0 2024-02-28T16:24:03.071 INFO:tasks.workunit.client.0.smithi023.stdout:6/352: creat d1/d18/d26/f84 x:0 0 0 2024-02-28T16:24:03.073 INFO:tasks.workunit.client.0.smithi023.stdout:2/284: mkdir d5/dc/d52 0 2024-02-28T16:24:03.079 INFO:tasks.workunit.client.0.smithi023.stdout:7/235: getdents de/d1c 0 2024-02-28T16:24:03.081 INFO:tasks.workunit.client.0.smithi023.stdout:8/336: mknod d0/c74 0 2024-02-28T16:24:03.084 INFO:tasks.workunit.client.0.smithi023.stdout:6/353: mkdir d1/d28/d1e/d2b/d85 0 2024-02-28T16:24:03.089 INFO:tasks.workunit.client.0.smithi023.stdout:1/322: readlink df/d11/d13/d1b/d2e/d5c/l5d 0 2024-02-28T16:24:03.093 INFO:tasks.workunit.client.0.smithi023.stdout:9/263: rename d0/d7/d2c/f45 to d0/d7/db/d18/d23/d28/f54 0 2024-02-28T16:24:03.098 INFO:tasks.workunit.client.0.smithi023.stdout:9/264: write d0/d7/de/f26 [1907216,34911] 0 2024-02-28T16:24:03.102 INFO:tasks.workunit.client.0.smithi023.stdout:7/236: mknod de/d1c/c51 0 2024-02-28T16:24:03.110 INFO:tasks.workunit.client.0.smithi023.stdout:8/337: symlink d0/d5/d1b/d36/l75 0 2024-02-28T16:24:03.111 INFO:tasks.workunit.client.0.smithi023.stdout:4/224: dwrite d13/f15 [0,4194304] 0 2024-02-28T16:24:03.114 INFO:tasks.workunit.client.0.smithi023.stdout:6/354: mkdir d1/d28/d1e/d2b/d44/d86 0 2024-02-28T16:24:03.119 INFO:tasks.workunit.client.0.smithi023.stdout:9/265: creat d0/d7/d2c/f55 x:0 0 0 2024-02-28T16:24:03.127 INFO:tasks.workunit.client.0.smithi023.stdout:3/240: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:24:03.127 INFO:tasks.workunit.client.0.smithi023.stdout:5/464: dwrite d1/f40 [0,4194304] 0 2024-02-28T16:24:03.129 INFO:tasks.workunit.client.0.smithi023.stdout:8/338: creat d0/d5/d1a/d44/f76 x:0 0 0 2024-02-28T16:24:03.135 INFO:tasks.workunit.client.0.smithi023.stdout:9/266: creat d0/d7/db/d18/f56 x:0 0 0 2024-02-28T16:24:03.136 INFO:tasks.workunit.client.0.smithi023.stdout:8/339: stat d0/d5/d1a/d2d/d30/d39/d3d/l42 0 2024-02-28T16:24:03.136 INFO:tasks.workunit.client.0.smithi023.stdout:2/285: getdents d5/da/db/d17/d39 0 2024-02-28T16:24:03.139 INFO:tasks.workunit.client.0.smithi023.stdout:3/241: write d1/df/d2d/f40 [925965,113316] 0 2024-02-28T16:24:03.141 INFO:tasks.workunit.client.0.smithi023.stdout:7/237: dwrite f8 [4194304,4194304] 0 2024-02-28T16:24:03.142 INFO:tasks.workunit.client.0.smithi023.stdout:2/286: readlink d5/ld 0 2024-02-28T16:24:03.145 INFO:tasks.workunit.client.0.smithi023.stdout:5/465: write d1/d2a/d32/d37/f51 [2363532,27372] 0 2024-02-28T16:24:03.147 INFO:tasks.workunit.client.0.smithi023.stdout:6/355: link d1/l4d d1/d3d/l87 0 2024-02-28T16:24:03.148 INFO:tasks.workunit.client.0.smithi023.stdout:0/264: write d6/db/d3b/f28 [521979,2402] 0 2024-02-28T16:24:03.149 INFO:tasks.workunit.client.0.smithi023.stdout:8/340: write d0/d5/d1a/d2d/f61 [787090,37766] 0 2024-02-28T16:24:03.156 INFO:tasks.workunit.client.0.smithi023.stdout:5/466: chown d1/d2a/l5d 7 1 2024-02-28T16:24:03.157 INFO:tasks.workunit.client.0.smithi023.stdout:0/265: chown d6/db/d1a/d26/f38 43 1 2024-02-28T16:24:03.163 INFO:tasks.workunit.client.0.smithi023.stdout:6/356: creat d1/d28/d1e/d2b/d76/f88 x:0 0 0 2024-02-28T16:24:03.164 INFO:tasks.workunit.client.0.smithi023.stdout:4/225: dread d13/d2b/d2c/f30 [0,4194304] 0 2024-02-28T16:24:03.171 INFO:tasks.workunit.client.0.smithi023.stdout:3/242: rename d1/df/d22 to d1/df/d2d/d45 0 2024-02-28T16:24:03.172 INFO:tasks.workunit.client.0.smithi023.stdout:3/243: readlink d1/df/l10 0 2024-02-28T16:24:03.175 INFO:tasks.workunit.client.0.smithi023.stdout:7/238: creat de/d13/d1b/d3f/f52 x:0 0 0 2024-02-28T16:24:03.179 INFO:tasks.workunit.client.0.smithi023.stdout:4/226: mknod d13/d2b/d2c/d31/c46 0 2024-02-28T16:24:03.180 INFO:tasks.workunit.client.0.smithi023.stdout:2/287: dwrite d5/da/d1b/f2c [0,4194304] 0 2024-02-28T16:24:03.187 INFO:tasks.workunit.client.0.smithi023.stdout:5/467: mkdir d1/d2a/d32/d58/d60/d88/d89 0 2024-02-28T16:24:03.189 INFO:tasks.workunit.client.0.smithi023.stdout:7/239: mkdir de/d13/d1b/d3d/d53 0 2024-02-28T16:24:03.191 INFO:tasks.workunit.client.0.smithi023.stdout:9/267: getdents d0/d7 0 2024-02-28T16:24:03.194 INFO:tasks.workunit.client.0.smithi023.stdout:8/341: dwrite d0/d5/d1a/d2d/d30/f46 [0,4194304] 0 2024-02-28T16:24:03.196 INFO:tasks.workunit.client.0.smithi023.stdout:0/266: dwrite d6/f36 [0,4194304] 0 2024-02-28T16:24:03.197 INFO:tasks.workunit.client.0.smithi023.stdout:9/268: read d0/d7/db/d18/d23/d28/f54 [8282581,95362] 0 2024-02-28T16:24:03.198 INFO:tasks.workunit.client.0.smithi023.stdout:0/267: stat d6/db/d1a/d26/d31/d33/c40 0 2024-02-28T16:24:03.198 INFO:tasks.workunit.client.0.smithi023.stdout:9/269: dread - d0/d7/d2c/f55 zero size 2024-02-28T16:24:03.205 INFO:tasks.workunit.client.0.smithi023.stdout:8/342: chown d0/d5/d35/f5f 323650 1 2024-02-28T16:24:03.209 INFO:tasks.workunit.client.0.smithi023.stdout:4/227: creat d13/d1d/d2d/f47 x:0 0 0 2024-02-28T16:24:03.224 INFO:tasks.workunit.client.0.smithi023.stdout:3/244: write d1/df/f3e [1312451,113977] 0 2024-02-28T16:24:03.225 INFO:tasks.workunit.client.0.smithi023.stdout:6/357: getdents d1/d28/d1e 0 2024-02-28T16:24:03.226 INFO:tasks.workunit.client.0.smithi023.stdout:5/468: unlink d1/d2a/d32/d37/d3a/d7f/d62/d68/f6c 0 2024-02-28T16:24:03.227 INFO:tasks.workunit.client.0.smithi023.stdout:0/268: mkdir d6/d4c 0 2024-02-28T16:24:03.228 INFO:tasks.workunit.client.0.smithi023.stdout:4/228: dread d13/f17 [0,4194304] 0 2024-02-28T16:24:03.237 INFO:tasks.workunit.client.0.smithi023.stdout:7/240: link de/c16 de/d13/d1b/d3d/d53/c54 0 2024-02-28T16:24:03.237 INFO:tasks.workunit.client.0.smithi023.stdout:2/288: getdents d5/da/db 0 2024-02-28T16:24:03.245 INFO:tasks.workunit.client.0.smithi023.stdout:5/469: creat d1/d2a/d32/d37/d3a/f8a x:0 0 0 2024-02-28T16:24:03.245 INFO:tasks.workunit.client.0.smithi023.stdout:9/270: getdents d0/d7/d2c 0 2024-02-28T16:24:03.248 INFO:tasks.workunit.client.0.smithi023.stdout:6/358: rename d1/d28/d1e/l21 to d1/d18/l89 0 2024-02-28T16:24:03.251 INFO:tasks.workunit.client.0.smithi023.stdout:4/229: creat d13/d2b/d2c/d31/f48 x:0 0 0 2024-02-28T16:24:03.252 INFO:tasks.workunit.client.0.smithi023.stdout:7/241: dread - de/d13/d1b/f4c zero size 2024-02-28T16:24:03.258 INFO:tasks.workunit.client.0.smithi023.stdout:8/343: dwrite d0/d5/d1a/d44/f76 [0,4194304] 0 2024-02-28T16:24:03.263 INFO:tasks.workunit.client.0.smithi023.stdout:8/344: chown d0/d5/f26 4 1 2024-02-28T16:24:03.266 INFO:tasks.workunit.client.0.smithi023.stdout:0/269: getdents d6/db/d1a/d26/d31/d33 0 2024-02-28T16:24:03.267 INFO:tasks.workunit.client.0.smithi023.stdout:5/470: getdents d1/d2a 0 2024-02-28T16:24:03.267 INFO:tasks.workunit.client.0.smithi023.stdout:3/245: dwrite d1/df/d33/d38/f43 [0,4194304] 0 2024-02-28T16:24:03.267 INFO:tasks.workunit.client.0.smithi023.stdout:4/230: symlink d13/d1d/l49 0 2024-02-28T16:24:03.274 INFO:tasks.workunit.client.0.smithi023.stdout:2/289: dwrite d5/da/db/d17/f27 [0,4194304] 0 2024-02-28T16:24:03.274 INFO:tasks.workunit.client.0.smithi023.stdout:6/359: mknod d1/d28/d1e/d52/c8a 0 2024-02-28T16:24:03.277 INFO:tasks.workunit.client.0.smithi023.stdout:7/242: mknod de/d13/d1b/d3d/d53/c55 0 2024-02-28T16:24:03.281 INFO:tasks.workunit.client.0.smithi023.stdout:5/471: write d1/d2a/f3f [4773409,79132] 0 2024-02-28T16:24:03.288 INFO:tasks.workunit.client.0.smithi023.stdout:8/345: symlink d0/d5/d1a/d2d/d30/d39/d3d/l77 0 2024-02-28T16:24:03.292 INFO:tasks.workunit.client.0.smithi023.stdout:2/290: creat d5/da/d1b/d3f/f53 x:0 0 0 2024-02-28T16:24:03.295 INFO:tasks.workunit.client.0.smithi023.stdout:7/243: rename l6 to de/d1c/l56 0 2024-02-28T16:24:03.299 INFO:tasks.workunit.client.0.smithi023.stdout:3/246: dread d1/f4 [0,4194304] 0 2024-02-28T16:24:03.302 INFO:tasks.workunit.client.0.smithi023.stdout:0/270: dwrite d6/db/d3b/d1f/f4b [0,4194304] 0 2024-02-28T16:24:03.303 INFO:tasks.workunit.client.0.smithi023.stdout:5/472: symlink d1/d2a/d32/d58/d60/d88/d89/l8b 0 2024-02-28T16:24:03.309 INFO:tasks.workunit.client.0.smithi023.stdout:4/231: getdents d13/d1e 0 2024-02-28T16:24:03.310 INFO:tasks.workunit.client.0.smithi023.stdout:8/346: creat d0/d5/d1b/d36/f78 x:0 0 0 2024-02-28T16:24:03.319 INFO:tasks.workunit.client.0.smithi023.stdout:1/323: sync 2024-02-28T16:24:03.319 INFO:tasks.workunit.client.0.smithi023.stdout:8/347: fdatasync d0/d5/f40 0 2024-02-28T16:24:03.320 INFO:tasks.workunit.client.0.smithi023.stdout:0/271: write d6/db/d3b/d1f/f4b [1025937,5749] 0 2024-02-28T16:24:03.327 INFO:tasks.workunit.client.0.smithi023.stdout:4/232: write f5 [2611006,101965] 0 2024-02-28T16:24:03.329 INFO:tasks.workunit.client.0.smithi023.stdout:1/324: write df/d26/d48/f70 [1046624,122677] 0 2024-02-28T16:24:03.333 INFO:tasks.workunit.client.0.smithi023.stdout:2/291: getdents d5/da/db/d17/d3c 0 2024-02-28T16:24:03.340 INFO:tasks.workunit.client.0.smithi023.stdout:9/271: dread d0/d7/db/fc [0,4194304] 0 2024-02-28T16:24:03.343 INFO:tasks.workunit.client.0.smithi023.stdout:7/244: dwrite de/d13/f22 [0,4194304] 0 2024-02-28T16:24:03.343 INFO:tasks.workunit.client.0.smithi023.stdout:2/292: fdatasync d5/da/db/d17/d3c/f4c 0 2024-02-28T16:24:03.347 INFO:tasks.workunit.client.0.smithi023.stdout:0/272: creat d6/db/d1a/d26/f4d x:0 0 0 2024-02-28T16:24:03.351 INFO:tasks.workunit.client.0.smithi023.stdout:4/233: truncate d13/d1d/f33 176848 0 2024-02-28T16:24:03.351 INFO:tasks.workunit.client.0.smithi023.stdout:2/293: chown d5/da/l29 1909 1 2024-02-28T16:24:03.355 INFO:tasks.workunit.client.0.smithi023.stdout:6/360: dwrite d1/d28/f3e [0,4194304] 0 2024-02-28T16:24:03.357 INFO:tasks.workunit.client.0.smithi023.stdout:0/273: chown d6/db/d1a/d1b/f1d 129642530 1 2024-02-28T16:24:03.359 INFO:tasks.workunit.client.0.smithi023.stdout:2/294: write d5/da/d1b/f1e [712177,23960] 0 2024-02-28T16:24:03.359 INFO:tasks.workunit.client.0.smithi023.stdout:3/247: dread d1/f8 [0,4194304] 0 2024-02-28T16:24:03.364 INFO:tasks.workunit.client.0.smithi023.stdout:7/245: unlink de/f12 0 2024-02-28T16:24:03.365 INFO:tasks.workunit.client.0.smithi023.stdout:1/325: creat df/f75 x:0 0 0 2024-02-28T16:24:03.368 INFO:tasks.workunit.client.0.smithi023.stdout:1/326: write f3 [1504734,62001] 0 2024-02-28T16:24:03.369 INFO:tasks.workunit.client.0.smithi023.stdout:2/295: write d5/dc/f34 [4000157,50791] 0 2024-02-28T16:24:03.376 INFO:tasks.workunit.client.0.smithi023.stdout:4/234: mknod d13/d1d/d2d/c4a 0 2024-02-28T16:24:03.376 INFO:tasks.workunit.client.0.smithi023.stdout:0/274: symlink d6/db/d24/l4e 0 2024-02-28T16:24:03.377 INFO:tasks.workunit.client.0.smithi023.stdout:6/361: rename d1/d4f/l67 to d1/d18/d26/d3a/l8b 0 2024-02-28T16:24:03.378 INFO:tasks.workunit.client.0.smithi023.stdout:2/296: dread - d5/da/d1b/f4b zero size 2024-02-28T16:24:03.380 INFO:tasks.workunit.client.0.smithi023.stdout:6/362: fdatasync d1/d28/f62 0 2024-02-28T16:24:03.381 INFO:tasks.workunit.client.0.smithi023.stdout:5/473: dread d1/d2a/d32/d37/d3a/d7f/f29 [0,4194304] 0 2024-02-28T16:24:03.383 INFO:tasks.workunit.client.0.smithi023.stdout:8/348: truncate d0/d5/d1b/f20 2126243 0 2024-02-28T16:24:03.386 INFO:tasks.workunit.client.0.smithi023.stdout:3/248: mkdir d1/df/d37/d46 0 2024-02-28T16:24:03.391 INFO:tasks.workunit.client.0.smithi023.stdout:3/249: write d1/f27 [4144817,121481] 0 2024-02-28T16:24:03.391 INFO:tasks.workunit.client.0.smithi023.stdout:2/297: truncate d5/da/db/f23 5085304 0 2024-02-28T16:24:03.394 INFO:tasks.workunit.client.0.smithi023.stdout:3/250: read d1/f4 [2475466,97044] 0 2024-02-28T16:24:03.395 INFO:tasks.workunit.client.0.smithi023.stdout:2/298: write d5/da/f15 [2254728,74421] 0 2024-02-28T16:24:03.396 INFO:tasks.workunit.client.0.smithi023.stdout:1/327: mknod df/d11/c76 0 2024-02-28T16:24:03.400 INFO:tasks.workunit.client.0.smithi023.stdout:3/251: write d1/f20 [926016,37270] 0 2024-02-28T16:24:03.406 INFO:tasks.workunit.client.0.smithi023.stdout:5/474: chown d1/d2a/d32/d37/d4e/f57 106 1 2024-02-28T16:24:03.407 INFO:tasks.workunit.client.0.smithi023.stdout:3/252: chown d1/c1a 2022708 1 2024-02-28T16:24:03.408 INFO:tasks.workunit.client.0.smithi023.stdout:8/349: mknod d0/d5/c79 0 2024-02-28T16:24:03.409 INFO:tasks.workunit.client.0.smithi023.stdout:9/272: dread d0/f1f [0,4194304] 0 2024-02-28T16:24:03.413 INFO:tasks.workunit.client.0.smithi023.stdout:8/350: dread - d0/d5/d1b/f43 zero size 2024-02-28T16:24:03.414 INFO:tasks.workunit.client.0.smithi023.stdout:0/275: dread d6/db/d3b/d1f/f4b [0,4194304] 0 2024-02-28T16:24:03.414 INFO:tasks.workunit.client.0.smithi023.stdout:3/253: dread - d1/df/f30 zero size 2024-02-28T16:24:03.421 INFO:tasks.workunit.client.0.smithi023.stdout:4/235: link d13/d1d/l3a d13/d2b/d2c/l4b 0 2024-02-28T16:24:03.428 INFO:tasks.workunit.client.0.smithi023.stdout:0/276: chown d6/db/d3b/c14 161604 1 2024-02-28T16:24:03.431 INFO:tasks.workunit.client.0.smithi023.stdout:8/351: creat d0/f7a x:0 0 0 2024-02-28T16:24:03.433 INFO:tasks.workunit.client.0.smithi023.stdout:2/299: dread d5/dc/f42 [0,4194304] 0 2024-02-28T16:24:03.438 INFO:tasks.workunit.client.0.smithi023.stdout:4/236: link d13/d1e/l23 d13/l4c 0 2024-02-28T16:24:03.440 INFO:tasks.workunit.client.0.smithi023.stdout:8/352: stat d0/d5/d1b/d36/f78 0 2024-02-28T16:24:03.442 INFO:tasks.workunit.client.0.smithi023.stdout:6/363: dwrite d1/d28/f77 [4194304,4194304] 0 2024-02-28T16:24:03.449 INFO:tasks.workunit.client.0.smithi023.stdout:0/277: fsync d6/db/d1a/d1b/f27 0 2024-02-28T16:24:03.451 INFO:tasks.workunit.client.0.smithi023.stdout:7/246: dread de/d1c/f20 [0,4194304] 0 2024-02-28T16:24:03.451 INFO:tasks.workunit.client.0.smithi023.stdout:4/237: read d13/f15 [1035333,99930] 0 2024-02-28T16:24:03.453 INFO:tasks.workunit.client.0.smithi023.stdout:1/328: dwrite df/f16 [0,4194304] 0 2024-02-28T16:24:03.456 INFO:tasks.workunit.client.0.smithi023.stdout:2/300: stat d5/da/db/d17/f3a 0 2024-02-28T16:24:03.461 INFO:tasks.workunit.client.0.smithi023.stdout:7/247: fsync de/d1c/f26 0 2024-02-28T16:24:03.461 INFO:tasks.workunit.client.0.smithi023.stdout:8/353: unlink d0/d5/f3c 0 2024-02-28T16:24:03.462 INFO:tasks.workunit.client.0.smithi023.stdout:2/301: dread - d5/da/d1b/f4b zero size 2024-02-28T16:24:03.463 INFO:tasks.workunit.client.0.smithi023.stdout:4/238: symlink d13/d1d/d2d/l4d 0 2024-02-28T16:24:03.464 INFO:tasks.workunit.client.0.smithi023.stdout:5/475: dwrite d1/d2a/d32/d37/d3a/d7f/f14 [4194304,4194304] 0 2024-02-28T16:24:03.466 INFO:tasks.workunit.client.0.smithi023.stdout:3/254: dwrite d1/f4 [4194304,4194304] 0 2024-02-28T16:24:03.466 INFO:tasks.workunit.client.0.smithi023.stdout:1/329: read df/d26/d48/f70 [522533,69641] 0 2024-02-28T16:24:03.472 INFO:tasks.workunit.client.0.smithi023.stdout:2/302: chown d5/dc 17 1 2024-02-28T16:24:03.474 INFO:tasks.workunit.client.0.smithi023.stdout:7/248: chown de/d13/d1b/d3d/d53 1 1 2024-02-28T16:24:03.476 INFO:tasks.workunit.client.0.smithi023.stdout:5/476: stat d1/d2a/l5d 0 2024-02-28T16:24:03.478 INFO:tasks.workunit.client.0.smithi023.stdout:8/354: creat d0/d5/d1a/d2d/f7b x:0 0 0 2024-02-28T16:24:03.478 INFO:tasks.workunit.client.0.smithi023.stdout:9/273: dwrite d0/d7/db/f24 [0,4194304] 0 2024-02-28T16:24:03.483 INFO:tasks.workunit.client.0.smithi023.stdout:4/239: creat d13/d1d/f4e x:0 0 0 2024-02-28T16:24:03.488 INFO:tasks.workunit.client.0.smithi023.stdout:7/249: rmdir de/d13/d1b/d3d 39 2024-02-28T16:24:03.490 INFO:tasks.workunit.client.0.smithi023.stdout:9/274: read d0/d7/db/d18/d23/d28/d32/f3f [3308502,4517] 0 2024-02-28T16:24:03.492 INFO:tasks.workunit.client.0.smithi023.stdout:0/278: dwrite d6/db/f39 [4194304,4194304] 0 2024-02-28T16:24:03.493 INFO:tasks.workunit.client.0.smithi023.stdout:5/477: unlink d1/f39 0 2024-02-28T16:24:03.499 INFO:tasks.workunit.client.0.smithi023.stdout:0/279: dread - d6/db/d1a/d26/d31/f46 zero size 2024-02-28T16:24:03.499 INFO:tasks.workunit.client.0.smithi023.stdout:5/478: write d1/d2a/d32/d37/d4e/f57 [1600769,113927] 0 2024-02-28T16:24:03.504 INFO:tasks.workunit.client.0.smithi023.stdout:8/355: creat d0/d5/d1a/d2d/d67/f7c x:0 0 0 2024-02-28T16:24:03.508 INFO:tasks.workunit.client.0.smithi023.stdout:1/330: symlink df/d11/d13/d1b/d30/d57/d5a/d68/l77 0 2024-02-28T16:24:03.515 INFO:tasks.workunit.client.0.smithi023.stdout:4/240: readlink d13/d2b/d2c/l4b 0 2024-02-28T16:24:03.517 INFO:tasks.workunit.client.0.smithi023.stdout:2/303: creat d5/da/f54 x:0 0 0 2024-02-28T16:24:03.518 INFO:tasks.workunit.client.0.smithi023.stdout:7/250: rmdir de 39 2024-02-28T16:24:03.521 INFO:tasks.workunit.client.0.smithi023.stdout:3/255: creat d1/df/d3d/f47 x:0 0 0 2024-02-28T16:24:03.523 INFO:tasks.workunit.client.0.smithi023.stdout:0/280: creat d6/db/d1a/d2e/f4f x:0 0 0 2024-02-28T16:24:03.527 INFO:tasks.workunit.client.0.smithi023.stdout:8/356: rmdir d0/d5/d1b 39 2024-02-28T16:24:03.529 INFO:tasks.workunit.client.0.smithi023.stdout:8/357: chown d0/d5/d35 1361 1 2024-02-28T16:24:03.531 INFO:tasks.workunit.client.0.smithi023.stdout:1/331: dwrite df/d11/d13/d1b/d30/f41 [0,4194304] 0 2024-02-28T16:24:03.541 INFO:tasks.workunit.client.0.smithi023.stdout:3/256: creat d1/df/d33/d38/f48 x:0 0 0 2024-02-28T16:24:03.542 INFO:tasks.workunit.client.0.smithi023.stdout:8/358: mkdir d0/d5/d1a/d2d/d67/d7d 0 2024-02-28T16:24:03.545 INFO:tasks.workunit.client.0.smithi023.stdout:8/359: readlink d0/la 0 2024-02-28T16:24:03.546 INFO:tasks.workunit.client.0.smithi023.stdout:5/479: dwrite d1/d2a/d32/d37/f59 [0,4194304] 0 2024-02-28T16:24:03.550 INFO:tasks.workunit.client.0.smithi023.stdout:2/304: getdents d5/da/db/d17/d39 0 2024-02-28T16:24:03.551 INFO:tasks.workunit.client.0.smithi023.stdout:4/241: creat d13/d2b/f4f x:0 0 0 2024-02-28T16:24:03.555 INFO:tasks.workunit.client.0.smithi023.stdout:3/257: rename d1/df/d2d/d32/f44 to d1/df/d2d/f49 0 2024-02-28T16:24:03.556 INFO:tasks.workunit.client.0.smithi023.stdout:2/305: read - d5/da/db/d17/d3c/f46 zero size 2024-02-28T16:24:03.558 INFO:tasks.workunit.client.0.smithi023.stdout:4/242: truncate d13/d2b/d2c/f35 1845829 0 2024-02-28T16:24:03.558 INFO:tasks.workunit.client.0.smithi023.stdout:5/480: chown d1/d2a/d32/d37/d3a/d7f/l53 4124672 1 2024-02-28T16:24:03.561 INFO:tasks.workunit.client.0.smithi023.stdout:1/332: dwrite df/d11/d13/d1b/f55 [0,4194304] 0 2024-02-28T16:24:03.561 INFO:tasks.workunit.client.0.smithi023.stdout:4/243: fdatasync d13/d1e/d39/f45 0 2024-02-28T16:24:03.564 INFO:tasks.workunit.client.0.smithi023.stdout:7/251: symlink de/d13/d1b/d3d/d53/l57 0 2024-02-28T16:24:03.565 INFO:tasks.workunit.client.0.smithi023.stdout:5/481: creat d1/d2a/d32/d37/d3a/d7f/d62/d68/f8c x:0 0 0 2024-02-28T16:24:03.572 INFO:tasks.workunit.client.0.smithi023.stdout:7/252: stat de/d13/d1b/l47 0 2024-02-28T16:24:03.579 INFO:tasks.workunit.client.0.smithi023.stdout:3/258: truncate d1/f41 858424 0 2024-02-28T16:24:03.583 INFO:tasks.workunit.client.0.smithi023.stdout:4/244: truncate d13/f3c 161972 0 2024-02-28T16:24:03.583 INFO:tasks.workunit.client.0.smithi023.stdout:8/360: rename d0/d5/d1a/d2d/d30/d39/d3d/d3e/f6f to d0/d5/f7e 0 2024-02-28T16:24:03.588 INFO:tasks.workunit.client.0.smithi023.stdout:4/245: unlink d13/d1d/f4e 0 2024-02-28T16:24:03.590 INFO:tasks.workunit.client.0.smithi023.stdout:1/333: rename df/d11/d13/d1b/d2e/d5c/d6b to df/d11/d13/d1b/d30/d57/d78 0 2024-02-28T16:24:03.593 INFO:tasks.workunit.client.0.smithi023.stdout:7/253: link de/l31 de/d1c/l58 0 2024-02-28T16:24:03.597 INFO:tasks.workunit.client.0.smithi023.stdout:3/259: dwrite d1/df/f1e [0,4194304] 0 2024-02-28T16:24:03.601 INFO:tasks.workunit.client.0.smithi023.stdout:1/334: creat df/d26/d48/f79 x:0 0 0 2024-02-28T16:24:03.602 INFO:tasks.workunit.client.0.smithi023.stdout:4/246: mknod d13/d1d/c50 0 2024-02-28T16:24:03.603 INFO:tasks.workunit.client.0.smithi023.stdout:8/361: mkdir d0/d5/d1b/d7f 0 2024-02-28T16:24:03.605 INFO:tasks.workunit.client.0.smithi023.stdout:7/254: creat de/d2f/f59 x:0 0 0 2024-02-28T16:24:03.608 INFO:tasks.workunit.client.0.smithi023.stdout:1/335: unlink df/d11/f21 0 2024-02-28T16:24:03.611 INFO:tasks.workunit.client.0.smithi023.stdout:4/247: fdatasync d13/f15 0 2024-02-28T16:24:03.612 INFO:tasks.workunit.client.0.smithi023.stdout:8/362: creat d0/d5/d1b/d36/f80 x:0 0 0 2024-02-28T16:24:03.614 INFO:tasks.workunit.client.0.smithi023.stdout:5/482: rename d1/d2a/d32/d36/f43 to d1/d2a/d32/d37/d3a/d7f/f8d 0 2024-02-28T16:24:03.615 INFO:tasks.workunit.client.0.smithi023.stdout:8/363: chown d0/d5/d1a/d2d/f5c 231 1 2024-02-28T16:24:03.617 INFO:tasks.workunit.client.0.smithi023.stdout:3/260: mkdir d1/d4a 0 2024-02-28T16:24:03.617 INFO:tasks.workunit.client.0.smithi023.stdout:5/483: chown d1/d2a/d32/d36/f66 449463 1 2024-02-28T16:24:03.618 INFO:tasks.workunit.client.0.smithi023.stdout:5/484: chown d1/f19 13 1 2024-02-28T16:24:03.619 INFO:tasks.workunit.client.0.smithi023.stdout:3/261: chown d1/f23 5 1 2024-02-28T16:24:03.624 INFO:tasks.workunit.client.0.smithi023.stdout:1/336: mkdir df/d11/d13/d1b/d30/d57/d5a/d68/d7a 0 2024-02-28T16:24:03.625 INFO:tasks.workunit.client.0.smithi023.stdout:4/248: dread d13/f15 [0,4194304] 0 2024-02-28T16:24:03.626 INFO:tasks.workunit.client.0.smithi023.stdout:7/255: dread de/f38 [0,4194304] 0 2024-02-28T16:24:03.628 INFO:tasks.workunit.client.0.smithi023.stdout:7/256: chown de/d2f/c4f 12378 1 2024-02-28T16:24:03.628 INFO:tasks.workunit.client.0.smithi023.stdout:4/249: truncate d13/d1d/f41 573440 0 2024-02-28T16:24:03.630 INFO:tasks.workunit.client.0.smithi023.stdout:5/485: chown d1/d2a/d32/d37/d3a/c75 324 1 2024-02-28T16:24:03.631 INFO:tasks.workunit.client.0.smithi023.stdout:4/250: readlink d13/d2b/d2c/d31/l3e 0 2024-02-28T16:24:03.632 INFO:tasks.workunit.client.0.smithi023.stdout:3/262: symlink d1/df/d2d/d32/d3f/l4b 0 2024-02-28T16:24:03.633 INFO:tasks.workunit.client.0.smithi023.stdout:3/263: chown d1/df/d2d/c36 421492 1 2024-02-28T16:24:03.634 INFO:tasks.workunit.client.0.smithi023.stdout:7/257: creat de/d1c/f5a x:0 0 0 2024-02-28T16:24:03.639 INFO:tasks.workunit.client.0.smithi023.stdout:8/364: getdents d0/d5/d1a/d2d/d30/d39 0 2024-02-28T16:24:03.649 INFO:tasks.workunit.client.0.smithi023.stdout:3/264: dwrite d1/f23 [0,4194304] 0 2024-02-28T16:24:03.650 INFO:tasks.workunit.client.0.smithi023.stdout:4/251: dread fe [0,4194304] 0 2024-02-28T16:24:03.652 INFO:tasks.workunit.client.0.smithi023.stdout:8/365: rename d0/d5/d1a/d2d/d30/d39/d3d/d3e/l52 to d0/l81 0 2024-02-28T16:24:03.655 INFO:tasks.workunit.client.0.smithi023.stdout:1/337: write df/d11/d13/d1b/d30/f43 [2681955,114107] 0 2024-02-28T16:24:03.655 INFO:tasks.workunit.client.0.smithi023.stdout:8/366: write d0/d5/d1a/d2d/f5c [631740,28786] 0 2024-02-28T16:24:03.657 INFO:tasks.workunit.client.0.smithi023.stdout:3/265: mkdir d1/df/d33/d38/d4c 0 2024-02-28T16:24:03.658 INFO:tasks.workunit.client.0.smithi023.stdout:8/367: write d0/fc [3296878,94547] 0 2024-02-28T16:24:03.661 INFO:tasks.workunit.client.0.smithi023.stdout:1/338: mkdir df/d11/d13/d1b/d30/d3d/d7b 0 2024-02-28T16:24:03.663 INFO:tasks.workunit.client.0.smithi023.stdout:4/252: rename d13/f15 to d13/d2b/f51 0 2024-02-28T16:24:03.665 INFO:tasks.workunit.client.0.smithi023.stdout:4/253: chown d13/d1d/d2e 3049621 1 2024-02-28T16:24:03.679 INFO:tasks.workunit.client.0.smithi023.stdout:8/368: dread d0/d5/d1a/d2d/d30/d39/f3b [0,4194304] 0 2024-02-28T16:24:03.681 INFO:tasks.workunit.client.0.smithi023.stdout:8/369: readlink d0/d5/d1b/l12 0 2024-02-28T16:24:03.682 INFO:tasks.workunit.client.0.smithi023.stdout:1/339: dwrite df/d11/d13/d1b/d2e/f6d [0,4194304] 0 2024-02-28T16:24:03.684 INFO:tasks.workunit.client.0.smithi023.stdout:8/370: write d0/d5/d1b/f70 [241470,29708] 0 2024-02-28T16:24:03.689 INFO:tasks.workunit.client.0.smithi023.stdout:1/340: rename df/l20 to df/d11/d13/d1b/d2e/d5c/l7c 0 2024-02-28T16:24:03.691 INFO:tasks.workunit.client.0.smithi023.stdout:4/254: truncate d13/d2b/d2c/f35 970600 0 2024-02-28T16:24:03.693 INFO:tasks.workunit.client.0.smithi023.stdout:8/371: symlink d0/d5/d1a/d63/l82 0 2024-02-28T16:24:03.694 INFO:tasks.workunit.client.0.smithi023.stdout:3/266: dread d1/df/d2d/d45/f1b [0,4194304] 0 2024-02-28T16:24:03.695 INFO:tasks.workunit.client.0.smithi023.stdout:1/341: unlink c9 0 2024-02-28T16:24:03.697 INFO:tasks.workunit.client.0.smithi023.stdout:4/255: unlink d13/d2b/d2c/l4b 0 2024-02-28T16:24:03.700 INFO:tasks.workunit.client.0.smithi023.stdout:8/372: rmdir d0/d5/d1a/d2d 39 2024-02-28T16:24:03.705 INFO:tasks.workunit.client.0.smithi023.stdout:4/256: creat d13/d1d/d2e/f52 x:0 0 0 2024-02-28T16:24:03.708 INFO:tasks.workunit.client.0.smithi023.stdout:1/342: creat df/d11/d13/d1b/d30/d3d/d7b/f7d x:0 0 0 2024-02-28T16:24:03.710 INFO:tasks.workunit.client.0.smithi023.stdout:4/257: symlink d13/d2b/d2c/d31/l53 0 2024-02-28T16:24:03.715 INFO:tasks.workunit.client.0.smithi023.stdout:8/373: symlink d0/d5/d1a/d2d/d67/d71/l83 0 2024-02-28T16:24:03.722 INFO:tasks.workunit.client.0.smithi023.stdout:1/343: getdents df/d26 0 2024-02-28T16:24:03.723 INFO:tasks.workunit.client.0.smithi023.stdout:4/258: link cc d13/d1d/d2d/c54 0 2024-02-28T16:24:03.724 INFO:tasks.workunit.client.0.smithi023.stdout:3/267: dread d1/f2c [0,4194304] 0 2024-02-28T16:24:03.726 INFO:tasks.workunit.client.0.smithi023.stdout:4/259: write d13/d2b/d2c/f2f [9173878,101938] 0 2024-02-28T16:24:03.726 INFO:tasks.workunit.client.0.smithi023.stdout:1/344: symlink df/d11/d13/d1b/d2e/d5c/l7e 0 2024-02-28T16:24:03.729 INFO:tasks.workunit.client.0.smithi023.stdout:4/260: mkdir d13/d1e/d39/d55 0 2024-02-28T16:24:03.732 INFO:tasks.workunit.client.0.smithi023.stdout:3/268: getdents d1/df/d33/d38/d4c 0 2024-02-28T16:24:03.735 INFO:tasks.workunit.client.0.smithi023.stdout:3/269: fdatasync d1/df/d2d/f49 0 2024-02-28T16:24:03.736 INFO:tasks.workunit.client.0.smithi023.stdout:8/374: truncate d0/d5/f26 547650 0 2024-02-28T16:24:03.741 INFO:tasks.workunit.client.0.smithi023.stdout:3/270: rename d1/l2f to d1/df/d37/d46/l4d 0 2024-02-28T16:24:03.744 INFO:tasks.workunit.client.0.smithi023.stdout:1/345: dwrite df/d11/d13/f2c [4194304,4194304] 0 2024-02-28T16:24:03.750 INFO:tasks.workunit.client.0.smithi023.stdout:4/261: dwrite d13/d2b/d2c/f30 [0,4194304] 0 2024-02-28T16:24:03.758 INFO:tasks.workunit.client.0.smithi023.stdout:4/262: rename d13/d2b/d2c/d31/l53 to d13/d2b/d2c/l56 0 2024-02-28T16:24:03.759 INFO:tasks.workunit.client.0.smithi023.stdout:3/271: dread d1/df/d2d/d45/f1b [0,4194304] 0 2024-02-28T16:24:03.762 INFO:tasks.workunit.client.0.smithi023.stdout:4/263: creat d13/d2b/d2c/f57 x:0 0 0 2024-02-28T16:24:03.769 INFO:tasks.workunit.client.0.smithi023.stdout:4/264: write d13/d1d/d2d/f36 [711449,13643] 0 2024-02-28T16:24:03.770 INFO:tasks.workunit.client.0.smithi023.stdout:4/265: chown d13/d1d 143540 1 2024-02-28T16:24:03.774 INFO:tasks.workunit.client.0.smithi023.stdout:4/266: mkdir d13/d1d/d58 0 2024-02-28T16:24:03.778 INFO:tasks.workunit.client.0.smithi023.stdout:1/346: dwrite df/d11/d13/d1b/d30/f69 [0,4194304] 0 2024-02-28T16:24:03.778 INFO:tasks.workunit.client.0.smithi023.stdout:4/267: write d13/d1d/f25 [74671,24622] 0 2024-02-28T16:24:03.783 INFO:tasks.workunit.client.0.smithi023.stdout:3/272: dwrite d1/df/f3b [0,4194304] 0 2024-02-28T16:24:03.789 INFO:tasks.workunit.client.0.smithi023.stdout:8/375: dread d0/d5/d1a/d2d/d30/d39/d3d/d3e/f48 [0,4194304] 0 2024-02-28T16:24:03.792 INFO:tasks.workunit.client.0.smithi023.stdout:3/273: symlink d1/d4a/l4e 0 2024-02-28T16:24:03.793 INFO:tasks.workunit.client.0.smithi023.stdout:1/347: rename df/d11/d13/d1b/f44 to df/d11/d13/d1b/f7f 0 2024-02-28T16:24:03.799 INFO:tasks.workunit.client.0.smithi023.stdout:1/348: mkdir df/d26/d48/d80 0 2024-02-28T16:24:03.803 INFO:tasks.workunit.client.0.smithi023.stdout:1/349: unlink df/d11/f67 0 2024-02-28T16:24:03.807 INFO:tasks.workunit.client.0.smithi023.stdout:8/376: getdents d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62 0 2024-02-28T16:24:03.807 INFO:tasks.workunit.client.0.smithi023.stdout:3/274: dread d1/df/d2d/d45/f14 [0,4194304] 0 2024-02-28T16:24:03.807 INFO:tasks.workunit.client.0.smithi023.stdout:1/350: creat df/d11/d13/d1b/d30/d3d/f81 x:0 0 0 2024-02-28T16:24:03.812 INFO:tasks.workunit.client.0.smithi023.stdout:3/275: write d1/f2c [2527043,374] 0 2024-02-28T16:24:03.814 INFO:tasks.workunit.client.0.smithi023.stdout:6/364: sync 2024-02-28T16:24:03.815 INFO:tasks.workunit.client.0.smithi023.stdout:8/377: getdents d0/d5/d1a/d2d/d30 0 2024-02-28T16:24:03.818 INFO:tasks.workunit.client.0.smithi023.stdout:6/365: creat d1/d18/f8c x:0 0 0 2024-02-28T16:24:03.819 INFO:tasks.workunit.client.0.smithi023.stdout:8/378: creat d0/d5/d1a/d2d/f84 x:0 0 0 2024-02-28T16:24:03.820 INFO:tasks.workunit.client.0.smithi023.stdout:3/276: rename d1/df/f1e to d1/df/d3d/f4f 0 2024-02-28T16:24:03.821 INFO:tasks.workunit.client.0.smithi023.stdout:6/366: read d1/f12 [788005,11817] 0 2024-02-28T16:24:03.830 INFO:tasks.workunit.client.0.smithi023.stdout:8/379: unlink d0/l5b 0 2024-02-28T16:24:03.836 INFO:tasks.workunit.client.0.smithi023.stdout:3/277: creat d1/df/d33/d38/d4c/f50 x:0 0 0 2024-02-28T16:24:03.836 INFO:tasks.workunit.client.0.smithi023.stdout:8/380: dread d0/d5/d1b/f70 [0,4194304] 0 2024-02-28T16:24:03.840 INFO:tasks.workunit.client.0.smithi023.stdout:6/367: dwrite d1/f11 [4194304,4194304] 0 2024-02-28T16:24:03.841 INFO:tasks.workunit.client.0.smithi023.stdout:3/278: write d1/df/d33/d38/f48 [626220,60244] 0 2024-02-28T16:24:03.845 INFO:tasks.workunit.client.0.smithi023.stdout:8/381: dread - d0/f7a zero size 2024-02-28T16:24:03.851 INFO:tasks.workunit.client.0.smithi023.stdout:1/351: dread df/d11/d13/d1b/d30/d57/d5a/f64 [0,4194304] 0 2024-02-28T16:24:03.853 INFO:tasks.workunit.client.0.smithi023.stdout:1/352: dread - df/d11/f54 zero size 2024-02-28T16:24:03.855 INFO:tasks.workunit.client.0.smithi023.stdout:6/368: truncate d1/d28/d1e/d2b/d76/f88 454621 0 2024-02-28T16:24:03.855 INFO:tasks.workunit.client.0.smithi023.stdout:3/279: link d1/df/d33/d38/f48 d1/df/d2d/d32/f51 0 2024-02-28T16:24:03.856 INFO:tasks.workunit.client.0.smithi023.stdout:8/382: getdents d0/d5/d1a/d2d/d30/d39/d3d/d6c 0 2024-02-28T16:24:03.856 INFO:tasks.workunit.client.0.smithi023.stdout:6/369: write d1/f69 [239860,68900] 0 2024-02-28T16:24:03.858 INFO:tasks.workunit.client.0.smithi023.stdout:3/280: mkdir d1/df/d2d/d45/d52 0 2024-02-28T16:24:03.859 INFO:tasks.workunit.client.0.smithi023.stdout:6/370: stat d1/d28/d1e/d2b/d44/l6e 0 2024-02-28T16:24:03.860 INFO:tasks.workunit.client.0.smithi023.stdout:8/383: creat d0/d5/d1b/d36/f85 x:0 0 0 2024-02-28T16:24:03.862 INFO:tasks.workunit.client.0.smithi023.stdout:6/371: unlink d1/f4 0 2024-02-28T16:24:03.863 INFO:tasks.workunit.client.0.smithi023.stdout:3/281: creat d1/df/d3d/f53 x:0 0 0 2024-02-28T16:24:03.866 INFO:tasks.workunit.client.0.smithi023.stdout:8/384: creat d0/d5/d35/f86 x:0 0 0 2024-02-28T16:24:03.869 INFO:tasks.workunit.client.0.smithi023.stdout:3/282: write d1/df/f16 [2762044,101305] 0 2024-02-28T16:24:03.869 INFO:tasks.workunit.client.0.smithi023.stdout:8/385: write d0/d5/d1a/d2d/f5c [42223,110841] 0 2024-02-28T16:24:03.874 INFO:tasks.workunit.client.0.smithi023.stdout:3/283: write d1/df/d3d/f47 [475960,76863] 0 2024-02-28T16:24:03.877 INFO:tasks.workunit.client.0.smithi023.stdout:8/386: fdatasync d0/d5/d1a/d2d/f31 0 2024-02-28T16:24:03.888 INFO:tasks.workunit.client.0.smithi023.stdout:8/387: getdents d0/d5/d1a/d2d/d67 0 2024-02-28T16:24:03.889 INFO:tasks.workunit.client.0.smithi023.stdout:1/353: truncate df/d11/d13/d1b/d30/f41 501341 0 2024-02-28T16:24:03.889 INFO:tasks.workunit.client.0.smithi023.stdout:8/388: dread - d0/d5/d1b/f43 zero size 2024-02-28T16:24:03.892 INFO:tasks.workunit.client.0.smithi023.stdout:8/389: fdatasync d0/d5/d1a/f6d 0 2024-02-28T16:24:03.894 INFO:tasks.workunit.client.0.smithi023.stdout:3/284: truncate d1/df/d2d/d45/f14 116173 0 2024-02-28T16:24:03.899 INFO:tasks.workunit.client.0.smithi023.stdout:3/285: creat d1/df/d3d/f54 x:0 0 0 2024-02-28T16:24:03.899 INFO:tasks.workunit.client.0.smithi023.stdout:6/372: dread d1/d28/f77 [0,4194304] 0 2024-02-28T16:24:03.904 INFO:tasks.workunit.client.0.smithi023.stdout:6/373: symlink d1/d3d/l8d 0 2024-02-28T16:24:03.904 INFO:tasks.workunit.client.0.smithi023.stdout:8/390: rmdir d0/d5/d1a/d2d/d30/d39/d3d/d6c 0 2024-02-28T16:24:03.906 INFO:tasks.workunit.client.0.smithi023.stdout:1/354: dwrite df/d11/f54 [0,4194304] 0 2024-02-28T16:24:03.912 INFO:tasks.workunit.client.0.smithi023.stdout:8/391: mknod d0/d5/d1a/d2d/d67/c87 0 2024-02-28T16:24:03.913 INFO:tasks.workunit.client.0.smithi023.stdout:6/374: creat d1/d28/d1e/d2b/f8e x:0 0 0 2024-02-28T16:24:03.917 INFO:tasks.workunit.client.0.smithi023.stdout:6/375: fsync d1/d28/d1e/f4e 0 2024-02-28T16:24:03.921 INFO:tasks.workunit.client.0.smithi023.stdout:8/392: dread d0/d5/d1a/d2d/f61 [0,4194304] 0 2024-02-28T16:24:03.932 INFO:tasks.workunit.client.0.smithi023.stdout:3/286: dwrite d1/f41 [0,4194304] 0 2024-02-28T16:24:03.932 INFO:tasks.workunit.client.0.smithi023.stdout:3/287: fsync d1/df/d3d/f54 0 2024-02-28T16:24:03.935 INFO:tasks.workunit.client.0.smithi023.stdout:3/288: readlink d1/df/d2d/d32/d3f/l4b 0 2024-02-28T16:24:03.936 INFO:tasks.workunit.client.0.smithi023.stdout:8/393: rename d0/d5/d1a/d2d/f7b to d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/f88 0 2024-02-28T16:24:03.938 INFO:tasks.workunit.client.0.smithi023.stdout:1/355: dread df/d11/f12 [0,4194304] 0 2024-02-28T16:24:03.945 INFO:tasks.workunit.client.0.smithi023.stdout:8/394: creat d0/d5/d1a/d2d/d30/d39/d3d/f89 x:0 0 0 2024-02-28T16:24:03.947 INFO:tasks.workunit.client.0.smithi023.stdout:1/356: symlink df/d11/d13/d1b/d30/d3d/d7b/l82 0 2024-02-28T16:24:03.948 INFO:tasks.workunit.client.0.smithi023.stdout:1/357: fsync df/f75 0 2024-02-28T16:24:03.952 INFO:tasks.workunit.client.0.smithi023.stdout:6/376: dread d1/fe [0,4194304] 0 2024-02-28T16:24:03.953 INFO:tasks.workunit.client.0.smithi023.stdout:1/358: dread df/d11/d13/d1b/f40 [0,4194304] 0 2024-02-28T16:24:03.954 INFO:tasks.workunit.client.0.smithi023.stdout:8/395: write d0/d5/d1a/d2d/f61 [517035,59725] 0 2024-02-28T16:24:03.955 INFO:tasks.workunit.client.0.smithi023.stdout:6/377: write d1/f69 [335992,52464] 0 2024-02-28T16:24:03.964 INFO:tasks.workunit.client.0.smithi023.stdout:8/396: symlink d0/d5/d1a/d2d/d30/l8a 0 2024-02-28T16:24:03.967 INFO:tasks.workunit.client.0.smithi023.stdout:6/378: rename d1/f12 to d1/d28/d1e/d2b/d44/d86/f8f 0 2024-02-28T16:24:03.969 INFO:tasks.workunit.client.0.smithi023.stdout:1/359: mknod df/c83 0 2024-02-28T16:24:03.970 INFO:tasks.workunit.client.0.smithi023.stdout:3/289: write d1/df/d2d/d45/f14 [719754,27529] 0 2024-02-28T16:24:03.976 INFO:tasks.workunit.client.0.smithi023.stdout:6/379: rename d1/d28/d1e/d2b/f54 to d1/d18/f90 0 2024-02-28T16:24:03.978 INFO:tasks.workunit.client.0.smithi023.stdout:3/290: creat d1/df/d33/d38/d4c/f55 x:0 0 0 2024-02-28T16:24:03.981 INFO:tasks.workunit.client.0.smithi023.stdout:8/397: creat d0/d5/d1a/f8b x:0 0 0 2024-02-28T16:24:03.987 INFO:tasks.workunit.client.0.smithi023.stdout:8/398: symlink d0/d5/d1a/d44/l8c 0 2024-02-28T16:24:03.992 INFO:tasks.workunit.client.0.smithi023.stdout:1/360: dwrite df/d11/d13/d1b/d30/d3d/d7b/f7d [0,4194304] 0 2024-02-28T16:24:03.993 INFO:tasks.workunit.client.0.smithi023.stdout:8/399: write d0/f7a [872037,9707] 0 2024-02-28T16:24:03.993 INFO:tasks.workunit.client.0.smithi023.stdout:6/380: dwrite d1/f1b [0,4194304] 0 2024-02-28T16:24:04.010 INFO:tasks.workunit.client.0.smithi023.stdout:8/400: dread d0/d5/d1a/f2e [0,4194304] 0 2024-02-28T16:24:04.014 INFO:tasks.workunit.client.0.smithi023.stdout:1/361: dwrite df/d11/d13/d1b/f39 [0,4194304] 0 2024-02-28T16:24:04.015 INFO:tasks.workunit.client.0.smithi023.stdout:8/401: mkdir d0/d5/d1b/d8d 0 2024-02-28T16:24:04.028 INFO:tasks.workunit.client.0.smithi023.stdout:6/381: write d1/d18/f90 [593475,88175] 0 2024-02-28T16:24:04.032 INFO:tasks.workunit.client.0.smithi023.stdout:6/382: mknod d1/d18/c91 0 2024-02-28T16:24:04.034 INFO:tasks.workunit.client.0.smithi023.stdout:6/383: chown d1/d3d/l8d 242 1 2024-02-28T16:24:04.035 INFO:tasks.workunit.client.0.smithi023.stdout:1/362: dwrite df/d11/d13/d1b/d30/d57/d5a/f64 [4194304,4194304] 0 2024-02-28T16:24:04.058 INFO:tasks.workunit.client.0.smithi023.stdout:6/384: dread d1/d3d/f45 [0,4194304] 0 2024-02-28T16:24:04.062 INFO:tasks.workunit.client.0.smithi023.stdout:6/385: creat d1/d28/d1e/d2b/d6d/f92 x:0 0 0 2024-02-28T16:24:04.074 INFO:tasks.workunit.client.0.smithi023.stdout:1/363: fdatasync df/d11/d13/d1b/d30/d57/d5a/f64 0 2024-02-28T16:24:04.077 INFO:tasks.workunit.client.0.smithi023.stdout:1/364: creat df/d11/d13/d1b/d2e/f84 x:0 0 0 2024-02-28T16:24:04.080 INFO:tasks.workunit.client.0.smithi023.stdout:1/365: creat df/d11/d13/d1b/d30/d57/f85 x:0 0 0 2024-02-28T16:24:04.084 INFO:tasks.workunit.client.0.smithi023.stdout:1/366: creat df/d11/d13/d1b/f86 x:0 0 0 2024-02-28T16:24:04.087 INFO:tasks.workunit.client.0.smithi023.stdout:1/367: unlink lb 0 2024-02-28T16:24:04.090 INFO:tasks.workunit.client.0.smithi023.stdout:1/368: unlink df/d26/c42 0 2024-02-28T16:24:04.094 INFO:tasks.workunit.client.0.smithi023.stdout:1/369: link f4 df/d11/d13/d1b/d2e/f87 0 2024-02-28T16:24:04.112 INFO:tasks.workunit.client.0.smithi023.stdout:1/370: dwrite df/d11/d13/d1b/d2e/f84 [0,4194304] 0 2024-02-28T16:24:04.117 INFO:tasks.workunit.client.0.smithi023.stdout:1/371: creat df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f88 x:0 0 0 2024-02-28T16:24:04.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:03 smithi153 ceph-mon[35341]: pgmap v33: 65 pgs: 65 active+clean; 478 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 47 MiB/s wr, 158 op/s 2024-02-28T16:24:04.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:03 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:04.172 INFO:tasks.workunit.client.0.smithi023.stdout:1/372: rename df/d11/d13/d1b/f2f to df/d11/d13/d1b/d30/d57/d5a/d68/f89 0 2024-02-28T16:24:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:03 smithi023 ceph-mon[29137]: pgmap v33: 65 pgs: 65 active+clean; 478 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 47 MiB/s wr, 158 op/s 2024-02-28T16:24:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:03 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:04.204 INFO:tasks.workunit.client.0.smithi023.stdout:1/373: dwrite df/d11/d13/d1b/f86 [0,4194304] 0 2024-02-28T16:24:04.220 INFO:tasks.workunit.client.0.smithi023.stdout:1/374: truncate df/d11/f12 348722 0 2024-02-28T16:24:04.225 INFO:tasks.workunit.client.0.smithi023.stdout:1/375: mkdir df/d11/d8a 0 2024-02-28T16:24:04.238 INFO:tasks.workunit.client.0.smithi023.stdout:1/376: link df/d26/l59 df/d11/d13/d1b/d2e/d5c/l8b 0 2024-02-28T16:24:04.260 INFO:tasks.workunit.client.0.smithi023.stdout:9/275: sync 2024-02-28T16:24:04.266 INFO:tasks.workunit.client.0.smithi023.stdout:1/377: dwrite f3 [4194304,4194304] 0 2024-02-28T16:24:04.267 INFO:tasks.workunit.client.0.smithi023.stdout:9/276: dread - d0/d7/db/d18/d23/d28/d32/d3c/f51 zero size 2024-02-28T16:24:04.275 INFO:tasks.workunit.client.0.smithi023.stdout:9/277: mkdir d0/d7/d2c/d57 0 2024-02-28T16:24:04.277 INFO:tasks.workunit.client.0.smithi023.stdout:1/378: getdents df/d11/d13/d73 0 2024-02-28T16:24:04.284 INFO:tasks.workunit.client.0.smithi023.stdout:1/379: write df/f75 [698522,42021] 0 2024-02-28T16:24:04.301 INFO:tasks.workunit.client.0.smithi023.stdout:9/278: write d0/d7/db/d18/d23/d28/f54 [9142596,45205] 0 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:2/306: sync 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:6/386: sync 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:4/268: sync 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:0/281: sync 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:7/258: sync 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:5/486: sync 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:3/291: sync 2024-02-28T16:24:04.324 INFO:tasks.workunit.client.0.smithi023.stdout:8/402: sync 2024-02-28T16:24:04.333 INFO:tasks.workunit.client.0.smithi023.stdout:4/269: truncate d13/d1d/f25 419953 0 2024-02-28T16:24:04.334 INFO:tasks.workunit.client.0.smithi023.stdout:3/292: readlink d1/df/d37/d46/l4d 0 2024-02-28T16:24:04.335 INFO:tasks.workunit.client.0.smithi023.stdout:9/279: dwrite d0/d7/de/d2e/d2f/d4d/f4b [0,4194304] 0 2024-02-28T16:24:04.337 INFO:tasks.workunit.client.0.smithi023.stdout:4/270: write d13/d1d/f25 [516124,104824] 0 2024-02-28T16:24:04.340 INFO:tasks.workunit.client.0.smithi023.stdout:0/282: rename d6/f36 to d6/db/f50 0 2024-02-28T16:24:04.345 INFO:tasks.workunit.client.0.smithi023.stdout:1/380: dread f3 [8388608,4194304] 0 2024-02-28T16:24:04.345 INFO:tasks.workunit.client.0.smithi023.stdout:5/487: symlink d1/d2a/d32/d37/d3a/d7f/d62/d68/l8e 0 2024-02-28T16:24:04.383 INFO:tasks.workunit.client.0.smithi023.stdout:9/280: rename d0/d7/db/d18/d23/c4c to d0/d7/de/d2e/d2f/d4d/c58 0 2024-02-28T16:24:04.385 INFO:tasks.workunit.client.0.smithi023.stdout:7/259: write de/d13/d1b/f34 [2989830,51124] 0 2024-02-28T16:24:04.391 INFO:tasks.workunit.client.0.smithi023.stdout:7/260: fsync de/f43 0 2024-02-28T16:24:04.391 INFO:tasks.workunit.client.0.smithi023.stdout:1/381: creat df/d26/d48/d72/f8c x:0 0 0 2024-02-28T16:24:04.393 INFO:tasks.workunit.client.0.smithi023.stdout:5/488: symlink d1/d2a/d32/d37/d3a/d7f/l8f 0 2024-02-28T16:24:04.397 INFO:tasks.workunit.client.0.smithi023.stdout:2/307: dwrite d5/da/d1b/f26 [0,4194304] 0 2024-02-28T16:24:04.403 INFO:tasks.workunit.client.0.smithi023.stdout:5/489: read - d1/d2a/d32/d37/d3a/f7e zero size 2024-02-28T16:24:04.407 INFO:tasks.workunit.client.0.smithi023.stdout:6/387: dwrite d1/d28/d1e/d52/f5b [0,4194304] 0 2024-02-28T16:24:04.407 INFO:tasks.workunit.client.0.smithi023.stdout:1/382: rmdir df/d26/d48/d72 39 2024-02-28T16:24:04.408 INFO:tasks.workunit.client.0.smithi023.stdout:4/271: dwrite d13/d2b/d2c/f57 [0,4194304] 0 2024-02-28T16:24:04.411 INFO:tasks.workunit.client.0.smithi023.stdout:7/261: mknod de/d2f/c5b 0 2024-02-28T16:24:04.412 INFO:tasks.workunit.client.0.smithi023.stdout:0/283: dwrite d6/db/d1a/d26/f4d [0,4194304] 0 2024-02-28T16:24:04.413 INFO:tasks.workunit.client.0.smithi023.stdout:1/383: fdatasync df/d11/d13/d1b/d2e/f6d 0 2024-02-28T16:24:04.416 INFO:tasks.workunit.client.0.smithi023.stdout:6/388: mknod d1/c93 0 2024-02-28T16:24:04.418 INFO:tasks.workunit.client.0.smithi023.stdout:7/262: dread - de/d2f/f59 zero size 2024-02-28T16:24:04.418 INFO:tasks.workunit.client.0.smithi023.stdout:5/490: write d1/d2a/d32/d37/d3a/f50 [1877079,125851] 0 2024-02-28T16:24:04.421 INFO:tasks.workunit.client.0.smithi023.stdout:8/403: dread d0/d5/d1b/f33 [0,4194304] 0 2024-02-28T16:24:04.422 INFO:tasks.workunit.client.0.smithi023.stdout:7/263: readlink de/l35 0 2024-02-28T16:24:04.425 INFO:tasks.workunit.client.0.smithi023.stdout:5/491: fdatasync d1/d2a/d32/d37/f38 0 2024-02-28T16:24:04.427 INFO:tasks.workunit.client.0.smithi023.stdout:2/308: creat d5/da/f55 x:0 0 0 2024-02-28T16:24:04.427 INFO:tasks.workunit.client.0.smithi023.stdout:1/384: mkdir df/d11/d13/d1b/d30/d57/d8d 0 2024-02-28T16:24:04.433 INFO:tasks.workunit.client.0.smithi023.stdout:6/389: chown d1/d28/d1e/d80/c82 4040 1 2024-02-28T16:24:04.437 INFO:tasks.workunit.client.0.smithi023.stdout:2/309: stat d5/da/d1b/d3f/f53 0 2024-02-28T16:24:04.437 INFO:tasks.workunit.client.0.smithi023.stdout:7/264: creat de/d13/d1b/d3d/f5c x:0 0 0 2024-02-28T16:24:04.437 INFO:tasks.workunit.client.0.smithi023.stdout:9/281: dread d0/d7/db/d18/f22 [0,4194304] 0 2024-02-28T16:24:04.439 INFO:tasks.workunit.client.0.smithi023.stdout:0/284: rename d6/db/d1a/d26/d31/c41 to d6/db/d3b/d1f/c51 0 2024-02-28T16:24:04.440 INFO:tasks.workunit.client.0.smithi023.stdout:5/492: write d1/d2a/d32/d37/d4e/f70 [1154879,74977] 0 2024-02-28T16:24:04.440 INFO:tasks.workunit.client.0.smithi023.stdout:1/385: dread - df/d26/d48/d72/f8c zero size 2024-02-28T16:24:04.441 INFO:tasks.workunit.client.0.smithi023.stdout:6/390: mknod d1/d3d/d7d/c94 0 2024-02-28T16:24:04.444 INFO:tasks.workunit.client.0.smithi023.stdout:7/265: fdatasync de/d13/f22 0 2024-02-28T16:24:04.446 INFO:tasks.workunit.client.0.smithi023.stdout:4/272: dwrite d13/d1d/f20 [0,4194304] 0 2024-02-28T16:24:04.451 INFO:tasks.workunit.client.0.smithi023.stdout:2/310: mkdir d5/da/db/d17/d39/d56 0 2024-02-28T16:24:04.451 INFO:tasks.workunit.client.0.smithi023.stdout:7/266: write de/d13/f25 [906492,96831] 0 2024-02-28T16:24:04.454 INFO:tasks.workunit.client.0.smithi023.stdout:7/267: chown de/d1c/f20 2 1 2024-02-28T16:24:04.454 INFO:tasks.workunit.client.0.smithi023.stdout:9/282: symlink d0/d7/db/d18/d23/d28/d32/d3c/l59 0 2024-02-28T16:24:04.459 INFO:tasks.workunit.client.0.smithi023.stdout:0/285: creat d6/db/d1a/d26/f52 x:0 0 0 2024-02-28T16:24:04.459 INFO:tasks.workunit.client.0.smithi023.stdout:7/268: read de/d13/d1b/f2e [3866476,55293] 0 2024-02-28T16:24:04.460 INFO:tasks.workunit.client.0.smithi023.stdout:5/493: creat d1/d2a/d32/d58/d60/f90 x:0 0 0 2024-02-28T16:24:04.463 INFO:tasks.workunit.client.0.smithi023.stdout:6/391: creat d1/d28/d1e/d2b/d76/f95 x:0 0 0 2024-02-28T16:24:04.465 INFO:tasks.workunit.client.0.smithi023.stdout:5/494: chown d1/c28 572 1 2024-02-28T16:24:04.469 INFO:tasks.workunit.client.0.smithi023.stdout:2/311: chown d5/l9 224765516 1 2024-02-28T16:24:04.470 INFO:tasks.workunit.client.0.smithi023.stdout:9/283: symlink d0/d7/l5a 0 2024-02-28T16:24:04.471 INFO:tasks.workunit.client.0.smithi023.stdout:6/392: mknod d1/d18/c96 0 2024-02-28T16:24:04.474 INFO:tasks.workunit.client.0.smithi023.stdout:2/312: write d5/da/f15 [3355204,106759] 0 2024-02-28T16:24:04.477 INFO:tasks.workunit.client.0.smithi023.stdout:7/269: rename de/d2f/c4f to de/d13/d1b/d3f/c5d 0 2024-02-28T16:24:04.477 INFO:tasks.workunit.client.0.smithi023.stdout:1/386: dwrite df/d11/d13/d1b/d30/d57/f85 [0,4194304] 0 2024-02-28T16:24:04.478 INFO:tasks.workunit.client.0.smithi023.stdout:0/286: mknod d6/db/d3b/d1f/c53 0 2024-02-28T16:24:04.479 INFO:tasks.workunit.client.0.smithi023.stdout:9/284: fdatasync d0/d7/de/f26 0 2024-02-28T16:24:04.479 INFO:tasks.workunit.client.0.smithi023.stdout:3/293: sync 2024-02-28T16:24:04.483 INFO:tasks.workunit.client.0.smithi023.stdout:6/393: readlink d1/d18/d26/d3a/l8b 0 2024-02-28T16:24:04.484 INFO:tasks.workunit.client.0.smithi023.stdout:3/294: chown d1 0 1 2024-02-28T16:24:04.484 INFO:tasks.workunit.client.0.smithi023.stdout:7/270: fdatasync de/d13/d1b/f4c 0 2024-02-28T16:24:04.487 INFO:tasks.workunit.client.0.smithi023.stdout:1/387: dread - df/d26/d48/d72/f8c zero size 2024-02-28T16:24:04.504 INFO:tasks.workunit.client.0.smithi023.stdout:1/388: chown df/d11/d13/d1b/d30/d57/d5a/l6a 703 1 2024-02-28T16:24:04.504 INFO:tasks.workunit.client.0.smithi023.stdout:7/271: creat de/d2f/f5e x:0 0 0 2024-02-28T16:24:04.505 INFO:tasks.workunit.client.0.smithi023.stdout:6/394: creat d1/d18/d26/d3a/f97 x:0 0 0 2024-02-28T16:24:04.511 INFO:tasks.workunit.client.0.smithi023.stdout:4/273: dwrite d13/f1b [0,4194304] 0 2024-02-28T16:24:04.514 INFO:tasks.workunit.client.0.smithi023.stdout:7/272: symlink de/d13/d1b/d40/l5f 0 2024-02-28T16:24:04.517 INFO:tasks.workunit.client.0.smithi023.stdout:8/404: dread d0/d5/d1a/d2d/d30/f46 [0,4194304] 0 2024-02-28T16:24:04.522 INFO:tasks.workunit.client.0.smithi023.stdout:5/495: dread d1/f19 [0,4194304] 0 2024-02-28T16:24:04.522 INFO:tasks.workunit.client.0.smithi023.stdout:8/405: chown d0/d5/l58 8669295 1 2024-02-28T16:24:04.528 INFO:tasks.workunit.client.0.smithi023.stdout:4/274: symlink d13/l59 0 2024-02-28T16:24:04.532 INFO:tasks.workunit.client.0.smithi023.stdout:7/273: fdatasync de/d13/d1b/f2e 0 2024-02-28T16:24:04.541 INFO:tasks.workunit.client.0.smithi023.stdout:5/496: rmdir d1/d2a/d32/d58/d60/d88/d89 39 2024-02-28T16:24:04.543 INFO:tasks.workunit.client.0.smithi023.stdout:0/287: truncate d6/db/f39 6730648 0 2024-02-28T16:24:04.547 INFO:tasks.workunit.client.0.smithi023.stdout:9/285: truncate d0/d7/db/d18/f25 2134747 0 2024-02-28T16:24:04.547 INFO:tasks.workunit.client.0.smithi023.stdout:7/274: write de/d13/d1b/d40/f50 [712419,114505] 0 2024-02-28T16:24:04.553 INFO:tasks.workunit.client.0.smithi023.stdout:1/389: getdents df/d26 0 2024-02-28T16:24:04.555 INFO:tasks.workunit.client.0.smithi023.stdout:2/313: dread d5/ff [0,4194304] 0 2024-02-28T16:24:04.557 INFO:tasks.workunit.client.0.smithi023.stdout:6/395: dwrite d1/f22 [0,4194304] 0 2024-02-28T16:24:04.559 INFO:tasks.workunit.client.0.smithi023.stdout:0/288: fsync d6/db/fd 0 2024-02-28T16:24:04.568 INFO:tasks.workunit.client.0.smithi023.stdout:5/497: creat d1/d2a/d32/d58/d79/f91 x:0 0 0 2024-02-28T16:24:04.573 INFO:tasks.workunit.client.0.smithi023.stdout:4/275: dwrite d13/d1d/d2e/f52 [0,4194304] 0 2024-02-28T16:24:04.574 INFO:tasks.workunit.client.0.smithi023.stdout:4/276: chown d13/d2b 132345 1 2024-02-28T16:24:04.578 INFO:tasks.workunit.client.0.smithi023.stdout:7/275: rmdir de/d13/d1b/d3d/d53 39 2024-02-28T16:24:04.579 INFO:tasks.workunit.client.0.smithi023.stdout:4/277: readlink d13/d2b/l3b 0 2024-02-28T16:24:04.584 INFO:tasks.workunit.client.0.smithi023.stdout:9/286: mknod d0/d7/de/d2a/c5b 0 2024-02-28T16:24:04.590 INFO:tasks.workunit.client.0.smithi023.stdout:1/390: mknod df/d11/d13/d1b/d30/c8e 0 2024-02-28T16:24:04.593 INFO:tasks.workunit.client.0.smithi023.stdout:6/396: rename d1/f22 to d1/d18/d26/d6a/f98 0 2024-02-28T16:24:04.597 INFO:tasks.workunit.client.0.smithi023.stdout:0/289: symlink d6/db/d1a/d26/l54 0 2024-02-28T16:24:04.604 INFO:tasks.workunit.client.0.smithi023.stdout:4/278: readlink d13/l18 0 2024-02-28T16:24:04.604 INFO:tasks.workunit.client.0.smithi023.stdout:2/314: dwrite d5/da/f28 [4194304,4194304] 0 2024-02-28T16:24:04.605 INFO:tasks.workunit.client.0.smithi023.stdout:8/406: dread d0/f18 [0,4194304] 0 2024-02-28T16:24:04.605 INFO:tasks.workunit.client.0.smithi023.stdout:3/295: sync 2024-02-28T16:24:04.610 INFO:tasks.workunit.client.0.smithi023.stdout:9/287: symlink d0/d7/l5c 0 2024-02-28T16:24:04.612 INFO:tasks.workunit.client.0.smithi023.stdout:0/290: write f4 [5097762,125913] 0 2024-02-28T16:24:04.612 INFO:tasks.workunit.client.0.smithi023.stdout:9/288: fsync d0/d7/db/f24 0 2024-02-28T16:24:04.614 INFO:tasks.workunit.client.0.smithi023.stdout:5/498: symlink d1/d2a/d32/d37/d3a/d7f/l92 0 2024-02-28T16:24:04.616 INFO:tasks.workunit.client.0.smithi023.stdout:9/289: write d0/d7/db/d18/f1d [3177059,25102] 0 2024-02-28T16:24:04.617 INFO:tasks.workunit.client.0.smithi023.stdout:0/291: chown d6/db/d1a/d26/d31/d33/d37 125246 1 2024-02-28T16:24:04.622 INFO:tasks.workunit.client.0.smithi023.stdout:3/296: rmdir d1/df/d2d/d45 39 2024-02-28T16:24:04.623 INFO:tasks.workunit.client.0.smithi023.stdout:8/407: read d0/d5/f26 [8410,10111] 0 2024-02-28T16:24:04.627 INFO:tasks.workunit.client.0.smithi023.stdout:8/408: write d0/d5/d1a/d2d/f84 [256167,22621] 0 2024-02-28T16:24:04.627 INFO:tasks.workunit.client.0.smithi023.stdout:2/315: dread d5/da/d1b/f35 [0,4194304] 0 2024-02-28T16:24:04.629 INFO:tasks.workunit.client.0.smithi023.stdout:8/409: dread - d0/d5/d1a/d2d/d67/f7c zero size 2024-02-28T16:24:04.638 INFO:tasks.workunit.client.0.smithi023.stdout:9/290: creat d0/d7/f5d x:0 0 0 2024-02-28T16:24:04.639 INFO:tasks.workunit.client.0.smithi023.stdout:7/276: rename de/d2f to de/d60 0 2024-02-28T16:24:04.654 INFO:tasks.workunit.client.0.smithi023.stdout:1/391: truncate df/d11/d13/d1b/d2e/f6d 1354437 0 2024-02-28T16:24:04.654 INFO:tasks.workunit.client.0.smithi023.stdout:4/279: dwrite f7 [0,4194304] 0 2024-02-28T16:24:04.654 INFO:tasks.workunit.client.0.smithi023.stdout:2/316: creat d5/da/db/d17/f57 x:0 0 0 2024-02-28T16:24:04.654 INFO:tasks.workunit.client.0.smithi023.stdout:9/291: creat d0/d7/db/f5e x:0 0 0 2024-02-28T16:24:04.654 INFO:tasks.workunit.client.0.smithi023.stdout:5/499: mknod d1/d2a/d32/d58/d60/d88/c93 0 2024-02-28T16:24:04.655 INFO:tasks.workunit.client.0.smithi023.stdout:4/280: chown f7 688 1 2024-02-28T16:24:04.656 INFO:tasks.workunit.client.0.smithi023.stdout:8/410: dwrite d0/d5/d1b/d36/f78 [0,4194304] 0 2024-02-28T16:24:04.659 INFO:tasks.workunit.client.0.smithi023.stdout:0/292: creat d6/db/d3d/f55 x:0 0 0 2024-02-28T16:24:04.661 INFO:tasks.workunit.client.0.smithi023.stdout:5/500: write d1/d2a/d32/d37/f59 [3611786,27957] 0 2024-02-28T16:24:04.661 INFO:tasks.workunit.client.0.smithi023.stdout:6/397: link d1/d28/d1e/d2b/l65 d1/d18/l99 0 2024-02-28T16:24:04.664 INFO:tasks.workunit.client.0.smithi023.stdout:3/297: creat d1/df/d2d/d45/f56 x:0 0 0 2024-02-28T16:24:04.670 INFO:tasks.workunit.client.0.smithi023.stdout:7/277: rename de/d13/d1b/c3a to de/d13/d1b/d3f/c61 0 2024-02-28T16:24:04.670 INFO:tasks.workunit.client.0.smithi023.stdout:8/411: chown d0/d5/d1a/f4b 32435278 1 2024-02-28T16:24:04.674 INFO:tasks.workunit.client.0.smithi023.stdout:6/398: rmdir d1/d28/d1e/d2b/d76 39 2024-02-28T16:24:04.675 INFO:tasks.workunit.client.0.smithi023.stdout:3/298: read d1/f8 [1325724,78482] 0 2024-02-28T16:24:04.680 INFO:tasks.workunit.client.0.smithi023.stdout:8/412: chown d0/d5/d1a/d2d/d30/f46 113223 1 2024-02-28T16:24:04.680 INFO:tasks.workunit.client.0.smithi023.stdout:3/299: stat d1/df/f29 0 2024-02-28T16:24:04.685 INFO:tasks.workunit.client.0.smithi023.stdout:9/292: creat d0/d7/d2c/d57/f5f x:0 0 0 2024-02-28T16:24:04.686 INFO:tasks.workunit.client.0.smithi023.stdout:0/293: mknod d6/db/d3b/d1f/d42/c56 0 2024-02-28T16:24:04.691 INFO:tasks.workunit.client.0.smithi023.stdout:5/501: rename d1/d2a/d32/d37/d3a/d7f/f14 to d1/d2a/d32/d58/d60/d82/f94 0 2024-02-28T16:24:04.693 INFO:tasks.workunit.client.0.smithi023.stdout:4/281: dread d13/f1b [0,4194304] 0 2024-02-28T16:24:04.693 INFO:tasks.workunit.client.0.smithi023.stdout:7/278: mkdir de/d62 0 2024-02-28T16:24:04.694 INFO:tasks.workunit.client.0.smithi023.stdout:9/293: write d0/d7/de/d34/f3b [1399313,32039] 0 2024-02-28T16:24:04.702 INFO:tasks.workunit.client.0.smithi023.stdout:6/399: rename d1/d18/d26/d3a/l74 to d1/d28/d1e/d80/l9a 0 2024-02-28T16:24:04.703 INFO:tasks.workunit.client.0.smithi023.stdout:6/400: stat d1/l3 0 2024-02-28T16:24:04.706 INFO:tasks.workunit.client.0.smithi023.stdout:2/317: truncate d5/dc/f34 1350490 0 2024-02-28T16:24:04.707 INFO:tasks.workunit.client.0.smithi023.stdout:0/294: creat d6/db/d1a/d2e/f57 x:0 0 0 2024-02-28T16:24:04.708 INFO:tasks.workunit.client.0.smithi023.stdout:3/300: dwrite d1/df/d33/d38/d4c/f55 [0,4194304] 0 2024-02-28T16:24:04.711 INFO:tasks.workunit.client.0.smithi023.stdout:5/502: write d1/f19 [370161,110996] 0 2024-02-28T16:24:04.715 INFO:tasks.workunit.client.0.smithi023.stdout:7/279: mknod de/c63 0 2024-02-28T16:24:04.716 INFO:tasks.workunit.client.0.smithi023.stdout:4/282: dwrite d13/d1d/f25 [0,4194304] 0 2024-02-28T16:24:04.716 INFO:tasks.workunit.client.0.smithi023.stdout:8/413: link d0/d5/d1a/d2d/f84 d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69/f8e 0 2024-02-28T16:24:04.719 INFO:tasks.workunit.client.0.smithi023.stdout:2/318: symlink d5/da/d1b/d3f/l58 0 2024-02-28T16:24:04.720 INFO:tasks.workunit.client.0.smithi023.stdout:9/294: truncate d0/d7/de/f14 2224493 0 2024-02-28T16:24:04.720 INFO:tasks.workunit.client.0.smithi023.stdout:9/295: readlink d0/l52 0 2024-02-28T16:24:04.735 INFO:tasks.workunit.client.0.smithi023.stdout:8/414: dwrite d0/d5/d1b/ff [0,4194304] 0 2024-02-28T16:24:04.736 INFO:tasks.workunit.client.0.smithi023.stdout:6/401: link d1/d4f/l59 d1/d28/d1e/d80/l9b 0 2024-02-28T16:24:04.741 INFO:tasks.workunit.client.0.smithi023.stdout:8/415: read - d0/d5/d35/f5f zero size 2024-02-28T16:24:04.743 INFO:tasks.workunit.client.0.smithi023.stdout:5/503: symlink d1/d2a/d32/d37/d3a/d7f/d62/l95 0 2024-02-28T16:24:04.748 INFO:tasks.workunit.client.0.smithi023.stdout:0/295: creat d6/db/d3b/f58 x:0 0 0 2024-02-28T16:24:04.751 INFO:tasks.workunit.client.0.smithi023.stdout:8/416: rename d0/d5 to d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/d6e/d8f 22 2024-02-28T16:24:04.751 INFO:tasks.workunit.client.0.smithi023.stdout:8/417: chown d0/d5/f5e 606 1 2024-02-28T16:24:04.756 INFO:tasks.workunit.client.0.smithi023.stdout:5/504: read d1/d2a/d32/d58/d60/d82/f94 [1158228,58581] 0 2024-02-28T16:24:04.761 INFO:tasks.workunit.client.0.smithi023.stdout:6/402: symlink d1/d18/d26/d6a/l9c 0 2024-02-28T16:24:04.763 INFO:tasks.workunit.client.0.smithi023.stdout:7/280: dread de/d1c/f26 [0,4194304] 0 2024-02-28T16:24:04.764 INFO:tasks.workunit.client.0.smithi023.stdout:4/283: creat d13/d2b/f5a x:0 0 0 2024-02-28T16:24:04.764 INFO:tasks.workunit.client.0.smithi023.stdout:3/301: getdents d1/df/d37/d46 0 2024-02-28T16:24:04.766 INFO:tasks.workunit.client.0.smithi023.stdout:4/284: stat d13/d1d/c24 0 2024-02-28T16:24:04.766 INFO:tasks.workunit.client.0.smithi023.stdout:7/281: stat de/d13/f1f 0 2024-02-28T16:24:04.770 INFO:tasks.workunit.client.0.smithi023.stdout:8/418: mkdir d0/d5/d1a/d63/d90 0 2024-02-28T16:24:04.774 INFO:tasks.workunit.client.0.smithi023.stdout:2/319: truncate d5/da/d1b/f2c 1784797 0 2024-02-28T16:24:04.776 INFO:tasks.workunit.client.0.smithi023.stdout:9/296: truncate d0/f4 2628272 0 2024-02-28T16:24:04.777 INFO:tasks.workunit.client.0.smithi023.stdout:3/302: mkdir d1/df/d3d/d57 0 2024-02-28T16:24:04.778 INFO:tasks.workunit.client.0.smithi023.stdout:5/505: symlink d1/d2a/d32/d37/d3a/d7f/d62/d7b/l96 0 2024-02-28T16:24:04.780 INFO:tasks.workunit.client.0.smithi023.stdout:6/403: mknod d1/d28/d1e/d2b/d85/c9d 0 2024-02-28T16:24:04.783 INFO:tasks.workunit.client.0.smithi023.stdout:8/419: creat d0/d5/d1b/d7f/f91 x:0 0 0 2024-02-28T16:24:04.785 INFO:tasks.workunit.client.0.smithi023.stdout:9/297: creat d0/d7/de/d2e/d2f/f60 x:0 0 0 2024-02-28T16:24:04.787 INFO:tasks.workunit.client.0.smithi023.stdout:2/320: rename d5/da/db/l22 to d5/l59 0 2024-02-28T16:24:04.789 INFO:tasks.workunit.client.0.smithi023.stdout:5/506: readlink d1/d2a/d32/d37/d3a/d7f/l92 0 2024-02-28T16:24:04.795 INFO:tasks.workunit.client.0.smithi023.stdout:9/298: unlink d0/c17 0 2024-02-28T16:24:04.795 INFO:tasks.workunit.client.0.smithi023.stdout:4/285: dwrite fb [4194304,4194304] 0 2024-02-28T16:24:04.795 INFO:tasks.workunit.client.0.smithi023.stdout:3/303: link d1/l26 d1/df/d33/l58 0 2024-02-28T16:24:04.795 INFO:tasks.workunit.client.0.smithi023.stdout:5/507: stat d1/d2a/d32/d58/d60/d81 0 2024-02-28T16:24:04.795 INFO:tasks.workunit.client.0.smithi023.stdout:2/321: mknod d5/dc/c5a 0 2024-02-28T16:24:04.796 INFO:tasks.workunit.client.0.smithi023.stdout:0/296: dwrite d6/db/d3b/d1f/d42/f4a [0,4194304] 0 2024-02-28T16:24:04.797 INFO:tasks.workunit.client.0.smithi023.stdout:8/420: stat d0/d5/d1a/d2d/d30/d39/d3d/d3e 0 2024-02-28T16:24:04.801 INFO:tasks.workunit.client.0.smithi023.stdout:4/286: symlink d13/d1d/l5b 0 2024-02-28T16:24:04.802 INFO:tasks.workunit.client.0.smithi023.stdout:3/304: write d1/df/d2d/d45/f14 [1194307,112432] 0 2024-02-28T16:24:04.804 INFO:tasks.workunit.client.0.smithi023.stdout:9/299: mkdir d0/d7/de/d61 0 2024-02-28T16:24:04.806 INFO:tasks.workunit.client.0.smithi023.stdout:3/305: readlink d1/df/l42 0 2024-02-28T16:24:04.808 INFO:tasks.workunit.client.0.smithi023.stdout:3/306: stat d1/df/f3b 0 2024-02-28T16:24:04.810 INFO:tasks.workunit.client.0.smithi023.stdout:2/322: creat d5/da/f5b x:0 0 0 2024-02-28T16:24:04.811 INFO:tasks.workunit.client.0.smithi023.stdout:5/508: creat d1/d2a/d32/d58/d60/d88/d89/f97 x:0 0 0 2024-02-28T16:24:04.813 INFO:tasks.workunit.client.0.smithi023.stdout:9/300: mknod d0/d7/d2c/d57/c62 0 2024-02-28T16:24:04.815 INFO:tasks.workunit.client.0.smithi023.stdout:4/287: creat d13/d1d/d58/f5c x:0 0 0 2024-02-28T16:24:04.816 INFO:tasks.workunit.client.0.smithi023.stdout:2/323: symlink d5/da/db/l5c 0 2024-02-28T16:24:04.821 INFO:tasks.workunit.client.0.smithi023.stdout:9/301: readlink d0/d7/db/d18/l20 0 2024-02-28T16:24:04.821 INFO:tasks.workunit.client.0.smithi023.stdout:2/324: dread - d5/da/f5b zero size 2024-02-28T16:24:04.826 INFO:tasks.workunit.client.0.smithi023.stdout:6/404: dwrite d1/d28/d1e/d2b/d76/f88 [0,4194304] 0 2024-02-28T16:24:04.826 INFO:tasks.workunit.client.0.smithi023.stdout:3/307: mkdir d1/df/d33/d38/d4c/d59 0 2024-02-28T16:24:04.833 INFO:tasks.workunit.client.0.smithi023.stdout:2/325: write d5/da/f5b [25730,10093] 0 2024-02-28T16:24:04.843 INFO:tasks.workunit.client.0.smithi023.stdout:4/288: rename d13/d1d/f27 to d13/d2b/f5d 0 2024-02-28T16:24:04.845 INFO:tasks.workunit.client.0.smithi023.stdout:3/308: truncate d1/df/d2d/d45/f56 478013 0 2024-02-28T16:24:04.845 INFO:tasks.workunit.client.0.smithi023.stdout:2/326: chown d5/da/db/d17/d3c 105400 1 2024-02-28T16:24:04.847 INFO:tasks.workunit.client.0.smithi023.stdout:6/405: mkdir d1/d28/d1e/d2b/d76/d9e 0 2024-02-28T16:24:04.851 INFO:tasks.workunit.client.0.smithi023.stdout:8/421: dwrite d0/d5/d1a/d2d/d30/d39/d3d/f68 [0,4194304] 0 2024-02-28T16:24:04.857 INFO:tasks.workunit.client.0.smithi023.stdout:4/289: rmdir d13 39 2024-02-28T16:24:04.857 INFO:tasks.workunit.client.0.smithi023.stdout:0/297: dwrite d6/db/f50 [0,4194304] 0 2024-02-28T16:24:04.857 INFO:tasks.workunit.client.0.smithi023.stdout:9/302: creat d0/d7/de/f63 x:0 0 0 2024-02-28T16:24:04.857 INFO:tasks.workunit.client.0.smithi023.stdout:6/406: fsync d1/d28/f19 0 2024-02-28T16:24:04.858 INFO:tasks.workunit.client.0.smithi023.stdout:3/309: read d1/f20 [4120617,85894] 0 2024-02-28T16:24:04.865 INFO:tasks.workunit.client.0.smithi023.stdout:2/327: symlink d5/da/db/d17/d39/l5d 0 2024-02-28T16:24:04.865 INFO:tasks.workunit.client.0.smithi023.stdout:2/328: dread d5/da/f5b [0,4194304] 0 2024-02-28T16:24:04.868 INFO:tasks.workunit.client.0.smithi023.stdout:6/407: symlink d1/d4f/l9f 0 2024-02-28T16:24:04.870 INFO:tasks.workunit.client.0.smithi023.stdout:6/408: stat d1/d18/d26 0 2024-02-28T16:24:04.874 INFO:tasks.workunit.client.0.smithi023.stdout:5/509: dread d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:24:04.885 INFO:tasks.workunit.client.0.smithi023.stdout:2/329: unlink d5/da/f33 0 2024-02-28T16:24:04.885 INFO:tasks.workunit.client.0.smithi023.stdout:0/298: mkdir d6/db/d1a/d59 0 2024-02-28T16:24:04.891 INFO:tasks.workunit.client.0.smithi023.stdout:6/409: dread d1/f1b [0,4194304] 0 2024-02-28T16:24:04.895 INFO:tasks.workunit.client.0.smithi023.stdout:5/510: symlink d1/l98 0 2024-02-28T16:24:04.901 INFO:tasks.workunit.client.0.smithi023.stdout:0/299: creat d6/db/d1a/d1b/f5a x:0 0 0 2024-02-28T16:24:04.902 INFO:tasks.workunit.client.0.smithi023.stdout:8/422: link d0/d5/d1a/d63/l82 d0/d5/d1a/d2d/d67/d71/l92 0 2024-02-28T16:24:04.905 INFO:tasks.workunit.client.0.smithi023.stdout:2/330: mknod d5/da/db/d17/d3c/c5e 0 2024-02-28T16:24:04.906 INFO:tasks.workunit.client.0.smithi023.stdout:8/423: rename d0/d5 to d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69/d93 22 2024-02-28T16:24:04.907 INFO:tasks.workunit.client.0.smithi023.stdout:6/410: write d1/fd [2331642,85003] 0 2024-02-28T16:24:04.909 INFO:tasks.workunit.client.0.smithi023.stdout:5/511: rmdir d1/d2a/d32/d36 39 2024-02-28T16:24:04.911 INFO:tasks.workunit.client.0.smithi023.stdout:6/411: write d1/d28/d1e/d2b/d44/f53 [553646,110531] 0 2024-02-28T16:24:04.912 INFO:tasks.workunit.client.0.smithi023.stdout:0/300: symlink d6/db/d1a/d26/d31/d33/l5b 0 2024-02-28T16:24:04.913 INFO:tasks.workunit.client.0.smithi023.stdout:2/331: mkdir d5/da/d45/d5f 0 2024-02-28T16:24:04.915 INFO:tasks.workunit.client.0.smithi023.stdout:2/332: stat d5/da/d1b/d3f/f53 0 2024-02-28T16:24:04.916 INFO:tasks.workunit.client.0.smithi023.stdout:8/424: rename d0/d5/d1b/d36/l75 to d0/d5/d1b/d36/l94 0 2024-02-28T16:24:04.917 INFO:tasks.workunit.client.0.smithi023.stdout:5/512: dread - d1/d2a/d32/d36/f74 zero size 2024-02-28T16:24:04.919 INFO:tasks.workunit.client.0.smithi023.stdout:5/513: stat d1/d2a/d32/d58/d79/f91 0 2024-02-28T16:24:04.923 INFO:tasks.workunit.client.0.smithi023.stdout:2/333: creat d5/da/d1b/d3f/f60 x:0 0 0 2024-02-28T16:24:04.925 INFO:tasks.workunit.client.0.smithi023.stdout:5/514: unlink d1/d2a/d32/d37/d3a/d7f/l8f 0 2024-02-28T16:24:04.929 INFO:tasks.workunit.client.0.smithi023.stdout:0/301: link d6/db/f50 d6/db/d1a/d26/f5c 0 2024-02-28T16:24:04.933 INFO:tasks.workunit.client.0.smithi023.stdout:0/302: chown d6/db/d1a/d1b/f27 2364836 1 2024-02-28T16:24:04.934 INFO:tasks.workunit.client.0.smithi023.stdout:9/303: dwrite d0/d7/ff [0,4194304] 0 2024-02-28T16:24:04.936 INFO:tasks.workunit.client.0.smithi023.stdout:6/412: dwrite d1/fb [0,4194304] 0 2024-02-28T16:24:04.938 INFO:tasks.workunit.client.0.smithi023.stdout:9/304: dread - d0/d7/db/d18/d23/d28/d32/d3c/f51 zero size 2024-02-28T16:24:04.946 INFO:tasks.workunit.client.0.smithi023.stdout:9/305: chown d0/d7/db/d18/d23/d28/l33 696030295 1 2024-02-28T16:24:04.948 INFO:tasks.workunit.client.0.smithi023.stdout:5/515: dwrite d1/d2a/d32/d37/d3a/f7e [0,4194304] 0 2024-02-28T16:24:04.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/303: write d6/db/d3b/d1f/f4b [4260783,28415] 0 2024-02-28T16:24:04.952 INFO:tasks.workunit.client.0.smithi023.stdout:2/334: link d5/da/db/l5c d5/da/db/l61 0 2024-02-28T16:24:04.953 INFO:tasks.workunit.client.0.smithi023.stdout:0/304: readlink d6/db/d1a/d1b/l23 0 2024-02-28T16:24:04.955 INFO:tasks.workunit.client.0.smithi023.stdout:4/290: dwrite d13/d2b/f51 [0,4194304] 0 2024-02-28T16:24:04.959 INFO:tasks.workunit.client.0.smithi023.stdout:9/306: rmdir d0/d7/db 39 2024-02-28T16:24:04.977 INFO:tasks.workunit.client.0.smithi023.stdout:8/425: dwrite d0/d5/d35/f5d [0,4194304] 0 2024-02-28T16:24:04.983 INFO:tasks.workunit.client.0.smithi023.stdout:4/291: stat d13/d1d/d2d/l32 0 2024-02-28T16:24:04.983 INFO:tasks.workunit.client.0.smithi023.stdout:8/426: chown d0/d5/d1a/l5a 0 1 2024-02-28T16:24:04.983 INFO:tasks.workunit.client.0.smithi023.stdout:0/305: dread d6/db/f50 [0,4194304] 0 2024-02-28T16:24:04.985 INFO:tasks.workunit.client.0.smithi023.stdout:5/516: creat d1/d2a/d32/d37/d3a/d7f/d62/d7b/f99 x:0 0 0 2024-02-28T16:24:04.988 INFO:tasks.workunit.client.0.smithi023.stdout:1/392: sync 2024-02-28T16:24:04.988 INFO:tasks.workunit.client.0.smithi023.stdout:9/307: creat d0/d7/de/d2e/d2f/f64 x:0 0 0 2024-02-28T16:24:04.992 INFO:tasks.workunit.client.0.smithi023.stdout:5/517: write d1/d2a/d32/d37/d3a/d7f/d62/f72 [406769,64805] 0 2024-02-28T16:24:04.994 INFO:tasks.workunit.client.0.smithi023.stdout:2/335: rmdir d5/da/d45/d5f 0 2024-02-28T16:24:04.997 INFO:tasks.workunit.client.0.smithi023.stdout:4/292: rmdir d13/d2b 39 2024-02-28T16:24:05.004 INFO:tasks.workunit.client.0.smithi023.stdout:6/413: link d1/d4f/l59 d1/d28/d1e/d2b/d6d/d7b/la0 0 2024-02-28T16:24:05.006 INFO:tasks.workunit.client.0.smithi023.stdout:9/308: creat d0/d7/d2c/d57/f65 x:0 0 0 2024-02-28T16:24:05.007 INFO:tasks.workunit.client.0.smithi023.stdout:9/309: stat d0/l1b 0 2024-02-28T16:24:05.009 INFO:tasks.workunit.client.0.smithi023.stdout:0/306: dwrite d6/db/d1a/d26/d31/f46 [0,4194304] 0 2024-02-28T16:24:05.019 INFO:tasks.workunit.client.0.smithi023.stdout:8/427: creat d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69/f95 x:0 0 0 2024-02-28T16:24:05.024 INFO:tasks.workunit.client.0.smithi023.stdout:4/293: dread d13/d2b/f5d [0,4194304] 0 2024-02-28T16:24:05.025 INFO:tasks.workunit.client.0.smithi023.stdout:6/414: rmdir d1/d28/d1e 39 2024-02-28T16:24:05.027 INFO:tasks.workunit.client.0.smithi023.stdout:8/428: write d0/d5/d1a/d2d/d30/d39/d3d/f68 [2518254,60715] 0 2024-02-28T16:24:05.029 INFO:tasks.workunit.client.0.smithi023.stdout:2/336: mkdir d5/da/d62 0 2024-02-28T16:24:05.029 INFO:tasks.workunit.client.0.smithi023.stdout:9/310: dwrite d0/f43 [0,4194304] 0 2024-02-28T16:24:05.030 INFO:tasks.workunit.client.0.smithi023.stdout:2/337: stat d5/da 0 2024-02-28T16:24:05.039 INFO:tasks.workunit.client.0.smithi023.stdout:3/310: sync 2024-02-28T16:24:05.039 INFO:tasks.workunit.client.0.smithi023.stdout:7/282: sync 2024-02-28T16:24:05.042 INFO:tasks.workunit.client.0.smithi023.stdout:0/307: dread d6/db/d3b/d1f/d42/f4a [4194304,4194304] 0 2024-02-28T16:24:05.043 INFO:tasks.workunit.client.0.smithi023.stdout:4/294: rmdir d13/d1d 39 2024-02-28T16:24:05.052 INFO:tasks.workunit.client.0.smithi023.stdout:5/518: truncate d1/d2a/d32/d37/d3a/d7f/f3c 112803 0 2024-02-28T16:24:05.054 INFO:tasks.workunit.client.0.smithi023.stdout:1/393: link df/d11/f12 df/d11/d13/d1b/d2e/d5c/f8f 0 2024-02-28T16:24:05.056 INFO:tasks.workunit.client.0.smithi023.stdout:3/311: chown d1/df/d33/l58 469 1 2024-02-28T16:24:05.058 INFO:tasks.workunit.client.0.smithi023.stdout:7/283: rename de/d13/f25 to de/d60/f64 0 2024-02-28T16:24:05.060 INFO:tasks.workunit.client.0.smithi023.stdout:0/308: mkdir d6/db/d5d 0 2024-02-28T16:24:05.065 INFO:tasks.workunit.client.0.smithi023.stdout:8/429: link d0/f18 d0/d5/d1a/d44/f96 0 2024-02-28T16:24:05.067 INFO:tasks.workunit.client.0.smithi023.stdout:2/338: creat d5/da/db/d17/d39/d56/f63 x:0 0 0 2024-02-28T16:24:05.076 INFO:tasks.workunit.client.0.smithi023.stdout:4/295: dwrite d13/d1d/d58/f5c [0,4194304] 0 2024-02-28T16:24:05.078 INFO:tasks.workunit.client.0.smithi023.stdout:7/284: symlink de/d60/l65 0 2024-02-28T16:24:05.080 INFO:tasks.workunit.client.0.smithi023.stdout:7/285: write de/d13/f4d [783804,9699] 0 2024-02-28T16:24:05.081 INFO:tasks.workunit.client.0.smithi023.stdout:0/309: symlink d6/db/d1a/d26/l5e 0 2024-02-28T16:24:05.084 INFO:tasks.workunit.client.0.smithi023.stdout:6/415: truncate d1/f11 2070001 0 2024-02-28T16:24:05.086 INFO:tasks.workunit.client.0.smithi023.stdout:6/416: write d1/f69 [603274,56707] 0 2024-02-28T16:24:05.091 INFO:tasks.workunit.client.0.smithi023.stdout:2/339: truncate d5/da/f5b 84260 0 2024-02-28T16:24:05.091 INFO:tasks.workunit.client.0.smithi023.stdout:3/312: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:24:05.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/310: symlink d6/db/d3b/d1f/d42/l5f 0 2024-02-28T16:24:05.099 INFO:tasks.workunit.client.0.smithi023.stdout:7/286: stat de/ff 0 2024-02-28T16:24:05.102 INFO:tasks.workunit.client.0.smithi023.stdout:6/417: mkdir d1/d4f/da1 0 2024-02-28T16:24:05.102 INFO:tasks.workunit.client.0.smithi023.stdout:6/418: chown d1/d18 2159 1 2024-02-28T16:24:05.104 INFO:tasks.workunit.client.0.smithi023.stdout:5/519: creat d1/d2a/d32/d37/d3a/d7f/d62/f9a x:0 0 0 2024-02-28T16:24:05.104 INFO:tasks.workunit.client.0.smithi023.stdout:7/287: truncate de/d13/d1b/d3d/f5c 1033278 0 2024-02-28T16:24:05.106 INFO:tasks.workunit.client.0.smithi023.stdout:8/430: rename d0/d5/le to d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69/l97 0 2024-02-28T16:24:05.112 INFO:tasks.workunit.client.0.smithi023.stdout:8/431: truncate d0/d5/d1b/f70 1099583 0 2024-02-28T16:24:05.117 INFO:tasks.workunit.client.0.smithi023.stdout:9/311: getdents d0/d7/db/d18/d23/d28/d32 0 2024-02-28T16:24:05.120 INFO:tasks.workunit.client.0.smithi023.stdout:0/311: mknod d6/db/d1a/d26/d31/c60 0 2024-02-28T16:24:05.120 INFO:tasks.workunit.client.0.smithi023.stdout:9/312: write d0/d7/de/f26 [5728072,116729] 0 2024-02-28T16:24:05.121 INFO:tasks.workunit.client.0.smithi023.stdout:7/288: mknod de/d13/d1b/d3f/c66 0 2024-02-28T16:24:05.123 INFO:tasks.workunit.client.0.smithi023.stdout:9/313: readlink d0/l2 0 2024-02-28T16:24:05.124 INFO:tasks.workunit.client.0.smithi023.stdout:1/394: getdents df/d11/d13/d1b/d30/d57/d5a 0 2024-02-28T16:24:05.126 INFO:tasks.workunit.client.0.smithi023.stdout:6/419: fsync d1/d28/d1e/d2b/f43 0 2024-02-28T16:24:05.128 INFO:tasks.workunit.client.0.smithi023.stdout:3/313: mknod d1/df/d33/d38/d4c/d59/c5a 0 2024-02-28T16:24:05.131 INFO:tasks.workunit.client.0.smithi023.stdout:8/432: dread d0/d5/f7e [0,4194304] 0 2024-02-28T16:24:05.131 INFO:tasks.workunit.client.0.smithi023.stdout:9/314: chown d0/d7/db/d18/d23 327706 1 2024-02-28T16:24:05.131 INFO:tasks.workunit.client.0.smithi023.stdout:2/340: link d5/da/d1b/d3f/f53 d5/da/f64 0 2024-02-28T16:24:05.133 INFO:tasks.workunit.client.0.smithi023.stdout:5/520: dwrite d1/d2a/d32/d37/d3a/d7f/d62/f9a [0,4194304] 0 2024-02-28T16:24:05.134 INFO:tasks.workunit.client.0.smithi023.stdout:7/289: chown de/c16 6232006 1 2024-02-28T16:24:05.135 INFO:tasks.workunit.client.0.smithi023.stdout:0/312: truncate d6/db/fd 980246 0 2024-02-28T16:24:05.137 INFO:tasks.workunit.client.0.smithi023.stdout:5/521: readlink d1/d2a/d32/d36/l67 0 2024-02-28T16:24:05.139 INFO:tasks.workunit.client.0.smithi023.stdout:3/314: fsync d1/f20 0 2024-02-28T16:24:05.141 INFO:tasks.workunit.client.0.smithi023.stdout:6/420: write d1/d28/d1e/d52/f5b [4335203,11198] 0 2024-02-28T16:24:05.148 INFO:tasks.workunit.client.0.smithi023.stdout:8/433: creat d0/d5/d1a/d44/f98 x:0 0 0 2024-02-28T16:24:05.152 INFO:tasks.workunit.client.0.smithi023.stdout:2/341: creat d5/da/db/d17/f65 x:0 0 0 2024-02-28T16:24:05.155 INFO:tasks.workunit.client.0.smithi023.stdout:2/342: read - d5/da/f64 zero size 2024-02-28T16:24:05.155 INFO:tasks.workunit.client.0.smithi023.stdout:9/315: dwrite d0/d7/de/f26 [0,4194304] 0 2024-02-28T16:24:05.156 INFO:tasks.workunit.client.0.smithi023.stdout:5/522: rename d1/d2a/l45 to d1/d2a/d32/d37/d3a/d7f/d62/d68/l9b 0 2024-02-28T16:24:05.159 INFO:tasks.workunit.client.0.smithi023.stdout:5/523: write d1/d2a/d32/d37/d3a/d7f/d62/f76 [680247,88704] 0 2024-02-28T16:24:05.160 INFO:tasks.workunit.client.0.smithi023.stdout:6/421: creat d1/d28/d1e/d2b/d44/d86/fa2 x:0 0 0 2024-02-28T16:24:05.161 INFO:tasks.workunit.client.0.smithi023.stdout:4/296: truncate fe 1194634 0 2024-02-28T16:24:05.163 INFO:tasks.workunit.client.0.smithi023.stdout:1/395: creat df/d11/f90 x:0 0 0 2024-02-28T16:24:05.166 INFO:tasks.workunit.client.0.smithi023.stdout:7/290: unlink de/d13/d1b/d3d/d53/c54 0 2024-02-28T16:24:05.168 INFO:tasks.workunit.client.0.smithi023.stdout:7/291: write de/d60/f3c [1468885,10888] 0 2024-02-28T16:24:05.168 INFO:tasks.workunit.client.0.smithi023.stdout:8/434: mknod d0/d5/d1a/d2d/c99 0 2024-02-28T16:24:05.171 INFO:tasks.workunit.client.0.smithi023.stdout:0/313: getdents d6/db/d5d 0 2024-02-28T16:24:05.172 INFO:tasks.workunit.client.0.smithi023.stdout:8/435: write d0/d5/d1a/d2d/d67/f7c [776473,122324] 0 2024-02-28T16:24:05.174 INFO:tasks.workunit.client.0.smithi023.stdout:7/292: write de/d13/d1b/d3d/f5c [148986,68383] 0 2024-02-28T16:24:05.175 INFO:tasks.workunit.client.0.smithi023.stdout:3/315: creat d1/df/d2d/d45/d52/f5b x:0 0 0 2024-02-28T16:24:05.176 INFO:tasks.workunit.client.0.smithi023.stdout:6/422: mknod d1/ca3 0 2024-02-28T16:24:05.176 INFO:tasks.workunit.client.0.smithi023.stdout:2/343: write d5/da/d1b/d3f/f53 [788353,5140] 0 2024-02-28T16:24:05.176 INFO:tasks.workunit.client.0.smithi023.stdout:5/524: rmdir d1/d2a/d32/d37 39 2024-02-28T16:24:05.181 INFO:tasks.workunit.client.0.smithi023.stdout:7/293: rename de/d13/d1b/d3f to de/d13/d1b/d3f/d67 22 2024-02-28T16:24:05.197 INFO:tasks.workunit.client.0.smithi023.stdout:3/316: creat d1/df/d37/d46/f5c x:0 0 0 2024-02-28T16:24:05.199 INFO:tasks.workunit.client.0.smithi023.stdout:1/396: truncate df/d11/d13/d1b/d30/f4b 706740 0 2024-02-28T16:24:05.200 INFO:tasks.workunit.client.0.smithi023.stdout:5/525: mknod d1/d2a/d32/d6e/c9c 0 2024-02-28T16:24:05.206 INFO:tasks.workunit.client.0.smithi023.stdout:6/423: rename d1/d28/d1e/d2b/d85 to d1/d28/d1e/d2b/d44/da4 0 2024-02-28T16:24:05.207 INFO:tasks.workunit.client.0.smithi023.stdout:9/316: dread d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:24:05.208 INFO:tasks.workunit.client.0.smithi023.stdout:3/317: creat d1/df/d33/d38/d4c/f5d x:0 0 0 2024-02-28T16:24:05.209 INFO:tasks.workunit.client.0.smithi023.stdout:4/297: dwrite d13/f1b [0,4194304] 0 2024-02-28T16:24:05.214 INFO:tasks.workunit.client.0.smithi023.stdout:8/436: dwrite d0/d5/d1a/d2d/d30/d39/f4c [0,4194304] 0 2024-02-28T16:24:05.215 INFO:tasks.workunit.client.0.smithi023.stdout:6/424: creat d1/d18/fa5 x:0 0 0 2024-02-28T16:24:05.216 INFO:tasks.workunit.client.0.smithi023.stdout:1/397: symlink df/d26/d48/d80/l91 0 2024-02-28T16:24:05.221 INFO:tasks.workunit.client.0.smithi023.stdout:3/318: creat d1/df/d37/d46/f5e x:0 0 0 2024-02-28T16:24:05.225 INFO:tasks.workunit.client.0.smithi023.stdout:5/526: truncate d1/d2a/d32/d37/d3a/f6d 371535 0 2024-02-28T16:24:05.227 INFO:tasks.workunit.client.0.smithi023.stdout:0/314: write d6/db/d1a/d1b/f1d [382369,84604] 0 2024-02-28T16:24:05.229 INFO:tasks.workunit.client.0.smithi023.stdout:7/294: dread de/d13/f1a [0,4194304] 0 2024-02-28T16:24:05.229 INFO:tasks.workunit.client.0.smithi023.stdout:5/527: readlink d1/l98 0 2024-02-28T16:24:05.230 INFO:tasks.workunit.client.0.smithi023.stdout:1/398: dread df/d11/d13/d1b/d30/f60 [0,4194304] 0 2024-02-28T16:24:05.236 INFO:tasks.workunit.client.0.smithi023.stdout:8/437: creat d0/d5/d1a/d2d/d67/d7d/f9a x:0 0 0 2024-02-28T16:24:05.242 INFO:tasks.workunit.client.0.smithi023.stdout:3/319: creat d1/df/d33/f5f x:0 0 0 2024-02-28T16:24:05.243 INFO:tasks.workunit.client.0.smithi023.stdout:6/425: dread d1/d28/d1e/d52/f5b [0,4194304] 0 2024-02-28T16:24:05.245 INFO:tasks.workunit.client.0.smithi023.stdout:3/320: chown d1/df/d37/d46 30 1 2024-02-28T16:24:05.246 INFO:tasks.workunit.client.0.smithi023.stdout:0/315: symlink d6/db/d24/l61 0 2024-02-28T16:24:05.246 INFO:tasks.workunit.client.0.smithi023.stdout:6/426: dread - d1/d28/d1e/d2b/f8e zero size 2024-02-28T16:24:05.248 INFO:tasks.workunit.client.0.smithi023.stdout:9/317: creat d0/f66 x:0 0 0 2024-02-28T16:24:05.250 INFO:tasks.workunit.client.0.smithi023.stdout:2/344: dwrite d5/da/f5b [0,4194304] 0 2024-02-28T16:24:05.252 INFO:tasks.workunit.client.0.smithi023.stdout:5/528: mknod d1/d2a/d32/d37/d3a/c9d 0 2024-02-28T16:24:05.253 INFO:tasks.workunit.client.0.smithi023.stdout:1/399: mknod df/d11/d13/d1b/d30/d3d/d6c/c92 0 2024-02-28T16:24:05.256 INFO:tasks.workunit.client.0.smithi023.stdout:8/438: symlink d0/d5/d1b/l9b 0 2024-02-28T16:24:05.259 INFO:tasks.workunit.client.0.smithi023.stdout:4/298: link d13/d1d/d2d/f47 d13/d2b/f5e 0 2024-02-28T16:24:05.261 INFO:tasks.workunit.client.0.smithi023.stdout:7/295: dwrite de/d13/d1b/f34 [0,4194304] 0 2024-02-28T16:24:05.264 INFO:tasks.workunit.client.0.smithi023.stdout:0/316: creat d6/db/d24/f62 x:0 0 0 2024-02-28T16:24:05.266 INFO:tasks.workunit.client.0.smithi023.stdout:6/427: mkdir d1/d18/d26/da6 0 2024-02-28T16:24:05.266 INFO:tasks.workunit.client.0.smithi023.stdout:7/296: chown de/d13/d1b/f2e 0 1 2024-02-28T16:24:05.268 INFO:tasks.workunit.client.0.smithi023.stdout:2/345: read d5/da/d1b/f1e [3282946,62261] 0 2024-02-28T16:24:05.271 INFO:tasks.workunit.client.0.smithi023.stdout:4/299: dread d13/d1d/f41 [0,4194304] 0 2024-02-28T16:24:05.274 INFO:tasks.workunit.client.0.smithi023.stdout:8/439: creat d0/d5/d1a/d2d/d67/d71/f9c x:0 0 0 2024-02-28T16:24:05.276 INFO:tasks.workunit.client.0.smithi023.stdout:3/321: link d1/df/f3e d1/df/f60 0 2024-02-28T16:24:05.276 INFO:tasks.workunit.client.0.smithi023.stdout:5/529: dread d1/d2a/d32/d58/d73/f84 [0,4194304] 0 2024-02-28T16:24:05.278 INFO:tasks.workunit.client.0.smithi023.stdout:7/297: stat de/c11 0 2024-02-28T16:24:05.281 INFO:tasks.workunit.client.0.smithi023.stdout:6/428: creat d1/d28/d1e/d80/fa7 x:0 0 0 2024-02-28T16:24:05.282 INFO:tasks.workunit.client.0.smithi023.stdout:4/300: mknod d13/d1d/c5f 0 2024-02-28T16:24:05.283 INFO:tasks.workunit.client.0.smithi023.stdout:6/429: fsync d1/d28/d1e/f4e 0 2024-02-28T16:24:05.283 INFO:tasks.workunit.client.0.smithi023.stdout:0/317: mknod d6/d4c/c63 0 2024-02-28T16:24:05.285 INFO:tasks.workunit.client.0.smithi023.stdout:2/346: fsync d5/dc/f21 0 2024-02-28T16:24:05.290 INFO:tasks.workunit.client.0.smithi023.stdout:6/430: read d1/d3d/f45 [139798,120294] 0 2024-02-28T16:24:05.292 INFO:tasks.workunit.client.0.smithi023.stdout:7/298: rename de/d13/d1b/d3f/f52 to de/d1c/f68 0 2024-02-28T16:24:05.292 INFO:tasks.workunit.client.0.smithi023.stdout:5/530: fdatasync d1/d2a/d32/d37/d3a/d7f/f8d 0 2024-02-28T16:24:05.295 INFO:tasks.workunit.client.0.smithi023.stdout:7/299: chown de/d13/l2c 6767515 1 2024-02-28T16:24:05.300 INFO:tasks.workunit.client.0.smithi023.stdout:8/440: creat d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/d6e/f9d x:0 0 0 2024-02-28T16:24:05.302 INFO:tasks.workunit.client.0.smithi023.stdout:0/318: dwrite d6/db/d1a/d26/f38 [0,4194304] 0 2024-02-28T16:24:05.304 INFO:tasks.workunit.client.0.smithi023.stdout:2/347: creat d5/da/d1b/d3f/f66 x:0 0 0 2024-02-28T16:24:05.305 INFO:tasks.workunit.client.0.smithi023.stdout:0/319: fsync d6/db/d1a/d2e/f4f 0 2024-02-28T16:24:05.308 INFO:tasks.workunit.client.0.smithi023.stdout:4/301: creat d13/d1e/d39/d55/f60 x:0 0 0 2024-02-28T16:24:05.318 INFO:tasks.workunit.client.0.smithi023.stdout:5/531: symlink d1/d2a/d32/d37/l9e 0 2024-02-28T16:24:05.321 INFO:tasks.workunit.client.0.smithi023.stdout:4/302: symlink d13/d1d/d2d/l61 0 2024-02-28T16:24:05.321 INFO:tasks.workunit.client.0.smithi023.stdout:7/300: dread f4 [4194304,4194304] 0 2024-02-28T16:24:05.323 INFO:tasks.workunit.client.0.smithi023.stdout:0/320: rename d6/db/d1a/d1b/f1d to d6/db/d3d/f64 0 2024-02-28T16:24:05.323 INFO:tasks.workunit.client.0.smithi023.stdout:7/301: fsync de/d13/f1f 0 2024-02-28T16:24:05.325 INFO:tasks.workunit.client.0.smithi023.stdout:8/441: fsync d0/d5/d1a/f38 0 2024-02-28T16:24:05.327 INFO:tasks.workunit.client.0.smithi023.stdout:2/348: dwrite d5/da/d45/f50 [0,4194304] 0 2024-02-28T16:24:05.328 INFO:tasks.workunit.client.0.smithi023.stdout:7/302: write de/d13/d1b/d40/f50 [1796849,45986] 0 2024-02-28T16:24:05.333 INFO:tasks.workunit.client.0.smithi023.stdout:8/442: dread - d0/d5/d1a/d2d/d67/d71/f9c zero size 2024-02-28T16:24:05.341 INFO:tasks.workunit.client.0.smithi023.stdout:8/443: rmdir d0/d5/d1b/d7f 39 2024-02-28T16:24:05.342 INFO:tasks.workunit.client.0.smithi023.stdout:1/400: write df/d11/f12 [1347572,120498] 0 2024-02-28T16:24:05.344 INFO:tasks.workunit.client.0.smithi023.stdout:3/322: getdents d1/df 0 2024-02-28T16:24:05.346 INFO:tasks.workunit.client.0.smithi023.stdout:4/303: dread d13/d2b/d2c/f57 [0,4194304] 0 2024-02-28T16:24:05.346 INFO:tasks.workunit.client.0.smithi023.stdout:2/349: mkdir d5/da/d67 0 2024-02-28T16:24:05.352 INFO:tasks.workunit.client.0.smithi023.stdout:7/303: dwrite de/d60/f3c [0,4194304] 0 2024-02-28T16:24:05.352 INFO:tasks.workunit.client.0.smithi023.stdout:0/321: rename d6/db/d3b/d1f/d42/c56 to d6/db/d1a/c65 0 2024-02-28T16:24:05.355 INFO:tasks.workunit.client.0.smithi023.stdout:0/322: dread - d6/db/d1a/d2e/f4f zero size 2024-02-28T16:24:05.356 INFO:tasks.workunit.client.0.smithi023.stdout:0/323: dread - d6/db/d1a/d2e/f57 zero size 2024-02-28T16:24:05.358 INFO:tasks.workunit.client.0.smithi023.stdout:2/350: chown d5/da/db/l1a 22128377 1 2024-02-28T16:24:05.358 INFO:tasks.workunit.client.0.smithi023.stdout:0/324: fdatasync d6/db/d1a/d26/d31/f46 0 2024-02-28T16:24:05.359 INFO:tasks.workunit.client.0.smithi023.stdout:4/304: symlink d13/d1e/d39/d55/l62 0 2024-02-28T16:24:05.362 INFO:tasks.workunit.client.0.smithi023.stdout:0/325: write d6/db/d1a/d2e/f44 [98366,14282] 0 2024-02-28T16:24:05.364 INFO:tasks.workunit.client.0.smithi023.stdout:0/326: dread - d6/db/d1a/d2e/f4f zero size 2024-02-28T16:24:05.365 INFO:tasks.workunit.client.0.smithi023.stdout:3/323: mkdir d1/df/d3d/d57/d61 0 2024-02-28T16:24:05.370 INFO:tasks.workunit.client.0.smithi023.stdout:3/324: write d1/df/d33/d38/d4c/f55 [4383400,42102] 0 2024-02-28T16:24:05.370 INFO:tasks.workunit.client.0.smithi023.stdout:8/444: dwrite d0/d5/f41 [0,4194304] 0 2024-02-28T16:24:05.372 INFO:tasks.workunit.client.0.smithi023.stdout:1/401: mkdir df/d93 0 2024-02-28T16:24:05.382 INFO:tasks.workunit.client.0.smithi023.stdout:4/305: read d13/f3c [141948,102416] 0 2024-02-28T16:24:05.387 INFO:tasks.workunit.client.0.smithi023.stdout:0/327: write d6/db/d3b/d1f/d42/f4a [934825,112320] 0 2024-02-28T16:24:05.387 INFO:tasks.workunit.client.0.smithi023.stdout:7/304: dread de/d13/f2b [0,4194304] 0 2024-02-28T16:24:05.389 INFO:tasks.workunit.client.0.smithi023.stdout:3/325: rename d1/f8 to d1/df/d3d/f62 0 2024-02-28T16:24:05.394 INFO:tasks.workunit.client.0.smithi023.stdout:5/532: symlink d1/d2a/d32/d37/d3a/d7f/d62/d68/l9f 0 2024-02-28T16:24:05.397 INFO:tasks.workunit.client.0.smithi023.stdout:2/351: truncate d5/f11 232860 0 2024-02-28T16:24:05.401 INFO:tasks.workunit.client.0.smithi023.stdout:8/445: dwrite d0/d5/f40 [0,4194304] 0 2024-02-28T16:24:05.402 INFO:tasks.workunit.client.0.smithi023.stdout:2/352: dread - d5/da/d1b/d3f/f66 zero size 2024-02-28T16:24:05.403 INFO:tasks.workunit.client.0.smithi023.stdout:0/328: mkdir d6/db/d1a/d26/d66 0 2024-02-28T16:24:05.404 INFO:tasks.workunit.client.0.smithi023.stdout:7/305: symlink de/d13/d1b/d3d/d53/l69 0 2024-02-28T16:24:05.406 INFO:tasks.workunit.client.0.smithi023.stdout:8/446: readlink d0/d5/d35/l4e 0 2024-02-28T16:24:05.408 INFO:tasks.workunit.client.0.smithi023.stdout:7/306: fdatasync de/d1c/f5a 0 2024-02-28T16:24:05.410 INFO:tasks.workunit.client.0.smithi023.stdout:3/326: creat d1/df/d33/d38/d4c/f63 x:0 0 0 2024-02-28T16:24:05.412 INFO:tasks.workunit.client.0.smithi023.stdout:4/306: dread d13/d1d/d58/f5c [0,4194304] 0 2024-02-28T16:24:05.413 INFO:tasks.workunit.client.0.smithi023.stdout:5/533: symlink d1/d2a/d32/d58/d60/d82/la0 0 2024-02-28T16:24:05.416 INFO:tasks.workunit.client.0.smithi023.stdout:1/402: creat df/d26/d48/f94 x:0 0 0 2024-02-28T16:24:05.418 INFO:tasks.workunit.client.0.smithi023.stdout:7/307: symlink de/d1c/l6a 0 2024-02-28T16:24:05.419 INFO:tasks.workunit.client.0.smithi023.stdout:8/447: mkdir d0/d5/d1a/d2d/d67/d71/d9e 0 2024-02-28T16:24:05.421 INFO:tasks.workunit.client.0.smithi023.stdout:7/308: readlink de/d13/d1b/d40/l5f 0 2024-02-28T16:24:05.423 INFO:tasks.workunit.client.0.smithi023.stdout:3/327: rename d1/f2c to d1/df/d37/d46/f64 0 2024-02-28T16:24:05.426 INFO:tasks.workunit.client.0.smithi023.stdout:7/309: chown de/d1c/l21 37279676 1 2024-02-28T16:24:05.427 INFO:tasks.workunit.client.0.smithi023.stdout:4/307: mkdir d13/d1d/d63 0 2024-02-28T16:24:05.428 INFO:tasks.workunit.client.0.smithi023.stdout:5/534: chown d1/d2a/d32/d37/d3a/d7f/c10 6617 1 2024-02-28T16:24:05.429 INFO:tasks.workunit.client.0.smithi023.stdout:4/308: write f5 [413478,97295] 0 2024-02-28T16:24:05.429 INFO:tasks.workunit.client.0.smithi023.stdout:0/329: getdents d6/db/d1a/d26/d66 0 2024-02-28T16:24:05.435 INFO:tasks.workunit.client.0.smithi023.stdout:1/403: mknod df/d11/d13/d1b/d30/d57/d5a/d68/c95 0 2024-02-28T16:24:05.436 INFO:tasks.workunit.client.0.smithi023.stdout:3/328: mkdir d1/df/d2d/d45/d52/d65 0 2024-02-28T16:24:05.445 INFO:tasks.workunit.client.0.smithi023.stdout:3/329: mknod d1/df/d2d/d32/c66 0 2024-02-28T16:24:05.446 INFO:tasks.workunit.client.0.smithi023.stdout:2/353: write d5/dc/f30 [138531,6776] 0 2024-02-28T16:24:05.450 INFO:tasks.workunit.client.0.smithi023.stdout:1/404: creat df/d11/d8a/f96 x:0 0 0 2024-02-28T16:24:05.453 INFO:tasks.workunit.client.0.smithi023.stdout:5/535: dwrite d1/d2a/d32/d6e/f85 [0,4194304] 0 2024-02-28T16:24:05.453 INFO:tasks.workunit.client.0.smithi023.stdout:4/309: dwrite d13/d2b/d2c/f2f [8388608,4194304] 0 2024-02-28T16:24:05.458 INFO:tasks.workunit.client.0.smithi023.stdout:0/330: link d6/db/d1a/d26/l5e d6/db/d1a/d59/l67 0 2024-02-28T16:24:05.462 INFO:tasks.workunit.client.0.smithi023.stdout:2/354: link d5/da/f5b d5/da/d45/f68 0 2024-02-28T16:24:05.480 INFO:tasks.workunit.client.0.smithi023.stdout:2/355: fsync d5/da/f55 0 2024-02-28T16:24:05.487 INFO:tasks.workunit.client.0.smithi023.stdout:8/448: dwrite d0/d5/d1a/f38 [0,4194304] 0 2024-02-28T16:24:05.490 INFO:tasks.workunit.client.0.smithi023.stdout:3/330: dwrite d1/df/d2d/d45/f14 [0,4194304] 0 2024-02-28T16:24:05.494 INFO:tasks.workunit.client.0.smithi023.stdout:8/449: truncate d0/d5/d1a/f6d 828169 0 2024-02-28T16:24:05.499 INFO:tasks.workunit.client.0.smithi023.stdout:8/450: readlink d0/d5/d1a/d44/l66 0 2024-02-28T16:24:05.502 INFO:tasks.workunit.client.0.smithi023.stdout:4/310: dwrite d13/d2b/d2c/f30 [0,4194304] 0 2024-02-28T16:24:05.506 INFO:tasks.workunit.client.0.smithi023.stdout:0/331: truncate d6/db/d1a/d26/f4d 3128421 0 2024-02-28T16:24:05.511 INFO:tasks.workunit.client.0.smithi023.stdout:4/311: symlink d13/d1d/d2e/l64 0 2024-02-28T16:24:05.512 INFO:tasks.workunit.client.0.smithi023.stdout:4/312: stat d13/d1d/f41 0 2024-02-28T16:24:05.514 INFO:tasks.workunit.client.0.smithi023.stdout:0/332: readlink d6/db/d1a/d26/l54 0 2024-02-28T16:24:05.515 INFO:tasks.workunit.client.0.smithi023.stdout:2/356: dwrite d5/da/f64 [0,4194304] 0 2024-02-28T16:24:05.517 INFO:tasks.workunit.client.0.smithi023.stdout:3/331: rename d1/cb to d1/c67 0 2024-02-28T16:24:05.517 INFO:tasks.workunit.client.0.smithi023.stdout:8/451: symlink d0/d5/d1a/d63/d90/l9f 0 2024-02-28T16:24:05.522 INFO:tasks.workunit.client.0.smithi023.stdout:4/313: write d13/d2b/d2c/f57 [697063,61236] 0 2024-02-28T16:24:05.522 INFO:tasks.workunit.client.0.smithi023.stdout:3/332: dread - d1/df/d33/d38/d4c/f63 zero size 2024-02-28T16:24:05.525 INFO:tasks.workunit.client.0.smithi023.stdout:0/333: mkdir d6/db/d68 0 2024-02-28T16:24:05.528 INFO:tasks.workunit.client.0.smithi023.stdout:5/536: dread d1/d2a/f3f [0,4194304] 0 2024-02-28T16:24:05.532 INFO:tasks.workunit.client.0.smithi023.stdout:4/314: unlink d13/d1d/l49 0 2024-02-28T16:24:05.534 INFO:tasks.workunit.client.0.smithi023.stdout:8/452: creat d0/d5/d1a/d2d/d67/d71/fa0 x:0 0 0 2024-02-28T16:24:05.536 INFO:tasks.workunit.client.0.smithi023.stdout:2/357: creat d5/da/d62/f69 x:0 0 0 2024-02-28T16:24:05.538 INFO:tasks.workunit.client.0.smithi023.stdout:3/333: symlink d1/df/d2d/d32/d3f/l68 0 2024-02-28T16:24:05.540 INFO:tasks.workunit.client.0.smithi023.stdout:4/315: symlink d13/d1e/d39/d55/l65 0 2024-02-28T16:24:05.542 INFO:tasks.workunit.client.0.smithi023.stdout:8/453: mknod d0/d5/d1a/d2d/d30/d39/ca1 0 2024-02-28T16:24:05.545 INFO:tasks.workunit.client.0.smithi023.stdout:8/454: write d0/d5/d1a/f38 [2338205,112187] 0 2024-02-28T16:24:05.545 INFO:tasks.workunit.client.0.smithi023.stdout:5/537: symlink d1/d2a/d32/d58/d60/d88/la1 0 2024-02-28T16:24:05.549 INFO:tasks.workunit.client.0.smithi023.stdout:0/334: rename d6/db/d1a/d26/l54 to d6/db/d3b/l69 0 2024-02-28T16:24:05.551 INFO:tasks.workunit.client.0.smithi023.stdout:4/316: getdents d13/d1e 0 2024-02-28T16:24:05.552 INFO:tasks.workunit.client.0.smithi023.stdout:0/335: write d6/db/d3b/f28 [3886105,77399] 0 2024-02-28T16:24:05.554 INFO:tasks.workunit.client.0.smithi023.stdout:3/334: rename d1/df/d2d/d32/f51 to d1/df/d2d/d45/d52/d65/f69 0 2024-02-28T16:24:05.556 INFO:tasks.workunit.client.0.smithi023.stdout:3/335: readlink d1/df/d37/d46/l4d 0 2024-02-28T16:24:05.559 INFO:tasks.workunit.client.0.smithi023.stdout:4/317: mknod d13/d2b/d2c/d31/c66 0 2024-02-28T16:24:05.562 INFO:tasks.workunit.client.0.smithi023.stdout:8/455: creat d0/d5/d1a/fa2 x:0 0 0 2024-02-28T16:24:05.564 INFO:tasks.workunit.client.0.smithi023.stdout:5/538: getdents d1/d2a/d32/d58/d79 0 2024-02-28T16:24:05.568 INFO:tasks.workunit.client.0.smithi023.stdout:8/456: creat d0/d5/d1b/d36/fa3 x:0 0 0 2024-02-28T16:24:05.569 INFO:tasks.workunit.client.0.smithi023.stdout:3/336: link d1/df/d37/d46/f5c d1/df/d33/d38/f6a 0 2024-02-28T16:24:05.570 INFO:tasks.workunit.client.0.smithi023.stdout:8/457: read d0/d5/d35/f5f [322136,109664] 0 2024-02-28T16:24:05.572 INFO:tasks.workunit.client.0.smithi023.stdout:5/539: symlink d1/la2 0 2024-02-28T16:24:05.574 INFO:tasks.workunit.client.0.smithi023.stdout:3/337: write d1/df/d2d/d45/f14 [3930570,25712] 0 2024-02-28T16:24:05.578 INFO:tasks.workunit.client.0.smithi023.stdout:2/358: truncate d5/ff 4324325 0 2024-02-28T16:24:05.583 INFO:tasks.workunit.client.0.smithi023.stdout:3/338: rename d1/df/d37/d46/f5c to d1/df/d2d/d32/d3f/f6b 0 2024-02-28T16:24:05.587 INFO:tasks.workunit.client.0.smithi023.stdout:2/359: mkdir d5/da/d45/d6a 0 2024-02-28T16:24:05.589 INFO:tasks.workunit.client.0.smithi023.stdout:3/339: write d1/df/d37/d46/f5e [261725,68432] 0 2024-02-28T16:24:05.593 INFO:tasks.workunit.client.0.smithi023.stdout:3/340: truncate d1/df/d2d/f40 1202938 0 2024-02-28T16:24:05.598 INFO:tasks.workunit.client.0.smithi023.stdout:3/341: mkdir d1/df/d33/d38/d6c 0 2024-02-28T16:24:05.602 INFO:tasks.workunit.client.0.smithi023.stdout:4/318: dwrite d13/d2b/f5e [0,4194304] 0 2024-02-28T16:24:05.602 INFO:tasks.workunit.client.0.smithi023.stdout:2/360: symlink d5/da/d67/l6b 0 2024-02-28T16:24:05.604 INFO:tasks.workunit.client.0.smithi023.stdout:4/319: write d13/d1d/d2d/f47 [1170383,86085] 0 2024-02-28T16:24:05.605 INFO:tasks.workunit.client.0.smithi023.stdout:3/342: creat d1/df/d3d/d57/f6d x:0 0 0 2024-02-28T16:24:05.607 INFO:tasks.workunit.client.0.smithi023.stdout:2/361: read d5/da/db/d17/f27 [4054694,48885] 0 2024-02-28T16:24:05.610 INFO:tasks.workunit.client.0.smithi023.stdout:2/362: chown d5/da/d62 324697334 1 2024-02-28T16:24:05.610 INFO:tasks.workunit.client.0.smithi023.stdout:4/320: mkdir d13/d1e/d39/d67 0 2024-02-28T16:24:05.611 INFO:tasks.workunit.client.0.smithi023.stdout:5/540: dread d1/d2a/d32/d37/d3a/f6a [0,4194304] 0 2024-02-28T16:24:05.613 INFO:tasks.workunit.client.0.smithi023.stdout:3/343: mknod d1/df/d2d/d32/d3f/c6e 0 2024-02-28T16:24:05.613 INFO:tasks.workunit.client.0.smithi023.stdout:4/321: readlink d13/d2b/d2c/d31/l3e 0 2024-02-28T16:24:05.614 INFO:tasks.workunit.client.0.smithi023.stdout:3/344: readlink d1/l26 0 2024-02-28T16:24:05.617 INFO:tasks.workunit.client.0.smithi023.stdout:8/458: dwrite d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69/f8e [0,4194304] 0 2024-02-28T16:24:05.617 INFO:tasks.workunit.client.0.smithi023.stdout:4/322: truncate d13/f17 9263943 0 2024-02-28T16:24:05.619 INFO:tasks.workunit.client.0.smithi023.stdout:2/363: symlink d5/da/d45/d6a/l6c 0 2024-02-28T16:24:05.619 INFO:tasks.workunit.client.0.smithi023.stdout:3/345: dread - d1/df/d3d/d57/f6d zero size 2024-02-28T16:24:05.619 INFO:tasks.workunit.client.0.smithi023.stdout:8/459: readlink d0/d5/d1b/l16 0 2024-02-28T16:24:05.619 INFO:tasks.workunit.client.0.smithi023.stdout:5/541: write d1/d2a/d32/d37/d4e/f70 [1523958,50602] 0 2024-02-28T16:24:05.626 INFO:tasks.workunit.client.0.smithi023.stdout:4/323: creat d13/d1d/d58/f68 x:0 0 0 2024-02-28T16:24:05.626 INFO:tasks.workunit.client.0.smithi023.stdout:5/542: write d1/d2a/d32/d58/d60/d81/f86 [2715594,12220] 0 2024-02-28T16:24:05.629 INFO:tasks.workunit.client.0.smithi023.stdout:4/324: dread - d13/d1e/d39/f45 zero size 2024-02-28T16:24:05.633 INFO:tasks.workunit.client.0.smithi023.stdout:2/364: rename d5/da/f64 to d5/da/db/d17/d39/d56/f6d 0 2024-02-28T16:24:05.634 INFO:tasks.workunit.client.0.smithi023.stdout:5/543: write d1/d2a/d32/d37/d3a/d7f/d62/f72 [173246,87628] 0 2024-02-28T16:24:05.640 INFO:tasks.workunit.client.0.smithi023.stdout:8/460: dread d0/d5/d1a/d2d/d30/d39/f4c [0,4194304] 0 2024-02-28T16:24:05.648 INFO:tasks.workunit.client.0.smithi023.stdout:5/544: creat d1/d2a/d32/d58/d79/fa3 x:0 0 0 2024-02-28T16:24:05.651 INFO:tasks.workunit.client.0.smithi023.stdout:2/365: rename d5/da/db/d17/d39/d56/f6d to d5/da/d45/d6a/f6e 0 2024-02-28T16:24:05.657 INFO:tasks.workunit.client.0.smithi023.stdout:8/461: fsync d0/d5/f26 0 2024-02-28T16:24:05.659 INFO:tasks.workunit.client.0.smithi023.stdout:3/346: getdents d1/df/d3d/d57 0 2024-02-28T16:24:05.661 INFO:tasks.workunit.client.0.smithi023.stdout:2/366: write d5/da/d45/d6a/f6e [1177862,128660] 0 2024-02-28T16:24:05.663 INFO:tasks.workunit.client.0.smithi023.stdout:3/347: dread - d1/df/d33/d38/d4c/f50 zero size 2024-02-28T16:24:05.665 INFO:tasks.workunit.client.0.smithi023.stdout:4/325: dread f7 [0,4194304] 0 2024-02-28T16:24:05.667 INFO:tasks.workunit.client.0.smithi023.stdout:8/462: unlink d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69/f8e 0 2024-02-28T16:24:05.670 INFO:tasks.workunit.client.0.smithi023.stdout:8/463: read d0/d5/d1a/d44/f76 [2968867,44246] 0 2024-02-28T16:24:05.673 INFO:tasks.workunit.client.0.smithi023.stdout:5/545: link d1/d2a/d32/d37/c41 d1/d2a/d32/d58/d73/ca4 0 2024-02-28T16:24:05.678 INFO:tasks.workunit.client.0.smithi023.stdout:3/348: dwrite d1/df/d2d/d45/f14 [0,4194304] 0 2024-02-28T16:24:05.679 INFO:tasks.workunit.client.0.smithi023.stdout:8/464: rename d0/d5/d1a/d44/f98 to d0/d5/d1a/d2d/d67/d71/d9e/fa4 0 2024-02-28T16:24:05.681 INFO:tasks.workunit.client.0.smithi023.stdout:5/546: mkdir d1/d2a/da5 0 2024-02-28T16:24:05.692 INFO:tasks.workunit.client.0.smithi023.stdout:2/367: truncate d5/da/db/f23 4755447 0 2024-02-28T16:24:05.693 INFO:tasks.workunit.client.0.smithi023.stdout:5/547: symlink d1/d2a/d32/d37/d3a/d7f/d62/la6 0 2024-02-28T16:24:05.695 INFO:tasks.workunit.client.0.smithi023.stdout:2/368: write d5/da/d1b/d3f/f53 [5154065,31143] 0 2024-02-28T16:24:05.697 INFO:tasks.workunit.client.0.smithi023.stdout:3/349: write d1/f41 [497275,102493] 0 2024-02-28T16:24:05.697 INFO:tasks.workunit.client.0.smithi023.stdout:5/548: chown d1/d2a/d32/d37/d3a/d7f/d62/d68/l8e 24 1 2024-02-28T16:24:05.701 INFO:tasks.workunit.client.0.smithi023.stdout:3/350: truncate d1/df/d2d/f31 953659 0 2024-02-28T16:24:05.704 INFO:tasks.workunit.client.0.smithi023.stdout:5/549: dread d1/d2a/d32/d37/d3a/d7f/d62/f72 [0,4194304] 0 2024-02-28T16:24:05.706 INFO:tasks.workunit.client.0.smithi023.stdout:5/550: mkdir d1/d2a/d32/d36/da7 0 2024-02-28T16:24:05.710 INFO:tasks.workunit.client.0.smithi023.stdout:5/551: creat d1/d2a/d32/d58/d73/fa8 x:0 0 0 2024-02-28T16:24:05.713 INFO:tasks.workunit.client.0.smithi023.stdout:2/369: truncate d5/da/d45/d6a/f6e 4907127 0 2024-02-28T16:24:05.719 INFO:tasks.workunit.client.0.smithi023.stdout:2/370: getdents d5/da/d1b/d3f 0 2024-02-28T16:24:05.724 INFO:tasks.workunit.client.0.smithi023.stdout:2/371: read d5/da/db/f51 [152440,53072] 0 2024-02-28T16:24:05.728 INFO:tasks.workunit.client.0.smithi023.stdout:5/552: dwrite d1/d2a/d32/d37/d3a/d7f/f29 [0,4194304] 0 2024-02-28T16:24:05.731 INFO:tasks.workunit.client.0.smithi023.stdout:2/372: truncate d5/da/db/d17/f2a 747653 0 2024-02-28T16:24:05.733 INFO:tasks.workunit.client.0.smithi023.stdout:5/553: unlink d1/d2a/d32/d37/l5c 0 2024-02-28T16:24:05.734 INFO:tasks.workunit.client.0.smithi023.stdout:2/373: mknod d5/da/d62/c6f 0 2024-02-28T16:24:05.735 INFO:tasks.workunit.client.0.smithi023.stdout:5/554: write d1/d2a/d32/d58/d79/fa3 [639850,11369] 0 2024-02-28T16:24:05.740 INFO:tasks.workunit.client.0.smithi023.stdout:2/374: link d5/da/d45/d6a/l6c d5/da/d67/l70 0 2024-02-28T16:24:05.741 INFO:tasks.workunit.client.0.smithi023.stdout:2/375: stat d5/da/d1b/d3f/l58 0 2024-02-28T16:24:05.742 INFO:tasks.workunit.client.0.smithi023.stdout:5/555: creat d1/d2a/d32/d37/d3a/d7f/d62/fa9 x:0 0 0 2024-02-28T16:24:05.745 INFO:tasks.workunit.client.0.smithi023.stdout:2/376: dread d5/f40 [0,4194304] 0 2024-02-28T16:24:05.746 INFO:tasks.workunit.client.0.smithi023.stdout:5/556: write d1/d2a/d32/d36/f66 [2332453,110603] 0 2024-02-28T16:24:05.751 INFO:tasks.workunit.client.0.smithi023.stdout:2/377: link d5/da/d1b/f35 d5/da/db/f71 0 2024-02-28T16:24:05.752 INFO:tasks.workunit.client.0.smithi023.stdout:2/378: write d5/da/f55 [984824,71698] 0 2024-02-28T16:24:05.754 INFO:tasks.workunit.client.0.smithi023.stdout:2/379: readlink d5/da/db/d17/l47 0 2024-02-28T16:24:05.756 INFO:tasks.workunit.client.0.smithi023.stdout:2/380: symlink d5/dc/d52/l72 0 2024-02-28T16:24:05.758 INFO:tasks.workunit.client.0.smithi023.stdout:2/381: write d5/da/f54 [132803,2807] 0 2024-02-28T16:24:05.760 INFO:tasks.workunit.client.0.smithi023.stdout:2/382: dread - d5/da/d1b/d3f/f66 zero size 2024-02-28T16:24:05.762 INFO:tasks.workunit.client.0.smithi023.stdout:2/383: rmdir d5/da/db/d17/d39 39 2024-02-28T16:24:05.765 INFO:tasks.workunit.client.0.smithi023.stdout:2/384: mkdir d5/da/db/d17/d73 0 2024-02-28T16:24:05.768 INFO:tasks.workunit.client.0.smithi023.stdout:2/385: truncate d5/da/db/d17/f57 421639 0 2024-02-28T16:24:05.770 INFO:tasks.workunit.client.0.smithi023.stdout:2/386: fsync d5/f11 0 2024-02-28T16:24:05.772 INFO:tasks.workunit.client.0.smithi023.stdout:2/387: symlink d5/da/d62/l74 0 2024-02-28T16:24:05.775 INFO:tasks.workunit.client.0.smithi023.stdout:2/388: mkdir d5/da/d1b/d3f/d75 0 2024-02-28T16:24:05.781 INFO:tasks.workunit.client.0.smithi023.stdout:2/389: creat d5/f76 x:0 0 0 2024-02-28T16:24:05.783 INFO:tasks.workunit.client.0.smithi023.stdout:2/390: truncate d5/da/db/f49 26183 0 2024-02-28T16:24:05.786 INFO:tasks.workunit.client.0.smithi023.stdout:2/391: creat d5/da/d1b/d3f/d75/f77 x:0 0 0 2024-02-28T16:24:05.795 INFO:tasks.workunit.client.0.smithi023.stdout:2/392: write d5/da/f5b [1590504,3143] 0 2024-02-28T16:24:05.796 INFO:tasks.workunit.client.0.smithi023.stdout:2/393: chown d5/da/l37 0 1 2024-02-28T16:24:05.798 INFO:tasks.workunit.client.0.smithi023.stdout:2/394: readlink d5/da/db/d17/d3c/l4a 0 2024-02-28T16:24:05.801 INFO:tasks.workunit.client.0.smithi023.stdout:2/395: symlink d5/da/db/d17/l78 0 2024-02-28T16:24:05.815 INFO:tasks.workunit.client.0.smithi023.stdout:2/396: dwrite d5/da/db/d17/d39/d56/f63 [0,4194304] 0 2024-02-28T16:24:05.824 INFO:tasks.workunit.client.0.smithi023.stdout:2/397: unlink d5/da/db/d17/f27 0 2024-02-28T16:24:05.824 INFO:tasks.workunit.client.0.smithi023.stdout:2/398: chown d5/da/l2d 1635462 1 2024-02-28T16:24:05.827 INFO:tasks.workunit.client.0.smithi023.stdout:2/399: write d5/da/d1b/d3f/f60 [400010,64414] 0 2024-02-28T16:24:05.838 INFO:tasks.workunit.client.0.smithi023.stdout:2/400: dread d5/da/d45/f68 [0,4194304] 0 2024-02-28T16:24:05.852 INFO:tasks.workunit.client.0.smithi023.stdout:2/401: dwrite d5/da/d45/f50 [0,4194304] 0 2024-02-28T16:24:05.857 INFO:tasks.workunit.client.0.smithi023.stdout:2/402: rename d5/da/d1b/f2c to d5/dc/f79 0 2024-02-28T16:24:05.861 INFO:tasks.workunit.client.0.smithi023.stdout:2/403: creat d5/f7a x:0 0 0 2024-02-28T16:24:05.865 INFO:tasks.workunit.client.0.smithi023.stdout:2/404: symlink d5/dc/d52/l7b 0 2024-02-28T16:24:05.879 INFO:tasks.workunit.client.0.smithi023.stdout:2/405: dwrite d5/f7a [0,4194304] 0 2024-02-28T16:24:05.887 INFO:tasks.workunit.client.0.smithi023.stdout:2/406: link d5/da/d1b/d3f/f60 d5/da/f7c 0 2024-02-28T16:24:05.891 INFO:tasks.workunit.client.0.smithi023.stdout:2/407: creat d5/f7d x:0 0 0 2024-02-28T16:24:05.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:05 smithi153 ceph-mon[35341]: pgmap v34: 65 pgs: 65 active+clean; 820 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 108 MiB/s wr, 296 op/s 2024-02-28T16:24:05.905 INFO:tasks.workunit.client.0.smithi023.stdout:2/408: read d5/dc/f21 [110544,107550] 0 2024-02-28T16:24:05.907 INFO:tasks.workunit.client.0.smithi023.stdout:2/409: chown d5/da/d62 8 1 2024-02-28T16:24:05.909 INFO:tasks.workunit.client.0.smithi023.stdout:2/410: dread - d5/da/db/d17/f65 zero size 2024-02-28T16:24:05.910 INFO:tasks.workunit.client.0.smithi023.stdout:2/411: chown d5/f40 877 1 2024-02-28T16:24:05.920 INFO:tasks.workunit.client.0.smithi023.stdout:2/412: write d5/dc/f34 [421562,12677] 0 2024-02-28T16:24:05.921 INFO:tasks.workunit.client.0.smithi023.stdout:2/413: readlink d5/ld 0 2024-02-28T16:24:05.922 INFO:tasks.workunit.client.0.smithi023.stdout:2/414: readlink d5/dc/d52/l7b 0 2024-02-28T16:24:05.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:05 smithi023 ceph-mon[29137]: pgmap v34: 65 pgs: 65 active+clean; 820 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 108 MiB/s wr, 296 op/s 2024-02-28T16:24:05.924 INFO:tasks.workunit.client.0.smithi023.stdout:2/415: chown d5/da/f28 267 1 2024-02-28T16:24:05.928 INFO:tasks.workunit.client.0.smithi023.stdout:2/416: fsync d5/da/db/d17/f2a 0 2024-02-28T16:24:05.932 INFO:tasks.workunit.client.0.smithi023.stdout:2/417: truncate d5/da/d1b/f4b 539528 0 2024-02-28T16:24:05.934 INFO:tasks.workunit.client.0.smithi023.stdout:2/418: mknod d5/da/db/c7e 0 2024-02-28T16:24:05.939 INFO:tasks.workunit.client.0.smithi023.stdout:2/419: mkdir d5/da/db/d17/d3c/d7f 0 2024-02-28T16:24:05.943 INFO:tasks.workunit.client.0.smithi023.stdout:2/420: creat d5/da/db/d17/d39/f80 x:0 0 0 2024-02-28T16:24:05.947 INFO:tasks.workunit.client.0.smithi023.stdout:2/421: mkdir d5/da/d45/d81 0 2024-02-28T16:24:06.006 INFO:tasks.workunit.client.0.smithi023.stdout:2/422: dwrite d5/dc/f79 [0,4194304] 0 2024-02-28T16:24:06.010 INFO:tasks.workunit.client.0.smithi023.stdout:2/423: dread - d5/da/d1b/d3f/d75/f77 zero size 2024-02-28T16:24:06.011 INFO:tasks.workunit.client.0.smithi023.stdout:2/424: chown d5 407621 1 2024-02-28T16:24:06.015 INFO:tasks.workunit.client.0.smithi023.stdout:2/425: dread - d5/da/db/d17/d3c/f46 zero size 2024-02-28T16:24:06.083 INFO:tasks.workunit.client.0.smithi023.stdout:9/318: sync 2024-02-28T16:24:06.098 INFO:tasks.workunit.client.0.smithi023.stdout:9/319: symlink d0/l67 0 2024-02-28T16:24:06.102 INFO:tasks.workunit.client.0.smithi023.stdout:9/320: readlink d0/d7/db/d18/d23/d28/l33 0 2024-02-28T16:24:06.107 INFO:tasks.workunit.client.0.smithi023.stdout:9/321: readlink d0/d7/db/d18/d23/d28/l37 0 2024-02-28T16:24:06.137 INFO:tasks.workunit.client.0.smithi023.stdout:9/322: dwrite d0/d7/db/fc [0,4194304] 0 2024-02-28T16:24:06.144 INFO:tasks.workunit.client.0.smithi023.stdout:9/323: rmdir d0/d7/db/d18/d23/d28/d32/d3c 39 2024-02-28T16:24:06.151 INFO:tasks.workunit.client.0.smithi023.stdout:6/431: sync 2024-02-28T16:24:06.154 INFO:tasks.workunit.client.0.smithi023.stdout:9/324: creat d0/d7/de/f68 x:0 0 0 2024-02-28T16:24:06.166 INFO:tasks.workunit.client.0.smithi023.stdout:9/325: rmdir d0/d7/de/d61 0 2024-02-28T16:24:06.182 INFO:tasks.workunit.client.0.smithi023.stdout:9/326: rename d0/d7/db/d18/d23/d28/l37 to d0/d7/de/l69 0 2024-02-28T16:24:06.188 INFO:tasks.workunit.client.0.smithi023.stdout:6/432: dwrite d1/d28/d1e/d52/f5b [0,4194304] 0 2024-02-28T16:24:06.188 INFO:tasks.workunit.client.0.smithi023.stdout:9/327: symlink d0/d7/d2c/d57/l6a 0 2024-02-28T16:24:06.189 INFO:tasks.workunit.client.0.smithi023.stdout:9/328: fdatasync d0/f43 0 2024-02-28T16:24:06.193 INFO:tasks.workunit.client.0.smithi023.stdout:6/433: creat d1/d18/d26/fa8 x:0 0 0 2024-02-28T16:24:06.203 INFO:tasks.workunit.client.0.smithi023.stdout:6/434: mkdir d1/d18/d26/da6/da9 0 2024-02-28T16:24:06.207 INFO:tasks.workunit.client.0.smithi023.stdout:9/329: rename d0/d7/db/d18/d23/d28/d32/d3c/l59 to d0/d7/db/d18/d23/d28/d32/l6b 0 2024-02-28T16:24:06.207 INFO:tasks.workunit.client.0.smithi023.stdout:5/557: sync 2024-02-28T16:24:06.207 INFO:tasks.workunit.client.0.smithi023.stdout:3/351: sync 2024-02-28T16:24:06.207 INFO:tasks.workunit.client.0.smithi023.stdout:4/326: sync 2024-02-28T16:24:06.207 INFO:tasks.workunit.client.0.smithi023.stdout:7/310: sync 2024-02-28T16:24:06.207 INFO:tasks.workunit.client.0.smithi023.stdout:8/465: sync 2024-02-28T16:24:06.207 INFO:tasks.workunit.client.0.smithi023.stdout:0/336: sync 2024-02-28T16:24:06.208 INFO:tasks.workunit.client.0.smithi023.stdout:2/426: sync 2024-02-28T16:24:06.208 INFO:tasks.workunit.client.0.smithi023.stdout:1/405: sync 2024-02-28T16:24:06.211 INFO:tasks.workunit.client.0.smithi023.stdout:6/435: symlink d1/d3d/d7d/laa 0 2024-02-28T16:24:06.213 INFO:tasks.workunit.client.0.smithi023.stdout:0/337: chown d6/db/d3d/f64 122501 1 2024-02-28T16:24:06.214 INFO:tasks.workunit.client.0.smithi023.stdout:4/327: chown d13/d1d/d2e/l64 949844316 1 2024-02-28T16:24:06.215 INFO:tasks.workunit.client.0.smithi023.stdout:7/311: write f8 [206600,92730] 0 2024-02-28T16:24:06.218 INFO:tasks.workunit.client.0.smithi023.stdout:6/436: stat d1/d28/d1e/d2b/l7a 0 2024-02-28T16:24:06.219 INFO:tasks.workunit.client.0.smithi023.stdout:5/558: creat d1/d2a/d32/d58/faa x:0 0 0 2024-02-28T16:24:06.222 INFO:tasks.workunit.client.0.smithi023.stdout:2/427: creat d5/da/d62/f82 x:0 0 0 2024-02-28T16:24:06.222 INFO:tasks.workunit.client.0.smithi023.stdout:1/406: dread - df/d26/f5b zero size 2024-02-28T16:24:06.223 INFO:tasks.workunit.client.0.smithi023.stdout:3/352: mkdir d1/df/d2d/d45/d6f 0 2024-02-28T16:24:06.226 INFO:tasks.workunit.client.0.smithi023.stdout:8/466: symlink d0/d5/d1a/d2d/d67/d71/d9e/la5 0 2024-02-28T16:24:06.226 INFO:tasks.workunit.client.0.smithi023.stdout:0/338: write d6/db/d1a/d2e/f4f [134498,28161] 0 2024-02-28T16:24:06.227 INFO:tasks.workunit.client.0.smithi023.stdout:7/312: mknod de/d13/d1b/d3d/d53/c6b 0 2024-02-28T16:24:06.227 INFO:tasks.workunit.client.0.smithi023.stdout:4/328: read d13/d1d/f41 [197257,45712] 0 2024-02-28T16:24:06.233 INFO:tasks.workunit.client.0.smithi023.stdout:4/329: read - d13/d1e/d39/d55/f60 zero size 2024-02-28T16:24:06.239 INFO:tasks.workunit.client.0.smithi023.stdout:5/559: creat d1/d2a/d32/d37/d3a/fab x:0 0 0 2024-02-28T16:24:06.239 INFO:tasks.workunit.client.0.smithi023.stdout:3/353: creat d1/df/d2d/d32/d3f/f70 x:0 0 0 2024-02-28T16:24:06.239 INFO:tasks.workunit.client.0.smithi023.stdout:0/339: mkdir d6/d4c/d6a 0 2024-02-28T16:24:06.241 INFO:tasks.workunit.client.0.smithi023.stdout:3/354: chown d1/df/f30 17135269 1 2024-02-28T16:24:06.242 INFO:tasks.workunit.client.0.smithi023.stdout:8/467: unlink d0/d5/d1b/f19 0 2024-02-28T16:24:06.248 INFO:tasks.workunit.client.0.smithi023.stdout:2/428: rename d5/da/db/d17/d39/l3e to d5/dc/l83 0 2024-02-28T16:24:06.252 INFO:tasks.workunit.client.0.smithi023.stdout:7/313: write de/d1c/f68 [65083,27120] 0 2024-02-28T16:24:06.254 INFO:tasks.workunit.client.0.smithi023.stdout:5/560: creat d1/d2a/d32/d58/d79/fac x:0 0 0 2024-02-28T16:24:06.254 INFO:tasks.workunit.client.0.smithi023.stdout:6/437: dwrite d1/d28/f77 [4194304,4194304] 0 2024-02-28T16:24:06.256 INFO:tasks.workunit.client.0.smithi023.stdout:9/330: dread d0/d7/de/d2e/d2f/d4d/f4b [0,4194304] 0 2024-02-28T16:24:06.260 INFO:tasks.workunit.client.0.smithi023.stdout:4/330: rename f7 to d13/d1d/f69 0 2024-02-28T16:24:06.263 INFO:tasks.workunit.client.0.smithi023.stdout:6/438: read d1/d18/d26/f58 [394062,41979] 0 2024-02-28T16:24:06.267 INFO:tasks.workunit.client.0.smithi023.stdout:9/331: chown d0/d7/l19 32996 1 2024-02-28T16:24:06.271 INFO:tasks.workunit.client.0.smithi023.stdout:4/331: write d13/d1d/f25 [601943,121836] 0 2024-02-28T16:24:06.274 INFO:tasks.workunit.client.0.smithi023.stdout:6/439: chown d1/d18/l71 6753087 1 2024-02-28T16:24:06.275 INFO:tasks.workunit.client.0.smithi023.stdout:3/355: dread d1/df/d2d/d45/d52/d65/f69 [0,4194304] 0 2024-02-28T16:24:06.279 INFO:tasks.workunit.client.0.smithi023.stdout:0/340: dwrite d6/db/d3d/f55 [0,4194304] 0 2024-02-28T16:24:06.279 INFO:tasks.workunit.client.0.smithi023.stdout:5/561: mkdir d1/d2a/d32/d58/d60/d82/dad 0 2024-02-28T16:24:06.280 INFO:tasks.workunit.client.0.smithi023.stdout:2/429: rename d5/f1f to d5/dc/f84 0 2024-02-28T16:24:06.284 INFO:tasks.workunit.client.0.smithi023.stdout:3/356: read d1/df/d37/d46/f64 [1219826,126191] 0 2024-02-28T16:24:06.286 INFO:tasks.workunit.client.0.smithi023.stdout:2/430: write d5/da/f54 [889207,5306] 0 2024-02-28T16:24:06.287 INFO:tasks.workunit.client.0.smithi023.stdout:1/407: dread df/d11/d13/d1b/f55 [0,4194304] 0 2024-02-28T16:24:06.292 INFO:tasks.workunit.client.0.smithi023.stdout:2/431: chown d5/da/db/d17/l78 3 1 2024-02-28T16:24:06.299 INFO:tasks.workunit.client.0.smithi023.stdout:6/440: rename d1/fb to d1/d3d/fab 0 2024-02-28T16:24:06.303 INFO:tasks.workunit.client.0.smithi023.stdout:6/441: chown d1/d28/f62 1 1 2024-02-28T16:24:06.308 INFO:tasks.workunit.client.0.smithi023.stdout:9/332: dread d0/d7/db/d18/d23/d28/f54 [0,4194304] 0 2024-02-28T16:24:06.311 INFO:tasks.workunit.client.0.smithi023.stdout:1/408: dwrite df/d11/f12 [0,4194304] 0 2024-02-28T16:24:06.313 INFO:tasks.workunit.client.0.smithi023.stdout:3/357: creat d1/df/d3d/d57/f71 x:0 0 0 2024-02-28T16:24:06.314 INFO:tasks.workunit.client.0.smithi023.stdout:2/432: creat d5/da/d1b/f85 x:0 0 0 2024-02-28T16:24:06.320 INFO:tasks.workunit.client.0.smithi023.stdout:6/442: dwrite d1/f40 [0,4194304] 0 2024-02-28T16:24:06.324 INFO:tasks.workunit.client.0.smithi023.stdout:6/443: fsync d1/fd 0 2024-02-28T16:24:06.328 INFO:tasks.workunit.client.0.smithi023.stdout:5/562: link d1/d2a/d32/d37/d3a/d7f/d62/f72 d1/d2a/d32/d37/d3a/fae 0 2024-02-28T16:24:06.333 INFO:tasks.workunit.client.0.smithi023.stdout:9/333: rmdir d0/d7/db/d18 39 2024-02-28T16:24:06.336 INFO:tasks.workunit.client.0.smithi023.stdout:0/341: creat d6/db/d1a/f6b x:0 0 0 2024-02-28T16:24:06.337 INFO:tasks.workunit.client.0.smithi023.stdout:2/433: creat d5/da/d45/f86 x:0 0 0 2024-02-28T16:24:06.339 INFO:tasks.workunit.client.0.smithi023.stdout:3/358: dwrite d1/df/d2d/d45/f56 [0,4194304] 0 2024-02-28T16:24:06.340 INFO:tasks.workunit.client.0.smithi023.stdout:0/342: dread - d6/db/d1a/f6b zero size 2024-02-28T16:24:06.341 INFO:tasks.workunit.client.0.smithi023.stdout:2/434: stat d5/da/db/d17/d3c/f3d 0 2024-02-28T16:24:06.343 INFO:tasks.workunit.client.0.smithi023.stdout:0/343: chown d6/f10 0 1 2024-02-28T16:24:06.347 INFO:tasks.workunit.client.0.smithi023.stdout:0/344: write d6/db/d1a/d1b/f27 [161126,75193] 0 2024-02-28T16:24:06.352 INFO:tasks.workunit.client.0.smithi023.stdout:3/359: creat d1/df/d37/d46/f72 x:0 0 0 2024-02-28T16:24:06.353 INFO:tasks.workunit.client.0.smithi023.stdout:5/563: dwrite d1/d2a/d32/d37/d3a/f48 [0,4194304] 0 2024-02-28T16:24:06.355 INFO:tasks.workunit.client.0.smithi023.stdout:6/444: mknod d1/d28/d1e/d2b/d76/d9e/cac 0 2024-02-28T16:24:06.360 INFO:tasks.workunit.client.0.smithi023.stdout:8/468: truncate d0/d5/d1b/f33 350303 0 2024-02-28T16:24:06.363 INFO:tasks.workunit.client.0.smithi023.stdout:0/345: getdents d6/db/d1a/d35 0 2024-02-28T16:24:06.364 INFO:tasks.workunit.client.0.smithi023.stdout:3/360: fdatasync d1/df/d37/d46/f64 0 2024-02-28T16:24:06.368 INFO:tasks.workunit.client.0.smithi023.stdout:2/435: link d5/da/d1b/d3f/l4d d5/da/d45/d6a/l87 0 2024-02-28T16:24:06.372 INFO:tasks.workunit.client.0.smithi023.stdout:1/409: dread df/d26/f35 [0,4194304] 0 2024-02-28T16:24:06.372 INFO:tasks.workunit.client.0.smithi023.stdout:6/445: dread d1/f2f [4194304,4194304] 0 2024-02-28T16:24:06.374 INFO:tasks.workunit.client.0.smithi023.stdout:1/410: chown df/f16 0 1 2024-02-28T16:24:06.379 INFO:tasks.workunit.client.0.smithi023.stdout:9/334: dwrite d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:24:06.382 INFO:tasks.workunit.client.0.smithi023.stdout:0/346: dread d6/db/d1a/d2e/f2f [0,4194304] 0 2024-02-28T16:24:06.383 INFO:tasks.workunit.client.0.smithi023.stdout:5/564: link d1/d2a/d32/d36/l67 d1/d2a/d32/d58/laf 0 2024-02-28T16:24:06.383 INFO:tasks.workunit.client.0.smithi023.stdout:7/314: truncate de/d13/d1b/d40/f50 1814768 0 2024-02-28T16:24:06.385 INFO:tasks.workunit.client.0.smithi023.stdout:2/436: dread d5/dc/f24 [0,4194304] 0 2024-02-28T16:24:06.387 INFO:tasks.workunit.client.0.smithi023.stdout:9/335: write d0/d7/db/d18/f49 [1895224,60729] 0 2024-02-28T16:24:06.388 INFO:tasks.workunit.client.0.smithi023.stdout:8/469: getdents d0/d5/d1a/d2d/d67/d71/d9e 0 2024-02-28T16:24:06.392 INFO:tasks.workunit.client.0.smithi023.stdout:0/347: truncate d6/db/d1a/d1b/f5a 243935 0 2024-02-28T16:24:06.395 INFO:tasks.workunit.client.0.smithi023.stdout:1/411: rename f3 to df/f97 0 2024-02-28T16:24:06.397 INFO:tasks.workunit.client.0.smithi023.stdout:2/437: creat d5/dc/f88 x:0 0 0 2024-02-28T16:24:06.399 INFO:tasks.workunit.client.0.smithi023.stdout:6/446: getdents d1 0 2024-02-28T16:24:06.400 INFO:tasks.workunit.client.0.smithi023.stdout:1/412: stat df/d11/d13/d1b/f40 0 2024-02-28T16:24:06.404 INFO:tasks.workunit.client.0.smithi023.stdout:2/438: write d5/da/db/f49 [268217,38548] 0 2024-02-28T16:24:06.407 INFO:tasks.workunit.client.0.smithi023.stdout:0/348: symlink d6/db/d1a/d2e/l6c 0 2024-02-28T16:24:06.408 INFO:tasks.workunit.client.0.smithi023.stdout:2/439: readlink d5/da/d67/l6b 0 2024-02-28T16:24:06.410 INFO:tasks.workunit.client.0.smithi023.stdout:2/440: chown d5/da/db/d17/l78 198840399 1 2024-02-28T16:24:06.411 INFO:tasks.workunit.client.0.smithi023.stdout:6/447: read d1/d3d/f45 [898388,63722] 0 2024-02-28T16:24:06.411 INFO:tasks.workunit.client.0.smithi023.stdout:5/565: symlink d1/d2a/d32/lb0 0 2024-02-28T16:24:06.416 INFO:tasks.workunit.client.0.smithi023.stdout:9/336: dread d0/d7/de/d34/f3b [0,4194304] 0 2024-02-28T16:24:06.417 INFO:tasks.workunit.client.0.smithi023.stdout:4/332: sync 2024-02-28T16:24:06.421 INFO:tasks.workunit.client.0.smithi023.stdout:1/413: creat df/d11/d13/d1b/d30/d3d/f98 x:0 0 0 2024-02-28T16:24:06.426 INFO:tasks.workunit.client.0.smithi023.stdout:7/315: unlink de/d13/d1b/d40/f50 0 2024-02-28T16:24:06.426 INFO:tasks.workunit.client.0.smithi023.stdout:4/333: dread - d13/d2b/f4f zero size 2024-02-28T16:24:06.430 INFO:tasks.workunit.client.0.smithi023.stdout:9/337: dread d0/d7/de/f14 [0,4194304] 0 2024-02-28T16:24:06.432 INFO:tasks.workunit.client.0.smithi023.stdout:0/349: mknod d6/db/d1a/d1b/c6d 0 2024-02-28T16:24:06.433 INFO:tasks.workunit.client.0.smithi023.stdout:2/441: symlink d5/da/d62/l89 0 2024-02-28T16:24:06.434 INFO:tasks.workunit.client.0.smithi023.stdout:7/316: write f8 [3225677,93862] 0 2024-02-28T16:24:06.438 INFO:tasks.workunit.client.0.smithi023.stdout:6/448: symlink d1/d28/d1e/d2b/d44/d86/lad 0 2024-02-28T16:24:06.439 INFO:tasks.workunit.client.0.smithi023.stdout:8/470: dread d0/d5/d35/f5d [0,4194304] 0 2024-02-28T16:24:06.442 INFO:tasks.workunit.client.0.smithi023.stdout:3/361: dwrite d1/df/d33/d38/f48 [0,4194304] 0 2024-02-28T16:24:06.443 INFO:tasks.workunit.client.0.smithi023.stdout:2/442: truncate d5/dc/f84 1246796 0 2024-02-28T16:24:06.445 INFO:tasks.workunit.client.0.smithi023.stdout:0/350: truncate d6/db/d3d/f64 1065051 0 2024-02-28T16:24:06.450 INFO:tasks.workunit.client.0.smithi023.stdout:6/449: fdatasync d1/d28/f3e 0 2024-02-28T16:24:06.452 INFO:tasks.workunit.client.0.smithi023.stdout:2/443: chown d5/da/d1b/d3f/l4d 32150 1 2024-02-28T16:24:06.455 INFO:tasks.workunit.client.0.smithi023.stdout:2/444: truncate d5/da/db/f51 1310055 0 2024-02-28T16:24:06.459 INFO:tasks.workunit.client.0.smithi023.stdout:3/362: creat d1/df/d33/d38/d4c/f73 x:0 0 0 2024-02-28T16:24:06.459 INFO:tasks.workunit.client.0.smithi023.stdout:3/363: chown d1/df/d37/d46 435860407 1 2024-02-28T16:24:06.466 INFO:tasks.workunit.client.0.smithi023.stdout:2/445: fsync d5/da/d1b/d3f/f60 0 2024-02-28T16:24:06.469 INFO:tasks.workunit.client.0.smithi023.stdout:9/338: write d0/d7/db/d18/f25 [1267093,96848] 0 2024-02-28T16:24:06.473 INFO:tasks.workunit.client.0.smithi023.stdout:5/566: truncate d1/d2a/d32/d37/f38 694484 0 2024-02-28T16:24:06.475 INFO:tasks.workunit.client.0.smithi023.stdout:4/334: write d13/d2b/d2c/f35 [775079,53994] 0 2024-02-28T16:24:06.475 INFO:tasks.workunit.client.0.smithi023.stdout:8/471: write d0/d5/f26 [373722,14256] 0 2024-02-28T16:24:06.478 INFO:tasks.workunit.client.0.smithi023.stdout:0/351: mkdir d6/db/d1a/d26/d31/d33/d6e 0 2024-02-28T16:24:06.480 INFO:tasks.workunit.client.0.smithi023.stdout:7/317: getdents de/d13/d1b/d3d/d53 0 2024-02-28T16:24:06.482 INFO:tasks.workunit.client.0.smithi023.stdout:9/339: fsync d0/d7/de/d34/f35 0 2024-02-28T16:24:06.484 INFO:tasks.workunit.client.0.smithi023.stdout:6/450: rename d1/d4f/da1 to d1/d28/d1e/dae 0 2024-02-28T16:24:06.486 INFO:tasks.workunit.client.0.smithi023.stdout:4/335: symlink d13/d1d/d2d/l6a 0 2024-02-28T16:24:06.499 INFO:tasks.workunit.client.0.smithi023.stdout:7/318: mkdir de/d13/d1b/d6c 0 2024-02-28T16:24:06.500 INFO:tasks.workunit.client.0.smithi023.stdout:4/336: mkdir d13/d1e/d39/d67/d6b 0 2024-02-28T16:24:06.503 INFO:tasks.workunit.client.0.smithi023.stdout:0/352: creat d6/db/d1a/d26/d31/d33/d6e/f6f x:0 0 0 2024-02-28T16:24:06.504 INFO:tasks.workunit.client.0.smithi023.stdout:3/364: rename d1/df/d37 to d1/d74 0 2024-02-28T16:24:06.508 INFO:tasks.workunit.client.0.smithi023.stdout:8/472: rename d0/d5 to d0/d5/d1a/d2d/d67/d71/da6 22 2024-02-28T16:24:06.509 INFO:tasks.workunit.client.0.smithi023.stdout:2/446: dread d5/da/f28 [0,4194304] 0 2024-02-28T16:24:06.510 INFO:tasks.workunit.client.0.smithi023.stdout:8/473: fdatasync d0/d5/f26 0 2024-02-28T16:24:06.512 INFO:tasks.workunit.client.0.smithi023.stdout:5/567: dread d1/d2a/d32/d6e/f85 [0,4194304] 0 2024-02-28T16:24:06.513 INFO:tasks.workunit.client.0.smithi023.stdout:0/353: write d6/db/d1a/d2e/f44 [1504206,7845] 0 2024-02-28T16:24:06.519 INFO:tasks.workunit.client.0.smithi023.stdout:6/451: dwrite d1/d18/f90 [0,4194304] 0 2024-02-28T16:24:06.521 INFO:tasks.workunit.client.0.smithi023.stdout:9/340: link d0/d7/de/d2e/c3a d0/d7/d2c/c6c 0 2024-02-28T16:24:06.521 INFO:tasks.workunit.client.0.smithi023.stdout:4/337: creat d13/d1e/d39/d55/f6c x:0 0 0 2024-02-28T16:24:06.530 INFO:tasks.workunit.client.0.smithi023.stdout:5/568: chown d1/d2a/d32/d58/d60/d82/f94 458938633 1 2024-02-28T16:24:06.530 INFO:tasks.workunit.client.0.smithi023.stdout:4/338: write d13/d1e/d39/d55/f6c [314105,38241] 0 2024-02-28T16:24:06.534 INFO:tasks.workunit.client.0.smithi023.stdout:0/354: creat d6/db/d3d/f70 x:0 0 0 2024-02-28T16:24:06.534 INFO:tasks.workunit.client.0.smithi023.stdout:2/447: write d5/da/d45/f68 [973330,95578] 0 2024-02-28T16:24:06.535 INFO:tasks.workunit.client.0.smithi023.stdout:7/319: dwrite de/d60/f64 [0,4194304] 0 2024-02-28T16:24:06.535 INFO:tasks.workunit.client.0.smithi023.stdout:4/339: readlink d13/d1d/l3a 0 2024-02-28T16:24:06.536 INFO:tasks.workunit.client.0.smithi023.stdout:9/341: symlink d0/d7/db/d18/l6d 0 2024-02-28T16:24:06.546 INFO:tasks.workunit.client.0.smithi023.stdout:2/448: mkdir d5/da/d1b/d3f/d75/d8a 0 2024-02-28T16:24:06.547 INFO:tasks.workunit.client.0.smithi023.stdout:3/365: write d1/df/f29 [595119,58898] 0 2024-02-28T16:24:06.550 INFO:tasks.workunit.client.0.smithi023.stdout:9/342: mkdir d0/d7/db/d18/d23/d28/d6e 0 2024-02-28T16:24:06.551 INFO:tasks.workunit.client.0.smithi023.stdout:2/449: stat d5/da/d1b/d3f/f60 0 2024-02-28T16:24:06.578 INFO:tasks.workunit.client.0.smithi023.stdout:9/343: write d0/f50 [419764,80653] 0 2024-02-28T16:24:06.578 INFO:tasks.workunit.client.0.smithi023.stdout:6/452: getdents d1/d28/d1e/d52 0 2024-02-28T16:24:06.582 INFO:tasks.workunit.client.0.smithi023.stdout:5/569: dwrite d1/d2a/d32/d58/d79/f91 [0,4194304] 0 2024-02-28T16:24:06.589 INFO:tasks.workunit.client.0.smithi023.stdout:0/355: dwrite d6/db/d1a/d1b/f27 [0,4194304] 0 2024-02-28T16:24:06.591 INFO:tasks.workunit.client.0.smithi023.stdout:3/366: symlink d1/df/d2d/d45/d52/d65/l75 0 2024-02-28T16:24:06.592 INFO:tasks.workunit.client.0.smithi023.stdout:2/450: mkdir d5/da/d45/d81/d8b 0 2024-02-28T16:24:06.596 INFO:tasks.workunit.client.0.smithi023.stdout:8/474: dwrite d0/d5/d1a/d2d/f84 [4194304,4194304] 0 2024-02-28T16:24:06.596 INFO:tasks.workunit.client.0.smithi023.stdout:6/453: mkdir d1/d28/d1e/d52/daf 0 2024-02-28T16:24:06.598 INFO:tasks.workunit.client.0.smithi023.stdout:2/451: write d5/da/d62/f69 [119086,6652] 0 2024-02-28T16:24:06.605 INFO:tasks.workunit.client.0.smithi023.stdout:3/367: creat d1/df/d2d/d32/f76 x:0 0 0 2024-02-28T16:24:06.608 INFO:tasks.workunit.client.0.smithi023.stdout:2/452: write d5/da/d45/f50 [354911,87566] 0 2024-02-28T16:24:06.608 INFO:tasks.workunit.client.0.smithi023.stdout:7/320: dread de/ff [0,4194304] 0 2024-02-28T16:24:06.613 INFO:tasks.workunit.client.0.smithi023.stdout:7/321: readlink de/l35 0 2024-02-28T16:24:06.621 INFO:tasks.workunit.client.0.smithi023.stdout:7/322: write de/d13/d1b/f4c [674813,83582] 0 2024-02-28T16:24:06.621 INFO:tasks.workunit.client.0.smithi023.stdout:2/453: chown d5/da/d45/d6a/l6c 44 1 2024-02-28T16:24:06.624 INFO:tasks.workunit.client.0.smithi023.stdout:9/344: dread d0/d7/de/d2e/d2f/d4d/f4b [0,4194304] 0 2024-02-28T16:24:06.626 INFO:tasks.workunit.client.0.smithi023.stdout:8/475: write d0/d5/d1b/f33 [809438,33880] 0 2024-02-28T16:24:06.636 INFO:tasks.workunit.client.0.smithi023.stdout:9/345: creat d0/d7/db/d18/f6f x:0 0 0 2024-02-28T16:24:06.636 INFO:tasks.workunit.client.0.smithi023.stdout:2/454: mkdir d5/da/d8c 0 2024-02-28T16:24:06.637 INFO:tasks.workunit.client.0.smithi023.stdout:3/368: link d1/df/c18 d1/df/d2d/d45/d52/c77 0 2024-02-28T16:24:06.643 INFO:tasks.workunit.client.0.smithi023.stdout:7/323: creat de/d13/f6d x:0 0 0 2024-02-28T16:24:06.643 INFO:tasks.workunit.client.0.smithi023.stdout:7/324: readlink de/l35 0 2024-02-28T16:24:06.644 INFO:tasks.workunit.client.0.smithi023.stdout:0/356: dread d6/db/d1a/d26/d31/d33/d37/f49 [0,4194304] 0 2024-02-28T16:24:06.645 INFO:tasks.workunit.client.0.smithi023.stdout:7/325: dread - de/d1c/f5a zero size 2024-02-28T16:24:06.648 INFO:tasks.workunit.client.0.smithi023.stdout:0/357: truncate d6/f21 1156030 0 2024-02-28T16:24:06.649 INFO:tasks.workunit.client.0.smithi023.stdout:2/455: symlink d5/da/d45/d6a/l8d 0 2024-02-28T16:24:06.651 INFO:tasks.workunit.client.0.smithi023.stdout:8/476: link d0/d5/l65 d0/d5/d1a/d2d/d67/d71/d9e/la7 0 2024-02-28T16:24:06.653 INFO:tasks.workunit.client.0.smithi023.stdout:9/346: symlink d0/d7/de/d2e/d2f/d44/l70 0 2024-02-28T16:24:06.653 INFO:tasks.workunit.client.0.smithi023.stdout:2/456: read d5/da/d1b/f4b [29027,112944] 0 2024-02-28T16:24:06.654 INFO:tasks.workunit.client.0.smithi023.stdout:8/477: read - d0/d5/d1b/d36/f85 zero size 2024-02-28T16:24:06.658 INFO:tasks.workunit.client.0.smithi023.stdout:7/326: creat de/d13/d1b/d3d/d53/f6e x:0 0 0 2024-02-28T16:24:06.663 INFO:tasks.workunit.client.0.smithi023.stdout:0/358: truncate d6/db/f50 581769 0 2024-02-28T16:24:06.666 INFO:tasks.workunit.client.0.smithi023.stdout:3/369: dwrite d1/df/d2d/d45/f56 [0,4194304] 0 2024-02-28T16:24:06.671 INFO:tasks.workunit.client.0.smithi023.stdout:2/457: link d5/da/d62/f69 d5/da/db/f8e 0 2024-02-28T16:24:06.677 INFO:tasks.workunit.client.0.smithi023.stdout:0/359: rename d6/db/d1a/d26/d31/f46 to d6/db/f71 0 2024-02-28T16:24:06.677 INFO:tasks.workunit.client.0.smithi023.stdout:3/370: mkdir d1/df/d2d/d45/d78 0 2024-02-28T16:24:06.681 INFO:tasks.workunit.client.0.smithi023.stdout:0/360: truncate d6/db/d1a/d1b/f5a 517300 0 2024-02-28T16:24:06.684 INFO:tasks.workunit.client.0.smithi023.stdout:8/478: write d0/d5/d1a/d2d/f31 [10083912,83984] 0 2024-02-28T16:24:06.688 INFO:tasks.workunit.client.0.smithi023.stdout:0/361: mkdir d6/db/d1a/d2e/d72 0 2024-02-28T16:24:06.689 INFO:tasks.workunit.client.0.smithi023.stdout:9/347: dread d0/f1f [4194304,4194304] 0 2024-02-28T16:24:06.690 INFO:tasks.workunit.client.0.smithi023.stdout:7/327: getdents de/d13/d1b/d3d 0 2024-02-28T16:24:06.690 INFO:tasks.workunit.client.0.smithi023.stdout:9/348: fsync d0/f50 0 2024-02-28T16:24:06.692 INFO:tasks.workunit.client.0.smithi023.stdout:8/479: symlink d0/d5/d1b/la8 0 2024-02-28T16:24:06.694 INFO:tasks.workunit.client.0.smithi023.stdout:2/458: dread d5/da/db/d17/f3a [0,4194304] 0 2024-02-28T16:24:06.695 INFO:tasks.workunit.client.0.smithi023.stdout:9/349: write d0/d7/db/f24 [2216060,53573] 0 2024-02-28T16:24:06.696 INFO:tasks.workunit.client.0.smithi023.stdout:0/362: rename d6/db/d1a/d1b/c6d to d6/db/d1a/d2e/c73 0 2024-02-28T16:24:06.698 INFO:tasks.workunit.client.0.smithi023.stdout:7/328: mkdir de/d13/d1b/d3d/d53/d6f 0 2024-02-28T16:24:06.700 INFO:tasks.workunit.client.0.smithi023.stdout:2/459: fdatasync d5/da/d1b/f4b 0 2024-02-28T16:24:06.700 INFO:tasks.workunit.client.0.smithi023.stdout:8/480: truncate d0/d5/d1a/d2d/d30/d39/d3d/f68 4732813 0 2024-02-28T16:24:06.702 INFO:tasks.workunit.client.0.smithi023.stdout:9/350: mkdir d0/d7/db/d18/d71 0 2024-02-28T16:24:06.704 INFO:tasks.workunit.client.0.smithi023.stdout:2/460: truncate d5/da/db/d17/f57 697050 0 2024-02-28T16:24:06.705 INFO:tasks.workunit.client.0.smithi023.stdout:9/351: truncate d0/d7/d2c/d57/f65 284302 0 2024-02-28T16:24:06.709 INFO:tasks.workunit.client.0.smithi023.stdout:0/363: symlink d6/db/d68/l74 0 2024-02-28T16:24:06.711 INFO:tasks.workunit.client.0.smithi023.stdout:3/371: write d1/f2b [961635,29759] 0 2024-02-28T16:24:06.711 INFO:tasks.workunit.client.0.smithi023.stdout:7/329: symlink de/d13/l70 0 2024-02-28T16:24:06.713 INFO:tasks.workunit.client.0.smithi023.stdout:7/330: dread - de/f43 zero size 2024-02-28T16:24:06.722 INFO:tasks.workunit.client.0.smithi023.stdout:9/352: truncate d0/f4 2272649 0 2024-02-28T16:24:06.723 INFO:tasks.workunit.client.0.smithi023.stdout:8/481: dwrite d0/d5/d1b/f4d [4194304,4194304] 0 2024-02-28T16:24:06.725 INFO:tasks.workunit.client.0.smithi023.stdout:7/331: creat de/d13/d1b/d6c/f71 x:0 0 0 2024-02-28T16:24:06.726 INFO:tasks.workunit.client.0.smithi023.stdout:3/372: creat d1/df/d2d/d45/d78/f79 x:0 0 0 2024-02-28T16:24:06.727 INFO:tasks.workunit.client.0.smithi023.stdout:7/332: chown de/d60/f59 209 1 2024-02-28T16:24:06.728 INFO:tasks.workunit.client.0.smithi023.stdout:9/353: creat d0/d7/db/d18/d23/d28/d6e/f72 x:0 0 0 2024-02-28T16:24:06.730 INFO:tasks.workunit.client.0.smithi023.stdout:3/373: mknod d1/df/d2d/d32/d3f/c7a 0 2024-02-28T16:24:06.730 INFO:tasks.workunit.client.0.smithi023.stdout:7/333: write f4 [7250314,96038] 0 2024-02-28T16:24:06.730 INFO:tasks.workunit.client.0.smithi023.stdout:9/354: chown d0/d7/l5c 576 1 2024-02-28T16:24:06.737 INFO:tasks.workunit.client.0.smithi023.stdout:3/374: symlink d1/d4a/l7b 0 2024-02-28T16:24:06.741 INFO:tasks.workunit.client.0.smithi023.stdout:0/364: truncate d6/db/d3d/f64 413470 0 2024-02-28T16:24:06.744 INFO:tasks.workunit.client.0.smithi023.stdout:0/365: write d6/db/d1a/d1b/f5a [893679,40901] 0 2024-02-28T16:24:06.745 INFO:tasks.workunit.client.0.smithi023.stdout:8/482: dwrite d0/d5/d1a/f8b [0,4194304] 0 2024-02-28T16:24:06.748 INFO:tasks.workunit.client.0.smithi023.stdout:1/414: sync 2024-02-28T16:24:06.750 INFO:tasks.workunit.client.0.smithi023.stdout:0/366: unlink d6/db/d3b/c29 0 2024-02-28T16:24:06.753 INFO:tasks.workunit.client.0.smithi023.stdout:3/375: creat d1/df/d33/d38/d4c/f7c x:0 0 0 2024-02-28T16:24:06.759 INFO:tasks.workunit.client.0.smithi023.stdout:9/355: link d0/d7/db/c29 d0/d7/d2c/c73 0 2024-02-28T16:24:06.761 INFO:tasks.workunit.client.0.smithi023.stdout:8/483: creat d0/d5/d1a/d2d/d67/d71/d9e/fa9 x:0 0 0 2024-02-28T16:24:06.764 INFO:tasks.workunit.client.0.smithi023.stdout:0/367: symlink d6/db/d1a/d1b/l75 0 2024-02-28T16:24:06.764 INFO:tasks.workunit.client.0.smithi023.stdout:8/484: readlink d0/l23 0 2024-02-28T16:24:06.768 INFO:tasks.workunit.client.0.smithi023.stdout:3/376: unlink d1/df/d2d/d45/c24 0 2024-02-28T16:24:06.769 INFO:tasks.workunit.client.0.smithi023.stdout:9/356: stat d0/d7/de/d2e/d2f/d4d/f4b 0 2024-02-28T16:24:06.776 INFO:tasks.workunit.client.0.smithi023.stdout:7/334: dwrite de/d13/d1b/d3d/d53/f6e [0,4194304] 0 2024-02-28T16:24:06.777 INFO:tasks.workunit.client.0.smithi023.stdout:0/368: creat d6/db/d5d/f76 x:0 0 0 2024-02-28T16:24:06.779 INFO:tasks.workunit.client.0.smithi023.stdout:8/485: mknod d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/d6e/caa 0 2024-02-28T16:24:06.781 INFO:tasks.workunit.client.0.smithi023.stdout:9/357: chown d0/d7/db/d18/d23/d28/d32/c47 4 1 2024-02-28T16:24:06.782 INFO:tasks.workunit.client.0.smithi023.stdout:7/335: dread - de/d13/d1b/d6c/f71 zero size 2024-02-28T16:24:06.782 INFO:tasks.workunit.client.0.smithi023.stdout:1/415: dread df/d11/d13/d1b/d2e/d5c/f8f [0,4194304] 0 2024-02-28T16:24:06.785 INFO:tasks.workunit.client.0.smithi023.stdout:9/358: read d0/d7/ff [3514864,65984] 0 2024-02-28T16:24:06.786 INFO:tasks.workunit.client.0.smithi023.stdout:3/377: symlink d1/df/d3d/l7d 0 2024-02-28T16:24:06.786 INFO:tasks.workunit.client.0.smithi023.stdout:1/416: chown l6 71180 1 2024-02-28T16:24:06.793 INFO:tasks.workunit.client.0.smithi023.stdout:7/336: chown de/d1c/l21 448587 1 2024-02-28T16:24:06.793 INFO:tasks.workunit.client.0.smithi023.stdout:3/378: readlink d1/d74/d46/l4d 0 2024-02-28T16:24:06.798 INFO:tasks.workunit.client.0.smithi023.stdout:8/486: truncate d0/d5/d1a/d44/f76 690199 0 2024-02-28T16:24:06.798 INFO:tasks.workunit.client.0.smithi023.stdout:9/359: creat d0/d7/db/d18/d23/d28/f74 x:0 0 0 2024-02-28T16:24:06.804 INFO:tasks.workunit.client.0.smithi023.stdout:3/379: creat d1/df/d33/d38/d4c/f7e x:0 0 0 2024-02-28T16:24:06.811 INFO:tasks.workunit.client.0.smithi023.stdout:7/337: rmdir de/d62 0 2024-02-28T16:24:06.812 INFO:tasks.workunit.client.0.smithi023.stdout:8/487: rename d0/d5/d1a/d2d/f31 to d0/d5/d1a/d2d/d30/fab 0 2024-02-28T16:24:06.813 INFO:tasks.workunit.client.0.smithi023.stdout:3/380: creat d1/df/d2d/d32/d3f/f7f x:0 0 0 2024-02-28T16:24:06.819 INFO:tasks.workunit.client.0.smithi023.stdout:1/417: write df/d11/d13/d1b/d30/d57/d5a/d68/f89 [1354952,39760] 0 2024-02-28T16:24:06.823 INFO:tasks.workunit.client.0.smithi023.stdout:9/360: dwrite d0/d7/d2c/f55 [0,4194304] 0 2024-02-28T16:24:06.826 INFO:tasks.workunit.client.0.smithi023.stdout:0/369: dwrite d6/db/d1a/d26/f4d [0,4194304] 0 2024-02-28T16:24:06.827 INFO:tasks.workunit.client.0.smithi023.stdout:3/381: rmdir d1/df/d2d/d32 39 2024-02-28T16:24:06.830 INFO:tasks.workunit.client.0.smithi023.stdout:0/370: write d6/db/d3b/d1f/f4b [2874546,2129] 0 2024-02-28T16:24:06.832 INFO:tasks.workunit.client.0.smithi023.stdout:3/382: write d1/df/d2d/d45/f56 [2721159,37391] 0 2024-02-28T16:24:06.833 INFO:tasks.workunit.client.0.smithi023.stdout:1/418: mkdir df/d11/d13/d99 0 2024-02-28T16:24:06.836 INFO:tasks.workunit.client.0.smithi023.stdout:7/338: dwrite de/d60/f59 [0,4194304] 0 2024-02-28T16:24:06.843 INFO:tasks.workunit.client.0.smithi023.stdout:3/383: truncate d1/df/d2d/d45/d78/f79 981835 0 2024-02-28T16:24:06.852 INFO:tasks.workunit.client.0.smithi023.stdout:0/371: creat d6/db/d24/f77 x:0 0 0 2024-02-28T16:24:06.852 INFO:tasks.workunit.client.0.smithi023.stdout:3/384: mknod d1/d4a/c80 0 2024-02-28T16:24:06.853 INFO:tasks.workunit.client.0.smithi023.stdout:9/361: creat d0/d7/db/f75 x:0 0 0 2024-02-28T16:24:06.859 INFO:tasks.workunit.client.0.smithi023.stdout:6/454: sync 2024-02-28T16:24:06.859 INFO:tasks.workunit.client.0.smithi023.stdout:4/340: sync 2024-02-28T16:24:06.859 INFO:tasks.workunit.client.0.smithi023.stdout:5/570: sync 2024-02-28T16:24:06.864 INFO:tasks.workunit.client.0.smithi023.stdout:0/372: mknod d6/db/d1a/d2e/c78 0 2024-02-28T16:24:06.865 INFO:tasks.workunit.client.0.smithi023.stdout:3/385: write d1/df/d33/d38/f48 [1433607,98100] 0 2024-02-28T16:24:06.874 INFO:tasks.workunit.client.0.smithi023.stdout:7/339: getdents de/d1c 0 2024-02-28T16:24:06.875 INFO:tasks.workunit.client.0.smithi023.stdout:6/455: fdatasync d1/d18/d26/d3a/f3f 0 2024-02-28T16:24:06.876 INFO:tasks.workunit.client.0.smithi023.stdout:3/386: fdatasync d1/df/d2d/f31 0 2024-02-28T16:24:06.877 INFO:tasks.workunit.client.0.smithi023.stdout:0/373: dread - d6/db/d5d/f76 zero size 2024-02-28T16:24:06.877 INFO:tasks.workunit.client.0.smithi023.stdout:8/488: dwrite d0/d5/f7e [0,4194304] 0 2024-02-28T16:24:06.885 INFO:tasks.workunit.client.0.smithi023.stdout:2/461: sync 2024-02-28T16:24:06.888 INFO:tasks.workunit.client.0.smithi023.stdout:3/387: creat d1/df/d33/f81 x:0 0 0 2024-02-28T16:24:06.891 INFO:tasks.workunit.client.0.smithi023.stdout:1/419: dwrite df/d26/d48/f4c [4194304,4194304] 0 2024-02-28T16:24:06.891 INFO:tasks.workunit.client.0.smithi023.stdout:7/340: mkdir de/d72 0 2024-02-28T16:24:06.895 INFO:tasks.workunit.client.0.smithi023.stdout:6/456: dread - d1/d18/d26/d3a/f4a zero size 2024-02-28T16:24:06.902 INFO:tasks.workunit.client.0.smithi023.stdout:7/341: truncate de/d13/f4d 1485658 0 2024-02-28T16:24:06.904 INFO:tasks.workunit.client.0.smithi023.stdout:5/571: link d1/d2a/d32/d58/d73/c7a d1/d2a/cb1 0 2024-02-28T16:24:06.911 INFO:tasks.workunit.client.0.smithi023.stdout:5/572: dread - d1/d2a/d32/d36/f74 zero size 2024-02-28T16:24:06.911 INFO:tasks.workunit.client.0.smithi023.stdout:6/457: chown d1/d18/f30 2777637 1 2024-02-28T16:24:06.911 INFO:tasks.workunit.client.0.smithi023.stdout:9/362: dwrite d0/d7/de/d2a/f38 [0,4194304] 0 2024-02-28T16:24:06.915 INFO:tasks.workunit.client.0.smithi023.stdout:3/388: creat d1/df/d33/d38/d4c/f82 x:0 0 0 2024-02-28T16:24:06.918 INFO:tasks.workunit.client.0.smithi023.stdout:1/420: write df/d11/d13/d1b/d30/f69 [798466,31102] 0 2024-02-28T16:24:06.919 INFO:tasks.workunit.client.0.smithi023.stdout:4/341: dread d13/f1b [0,4194304] 0 2024-02-28T16:24:06.928 INFO:tasks.workunit.client.0.smithi023.stdout:7/342: write de/d60/f5e [71466,120790] 0 2024-02-28T16:24:06.928 INFO:tasks.workunit.client.0.smithi023.stdout:3/389: truncate d1/df/d3d/f62 4892018 0 2024-02-28T16:24:06.929 INFO:tasks.workunit.client.0.smithi023.stdout:5/573: write d1/d2a/d32/d58/d73/f84 [775548,93419] 0 2024-02-28T16:24:06.931 INFO:tasks.workunit.client.0.smithi023.stdout:0/374: dwrite d6/db/d1a/d26/f52 [0,4194304] 0 2024-02-28T16:24:06.939 INFO:tasks.workunit.client.0.smithi023.stdout:1/421: chown df/d26/d48/d80/l91 118434524 1 2024-02-28T16:24:06.940 INFO:tasks.workunit.client.0.smithi023.stdout:4/342: getdents d13/d2b 0 2024-02-28T16:24:06.948 INFO:tasks.workunit.client.0.smithi023.stdout:6/458: dread d1/d3d/f55 [0,4194304] 0 2024-02-28T16:24:06.948 INFO:tasks.workunit.client.0.smithi023.stdout:5/574: creat d1/d2a/d32/d58/fb2 x:0 0 0 2024-02-28T16:24:06.948 INFO:tasks.workunit.client.0.smithi023.stdout:3/390: mknod d1/df/d2d/d45/d78/c83 0 2024-02-28T16:24:06.954 INFO:tasks.workunit.client.0.smithi023.stdout:0/375: mkdir d6/db/d1a/d2e/d72/d79 0 2024-02-28T16:24:06.955 INFO:tasks.workunit.client.0.smithi023.stdout:4/343: rename d13/d1d/f69 to d13/d1d/f6d 0 2024-02-28T16:24:06.959 INFO:tasks.workunit.client.0.smithi023.stdout:7/343: rmdir de/d13/d1b/d3d/d53/d6f 0 2024-02-28T16:24:06.962 INFO:tasks.workunit.client.0.smithi023.stdout:7/344: stat cb 0 2024-02-28T16:24:06.963 INFO:tasks.workunit.client.0.smithi023.stdout:6/459: readlink d1/d18/d26/d3a/l3b 0 2024-02-28T16:24:06.963 INFO:tasks.workunit.client.0.smithi023.stdout:9/363: dwrite d0/d7/de/f14 [0,4194304] 0 2024-02-28T16:24:06.965 INFO:tasks.workunit.client.0.smithi023.stdout:6/460: stat d1/d28/d1e/d2b/d76 0 2024-02-28T16:24:06.970 INFO:tasks.workunit.client.0.smithi023.stdout:5/575: symlink d1/d2a/d32/d37/d3a/d7f/d62/lb3 0 2024-02-28T16:24:06.973 INFO:tasks.workunit.client.0.smithi023.stdout:6/461: symlink d1/d28/d1e/d2b/d44/da4/lb0 0 2024-02-28T16:24:06.975 INFO:tasks.workunit.client.0.smithi023.stdout:3/391: creat d1/df/d2d/f84 x:0 0 0 2024-02-28T16:24:06.977 INFO:tasks.workunit.client.0.smithi023.stdout:5/576: write d1/d2a/d32/d37/d3a/d7f/d62/fa9 [672024,98770] 0 2024-02-28T16:24:06.987 INFO:tasks.workunit.client.0.smithi023.stdout:7/345: dwrite de/d60/f59 [0,4194304] 0 2024-02-28T16:24:06.987 INFO:tasks.workunit.client.0.smithi023.stdout:4/344: dwrite d13/d2b/d2c/f30 [0,4194304] 0 2024-02-28T16:24:06.991 INFO:tasks.workunit.client.0.smithi023.stdout:5/577: rmdir d1/d2a/d32/d58/d60/d82 39 2024-02-28T16:24:06.997 INFO:tasks.workunit.client.0.smithi023.stdout:3/392: rmdir d1/df/d33/d38/d4c/d59 39 2024-02-28T16:24:06.999 INFO:tasks.workunit.client.0.smithi023.stdout:5/578: truncate d1/d2a/d32/d58/d60/d88/d89/f97 699915 0 2024-02-28T16:24:06.999 INFO:tasks.workunit.client.0.smithi023.stdout:3/393: chown d1/df/d33/l58 3044265 1 2024-02-28T16:24:07.002 INFO:tasks.workunit.client.0.smithi023.stdout:7/346: creat de/d13/d1b/d3d/d53/f73 x:0 0 0 2024-02-28T16:24:07.006 INFO:tasks.workunit.client.0.smithi023.stdout:4/345: mkdir d13/d2b/d2c/d31/d6e 0 2024-02-28T16:24:07.006 INFO:tasks.workunit.client.0.smithi023.stdout:7/347: read de/d13/f4d [886959,30625] 0 2024-02-28T16:24:07.006 INFO:tasks.workunit.client.0.smithi023.stdout:4/346: chown d13/d2b 1 1 2024-02-28T16:24:07.009 INFO:tasks.workunit.client.0.smithi023.stdout:0/376: link d6/db/d1a/c65 d6/c7a 0 2024-02-28T16:24:07.011 INFO:tasks.workunit.client.0.smithi023.stdout:3/394: mkdir d1/df/d3d/d85 0 2024-02-28T16:24:07.011 INFO:tasks.workunit.client.0.smithi023.stdout:0/377: dread - d6/db/d3d/f70 zero size 2024-02-28T16:24:07.017 INFO:tasks.workunit.client.0.smithi023.stdout:7/348: unlink de/d13/f1f 0 2024-02-28T16:24:07.021 INFO:tasks.workunit.client.0.smithi023.stdout:3/395: creat d1/df/d2d/d45/f86 x:0 0 0 2024-02-28T16:24:07.025 INFO:tasks.workunit.client.0.smithi023.stdout:0/378: symlink d6/db/d1a/d26/d31/l7b 0 2024-02-28T16:24:07.027 INFO:tasks.workunit.client.0.smithi023.stdout:6/462: truncate d1/f69 364219 0 2024-02-28T16:24:07.028 INFO:tasks.workunit.client.0.smithi023.stdout:0/379: truncate d6/db/d1a/d2e/f2f 1024947 0 2024-02-28T16:24:07.029 INFO:tasks.workunit.client.0.smithi023.stdout:0/380: chown d6/db/d68 0 1 2024-02-28T16:24:07.031 INFO:tasks.workunit.client.0.smithi023.stdout:7/349: creat de/d13/d1b/d40/f74 x:0 0 0 2024-02-28T16:24:07.037 INFO:tasks.workunit.client.0.smithi023.stdout:3/396: unlink d1/d74/d46/f5e 0 2024-02-28T16:24:07.038 INFO:tasks.workunit.client.0.smithi023.stdout:3/397: readlink d1/df/d3d/l7d 0 2024-02-28T16:24:07.040 INFO:tasks.workunit.client.0.smithi023.stdout:3/398: chown d1/df/d2d/d45/f14 80483 1 2024-02-28T16:24:07.042 INFO:tasks.workunit.client.0.smithi023.stdout:7/350: creat de/d13/d1b/d6c/f75 x:0 0 0 2024-02-28T16:24:07.045 INFO:tasks.workunit.client.0.smithi023.stdout:4/347: rmdir d13/d1d/d63 0 2024-02-28T16:24:07.047 INFO:tasks.workunit.client.0.smithi023.stdout:4/348: truncate d13/d2b/f5d 1708140 0 2024-02-28T16:24:07.051 INFO:tasks.workunit.client.0.smithi023.stdout:8/489: sync 2024-02-28T16:24:07.055 INFO:tasks.workunit.client.0.smithi023.stdout:8/490: write d0/d5/d1a/d2d/d30/d39/d3d/d3e/d69/f95 [863121,104610] 0 2024-02-28T16:24:07.058 INFO:tasks.workunit.client.0.smithi023.stdout:7/351: mkdir de/d1c/d76 0 2024-02-28T16:24:07.059 INFO:tasks.workunit.client.0.smithi023.stdout:5/579: truncate d1/d2a/d32/d37/d3a/f7e 2063991 0 2024-02-28T16:24:07.059 INFO:tasks.workunit.client.0.smithi023.stdout:3/399: dwrite d1/df/d33/d38/d4c/f82 [0,4194304] 0 2024-02-28T16:24:07.071 INFO:tasks.workunit.client.0.smithi023.stdout:5/580: mknod d1/d2a/d32/d58/d79/cb4 0 2024-02-28T16:24:07.075 INFO:tasks.workunit.client.0.smithi023.stdout:5/581: truncate d1/d2a/d32/d58/d73/fa8 149412 0 2024-02-28T16:24:07.079 INFO:tasks.workunit.client.0.smithi023.stdout:0/381: fsync d6/f21 0 2024-02-28T16:24:07.115 INFO:tasks.workunit.client.0.smithi023.stdout:3/400: read d1/df/d33/d38/d4c/f55 [3331600,77887] 0 2024-02-28T16:24:07.115 INFO:tasks.workunit.client.0.smithi023.stdout:6/463: truncate d1/d28/d1e/d2b/d76/f88 1994331 0 2024-02-28T16:24:07.115 INFO:tasks.workunit.client.0.smithi023.stdout:0/382: read - d6/db/d24/f77 zero size 2024-02-28T16:24:07.120 INFO:tasks.workunit.client.0.smithi023.stdout:6/464: creat d1/d28/d1e/d52/daf/fb1 x:0 0 0 2024-02-28T16:24:07.121 INFO:tasks.workunit.client.0.smithi023.stdout:3/401: write d1/df/f3e [4951747,101882] 0 2024-02-28T16:24:07.121 INFO:tasks.workunit.client.0.smithi023.stdout:0/383: mknod d6/c7c 0 2024-02-28T16:24:07.175 INFO:tasks.workunit.client.0.smithi023.stdout:2/462: sync 2024-02-28T16:24:07.176 INFO:tasks.workunit.client.0.smithi023.stdout:1/422: sync 2024-02-28T16:24:07.180 INFO:tasks.workunit.client.0.smithi023.stdout:0/384: chown d6 0 1 2024-02-28T16:24:07.186 INFO:tasks.workunit.client.0.smithi023.stdout:4/349: dwrite fe [0,4194304] 0 2024-02-28T16:24:07.190 INFO:tasks.workunit.client.0.smithi023.stdout:6/465: creat d1/d18/d26/da6/da9/fb2 x:0 0 0 2024-02-28T16:24:07.190 INFO:tasks.workunit.client.0.smithi023.stdout:3/402: chown d1/df/d3d/d57/f71 34 1 2024-02-28T16:24:07.191 INFO:tasks.workunit.client.0.smithi023.stdout:0/385: write d6/db/d1a/d2e/f2f [754876,74685] 0 2024-02-28T16:24:07.192 INFO:tasks.workunit.client.0.smithi023.stdout:1/423: mknod df/d11/d13/d1b/d2e/d5c/c9a 0 2024-02-28T16:24:07.194 INFO:tasks.workunit.client.0.smithi023.stdout:2/463: getdents d5/da/d1b/d3f/d75/d8a 0 2024-02-28T16:24:07.195 INFO:tasks.workunit.client.0.smithi023.stdout:5/582: dwrite d1/d2a/d32/d37/d3a/d7f/f24 [0,4194304] 0 2024-02-28T16:24:07.201 INFO:tasks.workunit.client.0.smithi023.stdout:2/464: symlink d5/da/d45/l8f 0 2024-02-28T16:24:07.204 INFO:tasks.workunit.client.0.smithi023.stdout:6/466: rename d1/d28/c5a to d1/d28/d1e/d2b/d44/d86/cb3 0 2024-02-28T16:24:07.208 INFO:tasks.workunit.client.0.smithi023.stdout:5/583: chown d1/d2a/d32/d37/d3a/d7f/c1f 1398 1 2024-02-28T16:24:07.220 INFO:tasks.workunit.client.0.smithi023.stdout:2/465: dread d5/da/d45/f68 [0,4194304] 0 2024-02-28T16:24:07.220 INFO:tasks.workunit.client.0.smithi023.stdout:5/584: mkdir d1/d2a/d32/d37/d4e/db5 0 2024-02-28T16:24:07.223 INFO:tasks.workunit.client.0.smithi023.stdout:2/466: creat d5/da/d62/f90 x:0 0 0 2024-02-28T16:24:07.225 INFO:tasks.workunit.client.0.smithi023.stdout:5/585: creat d1/d2a/d32/d58/d60/d81/fb6 x:0 0 0 2024-02-28T16:24:07.227 INFO:tasks.workunit.client.0.smithi023.stdout:6/467: rmdir d1/d28/d1e/d2b/d44/d86 39 2024-02-28T16:24:07.228 INFO:tasks.workunit.client.0.smithi023.stdout:5/586: readlink d1/d2a/l35 0 2024-02-28T16:24:07.229 INFO:tasks.workunit.client.0.smithi023.stdout:1/424: truncate df/d26/f35 1638728 0 2024-02-28T16:24:07.234 INFO:tasks.workunit.client.0.smithi023.stdout:2/467: symlink d5/da/d45/d81/d8b/l91 0 2024-02-28T16:24:07.234 INFO:tasks.workunit.client.0.smithi023.stdout:1/425: stat df/d26/d48/d80 0 2024-02-28T16:24:07.235 INFO:tasks.workunit.client.0.smithi023.stdout:6/468: creat d1/d28/d1e/dae/fb4 x:0 0 0 2024-02-28T16:24:07.238 INFO:tasks.workunit.client.0.smithi023.stdout:5/587: read d1/d2a/d32/d37/d3a/f6a [781050,88599] 0 2024-02-28T16:24:07.238 INFO:tasks.workunit.client.0.smithi023.stdout:4/350: dwrite d13/d1d/f41 [0,4194304] 0 2024-02-28T16:24:07.243 INFO:tasks.workunit.client.0.smithi023.stdout:3/403: dwrite d1/df/d33/d38/f6a [0,4194304] 0 2024-02-28T16:24:07.245 INFO:tasks.workunit.client.0.smithi023.stdout:1/426: unlink df/d11/d13/d27/f65 0 2024-02-28T16:24:07.249 INFO:tasks.workunit.client.0.smithi023.stdout:2/468: mkdir d5/da/d1b/d3f/d75/d92 0 2024-02-28T16:24:07.252 INFO:tasks.workunit.client.0.smithi023.stdout:4/351: mknod d13/d1d/d2d/c6f 0 2024-02-28T16:24:07.255 INFO:tasks.workunit.client.0.smithi023.stdout:4/352: truncate d13/d2b/f5a 460878 0 2024-02-28T16:24:07.257 INFO:tasks.workunit.client.0.smithi023.stdout:6/469: creat d1/d28/d1e/d2b/d6d/d7b/fb5 x:0 0 0 2024-02-28T16:24:07.260 INFO:tasks.workunit.client.0.smithi023.stdout:5/588: symlink d1/d2a/d32/d37/d4e/db5/lb7 0 2024-02-28T16:24:07.261 INFO:tasks.workunit.client.0.smithi023.stdout:2/469: mkdir d5/da/d45/d81/d8b/d93 0 2024-02-28T16:24:07.264 INFO:tasks.workunit.client.0.smithi023.stdout:1/427: mknod df/d26/d48/c9b 0 2024-02-28T16:24:07.269 INFO:tasks.workunit.client.0.smithi023.stdout:3/404: rmdir d1/df/d3d/d85 0 2024-02-28T16:24:07.269 INFO:tasks.workunit.client.0.smithi023.stdout:4/353: rename d13/d2b/d2c/l56 to d13/d1e/l70 0 2024-02-28T16:24:07.269 INFO:tasks.workunit.client.0.smithi023.stdout:2/470: mknod d5/da/db/d17/d3c/c94 0 2024-02-28T16:24:07.272 INFO:tasks.workunit.client.0.smithi023.stdout:4/354: dread - d13/d1e/d39/f45 zero size 2024-02-28T16:24:07.274 INFO:tasks.workunit.client.0.smithi023.stdout:1/428: getdents df/d11/d13/d1b/d30/d57/d5a/d68/d7a 0 2024-02-28T16:24:07.275 INFO:tasks.workunit.client.0.smithi023.stdout:2/471: write d5/dc/f21 [1426226,97131] 0 2024-02-28T16:24:07.275 INFO:tasks.workunit.client.0.smithi023.stdout:5/589: link d1/d2a/d32/d37/d3a/d7f/d62/l95 d1/d2a/lb8 0 2024-02-28T16:24:07.279 INFO:tasks.workunit.client.0.smithi023.stdout:4/355: mknod d13/d2b/c71 0 2024-02-28T16:24:07.281 INFO:tasks.workunit.client.0.smithi023.stdout:5/590: readlink d1/d2a/d32/d58/d73/l61 0 2024-02-28T16:24:07.285 INFO:tasks.workunit.client.0.smithi023.stdout:1/429: read df/d11/d13/d1b/d2e/f87 [2407031,92960] 0 2024-02-28T16:24:07.288 INFO:tasks.workunit.client.0.smithi023.stdout:2/472: truncate d5/dc/f24 1063084 0 2024-02-28T16:24:07.291 INFO:tasks.workunit.client.0.smithi023.stdout:6/470: dread d1/d3d/fab [0,4194304] 0 2024-02-28T16:24:07.293 INFO:tasks.workunit.client.0.smithi023.stdout:9/364: sync 2024-02-28T16:24:07.294 INFO:tasks.workunit.client.0.smithi023.stdout:2/473: unlink d5/da/db/d17/l47 0 2024-02-28T16:24:07.294 INFO:tasks.workunit.client.0.smithi023.stdout:3/405: dwrite d1/df/d2d/d45/f14 [0,4194304] 0 2024-02-28T16:24:07.304 INFO:tasks.workunit.client.0.smithi023.stdout:6/471: symlink d1/lb6 0 2024-02-28T16:24:07.307 INFO:tasks.workunit.client.0.smithi023.stdout:9/365: chown d0/c3 429726 1 2024-02-28T16:24:07.311 INFO:tasks.workunit.client.0.smithi023.stdout:0/386: sync 2024-02-28T16:24:07.314 INFO:tasks.workunit.client.0.smithi023.stdout:3/406: creat d1/df/d33/d38/d6c/f87 x:0 0 0 2024-02-28T16:24:07.314 INFO:tasks.workunit.client.0.smithi023.stdout:7/352: sync 2024-02-28T16:24:07.314 INFO:tasks.workunit.client.0.smithi023.stdout:8/491: sync 2024-02-28T16:24:07.317 INFO:tasks.workunit.client.0.smithi023.stdout:9/366: write d0/d7/db/d18/d23/d28/d6e/f72 [80819,75246] 0 2024-02-28T16:24:07.323 INFO:tasks.workunit.client.0.smithi023.stdout:0/387: rmdir d6/db/d3b/d1f 39 2024-02-28T16:24:07.325 INFO:tasks.workunit.client.0.smithi023.stdout:3/407: read - d1/df/d33/d38/d4c/f50 zero size 2024-02-28T16:24:07.330 INFO:tasks.workunit.client.0.smithi023.stdout:8/492: read d0/d5/d1a/d2d/d30/fab [2821979,19010] 0 2024-02-28T16:24:07.330 INFO:tasks.workunit.client.0.smithi023.stdout:5/591: dread d1/f2b [0,4194304] 0 2024-02-28T16:24:07.331 INFO:tasks.workunit.client.0.smithi023.stdout:2/474: dwrite d5/da/db/d17/d3c/f3d [4194304,4194304] 0 2024-02-28T16:24:07.335 INFO:tasks.workunit.client.0.smithi023.stdout:9/367: rename d0/d7/db/f5e to d0/d7/d2c/d57/f76 0 2024-02-28T16:24:07.335 INFO:tasks.workunit.client.0.smithi023.stdout:1/430: truncate df/d11/f12 2950307 0 2024-02-28T16:24:07.339 INFO:tasks.workunit.client.0.smithi023.stdout:9/368: chown d0/d7/de 0 1 2024-02-28T16:24:07.339 INFO:tasks.workunit.client.0.smithi023.stdout:4/356: dread d13/d1d/d58/f5c [0,4194304] 0 2024-02-28T16:24:07.343 INFO:tasks.workunit.client.0.smithi023.stdout:4/357: chown d13/d1d/c24 1902144 1 2024-02-28T16:24:07.343 INFO:tasks.workunit.client.0.smithi023.stdout:1/431: chown df/d11/d13/d1b/d30/d57/d78 412116 1 2024-02-28T16:24:07.346 INFO:tasks.workunit.client.0.smithi023.stdout:3/408: symlink d1/df/d2d/d45/d52/d65/l88 0 2024-02-28T16:24:07.346 INFO:tasks.workunit.client.0.smithi023.stdout:6/472: dwrite d1/d28/f70 [0,4194304] 0 2024-02-28T16:24:07.347 INFO:tasks.workunit.client.0.smithi023.stdout:0/388: mknod d6/db/d3b/d1f/d42/c7d 0 2024-02-28T16:24:07.349 INFO:tasks.workunit.client.0.smithi023.stdout:6/473: chown d1/d18/d26/d6a 6 1 2024-02-28T16:24:07.351 INFO:tasks.workunit.client.0.smithi023.stdout:4/358: stat d13/c21 0 2024-02-28T16:24:07.351 INFO:tasks.workunit.client.0.smithi023.stdout:5/592: mkdir d1/d2a/d32/d58/d60/d88/db9 0 2024-02-28T16:24:07.357 INFO:tasks.workunit.client.0.smithi023.stdout:8/493: getdents d0/d5/d1b/d8d 0 2024-02-28T16:24:07.357 INFO:tasks.workunit.client.0.smithi023.stdout:0/389: mknod d6/db/c7e 0 2024-02-28T16:24:07.359 INFO:tasks.workunit.client.0.smithi023.stdout:6/474: rename d1/d28/c20 to d1/d18/d26/cb7 0 2024-02-28T16:24:07.359 INFO:tasks.workunit.client.0.smithi023.stdout:4/359: read d13/d1d/d2d/f47 [3595752,12413] 0 2024-02-28T16:24:07.360 INFO:tasks.workunit.client.0.smithi023.stdout:3/409: mkdir d1/df/d2d/d45/d52/d65/d89 0 2024-02-28T16:24:07.362 INFO:tasks.workunit.client.0.smithi023.stdout:0/390: chown d6/db/d1a/d26/d66 39306 1 2024-02-28T16:24:07.362 INFO:tasks.workunit.client.0.smithi023.stdout:5/593: mknod d1/d2a/d32/d58/cba 0 2024-02-28T16:24:07.365 INFO:tasks.workunit.client.0.smithi023.stdout:4/360: truncate d13/d1d/f20 4946976 0 2024-02-28T16:24:07.367 INFO:tasks.workunit.client.0.smithi023.stdout:1/432: symlink df/d11/d13/d1b/d30/d57/d5a/d68/d7a/l9c 0 2024-02-28T16:24:07.368 INFO:tasks.workunit.client.0.smithi023.stdout:1/433: dread - df/d11/f90 zero size 2024-02-28T16:24:07.372 INFO:tasks.workunit.client.0.smithi023.stdout:7/353: truncate de/d60/f37 3596683 0 2024-02-28T16:24:07.373 INFO:tasks.workunit.client.0.smithi023.stdout:1/434: read df/d11/d13/d1b/f86 [481701,87825] 0 2024-02-28T16:24:07.375 INFO:tasks.workunit.client.0.smithi023.stdout:3/410: mkdir d1/d74/d46/d8a 0 2024-02-28T16:24:07.375 INFO:tasks.workunit.client.0.smithi023.stdout:3/411: stat d1/d4a 0 2024-02-28T16:24:07.389 INFO:tasks.workunit.client.0.smithi023.stdout:2/475: dwrite d5/dc/f24 [0,4194304] 0 2024-02-28T16:24:07.397 INFO:tasks.workunit.client.0.smithi023.stdout:5/594: mknod d1/d2a/d32/d58/d60/d88/cbb 0 2024-02-28T16:24:07.402 INFO:tasks.workunit.client.0.smithi023.stdout:8/494: dread d0/d5/d35/f5f [0,4194304] 0 2024-02-28T16:24:07.406 INFO:tasks.workunit.client.0.smithi023.stdout:5/595: write d1/d2a/d32/d37/d3a/f48 [4191045,124394] 0 2024-02-28T16:24:07.407 INFO:tasks.workunit.client.0.smithi023.stdout:2/476: rmdir d5/da/d45 39 2024-02-28T16:24:07.411 INFO:tasks.workunit.client.0.smithi023.stdout:4/361: dwrite d13/f1b [0,4194304] 0 2024-02-28T16:24:07.411 INFO:tasks.workunit.client.0.smithi023.stdout:3/412: mknod d1/df/d2d/d45/d52/d65/d89/c8b 0 2024-02-28T16:24:07.411 INFO:tasks.workunit.client.0.smithi023.stdout:6/475: truncate d1/d18/f73 3255600 0 2024-02-28T16:24:07.413 INFO:tasks.workunit.client.0.smithi023.stdout:0/391: rename d6/db/d24/f62 to d6/db/d1a/f7f 0 2024-02-28T16:24:07.415 INFO:tasks.workunit.client.0.smithi023.stdout:6/476: dread - d1/d18/d26/da6/da9/fb2 zero size 2024-02-28T16:24:07.422 INFO:tasks.workunit.client.0.smithi023.stdout:1/435: creat df/d26/d48/f9d x:0 0 0 2024-02-28T16:24:07.427 INFO:tasks.workunit.client.0.smithi023.stdout:2/477: creat d5/dc/f95 x:0 0 0 2024-02-28T16:24:07.435 INFO:tasks.workunit.client.0.smithi023.stdout:7/354: getdents de/d13/d1b 0 2024-02-28T16:24:07.438 INFO:tasks.workunit.client.0.smithi023.stdout:1/436: write df/d11/d13/d1b/d30/d3d/d7b/f7d [2031263,95157] 0 2024-02-28T16:24:07.439 INFO:tasks.workunit.client.0.smithi023.stdout:0/392: creat d6/db/d1a/f80 x:0 0 0 2024-02-28T16:24:07.440 INFO:tasks.workunit.client.0.smithi023.stdout:8/495: dwrite d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/d6e/f9d [0,4194304] 0 2024-02-28T16:24:07.445 INFO:tasks.workunit.client.0.smithi023.stdout:2/478: creat d5/da/d1b/d3f/d75/d92/f96 x:0 0 0 2024-02-28T16:24:07.450 INFO:tasks.workunit.client.0.smithi023.stdout:4/362: dwrite d13/f1b [0,4194304] 0 2024-02-28T16:24:07.454 INFO:tasks.workunit.client.0.smithi023.stdout:8/496: read d0/d5/d1a/f8b [1750102,10417] 0 2024-02-28T16:24:07.454 INFO:tasks.workunit.client.0.smithi023.stdout:5/596: dwrite d1/d2a/d32/d58/d73/fa8 [0,4194304] 0 2024-02-28T16:24:07.454 INFO:tasks.workunit.client.0.smithi023.stdout:4/363: chown d13/d1d/f41 4 1 2024-02-28T16:24:07.463 INFO:tasks.workunit.client.0.smithi023.stdout:8/497: dread - d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/f88 zero size 2024-02-28T16:24:07.463 INFO:tasks.workunit.client.0.smithi023.stdout:6/477: truncate d1/d3d/f55 476044 0 2024-02-28T16:24:07.470 INFO:tasks.workunit.client.0.smithi023.stdout:7/355: dwrite de/d13/f1a [4194304,4194304] 0 2024-02-28T16:24:07.476 INFO:tasks.workunit.client.0.smithi023.stdout:4/364: mknod d13/d1e/c72 0 2024-02-28T16:24:07.479 INFO:tasks.workunit.client.0.smithi023.stdout:5/597: unlink d1/d2a/d32/d37/d3a/d7f/d62/la6 0 2024-02-28T16:24:07.483 INFO:tasks.workunit.client.0.smithi023.stdout:3/413: dread d1/df/f60 [0,4194304] 0 2024-02-28T16:24:07.484 INFO:tasks.workunit.client.0.smithi023.stdout:8/498: mkdir d0/d5/d1a/d63/d90/dac 0 2024-02-28T16:24:07.488 INFO:tasks.workunit.client.0.smithi023.stdout:0/393: creat d6/db/d1a/f81 x:0 0 0 2024-02-28T16:24:07.490 INFO:tasks.workunit.client.0.smithi023.stdout:4/365: fdatasync d13/d1d/d58/f5c 0 2024-02-28T16:24:07.492 INFO:tasks.workunit.client.0.smithi023.stdout:1/437: rename df/d11/c5e to df/d11/c9e 0 2024-02-28T16:24:07.495 INFO:tasks.workunit.client.0.smithi023.stdout:5/598: write d1/d2a/f3f [401082,28688] 0 2024-02-28T16:24:07.495 INFO:tasks.workunit.client.0.smithi023.stdout:6/478: chown d1/d18/f90 0 1 2024-02-28T16:24:07.495 INFO:tasks.workunit.client.0.smithi023.stdout:1/438: dread - df/d11/d13/d1b/f7f zero size 2024-02-28T16:24:07.497 INFO:tasks.workunit.client.0.smithi023.stdout:4/366: chown d13/d2b/c71 21671523 1 2024-02-28T16:24:07.498 INFO:tasks.workunit.client.0.smithi023.stdout:6/479: stat d1/d18/d26/f84 0 2024-02-28T16:24:07.499 INFO:tasks.workunit.client.0.smithi023.stdout:3/414: creat d1/df/d2d/f8c x:0 0 0 2024-02-28T16:24:07.504 INFO:tasks.workunit.client.0.smithi023.stdout:4/367: truncate d13/d1e/d39/f45 305711 0 2024-02-28T16:24:07.504 INFO:tasks.workunit.client.0.smithi023.stdout:0/394: getdents d6/db/d1a/d59 0 2024-02-28T16:24:07.504 INFO:tasks.workunit.client.0.smithi023.stdout:5/599: rmdir d1/d2a/d32/d58/d60/d88 39 2024-02-28T16:24:07.505 INFO:tasks.workunit.client.0.smithi023.stdout:5/600: readlink d1/l98 0 2024-02-28T16:24:07.506 INFO:tasks.workunit.client.0.smithi023.stdout:4/368: chown d13/d1d/d2d 22727 1 2024-02-28T16:24:07.508 INFO:tasks.workunit.client.0.smithi023.stdout:0/395: write d6/db/d1a/f6b [319743,93852] 0 2024-02-28T16:24:07.510 INFO:tasks.workunit.client.0.smithi023.stdout:6/480: mknod d1/d18/d26/da6/da9/cb8 0 2024-02-28T16:24:07.511 INFO:tasks.workunit.client.0.smithi023.stdout:1/439: symlink df/d11/d13/d1b/d30/d57/d5a/d68/d6f/l9f 0 2024-02-28T16:24:07.512 INFO:tasks.workunit.client.0.smithi023.stdout:0/396: write d6/db/d24/f77 [456203,124002] 0 2024-02-28T16:24:07.514 INFO:tasks.workunit.client.0.smithi023.stdout:1/440: fdatasync df/d11/f90 0 2024-02-28T16:24:07.516 INFO:tasks.workunit.client.0.smithi023.stdout:5/601: creat d1/d2a/d32/d6e/fbc x:0 0 0 2024-02-28T16:24:07.518 INFO:tasks.workunit.client.0.smithi023.stdout:9/369: sync 2024-02-28T16:24:07.519 INFO:tasks.workunit.client.0.smithi023.stdout:8/499: link d0/d5/d1a/d2d/d30/c32 d0/d5/d1b/d36/cad 0 2024-02-28T16:24:07.519 INFO:tasks.workunit.client.0.smithi023.stdout:3/415: creat d1/df/d2d/d32/d3f/f8d x:0 0 0 2024-02-28T16:24:07.525 INFO:tasks.workunit.client.0.smithi023.stdout:4/369: rename d13/d1d/l3a to d13/d1e/d39/d67/d6b/l73 0 2024-02-28T16:24:07.527 INFO:tasks.workunit.client.0.smithi023.stdout:1/441: stat df/d26/f35 0 2024-02-28T16:24:07.528 INFO:tasks.workunit.client.0.smithi023.stdout:9/370: fdatasync d0/d7/de/d2e/d2f/d4d/f4b 0 2024-02-28T16:24:07.531 INFO:tasks.workunit.client.0.smithi023.stdout:2/479: truncate d5/da/db/d17/d3c/f3d 216001 0 2024-02-28T16:24:07.533 INFO:tasks.workunit.client.0.smithi023.stdout:4/370: write d13/d1d/d2d/f36 [370048,66732] 0 2024-02-28T16:24:07.536 INFO:tasks.workunit.client.0.smithi023.stdout:1/442: write df/d26/d48/f79 [52116,5136] 0 2024-02-28T16:24:07.538 INFO:tasks.workunit.client.0.smithi023.stdout:6/481: link d1/d18/c96 d1/d4f/cb9 0 2024-02-28T16:24:07.540 INFO:tasks.workunit.client.0.smithi023.stdout:2/480: dread - d5/da/db/d17/f65 zero size 2024-02-28T16:24:07.540 INFO:tasks.workunit.client.0.smithi023.stdout:9/371: creat d0/d7/d2c/f77 x:0 0 0 2024-02-28T16:24:07.544 INFO:tasks.workunit.client.0.smithi023.stdout:0/397: rename d6/db/d1a/d2e to d6/db/d3b/d1f/d82 0 2024-02-28T16:24:07.546 INFO:tasks.workunit.client.0.smithi023.stdout:1/443: chown df/d26/l66 8 1 2024-02-28T16:24:07.549 INFO:tasks.workunit.client.0.smithi023.stdout:7/356: dwrite de/d13/f2b [0,4194304] 0 2024-02-28T16:24:07.549 INFO:tasks.workunit.client.0.smithi023.stdout:4/371: mknod d13/d1e/d39/c74 0 2024-02-28T16:24:07.550 INFO:tasks.workunit.client.0.smithi023.stdout:6/482: chown d1/d28/d1e/l33 1482 1 2024-02-28T16:24:07.555 INFO:tasks.workunit.client.0.smithi023.stdout:5/602: rename d1/d2a/d32/d37/c80 to d1/d2a/d32/d37/d4e/db5/cbd 0 2024-02-28T16:24:07.556 INFO:tasks.workunit.client.0.smithi023.stdout:7/357: chown de 0 1 2024-02-28T16:24:07.559 INFO:tasks.workunit.client.0.smithi023.stdout:0/398: creat d6/db/d3b/d1f/d42/f83 x:0 0 0 2024-02-28T16:24:07.560 INFO:tasks.workunit.client.0.smithi023.stdout:9/372: read d0/d7/db/f15 [3218887,7950] 0 2024-02-28T16:24:07.561 INFO:tasks.workunit.client.0.smithi023.stdout:8/500: dwrite d0/d5/d1a/d2d/f5c [0,4194304] 0 2024-02-28T16:24:07.563 INFO:tasks.workunit.client.0.smithi023.stdout:1/444: rmdir df/d11/d13/d1b/d30/d57 39 2024-02-28T16:24:07.567 INFO:tasks.workunit.client.0.smithi023.stdout:3/416: dread d1/d74/d46/f64 [0,4194304] 0 2024-02-28T16:24:07.567 INFO:tasks.workunit.client.0.smithi023.stdout:2/481: creat d5/da/db/d17/d39/d56/f97 x:0 0 0 2024-02-28T16:24:07.567 INFO:tasks.workunit.client.0.smithi023.stdout:1/445: chown df/d11/d13/d27/f53 17 1 2024-02-28T16:24:07.570 INFO:tasks.workunit.client.0.smithi023.stdout:1/446: write df/d11/d8a/f96 [48980,33370] 0 2024-02-28T16:24:07.575 INFO:tasks.workunit.client.0.smithi023.stdout:7/358: readlink de/d1c/l58 0 2024-02-28T16:24:07.575 INFO:tasks.workunit.client.0.smithi023.stdout:1/447: dread - df/d11/d13/d1b/d30/d3d/f98 zero size 2024-02-28T16:24:07.599 INFO:tasks.workunit.client.0.smithi023.stdout:9/373: creat d0/d7/de/d2e/d2f/d4d/f78 x:0 0 0 2024-02-28T16:24:07.599 INFO:tasks.workunit.client.0.smithi023.stdout:7/359: mknod de/d1c/c77 0 2024-02-28T16:24:07.599 INFO:tasks.workunit.client.0.smithi023.stdout:9/374: write d0/d7/d2c/f55 [2491925,115621] 0 2024-02-28T16:24:07.601 INFO:tasks.workunit.client.0.smithi023.stdout:0/399: mkdir d6/d84 0 2024-02-28T16:24:07.603 INFO:tasks.workunit.client.0.smithi023.stdout:8/501: dread d0/d5/d1a/d44/f76 [0,4194304] 0 2024-02-28T16:24:07.614 INFO:tasks.workunit.client.0.smithi023.stdout:7/360: dwrite de/d13/f1a [4194304,4194304] 0 2024-02-28T16:24:07.622 INFO:tasks.workunit.client.0.smithi023.stdout:4/372: dread d13/d1d/d2d/f47 [0,4194304] 0 2024-02-28T16:24:07.623 INFO:tasks.workunit.client.0.smithi023.stdout:6/483: dwrite d1/d18/f90 [0,4194304] 0 2024-02-28T16:24:07.632 INFO:tasks.workunit.client.0.smithi023.stdout:7/361: dread de/d60/f64 [0,4194304] 0 2024-02-28T16:24:07.640 INFO:tasks.workunit.client.0.smithi023.stdout:4/373: dread d13/d1d/d2d/f47 [0,4194304] 0 2024-02-28T16:24:07.677 INFO:tasks.workunit.client.0.smithi023.stdout:2/482: creat d5/f98 x:0 0 0 2024-02-28T16:24:07.679 INFO:tasks.workunit.client.0.smithi023.stdout:2/483: fdatasync d5/da/d62/f90 0 2024-02-28T16:24:07.680 INFO:tasks.workunit.client.0.smithi023.stdout:1/448: rmdir df/d11/d13/d73 0 2024-02-28T16:24:07.687 INFO:tasks.workunit.client.0.smithi023.stdout:5/603: getdents d1/d2a/d32/d37/d3a/d7f/d62 0 2024-02-28T16:24:07.688 INFO:tasks.workunit.client.0.smithi023.stdout:6/484: creat d1/d28/d1e/d2b/d44/da4/fba x:0 0 0 2024-02-28T16:24:07.689 INFO:tasks.workunit.client.0.smithi023.stdout:7/362: unlink de/d13/d1b/d40/l5f 0 2024-02-28T16:24:07.691 INFO:tasks.workunit.client.0.smithi023.stdout:4/374: write f9 [7867768,42673] 0 2024-02-28T16:24:07.693 INFO:tasks.workunit.client.0.smithi023.stdout:7/363: fsync de/d13/d1b/d40/f44 0 2024-02-28T16:24:07.696 INFO:tasks.workunit.client.0.smithi023.stdout:4/375: dread d13/d1e/d39/f45 [0,4194304] 0 2024-02-28T16:24:07.698 INFO:tasks.workunit.client.0.smithi023.stdout:2/484: dwrite d5/da/db/d17/f65 [0,4194304] 0 2024-02-28T16:24:07.713 INFO:tasks.workunit.client.0.smithi023.stdout:7/364: read de/d60/f37 [2449537,57512] 0 2024-02-28T16:24:07.714 INFO:tasks.workunit.client.0.smithi023.stdout:4/376: unlink d13/d1e/d39/c74 0 2024-02-28T16:24:07.716 INFO:tasks.workunit.client.0.smithi023.stdout:2/485: mknod d5/da/d1b/d3f/d75/d92/c99 0 2024-02-28T16:24:07.721 INFO:tasks.workunit.client.0.smithi023.stdout:9/375: rename d0/d7/de/d2e/d2f/d4d/f78 to d0/d7/de/d2e/f79 0 2024-02-28T16:24:07.722 INFO:tasks.workunit.client.0.smithi023.stdout:2/486: dread d5/dc/f34 [0,4194304] 0 2024-02-28T16:24:07.725 INFO:tasks.workunit.client.0.smithi023.stdout:0/400: link d6/db/d3b/d1f/c51 d6/db/d3b/d1f/d42/c85 0 2024-02-28T16:24:07.728 INFO:tasks.workunit.client.0.smithi023.stdout:7/365: unlink de/d1c/c3b 0 2024-02-28T16:24:07.730 INFO:tasks.workunit.client.0.smithi023.stdout:4/377: chown d13/d1d/d2d/l32 110 1 2024-02-28T16:24:07.730 INFO:tasks.workunit.client.0.smithi023.stdout:7/366: chown de/d60/f37 5 1 2024-02-28T16:24:07.738 INFO:tasks.workunit.client.0.smithi023.stdout:9/376: symlink d0/d7/d2c/l7a 0 2024-02-28T16:24:07.744 INFO:tasks.workunit.client.0.smithi023.stdout:7/367: unlink cb 0 2024-02-28T16:24:07.752 INFO:tasks.workunit.client.0.smithi023.stdout:8/502: sync 2024-02-28T16:24:07.753 INFO:tasks.workunit.client.0.smithi023.stdout:9/377: fsync d0/f1f 0 2024-02-28T16:24:07.754 INFO:tasks.workunit.client.0.smithi023.stdout:8/503: dread - d0/d5/d1b/d36/fa3 zero size 2024-02-28T16:24:07.755 INFO:tasks.workunit.client.0.smithi023.stdout:2/487: mknod d5/da/d45/c9a 0 2024-02-28T16:24:07.758 INFO:tasks.workunit.client.0.smithi023.stdout:0/401: mkdir d6/db/d1a/d35/d86 0 2024-02-28T16:24:07.762 INFO:tasks.workunit.client.0.smithi023.stdout:2/488: dread d5/da/f7c [0,4194304] 0 2024-02-28T16:24:07.762 INFO:tasks.workunit.client.0.smithi023.stdout:7/368: dwrite de/d1c/f68 [0,4194304] 0 2024-02-28T16:24:07.763 INFO:tasks.workunit.client.0.smithi023.stdout:5/604: getdents d1/d2a/d32/d58/d60/d88/d89 0 2024-02-28T16:24:07.765 INFO:tasks.workunit.client.0.smithi023.stdout:5/605: dread - d1/d2a/d32/d6e/fbc zero size 2024-02-28T16:24:07.766 INFO:tasks.workunit.client.0.smithi023.stdout:7/369: write de/d13/d1b/f34 [4567899,4679] 0 2024-02-28T16:24:07.768 INFO:tasks.workunit.client.0.smithi023.stdout:1/449: rename df/d11/d13/d1b/d30/d3d/f47 to df/fa0 0 2024-02-28T16:24:07.770 INFO:tasks.workunit.client.0.smithi023.stdout:9/378: creat d0/d7/de/d2e/d2f/d4d/f7b x:0 0 0 2024-02-28T16:24:07.774 INFO:tasks.workunit.client.0.smithi023.stdout:5/606: dread - d1/d2a/d32/d37/d3a/d7f/d62/d7b/f99 zero size 2024-02-28T16:24:07.774 INFO:tasks.workunit.client.0.smithi023.stdout:8/504: creat d0/d5/d1a/d63/d90/fae x:0 0 0 2024-02-28T16:24:07.777 INFO:tasks.workunit.client.0.smithi023.stdout:1/450: chown df/d11/d13/d1b/d30/f43 482 1 2024-02-28T16:24:07.779 INFO:tasks.workunit.client.0.smithi023.stdout:8/505: write d0/d5/d1b/f43 [590835,102582] 0 2024-02-28T16:24:07.782 INFO:tasks.workunit.client.0.smithi023.stdout:2/489: dread d5/dc/f24 [0,4194304] 0 2024-02-28T16:24:07.782 INFO:tasks.workunit.client.0.smithi023.stdout:8/506: fsync d0/d5/f41 0 2024-02-28T16:24:07.787 INFO:tasks.workunit.client.0.smithi023.stdout:7/370: mknod de/d60/c78 0 2024-02-28T16:24:07.790 INFO:tasks.workunit.client.0.smithi023.stdout:5/607: mknod d1/d2a/d32/d58/d60/d81/cbe 0 2024-02-28T16:24:07.796 INFO:tasks.workunit.client.0.smithi023.stdout:8/507: dread d0/d5/d35/f5f [0,4194304] 0 2024-02-28T16:24:07.799 INFO:tasks.workunit.client.0.smithi023.stdout:7/371: creat de/d1c/f79 x:0 0 0 2024-02-28T16:24:07.800 INFO:tasks.workunit.client.0.smithi023.stdout:6/485: write d1/d3d/f45 [500110,110930] 0 2024-02-28T16:24:07.800 INFO:tasks.workunit.client.0.smithi023.stdout:8/508: write d0/d5/d1a/d2d/f84 [5861887,84520] 0 2024-02-28T16:24:07.805 INFO:tasks.workunit.client.0.smithi023.stdout:5/608: symlink d1/d2a/d32/d37/d3a/d7f/d62/d7b/lbf 0 2024-02-28T16:24:07.807 INFO:tasks.workunit.client.0.smithi023.stdout:6/486: chown d1/d28/d1e/d52/daf/fb1 131702628 1 2024-02-28T16:24:07.808 INFO:tasks.workunit.client.0.smithi023.stdout:7/372: symlink de/d13/d1b/d6c/l7a 0 2024-02-28T16:24:07.810 INFO:tasks.workunit.client.0.smithi023.stdout:3/417: creat d1/df/f8e x:0 0 0 2024-02-28T16:24:07.813 INFO:tasks.workunit.client.0.smithi023.stdout:7/373: write de/d60/f3c [2228859,61686] 0 2024-02-28T16:24:07.814 INFO:tasks.workunit.client.0.smithi023.stdout:5/609: chown d1/d2a/d32/d58/d73/c7a 4530 1 2024-02-28T16:24:07.822 INFO:tasks.workunit.client.0.smithi023.stdout:5/610: unlink d1/d2a/c2d 0 2024-02-28T16:24:07.823 INFO:tasks.workunit.client.0.smithi023.stdout:1/451: dread df/d11/d13/d1b/d30/d57/f85 [0,4194304] 0 2024-02-28T16:24:07.823 INFO:tasks.workunit.client.0.smithi023.stdout:7/374: mkdir de/d1c/d76/d7b 0 2024-02-28T16:24:07.828 INFO:tasks.workunit.client.0.smithi023.stdout:7/375: dread - de/d13/d1b/d3d/d53/f73 zero size 2024-02-28T16:24:07.830 INFO:tasks.workunit.client.0.smithi023.stdout:7/376: dread - de/d13/d1b/d40/f74 zero size 2024-02-28T16:24:07.833 INFO:tasks.workunit.client.0.smithi023.stdout:3/418: dwrite d1/d74/d46/f64 [0,4194304] 0 2024-02-28T16:24:07.839 INFO:tasks.workunit.client.0.smithi023.stdout:7/377: creat de/d13/d1b/d3d/f7c x:0 0 0 2024-02-28T16:24:07.843 INFO:tasks.workunit.client.0.smithi023.stdout:7/378: read - de/d13/d1b/d6c/f71 zero size 2024-02-28T16:24:07.844 INFO:tasks.workunit.client.0.smithi023.stdout:3/419: stat d1/df/f16 0 2024-02-28T16:24:07.851 INFO:tasks.workunit.client.0.smithi023.stdout:7/379: symlink de/d13/d1b/d40/l7d 0 2024-02-28T16:24:07.851 INFO:tasks.workunit.client.0.smithi023.stdout:0/402: rmdir d6/db/d24 39 2024-02-28T16:24:07.853 INFO:tasks.workunit.client.0.smithi023.stdout:0/403: readlink d6/db/d1a/d1b/l75 0 2024-02-28T16:24:07.854 INFO:tasks.workunit.client.0.smithi023.stdout:3/420: chown d1/df/d2d/d45/d52/f5b 704 1 2024-02-28T16:24:07.856 INFO:tasks.workunit.client.0.smithi023.stdout:7/380: creat de/d13/d1b/d3d/d53/f7e x:0 0 0 2024-02-28T16:24:07.857 INFO:tasks.workunit.client.0.smithi023.stdout:0/404: read d6/db/f71 [1807015,12079] 0 2024-02-28T16:24:07.866 INFO:tasks.workunit.client.0.smithi023.stdout:3/421: rmdir d1/df/d33/d38 39 2024-02-28T16:24:07.867 INFO:tasks.workunit.client.0.smithi023.stdout:0/405: mkdir d6/db/d3b/d1f/d82/d87 0 2024-02-28T16:24:07.867 INFO:tasks.workunit.client.0.smithi023.stdout:3/422: dread - d1/df/d2d/f49 zero size 2024-02-28T16:24:07.870 INFO:tasks.workunit.client.0.smithi023.stdout:0/406: fdatasync d6/db/d3b/d1f/d42/f4a 0 2024-02-28T16:24:07.871 INFO:tasks.workunit.client.0.smithi023.stdout:3/423: mknod d1/df/d2d/d32/d3f/c8f 0 2024-02-28T16:24:07.877 INFO:tasks.workunit.client.0.smithi023.stdout:0/407: creat d6/d4c/d6a/f88 x:0 0 0 2024-02-28T16:24:07.878 INFO:tasks.workunit.client.0.smithi023.stdout:4/378: truncate d13/d2b/d2c/f35 611019 0 2024-02-28T16:24:07.878 INFO:tasks.workunit.client.0.smithi023.stdout:3/424: truncate d1/df/d33/d38/d4c/f50 635506 0 2024-02-28T16:24:07.881 INFO:tasks.workunit.client.0.smithi023.stdout:3/425: chown d1/df/d2d/d32/d3f/f6b 14295048 1 2024-02-28T16:24:07.883 INFO:tasks.workunit.client.0.smithi023.stdout:4/379: symlink d13/d1e/d39/d55/l75 0 2024-02-28T16:24:07.886 INFO:tasks.workunit.client.0.smithi023.stdout:3/426: stat d1/df/d3d/f4f 0 2024-02-28T16:24:07.891 INFO:tasks.workunit.client.0.smithi023.stdout:3/427: unlink d1/df/c18 0 2024-02-28T16:24:07.895 INFO:tasks.workunit.client.0.smithi023.stdout:4/380: getdents d13/d1d/d58 0 2024-02-28T16:24:07.896 INFO:tasks.workunit.client.0.smithi023.stdout:2/490: dwrite d5/da/d1b/d3f/f60 [0,4194304] 0 2024-02-28T16:24:07.902 INFO:tasks.workunit.client.0.smithi023.stdout:6/487: write d1/d28/f5f [295094,55332] 0 2024-02-28T16:24:07.903 INFO:tasks.workunit.client.0.smithi023.stdout:4/381: write d13/d2b/f5a [799692,127463] 0 2024-02-28T16:24:07.905 INFO:tasks.workunit.client.0.smithi023.stdout:6/488: chown d1/d18/d26/d3a/f5e 2 1 2024-02-28T16:24:07.906 INFO:tasks.workunit.client.0.smithi023.stdout:3/428: rmdir d1/d74/d46/d8a 0 2024-02-28T16:24:07.910 INFO:tasks.workunit.client.0.smithi023.stdout:1/452: write df/d11/d13/d1b/d30/f60 [1169655,77675] 0 2024-02-28T16:24:07.917 INFO:tasks.workunit.client.0.smithi023.stdout:6/489: truncate d1/d28/d1e/d2b/d6d/d7b/fb5 38160 0 2024-02-28T16:24:07.923 INFO:tasks.workunit.client.0.smithi023.stdout:1/453: creat df/d26/d48/fa1 x:0 0 0 2024-02-28T16:24:07.923 INFO:tasks.workunit.client.0.smithi023.stdout:5/611: dwrite d1/d2a/d32/d37/d3a/f6d [0,4194304] 0 2024-02-28T16:24:07.927 INFO:tasks.workunit.client.0.smithi023.stdout:9/379: sync 2024-02-28T16:24:07.930 INFO:tasks.workunit.client.0.smithi023.stdout:6/490: unlink d1/d28/d1e/c31 0 2024-02-28T16:24:07.932 INFO:tasks.workunit.client.0.smithi023.stdout:7/381: dwrite de/d60/f64 [4194304,4194304] 0 2024-02-28T16:24:07.933 INFO:tasks.workunit.client.0.smithi023.stdout:9/380: chown d0/d7/de/d2e/d2f/d44/l70 945 1 2024-02-28T16:24:07.936 INFO:tasks.workunit.client.0.smithi023.stdout:6/491: truncate d1/d3d/f45 1398910 0 2024-02-28T16:24:07.937 INFO:tasks.workunit.client.0.smithi023.stdout:0/408: write d6/db/f50 [143978,58109] 0 2024-02-28T16:24:07.939 INFO:tasks.workunit.client.0.smithi023.stdout:6/492: readlink d1/d18/d26/l39 0 2024-02-28T16:24:07.941 INFO:tasks.workunit.client.0.smithi023.stdout:0/409: chown d6/db/d1a/d26/d66 1477 1 2024-02-28T16:24:07.941 INFO:tasks.workunit.client.0.smithi023.stdout:6/493: write d1/d3d/f55 [949517,58484] 0 2024-02-28T16:24:07.946 INFO:tasks.workunit.client.0.smithi023.stdout:6/494: write d1/d18/d26/da6/da9/fb2 [1044080,46712] 0 2024-02-28T16:24:07.948 INFO:tasks.workunit.client.0.smithi023.stdout:5/612: mkdir d1/d2a/d32/d37/d4e/db5/dc0 0 2024-02-28T16:24:07.954 INFO:tasks.workunit.client.0.smithi023.stdout:5/613: read d1/d2a/d32/d37/d3a/f48 [1547448,71580] 0 2024-02-28T16:24:07.956 INFO:tasks.workunit.client.0.smithi023.stdout:2/491: truncate d5/f7a 1734903 0 2024-02-28T16:24:07.957 INFO:tasks.workunit.client.0.smithi023.stdout:3/429: dread d1/df/d33/d38/d4c/f55 [0,4194304] 0 2024-02-28T16:24:07.961 INFO:tasks.workunit.client.0.smithi023.stdout:9/381: creat d0/d7/db/d18/f7c x:0 0 0 2024-02-28T16:24:07.961 INFO:tasks.workunit.client.0.smithi023.stdout:3/430: chown d1/df/d33/d38/d4c 68 1 2024-02-28T16:24:07.962 INFO:tasks.workunit.client.0.smithi023.stdout:2/492: chown d5/da/db/d17/d39/l5d 2 1 2024-02-28T16:24:07.967 INFO:tasks.workunit.client.0.smithi023.stdout:3/431: chown d1/df/d3d/d57 965 1 2024-02-28T16:24:07.968 INFO:tasks.workunit.client.0.smithi023.stdout:8/509: sync 2024-02-28T16:24:07.975 INFO:tasks.workunit.client.0.smithi023.stdout:6/495: dwrite d1/d28/d1e/d52/daf/fb1 [0,4194304] 0 2024-02-28T16:24:07.975 INFO:tasks.workunit.client.0.smithi023.stdout:1/454: getdents df/d11/d13/d1b/d30/d57/d5a/d68 0 2024-02-28T16:24:07.978 INFO:tasks.workunit.client.0.smithi023.stdout:0/410: dwrite d6/db/f50 [0,4194304] 0 2024-02-28T16:24:07.983 INFO:tasks.workunit.client.0.smithi023.stdout:6/496: chown d1/d28/d1e/d2b/d6d/l83 472 1 2024-02-28T16:24:07.985 INFO:tasks.workunit.client.0.smithi023.stdout:4/382: dwrite d13/f3c [0,4194304] 0 2024-02-28T16:24:07.990 INFO:tasks.workunit.client.0.smithi023.stdout:9/382: mkdir d0/d7/d2c/d7d 0 2024-02-28T16:24:07.990 INFO:tasks.workunit.client.0.smithi023.stdout:2/493: fsync d5/da/d62/f69 0 2024-02-28T16:24:07.996 INFO:tasks.workunit.client.0.smithi023.stdout:3/432: write d1/df/d2d/d45/f1b [3239881,118613] 0 2024-02-28T16:24:07.998 INFO:tasks.workunit.client.0.smithi023.stdout:8/510: dread d0/d5/d1a/d44/f96 [0,4194304] 0 2024-02-28T16:24:08.004 INFO:tasks.workunit.client.0.smithi023.stdout:3/433: read d1/df/d2d/f40 [948255,64376] 0 2024-02-28T16:24:08.007 INFO:tasks.workunit.client.0.smithi023.stdout:7/382: truncate de/d60/f64 2067171 0 2024-02-28T16:24:08.014 INFO:tasks.workunit.client.0.smithi023.stdout:5/614: dread d1/d2a/d32/d36/f66 [0,4194304] 0 2024-02-28T16:24:08.015 INFO:tasks.workunit.client.0.smithi023.stdout:6/497: mknod d1/d4f/cbb 0 2024-02-28T16:24:08.029 INFO:tasks.workunit.client.0.smithi023.stdout:3/434: dwrite d1/df/f16 [0,4194304] 0 2024-02-28T16:24:08.040 INFO:tasks.workunit.client.0.smithi023.stdout:7/383: creat de/d1c/d76/f7f x:0 0 0 2024-02-28T16:24:08.043 INFO:tasks.workunit.client.0.smithi023.stdout:4/383: creat d13/d2b/d2c/d31/d6e/f76 x:0 0 0 2024-02-28T16:24:08.044 INFO:tasks.workunit.client.0.smithi023.stdout:7/384: read - de/d13/d1b/f49 zero size 2024-02-28T16:24:08.048 INFO:tasks.workunit.client.0.smithi023.stdout:9/383: dread d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:24:08.050 INFO:tasks.workunit.client.0.smithi023.stdout:1/455: dread df/d11/d13/d1b/d30/d3d/f50 [0,4194304] 0 2024-02-28T16:24:08.053 INFO:tasks.workunit.client.0.smithi023.stdout:3/435: chown d1/df/f3e 0 1 2024-02-28T16:24:08.058 INFO:tasks.workunit.client.0.smithi023.stdout:6/498: mkdir d1/d28/d1e/dbc 0 2024-02-28T16:24:08.059 INFO:tasks.workunit.client.0.smithi023.stdout:2/494: dread d5/ff [0,4194304] 0 2024-02-28T16:24:08.061 INFO:tasks.workunit.client.0.smithi023.stdout:4/384: symlink d13/d1d/l77 0 2024-02-28T16:24:08.064 INFO:tasks.workunit.client.0.smithi023.stdout:5/615: dread d1/d2a/d32/d58/d79/f91 [0,4194304] 0 2024-02-28T16:24:08.064 INFO:tasks.workunit.client.0.smithi023.stdout:9/384: creat d0/d7/de/d2e/f7e x:0 0 0 2024-02-28T16:24:08.066 INFO:tasks.workunit.client.0.smithi023.stdout:9/385: fsync d0/d7/d2c/f55 0 2024-02-28T16:24:08.067 INFO:tasks.workunit.client.0.smithi023.stdout:1/456: truncate df/d11/d13/d1b/d30/d3d/f6e 1035209 0 2024-02-28T16:24:08.067 INFO:tasks.workunit.client.0.smithi023.stdout:9/386: read - d0/d7/de/f63 zero size 2024-02-28T16:24:08.067 INFO:tasks.workunit.client.0.smithi023.stdout:5/616: fdatasync d1/d2a/d32/d37/d3a/d7f/d62/d68/f8c 0 2024-02-28T16:24:08.070 INFO:tasks.workunit.client.0.smithi023.stdout:5/617: readlink d1/d2a/l35 0 2024-02-28T16:24:08.070 INFO:tasks.workunit.client.0.smithi023.stdout:9/387: chown d0/d7/de/d2e/f7e 46 1 2024-02-28T16:24:08.073 INFO:tasks.workunit.client.0.smithi023.stdout:2/495: creat d5/da/d1b/f9b x:0 0 0 2024-02-28T16:24:08.076 INFO:tasks.workunit.client.0.smithi023.stdout:4/385: rename d13/d1d/d2d/l4d to d13/d1d/d58/l78 0 2024-02-28T16:24:08.079 INFO:tasks.workunit.client.0.smithi023.stdout:3/436: link d1/d74/d46/f72 d1/df/d2d/d32/d3f/f90 0 2024-02-28T16:24:08.083 INFO:tasks.workunit.client.0.smithi023.stdout:1/457: dwrite df/d11/f90 [0,4194304] 0 2024-02-28T16:24:08.086 INFO:tasks.workunit.client.0.smithi023.stdout:6/499: creat d1/d28/d1e/d2b/d44/d86/fbd x:0 0 0 2024-02-28T16:24:08.086 INFO:tasks.workunit.client.0.smithi023.stdout:1/458: chown df/d11/d13/d1b/d30/d3d 0 1 2024-02-28T16:24:08.090 INFO:tasks.workunit.client.0.smithi023.stdout:2/496: fsync d5/da/f5b 0 2024-02-28T16:24:08.090 INFO:tasks.workunit.client.0.smithi023.stdout:8/511: truncate d0/d5/d1b/d36/f78 3454061 0 2024-02-28T16:24:08.092 INFO:tasks.workunit.client.0.smithi023.stdout:9/388: rename d0/d7/de/d2e/d2f/d4d/f4b to d0/d7/db/d18/d23/d28/d6e/f7f 0 2024-02-28T16:24:08.093 INFO:tasks.workunit.client.0.smithi023.stdout:9/389: chown d0/d7/d2c 1 1 2024-02-28T16:24:08.093 INFO:tasks.workunit.client.0.smithi023.stdout:4/386: rmdir d13/d1e/d39/d67 39 2024-02-28T16:24:08.095 INFO:tasks.workunit.client.0.smithi023.stdout:4/387: rename d13 to d13/d1d/d58/d79 22 2024-02-28T16:24:08.104 INFO:tasks.workunit.client.0.smithi023.stdout:5/618: mknod d1/d2a/d32/d58/d60/d88/db9/cc1 0 2024-02-28T16:24:08.106 INFO:tasks.workunit.client.0.smithi023.stdout:1/459: rmdir df/d11/d13/d1b/d30/d57 39 2024-02-28T16:24:08.106 INFO:tasks.workunit.client.0.smithi023.stdout:5/619: write d1/d2a/d32/d37/d3a/f6a [1092585,55470] 0 2024-02-28T16:24:08.109 INFO:tasks.workunit.client.0.smithi023.stdout:5/620: dread - d1/d2a/d32/d58/d79/fac zero size 2024-02-28T16:24:08.109 INFO:tasks.workunit.client.0.smithi023.stdout:7/385: truncate de/d1c/f26 4149678 0 2024-02-28T16:24:08.111 INFO:tasks.workunit.client.0.smithi023.stdout:2/497: chown d5/da/d1b/f35 613931478 1 2024-02-28T16:24:08.111 INFO:tasks.workunit.client.0.smithi023.stdout:0/411: sync 2024-02-28T16:24:08.113 INFO:tasks.workunit.client.0.smithi023.stdout:7/386: dread - de/d13/d1b/d3d/f7c zero size 2024-02-28T16:24:08.113 INFO:tasks.workunit.client.0.smithi023.stdout:5/621: readlink d1/d2a/d32/d37/d3a/d7f/d62/d68/l52 0 2024-02-28T16:24:08.115 INFO:tasks.workunit.client.0.smithi023.stdout:5/622: chown d1/d2a/c33 0 1 2024-02-28T16:24:08.116 INFO:tasks.workunit.client.0.smithi023.stdout:9/390: symlink d0/d7/de/d2e/d2f/l80 0 2024-02-28T16:24:08.117 INFO:tasks.workunit.client.0.smithi023.stdout:3/437: link d1/d74/d46/f64 d1/df/d2d/d32/d3f/f91 0 2024-02-28T16:24:08.119 INFO:tasks.workunit.client.0.smithi023.stdout:5/623: stat d1/d2a/d32/d58/d60/f90 0 2024-02-28T16:24:08.119 INFO:tasks.workunit.client.0.smithi023.stdout:9/391: chown d0/d7/de/d34/f3b 12 1 2024-02-28T16:24:08.126 INFO:tasks.workunit.client.0.smithi023.stdout:2/498: mknod d5/da/db/d17/d39/c9c 0 2024-02-28T16:24:08.128 INFO:tasks.workunit.client.0.smithi023.stdout:0/412: rename d6/db/d1a/d1b/l23 to d6/d4c/d6a/l89 0 2024-02-28T16:24:08.128 INFO:tasks.workunit.client.0.smithi023.stdout:7/387: mknod de/d1c/c80 0 2024-02-28T16:24:08.132 INFO:tasks.workunit.client.0.smithi023.stdout:3/438: mkdir d1/d4a/d92 0 2024-02-28T16:24:08.134 INFO:tasks.workunit.client.0.smithi023.stdout:4/388: dread fb [4194304,4194304] 0 2024-02-28T16:24:08.137 INFO:tasks.workunit.client.0.smithi023.stdout:2/499: creat d5/da/d45/d81/d8b/f9d x:0 0 0 2024-02-28T16:24:08.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/413: creat d6/db/d3b/d1f/d42/f8a x:0 0 0 2024-02-28T16:24:08.139 INFO:tasks.workunit.client.0.smithi023.stdout:6/500: write d1/f1c [3885802,50666] 0 2024-02-28T16:24:08.143 INFO:tasks.workunit.client.0.smithi023.stdout:3/439: unlink d1/df/d33/f5f 0 2024-02-28T16:24:08.143 INFO:tasks.workunit.client.0.smithi023.stdout:0/414: truncate d6/db/d3b/f58 274255 0 2024-02-28T16:24:08.146 INFO:tasks.workunit.client.0.smithi023.stdout:9/392: getdents d0/d7/db/d18/d71 0 2024-02-28T16:24:08.147 INFO:tasks.workunit.client.0.smithi023.stdout:0/415: dread - d6/db/d1a/d26/d31/d33/d6e/f6f zero size 2024-02-28T16:24:08.153 INFO:tasks.workunit.client.0.smithi023.stdout:8/512: write d0/d5/d1a/d44/f76 [1691409,63401] 0 2024-02-28T16:24:08.154 INFO:tasks.workunit.client.0.smithi023.stdout:0/416: read d6/db/d3b/d1f/d82/f2f [115612,6922] 0 2024-02-28T16:24:08.159 INFO:tasks.workunit.client.0.smithi023.stdout:6/501: unlink d1/d28/d1e/d52/f7f 0 2024-02-28T16:24:08.165 INFO:tasks.workunit.client.0.smithi023.stdout:1/460: getdents df/d11 0 2024-02-28T16:24:08.165 INFO:tasks.workunit.client.0.smithi023.stdout:3/440: creat d1/d4a/f93 x:0 0 0 2024-02-28T16:24:08.169 INFO:tasks.workunit.client.0.smithi023.stdout:2/500: unlink d5/dc/l83 0 2024-02-28T16:24:08.171 INFO:tasks.workunit.client.0.smithi023.stdout:8/513: rename d0/d5/d1a/d2d/d67/d7d to d0/d5/d1a/d2d/d67/daf 0 2024-02-28T16:24:08.174 INFO:tasks.workunit.client.0.smithi023.stdout:9/393: link d0/f43 d0/d7/db/d18/d23/f81 0 2024-02-28T16:24:08.180 INFO:tasks.workunit.client.0.smithi023.stdout:3/441: write d1/df/f3b [1205184,32826] 0 2024-02-28T16:24:08.180 INFO:tasks.workunit.client.0.smithi023.stdout:2/501: write d5/da/f28 [1413429,51739] 0 2024-02-28T16:24:08.181 INFO:tasks.workunit.client.0.smithi023.stdout:0/417: creat d6/db/d3b/d1f/d82/d72/d79/f8b x:0 0 0 2024-02-28T16:24:08.182 INFO:tasks.workunit.client.0.smithi023.stdout:4/389: dread d13/d1d/d2e/f52 [0,4194304] 0 2024-02-28T16:24:08.184 INFO:tasks.workunit.client.0.smithi023.stdout:8/514: symlink d0/d5/d1b/d36/lb0 0 2024-02-28T16:24:08.186 INFO:tasks.workunit.client.0.smithi023.stdout:9/394: unlink d0/d7/l5a 0 2024-02-28T16:24:08.187 INFO:tasks.workunit.client.0.smithi023.stdout:5/624: write d1/d2a/d32/d37/d3a/f7e [1120299,36625] 0 2024-02-28T16:24:08.190 INFO:tasks.workunit.client.0.smithi023.stdout:7/388: truncate de/d13/f1a 4466913 0 2024-02-28T16:24:08.192 INFO:tasks.workunit.client.0.smithi023.stdout:2/502: chown d5/dc/l25 107649 1 2024-02-28T16:24:08.194 INFO:tasks.workunit.client.0.smithi023.stdout:6/502: rename d1/d18/d26/d3a/l8b to d1/d28/d1e/lbe 0 2024-02-28T16:24:08.197 INFO:tasks.workunit.client.0.smithi023.stdout:3/442: mkdir d1/d74/d94 0 2024-02-28T16:24:08.198 INFO:tasks.workunit.client.0.smithi023.stdout:4/390: mkdir d13/d1d/d58/d7a 0 2024-02-28T16:24:08.202 INFO:tasks.workunit.client.0.smithi023.stdout:9/395: unlink d0/d7/de/f68 0 2024-02-28T16:24:08.203 INFO:tasks.workunit.client.0.smithi023.stdout:7/389: readlink de/d1c/l56 0 2024-02-28T16:24:08.205 INFO:tasks.workunit.client.0.smithi023.stdout:4/391: creat d13/d2b/d2c/d31/d6e/f7b x:0 0 0 2024-02-28T16:24:08.206 INFO:tasks.workunit.client.0.smithi023.stdout:4/392: stat d13/d1d/d58/f68 0 2024-02-28T16:24:08.207 INFO:tasks.workunit.client.0.smithi023.stdout:3/443: rename d1/df/d2d/d45/c17 to d1/d74/d94/c95 0 2024-02-28T16:24:08.209 INFO:tasks.workunit.client.0.smithi023.stdout:4/393: stat d13/d1d/d2e 0 2024-02-28T16:24:08.212 INFO:tasks.workunit.client.0.smithi023.stdout:5/625: creat d1/d2a/d32/d58/d60/d82/fc2 x:0 0 0 2024-02-28T16:24:08.212 INFO:tasks.workunit.client.0.smithi023.stdout:2/503: mkdir d5/da/db/d17/d73/d9e 0 2024-02-28T16:24:08.213 INFO:tasks.workunit.client.0.smithi023.stdout:8/515: creat d0/fb1 x:0 0 0 2024-02-28T16:24:08.214 INFO:tasks.workunit.client.0.smithi023.stdout:1/461: link df/d11/d13/d1b/d30/d3d/d6c/l71 df/d11/d13/d1b/d30/d57/la2 0 2024-02-28T16:24:08.214 INFO:tasks.workunit.client.0.smithi023.stdout:9/396: creat d0/d7/db/d18/d23/d28/d32/d3c/f82 x:0 0 0 2024-02-28T16:24:08.217 INFO:tasks.workunit.client.0.smithi023.stdout:3/444: symlink d1/d74/d94/l96 0 2024-02-28T16:24:08.217 INFO:tasks.workunit.client.0.smithi023.stdout:2/504: readlink d5/da/d45/d81/d8b/l91 0 2024-02-28T16:24:08.219 INFO:tasks.workunit.client.0.smithi023.stdout:0/418: getdents d6/db/d1a/d26/d31/d33/d37 0 2024-02-28T16:24:08.220 INFO:tasks.workunit.client.0.smithi023.stdout:6/503: link d1/l13 d1/d28/lbf 0 2024-02-28T16:24:08.224 INFO:tasks.workunit.client.0.smithi023.stdout:2/505: write d5/da/d1b/d3f/f60 [4236452,91800] 0 2024-02-28T16:24:08.230 INFO:tasks.workunit.client.0.smithi023.stdout:8/516: mknod d0/d5/d1a/d2d/d67/daf/cb2 0 2024-02-28T16:24:08.231 INFO:tasks.workunit.client.0.smithi023.stdout:2/506: write d5/da/d1b/d3f/f60 [3146656,60494] 0 2024-02-28T16:24:08.243 INFO:tasks.workunit.client.0.smithi023.stdout:7/390: dwrite de/d1c/d76/f7f [0,4194304] 0 2024-02-28T16:24:08.253 INFO:tasks.workunit.client.0.smithi023.stdout:4/394: dwrite fb [0,4194304] 0 2024-02-28T16:24:08.257 INFO:tasks.workunit.client.0.smithi023.stdout:7/391: read - de/d1c/f5a zero size 2024-02-28T16:24:08.268 INFO:tasks.workunit.client.0.smithi023.stdout:7/392: fdatasync de/d13/d1b/f4c 0 2024-02-28T16:24:08.273 INFO:tasks.workunit.client.0.smithi023.stdout:1/462: write df/d26/f5b [915255,127426] 0 2024-02-28T16:24:08.273 INFO:tasks.workunit.client.0.smithi023.stdout:5/626: dread d1/d2a/f3f [0,4194304] 0 2024-02-28T16:24:08.281 INFO:tasks.workunit.client.0.smithi023.stdout:6/504: write d1/f69 [45030,118009] 0 2024-02-28T16:24:08.282 INFO:tasks.workunit.client.0.smithi023.stdout:9/397: dwrite d0/d7/db/f75 [0,4194304] 0 2024-02-28T16:24:08.282 INFO:tasks.workunit.client.0.smithi023.stdout:3/445: dwrite d1/df/f29 [0,4194304] 0 2024-02-28T16:24:08.287 INFO:tasks.workunit.client.0.smithi023.stdout:7/393: write de/d13/d1b/d40/f44 [3194748,75221] 0 2024-02-28T16:24:08.288 INFO:tasks.workunit.client.0.smithi023.stdout:4/395: write d13/d1e/d39/f45 [206749,97303] 0 2024-02-28T16:24:08.294 INFO:tasks.workunit.client.0.smithi023.stdout:0/419: dwrite d6/db/d3b/d1f/d82/f57 [0,4194304] 0 2024-02-28T16:24:08.296 INFO:tasks.workunit.client.0.smithi023.stdout:4/396: write d13/d1d/f33 [888950,4094] 0 2024-02-28T16:24:08.297 INFO:tasks.workunit.client.0.smithi023.stdout:6/505: mknod d1/d28/d1e/d2b/d6d/cc0 0 2024-02-28T16:24:08.298 INFO:tasks.workunit.client.0.smithi023.stdout:1/463: write df/d26/d48/d72/f8c [235141,14845] 0 2024-02-28T16:24:08.304 INFO:tasks.workunit.client.0.smithi023.stdout:8/517: dwrite d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/d6e/f9d [0,4194304] 0 2024-02-28T16:24:08.305 INFO:tasks.workunit.client.0.smithi023.stdout:9/398: truncate d0/d7/db/f24 4550828 0 2024-02-28T16:24:08.309 INFO:tasks.workunit.client.0.smithi023.stdout:6/506: fsync d1/d28/d1e/d2b/d6d/f92 0 2024-02-28T16:24:08.309 INFO:tasks.workunit.client.0.smithi023.stdout:2/507: dwrite d5/da/d1b/f4b [0,4194304] 0 2024-02-28T16:24:08.309 INFO:tasks.workunit.client.0.smithi023.stdout:0/420: write d6/db/d1a/f6b [967471,115563] 0 2024-02-28T16:24:08.312 INFO:tasks.workunit.client.0.smithi023.stdout:1/464: write df/d26/d48/f4c [3513124,27996] 0 2024-02-28T16:24:08.313 INFO:tasks.workunit.client.0.smithi023.stdout:9/399: fsync d0/d7/de/f14 0 2024-02-28T16:24:08.314 INFO:tasks.workunit.client.0.smithi023.stdout:6/507: stat d1/d28/d1e/d52/daf 0 2024-02-28T16:24:08.319 INFO:tasks.workunit.client.0.smithi023.stdout:8/518: stat d0/d5/d1b/d36/f78 0 2024-02-28T16:24:08.319 INFO:tasks.workunit.client.0.smithi023.stdout:0/421: write d6/db/d1a/d26/d31/d33/d37/f49 [2144714,20100] 0 2024-02-28T16:24:08.319 INFO:tasks.workunit.client.0.smithi023.stdout:9/400: read d0/d7/db/d18/f1d [2896666,96815] 0 2024-02-28T16:24:08.322 INFO:tasks.workunit.client.0.smithi023.stdout:3/446: rename d1/c67 to d1/df/d33/d38/c97 0 2024-02-28T16:24:08.323 INFO:tasks.workunit.client.0.smithi023.stdout:8/519: truncate d0/d5/d1a/f2e 1506511 0 2024-02-28T16:24:08.326 INFO:tasks.workunit.client.0.smithi023.stdout:0/422: chown d6/db/d3b/d1f/c53 202965425 1 2024-02-28T16:24:08.327 INFO:tasks.workunit.client.0.smithi023.stdout:3/447: readlink d1/df/d2d/d32/d3f/l4b 0 2024-02-28T16:24:08.332 INFO:tasks.workunit.client.0.smithi023.stdout:7/394: truncate de/d13/d1b/f2e 383601 0 2024-02-28T16:24:08.340 INFO:tasks.workunit.client.0.smithi023.stdout:2/508: creat d5/da/db/d17/d73/f9f x:0 0 0 2024-02-28T16:24:08.347 INFO:tasks.workunit.client.0.smithi023.stdout:4/397: truncate fe 3756726 0 2024-02-28T16:24:08.352 INFO:tasks.workunit.client.0.smithi023.stdout:9/401: creat d0/d7/db/d18/d23/d28/d32/d3c/f83 x:0 0 0 2024-02-28T16:24:08.354 INFO:tasks.workunit.client.0.smithi023.stdout:7/395: rmdir de/d13/d1b 39 2024-02-28T16:24:08.355 INFO:tasks.workunit.client.0.smithi023.stdout:6/508: mknod d1/d28/d1e/dbc/cc1 0 2024-02-28T16:24:08.356 INFO:tasks.workunit.client.0.smithi023.stdout:3/448: dwrite d1/df/f29 [0,4194304] 0 2024-02-28T16:24:08.357 INFO:tasks.workunit.client.0.smithi023.stdout:2/509: unlink d5/da/d45/c9a 0 2024-02-28T16:24:08.368 INFO:tasks.workunit.client.0.smithi023.stdout:4/398: unlink d13/d1e/d39/d55/l65 0 2024-02-28T16:24:08.369 INFO:tasks.workunit.client.0.smithi023.stdout:8/520: creat d0/d5/d1b/d7f/fb3 x:0 0 0 2024-02-28T16:24:08.373 INFO:tasks.workunit.client.0.smithi023.stdout:9/402: mkdir d0/d7/d2c/d84 0 2024-02-28T16:24:08.377 INFO:tasks.workunit.client.0.smithi023.stdout:6/509: mkdir d1/d28/d1e/d80/dc2 0 2024-02-28T16:24:08.377 INFO:tasks.workunit.client.0.smithi023.stdout:2/510: dwrite d5/da/d1b/f26 [0,4194304] 0 2024-02-28T16:24:08.378 INFO:tasks.workunit.client.0.smithi023.stdout:6/510: fsync d1/f40 0 2024-02-28T16:24:08.382 INFO:tasks.workunit.client.0.smithi023.stdout:5/627: rename d1/d2a/d32/d37/d3a/l83 to d1/d2a/d32/d58/d60/lc3 0 2024-02-28T16:24:08.384 INFO:tasks.workunit.client.0.smithi023.stdout:9/403: dread d0/d7/db/d18/d23/d28/d6e/f72 [0,4194304] 0 2024-02-28T16:24:08.386 INFO:tasks.workunit.client.0.smithi023.stdout:2/511: stat d5/da/db/d17/f57 0 2024-02-28T16:24:08.390 INFO:tasks.workunit.client.0.smithi023.stdout:7/396: symlink de/d13/d1b/d6c/l81 0 2024-02-28T16:24:08.390 INFO:tasks.workunit.client.0.smithi023.stdout:4/399: symlink d13/d1d/d2e/l7c 0 2024-02-28T16:24:08.390 INFO:tasks.workunit.client.0.smithi023.stdout:2/512: chown d5/da/l19 643 1 2024-02-28T16:24:08.393 INFO:tasks.workunit.client.0.smithi023.stdout:0/423: truncate d6/db/d1a/d26/f52 1942575 0 2024-02-28T16:24:08.396 INFO:tasks.workunit.client.0.smithi023.stdout:0/424: chown d6/db/d3b/f28 771 1 2024-02-28T16:24:08.401 INFO:tasks.workunit.client.0.smithi023.stdout:3/449: mknod d1/df/d3d/d57/d61/c98 0 2024-02-28T16:24:08.403 INFO:tasks.workunit.client.0.smithi023.stdout:9/404: creat d0/d7/de/d2e/d2f/d4d/f85 x:0 0 0 2024-02-28T16:24:08.404 INFO:tasks.workunit.client.0.smithi023.stdout:1/465: dwrite df/d11/d13/d1b/d2e/f6d [0,4194304] 0 2024-02-28T16:24:08.406 INFO:tasks.workunit.client.0.smithi023.stdout:9/405: stat d0/d7/db/d18/d71 0 2024-02-28T16:24:08.407 INFO:tasks.workunit.client.0.smithi023.stdout:6/511: dread d1/d18/d26/f58 [0,4194304] 0 2024-02-28T16:24:08.410 INFO:tasks.workunit.client.0.smithi023.stdout:7/397: chown de/d1c/f26 86 1 2024-02-28T16:24:08.412 INFO:tasks.workunit.client.0.smithi023.stdout:7/398: chown de/d1c/f68 11 1 2024-02-28T16:24:08.412 INFO:tasks.workunit.client.0.smithi023.stdout:9/406: chown d0/d7/db/d18/d23/f81 13394908 1 2024-02-28T16:24:08.413 INFO:tasks.workunit.client.0.smithi023.stdout:0/425: fdatasync d6/f10 0 2024-02-28T16:24:08.415 INFO:tasks.workunit.client.0.smithi023.stdout:3/450: rmdir d1/df/d3d/d57/d61 39 2024-02-28T16:24:08.418 INFO:tasks.workunit.client.0.smithi023.stdout:8/521: dwrite d0/d5/d1a/d2d/d30/d39/d3d/d3e/d62/d6e/f9d [0,4194304] 0 2024-02-28T16:24:08.422 INFO:tasks.workunit.client.0.smithi023.stdout:3/451: write d1/df/d33/d38/f43 [1947086,41816] 0 2024-02-28T16:24:08.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:08 smithi023 ceph-mon[29137]: pgmap v35: 65 pgs: 65 active+clean; 820 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 107 MiB/s wr, 225 op/s 2024-02-28T16:24:08.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:08 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:08.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:08 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:08.425 INFO:tasks.workunit.client.0.smithi023.stdout:4/400: creat d13/d1e/d39/d67/f7d x:0 0 0 2024-02-28T16:24:08.426 INFO:tasks.workunit.client.0.smithi023.stdout:8/522: read - d0/d5/d1a/d2d/d67/d71/fa0 zero size 2024-02-28T16:24:08.426 INFO:tasks.workunit.client.0.smithi023.stdout:5/628: rename d1/d2a/d32/d37/d4e/db5/cbd to d1/d2a/d32/d36/cc4 0 2024-02-28T16:24:08.429 INFO:tasks.workunit.client.0.smithi023.stdout:1/466: symlink df/d11/d13/d1b/d2e/la3 0 2024-02-28T16:24:08.431 INFO:tasks.workunit.client.0.smithi023.stdout:8/523: chown d0/d5/d1a/d2d/d67/d71/fa0 3 1 2024-02-28T16:24:08.432 INFO:tasks.workunit.client.0.smithi023.stdout:5/629: dread - d1/d2a/d32/d37/d3a/fab zero size 2024-02-28T16:24:08.437 INFO:tasks.workunit.client.0.smithi023.stdout:8/524: stat d0/d5/d1a/d63/d90/l9f 0 2024-02-28T16:24:08.440 INFO:tasks.workunit.client.0.smithi023.stdout:6/512: creat d1/d18/d26/da6/da9/fc3 x:0 0 0 2024-02-28T16:24:08.440 INFO:tasks.workunit.client.0.smithi023.stdout:7/399: read de/d13/d1b/f2e [50145,814] 0 2024-02-28T16:24:08.441 INFO:tasks.workunit.client.0.smithi023.stdout:9/407: symlink d0/d7/db/d18/d23/l86 0 2024-02-28T16:24:08.443 INFO:tasks.workunit.client.0.smithi023.stdout:9/408: readlink d0/d7/de/l12 0 2024-02-28T16:24:08.444 INFO:tasks.workunit.client.0.smithi023.stdout:6/513: chown d1/d28/d1e/d2b/d76/f95 185378 1 2024-02-28T16:24:08.446 INFO:tasks.workunit.client.0.smithi023.stdout:7/400: read de/d13/f22 [1658536,42031] 0 2024-02-28T16:24:08.448 INFO:tasks.workunit.client.0.smithi023.stdout:6/514: write d1/d18/fa5 [692719,3373] 0 2024-02-28T16:24:08.449 INFO:tasks.workunit.client.0.smithi023.stdout:0/426: creat d6/db/d1a/d26/d31/f8c x:0 0 0 2024-02-28T16:24:08.454 INFO:tasks.workunit.client.0.smithi023.stdout:2/513: rename d5/da/d45/d81 to d5/da/db/d17/d73/d9e/da0 0 2024-02-28T16:24:08.456 INFO:tasks.workunit.client.0.smithi023.stdout:2/514: stat d5/da/db/d17/f57 0 2024-02-28T16:24:08.456 INFO:tasks.workunit.client.0.smithi023.stdout:1/467: symlink df/d11/d13/d1b/d30/d57/d5a/la4 0 2024-02-28T16:24:08.461 INFO:tasks.workunit.client.0.smithi023.stdout:2/515: chown d5/da/d1b/d3f/d75/f77 952657492 1 2024-02-28T16:24:08.462 INFO:tasks.workunit.client.0.smithi023.stdout:5/630: dwrite d1/d2a/d32/d37/d3a/d7f/d62/d68/f8c [0,4194304] 0 2024-02-28T16:24:08.462 INFO:tasks.workunit.client.0.smithi023.stdout:1/468: dread - df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f88 zero size 2024-02-28T16:24:08.463 INFO:tasks.workunit.client.0.smithi023.stdout:6/515: mknod d1/d28/d1e/dbc/cc4 0 2024-02-28T16:24:08.464 INFO:tasks.workunit.client.0.smithi023.stdout:2/516: fsync d5/da/d45/f86 0 2024-02-28T16:24:08.468 INFO:tasks.workunit.client.0.smithi023.stdout:5/631: chown d1/d2a/d32/d37/d3a/d7f/d62/d68/l9f 50681489 1 2024-02-28T16:24:08.470 INFO:tasks.workunit.client.0.smithi023.stdout:4/401: rename d13/d1e/d39 to d13/d1d/d7e 0 2024-02-28T16:24:08.474 INFO:tasks.workunit.client.0.smithi023.stdout:9/409: symlink d0/d7/l87 0 2024-02-28T16:24:08.476 INFO:tasks.workunit.client.0.smithi023.stdout:1/469: symlink df/d26/la5 0 2024-02-28T16:24:08.480 INFO:tasks.workunit.client.0.smithi023.stdout:9/410: chown d0/d7/db/d18/d23/d28/d32/d3c 7110005 1 2024-02-28T16:24:08.482 INFO:tasks.workunit.client.0.smithi023.stdout:2/517: creat d5/da/db/d17/d73/d9e/da0/fa1 x:0 0 0 2024-02-28T16:24:08.489 INFO:tasks.workunit.client.0.smithi023.stdout:8/525: rename d0/d5/d1a/d2d/d30 to d0/d5/d1a/d2d/d67/d71/db4 0 2024-02-28T16:24:08.492 INFO:tasks.workunit.client.0.smithi023.stdout:7/401: creat de/f82 x:0 0 0 2024-02-28T16:24:08.493 INFO:tasks.workunit.client.0.smithi023.stdout:0/427: link d6/ca d6/db/d1a/d59/c8d 0 2024-02-28T16:24:08.495 INFO:tasks.workunit.client.0.smithi023.stdout:8/526: write d0/fc [855077,91220] 0 2024-02-28T16:24:08.497 INFO:tasks.workunit.client.0.smithi023.stdout:7/402: chown de/c63 8 1 2024-02-28T16:24:08.498 INFO:tasks.workunit.client.0.smithi023.stdout:1/470: rmdir df/d26/d48 39 2024-02-28T16:24:08.499 INFO:tasks.workunit.client.0.smithi023.stdout:3/452: dwrite d1/df/f60 [0,4194304] 0 2024-02-28T16:24:08.503 INFO:tasks.workunit.client.0.smithi023.stdout:7/403: chown de/d13/f22 22 1 2024-02-28T16:24:08.504 INFO:tasks.workunit.client.0.smithi023.stdout:4/402: dwrite d13/d1d/d7e/d55/f6c [0,4194304] 0 2024-02-28T16:24:08.507 INFO:tasks.workunit.client.0.smithi023.stdout:7/404: chown de/d13/d1b/d40/f74 1223 1 2024-02-28T16:24:08.508 INFO:tasks.workunit.client.0.smithi023.stdout:0/428: unlink d6/db/d3b/l30 0 2024-02-28T16:24:08.510 INFO:tasks.workunit.client.0.smithi023.stdout:5/632: dwrite d1/d2a/d32/d37/d3a/fab [0,4194304] 0 2024-02-28T16:24:08.516 INFO:tasks.workunit.client.0.smithi023.stdout:3/453: read - d1/f3c zero size 2024-02-28T16:24:08.519 INFO:tasks.workunit.client.0.smithi023.stdout:8/527: rename d0/d5/d1b/ff to d0/d5/d1a/d63/fb5 0 2024-02-28T16:24:08.522 INFO:tasks.workunit.client.0.smithi023.stdout:6/516: truncate d1/d18/d26/f58 3913851 0 2024-02-28T16:24:08.525 INFO:tasks.workunit.client.0.smithi023.stdout:9/411: getdents d0/d7/de/d2e/d2f/d4d 0 2024-02-28T16:24:08.532 INFO:tasks.workunit.client.0.smithi023.stdout:2/518: getdents d5/da/db/d17 0 2024-02-28T16:24:08.536 INFO:tasks.workunit.client.0.smithi023.stdout:7/405: dwrite f4 [4194304,4194304] 0 2024-02-28T16:24:08.539 INFO:tasks.workunit.client.0.smithi023.stdout:7/406: readlink de/d60/l32 0 2024-02-28T16:24:08.539 INFO:tasks.workunit.client.0.smithi023.stdout:0/429: dwrite d6/db/d1a/d26/f5c [0,4194304] 0 2024-02-28T16:24:08.541 INFO:tasks.workunit.client.0.smithi023.stdout:6/517: creat d1/d28/d1e/d52/fc5 x:0 0 0 2024-02-28T16:24:08.545 INFO:tasks.workunit.client.0.smithi023.stdout:3/454: creat d1/df/d2d/d45/d6f/f99 x:0 0 0 2024-02-28T16:24:08.546 INFO:tasks.workunit.client.0.smithi023.stdout:4/403: rename d13/l1c to d13/d2b/d2c/l7f 0 2024-02-28T16:24:08.550 INFO:tasks.workunit.client.0.smithi023.stdout:2/519: truncate d5/dc/f42 286006 0 2024-02-28T16:24:08.550 INFO:tasks.workunit.client.0.smithi023.stdout:7/407: creat de/d1c/f83 x:0 0 0 2024-02-28T16:24:08.552 INFO:tasks.workunit.client.0.smithi023.stdout:3/455: read d1/df/d3d/f47 [243343,2038] 0 2024-02-28T16:24:08.552 INFO:tasks.workunit.client.0.smithi023.stdout:2/520: stat d5/da/d1b/f1e 0 2024-02-28T16:24:08.556 INFO:tasks.workunit.client.0.smithi023.stdout:3/456: readlink d1/d4a/l7b 0 2024-02-28T16:24:08.556 INFO:tasks.workunit.client.0.smithi023.stdout:5/633: write d1/d2a/d32/d37/d3a/d7f/d62/f6b [1103749,17504] 0 2024-02-28T16:24:08.559 INFO:tasks.workunit.client.0.smithi023.stdout:2/521: dread - d5/da/d1b/d3f/d75/d92/f96 zero size 2024-02-28T16:24:08.562 INFO:tasks.workunit.client.0.smithi023.stdout:1/471: write df/d11/d13/d1b/d2e/d5c/f8f [2903752,79496] 0 2024-02-28T16:24:08.565 INFO:tasks.workunit.client.0.smithi023.stdout:0/430: creat d6/d84/f8e x:0 0 0 2024-02-28T16:24:08.565 INFO:tasks.workunit.client.0.smithi023.stdout:9/412: dread d0/d7/db/d18/f22 [0,4194304] 0 2024-02-28T16:24:08.569 INFO:tasks.workunit.client.0.smithi023.stdout:8/528: write d0/d5/d1a/d44/f96 [473589,53944] 0 2024-02-28T16:24:08.572 INFO:tasks.workunit.client.0.smithi023.stdout:9/413: truncate d0/d7/de/d2e/f7e 405660 0 2024-02-28T16:24:08.575 INFO:tasks.workunit.client.0.smithi023.stdout:2/522: mkdir d5/da/d62/da2 0 2024-02-28T16:24:08.581 INFO:tasks.workunit.client.0.smithi023.stdout:2/523: chown d5/da/d1b/d3f/f53 0 1 2024-02-28T16:24:08.582 INFO:tasks.workunit.client.0.smithi023.stdout:0/431: mkdir d6/db/d1a/d26/d31/d33/d37/d8f 0 2024-02-28T16:24:08.584 INFO:tasks.workunit.client.0.smithi023.stdout:1/472: write df/d26/d48/f4c [4508782,89921] 0 2024-02-28T16:24:08.586 INFO:tasks.workunit.client.0.smithi023.stdout:2/524: write d5/dc/f30 [910847,71125] 0 2024-02-28T16:24:08.586 INFO:tasks.workunit.client.0.smithi023.stdout:5/634: mknod d1/d2a/d32/d58/d60/d88/cc5 0 2024-02-28T16:24:08.590 INFO:tasks.workunit.client.0.smithi023.stdout:9/414: unlink d0/d7/db/d18/d23/d28/d32/d3c/f82 0 2024-02-28T16:24:08.591 INFO:tasks.workunit.client.0.smithi023.stdout:6/518: dread d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:24:08.593 INFO:tasks.workunit.client.0.smithi023.stdout:8/529: rename d0/d5/d1b/c59 to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/cb6 0 2024-02-28T16:24:08.602 INFO:tasks.workunit.client.0.smithi023.stdout:0/432: creat d6/db/d1a/d26/d31/f90 x:0 0 0 2024-02-28T16:24:08.602 INFO:tasks.workunit.client.0.smithi023.stdout:4/404: truncate d13/f17 8650803 0 2024-02-28T16:24:08.606 INFO:tasks.workunit.client.0.smithi023.stdout:7/408: truncate de/d60/f59 1542043 0 2024-02-28T16:24:08.607 INFO:tasks.workunit.client.0.smithi023.stdout:5/635: mkdir d1/d2a/d32/d37/d4e/db5/dc6 0 2024-02-28T16:24:08.612 INFO:tasks.workunit.client.0.smithi023.stdout:1/473: dwrite df/d11/d13/f2c [0,4194304] 0 2024-02-28T16:24:08.612 INFO:tasks.workunit.client.0.smithi023.stdout:6/519: rmdir d1/d4f 39 2024-02-28T16:24:08.624 INFO:tasks.workunit.client.0.smithi023.stdout:4/405: dwrite d13/d2b/d2c/d31/d6e/f76 [0,4194304] 0 2024-02-28T16:24:08.632 INFO:tasks.workunit.client.0.smithi023.stdout:7/409: dwrite de/d13/f6d [0,4194304] 0 2024-02-28T16:24:08.633 INFO:tasks.workunit.client.0.smithi023.stdout:3/457: creat d1/df/d2d/d45/d52/f9a x:0 0 0 2024-02-28T16:24:08.636 INFO:tasks.workunit.client.0.smithi023.stdout:3/458: chown d1/df/d2d/d32/d3f/f90 9695 1 2024-02-28T16:24:08.638 INFO:tasks.workunit.client.0.smithi023.stdout:3/459: readlink d1/d74/d94/l96 0 2024-02-28T16:24:08.639 INFO:tasks.workunit.client.0.smithi023.stdout:2/525: symlink d5/da/la3 0 2024-02-28T16:24:08.639 INFO:tasks.workunit.client.0.smithi023.stdout:9/415: creat d0/d7/d2c/d84/f88 x:0 0 0 2024-02-28T16:24:08.647 INFO:tasks.workunit.client.0.smithi023.stdout:5/636: creat d1/d2a/d32/d58/d60/d88/d89/fc7 x:0 0 0 2024-02-28T16:24:08.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:08 smithi153 ceph-mon[35341]: pgmap v35: 65 pgs: 65 active+clean; 820 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 107 MiB/s wr, 225 op/s 2024-02-28T16:24:08.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:08 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:08.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:08 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:08.650 INFO:tasks.workunit.client.0.smithi023.stdout:4/406: mkdir d13/d2b/d2c/d31/d6e/d80 0 2024-02-28T16:24:08.654 INFO:tasks.workunit.client.0.smithi023.stdout:7/410: fdatasync de/d1c/f20 0 2024-02-28T16:24:08.655 INFO:tasks.workunit.client.0.smithi023.stdout:0/433: symlink d6/db/d1a/d26/d66/l91 0 2024-02-28T16:24:08.657 INFO:tasks.workunit.client.0.smithi023.stdout:7/411: chown de/d1c/l21 1903010 1 2024-02-28T16:24:08.657 INFO:tasks.workunit.client.0.smithi023.stdout:5/637: dread d1/d2a/d32/d37/d3a/fae [0,4194304] 0 2024-02-28T16:24:08.661 INFO:tasks.workunit.client.0.smithi023.stdout:3/460: mknod d1/df/d33/d38/d6c/c9b 0 2024-02-28T16:24:08.664 INFO:tasks.workunit.client.0.smithi023.stdout:9/416: write d0/d7/db/d18/d23/d28/d6e/f7f [3961990,4453] 0 2024-02-28T16:24:08.664 INFO:tasks.workunit.client.0.smithi023.stdout:2/526: creat d5/da/db/d17/d73/d9e/da0/fa4 x:0 0 0 2024-02-28T16:24:08.666 INFO:tasks.workunit.client.0.smithi023.stdout:9/417: readlink d0/d7/de/d2e/d2f/l80 0 2024-02-28T16:24:08.667 INFO:tasks.workunit.client.0.smithi023.stdout:2/527: chown d5/da/d1b/d3f/l58 9 1 2024-02-28T16:24:08.669 INFO:tasks.workunit.client.0.smithi023.stdout:4/407: rename d13/d1e/c29 to d13/d1d/c81 0 2024-02-28T16:24:08.671 INFO:tasks.workunit.client.0.smithi023.stdout:9/418: dread - d0/d7/de/d2e/d2f/d4d/f7b zero size 2024-02-28T16:24:08.671 INFO:tasks.workunit.client.0.smithi023.stdout:6/520: link d1/d28/d1e/dbc/cc1 d1/d28/d1e/d2b/d76/d9e/cc6 0 2024-02-28T16:24:08.673 INFO:tasks.workunit.client.0.smithi023.stdout:6/521: fdatasync d1/f69 0 2024-02-28T16:24:08.675 INFO:tasks.workunit.client.0.smithi023.stdout:0/434: read d6/db/fd [30600,104525] 0 2024-02-28T16:24:08.678 INFO:tasks.workunit.client.0.smithi023.stdout:8/530: truncate d0/d5/f27 1799297 0 2024-02-28T16:24:08.678 INFO:tasks.workunit.client.0.smithi023.stdout:7/412: mknod de/d60/c84 0 2024-02-28T16:24:08.681 INFO:tasks.workunit.client.0.smithi023.stdout:3/461: mknod d1/d74/d46/c9c 0 2024-02-28T16:24:08.683 INFO:tasks.workunit.client.0.smithi023.stdout:4/408: creat d13/d2b/d2c/d31/d6e/f82 x:0 0 0 2024-02-28T16:24:08.685 INFO:tasks.workunit.client.0.smithi023.stdout:4/409: fsync d13/d2b/d2c/d31/d6e/f76 0 2024-02-28T16:24:08.687 INFO:tasks.workunit.client.0.smithi023.stdout:4/410: chown d13/d1d/f41 126450 1 2024-02-28T16:24:08.689 INFO:tasks.workunit.client.0.smithi023.stdout:1/474: dread df/d11/d13/f14 [0,4194304] 0 2024-02-28T16:24:08.691 INFO:tasks.workunit.client.0.smithi023.stdout:4/411: write d13/d2b/d2c/f2f [4063789,48898] 0 2024-02-28T16:24:08.693 INFO:tasks.workunit.client.0.smithi023.stdout:2/528: truncate d5/da/db/d17/d3c/f4c 320980 0 2024-02-28T16:24:08.694 INFO:tasks.workunit.client.0.smithi023.stdout:9/419: symlink d0/d7/d2c/l89 0 2024-02-28T16:24:08.695 INFO:tasks.workunit.client.0.smithi023.stdout:0/435: symlink d6/db/d1a/d26/d31/d33/d37/l92 0 2024-02-28T16:24:08.695 INFO:tasks.workunit.client.0.smithi023.stdout:4/412: stat d13/d1d/d58 0 2024-02-28T16:24:08.702 INFO:tasks.workunit.client.0.smithi023.stdout:2/529: read d5/dc/f30 [391424,113561] 0 2024-02-28T16:24:08.703 INFO:tasks.workunit.client.0.smithi023.stdout:8/531: readlink d0/d5/d35/l72 0 2024-02-28T16:24:08.710 INFO:tasks.workunit.client.0.smithi023.stdout:5/638: creat d1/d2a/d32/d37/fc8 x:0 0 0 2024-02-28T16:24:08.710 INFO:tasks.workunit.client.0.smithi023.stdout:3/462: dwrite d1/df/d3d/f4f [4194304,4194304] 0 2024-02-28T16:24:08.721 INFO:tasks.workunit.client.0.smithi023.stdout:9/420: mknod d0/c8a 0 2024-02-28T16:24:08.721 INFO:tasks.workunit.client.0.smithi023.stdout:0/436: dread d6/db/f50 [0,4194304] 0 2024-02-28T16:24:08.731 INFO:tasks.workunit.client.0.smithi023.stdout:5/639: truncate d1/f40 1843635 0 2024-02-28T16:24:08.738 INFO:tasks.workunit.client.0.smithi023.stdout:5/640: write d1/d2a/d32/d37/d3a/d7f/d62/fa9 [1565050,27218] 0 2024-02-28T16:24:08.740 INFO:tasks.workunit.client.0.smithi023.stdout:3/463: mkdir d1/df/d2d/d9d 0 2024-02-28T16:24:08.744 INFO:tasks.workunit.client.0.smithi023.stdout:2/530: rmdir d5/da/d62/da2 0 2024-02-28T16:24:08.745 INFO:tasks.workunit.client.0.smithi023.stdout:0/437: dwrite d6/db/d1a/d1b/f27 [0,4194304] 0 2024-02-28T16:24:08.749 INFO:tasks.workunit.client.0.smithi023.stdout:9/421: mkdir d0/d7/db/d18/d23/d28/d32/d8b 0 2024-02-28T16:24:08.751 INFO:tasks.workunit.client.0.smithi023.stdout:2/531: read d5/da/d45/d6a/f6e [3112023,75233] 0 2024-02-28T16:24:08.751 INFO:tasks.workunit.client.0.smithi023.stdout:0/438: chown d6/db/d3d/f55 40476 1 2024-02-28T16:24:08.752 INFO:tasks.workunit.client.0.smithi023.stdout:2/532: chown d5/da/db/d17 0 1 2024-02-28T16:24:08.756 INFO:tasks.workunit.client.0.smithi023.stdout:3/464: mkdir d1/df/d3d/d57/d61/d9e 0 2024-02-28T16:24:08.759 INFO:tasks.workunit.client.0.smithi023.stdout:5/641: symlink d1/d2a/d32/d37/d4e/db5/dc6/lc9 0 2024-02-28T16:24:08.764 INFO:tasks.workunit.client.0.smithi023.stdout:2/533: fsync d5/da/db/f8e 0 2024-02-28T16:24:08.766 INFO:tasks.workunit.client.0.smithi023.stdout:0/439: creat d6/db/d5d/f93 x:0 0 0 2024-02-28T16:24:08.768 INFO:tasks.workunit.client.0.smithi023.stdout:6/522: dwrite d1/d3d/f55 [0,4194304] 0 2024-02-28T16:24:08.769 INFO:tasks.workunit.client.0.smithi023.stdout:9/422: mknod d0/d7/db/d18/d23/d28/d32/d8b/c8c 0 2024-02-28T16:24:08.771 INFO:tasks.workunit.client.0.smithi023.stdout:1/475: truncate df/d11/d13/d1b/d2e/f84 3915277 0 2024-02-28T16:24:08.773 INFO:tasks.workunit.client.0.smithi023.stdout:1/476: chown l6 874 1 2024-02-28T16:24:08.773 INFO:tasks.workunit.client.0.smithi023.stdout:2/534: truncate d5/da/f7c 4675516 0 2024-02-28T16:24:08.774 INFO:tasks.workunit.client.0.smithi023.stdout:3/465: mkdir d1/df/d2d/d9d/d9f 0 2024-02-28T16:24:08.776 INFO:tasks.workunit.client.0.smithi023.stdout:5/642: mkdir d1/d2a/d32/d37/d3a/d7f/dca 0 2024-02-28T16:24:08.776 INFO:tasks.workunit.client.0.smithi023.stdout:3/466: stat d1/df/d2d/d32/d3f/f70 0 2024-02-28T16:24:08.779 INFO:tasks.workunit.client.0.smithi023.stdout:8/532: truncate d0/d5/f5e 7536255 0 2024-02-28T16:24:08.781 INFO:tasks.workunit.client.0.smithi023.stdout:6/523: chown d1/l4d 27151773 1 2024-02-28T16:24:08.782 INFO:tasks.workunit.client.0.smithi023.stdout:4/413: dwrite d13/d1d/d2d/f47 [0,4194304] 0 2024-02-28T16:24:08.785 INFO:tasks.workunit.client.0.smithi023.stdout:8/533: chown d0/d5/d1a/c73 41062 1 2024-02-28T16:24:08.786 INFO:tasks.workunit.client.0.smithi023.stdout:1/477: fsync f2 0 2024-02-28T16:24:08.788 INFO:tasks.workunit.client.0.smithi023.stdout:4/414: write d13/d2b/d2c/f2f [12900923,57088] 0 2024-02-28T16:24:08.789 INFO:tasks.workunit.client.0.smithi023.stdout:3/467: creat d1/df/d2d/d45/fa0 x:0 0 0 2024-02-28T16:24:08.792 INFO:tasks.workunit.client.0.smithi023.stdout:5/643: symlink d1/d2a/d32/d58/d60/d82/lcb 0 2024-02-28T16:24:08.795 INFO:tasks.workunit.client.0.smithi023.stdout:9/423: unlink d0/d7/d2c/c6c 0 2024-02-28T16:24:08.802 INFO:tasks.workunit.client.0.smithi023.stdout:0/440: dwrite d6/db/d1a/d1b/f5a [0,4194304] 0 2024-02-28T16:24:08.803 INFO:tasks.workunit.client.0.smithi023.stdout:4/415: mknod d13/d1d/d2d/c83 0 2024-02-28T16:24:08.810 INFO:tasks.workunit.client.0.smithi023.stdout:1/478: truncate df/d26/d48/f70 1923198 0 2024-02-28T16:24:08.814 INFO:tasks.workunit.client.0.smithi023.stdout:8/534: dwrite d0/d5/d1b/f43 [0,4194304] 0 2024-02-28T16:24:08.814 INFO:tasks.workunit.client.0.smithi023.stdout:5/644: readlink d1/d2a/d32/d37/d3a/d7f/d62/l95 0 2024-02-28T16:24:08.817 INFO:tasks.workunit.client.0.smithi023.stdout:5/645: fsync d1/d2a/d32/d37/fc8 0 2024-02-28T16:24:08.822 INFO:tasks.workunit.client.0.smithi023.stdout:5/646: readlink d1/d2a/d32/d37/d3a/d7f/d62/d68/l8e 0 2024-02-28T16:24:08.828 INFO:tasks.workunit.client.0.smithi023.stdout:3/468: creat d1/df/fa1 x:0 0 0 2024-02-28T16:24:08.828 INFO:tasks.workunit.client.0.smithi023.stdout:1/479: mkdir df/d11/d13/d1b/d30/d57/d5a/da6 0 2024-02-28T16:24:08.831 INFO:tasks.workunit.client.0.smithi023.stdout:3/469: chown d1/f23 107 1 2024-02-28T16:24:08.832 INFO:tasks.workunit.client.0.smithi023.stdout:4/416: dwrite d13/d1d/f25 [0,4194304] 0 2024-02-28T16:24:08.834 INFO:tasks.workunit.client.0.smithi023.stdout:1/480: stat df/d11/d13/d1b/d30/d3d/d7b 0 2024-02-28T16:24:08.835 INFO:tasks.workunit.client.0.smithi023.stdout:6/524: write d1/d18/d26/d3a/f5e [3160932,13551] 0 2024-02-28T16:24:08.837 INFO:tasks.workunit.client.0.smithi023.stdout:1/481: chown df/d11/f12 4 1 2024-02-28T16:24:08.837 INFO:tasks.workunit.client.0.smithi023.stdout:9/424: creat d0/d7/de/f8d x:0 0 0 2024-02-28T16:24:08.840 INFO:tasks.workunit.client.0.smithi023.stdout:6/525: fdatasync d1/d28/d1e/d52/f5b 0 2024-02-28T16:24:08.846 INFO:tasks.workunit.client.0.smithi023.stdout:8/535: write d0/d5/d35/f5f [1607999,122431] 0 2024-02-28T16:24:08.847 INFO:tasks.workunit.client.0.smithi023.stdout:0/441: creat d6/db/d1a/d26/d31/d33/f94 x:0 0 0 2024-02-28T16:24:08.852 INFO:tasks.workunit.client.0.smithi023.stdout:0/442: fdatasync d6/db/d1a/d1b/f27 0 2024-02-28T16:24:08.852 INFO:tasks.workunit.client.0.smithi023.stdout:1/482: truncate df/f16 1618784 0 2024-02-28T16:24:08.855 INFO:tasks.workunit.client.0.smithi023.stdout:9/425: creat d0/d7/db/d18/d23/d28/d32/d3c/f8e x:0 0 0 2024-02-28T16:24:08.857 INFO:tasks.workunit.client.0.smithi023.stdout:0/443: dread - d6/db/d5d/f93 zero size 2024-02-28T16:24:08.858 INFO:tasks.workunit.client.0.smithi023.stdout:8/536: creat d0/d5/d1a/d2d/d67/d71/fb7 x:0 0 0 2024-02-28T16:24:08.863 INFO:tasks.workunit.client.0.smithi023.stdout:1/483: mknod df/d11/d13/ca7 0 2024-02-28T16:24:08.865 INFO:tasks.workunit.client.0.smithi023.stdout:3/470: getdents d1/df/d3d 0 2024-02-28T16:24:08.869 INFO:tasks.workunit.client.0.smithi023.stdout:4/417: dwrite d13/d1d/d2d/f47 [0,4194304] 0 2024-02-28T16:24:08.872 INFO:tasks.workunit.client.0.smithi023.stdout:8/537: unlink d0/d5/d1a/d2d/d67/d71/db4/d39/ca1 0 2024-02-28T16:24:08.875 INFO:tasks.workunit.client.0.smithi023.stdout:0/444: rename d6/db/d1a/d1b/l75 to d6/db/d1a/d59/l95 0 2024-02-28T16:24:08.879 INFO:tasks.workunit.client.0.smithi023.stdout:3/471: rmdir d1/df/d3d/d57 39 2024-02-28T16:24:08.884 INFO:tasks.workunit.client.0.smithi023.stdout:1/484: creat df/d11/d8a/fa8 x:0 0 0 2024-02-28T16:24:08.895 INFO:tasks.workunit.client.0.smithi023.stdout:9/426: dwrite d0/d7/db/d18/f1d [0,4194304] 0 2024-02-28T16:24:08.898 INFO:tasks.workunit.client.0.smithi023.stdout:9/427: truncate d0/d7/d2c/f55 5080057 0 2024-02-28T16:24:08.900 INFO:tasks.workunit.client.0.smithi023.stdout:9/428: chown d0 1373 1 2024-02-28T16:24:08.903 INFO:tasks.workunit.client.0.smithi023.stdout:1/485: mknod df/d11/d13/d99/ca9 0 2024-02-28T16:24:08.909 INFO:tasks.workunit.client.0.smithi023.stdout:0/445: creat d6/db/d3b/f96 x:0 0 0 2024-02-28T16:24:08.912 INFO:tasks.workunit.client.0.smithi023.stdout:9/429: write d0/d7/db/d18/d23/d28/f54 [264053,106892] 0 2024-02-28T16:24:08.916 INFO:tasks.workunit.client.0.smithi023.stdout:3/472: rename d1/df/d2d/f49 to d1/df/d2d/d45/d52/d65/d89/fa2 0 2024-02-28T16:24:08.916 INFO:tasks.workunit.client.0.smithi023.stdout:4/418: dwrite d13/d2b/f5e [4194304,4194304] 0 2024-02-28T16:24:08.919 INFO:tasks.workunit.client.0.smithi023.stdout:0/446: readlink d6/db/lf 0 2024-02-28T16:24:08.923 INFO:tasks.workunit.client.0.smithi023.stdout:6/526: dwrite d1/d28/d1e/d2b/d76/f88 [0,4194304] 0 2024-02-28T16:24:08.926 INFO:tasks.workunit.client.0.smithi023.stdout:3/473: mkdir d1/d74/da3 0 2024-02-28T16:24:08.929 INFO:tasks.workunit.client.0.smithi023.stdout:3/474: fsync d1/df/d2d/f31 0 2024-02-28T16:24:08.930 INFO:tasks.workunit.client.0.smithi023.stdout:4/419: creat d13/d1d/d58/f84 x:0 0 0 2024-02-28T16:24:08.935 INFO:tasks.workunit.client.0.smithi023.stdout:8/538: dwrite d0/d5/f5e [0,4194304] 0 2024-02-28T16:24:08.942 INFO:tasks.workunit.client.0.smithi023.stdout:6/527: mknod d1/d4f/cc7 0 2024-02-28T16:24:08.946 INFO:tasks.workunit.client.0.smithi023.stdout:1/486: dwrite df/d26/d48/f79 [0,4194304] 0 2024-02-28T16:24:08.952 INFO:tasks.workunit.client.0.smithi023.stdout:4/420: rename d13/d1d/d7e/d67/d6b to d13/d1d/d85 0 2024-02-28T16:24:08.955 INFO:tasks.workunit.client.0.smithi023.stdout:3/475: symlink d1/d4a/d92/la4 0 2024-02-28T16:24:08.955 INFO:tasks.workunit.client.0.smithi023.stdout:4/421: dread - d13/d2b/d2c/d31/d6e/f7b zero size 2024-02-28T16:24:08.957 INFO:tasks.workunit.client.0.smithi023.stdout:4/422: dread - d13/d1d/d7e/d67/f7d zero size 2024-02-28T16:24:08.958 INFO:tasks.workunit.client.0.smithi023.stdout:9/430: link d0/d7/db/d18/d23/d28/d32/d3c/f51 d0/d7/db/f8f 0 2024-02-28T16:24:08.962 INFO:tasks.workunit.client.0.smithi023.stdout:6/528: creat d1/d28/d1e/d2b/d6d/fc8 x:0 0 0 2024-02-28T16:24:08.965 INFO:tasks.workunit.client.0.smithi023.stdout:1/487: creat df/d11/d13/d1b/d30/d57/d5a/faa x:0 0 0 2024-02-28T16:24:08.968 INFO:tasks.workunit.client.0.smithi023.stdout:1/488: chown df/d11/c52 129 1 2024-02-28T16:24:08.968 INFO:tasks.workunit.client.0.smithi023.stdout:0/447: getdents d6/db 0 2024-02-28T16:24:08.971 INFO:tasks.workunit.client.0.smithi023.stdout:0/448: fdatasync d6/db/d1a/f80 0 2024-02-28T16:24:08.975 INFO:tasks.workunit.client.0.smithi023.stdout:0/449: chown d6/db/d3b/d1f/c2b 32800 1 2024-02-28T16:24:08.978 INFO:tasks.workunit.client.0.smithi023.stdout:4/423: dwrite d13/d1d/d7e/d55/f60 [0,4194304] 0 2024-02-28T16:24:08.984 INFO:tasks.workunit.client.0.smithi023.stdout:1/489: symlink df/d93/lab 0 2024-02-28T16:24:08.989 INFO:tasks.workunit.client.0.smithi023.stdout:6/529: dwrite d1/d28/d1e/d2b/d6d/d7b/fb5 [0,4194304] 0 2024-02-28T16:24:08.990 INFO:tasks.workunit.client.0.smithi023.stdout:4/424: dread - d13/d2b/d2c/d31/f48 zero size 2024-02-28T16:24:08.993 INFO:tasks.workunit.client.0.smithi023.stdout:8/539: truncate d0/d5/d1a/f38 848198 0 2024-02-28T16:24:08.996 INFO:tasks.workunit.client.0.smithi023.stdout:4/425: write d13/d2b/d2c/d31/d6e/f7b [760853,48978] 0 2024-02-28T16:24:08.996 INFO:tasks.workunit.client.0.smithi023.stdout:9/431: rmdir d0/d7/db/d18/d71 0 2024-02-28T16:24:08.997 INFO:tasks.workunit.client.0.smithi023.stdout:6/530: readlink d1/d28/d1e/lbe 0 2024-02-28T16:24:09.000 INFO:tasks.workunit.client.0.smithi023.stdout:9/432: stat d0/d7/de/c13 0 2024-02-28T16:24:09.002 INFO:tasks.workunit.client.0.smithi023.stdout:3/476: dread d1/df/d3d/f62 [0,4194304] 0 2024-02-28T16:24:09.002 INFO:tasks.workunit.client.0.smithi023.stdout:1/490: mknod df/d11/d13/d1b/d30/d3d/d6c/cac 0 2024-02-28T16:24:09.005 INFO:tasks.workunit.client.0.smithi023.stdout:1/491: fdatasync df/d11/d13/f2c 0 2024-02-28T16:24:09.007 INFO:tasks.workunit.client.0.smithi023.stdout:6/531: readlink d1/d4f/l59 0 2024-02-28T16:24:09.009 INFO:tasks.workunit.client.0.smithi023.stdout:0/450: rename d6/db/lf to d6/db/d3b/d1f/l97 0 2024-02-28T16:24:09.014 INFO:tasks.workunit.client.0.smithi023.stdout:6/532: dread - d1/d28/d1e/dae/fb4 zero size 2024-02-28T16:24:09.023 INFO:tasks.workunit.client.0.smithi023.stdout:6/533: unlink d1/fe 0 2024-02-28T16:24:09.032 INFO:tasks.workunit.client.0.smithi023.stdout:8/540: dread d0/d5/d1a/f38 [0,4194304] 0 2024-02-28T16:24:09.033 INFO:tasks.workunit.client.0.smithi023.stdout:6/534: truncate d1/d28/d1e/d52/fc5 99694 0 2024-02-28T16:24:09.033 INFO:tasks.workunit.client.0.smithi023.stdout:3/477: link d1/l26 d1/df/d2d/la5 0 2024-02-28T16:24:09.034 INFO:tasks.workunit.client.0.smithi023.stdout:4/426: dwrite d13/d1d/d7e/d67/f7d [0,4194304] 0 2024-02-28T16:24:09.038 INFO:tasks.workunit.client.0.smithi023.stdout:9/433: dwrite d0/d7/db/d18/f7c [0,4194304] 0 2024-02-28T16:24:09.040 INFO:tasks.workunit.client.0.smithi023.stdout:8/541: write d0/d5/f40 [3900649,111576] 0 2024-02-28T16:24:09.042 INFO:tasks.workunit.client.0.smithi023.stdout:1/492: dwrite df/d11/d13/d1b/d30/d3d/f81 [0,4194304] 0 2024-02-28T16:24:09.044 INFO:tasks.workunit.client.0.smithi023.stdout:9/434: chown d0/d7/db/d18/d23/d28/d32 21 1 2024-02-28T16:24:09.051 INFO:tasks.workunit.client.0.smithi023.stdout:9/435: chown d0/d7/de/d2e/d2f/d4d/c58 363854 1 2024-02-28T16:24:09.057 INFO:tasks.workunit.client.0.smithi023.stdout:9/436: stat d0/d7/db/d18/d23/l86 0 2024-02-28T16:24:09.060 INFO:tasks.workunit.client.0.smithi023.stdout:8/542: rmdir d0 39 2024-02-28T16:24:09.068 INFO:tasks.workunit.client.0.smithi023.stdout:4/427: rename d13/d1d/c24 to d13/c86 0 2024-02-28T16:24:09.070 INFO:tasks.workunit.client.0.smithi023.stdout:3/478: dwrite d1/df/d33/d38/f48 [0,4194304] 0 2024-02-28T16:24:09.073 INFO:tasks.workunit.client.0.smithi023.stdout:9/437: rmdir d0/d7/db/d18/d23/d28/d32/d3c 39 2024-02-28T16:24:09.081 INFO:tasks.workunit.client.0.smithi023.stdout:6/535: getdents d1/d28/d1e/d2b/d44/d86 0 2024-02-28T16:24:09.087 INFO:tasks.workunit.client.0.smithi023.stdout:6/536: truncate d1/d18/d26/d3a/f97 108486 0 2024-02-28T16:24:09.090 INFO:tasks.workunit.client.0.smithi023.stdout:3/479: dwrite d1/df/f60 [0,4194304] 0 2024-02-28T16:24:09.097 INFO:tasks.workunit.client.0.smithi023.stdout:9/438: symlink d0/d7/de/d2e/l90 0 2024-02-28T16:24:09.107 INFO:tasks.workunit.client.0.smithi023.stdout:4/428: dwrite d13/d1d/d2d/f47 [8388608,4194304] 0 2024-02-28T16:24:09.112 INFO:tasks.workunit.client.0.smithi023.stdout:9/439: symlink d0/d7/db/d18/d23/d28/d6e/l91 0 2024-02-28T16:24:09.112 INFO:tasks.workunit.client.0.smithi023.stdout:3/480: link d1/df/d33/d38/d6c/f87 d1/df/d2d/d32/d3f/fa6 0 2024-02-28T16:24:09.119 INFO:tasks.workunit.client.0.smithi023.stdout:1/493: dwrite df/d11/d13/d1b/d30/f4b [0,4194304] 0 2024-02-28T16:24:09.121 INFO:tasks.workunit.client.0.smithi023.stdout:8/543: truncate d0/d5/d1a/f2e 200810 0 2024-02-28T16:24:09.125 INFO:tasks.workunit.client.0.smithi023.stdout:3/481: unlink d1/df/d3d/d57/f71 0 2024-02-28T16:24:09.127 INFO:tasks.workunit.client.0.smithi023.stdout:6/537: truncate d1/d28/d1e/d52/daf/fb1 1136097 0 2024-02-28T16:24:09.131 INFO:tasks.workunit.client.0.smithi023.stdout:8/544: symlink d0/d5/d1b/d7f/lb8 0 2024-02-28T16:24:09.132 INFO:tasks.workunit.client.0.smithi023.stdout:6/538: chown d1/f1b 6 1 2024-02-28T16:24:09.133 INFO:tasks.workunit.client.0.smithi023.stdout:4/429: dwrite d13/d1d/d7e/d55/f6c [0,4194304] 0 2024-02-28T16:24:09.137 INFO:tasks.workunit.client.0.smithi023.stdout:3/482: mkdir d1/df/d33/d38/da7 0 2024-02-28T16:24:09.143 INFO:tasks.workunit.client.0.smithi023.stdout:6/539: creat d1/d28/d1e/d2b/d44/da4/fc9 x:0 0 0 2024-02-28T16:24:09.143 INFO:tasks.workunit.client.0.smithi023.stdout:1/494: creat df/d11/d13/d1b/d30/d57/d5a/da6/fad x:0 0 0 2024-02-28T16:24:09.144 INFO:tasks.workunit.client.0.smithi023.stdout:6/540: write d1/d28/d1e/d2b/d6d/d7b/fb5 [1830398,47177] 0 2024-02-28T16:24:09.148 INFO:tasks.workunit.client.0.smithi023.stdout:8/545: rename d0/d5/d35/f5f to d0/fb9 0 2024-02-28T16:24:09.151 INFO:tasks.workunit.client.0.smithi023.stdout:1/495: truncate f4 5066234 0 2024-02-28T16:24:09.152 INFO:tasks.workunit.client.0.smithi023.stdout:6/541: fdatasync d1/d18/d26/f38 0 2024-02-28T16:24:09.155 INFO:tasks.workunit.client.0.smithi023.stdout:8/546: rmdir d0/d5/d1a/d2d 39 2024-02-28T16:24:09.161 INFO:tasks.workunit.client.0.smithi023.stdout:3/483: dwrite d1/df/d2d/f8c [0,4194304] 0 2024-02-28T16:24:09.162 INFO:tasks.workunit.client.0.smithi023.stdout:6/542: creat d1/d18/fca x:0 0 0 2024-02-28T16:24:09.165 INFO:tasks.workunit.client.0.smithi023.stdout:4/430: dwrite d13/d2b/d2c/d31/d6e/f7b [0,4194304] 0 2024-02-28T16:24:09.168 INFO:tasks.workunit.client.0.smithi023.stdout:8/547: mkdir d0/d5/d1b/d36/dba 0 2024-02-28T16:24:09.172 INFO:tasks.workunit.client.0.smithi023.stdout:8/548: fdatasync d0/d5/f26 0 2024-02-28T16:24:09.174 INFO:tasks.workunit.client.0.smithi023.stdout:4/431: fdatasync d13/d1d/f33 0 2024-02-28T16:24:09.182 INFO:tasks.workunit.client.0.smithi023.stdout:4/432: mknod d13/d1d/d7e/d67/c87 0 2024-02-28T16:24:09.182 INFO:tasks.workunit.client.0.smithi023.stdout:8/549: write d0/d5/d1a/d2d/d67/daf/f9a [937735,14954] 0 2024-02-28T16:24:09.183 INFO:tasks.workunit.client.0.smithi023.stdout:6/543: dread d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:24:09.184 INFO:tasks.workunit.client.0.smithi023.stdout:4/433: write d13/d1d/f25 [1292936,36415] 0 2024-02-28T16:24:09.190 INFO:tasks.workunit.client.0.smithi023.stdout:8/550: mkdir d0/d5/d1a/d2d/d67/d71/d9e/dbb 0 2024-02-28T16:24:09.193 INFO:tasks.workunit.client.0.smithi023.stdout:4/434: symlink d13/d1d/d7e/d55/l88 0 2024-02-28T16:24:09.194 INFO:tasks.workunit.client.0.smithi023.stdout:3/484: getdents d1/df/d3d/d57/d61 0 2024-02-28T16:24:09.245 INFO:tasks.workunit.client.0.smithi023.stdout:7/413: sync 2024-02-28T16:24:09.250 INFO:tasks.workunit.client.0.smithi023.stdout:7/414: dread de/d13/d1b/f4c [0,4194304] 0 2024-02-28T16:24:09.288 INFO:tasks.workunit.client.0.smithi023.stdout:8/551: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/fbc x:0 0 0 2024-02-28T16:24:09.291 INFO:tasks.workunit.client.0.smithi023.stdout:3/485: unlink d1/df/d3d/f47 0 2024-02-28T16:24:09.297 INFO:tasks.workunit.client.0.smithi023.stdout:4/435: getdents d13/d2b/d2c/d31/d6e/d80 0 2024-02-28T16:24:09.302 INFO:tasks.workunit.client.0.smithi023.stdout:7/415: unlink de/l33 0 2024-02-28T16:24:09.303 INFO:tasks.workunit.client.0.smithi023.stdout:6/544: link d1/d18/d26/d3a/l3b d1/d28/d1e/lcb 0 2024-02-28T16:24:09.306 INFO:tasks.workunit.client.0.smithi023.stdout:4/436: stat d13/d1d/d58/l78 0 2024-02-28T16:24:09.316 INFO:tasks.workunit.client.0.smithi023.stdout:3/486: rmdir d1/d74/da3 0 2024-02-28T16:24:09.317 INFO:tasks.workunit.client.0.smithi023.stdout:7/416: creat de/d72/f85 x:0 0 0 2024-02-28T16:24:09.323 INFO:tasks.workunit.client.0.smithi023.stdout:6/545: dwrite d1/f40 [4194304,4194304] 0 2024-02-28T16:24:09.324 INFO:tasks.workunit.client.0.smithi023.stdout:7/417: creat de/d1c/d76/f86 x:0 0 0 2024-02-28T16:24:09.328 INFO:tasks.workunit.client.0.smithi023.stdout:6/546: fsync d1/d28/d1e/f4e 0 2024-02-28T16:24:09.332 INFO:tasks.workunit.client.0.smithi023.stdout:8/552: dread d0/d5/d1a/d2d/d67/d71/db4/f46 [0,4194304] 0 2024-02-28T16:24:09.336 INFO:tasks.workunit.client.0.smithi023.stdout:8/553: chown d0/d5/d1b 4693 1 2024-02-28T16:24:09.339 INFO:tasks.workunit.client.0.smithi023.stdout:6/547: unlink d1/d28/d1e/c6b 0 2024-02-28T16:24:09.342 INFO:tasks.workunit.client.0.smithi023.stdout:6/548: chown d1/ca3 12 1 2024-02-28T16:24:09.342 INFO:tasks.workunit.client.0.smithi023.stdout:3/487: dwrite d1/f23 [0,4194304] 0 2024-02-28T16:24:09.342 INFO:tasks.workunit.client.0.smithi023.stdout:1/496: dwrite f4 [0,4194304] 0 2024-02-28T16:24:09.343 INFO:tasks.workunit.client.0.smithi023.stdout:8/554: read - d0/d5/d1a/d2d/d67/d71/f9c zero size 2024-02-28T16:24:09.346 INFO:tasks.workunit.client.0.smithi023.stdout:4/437: write d13/f17 [6642781,87358] 0 2024-02-28T16:24:09.346 INFO:tasks.workunit.client.0.smithi023.stdout:7/418: rmdir de/d1c/d76 39 2024-02-28T16:24:09.351 INFO:tasks.workunit.client.0.smithi023.stdout:6/549: truncate d1/d28/d1e/d80/fa7 818679 0 2024-02-28T16:24:09.352 INFO:tasks.workunit.client.0.smithi023.stdout:3/488: mkdir d1/df/d2d/da8 0 2024-02-28T16:24:09.357 INFO:tasks.workunit.client.0.smithi023.stdout:4/438: creat d13/d1d/d2e/f89 x:0 0 0 2024-02-28T16:24:09.361 INFO:tasks.workunit.client.0.smithi023.stdout:1/497: getdents df/d11/d13/d1b/d30/d57/d78 0 2024-02-28T16:24:09.366 INFO:tasks.workunit.client.0.smithi023.stdout:3/489: rename d1/df/d2d/d45/f56 to d1/df/d33/d38/d6c/fa9 0 2024-02-28T16:24:09.369 INFO:tasks.workunit.client.0.smithi023.stdout:1/498: truncate df/d26/d48/f94 814097 0 2024-02-28T16:24:09.376 INFO:tasks.workunit.client.0.smithi023.stdout:7/419: link de/d13/f6d de/d1c/f87 0 2024-02-28T16:24:09.377 INFO:tasks.workunit.client.0.smithi023.stdout:8/555: getdents d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69 0 2024-02-28T16:24:09.377 INFO:tasks.workunit.client.0.smithi023.stdout:3/490: creat d1/df/d2d/d45/d52/d65/d89/faa x:0 0 0 2024-02-28T16:24:09.383 INFO:tasks.workunit.client.0.smithi023.stdout:1/499: mkdir df/d11/d13/d1b/d30/dae 0 2024-02-28T16:24:09.386 INFO:tasks.workunit.client.0.smithi023.stdout:8/556: symlink d0/d5/d1a/d2d/d67/d71/db4/d39/lbd 0 2024-02-28T16:24:09.388 INFO:tasks.workunit.client.0.smithi023.stdout:7/420: truncate de/d13/d1b/f34 4862411 0 2024-02-28T16:24:09.388 INFO:tasks.workunit.client.0.smithi023.stdout:3/491: mknod d1/df/d2d/d45/d52/d65/d89/cab 0 2024-02-28T16:24:09.389 INFO:tasks.workunit.client.0.smithi023.stdout:6/550: dwrite d1/d18/f8c [0,4194304] 0 2024-02-28T16:24:09.400 INFO:tasks.workunit.client.0.smithi023.stdout:4/439: dwrite d13/d2b/f5d [0,4194304] 0 2024-02-28T16:24:09.401 INFO:tasks.workunit.client.0.smithi023.stdout:2/535: sync 2024-02-28T16:24:09.406 INFO:tasks.workunit.client.0.smithi023.stdout:3/492: read d1/df/d33/d38/d6c/fa9 [2994413,102306] 0 2024-02-28T16:24:09.410 INFO:tasks.workunit.client.0.smithi023.stdout:2/536: stat d5/dc/f34 0 2024-02-28T16:24:09.417 INFO:tasks.workunit.client.0.smithi023.stdout:2/537: write d5/da/d45/f86 [803037,89312] 0 2024-02-28T16:24:09.426 INFO:tasks.workunit.client.0.smithi023.stdout:2/538: dread - d5/da/d1b/f85 zero size 2024-02-28T16:24:09.427 INFO:tasks.workunit.client.0.smithi023.stdout:3/493: rmdir d1/df/d33/d38/da7 0 2024-02-28T16:24:09.427 INFO:tasks.workunit.client.0.smithi023.stdout:1/500: dwrite df/d11/d13/f2c [4194304,4194304] 0 2024-02-28T16:24:09.429 INFO:tasks.workunit.client.0.smithi023.stdout:4/440: link cc d13/d1d/d85/c8a 0 2024-02-28T16:24:09.433 INFO:tasks.workunit.client.0.smithi023.stdout:7/421: dwrite de/d13/d1b/d40/f44 [0,4194304] 0 2024-02-28T16:24:09.437 INFO:tasks.workunit.client.0.smithi023.stdout:3/494: chown d1/df/d2d/d32/d3f/l68 1 1 2024-02-28T16:24:09.439 INFO:tasks.workunit.client.0.smithi023.stdout:7/422: stat de/d13/l39 0 2024-02-28T16:24:09.443 INFO:tasks.workunit.client.0.smithi023.stdout:6/551: dwrite d1/d28/d1e/d2b/d44/da4/fc9 [0,4194304] 0 2024-02-28T16:24:09.443 INFO:tasks.workunit.client.0.smithi023.stdout:8/557: dread d0/d5/d1a/d2d/d67/d71/db4/d39/f3b [0,4194304] 0 2024-02-28T16:24:09.455 INFO:tasks.workunit.client.0.smithi023.stdout:0/451: sync 2024-02-28T16:24:09.455 INFO:tasks.workunit.client.0.smithi023.stdout:5/647: sync 2024-02-28T16:24:09.455 INFO:tasks.workunit.client.0.smithi023.stdout:9/440: sync 2024-02-28T16:24:09.458 INFO:tasks.workunit.client.0.smithi023.stdout:2/539: dread d5/dc/f84 [0,4194304] 0 2024-02-28T16:24:09.459 INFO:tasks.workunit.client.0.smithi023.stdout:9/441: readlink d0/d7/de/d34/l53 0 2024-02-28T16:24:09.460 INFO:tasks.workunit.client.0.smithi023.stdout:6/552: write d1/d28/d1e/d2b/d44/d86/fbd [563902,53039] 0 2024-02-28T16:24:09.463 INFO:tasks.workunit.client.0.smithi023.stdout:7/423: rename de/l35 to de/d72/l88 0 2024-02-28T16:24:09.466 INFO:tasks.workunit.client.0.smithi023.stdout:8/558: rmdir d0/d5/d1b/d7f 39 2024-02-28T16:24:09.468 INFO:tasks.workunit.client.0.smithi023.stdout:7/424: write de/d60/f5e [313223,44574] 0 2024-02-28T16:24:09.472 INFO:tasks.workunit.client.0.smithi023.stdout:4/441: truncate d13/d1d/d7e/f45 36869 0 2024-02-28T16:24:09.472 INFO:tasks.workunit.client.0.smithi023.stdout:3/495: dwrite d1/df/d33/d38/d4c/f82 [0,4194304] 0 2024-02-28T16:24:09.474 INFO:tasks.workunit.client.0.smithi023.stdout:1/501: rename df/d26/c58 to df/d11/d13/d1b/d30/d57/d5a/d68/d6f/caf 0 2024-02-28T16:24:09.476 INFO:tasks.workunit.client.0.smithi023.stdout:1/502: readlink df/l56 0 2024-02-28T16:24:09.478 INFO:tasks.workunit.client.0.smithi023.stdout:9/442: mknod d0/d7/de/d2a/c92 0 2024-02-28T16:24:09.483 INFO:tasks.workunit.client.0.smithi023.stdout:5/648: creat d1/d2a/d32/d37/d3a/d7f/d62/d7b/fcc x:0 0 0 2024-02-28T16:24:09.484 INFO:tasks.workunit.client.0.smithi023.stdout:0/452: write d6/db/d3b/d1f/d82/d72/d79/f8b [988769,121976] 0 2024-02-28T16:24:09.485 INFO:tasks.workunit.client.0.smithi023.stdout:7/425: creat de/d13/d1b/d6c/f89 x:0 0 0 2024-02-28T16:24:09.487 INFO:tasks.workunit.client.0.smithi023.stdout:6/553: rename d1/d28/f3e to d1/d28/d1e/d2b/d6d/d7b/fcc 0 2024-02-28T16:24:09.490 INFO:tasks.workunit.client.0.smithi023.stdout:1/503: mknod df/d11/d8a/cb0 0 2024-02-28T16:24:09.491 INFO:tasks.workunit.client.0.smithi023.stdout:7/426: write de/f82 [244749,5390] 0 2024-02-28T16:24:09.496 INFO:tasks.workunit.client.0.smithi023.stdout:6/554: chown d1/d28/lbf 26 1 2024-02-28T16:24:09.496 INFO:tasks.workunit.client.0.smithi023.stdout:2/540: link d5/da/d1b/d3f/d75/d92/c99 d5/da/d1b/d3f/ca5 0 2024-02-28T16:24:09.498 INFO:tasks.workunit.client.0.smithi023.stdout:9/443: rename d0/d7/ff to d0/d7/db/d18/d23/d28/d6e/f93 0 2024-02-28T16:24:09.499 INFO:tasks.workunit.client.0.smithi023.stdout:0/453: mkdir d6/d98 0 2024-02-28T16:24:09.502 INFO:tasks.workunit.client.0.smithi023.stdout:2/541: write d5/da/f7c [1326144,2581] 0 2024-02-28T16:24:09.510 INFO:tasks.workunit.client.0.smithi023.stdout:8/559: getdents d0/d5/d1a/d2d/d67/d71/db4/d39 0 2024-02-28T16:24:09.513 INFO:tasks.workunit.client.0.smithi023.stdout:4/442: truncate f5 4075713 0 2024-02-28T16:24:09.516 INFO:tasks.workunit.client.0.smithi023.stdout:3/496: getdents d1/df/d2d/d45/d52/d65/d89 0 2024-02-28T16:24:09.520 INFO:tasks.workunit.client.0.smithi023.stdout:1/504: dwrite df/d11/d13/d1b/d30/d57/d5a/faa [0,4194304] 0 2024-02-28T16:24:09.522 INFO:tasks.workunit.client.0.smithi023.stdout:7/427: mknod de/d1c/c8a 0 2024-02-28T16:24:09.523 INFO:tasks.workunit.client.0.smithi023.stdout:5/649: dwrite d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:24:09.523 INFO:tasks.workunit.client.0.smithi023.stdout:9/444: unlink d0/d7/db/f15 0 2024-02-28T16:24:09.525 INFO:tasks.workunit.client.0.smithi023.stdout:0/454: symlink d6/d4c/d6a/l99 0 2024-02-28T16:24:09.528 INFO:tasks.workunit.client.0.smithi023.stdout:9/445: write d0/d7/db/d18/d23/d28/d6e/f7f [484583,103462] 0 2024-02-28T16:24:09.531 INFO:tasks.workunit.client.0.smithi023.stdout:6/555: mknod d1/d28/d1e/d80/dc2/ccd 0 2024-02-28T16:24:09.539 INFO:tasks.workunit.client.0.smithi023.stdout:3/497: mknod d1/df/d2d/d9d/cac 0 2024-02-28T16:24:09.542 INFO:tasks.workunit.client.0.smithi023.stdout:7/428: fsync de/d13/f6d 0 2024-02-28T16:24:09.553 INFO:tasks.workunit.client.0.smithi023.stdout:4/443: symlink d13/d2b/l8b 0 2024-02-28T16:24:09.555 INFO:tasks.workunit.client.0.smithi023.stdout:6/556: creat d1/d28/d1e/d2b/d76/d9e/fce x:0 0 0 2024-02-28T16:24:09.558 INFO:tasks.workunit.client.0.smithi023.stdout:5/650: dread d1/d2a/d32/d37/f38 [0,4194304] 0 2024-02-28T16:24:09.558 INFO:tasks.workunit.client.0.smithi023.stdout:3/498: creat d1/df/d2d/d32/fad x:0 0 0 2024-02-28T16:24:09.563 INFO:tasks.workunit.client.0.smithi023.stdout:0/455: readlink d6/db/d1a/d26/l5e 0 2024-02-28T16:24:09.567 INFO:tasks.workunit.client.0.smithi023.stdout:8/560: rename d0/d5/f40 to d0/d5/d1a/fbe 0 2024-02-28T16:24:09.569 INFO:tasks.workunit.client.0.smithi023.stdout:8/561: chown d0/d5/d1a/d2d/f61 33265 1 2024-02-28T16:24:09.569 INFO:tasks.workunit.client.0.smithi023.stdout:6/557: creat d1/d18/d26/da6/fcf x:0 0 0 2024-02-28T16:24:09.574 INFO:tasks.workunit.client.0.smithi023.stdout:3/499: write d1/df/f19 [2737393,2934] 0 2024-02-28T16:24:09.577 INFO:tasks.workunit.client.0.smithi023.stdout:2/542: getdents d5/da/d1b/d3f/d75 0 2024-02-28T16:24:09.577 INFO:tasks.workunit.client.0.smithi023.stdout:6/558: dread d1/d28/d1e/d2b/d44/f53 [0,4194304] 0 2024-02-28T16:24:09.580 INFO:tasks.workunit.client.0.smithi023.stdout:9/446: truncate d0/d7/db/d18/d23/d28/f54 2627103 0 2024-02-28T16:24:09.585 INFO:tasks.workunit.client.0.smithi023.stdout:1/505: rename df/d11/d13/d1b/d30/d3d/f4e to df/d11/d13/d1b/d30/d57/d5a/d68/d7a/fb1 0 2024-02-28T16:24:09.587 INFO:tasks.workunit.client.0.smithi023.stdout:8/562: mkdir d0/d5/d35/dbf 0 2024-02-28T16:24:09.593 INFO:tasks.workunit.client.0.smithi023.stdout:1/506: write df/d11/d13/d1b/d30/d3d/f81 [3794691,124105] 0 2024-02-28T16:24:09.597 INFO:tasks.workunit.client.0.smithi023.stdout:7/429: truncate de/d13/d1b/d3d/d53/f6e 3687055 0 2024-02-28T16:24:09.597 INFO:tasks.workunit.client.0.smithi023.stdout:3/500: readlink d1/df/l10 0 2024-02-28T16:24:09.598 INFO:tasks.workunit.client.0.smithi023.stdout:6/559: symlink d1/d28/d1e/dae/ld0 0 2024-02-28T16:24:09.599 INFO:tasks.workunit.client.0.smithi023.stdout:7/430: read de/ff [3219666,78078] 0 2024-02-28T16:24:09.600 INFO:tasks.workunit.client.0.smithi023.stdout:0/456: truncate d6/db/fd 1461010 0 2024-02-28T16:24:09.600 INFO:tasks.workunit.client.0.smithi023.stdout:7/431: readlink de/l46 0 2024-02-28T16:24:09.601 INFO:tasks.workunit.client.0.smithi023.stdout:1/507: truncate df/d11/d13/f62 2599216 0 2024-02-28T16:24:09.607 INFO:tasks.workunit.client.0.smithi023.stdout:0/457: fsync d6/db/d3b/d1f/f4b 0 2024-02-28T16:24:09.609 INFO:tasks.workunit.client.0.smithi023.stdout:3/501: creat d1/d4a/fae x:0 0 0 2024-02-28T16:24:09.615 INFO:tasks.workunit.client.0.smithi023.stdout:0/458: write d6/db/d1a/d26/d31/d33/d6e/f6f [262131,45531] 0 2024-02-28T16:24:09.620 INFO:tasks.workunit.client.0.smithi023.stdout:5/651: dwrite d1/d2a/d32/d37/d3a/d7f/f3c [0,4194304] 0 2024-02-28T16:24:09.625 INFO:tasks.workunit.client.0.smithi023.stdout:2/543: write d5/da/db/f23 [4169195,102874] 0 2024-02-28T16:24:09.636 INFO:tasks.workunit.client.0.smithi023.stdout:4/444: rename d13/d2b/l42 to d13/d2b/d2c/d31/l8c 0 2024-02-28T16:24:09.642 INFO:tasks.workunit.client.0.smithi023.stdout:0/459: mknod d6/db/d1a/d26/d31/c9a 0 2024-02-28T16:24:09.643 INFO:tasks.workunit.client.0.smithi023.stdout:2/544: creat d5/da/db/d17/d73/d9e/da0/fa6 x:0 0 0 2024-02-28T16:24:09.644 INFO:tasks.workunit.client.0.smithi023.stdout:7/432: mkdir de/d8b 0 2024-02-28T16:24:09.646 INFO:tasks.workunit.client.0.smithi023.stdout:6/560: creat d1/d28/d1e/d2b/fd1 x:0 0 0 2024-02-28T16:24:09.646 INFO:tasks.workunit.client.0.smithi023.stdout:0/460: dread - d6/db/d3b/d1f/d42/f83 zero size 2024-02-28T16:24:09.647 INFO:tasks.workunit.client.0.smithi023.stdout:9/447: getdents d0/d7/de/d2e/d2f/d44 0 2024-02-28T16:24:09.648 INFO:tasks.workunit.client.0.smithi023.stdout:1/508: dread df/fa0 [0,4194304] 0 2024-02-28T16:24:09.657 INFO:tasks.workunit.client.0.smithi023.stdout:9/448: truncate d0/d7/de/d2e/d2f/d4d/f7b 249357 0 2024-02-28T16:24:09.657 INFO:tasks.workunit.client.0.smithi023.stdout:2/545: creat d5/da/db/d17/fa7 x:0 0 0 2024-02-28T16:24:09.661 INFO:tasks.workunit.client.0.smithi023.stdout:2/546: write d5/da/d1b/d3f/f66 [959132,89286] 0 2024-02-28T16:24:09.662 INFO:tasks.workunit.client.0.smithi023.stdout:6/561: creat d1/d18/d26/d3a/fd2 x:0 0 0 2024-02-28T16:24:09.665 INFO:tasks.workunit.client.0.smithi023.stdout:6/562: chown d1/d28/d1e/d2b/d44 771571 1 2024-02-28T16:24:09.671 INFO:tasks.workunit.client.0.smithi023.stdout:1/509: dwrite f4 [0,4194304] 0 2024-02-28T16:24:09.673 INFO:tasks.workunit.client.0.smithi023.stdout:0/461: write d6/db/f71 [95029,81623] 0 2024-02-28T16:24:09.674 INFO:tasks.workunit.client.0.smithi023.stdout:5/652: rename d1/d2a/d32/d58/d60/d88/db9 to d1/d2a/d32/d37/dcd 0 2024-02-28T16:24:09.675 INFO:tasks.workunit.client.0.smithi023.stdout:6/563: write d1/d28/d1e/d52/f5b [3052883,2953] 0 2024-02-28T16:24:09.679 INFO:tasks.workunit.client.0.smithi023.stdout:6/564: dread - d1/d18/d26/fa8 zero size 2024-02-28T16:24:09.679 INFO:tasks.workunit.client.0.smithi023.stdout:3/502: write d1/df/d2d/d32/d3f/f90 [614614,98522] 0 2024-02-28T16:24:09.679 INFO:tasks.workunit.client.0.smithi023.stdout:5/653: fsync d1/d2a/d32/d37/d3a/f7e 0 2024-02-28T16:24:09.685 INFO:tasks.workunit.client.0.smithi023.stdout:0/462: mknod d6/c9b 0 2024-02-28T16:24:09.685 INFO:tasks.workunit.client.0.smithi023.stdout:1/510: unlink df/d26/d48/f70 0 2024-02-28T16:24:09.686 INFO:tasks.workunit.client.0.smithi023.stdout:2/547: write d5/dc/f30 [2234478,49438] 0 2024-02-28T16:24:09.686 INFO:tasks.workunit.client.0.smithi023.stdout:9/449: write d0/d7/db/f8f [742277,119974] 0 2024-02-28T16:24:09.694 INFO:tasks.workunit.client.0.smithi023.stdout:3/503: unlink d1/df/d33/d38/d6c/c9b 0 2024-02-28T16:24:09.700 INFO:tasks.workunit.client.0.smithi023.stdout:7/433: dread de/d13/d1b/f34 [0,4194304] 0 2024-02-28T16:24:09.702 INFO:tasks.workunit.client.0.smithi023.stdout:3/504: rmdir d1/df/d3d 39 2024-02-28T16:24:09.705 INFO:tasks.workunit.client.0.smithi023.stdout:1/511: mkdir df/d11/d13/d1b/d30/d57/d78/db2 0 2024-02-28T16:24:09.711 INFO:tasks.workunit.client.0.smithi023.stdout:9/450: read d0/d7/de/d2e/d2f/d4d/f7b [167245,122843] 0 2024-02-28T16:24:09.712 INFO:tasks.workunit.client.0.smithi023.stdout:4/445: dwrite d13/f1b [4194304,4194304] 0 2024-02-28T16:24:09.716 INFO:tasks.workunit.client.0.smithi023.stdout:7/434: chown de/d1c/d76 44175 1 2024-02-28T16:24:09.722 INFO:tasks.workunit.client.0.smithi023.stdout:4/446: chown c11 2 1 2024-02-28T16:24:09.727 INFO:tasks.workunit.client.0.smithi023.stdout:0/463: dwrite d6/db/d1a/d26/d31/d33/d6e/f6f [0,4194304] 0 2024-02-28T16:24:09.728 INFO:tasks.workunit.client.0.smithi023.stdout:1/512: mkdir df/d26/d48/db3 0 2024-02-28T16:24:09.730 INFO:tasks.workunit.client.0.smithi023.stdout:5/654: dwrite d1/d2a/d32/d58/d79/f91 [0,4194304] 0 2024-02-28T16:24:09.735 INFO:tasks.workunit.client.0.smithi023.stdout:3/505: rename d1/df/d33/d38/d4c/f82 to d1/df/d3d/d57/d61/faf 0 2024-02-28T16:24:09.738 INFO:tasks.workunit.client.0.smithi023.stdout:6/565: dread d1/f2f [0,4194304] 0 2024-02-28T16:24:09.739 INFO:tasks.workunit.client.0.smithi023.stdout:2/548: truncate d5/da/d1b/d3f/f66 705052 0 2024-02-28T16:24:09.745 INFO:tasks.workunit.client.0.smithi023.stdout:4/447: mkdir d13/d2b/d2c/d31/d8d 0 2024-02-28T16:24:09.745 INFO:tasks.workunit.client.0.smithi023.stdout:7/435: symlink de/d1c/l8c 0 2024-02-28T16:24:09.745 INFO:tasks.workunit.client.0.smithi023.stdout:1/513: creat df/d11/d13/d1b/d30/d57/d5a/d68/d6f/fb4 x:0 0 0 2024-02-28T16:24:09.746 INFO:tasks.workunit.client.0.smithi023.stdout:8/563: sync 2024-02-28T16:24:09.746 INFO:tasks.workunit.client.0.smithi023.stdout:0/464: readlink d6/db/d1a/d59/l95 0 2024-02-28T16:24:09.747 INFO:tasks.workunit.client.0.smithi023.stdout:5/655: creat d1/d2a/d32/d37/d4e/db5/fce x:0 0 0 2024-02-28T16:24:09.753 INFO:tasks.workunit.client.0.smithi023.stdout:3/506: symlink d1/df/d2d/d45/lb0 0 2024-02-28T16:24:09.755 INFO:tasks.workunit.client.0.smithi023.stdout:5/656: fdatasync d1/d2a/d32/d37/d3a/d7f/d62/d68/f8c 0 2024-02-28T16:24:09.757 INFO:tasks.workunit.client.0.smithi023.stdout:3/507: dread - d1/df/d3d/d57/f6d zero size 2024-02-28T16:24:09.763 INFO:tasks.workunit.client.0.smithi023.stdout:7/436: mknod de/d13/d1b/d3d/d53/c8d 0 2024-02-28T16:24:09.764 INFO:tasks.workunit.client.0.smithi023.stdout:9/451: link d0/c8a d0/d7/db/d18/d23/d28/d6e/c94 0 2024-02-28T16:24:09.773 INFO:tasks.workunit.client.0.smithi023.stdout:5/657: creat d1/d2a/d32/d37/d4e/db5/fcf x:0 0 0 2024-02-28T16:24:09.779 INFO:tasks.workunit.client.0.smithi023.stdout:1/514: dread df/d11/d13/d1b/d30/d57/d5a/d68/d7a/fb1 [0,4194304] 0 2024-02-28T16:24:09.779 INFO:tasks.workunit.client.0.smithi023.stdout:3/508: dread d1/df/d3d/d57/d61/faf [0,4194304] 0 2024-02-28T16:24:09.780 INFO:tasks.workunit.client.0.smithi023.stdout:1/515: chown df/d11/d13/d1b/d30/d3d 21401 1 2024-02-28T16:24:09.785 INFO:tasks.workunit.client.0.smithi023.stdout:4/448: dread fb [4194304,4194304] 0 2024-02-28T16:24:09.786 INFO:tasks.workunit.client.0.smithi023.stdout:7/437: creat de/d1c/d76/f8e x:0 0 0 2024-02-28T16:24:09.790 INFO:tasks.workunit.client.0.smithi023.stdout:8/564: dread d0/d5/f41 [0,4194304] 0 2024-02-28T16:24:09.790 INFO:tasks.workunit.client.0.smithi023.stdout:2/549: symlink d5/da/db/d17/d39/d56/la8 0 2024-02-28T16:24:09.792 INFO:tasks.workunit.client.0.smithi023.stdout:8/565: write d0/fb1 [781730,42507] 0 2024-02-28T16:24:09.793 INFO:tasks.workunit.client.0.smithi023.stdout:6/566: link d1/d18/d26/d3a/f4a d1/d28/d1e/dae/fd3 0 2024-02-28T16:24:09.794 INFO:tasks.workunit.client.0.smithi023.stdout:1/516: truncate f2 3090119 0 2024-02-28T16:24:09.796 INFO:tasks.workunit.client.0.smithi023.stdout:2/550: truncate d5/dc/f95 311175 0 2024-02-28T16:24:09.796 INFO:tasks.workunit.client.0.smithi023.stdout:3/509: mknod d1/df/d2d/d45/d52/d65/cb1 0 2024-02-28T16:24:09.799 INFO:tasks.workunit.client.0.smithi023.stdout:0/465: rmdir d6/db/d3b/d1f/d82/d87 0 2024-02-28T16:24:09.800 INFO:tasks.workunit.client.0.smithi023.stdout:2/551: chown d5/da/db/l3b 28938372 1 2024-02-28T16:24:09.802 INFO:tasks.workunit.client.0.smithi023.stdout:1/517: write df/d11/d13/d1b/d30/f69 [3337382,93325] 0 2024-02-28T16:24:09.802 INFO:tasks.workunit.client.0.smithi023.stdout:4/449: creat d13/d1d/d58/f8e x:0 0 0 2024-02-28T16:24:09.803 INFO:tasks.workunit.client.0.smithi023.stdout:3/510: dread - d1/df/d33/d38/d4c/f7c zero size 2024-02-28T16:24:09.804 INFO:tasks.workunit.client.0.smithi023.stdout:4/450: fsync f5 0 2024-02-28T16:24:09.808 INFO:tasks.workunit.client.0.smithi023.stdout:3/511: chown d1/df/d33/d38/d4c/f73 653416 1 2024-02-28T16:24:09.814 INFO:tasks.workunit.client.0.smithi023.stdout:6/567: rmdir d1/d28/d1e/d2b/d44/d86 39 2024-02-28T16:24:09.815 INFO:tasks.workunit.client.0.smithi023.stdout:5/658: write d1/d2a/d32/d37/d3a/f48 [3260555,19843] 0 2024-02-28T16:24:09.816 INFO:tasks.workunit.client.0.smithi023.stdout:9/452: dread d0/f4 [0,4194304] 0 2024-02-28T16:24:09.820 INFO:tasks.workunit.client.0.smithi023.stdout:9/453: stat d0/d7/de/d2a 0 2024-02-28T16:24:09.824 INFO:tasks.workunit.client.0.smithi023.stdout:0/466: rmdir d6/db/d1a/d26/d31 39 2024-02-28T16:24:09.827 INFO:tasks.workunit.client.0.smithi023.stdout:0/467: read - d6/db/d3b/f96 zero size 2024-02-28T16:24:09.831 INFO:tasks.workunit.client.0.smithi023.stdout:6/568: mkdir d1/d28/d1e/d52/dd4 0 2024-02-28T16:24:09.834 INFO:tasks.workunit.client.0.smithi023.stdout:5/659: rename d1/d2a/d32/d58/d73/l61 to d1/d2a/d32/d37/d3a/d7f/dca/ld0 0 2024-02-28T16:24:09.835 INFO:tasks.workunit.client.0.smithi023.stdout:8/566: dwrite d0/d5/d35/f5d [0,4194304] 0 2024-02-28T16:24:09.838 INFO:tasks.workunit.client.0.smithi023.stdout:1/518: dwrite df/d11/d8a/fa8 [0,4194304] 0 2024-02-28T16:24:09.841 INFO:tasks.workunit.client.0.smithi023.stdout:7/438: creat de/d13/f8f x:0 0 0 2024-02-28T16:24:09.850 INFO:tasks.workunit.client.0.smithi023.stdout:4/451: unlink d13/d2b/d2c/l7f 0 2024-02-28T16:24:09.858 INFO:tasks.workunit.client.0.smithi023.stdout:6/569: symlink d1/d18/ld5 0 2024-02-28T16:24:09.858 INFO:tasks.workunit.client.0.smithi023.stdout:2/552: dwrite d5/da/d1b/d3f/f53 [0,4194304] 0 2024-02-28T16:24:09.864 INFO:tasks.workunit.client.0.smithi023.stdout:3/512: creat d1/df/d2d/d45/d52/fb2 x:0 0 0 2024-02-28T16:24:09.871 INFO:tasks.workunit.client.0.smithi023.stdout:9/454: dwrite d0/d7/d2c/d57/f65 [0,4194304] 0 2024-02-28T16:24:09.876 INFO:tasks.workunit.client.0.smithi023.stdout:7/439: unlink de/d13/d1b/d3d/d53/l57 0 2024-02-28T16:24:09.879 INFO:tasks.workunit.client.0.smithi023.stdout:4/452: rmdir d13/d2b/d2c/d31/d6e 39 2024-02-28T16:24:09.885 INFO:tasks.workunit.client.0.smithi023.stdout:5/660: mkdir d1/d2a/d32/d37/d3a/d7f/d62/dd1 0 2024-02-28T16:24:09.885 INFO:tasks.workunit.client.0.smithi023.stdout:0/468: dwrite d6/db/d3b/d1f/d42/f4a [4194304,4194304] 0 2024-02-28T16:24:09.886 INFO:tasks.workunit.client.0.smithi023.stdout:2/553: dread d5/da/f54 [0,4194304] 0 2024-02-28T16:24:09.886 INFO:tasks.workunit.client.0.smithi023.stdout:9/455: readlink d0/d7/db/d18/d23/d28/l33 0 2024-02-28T16:24:09.888 INFO:tasks.workunit.client.0.smithi023.stdout:5/661: chown d1/d2a/d32/d37 1898191297 1 2024-02-28T16:24:09.890 INFO:tasks.workunit.client.0.smithi023.stdout:6/570: mkdir d1/d3d/dd6 0 2024-02-28T16:24:09.890 INFO:tasks.workunit.client.0.smithi023.stdout:8/567: write d0/d5/d1a/f4b [258294,47345] 0 2024-02-28T16:24:09.892 INFO:tasks.workunit.client.0.smithi023.stdout:9/456: readlink d0/d7/db/d18/d23/l86 0 2024-02-28T16:24:09.903 INFO:tasks.workunit.client.0.smithi023.stdout:3/513: fdatasync d1/df/d3d/f62 0 2024-02-28T16:24:09.917 INFO:tasks.workunit.client.0.smithi023.stdout:4/453: symlink d13/d1d/d2d/l8f 0 2024-02-28T16:24:09.921 INFO:tasks.workunit.client.0.smithi023.stdout:2/554: rename d5/da/d45/f50 to d5/da/d1b/d3f/d75/d92/fa9 0 2024-02-28T16:24:09.929 INFO:tasks.workunit.client.0.smithi023.stdout:9/457: dwrite d0/d7/db/f8f [0,4194304] 0 2024-02-28T16:24:09.929 INFO:tasks.workunit.client.0.smithi023.stdout:1/519: dwrite df/d11/d13/d1b/d30/d57/f85 [0,4194304] 0 2024-02-28T16:24:09.931 INFO:tasks.workunit.client.0.smithi023.stdout:3/514: symlink d1/df/d3d/d57/d61/lb3 0 2024-02-28T16:24:09.933 INFO:tasks.workunit.client.0.smithi023.stdout:8/568: dread d0/d5/d1a/d2d/d67/daf/f9a [0,4194304] 0 2024-02-28T16:24:09.936 INFO:tasks.workunit.client.0.smithi023.stdout:3/515: chown d1/df/d3d/d57/d61/faf 21180730 1 2024-02-28T16:24:09.940 INFO:tasks.workunit.client.0.smithi023.stdout:5/662: dwrite d1/d2a/d32/d58/d79/fa3 [0,4194304] 0 2024-02-28T16:24:09.941 INFO:tasks.workunit.client.0.smithi023.stdout:0/469: mkdir d6/db/d1a/d26/d9c 0 2024-02-28T16:24:09.943 INFO:tasks.workunit.client.0.smithi023.stdout:7/440: rename de/d13/d1b/f2e to de/d13/d1b/d3d/d53/f90 0 2024-02-28T16:24:09.948 INFO:tasks.workunit.client.0.smithi023.stdout:5/663: fdatasync d1/d2a/d32/d58/d60/d88/d89/f97 0 2024-02-28T16:24:09.953 INFO:tasks.workunit.client.0.smithi023.stdout:2/555: readlink d5/da/db/d17/l78 0 2024-02-28T16:24:09.961 INFO:tasks.workunit.client.0.smithi023.stdout:1/520: rmdir df 39 2024-02-28T16:24:09.966 INFO:tasks.workunit.client.0.smithi023.stdout:8/569: creat d0/d5/d1a/d2d/d67/d71/db4/d39/fc0 x:0 0 0 2024-02-28T16:24:09.968 INFO:tasks.workunit.client.0.smithi023.stdout:9/458: mkdir d0/d7/de/d2e/d2f/d44/d95 0 2024-02-28T16:24:09.976 INFO:tasks.workunit.client.0.smithi023.stdout:0/470: mkdir d6/db/d1a/d35/d9d 0 2024-02-28T16:24:09.985 INFO:tasks.workunit.client.0.smithi023.stdout:2/556: creat d5/da/d45/d6a/faa x:0 0 0 2024-02-28T16:24:09.988 INFO:tasks.workunit.client.0.smithi023.stdout:8/570: dread d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/f48 [4194304,4194304] 0 2024-02-28T16:24:09.990 INFO:tasks.workunit.client.0.smithi023.stdout:1/521: chown df/d11/d13/d1b/d2e/d5c/c9a 4697 1 2024-02-28T16:24:09.995 INFO:tasks.workunit.client.0.smithi023.stdout:6/571: getdents d1/d28/d1e/d52/daf 0 2024-02-28T16:24:09.997 INFO:tasks.workunit.client.0.smithi023.stdout:7/441: creat de/d1c/d76/d7b/f91 x:0 0 0 2024-02-28T16:24:10.001 INFO:tasks.workunit.client.0.smithi023.stdout:2/557: creat d5/da/d1b/d3f/d75/fab x:0 0 0 2024-02-28T16:24:10.004 INFO:tasks.workunit.client.0.smithi023.stdout:5/664: dwrite d1/d2a/d32/d58/d60/f90 [0,4194304] 0 2024-02-28T16:24:10.004 INFO:tasks.workunit.client.0.smithi023.stdout:1/522: rmdir df/d26 39 2024-02-28T16:24:10.004 INFO:tasks.workunit.client.0.smithi023.stdout:2/558: dread - d5/f76 zero size 2024-02-28T16:24:10.007 INFO:tasks.workunit.client.0.smithi023.stdout:2/559: stat d5/da/c13 0 2024-02-28T16:24:10.008 INFO:tasks.workunit.client.0.smithi023.stdout:8/571: rename d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/l77 to d0/d5/d1a/d63/d90/dac/lc1 0 2024-02-28T16:24:10.009 INFO:tasks.workunit.client.0.smithi023.stdout:4/454: mkdir d13/d1d/d58/d7a/d90 0 2024-02-28T16:24:10.011 INFO:tasks.workunit.client.0.smithi023.stdout:9/459: dwrite d0/d7/d2c/d57/f76 [0,4194304] 0 2024-02-28T16:24:10.013 INFO:tasks.workunit.client.0.smithi023.stdout:9/460: readlink d0/d7/d2c/l89 0 2024-02-28T16:24:10.022 INFO:tasks.workunit.client.0.smithi023.stdout:3/516: getdents d1/d74/d94 0 2024-02-28T16:24:10.024 INFO:tasks.workunit.client.0.smithi023.stdout:3/517: dread - d1/df/d2d/d45/d52/f9a zero size 2024-02-28T16:24:10.030 INFO:tasks.workunit.client.0.smithi023.stdout:5/665: creat d1/d2a/d32/d58/d73/fd2 x:0 0 0 2024-02-28T16:24:10.032 INFO:tasks.workunit.client.0.smithi023.stdout:2/560: fdatasync d5/da/d1b/f36 0 2024-02-28T16:24:10.033 INFO:tasks.workunit.client.0.smithi023.stdout:3/518: write d1/df/d33/d38/d4c/f63 [179080,19383] 0 2024-02-28T16:24:10.034 INFO:tasks.workunit.client.0.smithi023.stdout:8/572: unlink d0/d5/d1a/d44/f76 0 2024-02-28T16:24:10.037 INFO:tasks.workunit.client.0.smithi023.stdout:2/561: write d5/da/db/f51 [1051385,10265] 0 2024-02-28T16:24:10.041 INFO:tasks.workunit.client.0.smithi023.stdout:9/461: rmdir d0/d7/de/d2e/d2f/d4d 39 2024-02-28T16:24:10.046 INFO:tasks.workunit.client.0.smithi023.stdout:1/523: fdatasync df/d26/f35 0 2024-02-28T16:24:10.046 INFO:tasks.workunit.client.0.smithi023.stdout:7/442: dread de/d1c/f68 [0,4194304] 0 2024-02-28T16:24:10.052 INFO:tasks.workunit.client.0.smithi023.stdout:5/666: dwrite d1/d2a/d32/d58/d79/fac [0,4194304] 0 2024-02-28T16:24:10.056 INFO:tasks.workunit.client.0.smithi023.stdout:5/667: chown d1/d2a/d32/d37/d3a/d7f/d62/f6b 9518838 1 2024-02-28T16:24:10.057 INFO:tasks.workunit.client.0.smithi023.stdout:2/562: fdatasync d5/dc/f84 0 2024-02-28T16:24:10.059 INFO:tasks.workunit.client.0.smithi023.stdout:5/668: stat d1/d2a/d32/d37/d4e/db5 0 2024-02-28T16:24:10.060 INFO:tasks.workunit.client.0.smithi023.stdout:0/471: getdents d6/db/d1a/d59 0 2024-02-28T16:24:10.060 INFO:tasks.workunit.client.0.smithi023.stdout:6/572: dwrite d1/d28/d1e/d52/daf/fb1 [0,4194304] 0 2024-02-28T16:24:10.064 INFO:tasks.workunit.client.0.smithi023.stdout:9/462: creat d0/d7/db/d18/f96 x:0 0 0 2024-02-28T16:24:10.071 INFO:tasks.workunit.client.0.smithi023.stdout:7/443: write de/d1c/f68 [3647287,86973] 0 2024-02-28T16:24:10.072 INFO:tasks.workunit.client.0.smithi023.stdout:7/444: chown de/d13 3091 1 2024-02-28T16:24:10.080 INFO:tasks.workunit.client.0.smithi023.stdout:9/463: stat d0/d7/db/d18/d23/d28/d32/l6b 0 2024-02-28T16:24:10.081 INFO:tasks.workunit.client.0.smithi023.stdout:9/464: fdatasync d0/d7/d2c/d84/f88 0 2024-02-28T16:24:10.083 INFO:tasks.workunit.client.0.smithi023.stdout:4/455: rename d13/d1d/d2e/l64 to d13/d2b/l91 0 2024-02-28T16:24:10.086 INFO:tasks.workunit.client.0.smithi023.stdout:2/563: rmdir d5/da/db/d17/d3c 39 2024-02-28T16:24:10.087 INFO:tasks.workunit.client.0.smithi023.stdout:4/456: write d13/d1d/f41 [2270677,116888] 0 2024-02-28T16:24:10.089 INFO:tasks.workunit.client.0.smithi023.stdout:4/457: readlink d13/d1d/d2d/l6a 0 2024-02-28T16:24:10.093 INFO:tasks.workunit.client.0.smithi023.stdout:7/445: dwrite de/d13/d1b/d6c/f71 [0,4194304] 0 2024-02-28T16:24:10.103 INFO:tasks.workunit.client.0.smithi023.stdout:6/573: creat d1/fd7 x:0 0 0 2024-02-28T16:24:10.107 INFO:tasks.workunit.client.0.smithi023.stdout:7/446: creat de/d1c/d76/d7b/f92 x:0 0 0 2024-02-28T16:24:10.109 INFO:tasks.workunit.client.0.smithi023.stdout:7/447: stat de/d1c/c8a 0 2024-02-28T16:24:10.109 INFO:tasks.workunit.client.0.smithi023.stdout:5/669: write d1/f7c [950072,7694] 0 2024-02-28T16:24:10.114 INFO:tasks.workunit.client.0.smithi023.stdout:3/519: rename d1/d74/d94/l96 to d1/df/lb4 0 2024-02-28T16:24:10.117 INFO:tasks.workunit.client.0.smithi023.stdout:3/520: write d1/df/d2d/d32/d3f/f6b [2349439,31996] 0 2024-02-28T16:24:10.118 INFO:tasks.workunit.client.0.smithi023.stdout:6/574: mkdir d1/d18/dd8 0 2024-02-28T16:24:10.119 INFO:tasks.workunit.client.0.smithi023.stdout:3/521: chown d1/df/d3d 4082 1 2024-02-28T16:24:10.119 INFO:tasks.workunit.client.0.smithi023.stdout:6/575: stat d1/d28/d1e/f4e 0 2024-02-28T16:24:10.121 INFO:tasks.workunit.client.0.smithi023.stdout:7/448: creat de/d1c/d76/f93 x:0 0 0 2024-02-28T16:24:10.121 INFO:tasks.workunit.client.0.smithi023.stdout:3/522: chown d1/df/d2d/d32/l35 1 1 2024-02-28T16:24:10.122 INFO:tasks.workunit.client.0.smithi023.stdout:6/576: dread - d1/d18/d26/da6/fcf zero size 2024-02-28T16:24:10.123 INFO:tasks.workunit.client.0.smithi023.stdout:3/523: chown c0 96647 1 2024-02-28T16:24:10.123 INFO:tasks.workunit.client.0.smithi023.stdout:2/564: creat d5/da/db/d17/d73/d9e/fac x:0 0 0 2024-02-28T16:24:10.132 INFO:tasks.workunit.client.0.smithi023.stdout:5/670: dwrite d1/d2a/d32/d37/d3a/d7f/f29 [0,4194304] 0 2024-02-28T16:24:10.134 INFO:tasks.workunit.client.0.smithi023.stdout:8/573: rename d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/f89 to d0/d5/d1a/d2d/d67/d71/d9e/fc2 0 2024-02-28T16:24:10.137 INFO:tasks.workunit.client.0.smithi023.stdout:3/524: write d1/df/d33/d38/d4c/f50 [1401751,44934] 0 2024-02-28T16:24:10.139 INFO:tasks.workunit.client.0.smithi023.stdout:5/671: stat d1/d2a/d32/d37/d3a/fae 0 2024-02-28T16:24:10.142 INFO:tasks.workunit.client.0.smithi023.stdout:4/458: write fe [1306349,115627] 0 2024-02-28T16:24:10.143 INFO:tasks.workunit.client.0.smithi023.stdout:1/524: rename df/d11/d13/d1b/d30/l61 to df/d11/d13/d1b/d30/d57/d5a/d68/lb5 0 2024-02-28T16:24:10.145 INFO:tasks.workunit.client.0.smithi023.stdout:4/459: chown d13/d1d/d2d/l61 786 1 2024-02-28T16:24:10.146 INFO:tasks.workunit.client.0.smithi023.stdout:3/525: mkdir d1/df/d3d/d57/d61/db5 0 2024-02-28T16:24:10.151 INFO:tasks.workunit.client.0.smithi023.stdout:7/449: dwrite de/d1c/f20 [0,4194304] 0 2024-02-28T16:24:10.160 INFO:tasks.workunit.client.0.smithi023.stdout:6/577: dwrite d1/d28/d1e/dae/fb4 [0,4194304] 0 2024-02-28T16:24:10.170 INFO:tasks.workunit.client.0.smithi023.stdout:3/526: dwrite d1/df/d2d/d32/d3f/f7f [0,4194304] 0 2024-02-28T16:24:10.264 INFO:tasks.workunit.client.0.smithi023.stdout:0/472: rename d6/db/d3b/d1f/d42/f4a to d6/db/d1a/d35/d9d/f9e 0 2024-02-28T16:24:10.266 INFO:tasks.workunit.client.0.smithi023.stdout:5/672: mkdir d1/d2a/d32/d37/d3a/d7f/dd3 0 2024-02-28T16:24:10.276 INFO:tasks.workunit.client.0.smithi023.stdout:9/465: rename d0/d7/de/d2e/d2f/f64 to d0/d7/d2c/f97 0 2024-02-28T16:24:10.278 INFO:tasks.workunit.client.0.smithi023.stdout:5/673: mknod d1/d2a/d32/d6e/cd4 0 2024-02-28T16:24:10.279 INFO:tasks.workunit.client.0.smithi023.stdout:5/674: readlink d1/d2a/d32/l63 0 2024-02-28T16:24:10.279 INFO:tasks.workunit.client.0.smithi023.stdout:3/527: creat d1/df/d2d/da8/fb6 x:0 0 0 2024-02-28T16:24:10.286 INFO:tasks.workunit.client.0.smithi023.stdout:9/466: mknod d0/d7/db/d18/d23/d28/c98 0 2024-02-28T16:24:10.289 INFO:tasks.workunit.client.0.smithi023.stdout:3/528: mknod d1/df/d2d/d45/cb7 0 2024-02-28T16:24:10.294 INFO:tasks.workunit.client.0.smithi023.stdout:4/460: getdents d13/d1d/d2d 0 2024-02-28T16:24:10.295 INFO:tasks.workunit.client.0.smithi023.stdout:5/675: mkdir d1/d2a/d32/dd5 0 2024-02-28T16:24:10.298 INFO:tasks.workunit.client.0.smithi023.stdout:6/578: write d1/d18/d26/f84 [880889,105198] 0 2024-02-28T16:24:10.298 INFO:tasks.workunit.client.0.smithi023.stdout:9/467: creat d0/d7/db/d18/d23/d28/f99 x:0 0 0 2024-02-28T16:24:10.304 INFO:tasks.workunit.client.0.smithi023.stdout:5/676: mknod d1/d2a/cd6 0 2024-02-28T16:24:10.304 INFO:tasks.workunit.client.0.smithi023.stdout:1/525: dwrite f2 [0,4194304] 0 2024-02-28T16:24:10.308 INFO:tasks.workunit.client.0.smithi023.stdout:6/579: creat d1/d18/d26/da6/fd9 x:0 0 0 2024-02-28T16:24:10.309 INFO:tasks.workunit.client.0.smithi023.stdout:1/526: chown df/d11/d13/d1b/d30/f43 258580490 1 2024-02-28T16:24:10.309 INFO:tasks.workunit.client.0.smithi023.stdout:5/677: write d1/d2a/d32/d37/d3a/d7f/d62/f9a [2791370,64317] 0 2024-02-28T16:24:10.310 INFO:tasks.workunit.client.0.smithi023.stdout:4/461: rename d13/d1d/d58/f8e to d13/d2b/d2c/d31/d6e/d80/f92 0 2024-02-28T16:24:10.311 INFO:tasks.workunit.client.0.smithi023.stdout:0/473: write d6/db/d3d/f64 [410716,25994] 0 2024-02-28T16:24:10.316 INFO:tasks.workunit.client.0.smithi023.stdout:9/468: creat d0/d7/db/f9a x:0 0 0 2024-02-28T16:24:10.321 INFO:tasks.workunit.client.0.smithi023.stdout:3/529: link d1/df/d2d/d45/d52/d65/d89/fa2 d1/df/d3d/fb8 0 2024-02-28T16:24:10.323 INFO:tasks.workunit.client.0.smithi023.stdout:9/469: unlink d0/d7/d2c/d57/f65 0 2024-02-28T16:24:10.328 INFO:tasks.workunit.client.0.smithi023.stdout:6/580: rename d1/d28/d1e/d2b/f8e to d1/d28/fda 0 2024-02-28T16:24:10.330 INFO:tasks.workunit.client.0.smithi023.stdout:1/527: dread df/d26/f5b [0,4194304] 0 2024-02-28T16:24:10.333 INFO:tasks.workunit.client.0.smithi023.stdout:3/530: mkdir d1/df/d3d/d57/d61/db5/db9 0 2024-02-28T16:24:10.341 INFO:tasks.workunit.client.0.smithi023.stdout:3/531: write d1/df/d33/d38/d4c/f73 [747349,53686] 0 2024-02-28T16:24:10.343 INFO:tasks.workunit.client.0.smithi023.stdout:1/528: unlink df/d26/d48/d72/f8c 0 2024-02-28T16:24:10.344 INFO:tasks.workunit.client.0.smithi023.stdout:6/581: getdents d1/d28/d1e/d52/daf 0 2024-02-28T16:24:10.346 INFO:tasks.workunit.client.0.smithi023.stdout:4/462: dwrite d13/d2b/f4f [0,4194304] 0 2024-02-28T16:24:10.347 INFO:tasks.workunit.client.0.smithi023.stdout:1/529: read - df/d11/d13/d1b/f7f zero size 2024-02-28T16:24:10.349 INFO:tasks.workunit.client.0.smithi023.stdout:3/532: write d1/d4a/fae [930683,122096] 0 2024-02-28T16:24:10.350 INFO:tasks.workunit.client.0.smithi023.stdout:0/474: dwrite d6/db/d5d/f76 [0,4194304] 0 2024-02-28T16:24:10.359 INFO:tasks.workunit.client.0.smithi023.stdout:4/463: symlink d13/l93 0 2024-02-28T16:24:10.360 INFO:tasks.workunit.client.0.smithi023.stdout:1/530: write df/d26/f5b [992480,125222] 0 2024-02-28T16:24:10.360 INFO:tasks.workunit.client.0.smithi023.stdout:4/464: stat d13/d1d 0 2024-02-28T16:24:10.361 INFO:tasks.workunit.client.0.smithi023.stdout:6/582: dread d1/d28/d1e/d80/fa7 [0,4194304] 0 2024-02-28T16:24:10.365 INFO:tasks.workunit.client.0.smithi023.stdout:5/678: dwrite d1/d2a/d32/d37/d3a/d7f/f25 [0,4194304] 0 2024-02-28T16:24:10.377 INFO:tasks.workunit.client.0.smithi023.stdout:4/465: creat d13/d2b/d2c/d31/d8d/f94 x:0 0 0 2024-02-28T16:24:10.378 INFO:tasks.workunit.client.0.smithi023.stdout:6/583: symlink d1/d28/d1e/d2b/d6d/d7b/ldb 0 2024-02-28T16:24:10.379 INFO:tasks.workunit.client.0.smithi023.stdout:5/679: creat d1/d2a/d32/d58/d79/fd7 x:0 0 0 2024-02-28T16:24:10.383 INFO:tasks.workunit.client.0.smithi023.stdout:0/475: rename d6/db/d3b/d1f/l2a to d6/db/d3b/l9f 0 2024-02-28T16:24:10.384 INFO:tasks.workunit.client.0.smithi023.stdout:9/470: dread d0/d7/db/d18/f25 [0,4194304] 0 2024-02-28T16:24:10.385 INFO:tasks.workunit.client.0.smithi023.stdout:5/680: dread - d1/d2a/d32/d58/d79/fd7 zero size 2024-02-28T16:24:10.386 INFO:tasks.workunit.client.0.smithi023.stdout:6/584: dread - d1/d28/d1e/d2b/d6d/f92 zero size 2024-02-28T16:24:10.388 INFO:tasks.workunit.client.0.smithi023.stdout:0/476: chown d6/d84 865074022 1 2024-02-28T16:24:10.397 INFO:tasks.workunit.client.0.smithi023.stdout:9/471: mknod d0/d7/db/d18/d23/d28/d32/c9b 0 2024-02-28T16:24:10.398 INFO:tasks.workunit.client.0.smithi023.stdout:5/681: write d1/d2a/d32/d37/d3a/d7f/f8d [3757526,130870] 0 2024-02-28T16:24:10.399 INFO:tasks.workunit.client.0.smithi023.stdout:1/531: dwrite df/d11/d13/d1b/d30/d57/d5a/faa [0,4194304] 0 2024-02-28T16:24:10.405 INFO:tasks.workunit.client.0.smithi023.stdout:6/585: dread d1/d28/d1e/d2b/f43 [0,4194304] 0 2024-02-28T16:24:10.405 INFO:tasks.workunit.client.0.smithi023.stdout:9/472: read - d0/d7/de/d2e/d2f/f60 zero size 2024-02-28T16:24:10.412 INFO:tasks.workunit.client.0.smithi023.stdout:3/533: dread d1/df/d2d/d45/f14 [0,4194304] 0 2024-02-28T16:24:10.415 INFO:tasks.workunit.client.0.smithi023.stdout:9/473: rename d0/d7/d2c/d57 to d0/d7/db/d18/d23/d28/d9c 0 2024-02-28T16:24:10.416 INFO:tasks.workunit.client.0.smithi023.stdout:3/534: fdatasync d1/df/f3b 0 2024-02-28T16:24:10.422 INFO:tasks.workunit.client.0.smithi023.stdout:0/477: fsync d6/db/d5d/f76 0 2024-02-28T16:24:10.424 INFO:tasks.workunit.client.0.smithi023.stdout:5/682: symlink d1/d2a/d32/d37/d3a/d7f/dd3/ld8 0 2024-02-28T16:24:10.425 INFO:tasks.workunit.client.0.smithi023.stdout:9/474: chown d0/d7/db/d18/d23/d28/d9c/c62 54227 1 2024-02-28T16:24:10.427 INFO:tasks.workunit.client.0.smithi023.stdout:3/535: symlink d1/df/d3d/d57/d61/db5/lba 0 2024-02-28T16:24:10.427 INFO:tasks.workunit.client.0.smithi023.stdout:4/466: dwrite d13/f1b [0,4194304] 0 2024-02-28T16:24:10.432 INFO:tasks.workunit.client.0.smithi023.stdout:6/586: creat d1/d28/d1e/d2b/d44/d86/fdc x:0 0 0 2024-02-28T16:24:10.432 INFO:tasks.workunit.client.0.smithi023.stdout:5/683: symlink d1/d2a/d32/d37/dcd/ld9 0 2024-02-28T16:24:10.434 INFO:tasks.workunit.client.0.smithi023.stdout:3/536: stat d1/df/l42 0 2024-02-28T16:24:10.435 INFO:tasks.workunit.client.0.smithi023.stdout:6/587: chown d1/d28/d1e/d2b/l7a 26 1 2024-02-28T16:24:10.439 INFO:tasks.workunit.client.0.smithi023.stdout:1/532: dwrite df/d26/d48/f4c [4194304,4194304] 0 2024-02-28T16:24:10.441 INFO:tasks.workunit.client.0.smithi023.stdout:5/684: fsync d1/d2a/d32/d36/f74 0 2024-02-28T16:24:10.445 INFO:tasks.workunit.client.0.smithi023.stdout:6/588: symlink d1/d18/d26/d6a/ldd 0 2024-02-28T16:24:10.445 INFO:tasks.workunit.client.0.smithi023.stdout:4/467: link d13/d1d/l28 d13/d2b/d2c/d31/l95 0 2024-02-28T16:24:10.453 INFO:tasks.workunit.client.0.smithi023.stdout:6/589: unlink d1/d28/fda 0 2024-02-28T16:24:10.460 INFO:tasks.workunit.client.0.smithi023.stdout:1/533: rename df/d11/c76 to df/d11/d13/d1b/d30/d3d/d6c/cb6 0 2024-02-28T16:24:10.461 INFO:tasks.workunit.client.0.smithi023.stdout:6/590: dread - d1/d18/d26/d3a/fd2 zero size 2024-02-28T16:24:10.470 INFO:tasks.workunit.client.0.smithi023.stdout:3/537: dread d1/df/d33/d38/d4c/f73 [0,4194304] 0 2024-02-28T16:24:10.472 INFO:tasks.workunit.client.0.smithi023.stdout:0/478: dread d6/db/d3b/d1f/d82/f44 [0,4194304] 0 2024-02-28T16:24:10.473 INFO:tasks.workunit.client.0.smithi023.stdout:6/591: fdatasync d1/d28/d1e/d2b/d44/f53 0 2024-02-28T16:24:10.478 INFO:tasks.workunit.client.0.smithi023.stdout:5/685: dwrite d1/d2a/d32/d58/d60/f90 [0,4194304] 0 2024-02-28T16:24:10.485 INFO:tasks.workunit.client.0.smithi023.stdout:4/468: dwrite d13/d2b/d2c/d31/d6e/f82 [0,4194304] 0 2024-02-28T16:24:10.487 INFO:tasks.workunit.client.0.smithi023.stdout:0/479: mkdir d6/db/d1a/d26/d31/da0 0 2024-02-28T16:24:10.492 INFO:tasks.workunit.client.0.smithi023.stdout:6/592: creat d1/d28/d1e/d52/dd4/fde x:0 0 0 2024-02-28T16:24:10.495 INFO:tasks.workunit.client.0.smithi023.stdout:1/534: rename df/d26/d48/c9b to df/d11/d13/d1b/d30/d3d/cb7 0 2024-02-28T16:24:10.496 INFO:tasks.workunit.client.0.smithi023.stdout:3/538: getdents d1/d4a 0 2024-02-28T16:24:10.497 INFO:tasks.workunit.client.0.smithi023.stdout:1/535: stat df/d11/d13/ca7 0 2024-02-28T16:24:10.499 INFO:tasks.workunit.client.0.smithi023.stdout:3/539: fdatasync d1/df/d2d/f31 0 2024-02-28T16:24:10.501 INFO:tasks.workunit.client.0.smithi023.stdout:6/593: unlink d1/d28/d1e/d52/dd4/fde 0 2024-02-28T16:24:10.510 INFO:tasks.workunit.client.0.smithi023.stdout:0/480: mkdir d6/db/d1a/d26/d31/da0/da1 0 2024-02-28T16:24:10.510 INFO:tasks.workunit.client.0.smithi023.stdout:1/536: fdatasync df/d11/d13/f15 0 2024-02-28T16:24:10.511 INFO:tasks.workunit.client.0.smithi023.stdout:3/540: rmdir d1/d74/d94 39 2024-02-28T16:24:10.514 INFO:tasks.workunit.client.0.smithi023.stdout:3/541: chown d1/df/d2d/d45/c39 22998 1 2024-02-28T16:24:10.518 INFO:tasks.workunit.client.0.smithi023.stdout:1/537: write df/d11/d13/d1b/d2e/f87 [1744239,53744] 0 2024-02-28T16:24:10.520 INFO:tasks.workunit.client.0.smithi023.stdout:3/542: write d1/df/d3d/d57/f6d [325440,19230] 0 2024-02-28T16:24:10.522 INFO:tasks.workunit.client.0.smithi023.stdout:5/686: dread d1/d2a/d32/d37/f59 [0,4194304] 0 2024-02-28T16:24:10.524 INFO:tasks.workunit.client.0.smithi023.stdout:0/481: symlink d6/db/la2 0 2024-02-28T16:24:10.525 INFO:tasks.workunit.client.0.smithi023.stdout:5/687: dread - d1/d2a/d32/d58/d60/d88/d89/fc7 zero size 2024-02-28T16:24:10.528 INFO:tasks.workunit.client.0.smithi023.stdout:6/594: link d1/d28/d1e/d2b/fd1 d1/d28/d1e/d2b/fdf 0 2024-02-28T16:24:10.528 INFO:tasks.workunit.client.0.smithi023.stdout:4/469: truncate d13/d2b/d2c/d31/d6e/f7b 3554762 0 2024-02-28T16:24:10.533 INFO:tasks.workunit.client.0.smithi023.stdout:5/688: symlink d1/d2a/d32/d37/d3a/d7f/dca/lda 0 2024-02-28T16:24:10.533 INFO:tasks.workunit.client.0.smithi023.stdout:6/595: mkdir d1/d18/d26/d3a/de0 0 2024-02-28T16:24:10.535 INFO:tasks.workunit.client.0.smithi023.stdout:0/482: rmdir d6/db/d68 39 2024-02-28T16:24:10.538 INFO:tasks.workunit.client.0.smithi023.stdout:5/689: creat d1/d2a/d32/d58/fdb x:0 0 0 2024-02-28T16:24:10.540 INFO:tasks.workunit.client.0.smithi023.stdout:6/596: unlink d1/d28/d1e/d2b/d44/da4/fc9 0 2024-02-28T16:24:10.541 INFO:tasks.workunit.client.0.smithi023.stdout:4/470: getdents d13/d1d/d58/d7a/d90 0 2024-02-28T16:24:10.543 INFO:tasks.workunit.client.0.smithi023.stdout:0/483: mkdir d6/db/d3b/d1f/d82/da3 0 2024-02-28T16:24:10.544 INFO:tasks.workunit.client.0.smithi023.stdout:4/471: read f9 [2321496,120086] 0 2024-02-28T16:24:10.545 INFO:tasks.workunit.client.0.smithi023.stdout:4/472: stat d13/d2b/d2c/d31/d6e/f76 0 2024-02-28T16:24:10.545 INFO:tasks.workunit.client.0.smithi023.stdout:0/484: dread - d6/db/d1a/f80 zero size 2024-02-28T16:24:10.550 INFO:tasks.workunit.client.0.smithi023.stdout:6/597: mknod d1/d18/d26/da6/da9/ce1 0 2024-02-28T16:24:10.556 INFO:tasks.workunit.client.0.smithi023.stdout:6/598: mknod d1/d28/d1e/d2b/d76/d9e/ce2 0 2024-02-28T16:24:10.557 INFO:tasks.workunit.client.0.smithi023.stdout:3/543: truncate d1/df/d2d/d45/d52/d65/f69 2526791 0 2024-02-28T16:24:10.558 INFO:tasks.workunit.client.0.smithi023.stdout:4/473: symlink d13/d1e/l96 0 2024-02-28T16:24:10.560 INFO:tasks.workunit.client.0.smithi023.stdout:4/474: readlink d13/d1d/d2e/l7c 0 2024-02-28T16:24:10.562 INFO:tasks.workunit.client.0.smithi023.stdout:4/475: fdatasync d13/d2b/d2c/d31/d6e/f76 0 2024-02-28T16:24:10.564 INFO:tasks.workunit.client.0.smithi023.stdout:6/599: mknod d1/d28/d1e/d2b/d6d/ce3 0 2024-02-28T16:24:10.565 INFO:tasks.workunit.client.0.smithi023.stdout:1/538: dwrite df/d11/d13/d1b/d30/f41 [0,4194304] 0 2024-02-28T16:24:10.566 INFO:tasks.workunit.client.0.smithi023.stdout:3/544: creat d1/d4a/d92/fbb x:0 0 0 2024-02-28T16:24:10.567 INFO:tasks.workunit.client.0.smithi023.stdout:3/545: fdatasync d1/f2b 0 2024-02-28T16:24:10.568 INFO:tasks.workunit.client.0.smithi023.stdout:6/600: write d1/d28/d1e/d2b/d6d/fc8 [638482,67643] 0 2024-02-28T16:24:10.571 INFO:tasks.workunit.client.0.smithi023.stdout:5/690: truncate d1/d2a/d32/d37/f51 2920392 0 2024-02-28T16:24:10.571 INFO:tasks.workunit.client.0.smithi023.stdout:1/539: write df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f88 [555509,31988] 0 2024-02-28T16:24:10.582 INFO:tasks.workunit.client.0.smithi023.stdout:1/540: creat df/d26/d48/db3/fb8 x:0 0 0 2024-02-28T16:24:10.585 INFO:tasks.workunit.client.0.smithi023.stdout:3/546: link d1/df/d2d/f31 d1/df/d33/fbc 0 2024-02-28T16:24:10.586 INFO:tasks.workunit.client.0.smithi023.stdout:6/601: rmdir d1 39 2024-02-28T16:24:10.588 INFO:tasks.workunit.client.0.smithi023.stdout:1/541: chown df/d11/d13/d1b/d30/d57/d5a/d68/l77 558 1 2024-02-28T16:24:10.591 INFO:tasks.workunit.client.0.smithi023.stdout:6/602: chown d1/d18/d26/da6 6470738 1 2024-02-28T16:24:10.594 INFO:tasks.workunit.client.0.smithi023.stdout:1/542: symlink df/d26/d48/db3/lb9 0 2024-02-28T16:24:10.595 INFO:tasks.workunit.client.0.smithi023.stdout:5/691: dwrite d1/d2a/d32/d37/d3a/d7f/f25 [0,4194304] 0 2024-02-28T16:24:10.598 INFO:tasks.workunit.client.0.smithi023.stdout:6/603: truncate d1/d18/d26/da6/da9/fc3 984596 0 2024-02-28T16:24:10.601 INFO:tasks.workunit.client.0.smithi023.stdout:5/692: fsync d1/d2a/d32/d37/d3a/fab 0 2024-02-28T16:24:10.604 INFO:tasks.workunit.client.0.smithi023.stdout:5/693: fsync d1/d2a/d32/d58/fb2 0 2024-02-28T16:24:10.614 INFO:tasks.workunit.client.0.smithi023.stdout:3/547: dwrite d1/df/d2d/d45/d52/d65/d89/fa2 [0,4194304] 0 2024-02-28T16:24:10.626 INFO:tasks.workunit.client.0.smithi023.stdout:1/543: link df/d26/l34 df/d26/d48/d80/lba 0 2024-02-28T16:24:10.629 INFO:tasks.workunit.client.0.smithi023.stdout:3/548: symlink d1/df/d2d/da8/lbd 0 2024-02-28T16:24:10.629 INFO:tasks.workunit.client.0.smithi023.stdout:1/544: write df/d26/d48/f9d [164210,116046] 0 2024-02-28T16:24:10.632 INFO:tasks.workunit.client.0.smithi023.stdout:6/604: getdents d1/d28/d1e/d2b/d44 0 2024-02-28T16:24:10.633 INFO:tasks.workunit.client.0.smithi023.stdout:5/694: rename d1/d2a/d32/d37/d3a/d7f/dd3 to d1/d2a/d32/ddc 0 2024-02-28T16:24:10.634 INFO:tasks.workunit.client.0.smithi023.stdout:1/545: dread - df/d11/d13/d27/f53 zero size 2024-02-28T16:24:10.637 INFO:tasks.workunit.client.0.smithi023.stdout:5/695: read d1/d2a/d32/d58/d79/fa3 [154452,127209] 0 2024-02-28T16:24:10.640 INFO:tasks.workunit.client.0.smithi023.stdout:3/549: fdatasync d1/df/d2d/d45/d52/d65/f69 0 2024-02-28T16:24:10.642 INFO:tasks.workunit.client.0.smithi023.stdout:5/696: mknod d1/d2a/cdd 0 2024-02-28T16:24:10.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:10 smithi153 ceph-mon[35341]: pgmap v36: 65 pgs: 65 active+clean; 982 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 30 MiB/s rd, 138 MiB/s wr, 310 op/s 2024-02-28T16:24:10.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:10 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:10.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:10 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:10.646 INFO:tasks.workunit.client.0.smithi023.stdout:1/546: unlink df/d11/d13/d1b/d30/d57/d5a/d68/d6f/caf 0 2024-02-28T16:24:10.649 INFO:tasks.workunit.client.0.smithi023.stdout:5/697: write d1/d2a/d32/d6e/f85 [337547,90495] 0 2024-02-28T16:24:10.652 INFO:tasks.workunit.client.0.smithi023.stdout:1/547: symlink df/d11/d13/d1b/lbb 0 2024-02-28T16:24:10.655 INFO:tasks.workunit.client.0.smithi023.stdout:5/698: creat d1/d2a/d32/d37/d4e/db5/dc6/fde x:0 0 0 2024-02-28T16:24:10.658 INFO:tasks.workunit.client.0.smithi023.stdout:1/548: creat df/d11/d13/d1b/d30/d57/d5a/d68/fbc x:0 0 0 2024-02-28T16:24:10.664 INFO:tasks.workunit.client.0.smithi023.stdout:3/550: dwrite d1/df/d33/d38/d4c/f55 [4194304,4194304] 0 2024-02-28T16:24:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:10 smithi023 ceph-mon[29137]: pgmap v36: 65 pgs: 65 active+clean; 982 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 30 MiB/s rd, 138 MiB/s wr, 310 op/s 2024-02-28T16:24:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:10 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:10 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:10.673 INFO:tasks.workunit.client.0.smithi023.stdout:1/549: rename df/d11/d13/d1b/d30/d3d to df/dbd 0 2024-02-28T16:24:10.675 INFO:tasks.workunit.client.0.smithi023.stdout:3/551: symlink d1/d74/lbe 0 2024-02-28T16:24:10.677 INFO:tasks.workunit.client.0.smithi023.stdout:1/550: mkdir df/d11/d13/d1b/d2e/dbe 0 2024-02-28T16:24:10.679 INFO:tasks.workunit.client.0.smithi023.stdout:5/699: dwrite d1/d2a/d32/d37/d3a/d7f/d62/d7b/f99 [0,4194304] 0 2024-02-28T16:24:10.685 INFO:tasks.workunit.client.0.smithi023.stdout:3/552: unlink d1/df/d2d/d45/d52/d65/f69 0 2024-02-28T16:24:10.687 INFO:tasks.workunit.client.0.smithi023.stdout:3/553: fdatasync d1/df/d33/f81 0 2024-02-28T16:24:10.687 INFO:tasks.workunit.client.0.smithi023.stdout:5/700: symlink d1/d2a/d32/d58/d60/d88/ldf 0 2024-02-28T16:24:10.689 INFO:tasks.workunit.client.0.smithi023.stdout:1/551: truncate df/d11/d13/d1b/d30/d57/d5a/f64 8325063 0 2024-02-28T16:24:10.691 INFO:tasks.workunit.client.0.smithi023.stdout:5/701: chown d1/d2a/d32/d37/d3a/d7f/f8d 266936882 1 2024-02-28T16:24:10.695 INFO:tasks.workunit.client.0.smithi023.stdout:1/552: write df/d11/d13/d1b/d30/d57/d5a/d68/fbc [757258,42568] 0 2024-02-28T16:24:10.698 INFO:tasks.workunit.client.0.smithi023.stdout:5/702: mkdir d1/d2a/d32/de0 0 2024-02-28T16:24:10.699 INFO:tasks.workunit.client.0.smithi023.stdout:1/553: write df/f97 [11182898,3467] 0 2024-02-28T16:24:10.700 INFO:tasks.workunit.client.0.smithi023.stdout:3/554: link d1/df/d2d/d45/d52/f5b d1/df/d3d/d57/d61/db5/fbf 0 2024-02-28T16:24:10.702 INFO:tasks.workunit.client.0.smithi023.stdout:5/703: creat d1/d2a/d32/d58/d73/fe1 x:0 0 0 2024-02-28T16:24:10.705 INFO:tasks.workunit.client.0.smithi023.stdout:3/555: truncate d1/df/d33/f81 705702 0 2024-02-28T16:24:10.705 INFO:tasks.workunit.client.0.smithi023.stdout:1/554: mknod df/d11/d13/d1b/d30/d57/d5a/d68/d6f/cbf 0 2024-02-28T16:24:10.706 INFO:tasks.workunit.client.0.smithi023.stdout:5/704: write d1/d2a/d32/d37/d3a/f7e [987898,69764] 0 2024-02-28T16:24:10.710 INFO:tasks.workunit.client.0.smithi023.stdout:5/705: chown d1/d2a/d32/d37/d3a/d7f/dca/ld0 203 1 2024-02-28T16:24:10.728 INFO:tasks.workunit.client.0.smithi023.stdout:1/555: dwrite df/d11/d13/f62 [0,4194304] 0 2024-02-28T16:24:10.729 INFO:tasks.workunit.client.0.smithi023.stdout:3/556: dwrite d1/d4a/f93 [0,4194304] 0 2024-02-28T16:24:10.733 INFO:tasks.workunit.client.0.smithi023.stdout:3/557: chown d1/df/f3e 165924312 1 2024-02-28T16:24:10.735 INFO:tasks.workunit.client.0.smithi023.stdout:5/706: truncate d1/d2a/d32/d58/d60/f90 2338134 0 2024-02-28T16:24:10.736 INFO:tasks.workunit.client.0.smithi023.stdout:3/558: truncate d1/f11 4805548 0 2024-02-28T16:24:10.742 INFO:tasks.workunit.client.0.smithi023.stdout:3/559: creat d1/d4a/fc0 x:0 0 0 2024-02-28T16:24:10.744 INFO:tasks.workunit.client.0.smithi023.stdout:5/707: mknod d1/d2a/d32/d37/d3a/d7f/dca/ce2 0 2024-02-28T16:24:10.744 INFO:tasks.workunit.client.0.smithi023.stdout:3/560: chown d1/df/fa1 13619425 1 2024-02-28T16:24:10.747 INFO:tasks.workunit.client.0.smithi023.stdout:1/556: dread df/d11/d13/d1b/d30/d57/d5a/d68/fbc [0,4194304] 0 2024-02-28T16:24:10.749 INFO:tasks.workunit.client.0.smithi023.stdout:3/561: mknod d1/df/d2d/d9d/cc1 0 2024-02-28T16:24:10.749 INFO:tasks.workunit.client.0.smithi023.stdout:5/708: fdatasync d1/d2a/d32/d37/d3a/d7f/d62/f6b 0 2024-02-28T16:24:10.751 INFO:tasks.workunit.client.0.smithi023.stdout:3/562: dread - d1/f3c zero size 2024-02-28T16:24:10.752 INFO:tasks.workunit.client.0.smithi023.stdout:3/563: fdatasync d1/df/f8e 0 2024-02-28T16:24:10.753 INFO:tasks.workunit.client.0.smithi023.stdout:1/557: truncate df/d11/d13/d1b/f39 4157127 0 2024-02-28T16:24:10.756 INFO:tasks.workunit.client.0.smithi023.stdout:1/558: mknod df/d11/d13/cc0 0 2024-02-28T16:24:10.768 INFO:tasks.workunit.client.0.smithi023.stdout:1/559: link df/d26/d48/f79 df/dbd/d7b/fc1 0 2024-02-28T16:24:10.768 INFO:tasks.workunit.client.0.smithi023.stdout:1/560: fsync df/d26/f35 0 2024-02-28T16:24:10.776 INFO:tasks.workunit.client.0.smithi023.stdout:5/709: truncate d1/d2a/d32/d36/f66 981729 0 2024-02-28T16:24:10.785 INFO:tasks.workunit.client.0.smithi023.stdout:5/710: dread d1/d2a/d32/d58/d60/d88/d89/f97 [0,4194304] 0 2024-02-28T16:24:10.788 INFO:tasks.workunit.client.0.smithi023.stdout:5/711: chown d1/d2a/d32/d58/d60/d81 0 1 2024-02-28T16:24:10.789 INFO:tasks.workunit.client.0.smithi023.stdout:3/564: dwrite d1/df/d2d/d45/d52/f5b [0,4194304] 0 2024-02-28T16:24:10.792 INFO:tasks.workunit.client.0.smithi023.stdout:1/561: truncate df/d11/d13/d1b/d30/d57/d5a/d68/fbc 286529 0 2024-02-28T16:24:10.793 INFO:tasks.workunit.client.0.smithi023.stdout:5/712: mkdir d1/d2a/d32/ddc/de3 0 2024-02-28T16:24:10.797 INFO:tasks.workunit.client.0.smithi023.stdout:3/565: mkdir d1/df/d33/dc2 0 2024-02-28T16:24:10.797 INFO:tasks.workunit.client.0.smithi023.stdout:9/475: sync 2024-02-28T16:24:10.797 INFO:tasks.workunit.client.0.smithi023.stdout:2/565: sync 2024-02-28T16:24:10.798 INFO:tasks.workunit.client.0.smithi023.stdout:8/574: sync 2024-02-28T16:24:10.798 INFO:tasks.workunit.client.0.smithi023.stdout:7/450: sync 2024-02-28T16:24:10.800 INFO:tasks.workunit.client.0.smithi023.stdout:1/562: mknod df/d11/d13/d1b/d30/dae/cc2 0 2024-02-28T16:24:10.809 INFO:tasks.workunit.client.0.smithi023.stdout:9/476: creat d0/d7/db/d18/f9d x:0 0 0 2024-02-28T16:24:10.810 INFO:tasks.workunit.client.0.smithi023.stdout:7/451: symlink de/d13/l94 0 2024-02-28T16:24:10.814 INFO:tasks.workunit.client.0.smithi023.stdout:9/477: creat d0/d7/de/d34/f9e x:0 0 0 2024-02-28T16:24:10.816 INFO:tasks.workunit.client.0.smithi023.stdout:7/452: mkdir de/d8b/d95 0 2024-02-28T16:24:10.821 INFO:tasks.workunit.client.0.smithi023.stdout:7/453: creat de/d60/f96 x:0 0 0 2024-02-28T16:24:10.822 INFO:tasks.workunit.client.0.smithi023.stdout:2/566: link d5/da/d1b/d3f/f66 d5/da/db/d17/d39/d56/fad 0 2024-02-28T16:24:10.823 INFO:tasks.workunit.client.0.smithi023.stdout:5/713: dwrite d1/d2a/d32/d58/d79/fa3 [0,4194304] 0 2024-02-28T16:24:10.828 INFO:tasks.workunit.client.0.smithi023.stdout:9/478: rename d0/d7/db/f24 to d0/d7/db/d18/d23/d28/d32/d8b/f9f 0 2024-02-28T16:24:10.830 INFO:tasks.workunit.client.0.smithi023.stdout:1/563: dwrite df/f97 [12582912,4194304] 0 2024-02-28T16:24:10.833 INFO:tasks.workunit.client.0.smithi023.stdout:2/567: truncate d5/da/db/d17/d73/f9f 798597 0 2024-02-28T16:24:10.833 INFO:tasks.workunit.client.0.smithi023.stdout:7/454: creat de/d13/d1b/d6c/f97 x:0 0 0 2024-02-28T16:24:10.836 INFO:tasks.workunit.client.0.smithi023.stdout:8/575: dwrite d0/d5/d1a/d63/fb5 [0,4194304] 0 2024-02-28T16:24:10.844 INFO:tasks.workunit.client.0.smithi023.stdout:8/576: write d0/d5/d1a/d63/fb5 [220204,87494] 0 2024-02-28T16:24:10.851 INFO:tasks.workunit.client.0.smithi023.stdout:5/714: dread d1/d2a/d32/d58/d60/f90 [0,4194304] 0 2024-02-28T16:24:10.854 INFO:tasks.workunit.client.0.smithi023.stdout:9/479: symlink d0/d7/db/d18/d23/d28/d32/d3c/la0 0 2024-02-28T16:24:10.856 INFO:tasks.workunit.client.0.smithi023.stdout:5/715: truncate d1/d2a/d32/d58/faa 539424 0 2024-02-28T16:24:10.860 INFO:tasks.workunit.client.0.smithi023.stdout:9/480: truncate d0/d7/de/d34/f9e 11849 0 2024-02-28T16:24:10.862 INFO:tasks.workunit.client.0.smithi023.stdout:5/716: dread - d1/d2a/d32/d58/d73/fe1 zero size 2024-02-28T16:24:10.864 INFO:tasks.workunit.client.0.smithi023.stdout:2/568: creat d5/fae x:0 0 0 2024-02-28T16:24:10.865 INFO:tasks.workunit.client.0.smithi023.stdout:2/569: readlink d5/da/db/l1a 0 2024-02-28T16:24:10.874 INFO:tasks.workunit.client.0.smithi023.stdout:2/570: creat d5/da/db/d17/d3c/faf x:0 0 0 2024-02-28T16:24:10.881 INFO:tasks.workunit.client.0.smithi023.stdout:2/571: fsync d5/da/d1b/d3f/d75/d92/fa9 0 2024-02-28T16:24:10.884 INFO:tasks.workunit.client.0.smithi023.stdout:8/577: write d0/d5/d1a/d2d/f61 [655504,101594] 0 2024-02-28T16:24:10.885 INFO:tasks.workunit.client.0.smithi023.stdout:1/564: truncate df/d26/d48/f9d 205293 0 2024-02-28T16:24:10.885 INFO:tasks.workunit.client.0.smithi023.stdout:2/572: chown d5/da/d62/f90 112102 1 2024-02-28T16:24:10.888 INFO:tasks.workunit.client.0.smithi023.stdout:2/573: write d5/dc/f21 [627374,90832] 0 2024-02-28T16:24:10.890 INFO:tasks.workunit.client.0.smithi023.stdout:1/565: fdatasync df/dbd/f6e 0 2024-02-28T16:24:10.892 INFO:tasks.workunit.client.0.smithi023.stdout:8/578: mkdir d0/d5/d1a/d63/d90/dac/dc3 0 2024-02-28T16:24:10.896 INFO:tasks.workunit.client.0.smithi023.stdout:2/574: rmdir d5/da/db/d17/d3c 39 2024-02-28T16:24:10.899 INFO:tasks.workunit.client.0.smithi023.stdout:1/566: stat df/d11/d13/d1b/d2e/d5c/l8b 0 2024-02-28T16:24:10.901 INFO:tasks.workunit.client.0.smithi023.stdout:9/481: dwrite d0/d7/de/f14 [0,4194304] 0 2024-02-28T16:24:10.902 INFO:tasks.workunit.client.0.smithi023.stdout:1/567: readlink df/d11/d13/l32 0 2024-02-28T16:24:10.910 INFO:tasks.workunit.client.0.smithi023.stdout:8/579: creat d0/d5/d1a/d2d/d67/d71/d9e/dbb/fc4 x:0 0 0 2024-02-28T16:24:10.910 INFO:tasks.workunit.client.0.smithi023.stdout:2/575: creat d5/da/db/d17/d73/d9e/da0/d8b/fb0 x:0 0 0 2024-02-28T16:24:10.911 INFO:tasks.workunit.client.0.smithi023.stdout:2/576: dread - d5/dc/f88 zero size 2024-02-28T16:24:10.915 INFO:tasks.workunit.client.0.smithi023.stdout:1/568: creat df/fc3 x:0 0 0 2024-02-28T16:24:10.916 INFO:tasks.workunit.client.0.smithi023.stdout:8/580: fsync d0/d5/d1a/d2d/d67/daf/f9a 0 2024-02-28T16:24:10.919 INFO:tasks.workunit.client.0.smithi023.stdout:2/577: fdatasync d5/da/db/d17/f57 0 2024-02-28T16:24:10.922 INFO:tasks.workunit.client.0.smithi023.stdout:9/482: dread d0/d7/db/f8f [0,4194304] 0 2024-02-28T16:24:10.924 INFO:tasks.workunit.client.0.smithi023.stdout:8/581: unlink d0/l1c 0 2024-02-28T16:24:10.925 INFO:tasks.workunit.client.0.smithi023.stdout:9/483: dread - d0/d7/de/d2e/d2f/f60 zero size 2024-02-28T16:24:10.928 INFO:tasks.workunit.client.0.smithi023.stdout:1/569: rename df/d11/d13/d1b/d30/d57/d5a/d68/d6f/fb4 to df/d93/fc4 0 2024-02-28T16:24:10.931 INFO:tasks.workunit.client.0.smithi023.stdout:9/484: fdatasync d0/d7/f5d 0 2024-02-28T16:24:10.934 INFO:tasks.workunit.client.0.smithi023.stdout:8/582: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fc5 x:0 0 0 2024-02-28T16:24:10.935 INFO:tasks.workunit.client.0.smithi023.stdout:8/583: readlink d0/d5/d1b/d36/lb0 0 2024-02-28T16:24:10.939 INFO:tasks.workunit.client.0.smithi023.stdout:9/485: creat d0/d7/db/d18/d23/d28/fa1 x:0 0 0 2024-02-28T16:24:10.941 INFO:tasks.workunit.client.0.smithi023.stdout:2/578: link d5/da/f38 d5/da/db/d17/d3c/fb1 0 2024-02-28T16:24:10.943 INFO:tasks.workunit.client.0.smithi023.stdout:8/584: chown d0/d5/d1a/f2e 47512247 1 2024-02-28T16:24:10.943 INFO:tasks.workunit.client.0.smithi023.stdout:2/579: readlink d5/da/db/d17/d73/d9e/da0/d8b/l91 0 2024-02-28T16:24:10.946 INFO:tasks.workunit.client.0.smithi023.stdout:9/486: write d0/d7/db/f8f [3384588,58847] 0 2024-02-28T16:24:10.946 INFO:tasks.workunit.client.0.smithi023.stdout:8/585: mknod d0/d5/d35/cc6 0 2024-02-28T16:24:10.950 INFO:tasks.workunit.client.0.smithi023.stdout:8/586: creat d0/d5/d35/fc7 x:0 0 0 2024-02-28T16:24:10.951 INFO:tasks.workunit.client.0.smithi023.stdout:8/587: stat d0/d5/d35/dbf 0 2024-02-28T16:24:10.952 INFO:tasks.workunit.client.0.smithi023.stdout:2/580: link d5/da/d1b/d3f/d75/d92/fa9 d5/da/d1b/d3f/d75/d92/fb2 0 2024-02-28T16:24:10.954 INFO:tasks.workunit.client.0.smithi023.stdout:9/487: creat d0/d7/db/d18/d23/d28/d32/d3c/fa2 x:0 0 0 2024-02-28T16:24:10.958 INFO:tasks.workunit.client.0.smithi023.stdout:1/570: truncate df/d11/d13/d1b/d30/d57/f85 2256997 0 2024-02-28T16:24:10.964 INFO:tasks.workunit.client.0.smithi023.stdout:9/488: creat d0/d7/fa3 x:0 0 0 2024-02-28T16:24:10.971 INFO:tasks.workunit.client.0.smithi023.stdout:9/489: read - d0/d7/db/d18/d23/d28/d32/d3c/f8e zero size 2024-02-28T16:24:10.973 INFO:tasks.workunit.client.0.smithi023.stdout:8/588: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/f68 [0,4194304] 0 2024-02-28T16:24:10.983 INFO:tasks.workunit.client.0.smithi023.stdout:1/571: write df/d11/d13/f15 [5243083,120553] 0 2024-02-28T16:24:10.984 INFO:tasks.workunit.client.0.smithi023.stdout:9/490: link d0/d7/db/d18/d23/d28/c30 d0/d7/db/d18/d23/d28/d9c/ca4 0 2024-02-28T16:24:10.995 INFO:tasks.workunit.client.0.smithi023.stdout:9/491: link d0/d7/db/d18/f9d d0/d7/de/d2e/fa5 0 2024-02-28T16:24:10.996 INFO:tasks.workunit.client.0.smithi023.stdout:8/589: dwrite d0/d5/d1a/d2d/d67/d71/f9c [0,4194304] 0 2024-02-28T16:24:10.998 INFO:tasks.workunit.client.0.smithi023.stdout:9/492: write d0/d7/de/f8d [311070,115818] 0 2024-02-28T16:24:11.003 INFO:tasks.workunit.client.0.smithi023.stdout:9/493: chown d0/d7/db/l11 1071136 1 2024-02-28T16:24:11.012 INFO:tasks.workunit.client.0.smithi023.stdout:8/590: creat d0/d5/d1a/d63/fc8 x:0 0 0 2024-02-28T16:24:11.016 INFO:tasks.workunit.client.0.smithi023.stdout:9/494: symlink d0/d7/de/d2e/d2f/la6 0 2024-02-28T16:24:11.018 INFO:tasks.workunit.client.0.smithi023.stdout:8/591: rmdir d0/d5/d1a/d2d 39 2024-02-28T16:24:11.027 INFO:tasks.workunit.client.0.smithi023.stdout:9/495: mknod d0/d7/de/d2e/d2f/d44/d95/ca7 0 2024-02-28T16:24:11.029 INFO:tasks.workunit.client.0.smithi023.stdout:1/572: write df/dbd/f50 [3746689,17226] 0 2024-02-28T16:24:11.029 INFO:tasks.workunit.client.0.smithi023.stdout:8/592: rmdir d0/d5/d1a/d2d/d67/daf 39 2024-02-28T16:24:11.035 INFO:tasks.workunit.client.0.smithi023.stdout:8/593: write d0/d5/d1a/fbe [3484299,75880] 0 2024-02-28T16:24:11.042 INFO:tasks.workunit.client.0.smithi023.stdout:9/496: link d0/d7/db/d18/d23/d28/d6e/f7f d0/d7/db/d18/d23/fa8 0 2024-02-28T16:24:11.045 INFO:tasks.workunit.client.0.smithi023.stdout:9/497: chown d0/d7/db/d18/d23/d28/d9c/f5f 9573 1 2024-02-28T16:24:11.045 INFO:tasks.workunit.client.0.smithi023.stdout:8/594: symlink d0/d5/d1a/d63/d90/dac/dc3/lc9 0 2024-02-28T16:24:11.048 INFO:tasks.workunit.client.0.smithi023.stdout:9/498: truncate d0/d7/db/d18/f9d 613951 0 2024-02-28T16:24:11.056 INFO:tasks.workunit.client.0.smithi023.stdout:9/499: creat d0/d7/de/d2e/fa9 x:0 0 0 2024-02-28T16:24:11.063 INFO:tasks.workunit.client.0.smithi023.stdout:8/595: dwrite d0/d5/d1a/d2d/d67/d71/d9e/fa9 [0,4194304] 0 2024-02-28T16:24:11.066 INFO:tasks.workunit.client.0.smithi023.stdout:9/500: rename d0/d7/d2c/d84/f88 to d0/d7/db/d18/d23/d28/d32/d8b/faa 0 2024-02-28T16:24:11.071 INFO:tasks.workunit.client.0.smithi023.stdout:8/596: truncate d0/d5/d1a/d2d/d67/d71/d9e/dbb/fc4 111975 0 2024-02-28T16:24:11.073 INFO:tasks.workunit.client.0.smithi023.stdout:9/501: mknod d0/d7/d2c/d7d/cab 0 2024-02-28T16:24:11.075 INFO:tasks.workunit.client.0.smithi023.stdout:9/502: chown d0/d7/de/f8d 115169632 1 2024-02-28T16:24:11.080 INFO:tasks.workunit.client.0.smithi023.stdout:8/597: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/fca x:0 0 0 2024-02-28T16:24:11.087 INFO:tasks.workunit.client.0.smithi023.stdout:8/598: symlink d0/d5/d1a/d2d/d67/daf/lcb 0 2024-02-28T16:24:11.088 INFO:tasks.workunit.client.0.smithi023.stdout:1/573: truncate df/d11/d13/d1b/d30/f60 955647 0 2024-02-28T16:24:11.093 INFO:tasks.workunit.client.0.smithi023.stdout:9/503: dread d0/d7/db/d18/d23/d28/d32/d3c/f51 [0,4194304] 0 2024-02-28T16:24:11.093 INFO:tasks.workunit.client.0.smithi023.stdout:9/504: stat d0/d7/db/f8f 0 2024-02-28T16:24:11.094 INFO:tasks.workunit.client.0.smithi023.stdout:8/599: write d0/fb9 [157746,108622] 0 2024-02-28T16:24:11.094 INFO:tasks.workunit.client.0.smithi023.stdout:1/574: mknod df/d11/d13/d1b/d2e/d5c/cc5 0 2024-02-28T16:24:11.099 INFO:tasks.workunit.client.0.smithi023.stdout:8/600: rename d0/d5/d1a/d2d/d67 to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/dcc 22 2024-02-28T16:24:11.103 INFO:tasks.workunit.client.0.smithi023.stdout:1/575: fdatasync df/d11/d13/d1b/d2e/f84 0 2024-02-28T16:24:11.112 INFO:tasks.workunit.client.0.smithi023.stdout:9/505: dwrite d0/d7/de/d2a/f38 [4194304,4194304] 0 2024-02-28T16:24:11.116 INFO:tasks.workunit.client.0.smithi023.stdout:9/506: dread - d0/d7/db/d18/d23/d28/d32/d3c/f83 zero size 2024-02-28T16:24:11.121 INFO:tasks.workunit.client.0.smithi023.stdout:1/576: dwrite df/d11/d13/d1b/f7f [0,4194304] 0 2024-02-28T16:24:11.124 INFO:tasks.workunit.client.0.smithi023.stdout:9/507: creat d0/d7/db/d18/d23/fac x:0 0 0 2024-02-28T16:24:11.127 INFO:tasks.workunit.client.0.smithi023.stdout:0/485: sync 2024-02-28T16:24:11.127 INFO:tasks.workunit.client.0.smithi023.stdout:4/476: sync 2024-02-28T16:24:11.132 INFO:tasks.workunit.client.0.smithi023.stdout:1/577: mknod df/d11/d13/d1b/d30/d57/d5a/d68/d6f/cc6 0 2024-02-28T16:24:11.140 INFO:tasks.workunit.client.0.smithi023.stdout:9/508: symlink d0/d7/de/d2e/d2f/d4d/lad 0 2024-02-28T16:24:11.144 INFO:tasks.workunit.client.0.smithi023.stdout:8/601: write d0/d5/d1b/d36/f80 [624276,75112] 0 2024-02-28T16:24:11.149 INFO:tasks.workunit.client.0.smithi023.stdout:0/486: rename d6/d4c/c63 to d6/db/d3b/ca4 0 2024-02-28T16:24:11.156 INFO:tasks.workunit.client.0.smithi023.stdout:8/602: write d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/f95 [1535621,65918] 0 2024-02-28T16:24:11.158 INFO:tasks.workunit.client.0.smithi023.stdout:1/578: dwrite df/d11/d13/d1b/d2e/f87 [0,4194304] 0 2024-02-28T16:24:11.159 INFO:tasks.workunit.client.0.smithi023.stdout:4/477: dread d13/f17 [4194304,4194304] 0 2024-02-28T16:24:11.169 INFO:tasks.workunit.client.0.smithi023.stdout:4/478: creat d13/d2b/d2c/d31/d6e/f97 x:0 0 0 2024-02-28T16:24:11.176 INFO:tasks.workunit.client.0.smithi023.stdout:5/717: sync 2024-02-28T16:24:11.176 INFO:tasks.workunit.client.0.smithi023.stdout:7/455: sync 2024-02-28T16:24:11.176 INFO:tasks.workunit.client.0.smithi023.stdout:6/605: sync 2024-02-28T16:24:11.176 INFO:tasks.workunit.client.0.smithi023.stdout:2/581: sync 2024-02-28T16:24:11.176 INFO:tasks.workunit.client.0.smithi023.stdout:3/566: sync 2024-02-28T16:24:11.176 INFO:tasks.workunit.client.0.smithi023.stdout:4/479: mknod d13/c98 0 2024-02-28T16:24:11.178 INFO:tasks.workunit.client.0.smithi023.stdout:7/456: dread - de/d13/f8f zero size 2024-02-28T16:24:11.179 INFO:tasks.workunit.client.0.smithi023.stdout:2/582: fdatasync d5/da/db/d17/fa7 0 2024-02-28T16:24:11.186 INFO:tasks.workunit.client.0.smithi023.stdout:9/509: dread d0/d7/db/d18/f7c [0,4194304] 0 2024-02-28T16:24:11.193 INFO:tasks.workunit.client.0.smithi023.stdout:8/603: dwrite d0/d5/f5e [4194304,4194304] 0 2024-02-28T16:24:11.195 INFO:tasks.workunit.client.0.smithi023.stdout:9/510: creat d0/d7/db/d18/d23/d28/fae x:0 0 0 2024-02-28T16:24:11.198 INFO:tasks.workunit.client.0.smithi023.stdout:8/604: fsync d0/d5/d1a/d2d/f61 0 2024-02-28T16:24:11.199 INFO:tasks.workunit.client.0.smithi023.stdout:5/718: getdents d1/d2a/d32/d58/d60/d88/d89 0 2024-02-28T16:24:11.201 INFO:tasks.workunit.client.0.smithi023.stdout:0/487: dread d6/db/d3d/f55 [0,4194304] 0 2024-02-28T16:24:11.201 INFO:tasks.workunit.client.0.smithi023.stdout:9/511: stat d0/d7/db/d18/d23/d28/d32/f3f 0 2024-02-28T16:24:11.202 INFO:tasks.workunit.client.0.smithi023.stdout:6/606: truncate d1/f1c 2748493 0 2024-02-28T16:24:11.205 INFO:tasks.workunit.client.0.smithi023.stdout:2/583: getdents d5/da/d1b/d3f/d75 0 2024-02-28T16:24:11.206 INFO:tasks.workunit.client.0.smithi023.stdout:8/605: chown d0/d5/d1a/d63 174635 1 2024-02-28T16:24:11.207 INFO:tasks.workunit.client.0.smithi023.stdout:7/457: write de/d13/d1b/d3d/d53/f90 [1070780,96348] 0 2024-02-28T16:24:11.217 INFO:tasks.workunit.client.0.smithi023.stdout:0/488: readlink d6/db/d1a/d26/d31/d33/d37/l3e 0 2024-02-28T16:24:11.218 INFO:tasks.workunit.client.0.smithi023.stdout:5/719: truncate d1/d2a/d32/d58/d73/fd2 614512 0 2024-02-28T16:24:11.220 INFO:tasks.workunit.client.0.smithi023.stdout:9/512: rename d0/d7/de/d2e to d0/d7/de/d2a/daf 0 2024-02-28T16:24:11.221 INFO:tasks.workunit.client.0.smithi023.stdout:4/480: dwrite d13/d2b/d2c/d31/d8d/f94 [0,4194304] 0 2024-02-28T16:24:11.221 INFO:tasks.workunit.client.0.smithi023.stdout:8/606: rmdir d0/d5/d1a/d2d/d67/d71/db4 39 2024-02-28T16:24:11.223 INFO:tasks.workunit.client.0.smithi023.stdout:5/720: fdatasync d1/d2a/d32/d37/d3a/d7f/d62/fa9 0 2024-02-28T16:24:11.230 INFO:tasks.workunit.client.0.smithi023.stdout:7/458: mkdir de/d8b/d95/d98 0 2024-02-28T16:24:11.231 INFO:tasks.workunit.client.0.smithi023.stdout:0/489: dread d6/db/d3b/f58 [0,4194304] 0 2024-02-28T16:24:11.231 INFO:tasks.workunit.client.0.smithi023.stdout:2/584: creat d5/da/db/d17/d73/d9e/da0/d8b/fb3 x:0 0 0 2024-02-28T16:24:11.231 INFO:tasks.workunit.client.0.smithi023.stdout:7/459: fsync de/d13/d1b/d3d/d53/f90 0 2024-02-28T16:24:11.233 INFO:tasks.workunit.client.0.smithi023.stdout:9/513: truncate d0/d7/de/f26 2882998 0 2024-02-28T16:24:11.244 INFO:tasks.workunit.client.0.smithi023.stdout:8/607: getdents d0/d5/d35 0 2024-02-28T16:24:11.244 INFO:tasks.workunit.client.0.smithi023.stdout:2/585: truncate d5/da/db/d17/d73/f9f 1603951 0 2024-02-28T16:24:11.246 INFO:tasks.workunit.client.0.smithi023.stdout:5/721: write d1/f19 [108623,35223] 0 2024-02-28T16:24:11.251 INFO:tasks.workunit.client.0.smithi023.stdout:4/481: dwrite d13/f3c [0,4194304] 0 2024-02-28T16:24:11.254 INFO:tasks.workunit.client.0.smithi023.stdout:5/722: fsync d1/d2a/d32/d37/d3a/fab 0 2024-02-28T16:24:11.256 INFO:tasks.workunit.client.0.smithi023.stdout:8/608: write d0/d5/d1a/d2d/d67/d71/d9e/fa9 [1139612,3501] 0 2024-02-28T16:24:11.265 INFO:tasks.workunit.client.0.smithi023.stdout:6/607: dwrite d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:24:11.272 INFO:tasks.workunit.client.0.smithi023.stdout:6/608: chown d1/d28/d1e/d2b/d6d/l75 8408 1 2024-02-28T16:24:11.282 INFO:tasks.workunit.client.0.smithi023.stdout:0/490: getdents d6/db/d3b/d1f 0 2024-02-28T16:24:11.284 INFO:tasks.workunit.client.0.smithi023.stdout:2/586: fsync d5/da/f38 0 2024-02-28T16:24:11.287 INFO:tasks.workunit.client.0.smithi023.stdout:9/514: write d0/d7/de/d2a/daf/fa5 [785509,1162] 0 2024-02-28T16:24:11.289 INFO:tasks.workunit.client.0.smithi023.stdout:5/723: unlink d1/d2a/d32/d58/d60/d82/lcb 0 2024-02-28T16:24:11.292 INFO:tasks.workunit.client.0.smithi023.stdout:4/482: unlink d13/d1d/d7e/d67/c87 0 2024-02-28T16:24:11.295 INFO:tasks.workunit.client.0.smithi023.stdout:6/609: dread d1/f40 [0,4194304] 0 2024-02-28T16:24:11.295 INFO:tasks.workunit.client.0.smithi023.stdout:7/460: getdents de/d13/d1b/d40 0 2024-02-28T16:24:11.298 INFO:tasks.workunit.client.0.smithi023.stdout:6/610: write d1/d18/d26/da6/fd9 [769784,16053] 0 2024-02-28T16:24:11.299 INFO:tasks.workunit.client.0.smithi023.stdout:0/491: rename d6/db/d1a/d59/l95 to d6/db/d1a/d35/la5 0 2024-02-28T16:24:11.300 INFO:tasks.workunit.client.0.smithi023.stdout:2/587: rmdir d5/da/db/d17/d3c 39 2024-02-28T16:24:11.301 INFO:tasks.workunit.client.0.smithi023.stdout:0/492: fsync d6/db/d3b/f96 0 2024-02-28T16:24:11.304 INFO:tasks.workunit.client.0.smithi023.stdout:9/515: unlink d0/d7/db/d18/d23/d28/c98 0 2024-02-28T16:24:11.305 INFO:tasks.workunit.client.0.smithi023.stdout:4/483: creat d13/d2b/d2c/d31/d8d/f99 x:0 0 0 2024-02-28T16:24:11.306 INFO:tasks.workunit.client.0.smithi023.stdout:7/461: mkdir de/d72/d99 0 2024-02-28T16:24:11.307 INFO:tasks.workunit.client.0.smithi023.stdout:4/484: dread - d13/d1d/d58/f84 zero size 2024-02-28T16:24:11.309 INFO:tasks.workunit.client.0.smithi023.stdout:4/485: write d13/d1d/d7e/d55/f60 [4095116,41678] 0 2024-02-28T16:24:11.310 INFO:tasks.workunit.client.0.smithi023.stdout:6/611: symlink d1/d28/d1e/dae/le4 0 2024-02-28T16:24:11.310 INFO:tasks.workunit.client.0.smithi023.stdout:5/724: mknod d1/d2a/d32/de0/ce4 0 2024-02-28T16:24:11.312 INFO:tasks.workunit.client.0.smithi023.stdout:2/588: creat d5/da/d1b/d3f/d75/fb4 x:0 0 0 2024-02-28T16:24:11.313 INFO:tasks.workunit.client.0.smithi023.stdout:8/609: getdents d0/d5/d1a/d2d/d67/d71/d9e 0 2024-02-28T16:24:11.316 INFO:tasks.workunit.client.0.smithi023.stdout:9/516: mkdir d0/d7/de/d2a/daf/d2f/db0 0 2024-02-28T16:24:11.319 INFO:tasks.workunit.client.0.smithi023.stdout:4/486: chown d13/d2b/d2c/f35 0 1 2024-02-28T16:24:11.323 INFO:tasks.workunit.client.0.smithi023.stdout:7/462: unlink de/d13/d1b/d3d/d53/f6e 0 2024-02-28T16:24:11.328 INFO:tasks.workunit.client.0.smithi023.stdout:0/493: creat d6/db/fa6 x:0 0 0 2024-02-28T16:24:11.333 INFO:tasks.workunit.client.0.smithi023.stdout:8/610: dread d0/d5/d1a/d2d/d67/d71/d9e/fa9 [0,4194304] 0 2024-02-28T16:24:11.333 INFO:tasks.workunit.client.0.smithi023.stdout:5/725: rename d1/d2a/d32/d58/d60/d88/d89 to d1/d2a/d32/d58/d79/de5 0 2024-02-28T16:24:11.340 INFO:tasks.workunit.client.0.smithi023.stdout:4/487: dwrite d13/d2b/f5d [4194304,4194304] 0 2024-02-28T16:24:11.340 INFO:tasks.workunit.client.0.smithi023.stdout:7/463: creat de/d13/d1b/d3f/f9a x:0 0 0 2024-02-28T16:24:11.343 INFO:tasks.workunit.client.0.smithi023.stdout:0/494: readlink d6/db/d24/l61 0 2024-02-28T16:24:11.345 INFO:tasks.workunit.client.0.smithi023.stdout:6/612: rmdir d1/d28/d1e/d52/dd4 0 2024-02-28T16:24:11.348 INFO:tasks.workunit.client.0.smithi023.stdout:2/589: rename d5/da/db/l1a to d5/da/db/d17/d73/d9e/da0/d8b/d93/lb5 0 2024-02-28T16:24:11.360 INFO:tasks.workunit.client.0.smithi023.stdout:5/726: rmdir d1/d2a 39 2024-02-28T16:24:11.364 INFO:tasks.workunit.client.0.smithi023.stdout:4/488: rename d13/d1d/d7e to d13/d1e/d9a 0 2024-02-28T16:24:11.365 INFO:tasks.workunit.client.0.smithi023.stdout:2/590: symlink d5/da/d45/lb6 0 2024-02-28T16:24:11.367 INFO:tasks.workunit.client.0.smithi023.stdout:4/489: write d13/d1e/d9a/d55/f6c [4497727,109887] 0 2024-02-28T16:24:11.370 INFO:tasks.workunit.client.0.smithi023.stdout:7/464: mkdir de/d9b 0 2024-02-28T16:24:11.373 INFO:tasks.workunit.client.0.smithi023.stdout:6/613: unlink d1/d28/d1e/d2b/l65 0 2024-02-28T16:24:11.376 INFO:tasks.workunit.client.0.smithi023.stdout:2/591: creat d5/da/d1b/d3f/d75/fb7 x:0 0 0 2024-02-28T16:24:11.377 INFO:tasks.workunit.client.0.smithi023.stdout:4/490: mknod d13/d2b/d2c/d31/d6e/c9b 0 2024-02-28T16:24:11.379 INFO:tasks.workunit.client.0.smithi023.stdout:0/495: link f4 d6/db/d1a/d35/fa7 0 2024-02-28T16:24:11.380 INFO:tasks.workunit.client.0.smithi023.stdout:8/611: getdents d0/d5 0 2024-02-28T16:24:11.381 INFO:tasks.workunit.client.0.smithi023.stdout:2/592: creat d5/da/d62/fb8 x:0 0 0 2024-02-28T16:24:11.382 INFO:tasks.workunit.client.0.smithi023.stdout:0/496: dread - d6/db/d1a/d26/d31/f90 zero size 2024-02-28T16:24:11.382 INFO:tasks.workunit.client.0.smithi023.stdout:2/593: chown d5/da/d67 1 1 2024-02-28T16:24:11.419 INFO:tasks.workunit.client.0.smithi023.stdout:7/465: creat de/d1c/f9c x:0 0 0 2024-02-28T16:24:11.420 INFO:tasks.workunit.client.0.smithi023.stdout:4/491: rmdir d13/d2b/d2c/d31/d6e 39 2024-02-28T16:24:11.422 INFO:tasks.workunit.client.0.smithi023.stdout:0/497: chown d6/db/d1a/d26/f38 3879 1 2024-02-28T16:24:11.422 INFO:tasks.workunit.client.0.smithi023.stdout:2/594: mkdir d5/da/db/db9 0 2024-02-28T16:24:11.423 INFO:tasks.workunit.client.0.smithi023.stdout:7/466: dread - de/d13/d1b/f49 zero size 2024-02-28T16:24:11.425 INFO:tasks.workunit.client.0.smithi023.stdout:8/612: fdatasync d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/f48 0 2024-02-28T16:24:11.425 INFO:tasks.workunit.client.0.smithi023.stdout:7/467: chown de/d1c/d76/f7f 5922283 1 2024-02-28T16:24:11.427 INFO:tasks.workunit.client.0.smithi023.stdout:4/492: mkdir d13/d1e/d9c 0 2024-02-28T16:24:11.428 INFO:tasks.workunit.client.0.smithi023.stdout:0/498: mkdir d6/db/d1a/d26/d31/da8 0 2024-02-28T16:24:11.428 INFO:tasks.workunit.client.0.smithi023.stdout:8/613: chown d0/d5/d1b/f4d 461906 1 2024-02-28T16:24:11.430 INFO:tasks.workunit.client.0.smithi023.stdout:2/595: rename d5/da/db/d17/d39/c9c to d5/da/d45/cba 0 2024-02-28T16:24:11.432 INFO:tasks.workunit.client.0.smithi023.stdout:7/468: symlink de/l9d 0 2024-02-28T16:24:11.432 INFO:tasks.workunit.client.0.smithi023.stdout:5/727: dwrite d1/d2a/d32/d37/d3a/d7f/f3c [0,4194304] 0 2024-02-28T16:24:11.435 INFO:tasks.workunit.client.0.smithi023.stdout:5/728: write d1/f7c [482909,88322] 0 2024-02-28T16:24:11.437 INFO:tasks.workunit.client.0.smithi023.stdout:4/493: mkdir d13/d2b/d9d 0 2024-02-28T16:24:11.444 INFO:tasks.workunit.client.0.smithi023.stdout:7/469: rename de/c11 to de/d72/c9e 0 2024-02-28T16:24:11.445 INFO:tasks.workunit.client.0.smithi023.stdout:7/470: stat de/d60/l32 0 2024-02-28T16:24:11.448 INFO:tasks.workunit.client.0.smithi023.stdout:5/729: mknod d1/d2a/d32/d37/dcd/ce6 0 2024-02-28T16:24:11.455 INFO:tasks.workunit.client.0.smithi023.stdout:4/494: symlink d13/d2b/d9d/l9e 0 2024-02-28T16:24:11.458 INFO:tasks.workunit.client.0.smithi023.stdout:5/730: mknod d1/d2a/d32/d37/d3a/d7f/d62/d68/ce7 0 2024-02-28T16:24:11.459 INFO:tasks.workunit.client.0.smithi023.stdout:2/596: truncate d5/da/d45/f68 2597761 0 2024-02-28T16:24:11.460 INFO:tasks.workunit.client.0.smithi023.stdout:8/614: dread d0/d5/d1a/d2d/d67/d71/db4/d39/f3b [0,4194304] 0 2024-02-28T16:24:11.461 INFO:tasks.workunit.client.0.smithi023.stdout:7/471: unlink de/d13/f1a 0 2024-02-28T16:24:11.463 INFO:tasks.workunit.client.0.smithi023.stdout:8/615: chown d0/d5/d1a/d63/d90/fae 29 1 2024-02-28T16:24:11.464 INFO:tasks.workunit.client.0.smithi023.stdout:8/616: readlink d0/la 0 2024-02-28T16:24:11.464 INFO:tasks.workunit.client.0.smithi023.stdout:2/597: mkdir d5/da/d1b/d3f/d75/d92/dbb 0 2024-02-28T16:24:11.465 INFO:tasks.workunit.client.0.smithi023.stdout:2/598: stat d5/da/d1b/d3f/f60 0 2024-02-28T16:24:11.468 INFO:tasks.workunit.client.0.smithi023.stdout:2/599: chown d5/da/db/d17/d39/d56 472165430 1 2024-02-28T16:24:11.469 INFO:tasks.workunit.client.0.smithi023.stdout:5/731: getdents d1/d2a/d32/d37/d3a/d7f 0 2024-02-28T16:24:11.475 INFO:tasks.workunit.client.0.smithi023.stdout:0/499: dread d6/db/d1a/d26/f4d [0,4194304] 0 2024-02-28T16:24:11.477 INFO:tasks.workunit.client.0.smithi023.stdout:2/600: write d5/da/f38 [877435,6204] 0 2024-02-28T16:24:11.478 INFO:tasks.workunit.client.0.smithi023.stdout:5/732: mknod d1/d2a/d32/ce8 0 2024-02-28T16:24:11.480 INFO:tasks.workunit.client.0.smithi023.stdout:8/617: rename d0/d5/d1a/d2d/f84 to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/fcd 0 2024-02-28T16:24:11.482 INFO:tasks.workunit.client.0.smithi023.stdout:0/500: rmdir d6/db/d1a/d26 39 2024-02-28T16:24:11.484 INFO:tasks.workunit.client.0.smithi023.stdout:0/501: fdatasync d6/db/d1a/f6b 0 2024-02-28T16:24:11.485 INFO:tasks.workunit.client.0.smithi023.stdout:7/472: dwrite de/d1c/f87 [0,4194304] 0 2024-02-28T16:24:11.487 INFO:tasks.workunit.client.0.smithi023.stdout:2/601: unlink d5/da/db/d17/d73/d9e/da0/fa1 0 2024-02-28T16:24:11.488 INFO:tasks.workunit.client.0.smithi023.stdout:7/473: write de/d13/f2b [4799223,121274] 0 2024-02-28T16:24:11.490 INFO:tasks.workunit.client.0.smithi023.stdout:0/502: write d6/db/d3b/d1f/d82/f57 [471539,20827] 0 2024-02-28T16:24:11.495 INFO:tasks.workunit.client.0.smithi023.stdout:2/602: creat d5/da/db/fbc x:0 0 0 2024-02-28T16:24:11.501 INFO:tasks.workunit.client.0.smithi023.stdout:5/733: link d1/d2a/d32/d37/f51 d1/d2a/d32/d37/d3a/d7f/d62/dd1/fe9 0 2024-02-28T16:24:11.502 INFO:tasks.workunit.client.0.smithi023.stdout:7/474: symlink de/d8b/d95/d98/l9f 0 2024-02-28T16:24:11.508 INFO:tasks.workunit.client.0.smithi023.stdout:7/475: write de/d1c/d76/f7f [421750,55720] 0 2024-02-28T16:24:11.514 INFO:tasks.workunit.client.0.smithi023.stdout:2/603: link d5/da/d62/c6f d5/da/db/d17/d73/d9e/da0/cbd 0 2024-02-28T16:24:11.514 INFO:tasks.workunit.client.0.smithi023.stdout:7/476: rmdir de/d13/d1b/d40 39 2024-02-28T16:24:11.515 INFO:tasks.workunit.client.0.smithi023.stdout:7/477: write de/d13/d1b/f49 [990332,66205] 0 2024-02-28T16:24:11.522 INFO:tasks.workunit.client.0.smithi023.stdout:2/604: rename d5/da/db/d17/d73/d9e/da0/d8b/d93 to d5/dbe 0 2024-02-28T16:24:11.524 INFO:tasks.workunit.client.0.smithi023.stdout:7/478: creat de/d9b/fa0 x:0 0 0 2024-02-28T16:24:11.525 INFO:tasks.workunit.client.0.smithi023.stdout:5/734: dread d1/f40 [0,4194304] 0 2024-02-28T16:24:11.526 INFO:tasks.workunit.client.0.smithi023.stdout:2/605: write d5/dc/f24 [296516,12167] 0 2024-02-28T16:24:11.527 INFO:tasks.workunit.client.0.smithi023.stdout:8/618: dread d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/f9d [0,4194304] 0 2024-02-28T16:24:11.528 INFO:tasks.workunit.client.0.smithi023.stdout:5/735: symlink d1/d2a/lea 0 2024-02-28T16:24:11.528 INFO:tasks.workunit.client.0.smithi023.stdout:7/479: mknod de/d13/d1b/d6c/ca1 0 2024-02-28T16:24:11.534 INFO:tasks.workunit.client.0.smithi023.stdout:7/480: mknod de/d13/d1b/ca2 0 2024-02-28T16:24:11.537 INFO:tasks.workunit.client.0.smithi023.stdout:5/736: link d1/d2a/d32/ddc/ld8 d1/d2a/d32/d58/d60/d88/leb 0 2024-02-28T16:24:11.539 INFO:tasks.workunit.client.0.smithi023.stdout:5/737: stat d1/d2a/d32/d37/d4e/db5/dc6/fde 0 2024-02-28T16:24:11.539 INFO:tasks.workunit.client.0.smithi023.stdout:2/606: rmdir d5/da/db/d17/d73/d9e/da0 39 2024-02-28T16:24:11.541 INFO:tasks.workunit.client.0.smithi023.stdout:2/607: write d5/dc/f21 [1398072,97639] 0 2024-02-28T16:24:11.543 INFO:tasks.workunit.client.0.smithi023.stdout:5/738: mknod d1/d2a/d32/de0/cec 0 2024-02-28T16:24:11.545 INFO:tasks.workunit.client.0.smithi023.stdout:8/619: write d0/d5/d1b/d7f/f91 [822217,109919] 0 2024-02-28T16:24:11.549 INFO:tasks.workunit.client.0.smithi023.stdout:5/739: mknod d1/d2a/d32/d58/d60/d82/dad/ced 0 2024-02-28T16:24:11.549 INFO:tasks.workunit.client.0.smithi023.stdout:8/620: dread - d0/d5/d1a/d2d/d67/d71/fa0 zero size 2024-02-28T16:24:11.553 INFO:tasks.workunit.client.0.smithi023.stdout:5/740: dread - d1/d2a/d32/d37/d4e/db5/fcf zero size 2024-02-28T16:24:11.554 INFO:tasks.workunit.client.0.smithi023.stdout:5/741: readlink d1/d2a/lea 0 2024-02-28T16:24:11.555 INFO:tasks.workunit.client.0.smithi023.stdout:7/481: dwrite de/d13/d1b/d3d/d53/f90 [0,4194304] 0 2024-02-28T16:24:11.555 INFO:tasks.workunit.client.0.smithi023.stdout:5/742: readlink d1/d2a/l35 0 2024-02-28T16:24:11.558 INFO:tasks.workunit.client.0.smithi023.stdout:5/743: fsync d1/d2a/d32/d37/d3a/f6d 0 2024-02-28T16:24:11.561 INFO:tasks.workunit.client.0.smithi023.stdout:5/744: write d1/d2a/d32/d37/d4e/db5/fcf [811685,40873] 0 2024-02-28T16:24:11.574 INFO:tasks.workunit.client.0.smithi023.stdout:8/621: dwrite d0/d5/d1b/f20 [0,4194304] 0 2024-02-28T16:24:11.578 INFO:tasks.workunit.client.0.smithi023.stdout:2/608: dread d5/da/db/f23 [0,4194304] 0 2024-02-28T16:24:11.583 INFO:tasks.workunit.client.0.smithi023.stdout:8/622: truncate d0/d5/d1a/d2d/d67/d71/fb7 942656 0 2024-02-28T16:24:11.583 INFO:tasks.workunit.client.0.smithi023.stdout:5/745: dwrite d1/d2a/d32/d37/fc8 [0,4194304] 0 2024-02-28T16:24:11.586 INFO:tasks.workunit.client.0.smithi023.stdout:2/609: mknod d5/da/d1b/d3f/d75/cbf 0 2024-02-28T16:24:11.588 INFO:tasks.workunit.client.0.smithi023.stdout:5/746: creat d1/d2a/d32/de0/fee x:0 0 0 2024-02-28T16:24:11.593 INFO:tasks.workunit.client.0.smithi023.stdout:8/623: rename d0/d5/d35/l4e to d0/d5/d1b/d7f/lce 0 2024-02-28T16:24:11.593 INFO:tasks.workunit.client.0.smithi023.stdout:2/610: chown d5/da/db/d17/d3c/faf 10506504 1 2024-02-28T16:24:11.594 INFO:tasks.workunit.client.0.smithi023.stdout:5/747: getdents d1/d2a/d32/d37/d4e/db5/dc0 0 2024-02-28T16:24:11.594 INFO:tasks.workunit.client.0.smithi023.stdout:2/611: chown d5/da/db/d17/d39/d56/f63 6849 1 2024-02-28T16:24:11.602 INFO:tasks.workunit.client.0.smithi023.stdout:5/748: rename d1/d2a/da5 to d1/d2a/d32/d58/def 0 2024-02-28T16:24:11.603 INFO:tasks.workunit.client.0.smithi023.stdout:2/612: truncate d5/dc/f42 575294 0 2024-02-28T16:24:11.603 INFO:tasks.workunit.client.0.smithi023.stdout:8/624: write d0/d5/d1a/f8b [2871890,32217] 0 2024-02-28T16:24:11.603 INFO:tasks.workunit.client.0.smithi023.stdout:3/567: sync 2024-02-28T16:24:11.603 INFO:tasks.workunit.client.0.smithi023.stdout:1/579: sync 2024-02-28T16:24:11.608 INFO:tasks.workunit.client.0.smithi023.stdout:2/613: creat d5/da/d67/fc0 x:0 0 0 2024-02-28T16:24:11.609 INFO:tasks.workunit.client.0.smithi023.stdout:3/568: read d1/df/d2d/d45/d78/f79 [692406,52135] 0 2024-02-28T16:24:11.610 INFO:tasks.workunit.client.0.smithi023.stdout:8/625: creat d0/d5/d1a/d63/fcf x:0 0 0 2024-02-28T16:24:11.611 INFO:tasks.workunit.client.0.smithi023.stdout:1/580: write df/d11/f90 [5009688,52636] 0 2024-02-28T16:24:11.612 INFO:tasks.workunit.client.0.smithi023.stdout:2/614: chown d5/da/d1b/d3f/d75/d8a 49184735 1 2024-02-28T16:24:11.618 INFO:tasks.workunit.client.0.smithi023.stdout:5/749: creat d1/d2a/d32/d37/d4e/db5/dc6/ff0 x:0 0 0 2024-02-28T16:24:11.619 INFO:tasks.workunit.client.0.smithi023.stdout:3/569: chown d1/df/d2d/d32/d3f/f90 8018 1 2024-02-28T16:24:11.621 INFO:tasks.workunit.client.0.smithi023.stdout:1/581: chown df/d11/d13/d1b/d2e/d5c/cc5 233961756 1 2024-02-28T16:24:11.622 INFO:tasks.workunit.client.0.smithi023.stdout:5/750: chown d1/d2a/d32/d37/dcd/ld9 9470 1 2024-02-28T16:24:11.637 INFO:tasks.workunit.client.0.smithi023.stdout:2/615: rmdir d5/da/db/d17/d73 39 2024-02-28T16:24:11.639 INFO:tasks.workunit.client.0.smithi023.stdout:5/751: dwrite d1/d2a/d32/d37/d4e/db5/dc6/ff0 [0,4194304] 0 2024-02-28T16:24:11.650 INFO:tasks.workunit.client.0.smithi023.stdout:5/752: creat d1/d2a/d32/d58/d60/d82/ff1 x:0 0 0 2024-02-28T16:24:11.651 INFO:tasks.workunit.client.0.smithi023.stdout:1/582: rmdir df/d11/d13/d1b/d30/d57/d78/db2 0 2024-02-28T16:24:11.651 INFO:tasks.workunit.client.0.smithi023.stdout:5/753: read d1/d2a/d32/d58/d60/f90 [676417,116450] 0 2024-02-28T16:24:11.655 INFO:tasks.workunit.client.0.smithi023.stdout:3/570: truncate d1/df/f60 280314 0 2024-02-28T16:24:11.655 INFO:tasks.workunit.client.0.smithi023.stdout:5/754: truncate d1/d2a/d32/d37/d3a/fab 4237937 0 2024-02-28T16:24:11.658 INFO:tasks.workunit.client.0.smithi023.stdout:5/755: chown d1/d2a/d32/d37/d3a/d7f/d62 25 1 2024-02-28T16:24:11.660 INFO:tasks.workunit.client.0.smithi023.stdout:2/616: dwrite d5/da/db/d17/d73/d9e/fac [0,4194304] 0 2024-02-28T16:24:11.663 INFO:tasks.workunit.client.0.smithi023.stdout:3/571: link d1/df/d2d/d45/f86 d1/df/d2d/d9d/fc3 0 2024-02-28T16:24:11.664 INFO:tasks.workunit.client.0.smithi023.stdout:1/583: truncate df/d11/d13/d1b/d30/d57/d5a/d68/d7a/fb1 172667 0 2024-02-28T16:24:11.665 INFO:tasks.workunit.client.0.smithi023.stdout:3/572: fdatasync d1/df/d33/d38/f43 0 2024-02-28T16:24:11.670 INFO:tasks.workunit.client.0.smithi023.stdout:2/617: rename d5/da/d67/l70 to d5/da/d67/lc1 0 2024-02-28T16:24:11.670 INFO:tasks.workunit.client.0.smithi023.stdout:3/573: dread - d1/df/d33/d38/d4c/f7c zero size 2024-02-28T16:24:11.670 INFO:tasks.workunit.client.0.smithi023.stdout:5/756: creat d1/d2a/d32/d36/da7/ff2 x:0 0 0 2024-02-28T16:24:11.671 INFO:tasks.workunit.client.0.smithi023.stdout:2/618: write d5/da/db/d17/d3c/faf [425953,121938] 0 2024-02-28T16:24:11.673 INFO:tasks.workunit.client.0.smithi023.stdout:2/619: chown d5/da/f54 1994127 1 2024-02-28T16:24:11.676 INFO:tasks.workunit.client.0.smithi023.stdout:1/584: creat df/dbd/fc7 x:0 0 0 2024-02-28T16:24:11.678 INFO:tasks.workunit.client.0.smithi023.stdout:1/585: stat df/d26/d48/d80/l91 0 2024-02-28T16:24:11.678 INFO:tasks.workunit.client.0.smithi023.stdout:5/757: read d1/f55 [3972437,108079] 0 2024-02-28T16:24:11.681 INFO:tasks.workunit.client.0.smithi023.stdout:3/574: getdents d1/df/d3d 0 2024-02-28T16:24:11.681 INFO:tasks.workunit.client.0.smithi023.stdout:5/758: chown d1/d2a/d32/d36/c64 4 1 2024-02-28T16:24:11.684 INFO:tasks.workunit.client.0.smithi023.stdout:3/575: chown d1/df/d2d/d45/d52/d65/d89/c8b 19863960 1 2024-02-28T16:24:11.685 INFO:tasks.workunit.client.0.smithi023.stdout:2/620: link d5/da/d1b/d3f/d75/d92/f96 d5/dbe/fc2 0 2024-02-28T16:24:11.685 INFO:tasks.workunit.client.0.smithi023.stdout:5/759: symlink d1/d2a/lf3 0 2024-02-28T16:24:11.689 INFO:tasks.workunit.client.0.smithi023.stdout:5/760: mknod d1/d2a/d32/d36/cf4 0 2024-02-28T16:24:11.690 INFO:tasks.workunit.client.0.smithi023.stdout:3/576: truncate d1/df/d33/d38/d4c/f5d 710311 0 2024-02-28T16:24:11.694 INFO:tasks.workunit.client.0.smithi023.stdout:3/577: truncate d1/df/d2d/f84 175369 0 2024-02-28T16:24:11.700 INFO:tasks.workunit.client.0.smithi023.stdout:3/578: readlink d1/df/lb4 0 2024-02-28T16:24:11.701 INFO:tasks.workunit.client.0.smithi023.stdout:1/586: dwrite df/d93/fc4 [0,4194304] 0 2024-02-28T16:24:11.706 INFO:tasks.workunit.client.0.smithi023.stdout:2/621: dwrite d5/da/d62/fb8 [0,4194304] 0 2024-02-28T16:24:11.711 INFO:tasks.workunit.client.0.smithi023.stdout:3/579: chown d1/df/d2d/d32/d3f/fa6 94 1 2024-02-28T16:24:11.712 INFO:tasks.workunit.client.0.smithi023.stdout:1/587: mknod df/d11/d13/cc8 0 2024-02-28T16:24:11.716 INFO:tasks.workunit.client.0.smithi023.stdout:5/761: dwrite d1/d2a/d32/d37/f59 [0,4194304] 0 2024-02-28T16:24:11.718 INFO:tasks.workunit.client.0.smithi023.stdout:5/762: write d1/f7c [331892,119473] 0 2024-02-28T16:24:11.718 INFO:tasks.workunit.client.0.smithi023.stdout:2/622: truncate d5/ff 4944443 0 2024-02-28T16:24:11.722 INFO:tasks.workunit.client.0.smithi023.stdout:1/588: creat df/d11/d13/d1b/d2e/fc9 x:0 0 0 2024-02-28T16:24:11.781 INFO:tasks.workunit.client.0.smithi023.stdout:9/517: sync 2024-02-28T16:24:11.781 INFO:tasks.workunit.client.0.smithi023.stdout:6/614: sync 2024-02-28T16:24:11.818 INFO:tasks.workunit.client.0.smithi023.stdout:3/580: dread d1/d4a/fae [0,4194304] 0 2024-02-28T16:24:11.819 INFO:tasks.workunit.client.0.smithi023.stdout:1/589: readlink df/d11/d13/d1b/d2e/d5c/l7c 0 2024-02-28T16:24:11.819 INFO:tasks.workunit.client.0.smithi023.stdout:5/763: truncate d1/f19 1357989 0 2024-02-28T16:24:11.819 INFO:tasks.workunit.client.0.smithi023.stdout:2/623: mknod d5/da/d1b/d3f/d75/d8a/cc3 0 2024-02-28T16:24:11.823 INFO:tasks.workunit.client.0.smithi023.stdout:3/581: dread - d1/df/d2d/d45/d6f/f99 zero size 2024-02-28T16:24:11.824 INFO:tasks.workunit.client.0.smithi023.stdout:6/615: rename d1/d4f/d63 to d1/d28/d1e/d2b/d6d/d7b/de5 0 2024-02-28T16:24:11.827 INFO:tasks.workunit.client.0.smithi023.stdout:2/624: rename d5/dc/f84 to d5/da/db/d17/d73/fc4 0 2024-02-28T16:24:11.828 INFO:tasks.workunit.client.0.smithi023.stdout:2/625: readlink d5/ld 0 2024-02-28T16:24:11.830 INFO:tasks.workunit.client.0.smithi023.stdout:3/582: mknod d1/df/d3d/d57/d61/db5/db9/cc4 0 2024-02-28T16:24:11.830 INFO:tasks.workunit.client.0.smithi023.stdout:2/626: readlink d5/da/d62/l89 0 2024-02-28T16:24:11.838 INFO:tasks.workunit.client.0.smithi023.stdout:9/518: dwrite d0/d7/de/d2a/daf/d2f/f60 [0,4194304] 0 2024-02-28T16:24:11.842 INFO:tasks.workunit.client.0.smithi023.stdout:9/519: write d0/d7/db/f9a [918263,50399] 0 2024-02-28T16:24:11.843 INFO:tasks.workunit.client.0.smithi023.stdout:6/616: rename d1/d28/d1e/d2b/d6d/d7b/fb5 to d1/d18/d26/d3a/de0/fe6 0 2024-02-28T16:24:11.846 INFO:tasks.workunit.client.0.smithi023.stdout:6/617: dread - d1/d18/d26/d3a/fd2 zero size 2024-02-28T16:24:11.850 INFO:tasks.workunit.client.0.smithi023.stdout:2/627: rename d5/da/d67/l6b to d5/da/db/d17/d73/d9e/da0/d8b/lc5 0 2024-02-28T16:24:11.853 INFO:tasks.workunit.client.0.smithi023.stdout:6/618: mknod d1/d28/d1e/dae/ce7 0 2024-02-28T16:24:11.856 INFO:tasks.workunit.client.0.smithi023.stdout:9/520: rename d0/d7/db/d18/d23/d28/d32/d3c/fa2 to d0/d7/db/d18/d23/d28/d9c/fb1 0 2024-02-28T16:24:11.856 INFO:tasks.workunit.client.0.smithi023.stdout:6/619: fsync d1/d28/d1e/d2b/d44/d86/fbd 0 2024-02-28T16:24:11.858 INFO:tasks.workunit.client.0.smithi023.stdout:9/521: chown d0/d7/db/d18/f22 65315 1 2024-02-28T16:24:11.863 INFO:tasks.workunit.client.0.smithi023.stdout:1/590: write df/d11/d13/f14 [1107134,64233] 0 2024-02-28T16:24:11.865 INFO:tasks.workunit.client.0.smithi023.stdout:9/522: truncate d0/d7/db/d18/d23/d28/f74 65825 0 2024-02-28T16:24:11.869 INFO:tasks.workunit.client.0.smithi023.stdout:2/628: dwrite d5/dc/f95 [0,4194304] 0 2024-02-28T16:24:11.869 INFO:tasks.workunit.client.0.smithi023.stdout:9/523: chown d0/d7/db/d18/d23/d28/d32/c47 1 1 2024-02-28T16:24:11.885 INFO:tasks.workunit.client.0.smithi023.stdout:6/620: dwrite d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:24:11.887 INFO:tasks.workunit.client.0.smithi023.stdout:3/583: dwrite d1/df/d2d/d9d/fc3 [0,4194304] 0 2024-02-28T16:24:11.890 INFO:tasks.workunit.client.0.smithi023.stdout:2/629: read d5/dc/f24 [4055972,85787] 0 2024-02-28T16:24:11.899 INFO:tasks.workunit.client.0.smithi023.stdout:6/621: rename d1/d28/d1e/d52/daf to d1/d18/dd8/de8 0 2024-02-28T16:24:11.900 INFO:tasks.workunit.client.0.smithi023.stdout:2/630: mkdir d5/da/db/d17/d3c/d7f/dc6 0 2024-02-28T16:24:11.900 INFO:tasks.workunit.client.0.smithi023.stdout:9/524: dwrite d0/d7/de/f14 [4194304,4194304] 0 2024-02-28T16:24:11.906 INFO:tasks.workunit.client.0.smithi023.stdout:6/622: mknod d1/d18/d26/d3a/de0/ce9 0 2024-02-28T16:24:11.909 INFO:tasks.workunit.client.0.smithi023.stdout:2/631: rename d5/da/db/d17/fa7 to d5/da/db/d17/d73/d9e/da0/fc7 0 2024-02-28T16:24:11.910 INFO:tasks.workunit.client.0.smithi023.stdout:9/525: symlink d0/d7/de/d2a/daf/d2f/lb2 0 2024-02-28T16:24:11.914 INFO:tasks.workunit.client.0.smithi023.stdout:6/623: rmdir d1/d18/d26/da6 39 2024-02-28T16:24:11.922 INFO:tasks.workunit.client.0.smithi023.stdout:2/632: dread d5/da/db/f23 [0,4194304] 0 2024-02-28T16:24:11.928 INFO:tasks.workunit.client.0.smithi023.stdout:2/633: getdents d5/da/db/d17 0 2024-02-28T16:24:11.930 INFO:tasks.workunit.client.0.smithi023.stdout:2/634: creat d5/da/d1b/fc8 x:0 0 0 2024-02-28T16:24:11.931 INFO:tasks.workunit.client.0.smithi023.stdout:6/624: write d1/d18/f30 [3001420,89953] 0 2024-02-28T16:24:11.936 INFO:tasks.workunit.client.0.smithi023.stdout:6/625: unlink d1/d3d/f45 0 2024-02-28T16:24:11.939 INFO:tasks.workunit.client.0.smithi023.stdout:6/626: chown d1/d28/f19 25863121 1 2024-02-28T16:24:11.939 INFO:tasks.workunit.client.0.smithi023.stdout:9/526: dwrite d0/d7/db/d18/d23/f81 [0,4194304] 0 2024-02-28T16:24:11.944 INFO:tasks.workunit.client.0.smithi023.stdout:9/527: read d0/d7/de/f26 [655279,48249] 0 2024-02-28T16:24:11.946 INFO:tasks.workunit.client.0.smithi023.stdout:9/528: stat d0/d7/de/d2a/daf/d2f/lb2 0 2024-02-28T16:24:11.948 INFO:tasks.workunit.client.0.smithi023.stdout:6/627: link d1/d28/f62 d1/d3d/fea 0 2024-02-28T16:24:11.952 INFO:tasks.workunit.client.0.smithi023.stdout:9/529: creat d0/d7/d2c/d84/fb3 x:0 0 0 2024-02-28T16:24:11.963 INFO:tasks.workunit.client.0.smithi023.stdout:2/635: dread d5/da/d1b/d3f/d75/d92/fa9 [0,4194304] 0 2024-02-28T16:24:11.965 INFO:tasks.workunit.client.0.smithi023.stdout:2/636: readlink d5/da/d45/lb6 0 2024-02-28T16:24:11.970 INFO:tasks.workunit.client.0.smithi023.stdout:6/628: dwrite d1/d28/d1e/d2b/d44/d86/f8f [0,4194304] 0 2024-02-28T16:24:11.972 INFO:tasks.workunit.client.0.smithi023.stdout:2/637: creat d5/da/db/d17/d3c/fc9 x:0 0 0 2024-02-28T16:24:11.977 INFO:tasks.workunit.client.0.smithi023.stdout:9/530: dwrite d0/d7/db/d18/d23/d28/d32/d8b/f9f [0,4194304] 0 2024-02-28T16:24:11.979 INFO:tasks.workunit.client.0.smithi023.stdout:9/531: chown d0/d7/de/d2a/daf/d2f 5 1 2024-02-28T16:24:11.981 INFO:tasks.workunit.client.0.smithi023.stdout:9/532: dread - d0/d7/de/d2a/daf/d2f/d4d/f85 zero size 2024-02-28T16:24:11.992 INFO:tasks.workunit.client.0.smithi023.stdout:9/533: rename d0/d7/db/d18/d23/d28/d9c/f76 to d0/d7/d2c/d7d/fb4 0 2024-02-28T16:24:12.003 INFO:tasks.workunit.client.0.smithi023.stdout:9/534: getdents d0/d7/de/d2a/daf/d2f/d44/d95 0 2024-02-28T16:24:12.004 INFO:tasks.workunit.client.0.smithi023.stdout:6/629: truncate d1/d18/f90 2623539 0 2024-02-28T16:24:12.004 INFO:tasks.workunit.client.0.smithi023.stdout:4/495: sync 2024-02-28T16:24:12.006 INFO:tasks.workunit.client.0.smithi023.stdout:4/496: fdatasync d13/d2b/f5d 0 2024-02-28T16:24:12.006 INFO:tasks.workunit.client.0.smithi023.stdout:2/638: dwrite d5/da/d1b/f1e [4194304,4194304] 0 2024-02-28T16:24:12.007 INFO:tasks.workunit.client.0.smithi023.stdout:9/535: dread - d0/d7/db/d18/d23/d28/d9c/fb1 zero size 2024-02-28T16:24:12.014 INFO:tasks.workunit.client.0.smithi023.stdout:6/630: creat d1/d28/d1e/d52/feb x:0 0 0 2024-02-28T16:24:12.029 INFO:tasks.workunit.client.0.smithi023.stdout:2/639: creat d5/da/d1b/d3f/d75/d92/dbb/fca x:0 0 0 2024-02-28T16:24:12.033 INFO:tasks.workunit.client.0.smithi023.stdout:9/536: dwrite d0/d7/db/d18/f7c [0,4194304] 0 2024-02-28T16:24:12.041 INFO:tasks.workunit.client.0.smithi023.stdout:9/537: truncate d0/d7/f5d 963835 0 2024-02-28T16:24:12.044 INFO:tasks.workunit.client.0.smithi023.stdout:9/538: chown d0/d7/db/d18/d23/d28/d32/d3c/f8e 0 1 2024-02-28T16:24:12.047 INFO:tasks.workunit.client.0.smithi023.stdout:6/631: getdents d1/d18/d26/da6/da9 0 2024-02-28T16:24:12.050 INFO:tasks.workunit.client.0.smithi023.stdout:9/539: dread d0/d7/de/d2a/daf/f7e [0,4194304] 0 2024-02-28T16:24:12.052 INFO:tasks.workunit.client.0.smithi023.stdout:9/540: chown d0/d7/db/d18/l20 4 1 2024-02-28T16:24:12.052 INFO:tasks.workunit.client.0.smithi023.stdout:4/497: dread d13/d1d/f41 [0,4194304] 0 2024-02-28T16:24:12.053 INFO:tasks.workunit.client.0.smithi023.stdout:6/632: chown d1/d18/fa5 454 1 2024-02-28T16:24:12.059 INFO:tasks.workunit.client.0.smithi023.stdout:6/633: rename d1/d28/d1e/lbe to d1/d18/d26/da6/da9/lec 0 2024-02-28T16:24:12.066 INFO:tasks.workunit.client.0.smithi023.stdout:9/541: link d0/d7/de/l69 d0/d7/de/d2a/daf/d2f/d44/lb5 0 2024-02-28T16:24:12.068 INFO:tasks.workunit.client.0.smithi023.stdout:6/634: dread d1/d28/f5f [0,4194304] 0 2024-02-28T16:24:12.069 INFO:tasks.workunit.client.0.smithi023.stdout:2/640: dwrite d5/f7d [0,4194304] 0 2024-02-28T16:24:12.071 INFO:tasks.workunit.client.0.smithi023.stdout:9/542: mkdir d0/d7/db/d18/d23/d28/db6 0 2024-02-28T16:24:12.072 INFO:tasks.workunit.client.0.smithi023.stdout:6/635: mkdir d1/d18/dd8/de8/ded 0 2024-02-28T16:24:12.074 INFO:tasks.workunit.client.0.smithi023.stdout:2/641: creat d5/da/db/d17/d39/fcb x:0 0 0 2024-02-28T16:24:12.087 INFO:tasks.workunit.client.0.smithi023.stdout:2/642: link d5/da/db/d17/f2a d5/da/d8c/fcc 0 2024-02-28T16:24:12.090 INFO:tasks.workunit.client.0.smithi023.stdout:6/636: dwrite d1/d28/d1e/d2b/d6d/fc8 [0,4194304] 0 2024-02-28T16:24:12.091 INFO:tasks.workunit.client.0.smithi023.stdout:6/637: stat d1/d28/d1e/f4e 0 2024-02-28T16:24:12.093 INFO:tasks.workunit.client.0.smithi023.stdout:2/643: mknod d5/da/d67/ccd 0 2024-02-28T16:24:12.096 INFO:tasks.workunit.client.0.smithi023.stdout:2/644: truncate d5/dc/f24 4792135 0 2024-02-28T16:24:12.211 INFO:tasks.workunit.client.0.smithi023.stdout:7/482: sync 2024-02-28T16:24:12.212 INFO:tasks.workunit.client.0.smithi023.stdout:0/503: sync 2024-02-28T16:24:12.216 INFO:tasks.workunit.client.0.smithi023.stdout:0/504: chown d6/db/d1a/f81 0 1 2024-02-28T16:24:12.221 INFO:tasks.workunit.client.0.smithi023.stdout:7/483: rename de/d13/l94 to de/d8b/d95/d98/la3 0 2024-02-28T16:24:12.223 INFO:tasks.workunit.client.0.smithi023.stdout:7/484: fsync de/d1c/f87 0 2024-02-28T16:24:12.226 INFO:tasks.workunit.client.0.smithi023.stdout:0/505: creat d6/db/d1a/d35/d9d/fa9 x:0 0 0 2024-02-28T16:24:12.231 INFO:tasks.workunit.client.0.smithi023.stdout:7/485: mknod de/d8b/d95/ca4 0 2024-02-28T16:24:12.234 INFO:tasks.workunit.client.0.smithi023.stdout:0/506: rmdir d6/d4c 39 2024-02-28T16:24:12.249 INFO:tasks.workunit.client.0.smithi023.stdout:0/507: creat d6/db/d1a/d26/d31/d33/d37/d8f/faa x:0 0 0 2024-02-28T16:24:12.267 INFO:tasks.workunit.client.0.smithi023.stdout:0/508: rename d6/db/d3b/d1f to d6/db/dab 0 2024-02-28T16:24:12.277 INFO:tasks.workunit.client.0.smithi023.stdout:0/509: unlink d6/db/d3b/f28 0 2024-02-28T16:24:12.282 INFO:tasks.workunit.client.0.smithi023.stdout:0/510: write d6/db/d3d/f70 [53039,71984] 0 2024-02-28T16:24:12.289 INFO:tasks.workunit.client.0.smithi023.stdout:0/511: write d6/db/d1a/d26/d31/d33/f94 [891427,42676] 0 2024-02-28T16:24:12.299 INFO:tasks.workunit.client.0.smithi023.stdout:0/512: mknod d6/db/d1a/d26/d31/d33/cac 0 2024-02-28T16:24:12.305 INFO:tasks.workunit.client.0.smithi023.stdout:0/513: rmdir d6/db/d1a/d26/d31/da0 39 2024-02-28T16:24:12.313 INFO:tasks.workunit.client.0.smithi023.stdout:0/514: creat d6/db/d1a/d26/d31/da8/fad x:0 0 0 2024-02-28T16:24:12.318 INFO:tasks.workunit.client.0.smithi023.stdout:8/626: sync 2024-02-28T16:24:12.319 INFO:tasks.workunit.client.0.smithi023.stdout:7/486: write f8 [1166325,82899] 0 2024-02-28T16:24:12.335 INFO:tasks.workunit.client.0.smithi023.stdout:7/487: link de/d13/d1b/d3d/d53/c55 de/d1c/ca5 0 2024-02-28T16:24:12.335 INFO:tasks.workunit.client.0.smithi023.stdout:0/515: dread d6/db/dab/d82/f2f [0,4194304] 0 2024-02-28T16:24:12.338 INFO:tasks.workunit.client.0.smithi023.stdout:7/488: write de/d1c/d76/f7f [1206388,63864] 0 2024-02-28T16:24:12.347 INFO:tasks.workunit.client.0.smithi023.stdout:0/516: link d6/db/dab/d82/f57 d6/db/dab/d82/fae 0 2024-02-28T16:24:12.350 INFO:tasks.workunit.client.0.smithi023.stdout:7/489: creat de/fa6 x:0 0 0 2024-02-28T16:24:12.353 INFO:tasks.workunit.client.0.smithi023.stdout:7/490: write de/d1c/d76/f7f [4873723,12048] 0 2024-02-28T16:24:12.353 INFO:tasks.workunit.client.0.smithi023.stdout:8/627: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/f88 [0,4194304] 0 2024-02-28T16:24:12.355 INFO:tasks.workunit.client.0.smithi023.stdout:0/517: readlink d6/db/d1a/d35/la5 0 2024-02-28T16:24:12.368 INFO:tasks.workunit.client.0.smithi023.stdout:9/543: sync 2024-02-28T16:24:12.368 INFO:tasks.workunit.client.0.smithi023.stdout:4/498: sync 2024-02-28T16:24:12.368 INFO:tasks.workunit.client.0.smithi023.stdout:1/591: sync 2024-02-28T16:24:12.368 INFO:tasks.workunit.client.0.smithi023.stdout:6/638: sync 2024-02-28T16:24:12.368 INFO:tasks.workunit.client.0.smithi023.stdout:3/584: sync 2024-02-28T16:24:12.368 INFO:tasks.workunit.client.0.smithi023.stdout:5/764: sync 2024-02-28T16:24:12.368 INFO:tasks.workunit.client.0.smithi023.stdout:2/645: sync 2024-02-28T16:24:12.377 INFO:tasks.workunit.client.0.smithi023.stdout:8/628: link d0/d5/d1a/d63/d90/dac/lc1 d0/d5/d1a/d44/ld0 0 2024-02-28T16:24:12.384 INFO:tasks.workunit.client.0.smithi023.stdout:9/544: symlink d0/d7/db/d18/d23/d28/d32/d8b/lb7 0 2024-02-28T16:24:12.386 INFO:tasks.workunit.client.0.smithi023.stdout:4/499: fdatasync d13/d2b/d2c/d31/f48 0 2024-02-28T16:24:12.386 INFO:tasks.workunit.client.0.smithi023.stdout:0/518: dwrite d6/db/d1a/d26/d31/d33/f94 [0,4194304] 0 2024-02-28T16:24:12.391 INFO:tasks.workunit.client.0.smithi023.stdout:9/545: chown d0/d7/db/d18/d23/d28/d32/d8b 2527 1 2024-02-28T16:24:12.394 INFO:tasks.workunit.client.0.smithi023.stdout:1/592: truncate df/d26/d48/f9d 198575 0 2024-02-28T16:24:12.396 INFO:tasks.workunit.client.0.smithi023.stdout:1/593: chown df/d11 303824 1 2024-02-28T16:24:12.399 INFO:tasks.workunit.client.0.smithi023.stdout:5/765: dread d1/d2a/d32/d37/d4e/db5/dc6/ff0 [0,4194304] 0 2024-02-28T16:24:12.399 INFO:tasks.workunit.client.0.smithi023.stdout:1/594: write df/d26/d48/f4c [15178092,113288] 0 2024-02-28T16:24:12.400 INFO:tasks.workunit.client.0.smithi023.stdout:8/629: rename d0/d5/d1b/d7f/lce to d0/d5/d1a/d63/d90/ld1 0 2024-02-28T16:24:12.401 INFO:tasks.workunit.client.0.smithi023.stdout:4/500: creat d13/d1e/d9c/f9f x:0 0 0 2024-02-28T16:24:12.403 INFO:tasks.workunit.client.0.smithi023.stdout:0/519: symlink d6/d98/laf 0 2024-02-28T16:24:12.404 INFO:tasks.workunit.client.0.smithi023.stdout:3/585: dwrite d1/d4a/fae [0,4194304] 0 2024-02-28T16:24:12.408 INFO:tasks.workunit.client.0.smithi023.stdout:1/595: unlink df/d26/d48/f4c 0 2024-02-28T16:24:12.415 INFO:tasks.workunit.client.0.smithi023.stdout:4/501: creat d13/d1d/fa0 x:0 0 0 2024-02-28T16:24:12.415 INFO:tasks.workunit.client.0.smithi023.stdout:5/766: mkdir d1/d2a/d32/d58/d73/df5 0 2024-02-28T16:24:12.421 INFO:tasks.workunit.client.0.smithi023.stdout:8/630: mknod d0/d5/d1a/d44/cd2 0 2024-02-28T16:24:12.422 INFO:tasks.workunit.client.0.smithi023.stdout:0/520: truncate d6/db/dab/d82/f2f 737562 0 2024-02-28T16:24:12.427 INFO:tasks.workunit.client.0.smithi023.stdout:7/491: truncate de/d13/d1b/d40/f44 1500968 0 2024-02-28T16:24:12.429 INFO:tasks.workunit.client.0.smithi023.stdout:7/492: chown de/d8b/d95/d98/l9f 167219 1 2024-02-28T16:24:12.429 INFO:tasks.workunit.client.0.smithi023.stdout:9/546: dwrite d0/d7/de/f63 [0,4194304] 0 2024-02-28T16:24:12.432 INFO:tasks.workunit.client.0.smithi023.stdout:4/502: unlink d13/d1d/d2d/l6a 0 2024-02-28T16:24:12.436 INFO:tasks.workunit.client.0.smithi023.stdout:5/767: mknod d1/d2a/d32/ddc/de3/cf6 0 2024-02-28T16:24:12.437 INFO:tasks.workunit.client.0.smithi023.stdout:8/631: mkdir d0/d5/d1a/d2d/d67/d71/db4/dd3 0 2024-02-28T16:24:12.441 INFO:tasks.workunit.client.0.smithi023.stdout:1/596: dread df/fa0 [0,4194304] 0 2024-02-28T16:24:12.441 INFO:tasks.workunit.client.0.smithi023.stdout:0/521: creat d6/fb0 x:0 0 0 2024-02-28T16:24:12.444 INFO:tasks.workunit.client.0.smithi023.stdout:4/503: creat d13/d2b/d2c/d31/d8d/fa1 x:0 0 0 2024-02-28T16:24:12.450 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:12 smithi153 ceph-mon[35341]: pgmap v37: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 111 MiB/s wr, 273 op/s 2024-02-28T16:24:12.451 INFO:tasks.workunit.client.0.smithi023.stdout:9/547: rename d0/f4 to d0/d7/db/d18/d23/d28/d6e/fb8 0 2024-02-28T16:24:12.451 INFO:tasks.workunit.client.0.smithi023.stdout:2/646: truncate d5/da/f28 1744834 0 2024-02-28T16:24:12.452 INFO:tasks.workunit.client.0.smithi023.stdout:7/493: stat de/d13/d1b/d40/f44 0 2024-02-28T16:24:12.454 INFO:tasks.workunit.client.0.smithi023.stdout:6/639: dwrite d1/d3d/fea [0,4194304] 0 2024-02-28T16:24:12.459 INFO:tasks.workunit.client.0.smithi023.stdout:9/548: read d0/d7/db/d18/f1d [4056238,80123] 0 2024-02-28T16:24:12.459 INFO:tasks.workunit.client.0.smithi023.stdout:1/597: mknod df/d11/d13/d1b/d30/d57/d5a/d68/d7a/cca 0 2024-02-28T16:24:12.462 INFO:tasks.workunit.client.0.smithi023.stdout:0/522: mkdir d6/db/d1a/d26/d31/d33/d6e/db1 0 2024-02-28T16:24:12.466 INFO:tasks.workunit.client.0.smithi023.stdout:0/523: write d6/db/d1a/d26/d31/d33/d37/f49 [1042882,66786] 0 2024-02-28T16:24:12.469 INFO:tasks.workunit.client.0.smithi023.stdout:2/647: symlink d5/dc/lce 0 2024-02-28T16:24:12.472 INFO:tasks.workunit.client.0.smithi023.stdout:7/494: write de/ff [290541,62590] 0 2024-02-28T16:24:12.474 INFO:tasks.workunit.client.0.smithi023.stdout:5/768: dread d1/d2a/f44 [0,4194304] 0 2024-02-28T16:24:12.478 INFO:tasks.workunit.client.0.smithi023.stdout:1/598: mknod df/d11/d13/d1b/d30/d57/ccb 0 2024-02-28T16:24:12.481 INFO:tasks.workunit.client.0.smithi023.stdout:1/599: chown df/d11/d13/d1b/d30/d57/d5a/faa 462 1 2024-02-28T16:24:12.481 INFO:tasks.workunit.client.0.smithi023.stdout:4/504: rename d13/d1d/d2d/c6f to d13/d2b/d2c/d31/d6e/ca2 0 2024-02-28T16:24:12.482 INFO:tasks.workunit.client.0.smithi023.stdout:0/524: rmdir d6/db/d1a/d26 39 2024-02-28T16:24:12.490 INFO:tasks.workunit.client.0.smithi023.stdout:4/505: write d13/d2b/d2c/d31/d8d/fa1 [808077,120781] 0 2024-02-28T16:24:12.490 INFO:tasks.workunit.client.0.smithi023.stdout:1/600: read df/d11/d13/d1b/d30/f4b [3164988,68017] 0 2024-02-28T16:24:12.490 INFO:tasks.workunit.client.0.smithi023.stdout:4/506: chown f5 12285847 1 2024-02-28T16:24:12.492 INFO:tasks.workunit.client.0.smithi023.stdout:2/648: dread d5/da/db/d17/d3c/f3d [0,4194304] 0 2024-02-28T16:24:12.504 INFO:tasks.workunit.client.0.smithi023.stdout:8/632: dwrite d0/d5/d1a/fa2 [0,4194304] 0 2024-02-28T16:24:12.504 INFO:tasks.workunit.client.0.smithi023.stdout:1/601: mknod df/d11/d13/d99/ccc 0 2024-02-28T16:24:12.506 INFO:tasks.workunit.client.0.smithi023.stdout:8/633: truncate d0/fb1 1850552 0 2024-02-28T16:24:12.510 INFO:tasks.workunit.client.0.smithi023.stdout:2/649: chown d5/da/db/l5c 4623 1 2024-02-28T16:24:12.515 INFO:tasks.workunit.client.0.smithi023.stdout:0/525: read d6/db/d1a/d26/f52 [55741,63077] 0 2024-02-28T16:24:12.515 INFO:tasks.workunit.client.0.smithi023.stdout:6/640: write d1/d18/d26/d3a/f4a [1037827,26021] 0 2024-02-28T16:24:12.516 INFO:tasks.workunit.client.0.smithi023.stdout:4/507: mknod d13/ca3 0 2024-02-28T16:24:12.521 INFO:tasks.workunit.client.0.smithi023.stdout:8/634: creat d0/d5/d1b/d36/fd4 x:0 0 0 2024-02-28T16:24:12.522 INFO:tasks.workunit.client.0.smithi023.stdout:1/602: mknod df/d11/d13/d1b/d30/d57/d5a/d68/d7a/ccd 0 2024-02-28T16:24:12.526 INFO:tasks.workunit.client.0.smithi023.stdout:7/495: getdents de/d1c/d76 0 2024-02-28T16:24:12.527 INFO:tasks.workunit.client.0.smithi023.stdout:4/508: symlink d13/d1d/d85/la4 0 2024-02-28T16:24:12.529 INFO:tasks.workunit.client.0.smithi023.stdout:9/549: dwrite d0/d7/db/fc [0,4194304] 0 2024-02-28T16:24:12.530 INFO:tasks.workunit.client.0.smithi023.stdout:6/641: rename d1/d28/d1e/d80/fa7 to d1/d28/d1e/d2b/d6d/d7b/fee 0 2024-02-28T16:24:12.533 INFO:tasks.workunit.client.0.smithi023.stdout:5/769: link d1/d2a/d32/d58/d60/d88/ldf d1/d2a/d32/d37/lf7 0 2024-02-28T16:24:12.533 INFO:tasks.workunit.client.0.smithi023.stdout:7/496: truncate de/d60/f3c 4609224 0 2024-02-28T16:24:12.535 INFO:tasks.workunit.client.0.smithi023.stdout:9/550: chown d0/d7/de/d2a/daf/d2f 1 1 2024-02-28T16:24:12.538 INFO:tasks.workunit.client.0.smithi023.stdout:9/551: dread - d0/d7/de/d34/f35 zero size 2024-02-28T16:24:12.538 INFO:tasks.workunit.client.0.smithi023.stdout:1/603: rmdir df/d11/d13/d1b/d30/d57/d5a/d68/d6f 39 2024-02-28T16:24:12.538 INFO:tasks.workunit.client.0.smithi023.stdout:4/509: chown cc 6655 1 2024-02-28T16:24:12.539 INFO:tasks.workunit.client.0.smithi023.stdout:0/526: dwrite d6/db/d3b/f96 [0,4194304] 0 2024-02-28T16:24:12.539 INFO:tasks.workunit.client.0.smithi023.stdout:7/497: read - de/d13/d1b/d3f/f9a zero size 2024-02-28T16:24:12.540 INFO:tasks.workunit.client.0.smithi023.stdout:6/642: dread - d1/d28/d1e/d2b/d76/d9e/fce zero size 2024-02-28T16:24:12.540 INFO:tasks.workunit.client.0.smithi023.stdout:8/635: mknod d0/d5/d1b/d36/dba/cd5 0 2024-02-28T16:24:12.543 INFO:tasks.workunit.client.0.smithi023.stdout:4/510: read d13/d2b/d2c/d31/d8d/f94 [3822418,1450] 0 2024-02-28T16:24:12.543 INFO:tasks.workunit.client.0.smithi023.stdout:7/498: fsync de/ff 0 2024-02-28T16:24:12.548 INFO:tasks.workunit.client.0.smithi023.stdout:4/511: fdatasync d13/d1d/fa0 0 2024-02-28T16:24:12.549 INFO:tasks.workunit.client.0.smithi023.stdout:4/512: dread - d13/d1e/d9c/f9f zero size 2024-02-28T16:24:12.551 INFO:tasks.workunit.client.0.smithi023.stdout:7/499: readlink de/d1c/l56 0 2024-02-28T16:24:12.553 INFO:tasks.workunit.client.0.smithi023.stdout:3/586: sync 2024-02-28T16:24:12.556 INFO:tasks.workunit.client.0.smithi023.stdout:6/643: creat d1/d28/d1e/d2b/d44/d86/fef x:0 0 0 2024-02-28T16:24:12.562 INFO:tasks.workunit.client.0.smithi023.stdout:0/527: creat d6/db/d1a/d26/d31/d33/d37/fb2 x:0 0 0 2024-02-28T16:24:12.566 INFO:tasks.workunit.client.0.smithi023.stdout:9/552: dwrite d0/d7/db/d18/d23/d28/f74 [0,4194304] 0 2024-02-28T16:24:12.566 INFO:tasks.workunit.client.0.smithi023.stdout:1/604: write df/fa0 [3496945,14796] 0 2024-02-28T16:24:12.571 INFO:tasks.workunit.client.0.smithi023.stdout:1/605: readlink df/d11/d13/d1b/lbb 0 2024-02-28T16:24:12.574 INFO:tasks.workunit.client.0.smithi023.stdout:4/513: mknod d13/d2b/d9d/ca5 0 2024-02-28T16:24:12.579 INFO:tasks.workunit.client.0.smithi023.stdout:7/500: rmdir de/d13 39 2024-02-28T16:24:12.579 INFO:tasks.workunit.client.0.smithi023.stdout:3/587: mknod d1/df/d3d/d57/d61/cc5 0 2024-02-28T16:24:12.581 INFO:tasks.workunit.client.0.smithi023.stdout:5/770: getdents d1/d2a/d32/d37/d3a 0 2024-02-28T16:24:12.583 INFO:tasks.workunit.client.0.smithi023.stdout:2/650: dwrite d5/da/d1b/d3f/f66 [0,4194304] 0 2024-02-28T16:24:12.584 INFO:tasks.workunit.client.0.smithi023.stdout:6/644: dwrite d1/d28/f62 [4194304,4194304] 0 2024-02-28T16:24:12.586 INFO:tasks.workunit.client.0.smithi023.stdout:8/636: creat d0/d5/d1a/d2d/d67/d71/db4/dd3/fd6 x:0 0 0 2024-02-28T16:24:12.587 INFO:tasks.workunit.client.0.smithi023.stdout:8/637: dread - d0/d5/d35/fc7 zero size 2024-02-28T16:24:12.588 INFO:tasks.workunit.client.0.smithi023.stdout:6/645: dread - d1/d28/d1e/d2b/d44/d86/fdc zero size 2024-02-28T16:24:12.591 INFO:tasks.workunit.client.0.smithi023.stdout:9/553: symlink d0/d7/db/d18/d23/d28/d9c/lb9 0 2024-02-28T16:24:12.593 INFO:tasks.workunit.client.0.smithi023.stdout:6/646: write d1/fd7 [636522,9323] 0 2024-02-28T16:24:12.593 INFO:tasks.workunit.client.0.smithi023.stdout:8/638: fdatasync d0/d5/d1a/d63/fcf 0 2024-02-28T16:24:12.594 INFO:tasks.workunit.client.0.smithi023.stdout:4/514: creat d13/d1e/fa6 x:0 0 0 2024-02-28T16:24:12.599 INFO:tasks.workunit.client.0.smithi023.stdout:3/588: symlink d1/df/d3d/d57/d61/db5/lc6 0 2024-02-28T16:24:12.600 INFO:tasks.workunit.client.0.smithi023.stdout:9/554: fdatasync d0/d7/de/d2a/daf/d2f/f60 0 2024-02-28T16:24:12.603 INFO:tasks.workunit.client.0.smithi023.stdout:9/555: readlink d0/d7/l87 0 2024-02-28T16:24:12.608 INFO:tasks.workunit.client.0.smithi023.stdout:2/651: write d5/da/d1b/d3f/d75/d92/fb2 [2929825,42998] 0 2024-02-28T16:24:12.608 INFO:tasks.workunit.client.0.smithi023.stdout:0/528: write d6/db/f50 [5092401,10691] 0 2024-02-28T16:24:12.608 INFO:tasks.workunit.client.0.smithi023.stdout:3/589: dread - d1/df/d2d/d32/d3f/fa6 zero size 2024-02-28T16:24:12.611 INFO:tasks.workunit.client.0.smithi023.stdout:7/501: rmdir de/d13/d1b/d3f 39 2024-02-28T16:24:12.613 INFO:tasks.workunit.client.0.smithi023.stdout:7/502: dread - de/f43 zero size 2024-02-28T16:24:12.614 INFO:tasks.workunit.client.0.smithi023.stdout:6/647: creat d1/d18/d26/da6/da9/ff0 x:0 0 0 2024-02-28T16:24:12.616 INFO:tasks.workunit.client.0.smithi023.stdout:7/503: fdatasync de/f43 0 2024-02-28T16:24:12.616 INFO:tasks.workunit.client.0.smithi023.stdout:3/590: creat d1/df/d2d/d45/d78/fc7 x:0 0 0 2024-02-28T16:24:12.617 INFO:tasks.workunit.client.0.smithi023.stdout:0/529: unlink d6/db/d1a/d26/d31/c60 0 2024-02-28T16:24:12.629 INFO:tasks.workunit.client.0.smithi023.stdout:1/606: dwrite df/d11/d13/d1b/d30/f43 [0,4194304] 0 2024-02-28T16:24:12.648 INFO:tasks.workunit.client.0.smithi023.stdout:9/556: symlink d0/d7/db/d18/d23/d28/d32/d3c/lba 0 2024-02-28T16:24:12.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:12 smithi023 ceph-mon[29137]: pgmap v37: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 111 MiB/s wr, 273 op/s 2024-02-28T16:24:12.677 INFO:tasks.workunit.client.0.smithi023.stdout:4/515: dwrite d13/d1d/d58/f68 [0,4194304] 0 2024-02-28T16:24:12.713 INFO:tasks.workunit.client.0.smithi023.stdout:1/607: symlink df/d11/d13/lce 0 2024-02-28T16:24:12.713 INFO:tasks.workunit.client.0.smithi023.stdout:9/557: fdatasync d0/d7/de/f26 0 2024-02-28T16:24:12.715 INFO:tasks.workunit.client.0.smithi023.stdout:1/608: stat df/d11/d13/d1b/d30/c3b 0 2024-02-28T16:24:12.715 INFO:tasks.workunit.client.0.smithi023.stdout:9/558: fdatasync d0/d7/db/d18/d23/fac 0 2024-02-28T16:24:12.716 INFO:tasks.workunit.client.0.smithi023.stdout:4/516: rmdir d13/d2b/d2c/d31 39 2024-02-28T16:24:12.717 INFO:tasks.workunit.client.0.smithi023.stdout:7/504: symlink de/d1c/la7 0 2024-02-28T16:24:12.719 INFO:tasks.workunit.client.0.smithi023.stdout:8/639: creat d0/d5/d1a/d2d/d67/d71/fd7 x:0 0 0 2024-02-28T16:24:12.720 INFO:tasks.workunit.client.0.smithi023.stdout:0/530: creat d6/db/d1a/d26/d31/da0/fb3 x:0 0 0 2024-02-28T16:24:12.723 INFO:tasks.workunit.client.0.smithi023.stdout:3/591: creat d1/df/d2d/d9d/d9f/fc8 x:0 0 0 2024-02-28T16:24:12.725 INFO:tasks.workunit.client.0.smithi023.stdout:3/592: stat d1/df/d3d/d57/d61/db5/lc6 0 2024-02-28T16:24:12.727 INFO:tasks.workunit.client.0.smithi023.stdout:4/517: mkdir d13/d1d/d2d/da7 0 2024-02-28T16:24:12.730 INFO:tasks.workunit.client.0.smithi023.stdout:0/531: mknod d6/d84/cb4 0 2024-02-28T16:24:12.731 INFO:tasks.workunit.client.0.smithi023.stdout:8/640: fdatasync d0/d5/d1a/f6d 0 2024-02-28T16:24:12.734 INFO:tasks.workunit.client.0.smithi023.stdout:8/641: chown d0/d5/d1a/d2d/d67/d71/db4/fab 3726349 1 2024-02-28T16:24:12.743 INFO:tasks.workunit.client.0.smithi023.stdout:0/532: symlink d6/db/d3b/lb5 0 2024-02-28T16:24:12.744 INFO:tasks.workunit.client.0.smithi023.stdout:9/559: dread d0/d7/db/d18/d23/d28/d32/d3c/f51 [0,4194304] 0 2024-02-28T16:24:12.752 INFO:tasks.workunit.client.0.smithi023.stdout:9/560: mknod d0/d7/d2c/d7d/cbb 0 2024-02-28T16:24:12.753 INFO:tasks.workunit.client.0.smithi023.stdout:0/533: dread d6/db/f50 [4194304,4194304] 0 2024-02-28T16:24:12.754 INFO:tasks.workunit.client.0.smithi023.stdout:8/642: dwrite d0/d5/d1a/f38 [0,4194304] 0 2024-02-28T16:24:12.756 INFO:tasks.workunit.client.0.smithi023.stdout:6/648: rename d1/d28/d1e/d52/c64 to d1/d28/d1e/d2b/d6d/d7b/de5/cf1 0 2024-02-28T16:24:12.759 INFO:tasks.workunit.client.0.smithi023.stdout:8/643: unlink d0/d5/d1a/c73 0 2024-02-28T16:24:12.760 INFO:tasks.workunit.client.0.smithi023.stdout:4/518: dread d13/d1d/f20 [0,4194304] 0 2024-02-28T16:24:12.761 INFO:tasks.workunit.client.0.smithi023.stdout:8/644: chown d0/d5/d1b/d36/dba 19282 1 2024-02-28T16:24:12.761 INFO:tasks.workunit.client.0.smithi023.stdout:0/534: symlink d6/db/d1a/d26/lb6 0 2024-02-28T16:24:12.782 INFO:tasks.workunit.client.0.smithi023.stdout:9/561: truncate d0/d7/d2c/f77 319068 0 2024-02-28T16:24:12.789 INFO:tasks.workunit.client.0.smithi023.stdout:7/505: write de/d13/f4d [1786631,120942] 0 2024-02-28T16:24:12.795 INFO:tasks.workunit.client.0.smithi023.stdout:1/609: dwrite df/d26/f35 [0,4194304] 0 2024-02-28T16:24:12.799 INFO:tasks.workunit.client.0.smithi023.stdout:6/649: write d1/d28/d1e/d2b/fdf [59501,73628] 0 2024-02-28T16:24:12.803 INFO:tasks.workunit.client.0.smithi023.stdout:4/519: write d13/d2b/d2c/d31/d8d/f94 [507865,8142] 0 2024-02-28T16:24:12.809 INFO:tasks.workunit.client.0.smithi023.stdout:4/520: symlink d13/d2b/la8 0 2024-02-28T16:24:12.811 INFO:tasks.workunit.client.0.smithi023.stdout:7/506: dwrite de/d60/f64 [0,4194304] 0 2024-02-28T16:24:12.816 INFO:tasks.workunit.client.0.smithi023.stdout:4/521: mkdir d13/d1d/d2d/da9 0 2024-02-28T16:24:12.819 INFO:tasks.workunit.client.0.smithi023.stdout:7/507: chown de/d13/d1b/d3d/f7c 2863568 1 2024-02-28T16:24:12.822 INFO:tasks.workunit.client.0.smithi023.stdout:4/522: fdatasync d13/d2b/d2c/f57 0 2024-02-28T16:24:12.822 INFO:tasks.workunit.client.0.smithi023.stdout:9/562: dwrite d0/d7/de/d2a/daf/f79 [0,4194304] 0 2024-02-28T16:24:12.824 INFO:tasks.workunit.client.0.smithi023.stdout:7/508: creat de/d9b/fa8 x:0 0 0 2024-02-28T16:24:12.828 INFO:tasks.workunit.client.0.smithi023.stdout:1/610: dwrite df/d11/d13/d1b/d30/d57/d5a/f64 [0,4194304] 0 2024-02-28T16:24:12.833 INFO:tasks.workunit.client.0.smithi023.stdout:6/650: dwrite d1/d28/d1e/d2b/fdf [0,4194304] 0 2024-02-28T16:24:12.836 INFO:tasks.workunit.client.0.smithi023.stdout:4/523: creat d13/d1e/d9c/faa x:0 0 0 2024-02-28T16:24:12.839 INFO:tasks.workunit.client.0.smithi023.stdout:9/563: mknod d0/d7/de/d2a/daf/d2f/d44/d95/cbc 0 2024-02-28T16:24:12.842 INFO:tasks.workunit.client.0.smithi023.stdout:6/651: mkdir d1/d18/dd8/df2 0 2024-02-28T16:24:12.844 INFO:tasks.workunit.client.0.smithi023.stdout:7/509: link de/d1c/d76/f8e de/d72/fa9 0 2024-02-28T16:24:12.845 INFO:tasks.workunit.client.0.smithi023.stdout:6/652: write d1/d28/d1e/d2b/fd1 [4183116,43536] 0 2024-02-28T16:24:12.846 INFO:tasks.workunit.client.0.smithi023.stdout:7/510: read - de/d72/fa9 zero size 2024-02-28T16:24:12.848 INFO:tasks.workunit.client.0.smithi023.stdout:6/653: chown d1/d28/d1e/d2b/c48 11465262 1 2024-02-28T16:24:12.848 INFO:tasks.workunit.client.0.smithi023.stdout:4/524: creat d13/d2b/fab x:0 0 0 2024-02-28T16:24:12.849 INFO:tasks.workunit.client.0.smithi023.stdout:6/654: fdatasync d1/f1c 0 2024-02-28T16:24:12.850 INFO:tasks.workunit.client.0.smithi023.stdout:9/564: link d0/d7/de/d2a/daf/d2f/f60 d0/d7/d2c/d7d/fbd 0 2024-02-28T16:24:12.854 INFO:tasks.workunit.client.0.smithi023.stdout:9/565: read d0/d7/db/d18/d23/d28/d32/d3c/f51 [1235152,16199] 0 2024-02-28T16:24:12.858 INFO:tasks.workunit.client.0.smithi023.stdout:4/525: mknod d13/d1d/d2d/da9/cac 0 2024-02-28T16:24:12.861 INFO:tasks.workunit.client.0.smithi023.stdout:4/526: write d13/d1d/d2e/f89 [115575,8273] 0 2024-02-28T16:24:12.864 INFO:tasks.workunit.client.0.smithi023.stdout:7/511: getdents de/d1c/d76/d7b 0 2024-02-28T16:24:12.866 INFO:tasks.workunit.client.0.smithi023.stdout:7/512: readlink de/d60/l65 0 2024-02-28T16:24:12.867 INFO:tasks.workunit.client.0.smithi023.stdout:6/655: rename d1/d28/d1e/d2b/d6d/d7b/la0 to d1/d18/lf3 0 2024-02-28T16:24:12.875 INFO:tasks.workunit.client.0.smithi023.stdout:7/513: chown de/d8b/d95/d98/la3 165831 1 2024-02-28T16:24:12.876 INFO:tasks.workunit.client.0.smithi023.stdout:6/656: mknod d1/d18/d26/da6/cf4 0 2024-02-28T16:24:12.879 INFO:tasks.workunit.client.0.smithi023.stdout:6/657: fdatasync d1/d28/d1e/d2b/d6d/f92 0 2024-02-28T16:24:12.880 INFO:tasks.workunit.client.0.smithi023.stdout:4/527: link d13/d1d/c50 d13/d1e/d9a/d55/cad 0 2024-02-28T16:24:12.882 INFO:tasks.workunit.client.0.smithi023.stdout:9/566: dwrite d0/d7/db/d18/d23/d28/f74 [0,4194304] 0 2024-02-28T16:24:12.887 INFO:tasks.workunit.client.0.smithi023.stdout:9/567: chown d0/d7/de/d34/f35 141514 1 2024-02-28T16:24:12.890 INFO:tasks.workunit.client.0.smithi023.stdout:7/514: link de/d1c/f87 de/d13/d1b/d40/faa 0 2024-02-28T16:24:12.893 INFO:tasks.workunit.client.0.smithi023.stdout:4/528: rename d13/d1e/d9c/f9f to d13/fae 0 2024-02-28T16:24:12.911 INFO:tasks.workunit.client.0.smithi023.stdout:9/568: dwrite d0/d7/db/d18/d23/d28/fa1 [0,4194304] 0 2024-02-28T16:24:12.913 INFO:tasks.workunit.client.0.smithi023.stdout:9/569: readlink d0/d7/l87 0 2024-02-28T16:24:12.924 INFO:tasks.workunit.client.0.smithi023.stdout:6/658: dread d1/d18/d26/d3a/f5e [0,4194304] 0 2024-02-28T16:24:12.925 INFO:tasks.workunit.client.0.smithi023.stdout:9/570: getdents d0/d7/de/d2a/daf 0 2024-02-28T16:24:12.928 INFO:tasks.workunit.client.0.smithi023.stdout:7/515: dwrite de/d1c/d76/f8e [0,4194304] 0 2024-02-28T16:24:12.928 INFO:tasks.workunit.client.0.smithi023.stdout:6/659: chown d1/d18/d26/d3a/de0 63 1 2024-02-28T16:24:12.932 INFO:tasks.workunit.client.0.smithi023.stdout:4/529: dread d13/d2b/d2c/f30 [0,4194304] 0 2024-02-28T16:24:12.936 INFO:tasks.workunit.client.0.smithi023.stdout:9/571: mkdir d0/d7/d2c/dbe 0 2024-02-28T16:24:12.939 INFO:tasks.workunit.client.0.smithi023.stdout:6/660: chown d1/d18/c91 0 1 2024-02-28T16:24:12.939 INFO:tasks.workunit.client.0.smithi023.stdout:4/530: unlink d13/l4c 0 2024-02-28T16:24:12.942 INFO:tasks.workunit.client.0.smithi023.stdout:4/531: readlink ld 0 2024-02-28T16:24:12.942 INFO:tasks.workunit.client.0.smithi023.stdout:6/661: stat d1/d28/d1e/d2b/d76/f95 0 2024-02-28T16:24:12.944 INFO:tasks.workunit.client.0.smithi023.stdout:9/572: mknod d0/d7/db/d18/d23/d28/d32/d8b/cbf 0 2024-02-28T16:24:12.947 INFO:tasks.workunit.client.0.smithi023.stdout:6/662: read d1/f11 [1300092,113752] 0 2024-02-28T16:24:12.948 INFO:tasks.workunit.client.0.smithi023.stdout:4/532: symlink d13/d1e/d9a/d55/laf 0 2024-02-28T16:24:12.953 INFO:tasks.workunit.client.0.smithi023.stdout:7/516: dwrite de/d13/d1b/f4c [0,4194304] 0 2024-02-28T16:24:12.956 INFO:tasks.workunit.client.0.smithi023.stdout:4/533: dread - d13/d2b/d2c/d31/d6e/d80/f92 zero size 2024-02-28T16:24:12.956 INFO:tasks.workunit.client.0.smithi023.stdout:6/663: mknod d1/d28/d1e/d2b/d44/da4/cf5 0 2024-02-28T16:24:12.958 INFO:tasks.workunit.client.0.smithi023.stdout:9/573: mknod d0/d7/de/cc0 0 2024-02-28T16:24:12.963 INFO:tasks.workunit.client.0.smithi023.stdout:9/574: write d0/d7/db/f75 [451878,21732] 0 2024-02-28T16:24:12.965 INFO:tasks.workunit.client.0.smithi023.stdout:4/534: creat d13/d1e/d9a/fb0 x:0 0 0 2024-02-28T16:24:12.969 INFO:tasks.workunit.client.0.smithi023.stdout:4/535: write d13/d2b/d2c/f2f [7338647,120864] 0 2024-02-28T16:24:12.982 INFO:tasks.workunit.client.0.smithi023.stdout:9/575: fsync d0/d7/de/d2a/daf/f7e 0 2024-02-28T16:24:12.984 INFO:tasks.workunit.client.0.smithi023.stdout:7/517: dwrite de/d13/d1b/d40/faa [0,4194304] 0 2024-02-28T16:24:12.984 INFO:tasks.workunit.client.0.smithi023.stdout:6/664: dread d1/d28/d1e/d2b/fdf [0,4194304] 0 2024-02-28T16:24:13.000 INFO:tasks.workunit.client.0.smithi023.stdout:4/536: getdents d13/d2b/d2c 0 2024-02-28T16:24:13.001 INFO:tasks.workunit.client.0.smithi023.stdout:4/537: readlink d13/d1d/d2d/l61 0 2024-02-28T16:24:13.002 INFO:tasks.workunit.client.0.smithi023.stdout:7/518: truncate de/d13/d1b/d6c/f75 815036 0 2024-02-28T16:24:13.003 INFO:tasks.workunit.client.0.smithi023.stdout:6/665: dwrite d1/d18/f30 [0,4194304] 0 2024-02-28T16:24:13.009 INFO:tasks.workunit.client.0.smithi023.stdout:4/538: creat d13/d1d/d85/fb1 x:0 0 0 2024-02-28T16:24:13.011 INFO:tasks.workunit.client.0.smithi023.stdout:9/576: getdents d0/d7/db/d18/d23/d28/d32 0 2024-02-28T16:24:13.012 INFO:tasks.workunit.client.0.smithi023.stdout:7/519: mkdir de/d1c/d76/d7b/dab 0 2024-02-28T16:24:13.014 INFO:tasks.workunit.client.0.smithi023.stdout:6/666: creat d1/d28/d1e/d2b/d44/da4/ff6 x:0 0 0 2024-02-28T16:24:13.020 INFO:tasks.workunit.client.0.smithi023.stdout:9/577: creat d0/d7/db/d18/d23/d28/d32/d3c/fc1 x:0 0 0 2024-02-28T16:24:13.021 INFO:tasks.workunit.client.0.smithi023.stdout:6/667: mkdir d1/d3d/df7 0 2024-02-28T16:24:13.026 INFO:tasks.workunit.client.0.smithi023.stdout:6/668: chown d1/d4f/l59 870 1 2024-02-28T16:24:13.028 INFO:tasks.workunit.client.0.smithi023.stdout:7/520: getdents de/d13/d1b/d3f 0 2024-02-28T16:24:13.030 INFO:tasks.workunit.client.0.smithi023.stdout:6/669: unlink d1/lb6 0 2024-02-28T16:24:13.033 INFO:tasks.workunit.client.0.smithi023.stdout:9/578: dread d0/d7/db/d18/d23/f81 [0,4194304] 0 2024-02-28T16:24:13.038 INFO:tasks.workunit.client.0.smithi023.stdout:9/579: creat d0/d7/db/d18/d23/fc2 x:0 0 0 2024-02-28T16:24:13.040 INFO:tasks.workunit.client.0.smithi023.stdout:9/580: chown d0/d7/de/f14 30757 1 2024-02-28T16:24:13.042 INFO:tasks.workunit.client.0.smithi023.stdout:6/670: dread d1/d28/d1e/d2b/fdf [0,4194304] 0 2024-02-28T16:24:13.044 INFO:tasks.workunit.client.0.smithi023.stdout:4/539: dread f9 [0,4194304] 0 2024-02-28T16:24:13.044 INFO:tasks.workunit.client.0.smithi023.stdout:9/581: chown d0/d7/db/d18/d23/d28/d32/f3f 26606 1 2024-02-28T16:24:13.049 INFO:tasks.workunit.client.0.smithi023.stdout:7/521: dwrite de/f38 [0,4194304] 0 2024-02-28T16:24:13.050 INFO:tasks.workunit.client.0.smithi023.stdout:6/671: unlink d1/d28/d1e/d2b/d44/f53 0 2024-02-28T16:24:13.063 INFO:tasks.workunit.client.0.smithi023.stdout:4/540: dread d13/d1d/f20 [0,4194304] 0 2024-02-28T16:24:13.065 INFO:tasks.workunit.client.0.smithi023.stdout:6/672: dread d1/d18/d26/f84 [0,4194304] 0 2024-02-28T16:24:13.068 INFO:tasks.workunit.client.0.smithi023.stdout:6/673: dread - d1/d18/d26/fa8 zero size 2024-02-28T16:24:13.068 INFO:tasks.workunit.client.0.smithi023.stdout:4/541: readlink d13/d1d/l28 0 2024-02-28T16:24:13.070 INFO:tasks.workunit.client.0.smithi023.stdout:7/522: dwrite de/d1c/f26 [0,4194304] 0 2024-02-28T16:24:13.074 INFO:tasks.workunit.client.0.smithi023.stdout:4/542: creat d13/d1e/d9a/d55/fb2 x:0 0 0 2024-02-28T16:24:13.078 INFO:tasks.workunit.client.0.smithi023.stdout:9/582: dread d0/d7/db/d18/d23/d28/d6e/fb8 [0,4194304] 0 2024-02-28T16:24:13.078 INFO:tasks.workunit.client.0.smithi023.stdout:7/523: symlink de/d60/lac 0 2024-02-28T16:24:13.079 INFO:tasks.workunit.client.0.smithi023.stdout:4/543: truncate d13/d2b/d2c/d31/d6e/f97 892195 0 2024-02-28T16:24:13.080 INFO:tasks.workunit.client.0.smithi023.stdout:6/674: creat d1/d28/d1e/d2b/d6d/d7b/de5/ff8 x:0 0 0 2024-02-28T16:24:13.083 INFO:tasks.workunit.client.0.smithi023.stdout:4/544: write d13/d1d/d2e/f89 [729638,143] 0 2024-02-28T16:24:13.084 INFO:tasks.workunit.client.0.smithi023.stdout:7/524: truncate de/d1c/d76/d7b/f92 505336 0 2024-02-28T16:24:13.087 INFO:tasks.workunit.client.0.smithi023.stdout:7/525: unlink de/d1c/l8c 0 2024-02-28T16:24:13.089 INFO:tasks.workunit.client.0.smithi023.stdout:7/526: write de/d60/f64 [892979,20049] 0 2024-02-28T16:24:13.091 INFO:tasks.workunit.client.0.smithi023.stdout:7/527: readlink de/d13/d1b/d3d/d53/l69 0 2024-02-28T16:24:13.094 INFO:tasks.workunit.client.0.smithi023.stdout:7/528: mkdir de/d1c/d76/d7b/dad 0 2024-02-28T16:24:13.095 INFO:tasks.workunit.client.0.smithi023.stdout:9/583: dwrite d0/d7/de/d2a/f38 [0,4194304] 0 2024-02-28T16:24:13.097 INFO:tasks.workunit.client.0.smithi023.stdout:7/529: write de/d1c/d76/d7b/f91 [750328,55492] 0 2024-02-28T16:24:13.108 INFO:tasks.workunit.client.0.smithi023.stdout:7/530: creat de/fae x:0 0 0 2024-02-28T16:24:13.122 INFO:tasks.workunit.client.0.smithi023.stdout:5/771: sync 2024-02-28T16:24:13.128 INFO:tasks.workunit.client.0.smithi023.stdout:4/545: dread d13/f3c [0,4194304] 0 2024-02-28T16:24:13.129 INFO:tasks.workunit.client.0.smithi023.stdout:7/531: dwrite de/d13/d1b/d3d/f7c [0,4194304] 0 2024-02-28T16:24:13.130 INFO:tasks.workunit.client.0.smithi023.stdout:4/546: readlink d13/d1d/d2d/l32 0 2024-02-28T16:24:13.132 INFO:tasks.workunit.client.0.smithi023.stdout:7/532: fdatasync de/d1c/d76/f7f 0 2024-02-28T16:24:13.132 INFO:tasks.workunit.client.0.smithi023.stdout:5/772: rename d1/d2a/d32/d37/d3a/l5f to d1/d2a/d32/ddc/de3/lf8 0 2024-02-28T16:24:13.133 INFO:tasks.workunit.client.0.smithi023.stdout:4/547: fdatasync d13/d1e/d9a/fb0 0 2024-02-28T16:24:13.135 INFO:tasks.workunit.client.0.smithi023.stdout:5/773: chown d1/d2a/d32/de0 145327 1 2024-02-28T16:24:13.135 INFO:tasks.workunit.client.0.smithi023.stdout:9/584: dread d0/d7/db/f75 [0,4194304] 0 2024-02-28T16:24:13.137 INFO:tasks.workunit.client.0.smithi023.stdout:4/548: fsync d13/d1d/fa0 0 2024-02-28T16:24:13.138 INFO:tasks.workunit.client.0.smithi023.stdout:7/533: creat de/d13/d1b/d3d/faf x:0 0 0 2024-02-28T16:24:13.139 INFO:tasks.workunit.client.0.smithi023.stdout:5/774: mknod d1/d2a/d32/de0/cf9 0 2024-02-28T16:24:13.143 INFO:tasks.workunit.client.0.smithi023.stdout:9/585: chown d0/d7/db/d18/d23/d28/d6e/c94 11 1 2024-02-28T16:24:13.145 INFO:tasks.workunit.client.0.smithi023.stdout:4/549: dread d13/d1e/d9a/f45 [0,4194304] 0 2024-02-28T16:24:13.149 INFO:tasks.workunit.client.0.smithi023.stdout:5/775: symlink d1/d2a/d32/d36/lfa 0 2024-02-28T16:24:13.149 INFO:tasks.workunit.client.0.smithi023.stdout:7/534: mknod de/d1c/d76/d7b/dad/cb0 0 2024-02-28T16:24:13.150 INFO:tasks.workunit.client.0.smithi023.stdout:4/550: write d13/d2b/d2c/d31/d6e/f97 [1546714,7924] 0 2024-02-28T16:24:13.151 INFO:tasks.workunit.client.0.smithi023.stdout:4/551: stat d13/d2b 0 2024-02-28T16:24:13.154 INFO:tasks.workunit.client.0.smithi023.stdout:7/535: mknod de/d13/d1b/cb1 0 2024-02-28T16:24:13.157 INFO:tasks.workunit.client.0.smithi023.stdout:7/536: write de/d13/d1b/d3d/faf [75096,80898] 0 2024-02-28T16:24:13.159 INFO:tasks.workunit.client.0.smithi023.stdout:4/552: rename d13/d1d/d58/d7a to d13/d2b/d2c/d31/d8d/db3 0 2024-02-28T16:24:13.163 INFO:tasks.workunit.client.0.smithi023.stdout:7/537: mknod de/cb2 0 2024-02-28T16:24:13.167 INFO:tasks.workunit.client.0.smithi023.stdout:4/553: rename d13/d1e/d9a/d55/laf to d13/d2b/d2c/d31/d8d/lb4 0 2024-02-28T16:24:13.168 INFO:tasks.workunit.client.0.smithi023.stdout:6/675: truncate d1/d18/dd8/de8/fb1 3124755 0 2024-02-28T16:24:13.169 INFO:tasks.workunit.client.0.smithi023.stdout:7/538: truncate de/d13/d1b/d3d/f5c 1488172 0 2024-02-28T16:24:13.170 INFO:tasks.workunit.client.0.smithi023.stdout:6/676: readlink d1/d4f/l59 0 2024-02-28T16:24:13.174 INFO:tasks.workunit.client.0.smithi023.stdout:6/677: write d1/d18/d26/d3a/f3f [2932652,77836] 0 2024-02-28T16:24:13.177 INFO:tasks.workunit.client.0.smithi023.stdout:6/678: read - d1/d28/d1e/d52/feb zero size 2024-02-28T16:24:13.179 INFO:tasks.workunit.client.0.smithi023.stdout:3/593: sync 2024-02-28T16:24:13.179 INFO:tasks.workunit.client.0.smithi023.stdout:1/611: sync 2024-02-28T16:24:13.180 INFO:tasks.workunit.client.0.smithi023.stdout:2/652: sync 2024-02-28T16:24:13.180 INFO:tasks.workunit.client.0.smithi023.stdout:8/645: sync 2024-02-28T16:24:13.181 INFO:tasks.workunit.client.0.smithi023.stdout:0/535: sync 2024-02-28T16:24:13.187 INFO:tasks.workunit.client.0.smithi023.stdout:9/586: dread d0/d7/db/d18/d23/d28/d32/f3f [0,4194304] 0 2024-02-28T16:24:13.187 INFO:tasks.workunit.client.0.smithi023.stdout:6/679: truncate d1/d3d/f55 353337 0 2024-02-28T16:24:13.188 INFO:tasks.workunit.client.0.smithi023.stdout:2/653: read d5/da/db/d17/d39/d56/fad [3284141,51560] 0 2024-02-28T16:24:13.188 INFO:tasks.workunit.client.0.smithi023.stdout:5/776: write d1/d2a/d32/d37/d3a/f50 [2278579,28776] 0 2024-02-28T16:24:13.193 INFO:tasks.workunit.client.0.smithi023.stdout:2/654: chown d5/da/l31 108 1 2024-02-28T16:24:13.198 INFO:tasks.workunit.client.0.smithi023.stdout:8/646: rmdir d0/d5/d1a/d2d/d67/d71/db4 39 2024-02-28T16:24:13.198 INFO:tasks.workunit.client.0.smithi023.stdout:7/539: dwrite de/d1c/f79 [0,4194304] 0 2024-02-28T16:24:13.199 INFO:tasks.workunit.client.0.smithi023.stdout:2/655: truncate d5/dc/f88 461404 0 2024-02-28T16:24:13.199 INFO:tasks.workunit.client.0.smithi023.stdout:4/554: write d13/d1e/d9a/f45 [177990,29734] 0 2024-02-28T16:24:13.204 INFO:tasks.workunit.client.0.smithi023.stdout:2/656: write d5/dc/f21 [2765301,61901] 0 2024-02-28T16:24:13.207 INFO:tasks.workunit.client.0.smithi023.stdout:4/555: write f5 [5351528,126152] 0 2024-02-28T16:24:13.216 INFO:tasks.workunit.client.0.smithi023.stdout:3/594: symlink d1/df/d3d/d57/d61/d9e/lc9 0 2024-02-28T16:24:13.217 INFO:tasks.workunit.client.0.smithi023.stdout:0/536: dread d6/db/d1a/d26/f4d [0,4194304] 0 2024-02-28T16:24:13.219 INFO:tasks.workunit.client.0.smithi023.stdout:6/680: dread d1/d28/d1e/d2b/fd1 [0,4194304] 0 2024-02-28T16:24:13.223 INFO:tasks.workunit.client.0.smithi023.stdout:2/657: rename d5/da/d45/f86 to d5/dc/d52/fcf 0 2024-02-28T16:24:13.223 INFO:tasks.workunit.client.0.smithi023.stdout:8/647: stat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/f95 0 2024-02-28T16:24:13.226 INFO:tasks.workunit.client.0.smithi023.stdout:5/777: creat d1/d2a/d32/d58/d60/d88/ffb x:0 0 0 2024-02-28T16:24:13.226 INFO:tasks.workunit.client.0.smithi023.stdout:3/595: truncate d1/df/d2d/d45/d6f/f99 1031831 0 2024-02-28T16:24:13.227 INFO:tasks.workunit.client.0.smithi023.stdout:9/587: link d0/l4f d0/d7/d2c/d7d/lc3 0 2024-02-28T16:24:13.228 INFO:tasks.workunit.client.0.smithi023.stdout:0/537: unlink d6/db/d1a/f81 0 2024-02-28T16:24:13.229 INFO:tasks.workunit.client.0.smithi023.stdout:2/658: chown d5/dc/f88 4 1 2024-02-28T16:24:13.231 INFO:tasks.workunit.client.0.smithi023.stdout:1/612: dwrite df/d11/d13/d27/f53 [0,4194304] 0 2024-02-28T16:24:13.234 INFO:tasks.workunit.client.0.smithi023.stdout:0/538: readlink d6/d4c/d6a/l99 0 2024-02-28T16:24:13.234 INFO:tasks.workunit.client.0.smithi023.stdout:4/556: rmdir d13/d1d/d2d/da7 0 2024-02-28T16:24:13.235 INFO:tasks.workunit.client.0.smithi023.stdout:8/648: mknod d0/d5/d1a/d2d/d67/cd8 0 2024-02-28T16:24:13.237 INFO:tasks.workunit.client.0.smithi023.stdout:1/613: write df/fc3 [895503,94833] 0 2024-02-28T16:24:13.239 INFO:tasks.workunit.client.0.smithi023.stdout:9/588: mkdir d0/d7/db/d18/d23/d28/d9c/dc4 0 2024-02-28T16:24:13.241 INFO:tasks.workunit.client.0.smithi023.stdout:5/778: mkdir d1/d2a/d32/d58/d79/de5/dfc 0 2024-02-28T16:24:13.242 INFO:tasks.workunit.client.0.smithi023.stdout:2/659: rename d5/dc to d5/da/db/d17/d73/dd0 0 2024-02-28T16:24:13.243 INFO:tasks.workunit.client.0.smithi023.stdout:8/649: chown d0/d5/d1a/d2d/d67/daf/lcb 896998 1 2024-02-28T16:24:13.245 INFO:tasks.workunit.client.0.smithi023.stdout:3/596: truncate d1/df/d2d/d32/f76 550145 0 2024-02-28T16:24:13.250 INFO:tasks.workunit.client.0.smithi023.stdout:7/540: truncate de/d13/f6d 573394 0 2024-02-28T16:24:13.251 INFO:tasks.workunit.client.0.smithi023.stdout:4/557: mknod d13/d2b/d2c/d31/d8d/db3/cb5 0 2024-02-28T16:24:13.253 INFO:tasks.workunit.client.0.smithi023.stdout:8/650: unlink d0/d5/d35/l72 0 2024-02-28T16:24:13.254 INFO:tasks.workunit.client.0.smithi023.stdout:9/589: write d0/d7/db/d18/d23/f81 [3399145,15543] 0 2024-02-28T16:24:13.255 INFO:tasks.workunit.client.0.smithi023.stdout:5/779: creat d1/d2a/d32/d58/d60/d82/ffd x:0 0 0 2024-02-28T16:24:13.255 INFO:tasks.workunit.client.0.smithi023.stdout:6/681: link d1/d18/d26/d6a/ldd d1/d28/d1e/d80/lf9 0 2024-02-28T16:24:13.263 INFO:tasks.workunit.client.0.smithi023.stdout:3/597: creat d1/df/d3d/d57/d61/db5/fca x:0 0 0 2024-02-28T16:24:13.263 INFO:tasks.workunit.client.0.smithi023.stdout:2/660: mkdir d5/dd1 0 2024-02-28T16:24:13.263 INFO:tasks.workunit.client.0.smithi023.stdout:1/614: truncate df/f16 413782 0 2024-02-28T16:24:13.265 INFO:tasks.workunit.client.0.smithi023.stdout:1/615: fsync df/fc3 0 2024-02-28T16:24:13.266 INFO:tasks.workunit.client.0.smithi023.stdout:9/590: creat d0/d7/db/d18/fc5 x:0 0 0 2024-02-28T16:24:13.266 INFO:tasks.workunit.client.0.smithi023.stdout:5/780: truncate d1/d2a/d32/d37/d4e/f70 234600 0 2024-02-28T16:24:13.271 INFO:tasks.workunit.client.0.smithi023.stdout:5/781: rmdir d1 39 2024-02-28T16:24:13.271 INFO:tasks.workunit.client.0.smithi023.stdout:3/598: write d1/df/d2d/d45/d78/fc7 [247436,61950] 0 2024-02-28T16:24:13.273 INFO:tasks.workunit.client.0.smithi023.stdout:4/558: rename d13/d1d/fa0 to d13/d2b/d2c/d31/fb6 0 2024-02-28T16:24:13.275 INFO:tasks.workunit.client.0.smithi023.stdout:2/661: write d5/da/db/d17/d73/d9e/da0/fc7 [243974,127713] 0 2024-02-28T16:24:13.276 INFO:tasks.workunit.client.0.smithi023.stdout:1/616: mkdir df/dcf 0 2024-02-28T16:24:13.285 INFO:tasks.workunit.client.0.smithi023.stdout:8/651: dwrite d0/fc [4194304,4194304] 0 2024-02-28T16:24:13.286 INFO:tasks.workunit.client.0.smithi023.stdout:9/591: creat d0/d7/de/d2a/daf/d2f/d44/fc6 x:0 0 0 2024-02-28T16:24:13.287 INFO:tasks.workunit.client.0.smithi023.stdout:5/782: fdatasync d1/d2a/d32/d58/d60/d82/ff1 0 2024-02-28T16:24:13.292 INFO:tasks.workunit.client.0.smithi023.stdout:7/541: dwrite de/d60/f64 [0,4194304] 0 2024-02-28T16:24:13.292 INFO:tasks.workunit.client.0.smithi023.stdout:0/539: dread d6/db/f50 [0,4194304] 0 2024-02-28T16:24:13.294 INFO:tasks.workunit.client.0.smithi023.stdout:7/542: dread - de/d1c/d76/f93 zero size 2024-02-28T16:24:13.295 INFO:tasks.workunit.client.0.smithi023.stdout:5/783: stat d1/d2a/d32/d58/d60/d82 0 2024-02-28T16:24:13.296 INFO:tasks.workunit.client.0.smithi023.stdout:0/540: write d6/db/d3b/f96 [603563,95960] 0 2024-02-28T16:24:13.303 INFO:tasks.workunit.client.0.smithi023.stdout:3/599: rename d1/df/d2d/f40 to d1/df/d2d/d45/d6f/fcb 0 2024-02-28T16:24:13.307 INFO:tasks.workunit.client.0.smithi023.stdout:7/543: mknod de/d13/d1b/d3d/d53/cb3 0 2024-02-28T16:24:13.309 INFO:tasks.workunit.client.0.smithi023.stdout:4/559: dwrite d13/d2b/f4f [0,4194304] 0 2024-02-28T16:24:13.318 INFO:tasks.workunit.client.0.smithi023.stdout:2/662: creat d5/fd2 x:0 0 0 2024-02-28T16:24:13.321 INFO:tasks.workunit.client.0.smithi023.stdout:5/784: dwrite d1/d2a/d32/d37/d3a/f6d [0,4194304] 0 2024-02-28T16:24:13.322 INFO:tasks.workunit.client.0.smithi023.stdout:6/682: truncate d1/d18/d26/da6/da9/fb2 208510 0 2024-02-28T16:24:13.322 INFO:tasks.workunit.client.0.smithi023.stdout:1/617: dwrite df/d11/d13/d27/f53 [0,4194304] 0 2024-02-28T16:24:13.323 INFO:tasks.workunit.client.0.smithi023.stdout:6/683: readlink d1/l25 0 2024-02-28T16:24:13.324 INFO:tasks.workunit.client.0.smithi023.stdout:7/544: mknod de/d13/d1b/d40/cb4 0 2024-02-28T16:24:13.325 INFO:tasks.workunit.client.0.smithi023.stdout:1/618: write df/d93/fc4 [2008797,82473] 0 2024-02-28T16:24:13.326 INFO:tasks.workunit.client.0.smithi023.stdout:5/785: dread - d1/d2a/d32/d58/d73/fe1 zero size 2024-02-28T16:24:13.326 INFO:tasks.workunit.client.0.smithi023.stdout:7/545: read - de/d60/f96 zero size 2024-02-28T16:24:13.330 INFO:tasks.workunit.client.0.smithi023.stdout:0/541: symlink d6/lb7 0 2024-02-28T16:24:13.336 INFO:tasks.workunit.client.0.smithi023.stdout:0/542: truncate d6/fb0 262164 0 2024-02-28T16:24:13.357 INFO:tasks.workunit.client.0.smithi023.stdout:5/786: dread d1/d2a/d32/d37/d4e/db5/fcf [0,4194304] 0 2024-02-28T16:24:13.363 INFO:tasks.workunit.client.0.smithi023.stdout:1/619: symlink df/ld0 0 2024-02-28T16:24:13.367 INFO:tasks.workunit.client.0.smithi023.stdout:9/592: dwrite d0/d7/de/d2a/daf/d2f/f60 [0,4194304] 0 2024-02-28T16:24:13.368 INFO:tasks.workunit.client.0.smithi023.stdout:1/620: chown df/d26/d48/d80 44 1 2024-02-28T16:24:13.369 INFO:tasks.workunit.client.0.smithi023.stdout:7/546: dwrite de/d1c/f79 [4194304,4194304] 0 2024-02-28T16:24:13.369 INFO:tasks.workunit.client.0.smithi023.stdout:8/652: getdents d0/d5/d1a/d2d/d67/d71/db4/d39 0 2024-02-28T16:24:13.370 INFO:tasks.workunit.client.0.smithi023.stdout:5/787: truncate d1/d2a/d32/d58/d73/fd2 1195397 0 2024-02-28T16:24:13.371 INFO:tasks.workunit.client.0.smithi023.stdout:3/600: truncate d1/df/d2d/d32/d3f/f6b 1669093 0 2024-02-28T16:24:13.376 INFO:tasks.workunit.client.0.smithi023.stdout:8/653: stat d0/d5/d1b/d36/f85 0 2024-02-28T16:24:13.380 INFO:tasks.workunit.client.0.smithi023.stdout:7/547: chown de/d13/d1b/d6c/l7a 1803 1 2024-02-28T16:24:13.384 INFO:tasks.workunit.client.0.smithi023.stdout:6/684: creat d1/d28/d1e/d2b/ffa x:0 0 0 2024-02-28T16:24:13.384 INFO:tasks.workunit.client.0.smithi023.stdout:0/543: creat d6/db/d1a/d26/d31/fb8 x:0 0 0 2024-02-28T16:24:13.388 INFO:tasks.workunit.client.0.smithi023.stdout:6/685: fdatasync d1/d18/d26/d3a/f4a 0 2024-02-28T16:24:13.393 INFO:tasks.workunit.client.0.smithi023.stdout:4/560: dwrite d13/d2b/d2c/f57 [0,4194304] 0 2024-02-28T16:24:13.393 INFO:tasks.workunit.client.0.smithi023.stdout:2/663: truncate d5/f7d 1132109 0 2024-02-28T16:24:13.397 INFO:tasks.workunit.client.0.smithi023.stdout:2/664: chown d5/da/d1b/d3f/d75/cbf 169 1 2024-02-28T16:24:13.397 INFO:tasks.workunit.client.0.smithi023.stdout:6/686: write d1/d28/d1e/d2b/d76/f88 [180853,109060] 0 2024-02-28T16:24:13.400 INFO:tasks.workunit.client.0.smithi023.stdout:1/621: rename df/l56 to df/d26/d48/d80/ld1 0 2024-02-28T16:24:13.403 INFO:tasks.workunit.client.0.smithi023.stdout:1/622: stat df/d26/f35 0 2024-02-28T16:24:13.404 INFO:tasks.workunit.client.0.smithi023.stdout:4/561: symlink d13/d1e/d9a/d67/lb7 0 2024-02-28T16:24:13.405 INFO:tasks.workunit.client.0.smithi023.stdout:3/601: mkdir d1/df/d33/dc2/dcc 0 2024-02-28T16:24:13.410 INFO:tasks.workunit.client.0.smithi023.stdout:5/788: rename d1/d2a/d32/d37/d3a/d7f/c7d to d1/d2a/d32/ddc/cfe 0 2024-02-28T16:24:13.411 INFO:tasks.workunit.client.0.smithi023.stdout:2/665: fdatasync d5/da/db/d17/d73/dd0/f24 0 2024-02-28T16:24:13.411 INFO:tasks.workunit.client.0.smithi023.stdout:6/687: write d1/d18/fca [894262,41540] 0 2024-02-28T16:24:13.414 INFO:tasks.workunit.client.0.smithi023.stdout:7/548: dwrite de/d13/f2b [0,4194304] 0 2024-02-28T16:24:13.416 INFO:tasks.workunit.client.0.smithi023.stdout:4/562: write d13/d1e/d9a/f45 [39740,129463] 0 2024-02-28T16:24:13.426 INFO:tasks.workunit.client.0.smithi023.stdout:3/602: symlink d1/df/d3d/d57/d61/db5/lcd 0 2024-02-28T16:24:13.428 INFO:tasks.workunit.client.0.smithi023.stdout:1/623: dread df/d11/d13/d27/f53 [0,4194304] 0 2024-02-28T16:24:13.429 INFO:tasks.workunit.client.0.smithi023.stdout:3/603: chown d1/d4a/c80 3653 1 2024-02-28T16:24:13.431 INFO:tasks.workunit.client.0.smithi023.stdout:8/654: rename d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/fcd to d0/d5/d1a/d63/d90/fd9 0 2024-02-28T16:24:13.433 INFO:tasks.workunit.client.0.smithi023.stdout:3/604: chown d1/d4a/d92/la4 27173 1 2024-02-28T16:24:13.438 INFO:tasks.workunit.client.0.smithi023.stdout:9/593: link d0/d7/de/d2a/daf/d2f/d44/d95/cbc d0/d7/d2c/d84/cc7 0 2024-02-28T16:24:13.446 INFO:tasks.workunit.client.0.smithi023.stdout:7/549: mknod de/d13/d1b/d6c/cb5 0 2024-02-28T16:24:13.447 INFO:tasks.workunit.client.0.smithi023.stdout:0/544: rename d6/db/dab/d82/c78 to d6/db/dab/d82/d72/cb9 0 2024-02-28T16:24:13.448 INFO:tasks.workunit.client.0.smithi023.stdout:7/550: write de/d60/f96 [754360,65643] 0 2024-02-28T16:24:13.450 INFO:tasks.workunit.client.0.smithi023.stdout:0/545: readlink d6/db/d1a/d35/la5 0 2024-02-28T16:24:13.452 INFO:tasks.workunit.client.0.smithi023.stdout:8/655: mkdir d0/d5/d1a/d63/d90/dda 0 2024-02-28T16:24:13.454 INFO:tasks.workunit.client.0.smithi023.stdout:2/666: mkdir d5/da/d8c/dd3 0 2024-02-28T16:24:13.455 INFO:tasks.workunit.client.0.smithi023.stdout:3/605: creat d1/df/d3d/d57/d61/fce x:0 0 0 2024-02-28T16:24:13.457 INFO:tasks.workunit.client.0.smithi023.stdout:3/606: stat d1/f27 0 2024-02-28T16:24:13.458 INFO:tasks.workunit.client.0.smithi023.stdout:2/667: stat d5/da/d1b/d3f/d75/d92/fb2 0 2024-02-28T16:24:13.459 INFO:tasks.workunit.client.0.smithi023.stdout:7/551: mkdir de/d13/d1b/d6c/db6 0 2024-02-28T16:24:13.461 INFO:tasks.workunit.client.0.smithi023.stdout:0/546: symlink d6/d84/lba 0 2024-02-28T16:24:13.462 INFO:tasks.workunit.client.0.smithi023.stdout:8/656: mkdir d0/d5/d1a/d2d/d67/d71/d9e/ddb 0 2024-02-28T16:24:13.463 INFO:tasks.workunit.client.0.smithi023.stdout:5/789: link d1/d2a/d32/d37/d4e/db5/lb7 d1/d2a/d32/ddc/de3/lff 0 2024-02-28T16:24:13.464 INFO:tasks.workunit.client.0.smithi023.stdout:1/624: dread df/d11/d13/f2c [4194304,4194304] 0 2024-02-28T16:24:13.468 INFO:tasks.workunit.client.0.smithi023.stdout:5/790: stat d1/d2a/d32/d37/f38 0 2024-02-28T16:24:13.470 INFO:tasks.workunit.client.0.smithi023.stdout:8/657: mkdir d0/d5/ddc 0 2024-02-28T16:24:13.472 INFO:tasks.workunit.client.0.smithi023.stdout:4/563: getdents d13/d1e/d9a/d55 0 2024-02-28T16:24:13.472 INFO:tasks.workunit.client.0.smithi023.stdout:1/625: truncate df/dbd/f98 306613 0 2024-02-28T16:24:13.475 INFO:tasks.workunit.client.0.smithi023.stdout:9/594: link d0/d7/de/d2a/c92 d0/d7/cc8 0 2024-02-28T16:24:13.478 INFO:tasks.workunit.client.0.smithi023.stdout:7/552: dwrite de/d1c/f20 [0,4194304] 0 2024-02-28T16:24:13.478 INFO:tasks.workunit.client.0.smithi023.stdout:0/547: rename d6/db/dab/d82/f2f to d6/db/dab/d82/d72/d79/fbb 0 2024-02-28T16:24:13.480 INFO:tasks.workunit.client.0.smithi023.stdout:5/791: chown d1/d2a/d32/ddc/cfe 25990363 1 2024-02-28T16:24:13.480 INFO:tasks.workunit.client.0.smithi023.stdout:0/548: chown d6/db/fa6 0 1 2024-02-28T16:24:13.484 INFO:tasks.workunit.client.0.smithi023.stdout:4/564: symlink d13/d1d/d2d/lb8 0 2024-02-28T16:24:13.485 INFO:tasks.workunit.client.0.smithi023.stdout:5/792: read - d1/d2a/d32/d37/d3a/d7f/d62/d7b/fcc zero size 2024-02-28T16:24:13.485 INFO:tasks.workunit.client.0.smithi023.stdout:1/626: chown df/d11/c25 11663 1 2024-02-28T16:24:13.485 INFO:tasks.workunit.client.0.smithi023.stdout:0/549: chown d6/db/d1a/d26/d31/da0/fb3 4 1 2024-02-28T16:24:13.486 INFO:tasks.workunit.client.0.smithi023.stdout:3/607: creat d1/df/d3d/d57/fcf x:0 0 0 2024-02-28T16:24:13.489 INFO:tasks.workunit.client.0.smithi023.stdout:3/608: chown d1/df/d2d/da8 22281 1 2024-02-28T16:24:13.489 INFO:tasks.workunit.client.0.smithi023.stdout:9/595: write d0/d7/d2c/d7d/fb4 [4055450,17473] 0 2024-02-28T16:24:13.494 INFO:tasks.workunit.client.0.smithi023.stdout:9/596: chown d0/d7/de/c10 0 1 2024-02-28T16:24:13.495 INFO:tasks.workunit.client.0.smithi023.stdout:4/565: stat d13/l19 0 2024-02-28T16:24:13.497 INFO:tasks.workunit.client.0.smithi023.stdout:9/597: chown d0/d7/db/d18/f22 799 1 2024-02-28T16:24:13.500 INFO:tasks.workunit.client.0.smithi023.stdout:1/627: mknod df/dbd/d7b/cd2 0 2024-02-28T16:24:13.500 INFO:tasks.workunit.client.0.smithi023.stdout:4/566: write d13/d1d/f33 [614501,69879] 0 2024-02-28T16:24:13.501 INFO:tasks.workunit.client.0.smithi023.stdout:0/550: mknod d6/d4c/d6a/cbc 0 2024-02-28T16:24:13.503 INFO:tasks.workunit.client.0.smithi023.stdout:0/551: write d6/db/dab/f4b [1161212,634] 0 2024-02-28T16:24:13.505 INFO:tasks.workunit.client.0.smithi023.stdout:5/793: creat d1/d2a/d32/ddc/f100 x:0 0 0 2024-02-28T16:24:13.506 INFO:tasks.workunit.client.0.smithi023.stdout:7/553: mknod de/d13/cb7 0 2024-02-28T16:24:13.516 INFO:tasks.workunit.client.0.smithi023.stdout:7/554: symlink de/d8b/d95/d98/lb8 0 2024-02-28T16:24:13.518 INFO:tasks.workunit.client.0.smithi023.stdout:3/609: dwrite d1/df/d2d/d45/d52/d65/d89/faa [0,4194304] 0 2024-02-28T16:24:13.520 INFO:tasks.workunit.client.0.smithi023.stdout:9/598: rename d0/d7/db/d18/d23/d28/fae to d0/d7/fc9 0 2024-02-28T16:24:13.524 INFO:tasks.workunit.client.0.smithi023.stdout:4/567: dwrite d13/d2b/d2c/d31/d8d/f99 [0,4194304] 0 2024-02-28T16:24:13.524 INFO:tasks.workunit.client.0.smithi023.stdout:4/568: readlink ld 0 2024-02-28T16:24:13.526 INFO:tasks.workunit.client.0.smithi023.stdout:4/569: chown c11 769 1 2024-02-28T16:24:13.527 INFO:tasks.workunit.client.0.smithi023.stdout:3/610: read d1/df/d33/f81 [250614,80023] 0 2024-02-28T16:24:13.529 INFO:tasks.workunit.client.0.smithi023.stdout:2/668: write d5/da/f5b [770640,90013] 0 2024-02-28T16:24:13.530 INFO:tasks.workunit.client.0.smithi023.stdout:7/555: rmdir de/d72 39 2024-02-28T16:24:13.531 INFO:tasks.workunit.client.0.smithi023.stdout:3/611: write d1/d74/d46/f72 [143878,51964] 0 2024-02-28T16:24:13.533 INFO:tasks.workunit.client.0.smithi023.stdout:1/628: truncate df/d11/d13/d1b/d30/f60 1530761 0 2024-02-28T16:24:13.539 INFO:tasks.workunit.client.0.smithi023.stdout:1/629: chown df/d11/d13/d1b/d2e/d5c/cc5 178594533 1 2024-02-28T16:24:13.542 INFO:tasks.workunit.client.0.smithi023.stdout:8/658: chown d0/d5/d1a/d2d/f61 47 1 2024-02-28T16:24:13.543 INFO:tasks.workunit.client.0.smithi023.stdout:9/599: mkdir d0/d7/db/d18/d23/d28/d32/dca 0 2024-02-28T16:24:13.544 INFO:tasks.workunit.client.0.smithi023.stdout:5/794: link d1/d2a/cd6 d1/d2a/d32/d58/c101 0 2024-02-28T16:24:13.548 INFO:tasks.workunit.client.0.smithi023.stdout:4/570: rmdir d13/d2b/d2c/d31/d6e 39 2024-02-28T16:24:13.549 INFO:tasks.workunit.client.0.smithi023.stdout:3/612: rmdir d1/df/d2d 39 2024-02-28T16:24:13.557 INFO:tasks.workunit.client.0.smithi023.stdout:0/552: rename d6/db/c19 to d6/db/dab/d82/cbd 0 2024-02-28T16:24:13.558 INFO:tasks.workunit.client.0.smithi023.stdout:5/795: rename d1/d2a/d32/d37 to d1/d2a/d32/d37/d3a/d7f/d62/dd1/d102 22 2024-02-28T16:24:13.559 INFO:tasks.workunit.client.0.smithi023.stdout:9/600: mknod d0/d7/db/d18/ccb 0 2024-02-28T16:24:13.562 INFO:tasks.workunit.client.0.smithi023.stdout:9/601: write d0/d7/db/d18/f9d [1437380,30781] 0 2024-02-28T16:24:13.563 INFO:tasks.workunit.client.0.smithi023.stdout:7/556: creat de/d13/d1b/d6c/db6/fb9 x:0 0 0 2024-02-28T16:24:13.564 INFO:tasks.workunit.client.0.smithi023.stdout:1/630: dread df/d26/f3c [0,4194304] 0 2024-02-28T16:24:13.565 INFO:tasks.workunit.client.0.smithi023.stdout:3/613: mknod d1/df/d33/d38/d6c/cd0 0 2024-02-28T16:24:13.566 INFO:tasks.workunit.client.0.smithi023.stdout:9/602: chown d0/d7/de/cc0 134 1 2024-02-28T16:24:13.567 INFO:tasks.workunit.client.0.smithi023.stdout:5/796: mknod d1/d2a/d32/d58/def/c103 0 2024-02-28T16:24:13.569 INFO:tasks.workunit.client.0.smithi023.stdout:7/557: dread de/d13/d1b/d3d/faf [0,4194304] 0 2024-02-28T16:24:13.571 INFO:tasks.workunit.client.0.smithi023.stdout:0/553: mkdir d6/db/d1a/d26/d31/d33/dbe 0 2024-02-28T16:24:13.572 INFO:tasks.workunit.client.0.smithi023.stdout:7/558: write de/fa6 [762258,78532] 0 2024-02-28T16:24:13.573 INFO:tasks.workunit.client.0.smithi023.stdout:8/659: dread d0/d5/d1a/d2d/d67/f7c [0,4194304] 0 2024-02-28T16:24:13.573 INFO:tasks.workunit.client.0.smithi023.stdout:3/614: fdatasync d1/df/d2d/d9d/fc3 0 2024-02-28T16:24:13.573 INFO:tasks.workunit.client.0.smithi023.stdout:4/571: creat d13/fb9 x:0 0 0 2024-02-28T16:24:13.576 INFO:tasks.workunit.client.0.smithi023.stdout:1/631: mkdir df/dbd/d6c/dd3 0 2024-02-28T16:24:13.576 INFO:tasks.workunit.client.0.smithi023.stdout:7/559: write de/f82 [1226843,35694] 0 2024-02-28T16:24:13.578 INFO:tasks.workunit.client.0.smithi023.stdout:7/560: fdatasync de/f43 0 2024-02-28T16:24:13.578 INFO:tasks.workunit.client.0.smithi023.stdout:2/669: getdents d5/da/db/d17/d39/d56 0 2024-02-28T16:24:13.580 INFO:tasks.workunit.client.0.smithi023.stdout:9/603: mkdir d0/d7/de/d34/dcc 0 2024-02-28T16:24:13.582 INFO:tasks.workunit.client.0.smithi023.stdout:5/797: mknod d1/d2a/d32/ddc/de3/c104 0 2024-02-28T16:24:13.586 INFO:tasks.workunit.client.0.smithi023.stdout:0/554: rmdir d6/db/d1a/d26/d66 39 2024-02-28T16:24:13.590 INFO:tasks.workunit.client.0.smithi023.stdout:4/572: readlink d13/l59 0 2024-02-28T16:24:13.593 INFO:tasks.workunit.client.0.smithi023.stdout:7/561: dwrite de/d13/f2b [0,4194304] 0 2024-02-28T16:24:13.593 INFO:tasks.workunit.client.0.smithi023.stdout:3/615: creat d1/df/d3d/d57/d61/d9e/fd1 x:0 0 0 2024-02-28T16:24:13.595 INFO:tasks.workunit.client.0.smithi023.stdout:3/616: write d1/d4a/fc0 [493541,5204] 0 2024-02-28T16:24:13.599 INFO:tasks.workunit.client.0.smithi023.stdout:3/617: chown d1/d74/d46/f72 5410 1 2024-02-28T16:24:13.606 INFO:tasks.workunit.client.0.smithi023.stdout:5/798: creat d1/d2a/d32/d58/d79/de5/f105 x:0 0 0 2024-02-28T16:24:13.608 INFO:tasks.workunit.client.0.smithi023.stdout:4/573: dread d13/d2b/d2c/d31/d8d/fa1 [0,4194304] 0 2024-02-28T16:24:13.614 INFO:tasks.workunit.client.0.smithi023.stdout:8/660: link d0/d5/d1a/d44/f96 d0/d5/d1a/d2d/d67/d71/db4/d39/fdd 0 2024-02-28T16:24:13.616 INFO:tasks.workunit.client.0.smithi023.stdout:1/632: truncate df/d11/d13/d1b/d30/f60 1141748 0 2024-02-28T16:24:13.618 INFO:tasks.workunit.client.0.smithi023.stdout:0/555: read d6/db/f39 [2697189,30243] 0 2024-02-28T16:24:13.621 INFO:tasks.workunit.client.0.smithi023.stdout:4/574: mknod d13/d1e/cba 0 2024-02-28T16:24:13.622 INFO:tasks.workunit.client.0.smithi023.stdout:5/799: mknod d1/d2a/d32/d37/d3a/d7f/dca/c106 0 2024-02-28T16:24:13.630 INFO:tasks.workunit.client.0.smithi023.stdout:7/562: dwrite de/d13/f8f [0,4194304] 0 2024-02-28T16:24:13.633 INFO:tasks.workunit.client.0.smithi023.stdout:2/670: dread d5/ff [0,4194304] 0 2024-02-28T16:24:13.637 INFO:tasks.workunit.client.0.smithi023.stdout:5/800: chown d1/d2a/d32/d37/d3a/d7f/d62/f76 836 1 2024-02-28T16:24:13.638 INFO:tasks.workunit.client.0.smithi023.stdout:3/618: dwrite d1/df/d3d/d57/d61/fce [0,4194304] 0 2024-02-28T16:24:13.656 INFO:tasks.workunit.client.0.smithi023.stdout:8/661: dwrite d0/d5/d1a/f6d [0,4194304] 0 2024-02-28T16:24:13.672 INFO:tasks.workunit.client.0.smithi023.stdout:1/633: mknod df/d93/cd4 0 2024-02-28T16:24:13.672 INFO:tasks.workunit.client.0.smithi023.stdout:9/604: dread d0/d7/db/d18/d23/d28/d32/d8b/f9f [0,4194304] 0 2024-02-28T16:24:13.672 INFO:tasks.workunit.client.0.smithi023.stdout:0/556: symlink d6/db/d5d/lbf 0 2024-02-28T16:24:13.673 INFO:tasks.workunit.client.0.smithi023.stdout:7/563: creat de/d9b/fba x:0 0 0 2024-02-28T16:24:13.673 INFO:tasks.workunit.client.0.smithi023.stdout:4/575: write fb [5215792,124914] 0 2024-02-28T16:24:13.673 INFO:tasks.workunit.client.0.smithi023.stdout:2/671: dread - d5/da/db/d17/d39/f80 zero size 2024-02-28T16:24:13.675 INFO:tasks.workunit.client.0.smithi023.stdout:5/801: rmdir d1/d2a/d32/d58/d79 39 2024-02-28T16:24:13.676 INFO:tasks.workunit.client.0.smithi023.stdout:3/619: creat d1/df/d3d/d57/d61/db5/fd2 x:0 0 0 2024-02-28T16:24:13.678 INFO:tasks.workunit.client.0.smithi023.stdout:3/620: stat d1/df/d3d/fb8 0 2024-02-28T16:24:13.680 INFO:tasks.workunit.client.0.smithi023.stdout:2/672: write d5/da/f5b [2549254,84658] 0 2024-02-28T16:24:13.680 INFO:tasks.workunit.client.0.smithi023.stdout:7/564: readlink de/l29 0 2024-02-28T16:24:13.685 INFO:tasks.workunit.client.0.smithi023.stdout:9/605: unlink d0/c31 0 2024-02-28T16:24:13.688 INFO:tasks.workunit.client.0.smithi023.stdout:5/802: creat d1/d2a/d32/ddc/de3/f107 x:0 0 0 2024-02-28T16:24:13.688 INFO:tasks.workunit.client.0.smithi023.stdout:2/673: read - d5/da/d1b/d3f/d75/fb4 zero size 2024-02-28T16:24:13.688 INFO:tasks.workunit.client.0.smithi023.stdout:1/634: rename df/dbd/d7b/cd2 to df/d11/d13/d1b/d30/d57/d5a/da6/cd5 0 2024-02-28T16:24:13.692 INFO:tasks.workunit.client.0.smithi023.stdout:5/803: read - d1/d2a/d32/d58/d73/fe1 zero size 2024-02-28T16:24:13.693 INFO:tasks.workunit.client.0.smithi023.stdout:7/565: unlink de/f43 0 2024-02-28T16:24:13.697 INFO:tasks.workunit.client.0.smithi023.stdout:8/662: dwrite d0/d5/d1a/d2d/d67/d71/d9e/fa4 [0,4194304] 0 2024-02-28T16:24:13.701 INFO:tasks.workunit.client.0.smithi023.stdout:0/557: dwrite d6/db/d1a/d26/f5c [0,4194304] 0 2024-02-28T16:24:13.702 INFO:tasks.workunit.client.0.smithi023.stdout:2/674: rmdir d5/da/db/d17/d3c/d7f 39 2024-02-28T16:24:13.703 INFO:tasks.workunit.client.0.smithi023.stdout:9/606: write d0/d7/db/d18/d23/d28/d32/d3c/f8e [440549,78030] 0 2024-02-28T16:24:13.708 INFO:tasks.workunit.client.0.smithi023.stdout:3/621: symlink d1/df/d33/d38/d4c/ld3 0 2024-02-28T16:24:13.710 INFO:tasks.workunit.client.0.smithi023.stdout:1/635: mkdir df/dcf/dd6 0 2024-02-28T16:24:13.714 INFO:tasks.workunit.client.0.smithi023.stdout:2/675: symlink d5/da/db/d17/d73/dd0/d52/ld4 0 2024-02-28T16:24:13.714 INFO:tasks.workunit.client.0.smithi023.stdout:9/607: symlink d0/d7/db/d18/d23/d28/lcd 0 2024-02-28T16:24:13.724 INFO:tasks.workunit.client.0.smithi023.stdout:9/608: creat d0/d7/db/d18/d23/d28/d32/d8b/fce x:0 0 0 2024-02-28T16:24:13.725 INFO:tasks.workunit.client.0.smithi023.stdout:5/804: dread d1/d2a/d32/d37/d3a/d7f/d62/fa9 [0,4194304] 0 2024-02-28T16:24:13.728 INFO:tasks.workunit.client.0.smithi023.stdout:9/609: read d0/d7/db/d18/d23/fa8 [1737201,50465] 0 2024-02-28T16:24:13.729 INFO:tasks.workunit.client.0.smithi023.stdout:8/663: link d0/d5/d1a/fbe d0/d5/d1a/fde 0 2024-02-28T16:24:13.732 INFO:tasks.workunit.client.0.smithi023.stdout:5/805: fsync d1/d2a/d32/d58/d60/d81/fb6 0 2024-02-28T16:24:13.734 INFO:tasks.workunit.client.0.smithi023.stdout:3/622: dread d1/df/f3e [0,4194304] 0 2024-02-28T16:24:13.736 INFO:tasks.workunit.client.0.smithi023.stdout:3/623: chown d1/df/d2d/d32/d3f/c7a 0 1 2024-02-28T16:24:13.737 INFO:tasks.workunit.client.0.smithi023.stdout:4/576: write d13/d2b/f51 [3540705,91215] 0 2024-02-28T16:24:13.743 INFO:tasks.workunit.client.0.smithi023.stdout:8/664: rename d0/d5/d1a/d2d/d67/d71/d9e/dbb/fc4 to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fdf 0 2024-02-28T16:24:13.751 INFO:tasks.workunit.client.0.smithi023.stdout:9/610: dwrite d0/d7/db/f8f [0,4194304] 0 2024-02-28T16:24:13.751 INFO:tasks.workunit.client.0.smithi023.stdout:0/558: truncate d6/db/d1a/d1b/f5a 228131 0 2024-02-28T16:24:13.755 INFO:tasks.workunit.client.0.smithi023.stdout:3/624: rename d1/df/d2d/d45/d52/d65/d89/c8b to d1/df/d2d/d45/d52/d65/cd4 0 2024-02-28T16:24:13.756 INFO:tasks.workunit.client.0.smithi023.stdout:5/806: creat d1/d2a/d32/d37/d4e/db5/dc0/f108 x:0 0 0 2024-02-28T16:24:13.763 INFO:tasks.workunit.client.0.smithi023.stdout:0/559: rmdir d6/db/dab/d82 39 2024-02-28T16:24:13.764 INFO:tasks.workunit.client.0.smithi023.stdout:9/611: symlink d0/d7/d2c/d84/lcf 0 2024-02-28T16:24:13.772 INFO:tasks.workunit.client.0.smithi023.stdout:3/625: rename d1/df/d2d/d32/c66 to d1/df/d2d/cd5 0 2024-02-28T16:24:13.773 INFO:tasks.workunit.client.0.smithi023.stdout:9/612: dread - d0/d7/db/d18/d23/d28/d9c/fb1 zero size 2024-02-28T16:24:13.775 INFO:tasks.workunit.client.0.smithi023.stdout:0/560: symlink d6/db/d1a/d59/lc0 0 2024-02-28T16:24:13.777 INFO:tasks.workunit.client.0.smithi023.stdout:1/636: dwrite df/d26/d48/f9d [0,4194304] 0 2024-02-28T16:24:13.778 INFO:tasks.workunit.client.0.smithi023.stdout:0/561: readlink d6/d84/lba 0 2024-02-28T16:24:13.778 INFO:tasks.workunit.client.0.smithi023.stdout:8/665: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fdf [0,4194304] 0 2024-02-28T16:24:13.783 INFO:tasks.workunit.client.0.smithi023.stdout:4/577: truncate d13/d2b/d2c/d31/d6e/f97 6301 0 2024-02-28T16:24:13.785 INFO:tasks.workunit.client.0.smithi023.stdout:5/807: rename d1/d2a/d32/d58/def to d1/d2a/d32/d36/da7/d109 0 2024-02-28T16:24:13.792 INFO:tasks.workunit.client.0.smithi023.stdout:4/578: read d13/d2b/d2c/d31/d8d/f94 [457510,92909] 0 2024-02-28T16:24:13.793 INFO:tasks.workunit.client.0.smithi023.stdout:1/637: mknod df/d26/d48/db3/cd7 0 2024-02-28T16:24:13.805 INFO:tasks.workunit.client.0.smithi023.stdout:1/638: symlink df/d11/d13/d1b/d2e/ld8 0 2024-02-28T16:24:13.807 INFO:tasks.workunit.client.0.smithi023.stdout:3/626: rename d1/df/d2d/cd5 to d1/df/d2d/d45/d6f/cd6 0 2024-02-28T16:24:13.812 INFO:tasks.workunit.client.0.smithi023.stdout:5/808: write d1/d2a/d32/d37/d3a/fae [530396,45399] 0 2024-02-28T16:24:13.818 INFO:tasks.workunit.client.0.smithi023.stdout:8/666: dwrite d0/d5/d1a/d2d/d67/f7c [0,4194304] 0 2024-02-28T16:24:13.818 INFO:tasks.workunit.client.0.smithi023.stdout:3/627: fsync d1/df/d2d/d45/d78/f79 0 2024-02-28T16:24:13.821 INFO:tasks.workunit.client.0.smithi023.stdout:9/613: rename d0/d7/db/d18/d23/d28/c30 to d0/d7/d2c/d84/cd0 0 2024-02-28T16:24:13.821 INFO:tasks.workunit.client.0.smithi023.stdout:0/562: link d6/d98/laf d6/db/dab/d82/d72/lc1 0 2024-02-28T16:24:13.823 INFO:tasks.workunit.client.0.smithi023.stdout:9/614: readlink d0/l1b 0 2024-02-28T16:24:13.825 INFO:tasks.workunit.client.0.smithi023.stdout:8/667: creat d0/d5/d1a/d44/fe0 x:0 0 0 2024-02-28T16:24:13.827 INFO:tasks.workunit.client.0.smithi023.stdout:3/628: unlink d1/df/d33/d38/d4c/f7c 0 2024-02-28T16:24:13.829 INFO:tasks.workunit.client.0.smithi023.stdout:9/615: mkdir d0/d7/d2c/d7d/dd1 0 2024-02-28T16:24:13.831 INFO:tasks.workunit.client.0.smithi023.stdout:3/629: stat d1/df/d2d/d45/d52/d65/l75 0 2024-02-28T16:24:13.832 INFO:tasks.workunit.client.0.smithi023.stdout:5/809: dwrite d1/d2a/d32/d36/da7/ff2 [0,4194304] 0 2024-02-28T16:24:13.832 INFO:tasks.workunit.client.0.smithi023.stdout:9/616: chown d0/d7/db/d18/f49 45880 1 2024-02-28T16:24:13.842 INFO:tasks.workunit.client.0.smithi023.stdout:0/563: rename d6/db/d1a/d26/d31/f8c to d6/db/dab/d42/fc2 0 2024-02-28T16:24:13.843 INFO:tasks.workunit.client.0.smithi023.stdout:1/639: truncate df/d26/f35 3584736 0 2024-02-28T16:24:13.844 INFO:tasks.workunit.client.0.smithi023.stdout:3/630: creat d1/d4a/fd7 x:0 0 0 2024-02-28T16:24:13.846 INFO:tasks.workunit.client.0.smithi023.stdout:5/810: symlink d1/d2a/d32/d37/d4e/l10a 0 2024-02-28T16:24:13.849 INFO:tasks.workunit.client.0.smithi023.stdout:3/631: write d1/df/d2d/f8c [2705463,123909] 0 2024-02-28T16:24:13.851 INFO:tasks.workunit.client.0.smithi023.stdout:8/668: mkdir d0/d5/d1b/de1 0 2024-02-28T16:24:13.853 INFO:tasks.workunit.client.0.smithi023.stdout:8/669: readlink d0/d5/d1a/d63/d90/dac/dc3/lc9 0 2024-02-28T16:24:13.858 INFO:tasks.workunit.client.0.smithi023.stdout:0/564: symlink d6/db/d1a/d26/d31/d33/d6e/db1/lc3 0 2024-02-28T16:24:13.861 INFO:tasks.workunit.client.0.smithi023.stdout:3/632: mknod d1/df/d33/dc2/cd8 0 2024-02-28T16:24:13.866 INFO:tasks.workunit.client.0.smithi023.stdout:9/617: dread d0/d7/de/f63 [0,4194304] 0 2024-02-28T16:24:13.868 INFO:tasks.workunit.client.0.smithi023.stdout:1/640: creat df/d11/d13/d1b/d30/d57/d5a/d68/d6f/fd9 x:0 0 0 2024-02-28T16:24:13.871 INFO:tasks.workunit.client.0.smithi023.stdout:8/670: mkdir d0/d5/ddc/de2 0 2024-02-28T16:24:13.874 INFO:tasks.workunit.client.0.smithi023.stdout:8/671: chown d0/d5/d1a/d2d/d67/d71/db4/d39 620213 1 2024-02-28T16:24:13.875 INFO:tasks.workunit.client.0.smithi023.stdout:0/565: creat d6/db/d68/fc4 x:0 0 0 2024-02-28T16:24:13.876 INFO:tasks.workunit.client.0.smithi023.stdout:1/641: read df/d11/f54 [618888,5374] 0 2024-02-28T16:24:13.878 INFO:tasks.workunit.client.0.smithi023.stdout:8/672: chown d0/d5/d1a/d2d/d67/d71/db4/d39/f3b 329228177 1 2024-02-28T16:24:13.878 INFO:tasks.workunit.client.0.smithi023.stdout:5/811: getdents d1/d2a/d32/d37/d3a/d7f/d62/d7b 0 2024-02-28T16:24:13.879 INFO:tasks.workunit.client.0.smithi023.stdout:3/633: link d1/c1a d1/df/d2d/d9d/cd9 0 2024-02-28T16:24:13.881 INFO:tasks.workunit.client.0.smithi023.stdout:0/566: creat d6/d84/fc5 x:0 0 0 2024-02-28T16:24:13.882 INFO:tasks.workunit.client.0.smithi023.stdout:9/618: unlink d0/d7/de/d2a/daf/d2f/d44/fc6 0 2024-02-28T16:24:13.885 INFO:tasks.workunit.client.0.smithi023.stdout:5/812: unlink d1/d2a/d32/d37/d4e/db5/fce 0 2024-02-28T16:24:13.889 INFO:tasks.workunit.client.0.smithi023.stdout:3/634: dread d1/df/d33/d38/d4c/f5d [0,4194304] 0 2024-02-28T16:24:13.896 INFO:tasks.workunit.client.0.smithi023.stdout:1/642: link df/d11/d13/d1b/d30/d57/d5a/l63 df/d26/d48/d72/lda 0 2024-02-28T16:24:13.898 INFO:tasks.workunit.client.0.smithi023.stdout:8/673: rmdir d0/d5/d1a/d2d/d67/d71/d9e/dbb 0 2024-02-28T16:24:13.900 INFO:tasks.workunit.client.0.smithi023.stdout:1/643: symlink df/d26/d48/d80/ldb 0 2024-02-28T16:24:13.901 INFO:tasks.workunit.client.0.smithi023.stdout:3/635: mknod d1/df/d33/cda 0 2024-02-28T16:24:13.904 INFO:tasks.workunit.client.0.smithi023.stdout:8/674: rename d0/d5/d1a/d2d/f5c to d0/d5/d1a/d2d/d67/d71/d9e/ddb/fe3 0 2024-02-28T16:24:13.905 INFO:tasks.workunit.client.0.smithi023.stdout:3/636: truncate d1/df/d2d/da8/fb6 320711 0 2024-02-28T16:24:13.911 INFO:tasks.workunit.client.0.smithi023.stdout:8/675: write d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/f6b [4436572,95027] 0 2024-02-28T16:24:13.911 INFO:tasks.workunit.client.0.smithi023.stdout:1/644: creat df/d26/d48/fdc x:0 0 0 2024-02-28T16:24:13.917 INFO:tasks.workunit.client.0.smithi023.stdout:3/637: link d1/df/f8e d1/fdb 0 2024-02-28T16:24:13.918 INFO:tasks.workunit.client.0.smithi023.stdout:3/638: readlink d1/df/lb4 0 2024-02-28T16:24:13.919 INFO:tasks.workunit.client.0.smithi023.stdout:1/645: write df/d11/d13/f2c [4874072,30683] 0 2024-02-28T16:24:13.920 INFO:tasks.workunit.client.0.smithi023.stdout:5/813: write d1/d2a/d32/d37/d3a/f6a [98860,45091] 0 2024-02-28T16:24:13.927 INFO:tasks.workunit.client.0.smithi023.stdout:1/646: read df/f16 [314309,79618] 0 2024-02-28T16:24:13.929 INFO:tasks.workunit.client.0.smithi023.stdout:9/619: dwrite d0/d7/de/d34/f35 [0,4194304] 0 2024-02-28T16:24:13.933 INFO:tasks.workunit.client.0.smithi023.stdout:5/814: unlink d1/d2a/d32/ddc/de3/lf8 0 2024-02-28T16:24:13.936 INFO:tasks.workunit.client.0.smithi023.stdout:3/639: rename d1/df/d3d/d57/f6d to d1/fdc 0 2024-02-28T16:24:13.944 INFO:tasks.workunit.client.0.smithi023.stdout:3/640: mkdir d1/df/d3d/d57/d61/ddd 0 2024-02-28T16:24:13.946 INFO:tasks.workunit.client.0.smithi023.stdout:5/815: rename d1/d2a/d32/d37/d4e/db5/dc0/f108 to d1/d2a/d32/d37/d3a/d7f/d62/dd1/f10b 0 2024-02-28T16:24:13.948 INFO:tasks.workunit.client.0.smithi023.stdout:3/641: chown d1/df/d33/d38/d4c/f7e 5 1 2024-02-28T16:24:13.948 INFO:tasks.workunit.client.0.smithi023.stdout:8/676: dwrite d0/d5/d1a/d44/f96 [0,4194304] 0 2024-02-28T16:24:13.950 INFO:tasks.workunit.client.0.smithi023.stdout:3/642: chown d1/f4 2783778 1 2024-02-28T16:24:13.951 INFO:tasks.workunit.client.0.smithi023.stdout:9/620: write d0/d7/db/d18/f56 [298149,90695] 0 2024-02-28T16:24:13.956 INFO:tasks.workunit.client.0.smithi023.stdout:3/643: mknod d1/df/d2d/d45/d6f/cde 0 2024-02-28T16:24:13.956 INFO:tasks.workunit.client.0.smithi023.stdout:9/621: readlink d0/d7/db/d18/d23/d28/lcd 0 2024-02-28T16:24:13.964 INFO:tasks.workunit.client.0.smithi023.stdout:3/644: fsync d1/df/f30 0 2024-02-28T16:24:13.965 INFO:tasks.workunit.client.0.smithi023.stdout:1/647: dwrite df/d11/d13/d1b/d30/d57/f85 [0,4194304] 0 2024-02-28T16:24:13.965 INFO:tasks.workunit.client.0.smithi023.stdout:9/622: mkdir d0/dd2 0 2024-02-28T16:24:13.966 INFO:tasks.workunit.client.0.smithi023.stdout:6/688: sync 2024-02-28T16:24:13.974 INFO:tasks.workunit.client.0.smithi023.stdout:5/816: dwrite d1/d2a/d32/d37/d3a/d7f/d62/fa9 [0,4194304] 0 2024-02-28T16:24:13.975 INFO:tasks.workunit.client.0.smithi023.stdout:8/677: dread d0/d5/d1a/d2d/d67/d71/db4/d39/fdd [0,4194304] 0 2024-02-28T16:24:13.975 INFO:tasks.workunit.client.0.smithi023.stdout:6/689: rmdir d1/d28/d1e/dae 39 2024-02-28T16:24:13.984 INFO:tasks.workunit.client.0.smithi023.stdout:1/648: mkdir df/d11/d13/d1b/d30/d57/d5a/d68/ddd 0 2024-02-28T16:24:13.986 INFO:tasks.workunit.client.0.smithi023.stdout:3/645: truncate d1/df/d33/d38/f48 204138 0 2024-02-28T16:24:13.992 INFO:tasks.workunit.client.0.smithi023.stdout:6/690: mkdir d1/d28/d1e/dbc/dfb 0 2024-02-28T16:24:13.994 INFO:tasks.workunit.client.0.smithi023.stdout:9/623: dwrite d0/d7/db/f8f [0,4194304] 0 2024-02-28T16:24:13.996 INFO:tasks.workunit.client.0.smithi023.stdout:5/817: fsync d1/d2a/d32/d36/f66 0 2024-02-28T16:24:14.002 INFO:tasks.workunit.client.0.smithi023.stdout:1/649: chown df/d11/d13/d1b/d30/d57/d5a/d68/lb5 463610 1 2024-02-28T16:24:14.006 INFO:tasks.workunit.client.0.smithi023.stdout:8/678: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/f48 [0,4194304] 0 2024-02-28T16:24:14.007 INFO:tasks.workunit.client.0.smithi023.stdout:3/646: dread d1/df/d2d/d45/d52/d65/d89/faa [0,4194304] 0 2024-02-28T16:24:14.011 INFO:tasks.workunit.client.0.smithi023.stdout:9/624: write d0/d7/de/d2a/daf/fa5 [1479737,63783] 0 2024-02-28T16:24:14.012 INFO:tasks.workunit.client.0.smithi023.stdout:1/650: stat df/d11/c52 0 2024-02-28T16:24:14.016 INFO:tasks.workunit.client.0.smithi023.stdout:6/691: chown d1/d28/d1e/d2b/d44/d86/fdc 5292177 1 2024-02-28T16:24:14.019 INFO:tasks.workunit.client.0.smithi023.stdout:8/679: chown d0/d5/f27 709 1 2024-02-28T16:24:14.028 INFO:tasks.workunit.client.0.smithi023.stdout:1/651: dread df/d11/d13/d1b/d30/d57/d5a/d68/d7a/fb1 [0,4194304] 0 2024-02-28T16:24:14.032 INFO:tasks.workunit.client.0.smithi023.stdout:9/625: symlink d0/d7/db/d18/d23/d28/db6/ld3 0 2024-02-28T16:24:14.032 INFO:tasks.workunit.client.0.smithi023.stdout:3/647: dwrite d1/df/d2d/d32/d3f/f90 [0,4194304] 0 2024-02-28T16:24:14.036 INFO:tasks.workunit.client.0.smithi023.stdout:5/818: rename d1/d2a/d32/d37/d3a/d7f/d62/l95 to d1/d2a/d32/d58/d60/d88/l10c 0 2024-02-28T16:24:14.038 INFO:tasks.workunit.client.0.smithi023.stdout:6/692: mknod d1/d3d/dd6/cfc 0 2024-02-28T16:24:14.040 INFO:tasks.workunit.client.0.smithi023.stdout:5/819: chown d1/d2a/d32/d36/da7/ff2 29220 1 2024-02-28T16:24:14.040 INFO:tasks.workunit.client.0.smithi023.stdout:6/693: fsync d1/d3d/fea 0 2024-02-28T16:24:14.042 INFO:tasks.workunit.client.0.smithi023.stdout:1/652: mkdir df/d11/d13/d99/dde 0 2024-02-28T16:24:14.043 INFO:tasks.workunit.client.0.smithi023.stdout:3/648: creat d1/df/d2d/d32/d3f/fdf x:0 0 0 2024-02-28T16:24:14.044 INFO:tasks.workunit.client.0.smithi023.stdout:1/653: fsync df/d11/d13/d1b/d2e/fc9 0 2024-02-28T16:24:14.179 INFO:tasks.workunit.client.0.smithi023.stdout:8/680: creat d0/d5/d35/dbf/fe4 x:0 0 0 2024-02-28T16:24:14.182 INFO:tasks.workunit.client.0.smithi023.stdout:6/694: mknod d1/d28/d1e/d80/cfd 0 2024-02-28T16:24:14.182 INFO:tasks.workunit.client.0.smithi023.stdout:8/681: dread - d0/d5/d1b/d36/fd4 zero size 2024-02-28T16:24:14.184 INFO:tasks.workunit.client.0.smithi023.stdout:5/820: truncate d1/d2a/d32/d58/d60/d81/fb6 828571 0 2024-02-28T16:24:14.185 INFO:tasks.workunit.client.0.smithi023.stdout:8/682: write d0/d5/d1b/f43 [164335,3751] 0 2024-02-28T16:24:14.188 INFO:tasks.workunit.client.0.smithi023.stdout:3/649: rename d1/df/d2d/d9d/cc1 to d1/df/d2d/d45/d52/d65/ce0 0 2024-02-28T16:24:14.190 INFO:tasks.workunit.client.0.smithi023.stdout:5/821: chown d1/d2a/d32/d37/d3a/d7f/d62/d7b/f99 91 1 2024-02-28T16:24:14.190 INFO:tasks.workunit.client.0.smithi023.stdout:3/650: fsync d1/df/d2d/d45/f1b 0 2024-02-28T16:24:14.194 INFO:tasks.workunit.client.0.smithi023.stdout:3/651: write d1/df/d2d/d9d/d9f/fc8 [41932,50411] 0 2024-02-28T16:24:14.204 INFO:tasks.workunit.client.0.smithi023.stdout:5/822: mkdir d1/d2a/d32/d37/d4e/d10d 0 2024-02-28T16:24:14.205 INFO:tasks.workunit.client.0.smithi023.stdout:8/683: dwrite d0/d5/d1b/d7f/f91 [0,4194304] 0 2024-02-28T16:24:14.212 INFO:tasks.workunit.client.0.smithi023.stdout:6/695: dread d1/d3d/fea [0,4194304] 0 2024-02-28T16:24:14.217 INFO:tasks.workunit.client.0.smithi023.stdout:8/684: mknod d0/d5/d1b/de1/ce5 0 2024-02-28T16:24:14.222 INFO:tasks.workunit.client.0.smithi023.stdout:7/566: sync 2024-02-28T16:24:14.225 INFO:tasks.workunit.client.0.smithi023.stdout:3/652: rename d1/df/d3d/d57/d61 to d1/d74/de1 0 2024-02-28T16:24:14.227 INFO:tasks.workunit.client.0.smithi023.stdout:7/567: fsync de/d1c/f26 0 2024-02-28T16:24:14.231 INFO:tasks.workunit.client.0.smithi023.stdout:7/568: write de/ff [4827187,123281] 0 2024-02-28T16:24:14.234 INFO:tasks.workunit.client.0.smithi023.stdout:5/823: dwrite d1/d2a/d32/d37/d3a/d7f/f29 [0,4194304] 0 2024-02-28T16:24:14.236 INFO:tasks.workunit.client.0.smithi023.stdout:7/569: read de/d13/d1b/f4c [997790,84267] 0 2024-02-28T16:24:14.237 INFO:tasks.workunit.client.0.smithi023.stdout:8/685: mknod d0/d5/d1a/d2d/d67/ce6 0 2024-02-28T16:24:14.238 INFO:tasks.workunit.client.0.smithi023.stdout:8/686: chown d0/d5/ddc 5814029 1 2024-02-28T16:24:14.239 INFO:tasks.workunit.client.0.smithi023.stdout:3/653: creat d1/df/d2d/d32/d3f/fe2 x:0 0 0 2024-02-28T16:24:14.242 INFO:tasks.workunit.client.0.smithi023.stdout:6/696: creat d1/d28/ffe x:0 0 0 2024-02-28T16:24:14.247 INFO:tasks.workunit.client.0.smithi023.stdout:5/824: read - d1/d2a/d32/d58/d79/de5/f105 zero size 2024-02-28T16:24:14.251 INFO:tasks.workunit.client.0.smithi023.stdout:7/570: creat de/d13/d1b/d6c/db6/fbb x:0 0 0 2024-02-28T16:24:14.254 INFO:tasks.workunit.client.0.smithi023.stdout:8/687: mkdir d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/de7 0 2024-02-28T16:24:14.256 INFO:tasks.workunit.client.0.smithi023.stdout:6/697: mknod d1/d18/d26/da6/da9/cff 0 2024-02-28T16:24:14.256 INFO:tasks.workunit.client.0.smithi023.stdout:8/688: write d0/fb9 [3458213,57743] 0 2024-02-28T16:24:14.266 INFO:tasks.workunit.client.0.smithi023.stdout:5/825: dread d1/d2a/d32/d36/da7/ff2 [0,4194304] 0 2024-02-28T16:24:14.266 INFO:tasks.workunit.client.0.smithi023.stdout:7/571: rename de/d1c/c8a to de/d8b/d95/cbc 0 2024-02-28T16:24:14.266 INFO:tasks.workunit.client.0.smithi023.stdout:3/654: dwrite d1/fdc [0,4194304] 0 2024-02-28T16:24:14.271 INFO:tasks.workunit.client.0.smithi023.stdout:5/826: write d1/d2a/d32/d37/d3a/d7f/d62/d68/f8c [989284,29330] 0 2024-02-28T16:24:14.274 INFO:tasks.workunit.client.0.smithi023.stdout:5/827: fdatasync d1/d2a/d32/d6e/f85 0 2024-02-28T16:24:14.279 INFO:tasks.workunit.client.0.smithi023.stdout:8/689: rename d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fdf to d0/d5/d1a/d63/d90/fe8 0 2024-02-28T16:24:14.280 INFO:tasks.workunit.client.0.smithi023.stdout:5/828: truncate d1/d2a/d32/d58/fb2 46954 0 2024-02-28T16:24:14.284 INFO:tasks.workunit.client.0.smithi023.stdout:3/655: fdatasync d1/df/d33/f81 0 2024-02-28T16:24:14.287 INFO:tasks.workunit.client.0.smithi023.stdout:6/698: dread d1/d18/d26/d3a/f3f [0,4194304] 0 2024-02-28T16:24:14.289 INFO:tasks.workunit.client.0.smithi023.stdout:6/699: chown d1/d28/d1e/d2b/d76 26446124 1 2024-02-28T16:24:14.307 INFO:tasks.workunit.client.0.smithi023.stdout:5/829: creat d1/d2a/d32/d58/d60/f10e x:0 0 0 2024-02-28T16:24:14.309 INFO:tasks.workunit.client.0.smithi023.stdout:8/690: write d0/d5/d1a/f2e [60919,35342] 0 2024-02-28T16:24:14.311 INFO:tasks.workunit.client.0.smithi023.stdout:7/572: dwrite de/d1c/f5a [0,4194304] 0 2024-02-28T16:24:14.318 INFO:tasks.workunit.client.0.smithi023.stdout:7/573: unlink de/d13/f6d 0 2024-02-28T16:24:14.321 INFO:tasks.workunit.client.0.smithi023.stdout:3/656: truncate d1/d74/d46/f72 3030395 0 2024-02-28T16:24:14.324 INFO:tasks.workunit.client.0.smithi023.stdout:5/830: write d1/d2a/d32/d36/f66 [1662283,12782] 0 2024-02-28T16:24:14.325 INFO:tasks.workunit.client.0.smithi023.stdout:3/657: chown d1/df/d2d/la5 244 1 2024-02-28T16:24:14.327 INFO:tasks.workunit.client.0.smithi023.stdout:8/691: truncate d0/d5/f5e 5798610 0 2024-02-28T16:24:14.331 INFO:tasks.workunit.client.0.smithi023.stdout:8/692: write d0/d5/d1a/d2d/d67/daf/f9a [1340983,64730] 0 2024-02-28T16:24:14.337 INFO:tasks.workunit.client.0.smithi023.stdout:5/831: rename d1/d2a/d32/d58/d60/d81/fb6 to d1/d2a/d32/d37/d3a/d7f/f10f 0 2024-02-28T16:24:14.339 INFO:tasks.workunit.client.0.smithi023.stdout:8/693: unlink d0/d5/d1a/fde 0 2024-02-28T16:24:14.347 INFO:tasks.workunit.client.0.smithi023.stdout:7/574: dread f8 [0,4194304] 0 2024-02-28T16:24:14.348 INFO:tasks.workunit.client.0.smithi023.stdout:5/832: creat d1/d2a/d32/d58/d60/d81/f110 x:0 0 0 2024-02-28T16:24:14.350 INFO:tasks.workunit.client.0.smithi023.stdout:3/658: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:24:14.351 INFO:tasks.workunit.client.0.smithi023.stdout:5/833: read d1/d2a/d32/d36/da7/ff2 [1888307,110126] 0 2024-02-28T16:24:14.355 INFO:tasks.workunit.client.0.smithi023.stdout:3/659: creat d1/d4a/d92/fe3 x:0 0 0 2024-02-28T16:24:14.360 INFO:tasks.workunit.client.0.smithi023.stdout:7/575: creat de/d1c/d76/d7b/dab/fbd x:0 0 0 2024-02-28T16:24:14.365 INFO:tasks.workunit.client.0.smithi023.stdout:5/834: link d1/d2a/d32/d37/d3a/d7f/d62/dd1/fe9 d1/d2a/d32/d58/d79/de5/f111 0 2024-02-28T16:24:14.369 INFO:tasks.workunit.client.0.smithi023.stdout:3/660: read d1/df/d33/d38/f43 [1474277,11012] 0 2024-02-28T16:24:14.371 INFO:tasks.workunit.client.0.smithi023.stdout:5/835: creat d1/d2a/d32/d58/d73/df5/f112 x:0 0 0 2024-02-28T16:24:14.372 INFO:tasks.workunit.client.0.smithi023.stdout:3/661: chown d1/df/d2d/d45/d78 47 1 2024-02-28T16:24:14.373 INFO:tasks.workunit.client.0.smithi023.stdout:8/694: dwrite d0/d5/d1a/d2d/d67/d71/d9e/ddb/fe3 [0,4194304] 0 2024-02-28T16:24:14.377 INFO:tasks.workunit.client.0.smithi023.stdout:5/836: readlink d1/d2a/d32/d37/d3a/d7f/d62/d68/l9f 0 2024-02-28T16:24:14.378 INFO:tasks.workunit.client.0.smithi023.stdout:3/662: mkdir d1/d74/d94/de4 0 2024-02-28T16:24:14.381 INFO:tasks.workunit.client.0.smithi023.stdout:3/663: stat d1/df/d2d/d32/d3f/fa6 0 2024-02-28T16:24:14.382 INFO:tasks.workunit.client.0.smithi023.stdout:8/695: fdatasync d0/d5/d1a/d2d/d67/d71/db4/d39/f4c 0 2024-02-28T16:24:14.387 INFO:tasks.workunit.client.0.smithi023.stdout:5/837: creat d1/d2a/d32/d37/d3a/d7f/d62/d7b/f113 x:0 0 0 2024-02-28T16:24:14.389 INFO:tasks.workunit.client.0.smithi023.stdout:3/664: creat d1/df/d33/dc2/dcc/fe5 x:0 0 0 2024-02-28T16:24:14.389 INFO:tasks.workunit.client.0.smithi023.stdout:8/696: read - d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fc5 zero size 2024-02-28T16:24:14.392 INFO:tasks.workunit.client.0.smithi023.stdout:8/697: write d0/d5/d1b/f43 [2525742,6545] 0 2024-02-28T16:24:14.397 INFO:tasks.workunit.client.0.smithi023.stdout:8/698: fdatasync d0/f7a 0 2024-02-28T16:24:14.398 INFO:tasks.workunit.client.0.smithi023.stdout:2/676: sync 2024-02-28T16:24:14.398 INFO:tasks.workunit.client.0.smithi023.stdout:4/579: sync 2024-02-28T16:24:14.401 INFO:tasks.workunit.client.0.smithi023.stdout:7/576: dread de/d60/f3c [0,4194304] 0 2024-02-28T16:24:14.404 INFO:tasks.workunit.client.0.smithi023.stdout:2/677: chown d5/da/d1b/d3f/d75/d92/c99 584616 1 2024-02-28T16:24:14.404 INFO:tasks.workunit.client.0.smithi023.stdout:5/838: dread d1/d2a/f44 [0,4194304] 0 2024-02-28T16:24:14.406 INFO:tasks.workunit.client.0.smithi023.stdout:2/678: chown d5/da/d1b/d3f/d75/fab 17552 1 2024-02-28T16:24:14.406 INFO:tasks.workunit.client.0.smithi023.stdout:8/699: rename d0/d5/d1b/l12 to d0/d5/d35/dbf/le9 0 2024-02-28T16:24:14.408 INFO:tasks.workunit.client.0.smithi023.stdout:8/700: fsync d0/d5/d1a/fa2 0 2024-02-28T16:24:14.408 INFO:tasks.workunit.client.0.smithi023.stdout:2/679: stat d5/da/db/d17/d3c/fb1 0 2024-02-28T16:24:14.410 INFO:tasks.workunit.client.0.smithi023.stdout:7/577: chown de/d1c/f26 135134206 1 2024-02-28T16:24:14.411 INFO:tasks.workunit.client.0.smithi023.stdout:4/580: creat d13/d2b/d2c/d31/d8d/fbb x:0 0 0 2024-02-28T16:24:14.413 INFO:tasks.workunit.client.0.smithi023.stdout:4/581: dread - d13/d1e/fa6 zero size 2024-02-28T16:24:14.415 INFO:tasks.workunit.client.0.smithi023.stdout:3/665: write d1/df/d33/d38/d4c/f5d [942886,78787] 0 2024-02-28T16:24:14.419 INFO:tasks.workunit.client.0.smithi023.stdout:5/839: truncate d1/d2a/d32/d37/d3a/d7f/f10f 128214 0 2024-02-28T16:24:14.419 INFO:tasks.workunit.client.0.smithi023.stdout:8/701: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/fea x:0 0 0 2024-02-28T16:24:14.420 INFO:tasks.workunit.client.0.smithi023.stdout:3/666: stat d1/df/d2d/d45/d78/c83 0 2024-02-28T16:24:14.421 INFO:tasks.workunit.client.0.smithi023.stdout:2/680: creat d5/da/db/d17/d3c/d7f/fd5 x:0 0 0 2024-02-28T16:24:14.425 INFO:tasks.workunit.client.0.smithi023.stdout:5/840: write d1/d2a/d32/d37/d4e/db5/dc6/fde [572389,127230] 0 2024-02-28T16:24:14.425 INFO:tasks.workunit.client.0.smithi023.stdout:8/702: symlink d0/d5/d1a/d2d/leb 0 2024-02-28T16:24:14.430 INFO:tasks.workunit.client.0.smithi023.stdout:2/681: write d5/da/db/d17/d73/d9e/da0/fa4 [633818,124428] 0 2024-02-28T16:24:14.431 INFO:tasks.workunit.client.0.smithi023.stdout:7/578: dwrite de/d13/f4d [0,4194304] 0 2024-02-28T16:24:14.436 INFO:tasks.workunit.client.0.smithi023.stdout:7/579: fdatasync de/d13/d1b/d6c/db6/fbb 0 2024-02-28T16:24:14.439 INFO:tasks.workunit.client.0.smithi023.stdout:5/841: mknod d1/d2a/d32/d37/d3a/d7f/dca/c114 0 2024-02-28T16:24:14.439 INFO:tasks.workunit.client.0.smithi023.stdout:8/703: write d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fc5 [837839,12002] 0 2024-02-28T16:24:14.440 INFO:tasks.workunit.client.0.smithi023.stdout:2/682: mkdir d5/da/db/d17/d39/dd6 0 2024-02-28T16:24:14.443 INFO:tasks.workunit.client.0.smithi023.stdout:4/582: dread d13/f3c [0,4194304] 0 2024-02-28T16:24:14.445 INFO:tasks.workunit.client.0.smithi023.stdout:8/704: mkdir d0/d5/d35/dec 0 2024-02-28T16:24:14.447 INFO:tasks.workunit.client.0.smithi023.stdout:7/580: fsync de/d13/d1b/d3d/d53/f73 0 2024-02-28T16:24:14.453 INFO:tasks.workunit.client.0.smithi023.stdout:4/583: unlink f9 0 2024-02-28T16:24:14.453 INFO:tasks.workunit.client.0.smithi023.stdout:3/667: dwrite d1/df/d33/f81 [0,4194304] 0 2024-02-28T16:24:14.454 INFO:tasks.workunit.client.0.smithi023.stdout:2/683: creat d5/da/fd7 x:0 0 0 2024-02-28T16:24:14.458 INFO:tasks.workunit.client.0.smithi023.stdout:2/684: write d5/da/d1b/d3f/d75/fb7 [117667,34009] 0 2024-02-28T16:24:14.461 INFO:tasks.workunit.client.0.smithi023.stdout:7/581: rmdir de/d8b/d95/d98 39 2024-02-28T16:24:14.463 INFO:tasks.workunit.client.0.smithi023.stdout:0/567: sync 2024-02-28T16:24:14.463 INFO:tasks.workunit.client.0.smithi023.stdout:5/842: dwrite d1/d2a/d32/d37/d3a/d7f/d62/d7b/f113 [0,4194304] 0 2024-02-28T16:24:14.470 INFO:tasks.workunit.client.0.smithi023.stdout:3/668: rename d1/f23 to d1/d74/d94/de4/fe6 0 2024-02-28T16:24:14.475 INFO:tasks.workunit.client.0.smithi023.stdout:0/568: unlink d6/db/d24/f77 0 2024-02-28T16:24:14.482 INFO:tasks.workunit.client.0.smithi023.stdout:3/669: unlink d1/df/d33/d38/d4c/ld3 0 2024-02-28T16:24:14.483 INFO:tasks.workunit.client.0.smithi023.stdout:3/670: readlink d1/df/d33/l58 0 2024-02-28T16:24:14.483 INFO:tasks.workunit.client.0.smithi023.stdout:4/584: dwrite d13/fae [0,4194304] 0 2024-02-28T16:24:14.486 INFO:tasks.workunit.client.0.smithi023.stdout:7/582: dwrite de/f82 [0,4194304] 0 2024-02-28T16:24:14.494 INFO:tasks.workunit.client.0.smithi023.stdout:0/569: creat d6/db/d1a/d59/fc6 x:0 0 0 2024-02-28T16:24:14.494 INFO:tasks.workunit.client.0.smithi023.stdout:5/843: symlink d1/l115 0 2024-02-28T16:24:14.498 INFO:tasks.workunit.client.0.smithi023.stdout:4/585: mknod d13/d2b/d2c/cbc 0 2024-02-28T16:24:14.501 INFO:tasks.workunit.client.0.smithi023.stdout:0/570: truncate d6/db/d1a/f7f 604336 0 2024-02-28T16:24:14.501 INFO:tasks.workunit.client.0.smithi023.stdout:4/586: readlink d13/d1e/l96 0 2024-02-28T16:24:14.501 INFO:tasks.workunit.client.0.smithi023.stdout:5/844: write d1/d2a/d32/d58/d60/d88/ffb [193730,115129] 0 2024-02-28T16:24:14.504 INFO:tasks.workunit.client.0.smithi023.stdout:8/705: dwrite d0/d5/d1a/d2d/d67/d71/d9e/fc2 [0,4194304] 0 2024-02-28T16:24:14.506 INFO:tasks.workunit.client.0.smithi023.stdout:5/845: readlink d1/d2a/lf3 0 2024-02-28T16:24:14.510 INFO:tasks.workunit.client.0.smithi023.stdout:0/571: read - d6/db/dab/d42/f83 zero size 2024-02-28T16:24:14.510 INFO:tasks.workunit.client.0.smithi023.stdout:2/685: getdents d5/da/db/d17/d73/d9e/da0 0 2024-02-28T16:24:14.510 INFO:tasks.workunit.client.0.smithi023.stdout:0/572: chown d6/db/d1a/l3f 40 1 2024-02-28T16:24:14.511 INFO:tasks.workunit.client.0.smithi023.stdout:2/686: fsync d5/da/d62/fb8 0 2024-02-28T16:24:14.512 INFO:tasks.workunit.client.0.smithi023.stdout:0/573: stat d6/db/d1a/d26 0 2024-02-28T16:24:14.512 INFO:tasks.workunit.client.0.smithi023.stdout:3/671: mknod d1/df/d2d/d45/d52/ce7 0 2024-02-28T16:24:14.513 INFO:tasks.workunit.client.0.smithi023.stdout:6/700: sync 2024-02-28T16:24:14.513 INFO:tasks.workunit.client.0.smithi023.stdout:1/654: sync 2024-02-28T16:24:14.514 INFO:tasks.workunit.client.0.smithi023.stdout:7/583: truncate de/d13/d1b/d6c/f75 167717 0 2024-02-28T16:24:14.514 INFO:tasks.workunit.client.0.smithi023.stdout:4/587: readlink lf 0 2024-02-28T16:24:14.516 INFO:tasks.workunit.client.0.smithi023.stdout:2/687: fdatasync d5/da/d1b/f85 0 2024-02-28T16:24:14.516 INFO:tasks.workunit.client.0.smithi023.stdout:9/626: sync 2024-02-28T16:24:14.517 INFO:tasks.workunit.client.0.smithi023.stdout:8/706: rename d0/d5/d1a/f2f to d0/d5/d1a/d44/fed 0 2024-02-28T16:24:14.519 INFO:tasks.workunit.client.0.smithi023.stdout:5/846: dread d1/d2a/d32/d58/d79/de5/f97 [0,4194304] 0 2024-02-28T16:24:14.521 INFO:tasks.workunit.client.0.smithi023.stdout:0/574: chown d6/db/d1a/d35/la5 15 1 2024-02-28T16:24:14.523 INFO:tasks.workunit.client.0.smithi023.stdout:1/655: mknod df/d11/d13/d1b/d2e/d5c/cdf 0 2024-02-28T16:24:14.523 INFO:tasks.workunit.client.0.smithi023.stdout:2/688: symlink d5/dbe/ld8 0 2024-02-28T16:24:14.523 INFO:tasks.workunit.client.0.smithi023.stdout:3/672: write d1/d74/de1/d9e/fd1 [627912,120446] 0 2024-02-28T16:24:14.525 INFO:tasks.workunit.client.0.smithi023.stdout:3/673: chown d1/d74/d46 4904 1 2024-02-28T16:24:14.528 INFO:tasks.workunit.client.0.smithi023.stdout:3/674: chown d1/df/d2d/d32/d3f 377685 1 2024-02-28T16:24:14.532 INFO:tasks.workunit.client.0.smithi023.stdout:0/575: rmdir d6/db 39 2024-02-28T16:24:14.533 INFO:tasks.workunit.client.0.smithi023.stdout:3/675: dread - d1/df/f8e zero size 2024-02-28T16:24:14.539 INFO:tasks.workunit.client.0.smithi023.stdout:8/707: symlink d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/lee 0 2024-02-28T16:24:14.546 INFO:tasks.workunit.client.0.smithi023.stdout:7/584: dwrite de/ff [4194304,4194304] 0 2024-02-28T16:24:14.548 INFO:tasks.workunit.client.0.smithi023.stdout:5/847: dwrite d1/d2a/d32/d58/d60/d82/ffd [0,4194304] 0 2024-02-28T16:24:14.549 INFO:tasks.workunit.client.0.smithi023.stdout:7/585: write de/d13/f8f [4792806,74915] 0 2024-02-28T16:24:14.551 INFO:tasks.workunit.client.0.smithi023.stdout:6/701: rename d1/d28/d1e/d2b/d76/f95 to d1/f100 0 2024-02-28T16:24:14.552 INFO:tasks.workunit.client.0.smithi023.stdout:6/702: chown d1/d3d 420 1 2024-02-28T16:24:14.552 INFO:tasks.workunit.client.0.smithi023.stdout:8/708: truncate d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/fbc 752570 0 2024-02-28T16:24:14.553 INFO:tasks.workunit.client.0.smithi023.stdout:4/588: truncate d13/d1d/f25 1244641 0 2024-02-28T16:24:14.559 INFO:tasks.workunit.client.0.smithi023.stdout:3/676: creat d1/d4a/fe8 x:0 0 0 2024-02-28T16:24:14.562 INFO:tasks.workunit.client.0.smithi023.stdout:9/627: creat d0/d7/de/d2a/daf/d2f/fd4 x:0 0 0 2024-02-28T16:24:14.562 INFO:tasks.workunit.client.0.smithi023.stdout:3/677: chown d1/df/d33/dc2/cd8 23223 1 2024-02-28T16:24:14.570 INFO:tasks.workunit.client.0.smithi023.stdout:2/689: mkdir d5/da/db/d17/d3c/d7f/dc6/dd9 0 2024-02-28T16:24:14.572 INFO:tasks.workunit.client.0.smithi023.stdout:6/703: unlink d1/d18/d26/da6/da9/ff0 0 2024-02-28T16:24:14.572 INFO:tasks.workunit.client.0.smithi023.stdout:2/690: chown d5/da/d1b/f36 257508677 1 2024-02-28T16:24:14.574 INFO:tasks.workunit.client.0.smithi023.stdout:0/576: creat d6/db/d1a/d26/d31/da8/fc7 x:0 0 0 2024-02-28T16:24:14.576 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:14 smithi153 ceph-mon[35341]: pgmap v38: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 111 MiB/s wr, 273 op/s 2024-02-28T16:24:14.580 INFO:tasks.workunit.client.0.smithi023.stdout:9/628: mkdir d0/d7/de/d2a/daf/d2f/d44/dd5 0 2024-02-28T16:24:14.580 INFO:tasks.workunit.client.0.smithi023.stdout:3/678: mkdir d1/d74/d46/de9 0 2024-02-28T16:24:14.582 INFO:tasks.workunit.client.0.smithi023.stdout:4/589: rmdir d13/d1d 39 2024-02-28T16:24:14.584 INFO:tasks.workunit.client.0.smithi023.stdout:1/656: write df/d11/d13/d1b/f39 [2363811,55004] 0 2024-02-28T16:24:14.586 INFO:tasks.workunit.client.0.smithi023.stdout:0/577: creat d6/db/d1a/d26/d31/da0/fc8 x:0 0 0 2024-02-28T16:24:14.588 INFO:tasks.workunit.client.0.smithi023.stdout:0/578: chown d6/db/d1a/d26/f4d 3473435 1 2024-02-28T16:24:14.589 INFO:tasks.workunit.client.0.smithi023.stdout:0/579: readlink d6/db/d1a/l3f 0 2024-02-28T16:24:14.593 INFO:tasks.workunit.client.0.smithi023.stdout:0/580: dread d6/fb0 [0,4194304] 0 2024-02-28T16:24:14.598 INFO:tasks.workunit.client.0.smithi023.stdout:3/679: rename d1/df/f30 to d1/d74/d94/fea 0 2024-02-28T16:24:14.599 INFO:tasks.workunit.client.0.smithi023.stdout:8/709: write d0/d5/d1b/f4d [2604602,46582] 0 2024-02-28T16:24:14.599 INFO:tasks.workunit.client.0.smithi023.stdout:7/586: creat de/fbe x:0 0 0 2024-02-28T16:24:14.601 INFO:tasks.workunit.client.0.smithi023.stdout:6/704: mkdir d1/d28/d1e/d2b/d44/d101 0 2024-02-28T16:24:14.601 INFO:tasks.workunit.client.0.smithi023.stdout:5/848: dread d1/d2a/d32/d6e/f85 [0,4194304] 0 2024-02-28T16:24:14.603 INFO:tasks.workunit.client.0.smithi023.stdout:8/710: stat d0/d5/d1b/d7f/fb3 0 2024-02-28T16:24:14.606 INFO:tasks.workunit.client.0.smithi023.stdout:4/590: creat d13/d1d/fbd x:0 0 0 2024-02-28T16:24:14.609 INFO:tasks.workunit.client.0.smithi023.stdout:3/680: creat d1/df/d33/dc2/feb x:0 0 0 2024-02-28T16:24:14.612 INFO:tasks.workunit.client.0.smithi023.stdout:2/691: dread d5/da/db/d17/f65 [0,4194304] 0 2024-02-28T16:24:14.619 INFO:tasks.workunit.client.0.smithi023.stdout:7/587: dread de/d13/f4d [0,4194304] 0 2024-02-28T16:24:14.620 INFO:tasks.workunit.client.0.smithi023.stdout:5/849: chown d1/d2a/d32/d58/d60/d88/leb 6 1 2024-02-28T16:24:14.620 INFO:tasks.workunit.client.0.smithi023.stdout:8/711: mknod d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/cef 0 2024-02-28T16:24:14.623 INFO:tasks.workunit.client.0.smithi023.stdout:5/850: fdatasync d1/d2a/d32/d37/d3a/d7f/d62/f6b 0 2024-02-28T16:24:14.625 INFO:tasks.workunit.client.0.smithi023.stdout:4/591: truncate d13/f17 3390470 0 2024-02-28T16:24:14.628 INFO:tasks.workunit.client.0.smithi023.stdout:7/588: mkdir de/d1c/d76/d7b/dbf 0 2024-02-28T16:24:14.628 INFO:tasks.workunit.client.0.smithi023.stdout:3/681: dwrite d1/df/d2d/d45/d52/d65/d89/fa2 [0,4194304] 0 2024-02-28T16:24:14.637 INFO:tasks.workunit.client.0.smithi023.stdout:0/581: link d6/d98/laf d6/db/d1a/d26/d9c/lc9 0 2024-02-28T16:24:14.638 INFO:tasks.workunit.client.0.smithi023.stdout:8/712: write d0/d5/d1a/d2d/d67/d71/db4/f46 [4431584,100495] 0 2024-02-28T16:24:14.639 INFO:tasks.workunit.client.0.smithi023.stdout:5/851: fsync d1/d2a/d32/d37/d4e/db5/dc6/ff0 0 2024-02-28T16:24:14.648 INFO:tasks.workunit.client.0.smithi023.stdout:6/705: dwrite d1/d18/fa5 [0,4194304] 0 2024-02-28T16:24:14.652 INFO:tasks.workunit.client.0.smithi023.stdout:6/706: readlink d1/d4f/l59 0 2024-02-28T16:24:14.652 INFO:tasks.workunit.client.0.smithi023.stdout:2/692: write d5/f7a [140698,86297] 0 2024-02-28T16:24:14.653 INFO:tasks.workunit.client.0.smithi023.stdout:2/693: fsync d5/da/d45/d6a/faa 0 2024-02-28T16:24:14.661 INFO:tasks.workunit.client.0.smithi023.stdout:2/694: truncate d5/da/db/d17/d73/d9e/da0/fc7 977009 0 2024-02-28T16:24:14.661 INFO:tasks.workunit.client.0.smithi023.stdout:4/592: dwrite d13/d2b/f5a [0,4194304] 0 2024-02-28T16:24:14.664 INFO:tasks.workunit.client.0.smithi023.stdout:4/593: chown d13/d1e/d9c 0 1 2024-02-28T16:24:14.664 INFO:tasks.workunit.client.0.smithi023.stdout:4/594: chown d13/d1e/c37 34538 1 2024-02-28T16:24:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:14 smithi023 ceph-mon[29137]: pgmap v38: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 111 MiB/s wr, 273 op/s 2024-02-28T16:24:14.684 INFO:tasks.workunit.client.0.smithi023.stdout:3/682: creat d1/d74/de1/db5/db9/fec x:0 0 0 2024-02-28T16:24:14.687 INFO:tasks.workunit.client.0.smithi023.stdout:8/713: creat d0/d5/d1a/d2d/d67/d71/db4/d39/ff0 x:0 0 0 2024-02-28T16:24:14.688 INFO:tasks.workunit.client.0.smithi023.stdout:5/852: creat d1/d2a/d32/d37/d3a/d7f/f116 x:0 0 0 2024-02-28T16:24:14.689 INFO:tasks.workunit.client.0.smithi023.stdout:8/714: dread - d0/d5/d1a/d63/fcf zero size 2024-02-28T16:24:14.691 INFO:tasks.workunit.client.0.smithi023.stdout:3/683: dread d1/df/d33/fbc [0,4194304] 0 2024-02-28T16:24:14.698 INFO:tasks.workunit.client.0.smithi023.stdout:7/589: dwrite de/d60/f5e [0,4194304] 0 2024-02-28T16:24:14.700 INFO:tasks.workunit.client.0.smithi023.stdout:5/853: symlink d1/d2a/d32/d36/l117 0 2024-02-28T16:24:14.700 INFO:tasks.workunit.client.0.smithi023.stdout:2/695: dread d5/da/db/f49 [0,4194304] 0 2024-02-28T16:24:14.702 INFO:tasks.workunit.client.0.smithi023.stdout:2/696: stat d5/da/d1b/d3f 0 2024-02-28T16:24:14.706 INFO:tasks.workunit.client.0.smithi023.stdout:8/715: chown d0/d5/d1a/d44/fed 4226180 1 2024-02-28T16:24:14.708 INFO:tasks.workunit.client.0.smithi023.stdout:3/684: rename d1/df/f16 to d1/df/d2d/d45/d78/fed 0 2024-02-28T16:24:14.711 INFO:tasks.workunit.client.0.smithi023.stdout:3/685: chown d1/df/d2d/d45/d52/f5b 1 1 2024-02-28T16:24:14.713 INFO:tasks.workunit.client.0.smithi023.stdout:5/854: mkdir d1/d2a/d32/d58/d79/de5/d118 0 2024-02-28T16:24:14.715 INFO:tasks.workunit.client.0.smithi023.stdout:2/697: mknod d5/da/db/d17/d39/d56/cda 0 2024-02-28T16:24:14.716 INFO:tasks.workunit.client.0.smithi023.stdout:5/855: dread - d1/d2a/d32/d37/d3a/d7f/f116 zero size 2024-02-28T16:24:14.717 INFO:tasks.workunit.client.0.smithi023.stdout:6/707: getdents d1/d28/d1e/d80/dc2 0 2024-02-28T16:24:14.720 INFO:tasks.workunit.client.0.smithi023.stdout:5/856: write d1/d2a/d32/d37/d3a/f7e [2495837,34849] 0 2024-02-28T16:24:14.723 INFO:tasks.workunit.client.0.smithi023.stdout:2/698: dread d5/da/db/d17/d73/dd0/f88 [0,4194304] 0 2024-02-28T16:24:14.724 INFO:tasks.workunit.client.0.smithi023.stdout:7/590: symlink de/lc0 0 2024-02-28T16:24:14.730 INFO:tasks.workunit.client.0.smithi023.stdout:6/708: symlink d1/d28/d1e/d80/dc2/l102 0 2024-02-28T16:24:14.730 INFO:tasks.workunit.client.0.smithi023.stdout:0/582: dwrite d6/db/d3b/f58 [0,4194304] 0 2024-02-28T16:24:14.731 INFO:tasks.workunit.client.0.smithi023.stdout:2/699: dread d5/da/db/f49 [0,4194304] 0 2024-02-28T16:24:14.743 INFO:tasks.workunit.client.0.smithi023.stdout:5/857: dwrite d1/d2a/d32/d36/f66 [0,4194304] 0 2024-02-28T16:24:14.747 INFO:tasks.workunit.client.0.smithi023.stdout:6/709: symlink d1/d3d/d7d/l103 0 2024-02-28T16:24:14.749 INFO:tasks.workunit.client.0.smithi023.stdout:3/686: write d1/df/d3d/f53 [537846,41088] 0 2024-02-28T16:24:14.753 INFO:tasks.workunit.client.0.smithi023.stdout:5/858: chown d1/d2a/d32/d37/d3a/d7f/d62/d7b/f99 135 1 2024-02-28T16:24:14.755 INFO:tasks.workunit.client.0.smithi023.stdout:2/700: dread d5/f40 [0,4194304] 0 2024-02-28T16:24:14.755 INFO:tasks.workunit.client.0.smithi023.stdout:7/591: rename de/d1c/d76/f93 to de/d13/fc1 0 2024-02-28T16:24:14.757 INFO:tasks.workunit.client.0.smithi023.stdout:2/701: stat d5/fd2 0 2024-02-28T16:24:14.757 INFO:tasks.workunit.client.0.smithi023.stdout:4/595: dread d13/d2b/d2c/f30 [0,4194304] 0 2024-02-28T16:24:14.762 INFO:tasks.workunit.client.0.smithi023.stdout:6/710: mknod d1/d28/d1e/d2b/d6d/d7b/c104 0 2024-02-28T16:24:14.767 INFO:tasks.workunit.client.0.smithi023.stdout:4/596: truncate d13/d1e/d9a/d67/f7d 1186395 0 2024-02-28T16:24:14.772 INFO:tasks.workunit.client.0.smithi023.stdout:3/687: creat d1/df/d2d/fee x:0 0 0 2024-02-28T16:24:14.773 INFO:tasks.workunit.client.0.smithi023.stdout:2/702: creat d5/da/db/d17/d3c/d7f/dc6/dd9/fdb x:0 0 0 2024-02-28T16:24:14.775 INFO:tasks.workunit.client.0.smithi023.stdout:6/711: creat d1/d28/d1e/d2b/d44/d101/f105 x:0 0 0 2024-02-28T16:24:14.777 INFO:tasks.workunit.client.0.smithi023.stdout:0/583: dwrite d6/db/d1a/d1b/f5a [0,4194304] 0 2024-02-28T16:24:14.781 INFO:tasks.workunit.client.0.smithi023.stdout:3/688: unlink d1/d74/d46/c9c 0 2024-02-28T16:24:14.784 INFO:tasks.workunit.client.0.smithi023.stdout:7/592: dwrite de/d13/d1b/f49 [0,4194304] 0 2024-02-28T16:24:14.790 INFO:tasks.workunit.client.0.smithi023.stdout:2/703: creat d5/dd1/fdc x:0 0 0 2024-02-28T16:24:14.794 INFO:tasks.workunit.client.0.smithi023.stdout:4/597: dread d13/fae [0,4194304] 0 2024-02-28T16:24:14.795 INFO:tasks.workunit.client.0.smithi023.stdout:5/859: dread d1/d2a/d32/d37/d3a/d7f/f24 [0,4194304] 0 2024-02-28T16:24:14.800 INFO:tasks.workunit.client.0.smithi023.stdout:0/584: fdatasync d6/db/dab/d82/d72/d79/fbb 0 2024-02-28T16:24:14.801 INFO:tasks.workunit.client.0.smithi023.stdout:5/860: truncate d1/d2a/d32/ddc/f100 435060 0 2024-02-28T16:24:14.802 INFO:tasks.workunit.client.0.smithi023.stdout:2/704: chown d5/l59 500128351 1 2024-02-28T16:24:14.805 INFO:tasks.workunit.client.0.smithi023.stdout:4/598: mknod d13/d1e/d9a/d55/cbe 0 2024-02-28T16:24:14.807 INFO:tasks.workunit.client.0.smithi023.stdout:4/599: chown d13/d1e/d9a/d55/f60 17631495 1 2024-02-28T16:24:14.811 INFO:tasks.workunit.client.0.smithi023.stdout:3/689: write d1/df/d2d/d45/d6f/fcb [128973,65706] 0 2024-02-28T16:24:14.814 INFO:tasks.workunit.client.0.smithi023.stdout:5/861: creat d1/d2a/d32/d58/d73/f119 x:0 0 0 2024-02-28T16:24:14.815 INFO:tasks.workunit.client.0.smithi023.stdout:2/705: read d5/f7d [280680,35464] 0 2024-02-28T16:24:14.816 INFO:tasks.workunit.client.0.smithi023.stdout:7/593: rmdir de/d1c/d76/d7b/dbf 0 2024-02-28T16:24:14.820 INFO:tasks.workunit.client.0.smithi023.stdout:6/712: dwrite d1/d28/d1e/d2b/d6d/d7b/fee [0,4194304] 0 2024-02-28T16:24:14.824 INFO:tasks.workunit.client.0.smithi023.stdout:7/594: write f8 [2714996,15190] 0 2024-02-28T16:24:14.825 INFO:tasks.workunit.client.0.smithi023.stdout:5/862: mknod d1/d2a/d32/d37/dcd/c11a 0 2024-02-28T16:24:14.827 INFO:tasks.workunit.client.0.smithi023.stdout:5/863: readlink d1/d2a/d32/d36/l4a 0 2024-02-28T16:24:14.833 INFO:tasks.workunit.client.0.smithi023.stdout:7/595: write de/d13/f8f [2701039,98631] 0 2024-02-28T16:24:14.840 INFO:tasks.workunit.client.0.smithi023.stdout:6/713: fsync d1/d28/d1e/d2b/d44/d86/fdc 0 2024-02-28T16:24:14.843 INFO:tasks.workunit.client.0.smithi023.stdout:2/706: dread d5/da/f54 [0,4194304] 0 2024-02-28T16:24:14.843 INFO:tasks.workunit.client.0.smithi023.stdout:7/596: creat de/d13/d1b/d6c/db6/fc2 x:0 0 0 2024-02-28T16:24:14.845 INFO:tasks.workunit.client.0.smithi023.stdout:4/600: dwrite d13/d2b/f5a [0,4194304] 0 2024-02-28T16:24:14.847 INFO:tasks.workunit.client.0.smithi023.stdout:6/714: dread - d1/d28/d1e/d2b/d76/d9e/fce zero size 2024-02-28T16:24:14.848 INFO:tasks.workunit.client.0.smithi023.stdout:7/597: chown de/d13/d1b/d3f/f9a 0 1 2024-02-28T16:24:14.851 INFO:tasks.workunit.client.0.smithi023.stdout:6/715: write d1/d28/f62 [8421054,18674] 0 2024-02-28T16:24:14.855 INFO:tasks.workunit.client.0.smithi023.stdout:4/601: dread - d13/d1e/d9c/faa zero size 2024-02-28T16:24:14.856 INFO:tasks.workunit.client.0.smithi023.stdout:2/707: rmdir d5/da/db/d17/d39/dd6 0 2024-02-28T16:24:14.859 INFO:tasks.workunit.client.0.smithi023.stdout:4/602: read - d13/d2b/d2c/d31/f48 zero size 2024-02-28T16:24:14.862 INFO:tasks.workunit.client.0.smithi023.stdout:7/598: truncate de/d13/d1b/d6c/f97 505477 0 2024-02-28T16:24:14.862 INFO:tasks.workunit.client.0.smithi023.stdout:2/708: creat d5/da/db/d17/d73/fdd x:0 0 0 2024-02-28T16:24:14.865 INFO:tasks.workunit.client.0.smithi023.stdout:6/716: getdents d1/d18/d26/d3a 0 2024-02-28T16:24:14.870 INFO:tasks.workunit.client.0.smithi023.stdout:0/585: dread d6/db/f71 [0,4194304] 0 2024-02-28T16:24:14.875 INFO:tasks.workunit.client.0.smithi023.stdout:2/709: creat d5/da/fde x:0 0 0 2024-02-28T16:24:14.878 INFO:tasks.workunit.client.0.smithi023.stdout:4/603: dread d13/d1d/d2d/f36 [0,4194304] 0 2024-02-28T16:24:14.879 INFO:tasks.workunit.client.0.smithi023.stdout:3/690: dread d1/d74/de1/fce [0,4194304] 0 2024-02-28T16:24:14.879 INFO:tasks.workunit.client.0.smithi023.stdout:6/717: dread d1/d18/d26/f58 [0,4194304] 0 2024-02-28T16:24:14.881 INFO:tasks.workunit.client.0.smithi023.stdout:2/710: creat d5/da/d45/fdf x:0 0 0 2024-02-28T16:24:14.881 INFO:tasks.workunit.client.0.smithi023.stdout:4/604: write d13/d2b/f5a [4016370,39059] 0 2024-02-28T16:24:14.882 INFO:tasks.workunit.client.0.smithi023.stdout:5/864: dread d1/d2a/d32/d37/d3a/d7f/f25 [0,4194304] 0 2024-02-28T16:24:14.892 INFO:tasks.workunit.client.0.smithi023.stdout:6/718: write d1/d28/d1e/d2b/fd1 [2013368,25133] 0 2024-02-28T16:24:14.894 INFO:tasks.workunit.client.0.smithi023.stdout:2/711: read - d5/da/db/d17/d3c/f46 zero size 2024-02-28T16:24:14.894 INFO:tasks.workunit.client.0.smithi023.stdout:5/865: mknod d1/d2a/d32/d36/c11b 0 2024-02-28T16:24:14.896 INFO:tasks.workunit.client.0.smithi023.stdout:3/691: mknod d1/d74/de1/ddd/cef 0 2024-02-28T16:24:14.898 INFO:tasks.workunit.client.0.smithi023.stdout:6/719: fdatasync d1/d28/d1e/d52/f5b 0 2024-02-28T16:24:14.900 INFO:tasks.workunit.client.0.smithi023.stdout:0/586: write d6/d4c/d6a/f88 [886277,30299] 0 2024-02-28T16:24:14.902 INFO:tasks.workunit.client.0.smithi023.stdout:7/599: dwrite de/d1c/d76/f86 [0,4194304] 0 2024-02-28T16:24:14.903 INFO:tasks.workunit.client.0.smithi023.stdout:2/712: fsync d5/da/db/d17/d39/f80 0 2024-02-28T16:24:14.905 INFO:tasks.workunit.client.0.smithi023.stdout:7/600: read de/d60/f5e [3911979,106009] 0 2024-02-28T16:24:14.906 INFO:tasks.workunit.client.0.smithi023.stdout:3/692: truncate d1/df/fa1 14357 0 2024-02-28T16:24:14.907 INFO:tasks.workunit.client.0.smithi023.stdout:0/587: mkdir d6/db/dab/d82/d72/dca 0 2024-02-28T16:24:14.914 INFO:tasks.workunit.client.0.smithi023.stdout:5/866: rename d1/f7c to d1/f11c 0 2024-02-28T16:24:14.915 INFO:tasks.workunit.client.0.smithi023.stdout:3/693: symlink d1/df/d3d/lf0 0 2024-02-28T16:24:14.918 INFO:tasks.workunit.client.0.smithi023.stdout:4/605: write d13/d1e/d9a/d67/f7d [371024,94355] 0 2024-02-28T16:24:14.920 INFO:tasks.workunit.client.0.smithi023.stdout:0/588: write d6/db/d3d/f55 [374161,35391] 0 2024-02-28T16:24:14.923 INFO:tasks.workunit.client.0.smithi023.stdout:2/713: symlink d5/da/db/d17/d3c/le0 0 2024-02-28T16:24:14.926 INFO:tasks.workunit.client.0.smithi023.stdout:6/720: dwrite d1/d28/d1e/d52/f5b [0,4194304] 0 2024-02-28T16:24:14.928 INFO:tasks.workunit.client.0.smithi023.stdout:2/714: readlink d5/da/db/d17/d73/dd0/l25 0 2024-02-28T16:24:14.930 INFO:tasks.workunit.client.0.smithi023.stdout:2/715: chown d5/da/d62/f82 761130997 1 2024-02-28T16:24:14.937 INFO:tasks.workunit.client.0.smithi023.stdout:4/606: symlink d13/d2b/lbf 0 2024-02-28T16:24:14.943 INFO:tasks.workunit.client.0.smithi023.stdout:0/589: write d6/db/d5d/f93 [697658,66484] 0 2024-02-28T16:24:14.948 INFO:tasks.workunit.client.0.smithi023.stdout:5/867: write d1/f19 [1654154,121301] 0 2024-02-28T16:24:14.948 INFO:tasks.workunit.client.0.smithi023.stdout:4/607: mkdir d13/d1e/d9a/dc0 0 2024-02-28T16:24:14.951 INFO:tasks.workunit.client.0.smithi023.stdout:3/694: rename d1/df/d3d/fb8 to d1/d74/de1/ff1 0 2024-02-28T16:24:14.954 INFO:tasks.workunit.client.0.smithi023.stdout:4/608: write d13/d1e/d9c/faa [215368,52067] 0 2024-02-28T16:24:14.955 INFO:tasks.workunit.client.0.smithi023.stdout:5/868: creat d1/d2a/d32/de0/f11d x:0 0 0 2024-02-28T16:24:14.963 INFO:tasks.workunit.client.0.smithi023.stdout:0/590: rename d6/db/dab/c53 to d6/db/dab/d42/ccb 0 2024-02-28T16:24:14.965 INFO:tasks.workunit.client.0.smithi023.stdout:6/721: dwrite d1/d28/d1e/d2b/d6d/d7b/fcc [0,4194304] 0 2024-02-28T16:24:14.965 INFO:tasks.workunit.client.0.smithi023.stdout:5/869: fdatasync d1/d2a/d32/d37/d3a/d7f/d62/d7b/f99 0 2024-02-28T16:24:14.971 INFO:tasks.workunit.client.0.smithi023.stdout:2/716: dwrite d5/f98 [0,4194304] 0 2024-02-28T16:24:14.974 INFO:tasks.workunit.client.0.smithi023.stdout:6/722: write d1/f2f [5612729,43205] 0 2024-02-28T16:24:14.976 INFO:tasks.workunit.client.0.smithi023.stdout:4/609: rename d13/d1d/d2d/da9/cac to d13/d1e/d9a/cc1 0 2024-02-28T16:24:14.976 INFO:tasks.workunit.client.0.smithi023.stdout:2/717: write d5/da/f38 [1184725,10974] 0 2024-02-28T16:24:14.976 INFO:tasks.workunit.client.0.smithi023.stdout:5/870: write d1/d2a/d32/d37/d3a/d7f/d62/f6b [1179268,128405] 0 2024-02-28T16:24:14.983 INFO:tasks.workunit.client.0.smithi023.stdout:0/591: creat d6/db/d1a/d26/d31/fcc x:0 0 0 2024-02-28T16:24:14.986 INFO:tasks.workunit.client.0.smithi023.stdout:2/718: readlink d5/da/db/d17/l78 0 2024-02-28T16:24:14.986 INFO:tasks.workunit.client.0.smithi023.stdout:4/610: chown d13/d1d/d2d/c38 3663433 1 2024-02-28T16:24:14.987 INFO:tasks.workunit.client.0.smithi023.stdout:3/695: dwrite d1/d74/de1/d9e/fd1 [0,4194304] 0 2024-02-28T16:24:15.000 INFO:tasks.workunit.client.0.smithi023.stdout:6/723: mkdir d1/d28/d1e/d2b/d44/da4/d106 0 2024-02-28T16:24:15.005 INFO:tasks.workunit.client.0.smithi023.stdout:6/724: dread - d1/d28/d1e/d2b/d44/d86/fdc zero size 2024-02-28T16:24:15.005 INFO:tasks.workunit.client.0.smithi023.stdout:0/592: dwrite d6/db/d1a/f80 [0,4194304] 0 2024-02-28T16:24:15.011 INFO:tasks.workunit.client.0.smithi023.stdout:5/871: dwrite d1/d2a/d32/d36/f66 [0,4194304] 0 2024-02-28T16:24:15.015 INFO:tasks.workunit.client.0.smithi023.stdout:5/872: write d1/d2a/d32/d58/d79/fd7 [730442,37919] 0 2024-02-28T16:24:15.025 INFO:tasks.workunit.client.0.smithi023.stdout:3/696: rename d1/df/d2d/d45/d6f/f99 to d1/df/d2d/d9d/ff2 0 2024-02-28T16:24:15.025 INFO:tasks.workunit.client.0.smithi023.stdout:6/725: rmdir d1/d28/d1e/d52 39 2024-02-28T16:24:15.027 INFO:tasks.workunit.client.0.smithi023.stdout:0/593: mkdir d6/db/d1a/d59/dcd 0 2024-02-28T16:24:15.032 INFO:tasks.workunit.client.0.smithi023.stdout:6/726: chown d1/d28/d1e/d2b/d44/d86/fdc 30200356 1 2024-02-28T16:24:15.035 INFO:tasks.workunit.client.0.smithi023.stdout:2/719: dwrite d5/da/db/d17/d73/dd0/f88 [0,4194304] 0 2024-02-28T16:24:15.036 INFO:tasks.workunit.client.0.smithi023.stdout:3/697: symlink d1/df/d2d/d32/d3f/lf3 0 2024-02-28T16:24:15.038 INFO:tasks.workunit.client.0.smithi023.stdout:5/873: dwrite d1/d2a/d32/ddc/de3/f107 [0,4194304] 0 2024-02-28T16:24:15.039 INFO:tasks.workunit.client.0.smithi023.stdout:6/727: read d1/d28/d1e/d2b/d6d/d7b/fee [1104639,114256] 0 2024-02-28T16:24:15.050 INFO:tasks.workunit.client.0.smithi023.stdout:4/611: write d13/d2b/d2c/d31/d6e/f7b [702159,75760] 0 2024-02-28T16:24:15.050 INFO:tasks.workunit.client.0.smithi023.stdout:2/720: creat d5/da/db/d17/d3c/d7f/fe1 x:0 0 0 2024-02-28T16:24:15.052 INFO:tasks.workunit.client.0.smithi023.stdout:3/698: mknod d1/df/d2d/d45/d52/d65/cf4 0 2024-02-28T16:24:15.055 INFO:tasks.workunit.client.0.smithi023.stdout:2/721: read d5/da/db/d17/d73/dd0/f88 [1466706,48661] 0 2024-02-28T16:24:15.062 INFO:tasks.workunit.client.0.smithi023.stdout:0/594: dread f4 [4194304,4194304] 0 2024-02-28T16:24:15.065 INFO:tasks.workunit.client.0.smithi023.stdout:5/874: dwrite d1/d2a/d32/d58/d79/de5/fc7 [0,4194304] 0 2024-02-28T16:24:15.068 INFO:tasks.workunit.client.0.smithi023.stdout:6/728: dread d1/d28/d1e/dae/fd3 [0,4194304] 0 2024-02-28T16:24:15.075 INFO:tasks.workunit.client.0.smithi023.stdout:2/722: creat d5/da/d45/d6a/fe2 x:0 0 0 2024-02-28T16:24:15.077 INFO:tasks.workunit.client.0.smithi023.stdout:4/612: symlink d13/d1e/d9a/lc2 0 2024-02-28T16:24:15.078 INFO:tasks.workunit.client.0.smithi023.stdout:4/613: write f5 [8191101,34965] 0 2024-02-28T16:24:15.082 INFO:tasks.workunit.client.0.smithi023.stdout:9/629: sync 2024-02-28T16:24:15.082 INFO:tasks.workunit.client.0.smithi023.stdout:1/657: sync 2024-02-28T16:24:15.082 INFO:tasks.workunit.client.0.smithi023.stdout:8/716: sync 2024-02-28T16:24:15.082 INFO:tasks.workunit.client.0.smithi023.stdout:7/601: sync 2024-02-28T16:24:15.085 INFO:tasks.workunit.client.0.smithi023.stdout:5/875: read d1/d2a/d32/d37/d3a/d7f/d62/f76 [149170,116768] 0 2024-02-28T16:24:15.085 INFO:tasks.workunit.client.0.smithi023.stdout:3/699: truncate d1/d74/d46/f64 3639286 0 2024-02-28T16:24:15.090 INFO:tasks.workunit.client.0.smithi023.stdout:4/614: creat d13/d2b/d2c/d31/d8d/db3/fc3 x:0 0 0 2024-02-28T16:24:15.095 INFO:tasks.workunit.client.0.smithi023.stdout:2/723: dwrite d5/f76 [0,4194304] 0 2024-02-28T16:24:15.095 INFO:tasks.workunit.client.0.smithi023.stdout:7/602: creat de/d1c/d76/fc3 x:0 0 0 2024-02-28T16:24:15.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/595: write d6/db/d1a/d35/fa7 [4842236,9304] 0 2024-02-28T16:24:15.101 INFO:tasks.workunit.client.0.smithi023.stdout:3/700: readlink d1/df/d3d/lf0 0 2024-02-28T16:24:15.104 INFO:tasks.workunit.client.0.smithi023.stdout:5/876: creat d1/d2a/d32/d37/dcd/f11e x:0 0 0 2024-02-28T16:24:15.109 INFO:tasks.workunit.client.0.smithi023.stdout:5/877: chown d1/d2a/l2c 137532 1 2024-02-28T16:24:15.114 INFO:tasks.workunit.client.0.smithi023.stdout:6/729: dwrite d1/d18/f90 [0,4194304] 0 2024-02-28T16:24:15.114 INFO:tasks.workunit.client.0.smithi023.stdout:4/615: read d13/d2b/f5e [9473567,50708] 0 2024-02-28T16:24:15.121 INFO:tasks.workunit.client.0.smithi023.stdout:9/630: mknod d0/d7/db/d18/d23/d28/d9c/dc4/cd6 0 2024-02-28T16:24:15.125 INFO:tasks.workunit.client.0.smithi023.stdout:3/701: mkdir d1/df/d33/d38/d6c/df5 0 2024-02-28T16:24:15.126 INFO:tasks.workunit.client.0.smithi023.stdout:7/603: dread de/d13/d1b/d3d/faf [0,4194304] 0 2024-02-28T16:24:15.130 INFO:tasks.workunit.client.0.smithi023.stdout:8/717: dread d0/d5/d1a/f4b [0,4194304] 0 2024-02-28T16:24:15.130 INFO:tasks.workunit.client.0.smithi023.stdout:0/596: rename d6/db/dab/d82/d72/dca to d6/db/d1a/d35/d9d/dce 0 2024-02-28T16:24:15.130 INFO:tasks.workunit.client.0.smithi023.stdout:7/604: write de/d13/d1b/d3d/d53/f90 [2072437,106178] 0 2024-02-28T16:24:15.136 INFO:tasks.workunit.client.0.smithi023.stdout:1/658: dread df/d11/d13/d1b/d30/f43 [0,4194304] 0 2024-02-28T16:24:15.138 INFO:tasks.workunit.client.0.smithi023.stdout:5/878: unlink d1/d2a/d32/d37/d3a/d7f/d62/f76 0 2024-02-28T16:24:15.141 INFO:tasks.workunit.client.0.smithi023.stdout:5/879: write d1/d2a/d32/d37/dcd/f11e [498117,4804] 0 2024-02-28T16:24:15.143 INFO:tasks.workunit.client.0.smithi023.stdout:4/616: unlink d13/d1d/d2d/l61 0 2024-02-28T16:24:15.145 INFO:tasks.workunit.client.0.smithi023.stdout:5/880: read d1/d2a/d32/d37/d3a/fab [2237148,36278] 0 2024-02-28T16:24:15.153 INFO:tasks.workunit.client.0.smithi023.stdout:0/597: rmdir d6 39 2024-02-28T16:24:15.156 INFO:tasks.workunit.client.0.smithi023.stdout:7/605: mknod de/d9b/cc4 0 2024-02-28T16:24:15.158 INFO:tasks.workunit.client.0.smithi023.stdout:2/724: link d5/da/f55 d5/da/db/d17/d73/d9e/da0/fe3 0 2024-02-28T16:24:15.168 INFO:tasks.workunit.client.0.smithi023.stdout:9/631: mknod d0/cd7 0 2024-02-28T16:24:15.172 INFO:tasks.workunit.client.0.smithi023.stdout:5/881: chown d1/ca 0 1 2024-02-28T16:24:15.192 INFO:tasks.workunit.client.0.smithi023.stdout:7/606: dwrite de/d1c/d76/d7b/dab/fbd [0,4194304] 0 2024-02-28T16:24:15.192 INFO:tasks.workunit.client.0.smithi023.stdout:0/598: stat d6/db/d1a/d26/d31/da0/fb3 0 2024-02-28T16:24:15.193 INFO:tasks.workunit.client.0.smithi023.stdout:5/882: readlink d1/d2a/d32/d37/dcd/ld9 0 2024-02-28T16:24:15.194 INFO:tasks.workunit.client.0.smithi023.stdout:7/607: fdatasync de/d1c/d76/d7b/f92 0 2024-02-28T16:24:15.195 INFO:tasks.workunit.client.0.smithi023.stdout:5/883: write d1/d2a/d32/d36/f74 [136660,78701] 0 2024-02-28T16:24:15.207 INFO:tasks.workunit.client.0.smithi023.stdout:6/730: creat d1/d18/f107 x:0 0 0 2024-02-28T16:24:15.208 INFO:tasks.workunit.client.0.smithi023.stdout:6/731: fsync d1/d18/d26/d3a/f4a 0 2024-02-28T16:24:15.212 INFO:tasks.workunit.client.0.smithi023.stdout:3/702: link d1/df/d2d/d45/d52/ce7 d1/df/d2d/d45/cf6 0 2024-02-28T16:24:15.213 INFO:tasks.workunit.client.0.smithi023.stdout:9/632: creat d0/d7/db/d18/d23/fd8 x:0 0 0 2024-02-28T16:24:15.216 INFO:tasks.workunit.client.0.smithi023.stdout:9/633: chown d0/d7/de/d2a/daf/d2f/d44/d95 18 1 2024-02-28T16:24:15.217 INFO:tasks.workunit.client.0.smithi023.stdout:9/634: chown d0/d7/db/d18/d23 97 1 2024-02-28T16:24:15.219 INFO:tasks.workunit.client.0.smithi023.stdout:1/659: dwrite df/d11/d13/d1b/d30/f4b [0,4194304] 0 2024-02-28T16:24:15.219 INFO:tasks.workunit.client.0.smithi023.stdout:4/617: rename d13/d1e/d9a to d13/d2b/d2c/d31/dc4 0 2024-02-28T16:24:15.221 INFO:tasks.workunit.client.0.smithi023.stdout:8/718: getdents d0/d5/d1a/d2d 0 2024-02-28T16:24:15.225 INFO:tasks.workunit.client.0.smithi023.stdout:6/732: truncate d1/d28/d1e/d52/fc5 637667 0 2024-02-28T16:24:15.227 INFO:tasks.workunit.client.0.smithi023.stdout:5/884: rename d1/d2a/d32/d37/dcd to d1/d2a/d32/d6e/d11f 0 2024-02-28T16:24:15.230 INFO:tasks.workunit.client.0.smithi023.stdout:0/599: creat d6/db/d1a/d26/d31/fcf x:0 0 0 2024-02-28T16:24:15.233 INFO:tasks.workunit.client.0.smithi023.stdout:0/600: dread - d6/db/d1a/d26/d31/f90 zero size 2024-02-28T16:24:15.237 INFO:tasks.workunit.client.0.smithi023.stdout:3/703: rename d1/df/d2d/d9d to d1/df/d33/d38/d6c/df5/df7 0 2024-02-28T16:24:15.239 INFO:tasks.workunit.client.0.smithi023.stdout:3/704: readlink d1/d74/de1/lb3 0 2024-02-28T16:24:15.240 INFO:tasks.workunit.client.0.smithi023.stdout:9/635: mkdir d0/d7/de/d2a/daf/d2f/db0/dd9 0 2024-02-28T16:24:15.240 INFO:tasks.workunit.client.0.smithi023.stdout:4/618: dwrite d13/d1d/d58/f68 [0,4194304] 0 2024-02-28T16:24:15.243 INFO:tasks.workunit.client.0.smithi023.stdout:8/719: mkdir d0/d5/d1a/df1 0 2024-02-28T16:24:15.243 INFO:tasks.workunit.client.0.smithi023.stdout:4/619: write d13/d1d/d85/fb1 [186260,7395] 0 2024-02-28T16:24:15.244 INFO:tasks.workunit.client.0.smithi023.stdout:9/636: fdatasync d0/d7/db/d18/d23/d28/d32/d3c/f83 0 2024-02-28T16:24:15.249 INFO:tasks.workunit.client.0.smithi023.stdout:1/660: mknod df/d11/d13/d1b/d30/d57/d5a/d68/ddd/ce0 0 2024-02-28T16:24:15.250 INFO:tasks.workunit.client.0.smithi023.stdout:0/601: creat d6/db/d3d/fd0 x:0 0 0 2024-02-28T16:24:15.253 INFO:tasks.workunit.client.0.smithi023.stdout:6/733: link d1/d18/d26/da6/da9/ce1 d1/d28/d1e/d2b/d6d/d7b/de5/c108 0 2024-02-28T16:24:15.256 INFO:tasks.workunit.client.0.smithi023.stdout:8/720: rename d0/d5/d1a/d2d/d67/daf to d0/d5/d1a/d63/d90/dac/df2 0 2024-02-28T16:24:15.263 INFO:tasks.workunit.client.0.smithi023.stdout:6/734: mkdir d1/d28/d1e/d80/d109 0 2024-02-28T16:24:15.264 INFO:tasks.workunit.client.0.smithi023.stdout:5/885: dread d1/d2a/d32/d37/d3a/d7f/d62/d68/f8c [0,4194304] 0 2024-02-28T16:24:15.265 INFO:tasks.workunit.client.0.smithi023.stdout:0/602: rmdir d6/db/d1a/d26/d31/da0/da1 0 2024-02-28T16:24:15.265 INFO:tasks.workunit.client.0.smithi023.stdout:3/705: read d1/f41 [250739,30474] 0 2024-02-28T16:24:15.269 INFO:tasks.workunit.client.0.smithi023.stdout:6/735: dread d1/d18/d26/d3a/f4a [0,4194304] 0 2024-02-28T16:24:15.269 INFO:tasks.workunit.client.0.smithi023.stdout:9/637: link d0/d7/de/d2a/daf/l90 d0/d7/db/d18/d23/d28/lda 0 2024-02-28T16:24:15.269 INFO:tasks.workunit.client.0.smithi023.stdout:3/706: write d1/df/d33/dc2/dcc/fe5 [92914,693] 0 2024-02-28T16:24:15.271 INFO:tasks.workunit.client.0.smithi023.stdout:8/721: creat d0/d5/ddc/de2/ff3 x:0 0 0 2024-02-28T16:24:15.276 INFO:tasks.workunit.client.0.smithi023.stdout:5/886: readlink d1/d2a/d32/d37/d3a/d7f/d62/d68/l9b 0 2024-02-28T16:24:15.279 INFO:tasks.workunit.client.0.smithi023.stdout:5/887: stat d1/d2a/d32/d58/d79/f91 0 2024-02-28T16:24:15.285 INFO:tasks.workunit.client.0.smithi023.stdout:4/620: dread d13/d2b/d2c/f2f [4194304,4194304] 0 2024-02-28T16:24:15.286 INFO:tasks.workunit.client.0.smithi023.stdout:9/638: creat d0/d7/de/d2a/daf/d2f/d4d/fdb x:0 0 0 2024-02-28T16:24:15.288 INFO:tasks.workunit.client.0.smithi023.stdout:3/707: fdatasync d1/df/d33/d38/f6a 0 2024-02-28T16:24:15.292 INFO:tasks.workunit.client.0.smithi023.stdout:8/722: getdents d0/d5 0 2024-02-28T16:24:15.293 INFO:tasks.workunit.client.0.smithi023.stdout:0/603: getdents d6/db/d1a/d26/d31/d33/d37/d8f 0 2024-02-28T16:24:15.296 INFO:tasks.workunit.client.0.smithi023.stdout:1/661: dwrite df/d11/d13/d1b/d2e/f6d [4194304,4194304] 0 2024-02-28T16:24:15.296 INFO:tasks.workunit.client.0.smithi023.stdout:6/736: dwrite d1/d28/d1e/d2b/d6d/d7b/fcc [4194304,4194304] 0 2024-02-28T16:24:15.297 INFO:tasks.workunit.client.0.smithi023.stdout:9/639: chown d0/d7/db/d18/d23/d28/d9c/c62 13431 1 2024-02-28T16:24:15.301 INFO:tasks.workunit.client.0.smithi023.stdout:0/604: symlink d6/db/d5d/ld1 0 2024-02-28T16:24:15.307 INFO:tasks.workunit.client.0.smithi023.stdout:9/640: symlink d0/d7/de/d2a/daf/d2f/d44/ldc 0 2024-02-28T16:24:15.312 INFO:tasks.workunit.client.0.smithi023.stdout:3/708: write d1/df/d2d/d32/f76 [1312051,25004] 0 2024-02-28T16:24:15.318 INFO:tasks.workunit.client.0.smithi023.stdout:1/662: getdents df/dcf 0 2024-02-28T16:24:15.324 INFO:tasks.workunit.client.0.smithi023.stdout:3/709: mknod d1/d74/d46/de9/cf8 0 2024-02-28T16:24:15.325 INFO:tasks.workunit.client.0.smithi023.stdout:4/621: dwrite d13/d2b/fab [0,4194304] 0 2024-02-28T16:24:15.329 INFO:tasks.workunit.client.0.smithi023.stdout:3/710: mkdir d1/df/d2d/d32/d3f/df9 0 2024-02-28T16:24:15.337 INFO:tasks.workunit.client.0.smithi023.stdout:5/888: dread d1/d2a/d32/d37/d3a/f6d [0,4194304] 0 2024-02-28T16:24:15.339 INFO:tasks.workunit.client.0.smithi023.stdout:9/641: rename d0/d7/db/d18/d23/d28/d32/c47 to d0/d7/de/d2a/daf/d2f/d44/d95/cdd 0 2024-02-28T16:24:15.339 INFO:tasks.workunit.client.0.smithi023.stdout:4/622: creat d13/d2b/d2c/d31/d6e/d80/fc5 x:0 0 0 2024-02-28T16:24:15.403 INFO:tasks.workunit.client.0.smithi023.stdout:5/889: rmdir d1 39 2024-02-28T16:24:15.405 INFO:tasks.workunit.client.0.smithi023.stdout:0/605: dread d6/db/dab/d82/fae [0,4194304] 0 2024-02-28T16:24:15.405 INFO:tasks.workunit.client.0.smithi023.stdout:3/711: write d1/df/d2d/d32/d3f/fa6 [833850,52247] 0 2024-02-28T16:24:15.410 INFO:tasks.workunit.client.0.smithi023.stdout:0/606: read - d6/db/d1a/d26/d31/fcf zero size 2024-02-28T16:24:15.412 INFO:tasks.workunit.client.0.smithi023.stdout:3/712: symlink d1/df/d2d/d32/d3f/df9/lfa 0 2024-02-28T16:24:15.413 INFO:tasks.workunit.client.0.smithi023.stdout:9/642: dread d0/d7/db/d18/f56 [0,4194304] 0 2024-02-28T16:24:15.413 INFO:tasks.workunit.client.0.smithi023.stdout:5/890: creat d1/d2a/d32/d37/d3a/d7f/f120 x:0 0 0 2024-02-28T16:24:15.414 INFO:tasks.workunit.client.0.smithi023.stdout:4/623: link d13/d1d/c81 d13/d1d/d2d/da9/cc6 0 2024-02-28T16:24:15.414 INFO:tasks.workunit.client.0.smithi023.stdout:1/663: dwrite df/dbd/f81 [0,4194304] 0 2024-02-28T16:24:15.418 INFO:tasks.workunit.client.0.smithi023.stdout:0/607: creat d6/db/fd2 x:0 0 0 2024-02-28T16:24:15.419 INFO:tasks.workunit.client.0.smithi023.stdout:3/713: fdatasync d1/df/d33/d38/d4c/f7e 0 2024-02-28T16:24:15.421 INFO:tasks.workunit.client.0.smithi023.stdout:5/891: symlink d1/d2a/d32/d37/d3a/d7f/dca/l121 0 2024-02-28T16:24:15.422 INFO:tasks.workunit.client.0.smithi023.stdout:4/624: symlink d13/d2b/d2c/lc7 0 2024-02-28T16:24:15.424 INFO:tasks.workunit.client.0.smithi023.stdout:4/625: fsync d13/d1d/d58/f68 0 2024-02-28T16:24:15.424 INFO:tasks.workunit.client.0.smithi023.stdout:0/608: symlink d6/db/d1a/d35/d9d/ld3 0 2024-02-28T16:24:15.427 INFO:tasks.workunit.client.0.smithi023.stdout:3/714: read d1/df/fa1 [13582,41171] 0 2024-02-28T16:24:15.427 INFO:tasks.workunit.client.0.smithi023.stdout:5/892: creat d1/d2a/d32/d58/d79/de5/dfc/f122 x:0 0 0 2024-02-28T16:24:15.428 INFO:tasks.workunit.client.0.smithi023.stdout:0/609: fdatasync d6/db/f71 0 2024-02-28T16:24:15.434 INFO:tasks.workunit.client.0.smithi023.stdout:9/643: dwrite d0/d7/db/f75 [0,4194304] 0 2024-02-28T16:24:15.434 INFO:tasks.workunit.client.0.smithi023.stdout:5/893: mkdir d1/d2a/d32/d58/d79/de5/dfc/d123 0 2024-02-28T16:24:15.440 INFO:tasks.workunit.client.0.smithi023.stdout:0/610: creat d6/db/d1a/d35/d9d/dce/fd4 x:0 0 0 2024-02-28T16:24:15.440 INFO:tasks.workunit.client.0.smithi023.stdout:1/664: dwrite df/d11/d13/d1b/f7f [0,4194304] 0 2024-02-28T16:24:15.444 INFO:tasks.workunit.client.0.smithi023.stdout:3/715: chown d1/df/d2d/d45/d52/d65/ce0 476 1 2024-02-28T16:24:15.444 INFO:tasks.workunit.client.0.smithi023.stdout:9/644: rename d0/d7/db/d18/l6d to d0/d7/de/d34/dcc/lde 0 2024-02-28T16:24:15.448 INFO:tasks.workunit.client.0.smithi023.stdout:4/626: dwrite d13/d1d/f41 [0,4194304] 0 2024-02-28T16:24:15.450 INFO:tasks.workunit.client.0.smithi023.stdout:0/611: creat d6/db/d5d/fd5 x:0 0 0 2024-02-28T16:24:15.452 INFO:tasks.workunit.client.0.smithi023.stdout:1/665: mkdir df/d11/d13/d1b/d30/d57/d5a/d68/ddd/de1 0 2024-02-28T16:24:15.463 INFO:tasks.workunit.client.0.smithi023.stdout:0/612: creat d6/db/dab/d82/fd6 x:0 0 0 2024-02-28T16:24:15.466 INFO:tasks.workunit.client.0.smithi023.stdout:5/894: getdents d1/d2a/d32/d36 0 2024-02-28T16:24:15.466 INFO:tasks.workunit.client.0.smithi023.stdout:9/645: dread d0/d7/db/d18/d23/d28/d6e/fb8 [0,4194304] 0 2024-02-28T16:24:15.469 INFO:tasks.workunit.client.0.smithi023.stdout:1/666: symlink df/d11/d13/d1b/d30/le2 0 2024-02-28T16:24:15.474 INFO:tasks.workunit.client.0.smithi023.stdout:9/646: chown d0/d7/de/d34/f3b 12 1 2024-02-28T16:24:15.475 INFO:tasks.workunit.client.0.smithi023.stdout:0/613: creat d6/db/d1a/d26/d31/d33/d6e/fd7 x:0 0 0 2024-02-28T16:24:15.479 INFO:tasks.workunit.client.0.smithi023.stdout:5/895: rename d1/d2a to d1/d2a/d32/d58/d79/de5/dfc/d123/d124 22 2024-02-28T16:24:15.479 INFO:tasks.workunit.client.0.smithi023.stdout:1/667: creat df/dbd/fe3 x:0 0 0 2024-02-28T16:24:15.482 INFO:tasks.workunit.client.0.smithi023.stdout:4/627: dwrite d13/d1e/fa6 [0,4194304] 0 2024-02-28T16:24:15.484 INFO:tasks.workunit.client.0.smithi023.stdout:0/614: mknod d6/db/d1a/d26/d31/d33/cd8 0 2024-02-28T16:24:15.487 INFO:tasks.workunit.client.0.smithi023.stdout:5/896: unlink d1/d2a/d32/d37/d3a/d7f/f29 0 2024-02-28T16:24:15.491 INFO:tasks.workunit.client.0.smithi023.stdout:1/668: mkdir df/d11/d13/d1b/d30/d57/d8d/de4 0 2024-02-28T16:24:15.492 INFO:tasks.workunit.client.0.smithi023.stdout:5/897: fsync d1/f40 0 2024-02-28T16:24:15.493 INFO:tasks.workunit.client.0.smithi023.stdout:1/669: readlink df/d11/d13/d1b/d2e/d5c/l7e 0 2024-02-28T16:24:15.495 INFO:tasks.workunit.client.0.smithi023.stdout:0/615: creat d6/db/d24/fd9 x:0 0 0 2024-02-28T16:24:15.495 INFO:tasks.workunit.client.0.smithi023.stdout:5/898: write d1/d2a/d32/d36/f66 [3868912,54811] 0 2024-02-28T16:24:15.496 INFO:tasks.workunit.client.0.smithi023.stdout:4/628: mknod d13/d1e/cc8 0 2024-02-28T16:24:15.497 INFO:tasks.workunit.client.0.smithi023.stdout:1/670: chown df/d11/d13/d1b/l29 7 1 2024-02-28T16:24:15.498 INFO:tasks.workunit.client.0.smithi023.stdout:9/647: link d0/d7/de/d2a/daf/f79 d0/d7/d2c/d7d/fdf 0 2024-02-28T16:24:15.499 INFO:tasks.workunit.client.0.smithi023.stdout:5/899: dread - d1/d2a/d32/d58/d60/f10e zero size 2024-02-28T16:24:15.500 INFO:tasks.workunit.client.0.smithi023.stdout:4/629: write d13/d2b/f51 [120252,124211] 0 2024-02-28T16:24:15.501 INFO:tasks.workunit.client.0.smithi023.stdout:4/630: readlink d13/d1e/l96 0 2024-02-28T16:24:15.506 INFO:tasks.workunit.client.0.smithi023.stdout:5/900: chown d1/d2a/d32/d37/d3a/d7f/c21 381 1 2024-02-28T16:24:15.507 INFO:tasks.workunit.client.0.smithi023.stdout:1/671: truncate df/d11/d13/d1b/d30/d57/d5a/d68/f89 2386521 0 2024-02-28T16:24:15.512 INFO:tasks.workunit.client.0.smithi023.stdout:5/901: mkdir d1/d2a/d32/d58/d79/de5/dfc/d125 0 2024-02-28T16:24:15.512 INFO:tasks.workunit.client.0.smithi023.stdout:1/672: truncate df/d11/d8a/fa8 5212017 0 2024-02-28T16:24:15.519 INFO:tasks.workunit.client.0.smithi023.stdout:0/616: dwrite d6/db/d1a/d26/d31/fb8 [0,4194304] 0 2024-02-28T16:24:15.522 INFO:tasks.workunit.client.0.smithi023.stdout:0/617: fsync d6/db/d1a/d26/d31/d33/f94 0 2024-02-28T16:24:15.525 INFO:tasks.workunit.client.0.smithi023.stdout:0/618: symlink d6/db/d1a/d26/d31/d33/dbe/lda 0 2024-02-28T16:24:15.540 INFO:tasks.workunit.client.0.smithi023.stdout:0/619: dwrite d6/db/d68/fc4 [0,4194304] 0 2024-02-28T16:24:15.546 INFO:tasks.workunit.client.0.smithi023.stdout:0/620: dread d6/db/d5d/f93 [0,4194304] 0 2024-02-28T16:24:15.547 INFO:tasks.workunit.client.0.smithi023.stdout:0/621: fsync d6/db/fa6 0 2024-02-28T16:24:15.548 INFO:tasks.workunit.client.0.smithi023.stdout:0/622: write d6/db/d1a/d59/fc6 [39636,21049] 0 2024-02-28T16:24:15.552 INFO:tasks.workunit.client.0.smithi023.stdout:0/623: truncate d6/db/d1a/d35/d9d/fa9 213122 0 2024-02-28T16:24:15.555 INFO:tasks.workunit.client.0.smithi023.stdout:0/624: unlink d6/db/d3b/lb5 0 2024-02-28T16:24:15.557 INFO:tasks.workunit.client.0.smithi023.stdout:0/625: fdatasync d6/db/d1a/d26/d31/d33/f94 0 2024-02-28T16:24:15.559 INFO:tasks.workunit.client.0.smithi023.stdout:0/626: write d6/db/d68/fc4 [1083682,109593] 0 2024-02-28T16:24:15.566 INFO:tasks.workunit.client.0.smithi023.stdout:0/627: link d6/db/dab/f4b d6/db/d1a/d26/d9c/fdb 0 2024-02-28T16:24:15.574 INFO:tasks.workunit.client.0.smithi023.stdout:0/628: dread d6/db/d1a/d35/fa7 [4194304,4194304] 0 2024-02-28T16:24:15.578 INFO:tasks.workunit.client.0.smithi023.stdout:0/629: dread d6/db/d5d/f93 [0,4194304] 0 2024-02-28T16:24:15.580 INFO:tasks.workunit.client.0.smithi023.stdout:0/630: fdatasync d6/db/d1a/d26/d31/d33/d6e/f6f 0 2024-02-28T16:24:15.587 INFO:tasks.workunit.client.0.smithi023.stdout:0/631: link d6/db/d3b/l9f d6/db/d1a/d59/ldc 0 2024-02-28T16:24:15.624 INFO:tasks.workunit.client.0.smithi023.stdout:3/716: dread d1/d74/de1/db5/fbf [0,4194304] 0 2024-02-28T16:24:15.627 INFO:tasks.workunit.client.0.smithi023.stdout:3/717: mkdir d1/df/d33/dfb 0 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 -- 172.21.15.23:0/1175072317 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 msgr2=0x7f2458100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 --2- 172.21.15.23:0/1175072317 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458100650 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2448009910 tx=0x7f2448009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 -- 172.21.15.23:0/1175072317 shutdown_connections 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 --2- 172.21.15.23:0/1175072317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2458101440 0x7f2458101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 --2- 172.21.15.23:0/1175072317 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458100650 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 -- 172.21.15.23:0/1175072317 >> 172.21.15.23:0/1175072317 conn(0x7f24580fb7f0 msgr2=0x7f24580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 -- 172.21.15.23:0/1175072317 shutdown_connections 2024-02-28T16:24:15.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.640+0000 7f245f200700 1 -- 172.21.15.23:0/1175072317 wait complete. 2024-02-28T16:24:15.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.642+0000 7f245f200700 1 Processor -- start 2024-02-28T16:24:15.631 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.642+0000 7f245f200700 1 -- start start 2024-02-28T16:24:15.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.643+0000 7f245f200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:15.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.643+0000 7f245f200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2458101440 0x7f24581981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:15.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.643+0000 7f245f200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24581987f0 con 0x7f2458100240 2024-02-28T16:24:15.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.643+0000 7f245f200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458198960 con 0x7f2458101440 2024-02-28T16:24:15.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.643+0000 7f2457e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:15.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.643+0000 7f2457e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57726/0 (socket says 172.21.15.23:57726) 2024-02-28T16:24:15.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.643+0000 7f2457e00700 1 -- 172.21.15.23:0/859019158 learned_addr learned my addr 172.21.15.23:0/859019158 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f2457e00700 1 -- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2458101440 msgr2=0x7f24581981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f2457e00700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2458101440 0x7f24581981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f2457e00700 1 -- 172.21.15.23:0/859019158 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480095f0 con 0x7f2458100240 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f2457e00700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458197cb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f244800bda0 tx=0x7f244800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f2454c00700 1 -- 172.21.15.23:0/859019158 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244801d070 con 0x7f2458100240 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f2454c00700 1 -- 172.21.15.23:0/859019158 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f244800f460 con 0x7f2458100240 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245819d390 con 0x7f2458100240 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f2454c00700 1 -- 172.21.15.23:0/859019158 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2448021620 con 0x7f2458100240 2024-02-28T16:24:15.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.644+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245819d880 con 0x7f2458100240 2024-02-28T16:24:15.635 INFO:tasks.workunit.client.0.smithi023.stdout:3/718: getdents d1/d74/d46 0 2024-02-28T16:24:15.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.646+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2438005320 con 0x7f2458100240 2024-02-28T16:24:15.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.647+0000 7f2454c00700 1 -- 172.21.15.23:0/859019158 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 26) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f244802b440 con 0x7f2458100240 2024-02-28T16:24:15.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.649+0000 7f2454c00700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f243c06d650 0x7f243c06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:15.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.649+0000 7f2454c00700 1 -- 172.21.15.23:0/859019158 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f244808e380 con 0x7f2458100240 2024-02-28T16:24:15.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.651+0000 7f2457400700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f243c06d650 0x7f243c06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:15.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.652+0000 7f2457400700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f243c06d650 0x7f243c06fb00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2444005950 tx=0x7f24440058e0 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:15.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:15.659+0000 7f2454c00700 1 -- 172.21.15.23:0/859019158 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f2448057ef0 con 0x7f2458100240 2024-02-28T16:24:15.653 INFO:tasks.workunit.client.0.smithi023.stdout:1/673: read df/d26/f3c [350186,78553] 0 2024-02-28T16:24:15.656 INFO:tasks.workunit.client.0.smithi023.stdout:1/674: chown df/d11/d13/d1b/d2e/f6d 61107 1 2024-02-28T16:24:15.663 INFO:tasks.workunit.client.0.smithi023.stdout:3/719: write d1/df/d2d/d45/d52/d65/d89/fa2 [4560105,61167] 0 2024-02-28T16:24:15.667 INFO:tasks.workunit.client.0.smithi023.stdout:3/720: symlink d1/d74/d94/de4/lfc 0 2024-02-28T16:24:15.677 INFO:tasks.workunit.client.0.smithi023.stdout:9/648: write d0/d7/de/d2a/daf/d2f/d4d/f7b [221439,128640] 0 2024-02-28T16:24:15.679 INFO:tasks.workunit.client.0.smithi023.stdout:4/631: write fb [1239990,11430] 0 2024-02-28T16:24:15.681 INFO:tasks.workunit.client.0.smithi023.stdout:3/721: dread d1/df/d2d/d45/d52/d65/d89/fa2 [0,4194304] 0 2024-02-28T16:24:15.684 INFO:tasks.workunit.client.0.smithi023.stdout:9/649: creat d0/d7/de/fe0 x:0 0 0 2024-02-28T16:24:15.685 INFO:tasks.workunit.client.0.smithi023.stdout:4/632: mknod d13/d2b/d2c/cc9 0 2024-02-28T16:24:15.691 INFO:tasks.workunit.client.0.smithi023.stdout:9/650: creat d0/d7/d2c/fe1 x:0 0 0 2024-02-28T16:24:15.691 INFO:tasks.workunit.client.0.smithi023.stdout:4/633: fdatasync d13/d2b/d2c/f2f 0 2024-02-28T16:24:15.693 INFO:tasks.workunit.client.0.smithi023.stdout:4/634: chown d13/d1e/c72 435 1 2024-02-28T16:24:15.695 INFO:tasks.workunit.client.0.smithi023.stdout:9/651: dread d0/d7/d2c/f77 [0,4194304] 0 2024-02-28T16:24:15.701 INFO:tasks.workunit.client.0.smithi023.stdout:9/652: symlink d0/d7/db/d18/d23/d28/d9c/le2 0 2024-02-28T16:24:15.707 INFO:tasks.workunit.client.0.smithi023.stdout:9/653: creat d0/d7/db/d18/fe3 x:0 0 0 2024-02-28T16:24:15.707 INFO:tasks.workunit.client.0.smithi023.stdout:0/632: dwrite d6/db/fd [0,4194304] 0 2024-02-28T16:24:15.718 INFO:tasks.workunit.client.0.smithi023.stdout:4/635: rmdir d13 39 2024-02-28T16:24:15.721 INFO:tasks.workunit.client.0.smithi023.stdout:0/633: dread d6/db/dab/d82/d72/d79/fbb [0,4194304] 0 2024-02-28T16:24:15.723 INFO:tasks.workunit.client.0.smithi023.stdout:9/654: write d0/d7/db/d18/f6f [952655,123749] 0 2024-02-28T16:24:15.727 INFO:tasks.workunit.client.0.smithi023.stdout:4/636: fdatasync d13/d2b/d2c/f35 0 2024-02-28T16:24:15.731 INFO:tasks.workunit.client.0.smithi023.stdout:3/722: dwrite d1/df/d33/d38/f6a [0,4194304] 0 2024-02-28T16:24:15.736 INFO:tasks.workunit.client.0.smithi023.stdout:4/637: mknod d13/d1d/d58/cca 0 2024-02-28T16:24:15.736 INFO:tasks.workunit.client.0.smithi023.stdout:9/655: rename d0/cd7 to d0/ce4 0 2024-02-28T16:24:15.742 INFO:tasks.workunit.client.0.smithi023.stdout:3/723: creat d1/df/d3d/ffd x:0 0 0 2024-02-28T16:24:15.745 INFO:tasks.workunit.client.0.smithi023.stdout:0/634: dread d6/db/d1a/d26/f4d [0,4194304] 0 2024-02-28T16:24:15.746 INFO:tasks.workunit.client.0.smithi023.stdout:3/724: fdatasync d1/df/fa1 0 2024-02-28T16:24:15.748 INFO:tasks.workunit.client.0.smithi023.stdout:0/635: read d6/db/f71 [4084367,74337] 0 2024-02-28T16:24:15.749 INFO:tasks.workunit.client.0.smithi023.stdout:9/656: dread d0/d7/db/d18/f6f [0,4194304] 0 2024-02-28T16:24:15.750 INFO:tasks.workunit.client.0.smithi023.stdout:0/636: rmdir d6/d84 39 2024-02-28T16:24:15.753 INFO:tasks.workunit.client.0.smithi023.stdout:3/725: symlink d1/df/d2d/lfe 0 2024-02-28T16:24:15.755 INFO:tasks.workunit.client.0.smithi023.stdout:3/726: fsync d1/f3c 0 2024-02-28T16:24:15.759 INFO:tasks.workunit.client.0.smithi023.stdout:0/637: link d6/db/d1a/d26/d31/d33/d6e/f6f d6/fdd 0 2024-02-28T16:24:15.761 INFO:tasks.workunit.client.0.smithi023.stdout:9/657: link d0/d7/de/d2a/daf/d2f/fd4 d0/d7/de/d2a/daf/d2f/d44/d95/fe5 0 2024-02-28T16:24:15.762 INFO:tasks.workunit.client.0.smithi023.stdout:4/638: dwrite d13/d2b/d2c/d31/d6e/f82 [0,4194304] 0 2024-02-28T16:24:15.764 INFO:tasks.workunit.client.0.smithi023.stdout:0/638: readlink d6/db/d1a/d26/d9c/lc9 0 2024-02-28T16:24:15.764 INFO:tasks.workunit.client.0.smithi023.stdout:3/727: mkdir d1/d4a/d92/dff 0 2024-02-28T16:24:15.767 INFO:tasks.workunit.client.0.smithi023.stdout:4/639: symlink d13/d2b/d2c/d31/dc4/dc0/lcb 0 2024-02-28T16:24:15.768 INFO:tasks.workunit.client.0.smithi023.stdout:9/658: rename d0/d7/db/l1e to d0/d7/d2c/d7d/le6 0 2024-02-28T16:24:15.770 INFO:tasks.workunit.client.0.smithi023.stdout:4/640: creat d13/d1d/d2e/fcc x:0 0 0 2024-02-28T16:24:15.774 INFO:tasks.workunit.client.0.smithi023.stdout:0/639: rename d6/db/dab/d42/c7d to d6/db/d1a/d26/d66/cde 0 2024-02-28T16:24:15.775 INFO:tasks.workunit.client.0.smithi023.stdout:6/737: sync 2024-02-28T16:24:15.775 INFO:tasks.workunit.client.0.smithi023.stdout:7/608: sync 2024-02-28T16:24:15.775 INFO:tasks.workunit.client.0.smithi023.stdout:2/725: sync 2024-02-28T16:24:15.776 INFO:tasks.workunit.client.0.smithi023.stdout:8/723: sync 2024-02-28T16:24:15.781 INFO:tasks.workunit.client.0.smithi023.stdout:8/724: write d0/d5/d35/dbf/fe4 [322579,106920] 0 2024-02-28T16:24:15.781 INFO:tasks.workunit.client.0.smithi023.stdout:0/640: dread d6/db/d1a/d35/d9d/fa9 [0,4194304] 0 2024-02-28T16:24:15.786 INFO:tasks.workunit.client.0.smithi023.stdout:0/641: readlink d6/db/d1a/d26/lb6 0 2024-02-28T16:24:15.787 INFO:tasks.workunit.client.0.smithi023.stdout:3/728: rename d1/d74/de1/d9e/fd1 to d1/df/d2d/d45/d52/d65/d89/f100 0 2024-02-28T16:24:15.793 INFO:tasks.workunit.client.0.smithi023.stdout:1/675: sync 2024-02-28T16:24:15.793 INFO:tasks.workunit.client.0.smithi023.stdout:5/902: sync 2024-02-28T16:24:15.793 INFO:tasks.workunit.client.0.smithi023.stdout:2/726: symlink d5/da/db/d17/d73/d9e/da0/le4 0 2024-02-28T16:24:15.794 INFO:tasks.workunit.client.0.smithi023.stdout:9/659: getdents d0/d7/db/d18/d23/d28/d9c 0 2024-02-28T16:24:15.800 INFO:tasks.workunit.client.0.smithi023.stdout:8/725: chown d0/d5/d1a/d63/d90/dac/lc1 16485 1 2024-02-28T16:24:15.804 INFO:tasks.workunit.client.0.smithi023.stdout:0/642: mkdir d6/db/d1a/d26/d31/d33/d37/d8f/ddf 0 2024-02-28T16:24:15.810 INFO:tasks.workunit.client.0.smithi023.stdout:5/903: readlink d1/d2a/d32/d58/laf 0 2024-02-28T16:24:15.810 INFO:tasks.workunit.client.0.smithi023.stdout:1/676: creat df/d11/d13/d1b/d30/dae/fe5 x:0 0 0 2024-02-28T16:24:15.811 INFO:tasks.workunit.client.0.smithi023.stdout:9/660: unlink d0/d7/db/d18/d23/l86 0 2024-02-28T16:24:15.815 INFO:tasks.workunit.client.0.smithi023.stdout:7/609: dwrite de/d13/d1b/d3f/f9a [0,4194304] 0 2024-02-28T16:24:15.822 INFO:tasks.workunit.client.0.smithi023.stdout:2/727: rename d5/da/f28 to d5/da/db/d17/d73/dd0/d52/fe5 0 2024-02-28T16:24:15.823 INFO:tasks.workunit.client.0.smithi023.stdout:8/726: write d0/d5/d1a/d44/f96 [3055386,109263] 0 2024-02-28T16:24:15.824 INFO:tasks.workunit.client.0.smithi023.stdout:0/643: rmdir d6/d84 39 2024-02-28T16:24:15.824 INFO:tasks.workunit.client.0.smithi023.stdout:3/729: dwrite d1/df/d2d/d45/d78/fc7 [0,4194304] 0 2024-02-28T16:24:15.826 INFO:tasks.workunit.client.0.smithi023.stdout:2/728: stat d5/l59 0 2024-02-28T16:24:15.834 INFO:tasks.workunit.client.0.smithi023.stdout:6/738: dread d1/d28/d1e/dae/fb4 [0,4194304] 0 2024-02-28T16:24:15.834 INFO:tasks.workunit.client.0.smithi023.stdout:4/641: dwrite d13/d2b/f5e [0,4194304] 0 2024-02-28T16:24:15.835 INFO:tasks.workunit.client.0.smithi023.stdout:9/661: stat d0/d7/cc8 0 2024-02-28T16:24:15.836 INFO:tasks.workunit.client.0.smithi023.stdout:0/644: stat d6/db/dab/d82/d72/d79/f8b 0 2024-02-28T16:24:15.839 INFO:tasks.workunit.client.0.smithi023.stdout:7/610: creat de/d72/d99/fc5 x:0 0 0 2024-02-28T16:24:15.840 INFO:tasks.workunit.client.0.smithi023.stdout:2/729: write d5/da/d1b/fc8 [598517,16480] 0 2024-02-28T16:24:15.843 INFO:tasks.workunit.client.0.smithi023.stdout:3/730: fsync d1/df/d33/d38/d4c/f50 0 2024-02-28T16:24:15.844 INFO:tasks.workunit.client.0.smithi023.stdout:2/730: chown d5/da/f55 257381337 1 2024-02-28T16:24:15.847 INFO:tasks.workunit.client.0.smithi023.stdout:5/904: truncate d1/d2a/d32/d37/d3a/d7f/d62/dd1/f10b 110755 0 2024-02-28T16:24:15.848 INFO:tasks.workunit.client.0.smithi023.stdout:6/739: getdents d1/d18/d26/d3a 0 2024-02-28T16:24:15.853 INFO:tasks.workunit.client.0.smithi023.stdout:0/645: creat d6/db/d1a/d26/d9c/fe0 x:0 0 0 2024-02-28T16:24:15.855 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:15 smithi023 ceph-mon[29137]: pgmap v39: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 165 MiB/s wr, 403 op/s 2024-02-28T16:24:15.855 INFO:tasks.workunit.client.0.smithi023.stdout:4/642: read d13/d2b/d2c/d31/dc4/d55/f6c [3400288,93734] 0 2024-02-28T16:24:15.856 INFO:tasks.workunit.client.0.smithi023.stdout:7/611: symlink de/d13/d1b/d3f/lc6 0 2024-02-28T16:24:15.860 INFO:tasks.workunit.client.0.smithi023.stdout:6/740: creat d1/d28/d1e/d2b/d44/da4/f10a x:0 0 0 2024-02-28T16:24:15.863 INFO:tasks.workunit.client.0.smithi023.stdout:0/646: symlink d6/db/d1a/d59/le1 0 2024-02-28T16:24:15.868 INFO:tasks.workunit.client.0.smithi023.stdout:5/905: mknod d1/d2a/d32/d37/c126 0 2024-02-28T16:24:15.873 INFO:tasks.workunit.client.0.smithi023.stdout:7/612: rename de/d60/f37 to de/d1c/d76/d7b/dad/fc7 0 2024-02-28T16:24:15.874 INFO:tasks.workunit.client.0.smithi023.stdout:5/906: write d1/d2a/d32/d58/d60/f10e [586023,9521] 0 2024-02-28T16:24:15.877 INFO:tasks.workunit.client.0.smithi023.stdout:6/741: mknod d1/c10b 0 2024-02-28T16:24:15.879 INFO:tasks.workunit.client.0.smithi023.stdout:4/643: mknod d13/d1d/d2d/ccd 0 2024-02-28T16:24:15.879 INFO:tasks.workunit.client.0.smithi023.stdout:3/731: dwrite d1/df/d2d/d45/f1b [0,4194304] 0 2024-02-28T16:24:15.883 INFO:tasks.workunit.client.0.smithi023.stdout:6/742: chown d1/c6 70227384 1 2024-02-28T16:24:15.883 INFO:tasks.workunit.client.0.smithi023.stdout:5/907: chown d1/d2a/d32/d58/d79/de5/l8b 11 1 2024-02-28T16:24:15.886 INFO:tasks.workunit.client.0.smithi023.stdout:0/647: rename d6/db/d5d/fd5 to d6/db/dab/d82/da3/fe2 0 2024-02-28T16:24:15.890 INFO:tasks.workunit.client.0.smithi023.stdout:1/677: truncate df/d11/d13/d1b/d2e/f87 115108 0 2024-02-28T16:24:15.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:15 smithi153 ceph-mon[35341]: pgmap v39: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 165 MiB/s wr, 403 op/s 2024-02-28T16:24:15.899 INFO:tasks.workunit.client.0.smithi023.stdout:1/678: truncate df/d11/d13/d1b/d2e/fc9 511472 0 2024-02-28T16:24:15.900 INFO:tasks.workunit.client.0.smithi023.stdout:2/731: write d5/da/db/d17/d39/f80 [8456,91544] 0 2024-02-28T16:24:15.902 INFO:tasks.workunit.client.0.smithi023.stdout:6/743: truncate d1/d18/d26/da6/fcf 460436 0 2024-02-28T16:24:15.907 INFO:tasks.workunit.client.0.smithi023.stdout:0/648: creat d6/db/d5d/fe3 x:0 0 0 2024-02-28T16:24:15.910 INFO:tasks.workunit.client.0.smithi023.stdout:9/662: truncate d0/d7/d2c/d7d/fb4 2564623 0 2024-02-28T16:24:15.912 INFO:tasks.workunit.client.0.smithi023.stdout:7/613: dwrite de/d1c/d76/d7b/f92 [0,4194304] 0 2024-02-28T16:24:15.915 INFO:tasks.workunit.client.0.smithi023.stdout:8/727: truncate d0/d5/d1a/d2d/d67/d71/d9e/ddb/fe3 2354990 0 2024-02-28T16:24:15.916 INFO:tasks.workunit.client.0.smithi023.stdout:7/614: stat de/d13/d1b/d3d/f7c 0 2024-02-28T16:24:15.916 INFO:tasks.workunit.client.0.smithi023.stdout:4/644: mkdir d13/d2b/d2c/d31/dce 0 2024-02-28T16:24:15.927 INFO:tasks.workunit.client.0.smithi023.stdout:3/732: rename d1/df/d3d/f62 to d1/df/d2d/d45/d6f/f101 0 2024-02-28T16:24:15.927 INFO:tasks.workunit.client.0.smithi023.stdout:8/728: read d0/d5/d1a/d63/fb5 [1092038,110060] 0 2024-02-28T16:24:15.930 INFO:tasks.workunit.client.0.smithi023.stdout:9/663: creat d0/d7/db/d18/fe7 x:0 0 0 2024-02-28T16:24:15.939 INFO:tasks.workunit.client.0.smithi023.stdout:2/732: mkdir d5/de6 0 2024-02-28T16:24:15.941 INFO:tasks.workunit.client.0.smithi023.stdout:9/664: read d0/d7/db/d18/d23/d28/d6e/f93 [2230421,17063] 0 2024-02-28T16:24:15.941 INFO:tasks.workunit.client.0.smithi023.stdout:5/908: dread d1/d2a/d32/d37/f51 [0,4194304] 0 2024-02-28T16:24:15.941 INFO:tasks.workunit.client.0.smithi023.stdout:1/679: mkdir df/d11/d13/d99/dde/de6 0 2024-02-28T16:24:15.945 INFO:tasks.workunit.client.0.smithi023.stdout:1/680: read df/dbd/f81 [610978,115001] 0 2024-02-28T16:24:15.945 INFO:tasks.workunit.client.0.smithi023.stdout:3/733: creat d1/d4a/d92/f102 x:0 0 0 2024-02-28T16:24:15.949 INFO:tasks.workunit.client.0.smithi023.stdout:0/649: mknod d6/db/d1a/d59/dcd/ce4 0 2024-02-28T16:24:15.954 INFO:tasks.workunit.client.0.smithi023.stdout:4/645: dwrite d13/d2b/f5d [4194304,4194304] 0 2024-02-28T16:24:15.962 INFO:tasks.workunit.client.0.smithi023.stdout:8/729: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/ff4 x:0 0 0 2024-02-28T16:24:15.975 INFO:tasks.workunit.client.0.smithi023.stdout:2/733: rename d5/da/db/d17/d73/f9f to d5/da/db/d17/d73/d9e/da0/d8b/fe7 0 2024-02-28T16:24:15.980 INFO:tasks.workunit.client.0.smithi023.stdout:6/744: write d1/d18/f8c [2919929,41145] 0 2024-02-28T16:24:15.980 INFO:tasks.workunit.client.0.smithi023.stdout:4/646: dread d13/d2b/fab [0,4194304] 0 2024-02-28T16:24:15.987 INFO:tasks.workunit.client.0.smithi023.stdout:3/734: dwrite d1/d4a/d92/f102 [0,4194304] 0 2024-02-28T16:24:15.995 INFO:tasks.workunit.client.0.smithi023.stdout:7/615: dwrite de/d1c/f68 [0,4194304] 0 2024-02-28T16:24:15.995 INFO:tasks.workunit.client.0.smithi023.stdout:3/735: readlink d1/d4a/l7b 0 2024-02-28T16:24:16.003 INFO:tasks.workunit.client.0.smithi023.stdout:5/909: rename d1/d2a/d32/d36/l4a to d1/d2a/d32/d58/d79/de5/l127 0 2024-02-28T16:24:16.009 INFO:tasks.workunit.client.0.smithi023.stdout:0/650: dwrite d6/d84/fc5 [0,4194304] 0 2024-02-28T16:24:16.011 INFO:tasks.workunit.client.0.smithi023.stdout:0/651: fdatasync d6/db/d1a/d26/d9c/fe0 0 2024-02-28T16:24:16.013 INFO:tasks.workunit.client.0.smithi023.stdout:4/647: dwrite d13/d2b/f5d [4194304,4194304] 0 2024-02-28T16:24:16.016 INFO:tasks.workunit.client.0.smithi023.stdout:4/648: write d13/d1d/f33 [1076990,70642] 0 2024-02-28T16:24:16.019 INFO:tasks.workunit.client.0.smithi023.stdout:9/665: creat d0/d7/de/d2a/daf/d2f/fe8 x:0 0 0 2024-02-28T16:24:16.026 INFO:tasks.workunit.client.0.smithi023.stdout:1/681: dread df/d11/d13/f2c [0,4194304] 0 2024-02-28T16:24:16.027 INFO:tasks.workunit.client.0.smithi023.stdout:1/682: stat f2 0 2024-02-28T16:24:16.028 INFO:tasks.workunit.client.0.smithi023.stdout:3/736: creat d1/d74/de1/f103 x:0 0 0 2024-02-28T16:24:16.029 INFO:tasks.workunit.client.0.smithi023.stdout:5/910: dwrite d1/d2a/d32/d37/fc8 [4194304,4194304] 0 2024-02-28T16:24:16.033 INFO:tasks.workunit.client.0.smithi023.stdout:6/745: rename d1/d28/d1e/d2b/d76/f88 to d1/d28/d1e/dbc/dfb/f10c 0 2024-02-28T16:24:16.034 INFO:tasks.workunit.client.0.smithi023.stdout:5/911: write d1/d2a/d32/d37/d3a/f6a [2062150,82296] 0 2024-02-28T16:24:16.036 INFO:tasks.workunit.client.0.smithi023.stdout:6/746: write d1/d3d/fea [3853676,83182] 0 2024-02-28T16:24:16.037 INFO:tasks.workunit.client.0.smithi023.stdout:2/734: link d5/da/db/d17/d3c/fc9 d5/da/db/d17/fe8 0 2024-02-28T16:24:16.039 INFO:tasks.workunit.client.0.smithi023.stdout:0/652: mknod d6/db/d1a/d26/d31/da0/ce5 0 2024-02-28T16:24:16.049 INFO:tasks.workunit.client.0.smithi023.stdout:9/666: write d0/d7/de/f63 [4091835,62131] 0 2024-02-28T16:24:16.055 INFO:tasks.workunit.client.0.smithi023.stdout:8/730: truncate d0/d5/d1a/d2d/d67/d71/db4/d39/f3b 4186879 0 2024-02-28T16:24:16.056 INFO:tasks.workunit.client.0.smithi023.stdout:7/616: write de/d13/d1b/f4c [627723,112516] 0 2024-02-28T16:24:16.066 INFO:tasks.workunit.client.0.smithi023.stdout:5/912: read d1/d2a/d32/d58/d60/d81/f86 [680240,35286] 0 2024-02-28T16:24:16.068 INFO:tasks.workunit.client.0.smithi023.stdout:2/735: mknod d5/da/d1b/d3f/d75/d92/ce9 0 2024-02-28T16:24:16.069 INFO:tasks.workunit.client.0.smithi023.stdout:0/653: symlink d6/db/d1a/d26/d31/d33/dbe/le6 0 2024-02-28T16:24:16.070 INFO:tasks.workunit.client.0.smithi023.stdout:0/654: readlink d6/db/d1a/d26/l5e 0 2024-02-28T16:24:16.073 INFO:tasks.workunit.client.0.smithi023.stdout:9/667: symlink d0/d7/db/d18/d23/d28/d32/d8b/le9 0 2024-02-28T16:24:16.075 INFO:tasks.workunit.client.0.smithi023.stdout:7/617: readlink de/d1c/l56 0 2024-02-28T16:24:16.101 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.112+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2438000bf0 con 0x7f243c06d650 2024-02-28T16:24:16.104 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.115+0000 7f2454c00700 1 -- 172.21.15.23:0/859019158 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2438000bf0 con 0x7f243c06d650 2024-02-28T16:24:16.108 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f243c06d650 msgr2=0x7f243c06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.108 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f243c06d650 0x7f243c06fb00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2444005950 tx=0x7f24440058e0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 msgr2=0x7f2458197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458197cb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f244800bda0 tx=0x7f244800be80 comp rx=0 tx=0).stop 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 shutdown_connections 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f243c06d650 0x7f243c06fb00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2458100240 0x7f2458197cb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 --2- 172.21.15.23:0/859019158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2458101440 0x7f24581981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 >> 172.21.15.23:0/859019158 conn(0x7f24580fb7f0 msgr2=0x7f2458102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 shutdown_connections 2024-02-28T16:24:16.109 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.119+0000 7f245f200700 1 -- 172.21.15.23:0/859019158 wait complete. 2024-02-28T16:24:16.124 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:24:16.223 INFO:tasks.workunit.client.0.smithi023.stdout:2/736: fdatasync d5/da/db/d17/fe8 0 2024-02-28T16:24:16.224 INFO:tasks.workunit.client.0.smithi023.stdout:9/668: mknod d0/d7/de/d2a/cea 0 2024-02-28T16:24:16.224 INFO:tasks.workunit.client.0.smithi023.stdout:0/655: mknod d6/db/dab/d82/da3/ce7 0 2024-02-28T16:24:16.226 INFO:tasks.workunit.client.0.smithi023.stdout:6/747: write d1/d18/d26/f38 [5450701,129909] 0 2024-02-28T16:24:16.227 INFO:tasks.workunit.client.0.smithi023.stdout:1/683: dread df/d11/d13/d27/f53 [0,4194304] 0 2024-02-28T16:24:16.228 INFO:tasks.workunit.client.0.smithi023.stdout:4/649: getdents d13/d2b/d2c/d31/dc4/d55 0 2024-02-28T16:24:16.231 INFO:tasks.workunit.client.0.smithi023.stdout:3/737: getdents d1/df/d33/dc2 0 2024-02-28T16:24:16.235 INFO:tasks.workunit.client.0.smithi023.stdout:0/656: fdatasync d6/db/d1a/d26/f4d 0 2024-02-28T16:24:16.236 INFO:tasks.workunit.client.0.smithi023.stdout:4/650: symlink d13/d1d/lcf 0 2024-02-28T16:24:16.237 INFO:tasks.workunit.client.0.smithi023.stdout:0/657: chown d6/db/d1a/d26/d31/l7b 2449595 1 2024-02-28T16:24:16.238 INFO:tasks.workunit.client.0.smithi023.stdout:5/913: getdents d1/d2a/d32/d37/d3a/d7f/d62/dd1 0 2024-02-28T16:24:16.240 INFO:tasks.workunit.client.0.smithi023.stdout:9/669: mkdir d0/d7/de/d2a/daf/d2f/d44/d95/deb 0 2024-02-28T16:24:16.243 INFO:tasks.workunit.client.0.smithi023.stdout:2/737: rmdir d5/da/db/d17/d73/d9e/da0 39 2024-02-28T16:24:16.244 INFO:tasks.workunit.client.0.smithi023.stdout:2/738: chown d5/da/db/d17/d73/dd0/l25 3171340 1 2024-02-28T16:24:16.245 INFO:tasks.workunit.client.0.smithi023.stdout:1/684: rename df/d26/l66 to df/d11/d13/le7 0 2024-02-28T16:24:16.248 INFO:tasks.workunit.client.0.smithi023.stdout:4/651: rmdir d13/d2b/d2c/d31/d8d 39 2024-02-28T16:24:16.252 INFO:tasks.workunit.client.0.smithi023.stdout:9/670: rmdir d0/d7/de/d2a/daf/d2f/d4d 39 2024-02-28T16:24:16.259 INFO:tasks.workunit.client.0.smithi023.stdout:4/652: unlink d13/ca3 0 2024-02-28T16:24:16.262 INFO:tasks.workunit.client.0.smithi023.stdout:5/914: creat d1/d2a/d32/d58/d79/de5/dfc/d123/f128 x:0 0 0 2024-02-28T16:24:16.271 INFO:tasks.workunit.client.0.smithi023.stdout:5/915: mkdir d1/d2a/d32/d37/d3a/d7f/d62/d68/d129 0 2024-02-28T16:24:16.273 INFO:tasks.workunit.client.0.smithi023.stdout:1/685: rename df/d11/d13/d1b/d30/le2 to df/d11/d13/d1b/d30/le8 0 2024-02-28T16:24:16.274 INFO:tasks.workunit.client.0.smithi023.stdout:4/653: rmdir d13/d2b/d2c/d31/d8d/db3 39 2024-02-28T16:24:16.275 INFO:tasks.workunit.client.0.smithi023.stdout:3/738: link d1/d74/d46/f72 d1/df/f104 0 2024-02-28T16:24:16.277 INFO:tasks.workunit.client.0.smithi023.stdout:5/916: symlink d1/d2a/d32/d6e/l12a 0 2024-02-28T16:24:16.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.291+0000 7f185ac00700 1 -- 172.21.15.23:0/2116796048 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 msgr2=0x7f1854103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.291+0000 7f185ac00700 1 --2- 172.21.15.23:0/2116796048 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f1854103b60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1840009910 tx=0x7f1840009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.291+0000 7f185ac00700 1 -- 172.21.15.23:0/2116796048 shutdown_connections 2024-02-28T16:24:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.291+0000 7f185ac00700 1 --2- 172.21.15.23:0/2116796048 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f1854103b60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.291+0000 7f185ac00700 1 --2- 172.21.15.23:0/2116796048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1854102450 0x7f1854102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.291+0000 7f185ac00700 1 -- 172.21.15.23:0/2116796048 >> 172.21.15.23:0/2116796048 conn(0x7f18540fdac0 msgr2=0x7f18540ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.291+0000 7f185ac00700 1 -- 172.21.15.23:0/2116796048 shutdown_connections 2024-02-28T16:24:16.281 INFO:tasks.workunit.client.0.smithi023.stdout:4/654: rename d13/d2b/d2c/d31/d6e/d80 to d13/d1d/dd0 0 2024-02-28T16:24:16.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.292+0000 7f185ac00700 1 -- 172.21.15.23:0/2116796048 wait complete. 2024-02-28T16:24:16.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.294+0000 7f185ac00700 1 Processor -- start 2024-02-28T16:24:16.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.294+0000 7f185ac00700 1 -- start start 2024-02-28T16:24:16.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f185ac00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1854102450 0x7f185419c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:16.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f185ac00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f185419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:16.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f185ac00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185419cbe0 con 0x7f18541036f0 2024-02-28T16:24:16.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f185ac00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185419cd20 con 0x7f1854102450 2024-02-28T16:24:16.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f1853400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f185419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:16.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f1853400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f185419c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57746/0 (socket says 172.21.15.23:57746) 2024-02-28T16:24:16.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f1853400700 1 -- 172.21.15.23:0/1199486607 learned_addr learned my addr 172.21.15.23:0/1199486607 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:16.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.295+0000 7f1853e00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1854102450 0x7f185419c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:16.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.296+0000 7f1853400700 1 -- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1854102450 msgr2=0x7f185419c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.296+0000 7f1853400700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1854102450 0x7f185419c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.296+0000 7f1853400700 1 -- 172.21.15.23:0/1199486607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400095f0 con 0x7f18541036f0 2024-02-28T16:24:16.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.296+0000 7f1853400700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f185419c5c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1840005b40 tx=0x7f184000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:16.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.297+0000 7f1850c00700 1 -- 172.21.15.23:0/1199486607 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184001d070 con 0x7f18541036f0 2024-02-28T16:24:16.287 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.297+0000 7f1850c00700 1 -- 172.21.15.23:0/1199486607 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f184000f460 con 0x7f18541036f0 2024-02-28T16:24:16.287 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.297+0000 7f1850c00700 1 -- 172.21.15.23:0/1199486607 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1840021620 con 0x7f18541036f0 2024-02-28T16:24:16.287 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.298+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18541a1770 con 0x7f18541036f0 2024-02-28T16:24:16.288 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.299+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18541a1c30 con 0x7f18541036f0 2024-02-28T16:24:16.289 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.300+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18541070c0 con 0x7f18541036f0 2024-02-28T16:24:16.291 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.302+0000 7f1850c00700 1 -- 172.21.15.23:0/1199486607 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 26) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f184000fa40 con 0x7f18541036f0 2024-02-28T16:24:16.293 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.303+0000 7f1850c00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f183806d650 0x7f183806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:16.295 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.303+0000 7f1850c00700 1 -- 172.21.15.23:0/1199486607 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f184008de90 con 0x7f18541036f0 2024-02-28T16:24:16.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.305+0000 7f1853e00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f183806d650 0x7f183806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:16.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.306+0000 7f1853e00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f183806d650 0x7f183806fb00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1844005950 tx=0x7f184400b410 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:16.299 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.309+0000 7f1850c00700 1 -- 172.21.15.23:0/1199486607 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f184005b5b0 con 0x7f18541036f0 2024-02-28T16:24:16.300 INFO:tasks.workunit.client.0.smithi023.stdout:6/748: write d1/d28/d1e/d2b/d6d/fc8 [5157184,97554] 0 2024-02-28T16:24:16.301 INFO:tasks.workunit.client.0.smithi023.stdout:0/658: write d6/db/dab/d82/f44 [1428052,12765] 0 2024-02-28T16:24:16.309 INFO:tasks.workunit.client.0.smithi023.stdout:2/739: truncate d5/da/db/d17/d3c/fb1 235525 0 2024-02-28T16:24:16.310 INFO:tasks.workunit.client.0.smithi023.stdout:7/618: dwrite de/d13/d1b/d3d/f5c [0,4194304] 0 2024-02-28T16:24:16.314 INFO:tasks.workunit.client.0.smithi023.stdout:7/619: fsync de/d13/d1b/f4c 0 2024-02-28T16:24:16.315 INFO:tasks.workunit.client.0.smithi023.stdout:6/749: mkdir d1/d3d/df7/d10d 0 2024-02-28T16:24:16.317 INFO:tasks.workunit.client.0.smithi023.stdout:2/740: fdatasync d5/da/d1b/f36 0 2024-02-28T16:24:16.320 INFO:tasks.workunit.client.0.smithi023.stdout:5/917: write d1/d2a/d32/d37/d3a/f48 [5059297,25935] 0 2024-02-28T16:24:16.324 INFO:tasks.workunit.client.0.smithi023.stdout:7/620: rename f8 to de/d72/fc8 0 2024-02-28T16:24:16.326 INFO:tasks.workunit.client.0.smithi023.stdout:6/750: creat d1/d18/dd8/f10e x:0 0 0 2024-02-28T16:24:16.327 INFO:tasks.workunit.client.0.smithi023.stdout:2/741: symlink d5/da/db/d17/d3c/d7f/lea 0 2024-02-28T16:24:16.327 INFO:tasks.workunit.client.0.smithi023.stdout:1/686: dread df/d11/d13/d1b/d30/f41 [0,4194304] 0 2024-02-28T16:24:16.331 INFO:tasks.workunit.client.0.smithi023.stdout:2/742: read d5/da/d1b/f4b [942887,31122] 0 2024-02-28T16:24:16.333 INFO:tasks.workunit.client.0.smithi023.stdout:5/918: rename d1/d2a/d32/l63 to d1/d2a/d32/d58/d60/d81/l12b 0 2024-02-28T16:24:16.334 INFO:tasks.workunit.client.0.smithi023.stdout:7/621: mkdir de/d1c/d76/d7b/dad/dc9 0 2024-02-28T16:24:16.338 INFO:tasks.workunit.client.0.smithi023.stdout:7/622: fdatasync de/d9b/fa8 0 2024-02-28T16:24:16.339 INFO:tasks.workunit.client.0.smithi023.stdout:5/919: write d1/d2a/d32/d37/d3a/f50 [4401073,9220] 0 2024-02-28T16:24:16.340 INFO:tasks.workunit.client.0.smithi023.stdout:0/659: dread d6/fdd [0,4194304] 0 2024-02-28T16:24:16.342 INFO:tasks.workunit.client.0.smithi023.stdout:1/687: mkdir df/d11/d13/d1b/d30/de9 0 2024-02-28T16:24:16.342 INFO:tasks.workunit.client.0.smithi023.stdout:7/623: dread - de/d9b/fba zero size 2024-02-28T16:24:16.345 INFO:tasks.workunit.client.0.smithi023.stdout:5/920: truncate d1/d2a/d32/d58/faa 1140735 0 2024-02-28T16:24:16.350 INFO:tasks.workunit.client.0.smithi023.stdout:6/751: link d1/l13 d1/d18/d26/d3a/l10f 0 2024-02-28T16:24:16.350 INFO:tasks.workunit.client.0.smithi023.stdout:5/921: chown d1/d2a/d32/d58/d60/f10e 111 1 2024-02-28T16:24:16.350 INFO:tasks.workunit.client.0.smithi023.stdout:0/660: write d6/db/d3d/f70 [319688,24716] 0 2024-02-28T16:24:16.352 INFO:tasks.workunit.client.0.smithi023.stdout:7/624: fsync de/d60/f5e 0 2024-02-28T16:24:16.356 INFO:tasks.workunit.client.0.smithi023.stdout:2/743: rename d5/da/db/d17/d73/dd0/f24 to d5/da/db/d17/d73/d9e/da0/d8b/feb 0 2024-02-28T16:24:16.356 INFO:tasks.workunit.client.0.smithi023.stdout:1/688: truncate f4 560807 0 2024-02-28T16:24:16.360 INFO:tasks.workunit.client.0.smithi023.stdout:5/922: mkdir d1/d2a/d32/d37/d3a/d7f/d62/d68/d12c 0 2024-02-28T16:24:16.363 INFO:tasks.workunit.client.0.smithi023.stdout:2/744: rmdir d5/da/db/d17/d73/d9e/da0/d8b 39 2024-02-28T16:24:16.364 INFO:tasks.workunit.client.0.smithi023.stdout:1/689: truncate df/d11/d13/d1b/d30/d57/d5a/d68/d6f/fd9 608715 0 2024-02-28T16:24:16.365 INFO:tasks.workunit.client.0.smithi023.stdout:5/923: write d1/d2a/d32/d58/d60/f10e [1397829,64087] 0 2024-02-28T16:24:16.365 INFO:tasks.workunit.client.0.smithi023.stdout:7/625: mknod de/d1c/d76/d7b/cca 0 2024-02-28T16:24:16.368 INFO:tasks.workunit.client.0.smithi023.stdout:5/924: stat d1/d2a/d32/d58/d60/d82 0 2024-02-28T16:24:16.368 INFO:tasks.workunit.client.0.smithi023.stdout:7/626: write de/d60/f96 [1489981,95488] 0 2024-02-28T16:24:16.368 INFO:tasks.workunit.client.0.smithi023.stdout:6/752: symlink d1/d3d/df7/d10d/l110 0 2024-02-28T16:24:16.375 INFO:tasks.workunit.client.0.smithi023.stdout:7/627: write de/d13/d1b/d3d/f5c [2895400,65969] 0 2024-02-28T16:24:16.378 INFO:tasks.workunit.client.0.smithi023.stdout:2/745: getdents d5/de6 0 2024-02-28T16:24:16.383 INFO:tasks.workunit.client.0.smithi023.stdout:0/661: getdents d6/db/d1a/d26/d31/d33/d6e/db1 0 2024-02-28T16:24:16.386 INFO:tasks.workunit.client.0.smithi023.stdout:5/925: creat d1/d2a/d32/d58/d79/de5/dfc/d125/f12d x:0 0 0 2024-02-28T16:24:16.388 INFO:tasks.workunit.client.0.smithi023.stdout:2/746: readlink d5/da/d67/lc1 0 2024-02-28T16:24:16.394 INFO:tasks.workunit.client.0.smithi023.stdout:5/926: symlink d1/d2a/d32/d37/d3a/l12e 0 2024-02-28T16:24:16.396 INFO:tasks.workunit.client.0.smithi023.stdout:2/747: unlink d5/da/d1b/f26 0 2024-02-28T16:24:16.398 INFO:tasks.workunit.client.0.smithi023.stdout:0/662: symlink d6/db/d1a/d26/d31/d33/d37/d8f/ddf/le8 0 2024-02-28T16:24:16.398 INFO:tasks.workunit.client.0.smithi023.stdout:2/748: readlink d5/da/d1b/d3f/l4d 0 2024-02-28T16:24:16.401 INFO:tasks.workunit.client.0.smithi023.stdout:5/927: creat d1/d2a/d32/ddc/f12f x:0 0 0 2024-02-28T16:24:16.404 INFO:tasks.workunit.client.0.smithi023.stdout:2/749: mknod d5/da/d1b/cec 0 2024-02-28T16:24:16.404 INFO:tasks.workunit.client.0.smithi023.stdout:6/753: truncate d1/d28/f5f 305900 0 2024-02-28T16:24:16.406 INFO:tasks.workunit.client.0.smithi023.stdout:7/628: truncate de/f38 764442 0 2024-02-28T16:24:16.407 INFO:tasks.workunit.client.0.smithi023.stdout:1/690: dwrite df/d11/d13/d1b/d30/f41 [0,4194304] 0 2024-02-28T16:24:16.407 INFO:tasks.workunit.client.0.smithi023.stdout:6/754: write d1/d18/f107 [716155,68192] 0 2024-02-28T16:24:16.409 INFO:tasks.workunit.client.0.smithi023.stdout:7/629: fdatasync de/d9b/fa8 0 2024-02-28T16:24:16.414 INFO:tasks.workunit.client.0.smithi023.stdout:7/630: mknod de/d13/d1b/d3f/ccb 0 2024-02-28T16:24:16.418 INFO:tasks.workunit.client.0.smithi023.stdout:5/928: link d1/d2a/d32/de0/ce4 d1/d2a/d32/d37/d3a/d7f/dca/c130 0 2024-02-28T16:24:16.420 INFO:tasks.workunit.client.0.smithi023.stdout:6/755: link d1/d28/f62 d1/d28/d1e/f111 0 2024-02-28T16:24:16.424 INFO:tasks.workunit.client.0.smithi023.stdout:7/631: creat de/d1c/d76/fcc x:0 0 0 2024-02-28T16:24:16.427 INFO:tasks.workunit.client.0.smithi023.stdout:7/632: chown de/d13/c48 867 1 2024-02-28T16:24:16.430 INFO:tasks.workunit.client.0.smithi023.stdout:5/929: truncate d1/d2a/d32/d37/d3a/d7f/d62/dd1/fe9 3356377 0 2024-02-28T16:24:16.431 INFO:tasks.workunit.client.0.smithi023.stdout:6/756: dread d1/d28/d1e/d52/fc5 [0,4194304] 0 2024-02-28T16:24:16.433 INFO:tasks.workunit.client.0.smithi023.stdout:2/750: write d5/da/d1b/f36 [60915,78486] 0 2024-02-28T16:24:16.434 INFO:tasks.workunit.client.0.smithi023.stdout:1/691: rmdir df/d11/d13/d1b/d30/d57/d5a/d68/ddd/de1 0 2024-02-28T16:24:16.438 INFO:tasks.workunit.client.0.smithi023.stdout:2/751: fdatasync d5/da/db/d17/d3c/d7f/fd5 0 2024-02-28T16:24:16.441 INFO:tasks.workunit.client.0.smithi023.stdout:5/930: rmdir d1/d2a/d32/d37/d3a/d7f/d62/d68 39 2024-02-28T16:24:16.444 INFO:tasks.workunit.client.0.smithi023.stdout:1/692: mkdir df/d11/d13/d1b/d30/dae/dea 0 2024-02-28T16:24:16.449 INFO:tasks.workunit.client.0.smithi023.stdout:2/752: unlink d5/da/f54 0 2024-02-28T16:24:16.449 INFO:tasks.workunit.client.0.smithi023.stdout:5/931: truncate d1/d2a/d32/d37/d4e/db5/dc6/fde 951051 0 2024-02-28T16:24:16.452 INFO:tasks.workunit.client.0.smithi023.stdout:2/753: stat d5/da/db/d17/d73/dd0/f30 0 2024-02-28T16:24:16.452 INFO:tasks.workunit.client.0.smithi023.stdout:2/754: stat d5/f7a 0 2024-02-28T16:24:16.454 INFO:tasks.workunit.client.0.smithi023.stdout:5/932: fdatasync d1/d2a/d32/d37/d4e/db5/fcf 0 2024-02-28T16:24:16.457 INFO:tasks.workunit.client.0.smithi023.stdout:6/757: dread d1/f1c [0,4194304] 0 2024-02-28T16:24:16.458 INFO:tasks.workunit.client.0.smithi023.stdout:7/633: chown de/f38 207789 1 2024-02-28T16:24:16.463 INFO:tasks.workunit.client.0.smithi023.stdout:2/755: rename d5/da/db/c7e to d5/da/d8c/dd3/ced 0 2024-02-28T16:24:16.466 INFO:tasks.workunit.client.0.smithi023.stdout:1/693: dwrite df/d11/d8a/fa8 [0,4194304] 0 2024-02-28T16:24:16.467 INFO:tasks.workunit.client.0.smithi023.stdout:6/758: dread d1/fd7 [0,4194304] 0 2024-02-28T16:24:16.469 INFO:tasks.workunit.client.0.smithi023.stdout:2/756: chown d5/da/db/d17/d73/dd0/f88 1 1 2024-02-28T16:24:16.471 INFO:tasks.workunit.client.0.smithi023.stdout:7/634: fsync de/d13/d1b/d40/f44 0 2024-02-28T16:24:16.471 INFO:tasks.workunit.client.0.smithi023.stdout:1/694: chown df/dbd/d6c/c92 17904 1 2024-02-28T16:24:16.473 INFO:tasks.workunit.client.0.smithi023.stdout:6/759: creat d1/d3d/f112 x:0 0 0 2024-02-28T16:24:16.476 INFO:tasks.workunit.client.0.smithi023.stdout:2/757: mknod d5/da/d1b/d3f/cee 0 2024-02-28T16:24:16.477 INFO:tasks.workunit.client.0.smithi023.stdout:6/760: read d1/d3d/f55 [3254235,89153] 0 2024-02-28T16:24:16.483 INFO:tasks.workunit.client.0.smithi023.stdout:1/695: truncate df/d26/f35 612281 0 2024-02-28T16:24:16.487 INFO:tasks.workunit.client.0.smithi023.stdout:7/635: read de/d13/d1b/d6c/f71 [3877083,37171] 0 2024-02-28T16:24:16.488 INFO:tasks.workunit.client.0.smithi023.stdout:1/696: write df/d11/d13/d1b/d30/d57/f85 [1286872,91483] 0 2024-02-28T16:24:16.494 INFO:tasks.workunit.client.0.smithi023.stdout:1/697: stat df/d11/d13/d1b/d2e/d5c/cdf 0 2024-02-28T16:24:16.500 INFO:tasks.workunit.client.0.smithi023.stdout:1/698: mknod df/d11/d13/d99/ceb 0 2024-02-28T16:24:16.508 INFO:tasks.workunit.client.0.smithi023.stdout:2/758: write d5/da/db/d17/d73/d9e/da0/d8b/f9d [821569,23242] 0 2024-02-28T16:24:16.513 INFO:tasks.workunit.client.0.smithi023.stdout:5/933: dread d1/d2a/d32/d58/d60/d82/f94 [0,4194304] 0 2024-02-28T16:24:16.513 INFO:tasks.workunit.client.0.smithi023.stdout:7/636: getdents de/d8b/d95/d98 0 2024-02-28T16:24:16.515 INFO:tasks.workunit.client.0.smithi023.stdout:2/759: write d5/da/db/d17/d73/dd0/f95 [4702550,119614] 0 2024-02-28T16:24:16.518 INFO:tasks.workunit.client.0.smithi023.stdout:1/699: write df/d11/d13/d1b/d30/f69 [3499436,76005] 0 2024-02-28T16:24:16.529 INFO:tasks.workunit.client.0.smithi023.stdout:2/760: dread d5/da/db/d17/d3c/faf [0,4194304] 0 2024-02-28T16:24:16.532 INFO:tasks.workunit.client.0.smithi023.stdout:5/934: write d1/d2a/d32/d37/d3a/d7f/f24 [158336,93131] 0 2024-02-28T16:24:16.532 INFO:tasks.workunit.client.0.smithi023.stdout:6/761: dread d1/fd [0,4194304] 0 2024-02-28T16:24:16.536 INFO:tasks.workunit.client.0.smithi023.stdout:7/637: dwrite de/f82 [0,4194304] 0 2024-02-28T16:24:16.536 INFO:tasks.workunit.client.0.smithi023.stdout:2/761: truncate d5/fae 333369 0 2024-02-28T16:24:16.540 INFO:tasks.workunit.client.0.smithi023.stdout:5/935: chown d1/d2a/d32/d37/lf7 487 1 2024-02-28T16:24:16.543 INFO:tasks.workunit.client.0.smithi023.stdout:7/638: symlink de/d1c/d76/lcd 0 2024-02-28T16:24:16.543 INFO:tasks.workunit.client.0.smithi023.stdout:2/762: dread - d5/da/db/d17/d73/d9e/da0/d8b/fb0 zero size 2024-02-28T16:24:16.545 INFO:tasks.workunit.client.0.smithi023.stdout:5/936: readlink d1/d2a/d32/d37/d3a/d7f/d62/d7b/lbf 0 2024-02-28T16:24:16.545 INFO:tasks.workunit.client.0.smithi023.stdout:6/762: creat d1/d28/d1e/d2b/d44/da4/d106/f113 x:0 0 0 2024-02-28T16:24:16.549 INFO:tasks.workunit.client.0.smithi023.stdout:1/700: dwrite df/d11/d13/d1b/f40 [0,4194304] 0 2024-02-28T16:24:16.551 INFO:tasks.workunit.client.0.smithi023.stdout:5/937: chown d1/d2a/d32/d58/d60/d88/cc5 25001128 1 2024-02-28T16:24:16.553 INFO:tasks.workunit.client.0.smithi023.stdout:7/639: unlink de/d13/d1b/d6c/l81 0 2024-02-28T16:24:16.559 INFO:tasks.workunit.client.0.smithi023.stdout:1/701: rename df/dbd/f81 to df/d93/fec 0 2024-02-28T16:24:16.564 INFO:tasks.workunit.client.0.smithi023.stdout:7/640: dread - de/d1c/f83 zero size 2024-02-28T16:24:16.568 INFO:tasks.workunit.client.0.smithi023.stdout:5/938: rename d1/d2a/d32/d58/d60/d88/ldf to d1/d2a/d32/d58/d73/l131 0 2024-02-28T16:24:16.569 INFO:tasks.workunit.client.0.smithi023.stdout:2/763: dread d5/f7a [0,4194304] 0 2024-02-28T16:24:16.572 INFO:tasks.workunit.client.0.smithi023.stdout:6/763: getdents d1/d28/d1e/d2b/d76/d9e 0 2024-02-28T16:24:16.578 INFO:tasks.workunit.client.0.smithi023.stdout:6/764: mkdir d1/d4f/d114 0 2024-02-28T16:24:16.584 INFO:tasks.workunit.client.0.smithi023.stdout:1/702: rename df/d11/d13/d1b/d30/d57/d5a/d68/fbc to df/dbd/d6c/fed 0 2024-02-28T16:24:16.585 INFO:tasks.workunit.client.0.smithi023.stdout:5/939: creat d1/d2a/d32/de0/f132 x:0 0 0 2024-02-28T16:24:16.587 INFO:tasks.workunit.client.0.smithi023.stdout:7/641: dwrite de/d1c/d76/f7f [0,4194304] 0 2024-02-28T16:24:16.588 INFO:tasks.workunit.client.0.smithi023.stdout:6/765: fdatasync d1/d28/d1e/d2b/d44/d86/fa2 0 2024-02-28T16:24:16.589 INFO:tasks.workunit.client.0.smithi023.stdout:7/642: truncate de/fae 578691 0 2024-02-28T16:24:16.590 INFO:tasks.workunit.client.0.smithi023.stdout:5/940: chown d1/d2a/d32/d6e/l12a 3 1 2024-02-28T16:24:16.591 INFO:tasks.workunit.client.0.smithi023.stdout:1/703: symlink df/d11/d13/d1b/d30/d57/d5a/d68/d6f/lee 0 2024-02-28T16:24:16.592 INFO:tasks.workunit.client.0.smithi023.stdout:6/766: stat d1/d28/d1e/d2b/d6d/fc8 0 2024-02-28T16:24:16.594 INFO:tasks.workunit.client.0.smithi023.stdout:7/643: readlink de/d8b/d95/d98/l9f 0 2024-02-28T16:24:16.596 INFO:tasks.workunit.client.0.smithi023.stdout:2/764: rename d5/da/db/d17/d73/d9e/da0/d8b to d5/da/db/d17/d73/d9e/da0/def 0 2024-02-28T16:24:16.598 INFO:tasks.workunit.client.0.smithi023.stdout:5/941: symlink d1/d2a/d32/d37/d3a/d7f/l133 0 2024-02-28T16:24:16.606 INFO:tasks.workunit.client.0.smithi023.stdout:2/765: dread - d5/da/d1b/f85 zero size 2024-02-28T16:24:16.607 INFO:tasks.workunit.client.0.smithi023.stdout:7/644: mkdir de/d13/d1b/dce 0 2024-02-28T16:24:16.609 INFO:tasks.workunit.client.0.smithi023.stdout:1/704: mknod df/d11/d13/d1b/d30/d57/d5a/d68/ddd/cef 0 2024-02-28T16:24:16.613 INFO:tasks.workunit.client.0.smithi023.stdout:7/645: write de/d60/f64 [3605895,127085] 0 2024-02-28T16:24:16.615 INFO:tasks.workunit.client.0.smithi023.stdout:2/766: truncate d5/da/f15 2784830 0 2024-02-28T16:24:16.618 INFO:tasks.workunit.client.0.smithi023.stdout:5/942: fsync d1/d2a/d32/d37/d4e/f70 0 2024-02-28T16:24:16.620 INFO:tasks.workunit.client.0.smithi023.stdout:2/767: symlink d5/da/db/lf0 0 2024-02-28T16:24:16.620 INFO:tasks.workunit.client.0.smithi023.stdout:1/705: mknod df/dbd/d6c/dd3/cf0 0 2024-02-28T16:24:16.620 INFO:tasks.workunit.client.0.smithi023.stdout:7/646: symlink de/d13/d1b/d3d/lcf 0 2024-02-28T16:24:16.621 INFO:tasks.workunit.client.0.smithi023.stdout:1/706: stat la 0 2024-02-28T16:24:16.621 INFO:tasks.workunit.client.0.smithi023.stdout:6/767: dwrite d1/d28/ffe [0,4194304] 0 2024-02-28T16:24:16.624 INFO:tasks.workunit.client.0.smithi023.stdout:7/647: dread - de/d13/d1b/d3d/d53/f73 zero size 2024-02-28T16:24:16.627 INFO:tasks.workunit.client.0.smithi023.stdout:1/707: stat df/d11/d13/d1b/d30/f69 0 2024-02-28T16:24:16.630 INFO:tasks.workunit.client.0.smithi023.stdout:2/768: rename d5/da/db/d17/d3c/faf to d5/da/d1b/d3f/d75/ff1 0 2024-02-28T16:24:16.641 INFO:tasks.workunit.client.0.smithi023.stdout:2/769: unlink d5/da/db/d17/fe8 0 2024-02-28T16:24:16.646 INFO:tasks.workunit.client.0.smithi023.stdout:7/648: creat de/fd0 x:0 0 0 2024-02-28T16:24:16.648 INFO:tasks.workunit.client.0.smithi023.stdout:5/943: truncate d1/d2a/d32/d37/d4e/db5/dc6/ff0 1263600 0 2024-02-28T16:24:16.649 INFO:tasks.workunit.client.0.smithi023.stdout:6/768: getdents d1/d18/d26/d6a 0 2024-02-28T16:24:16.650 INFO:tasks.workunit.client.0.smithi023.stdout:1/708: write df/dbd/d6c/fed [427129,56962] 0 2024-02-28T16:24:16.662 INFO:tasks.workunit.client.0.smithi023.stdout:8/731: sync 2024-02-28T16:24:16.675 INFO:tasks.workunit.client.0.smithi023.stdout:6/769: write d1/d18/d26/d6a/f98 [3832039,75500] 0 2024-02-28T16:24:16.678 INFO:tasks.workunit.client.0.smithi023.stdout:1/709: creat df/d11/d13/d1b/d30/de9/ff1 x:0 0 0 2024-02-28T16:24:16.678 INFO:tasks.workunit.client.0.smithi023.stdout:6/770: truncate d1/d3d/f112 542407 0 2024-02-28T16:24:16.679 INFO:tasks.workunit.client.0.smithi023.stdout:5/944: rename d1/d2a/lb8 to d1/d2a/d32/d37/d3a/d7f/l134 0 2024-02-28T16:24:16.681 INFO:tasks.workunit.client.0.smithi023.stdout:7/649: link de/d13/d1b/d3f/c61 de/d13/d1b/d6c/db6/cd1 0 2024-02-28T16:24:16.684 INFO:tasks.workunit.client.0.smithi023.stdout:2/770: getdents d5/da/d62 0 2024-02-28T16:24:16.685 INFO:tasks.workunit.client.0.smithi023.stdout:1/710: write df/dbd/f50 [1106847,100829] 0 2024-02-28T16:24:16.686 INFO:tasks.workunit.client.0.smithi023.stdout:6/771: symlink d1/d18/d26/l115 0 2024-02-28T16:24:16.689 INFO:tasks.workunit.client.0.smithi023.stdout:2/771: write d5/da/db/d17/d73/d9e/da0/def/fb0 [1036448,63068] 0 2024-02-28T16:24:16.694 INFO:tasks.workunit.client.0.smithi023.stdout:6/772: readlink d1/d18/d26/d6a/ldd 0 2024-02-28T16:24:16.699 INFO:tasks.workunit.client.0.smithi023.stdout:2/772: write d5/da/db/d17/d3c/d7f/dc6/dd9/fdb [476040,71663] 0 2024-02-28T16:24:16.703 INFO:tasks.workunit.client.0.smithi023.stdout:5/945: dwrite d1/d2a/d32/d58/d73/fe1 [0,4194304] 0 2024-02-28T16:24:16.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.718+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1854061190 con 0x7f183806d650 2024-02-28T16:24:16.710 INFO:tasks.workunit.client.0.smithi023.stdout:1/711: getdents df/d11/d13/d1b/d30 0 2024-02-28T16:24:16.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.720+0000 7f1850c00700 1 -- 172.21.15.23:0/1199486607 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1854061190 con 0x7f183806d650 2024-02-28T16:24:16.713 INFO:tasks.workunit.client.0.smithi023.stdout:6/773: mknod d1/d28/d1e/d80/d109/c116 0 2024-02-28T16:24:16.714 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.724+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f183806d650 msgr2=0x7f183806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.714 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.724+0000 7f185ac00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f183806d650 0x7f183806fb00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1844005950 tx=0x7f184400b410 comp rx=0 tx=0).stop 2024-02-28T16:24:16.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.725+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 msgr2=0x7f185419c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.725+0000 7f185ac00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f185419c5c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1840005b40 tx=0x7f184000bd70 comp rx=0 tx=0).stop 2024-02-28T16:24:16.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.725+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 shutdown_connections 2024-02-28T16:24:16.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.725+0000 7f185ac00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1854102450 0x7f185419c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.725+0000 7f185ac00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f183806d650 0x7f183806fb00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.725+0000 7f185ac00700 1 --2- 172.21.15.23:0/1199486607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f18541036f0 0x7f185419c5c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.725+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 >> 172.21.15.23:0/1199486607 conn(0x7f18540fdac0 msgr2=0x7f18540786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:16.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.726+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 shutdown_connections 2024-02-28T16:24:16.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.726+0000 7f185ac00700 1 -- 172.21.15.23:0/1199486607 wait complete. 2024-02-28T16:24:16.716 INFO:tasks.workunit.client.0.smithi023.stdout:2/773: symlink d5/da/db/d17/d3c/d7f/dc6/dd9/lf2 0 2024-02-28T16:24:16.717 INFO:tasks.workunit.client.0.smithi023.stdout:2/774: fdatasync d5/da/d62/fb8 0 2024-02-28T16:24:16.718 INFO:tasks.workunit.client.0.smithi023.stdout:1/712: rmdir df/d11/d13/d1b/d30/d57/d8d 39 2024-02-28T16:24:16.722 INFO:tasks.workunit.client.0.smithi023.stdout:2/775: mknod d5/da/db/d17/d3c/d7f/cf3 0 2024-02-28T16:24:16.725 INFO:tasks.workunit.client.0.smithi023.stdout:1/713: unlink df/d26/d48/db3/lb9 0 2024-02-28T16:24:16.728 INFO:tasks.workunit.client.0.smithi023.stdout:2/776: rmdir d5/da/db/d17/d39/d56 39 2024-02-28T16:24:16.732 INFO:tasks.workunit.client.0.smithi023.stdout:2/777: readlink d5/da/db/d17/d73/d9e/da0/def/l91 0 2024-02-28T16:24:16.732 INFO:tasks.workunit.client.0.smithi023.stdout:8/732: truncate d0/d5/d1a/f8b 1224460 0 2024-02-28T16:24:16.733 INFO:tasks.workunit.client.0.smithi023.stdout:1/714: dread df/d26/d48/f94 [0,4194304] 0 2024-02-28T16:24:16.734 INFO:tasks.workunit.client.0.smithi023.stdout:2/778: fdatasync d5/da/db/d17/d3c/d7f/fd5 0 2024-02-28T16:24:16.738 INFO:tasks.workunit.client.0.smithi023.stdout:1/715: rmdir df/d26 39 2024-02-28T16:24:16.753 INFO:tasks.workunit.client.0.smithi023.stdout:7/650: dwrite de/d13/d1b/d3d/faf [0,4194304] 0 2024-02-28T16:24:16.754 INFO:tasks.workunit.client.0.smithi023.stdout:1/716: link df/dbd/f6e df/d11/d13/d1b/d30/d57/d5a/d68/ddd/ff2 0 2024-02-28T16:24:16.762 INFO:tasks.workunit.client.0.smithi023.stdout:6/774: dread d1/d28/f70 [0,4194304] 0 2024-02-28T16:24:16.770 INFO:tasks.workunit.client.0.smithi023.stdout:7/651: rename de/d13/d1b/d40/f74 to de/d1c/fd2 0 2024-02-28T16:24:16.774 INFO:tasks.workunit.client.0.smithi023.stdout:8/733: dread d0/d5/f41 [0,4194304] 0 2024-02-28T16:24:16.778 INFO:tasks.workunit.client.0.smithi023.stdout:8/734: fsync d0/d5/d35/fc7 0 2024-02-28T16:24:16.778 INFO:tasks.workunit.client.0.smithi023.stdout:1/717: rename df/d11/d13/d1b/d30/d57/d5a/la4 to df/dcf/lf3 0 2024-02-28T16:24:16.778 INFO:tasks.workunit.client.0.smithi023.stdout:6/775: link d1/d28/d1e/d2b/d76/d9e/cac d1/d28/d1e/d2b/d6d/d7b/c117 0 2024-02-28T16:24:16.780 INFO:tasks.workunit.client.0.smithi023.stdout:7/652: mkdir de/d1c/d76/d7b/dd3 0 2024-02-28T16:24:16.782 INFO:tasks.workunit.client.0.smithi023.stdout:8/735: fsync d0/d5/d1a/f4b 0 2024-02-28T16:24:16.783 INFO:tasks.workunit.client.0.smithi023.stdout:2/779: dwrite d5/da/d1b/d3f/f53 [0,4194304] 0 2024-02-28T16:24:16.786 INFO:tasks.workunit.client.0.smithi023.stdout:6/776: mkdir d1/d28/d1e/d80/dc2/d118 0 2024-02-28T16:24:16.789 INFO:tasks.workunit.client.0.smithi023.stdout:6/777: read - d1/d28/d1e/d2b/d44/d101/f105 zero size 2024-02-28T16:24:16.790 INFO:tasks.workunit.client.0.smithi023.stdout:7/653: mkdir de/d13/d1b/d3d/dd4 0 2024-02-28T16:24:16.792 INFO:tasks.workunit.client.0.smithi023.stdout:1/718: mknod df/d11/d13/d1b/d30/d57/d8d/de4/cf4 0 2024-02-28T16:24:16.792 INFO:tasks.workunit.client.0.smithi023.stdout:2/780: chown d5/da/d45/cba 0 1 2024-02-28T16:24:16.797 INFO:tasks.workunit.client.0.smithi023.stdout:7/654: creat de/d13/d1b/d3d/fd5 x:0 0 0 2024-02-28T16:24:16.800 INFO:tasks.workunit.client.0.smithi023.stdout:1/719: symlink df/d11/d13/d1b/d2e/lf5 0 2024-02-28T16:24:16.805 INFO:tasks.workunit.client.0.smithi023.stdout:2/781: symlink d5/da/db/d17/d39/lf4 0 2024-02-28T16:24:16.808 INFO:tasks.workunit.client.0.smithi023.stdout:1/720: write df/d26/d48/f9d [3940884,21329] 0 2024-02-28T16:24:16.816 INFO:tasks.workunit.client.0.smithi023.stdout:1/721: fsync df/dbd/d7b/fc1 0 2024-02-28T16:24:16.823 INFO:tasks.workunit.client.0.smithi023.stdout:1/722: rmdir df/d11/d13/d27 39 2024-02-28T16:24:16.824 INFO:tasks.workunit.client.0.smithi023.stdout:7/655: dwrite de/d13/d1b/d6c/db6/fc2 [0,4194304] 0 2024-02-28T16:24:16.832 INFO:tasks.workunit.client.0.smithi023.stdout:6/778: dread d1/d18/f30 [0,4194304] 0 2024-02-28T16:24:16.837 INFO:tasks.workunit.client.0.smithi023.stdout:7/656: creat de/fd6 x:0 0 0 2024-02-28T16:24:16.837 INFO:tasks.workunit.client.0.smithi023.stdout:6/779: rmdir d1/d3d/df7 39 2024-02-28T16:24:16.840 INFO:tasks.workunit.client.0.smithi023.stdout:8/736: dwrite d0/d5/d35/f5d [0,4194304] 0 2024-02-28T16:24:16.841 INFO:tasks.workunit.client.0.smithi023.stdout:2/782: dwrite d5/da/db/d17/d39/d56/fad [4194304,4194304] 0 2024-02-28T16:24:16.852 INFO:tasks.workunit.client.0.smithi023.stdout:7/657: creat de/d13/d1b/d6c/fd7 x:0 0 0 2024-02-28T16:24:16.853 INFO:tasks.workunit.client.0.smithi023.stdout:6/780: creat d1/d18/d26/d3a/de0/f119 x:0 0 0 2024-02-28T16:24:16.858 INFO:tasks.workunit.client.0.smithi023.stdout:6/781: fsync d1/d18/fca 0 2024-02-28T16:24:16.867 INFO:tasks.workunit.client.0.smithi023.stdout:7/658: creat de/d1c/d76/d7b/dad/dc9/fd8 x:0 0 0 2024-02-28T16:24:16.867 INFO:tasks.workunit.client.0.smithi023.stdout:2/783: mknod d5/da/db/d17/d39/cf5 0 2024-02-28T16:24:16.872 INFO:tasks.workunit.client.0.smithi023.stdout:8/737: write d0/d5/d1b/d36/f85 [772713,129915] 0 2024-02-28T16:24:16.873 INFO:tasks.workunit.client.0.smithi023.stdout:7/659: creat de/d13/d1b/d6c/fd9 x:0 0 0 2024-02-28T16:24:16.875 INFO:tasks.workunit.client.0.smithi023.stdout:8/738: readlink d0/la 0 2024-02-28T16:24:16.881 INFO:tasks.workunit.client.0.smithi023.stdout:7/660: truncate de/d1c/f79 8439681 0 2024-02-28T16:24:16.883 INFO:tasks.workunit.client.0.smithi023.stdout:2/784: link d5/da/f5b d5/da/db/d17/d73/dd0/ff6 0 2024-02-28T16:24:16.884 INFO:tasks.workunit.client.0.smithi023.stdout:6/782: dwrite d1/d18/d26/d3a/de0/f119 [0,4194304] 0 2024-02-28T16:24:16.885 INFO:tasks.workunit.client.0.smithi023.stdout:6/783: chown d1/d28/d1e/d2b/d76 27948 1 2024-02-28T16:24:16.886 INFO:tasks.workunit.client.0.smithi023.stdout:2/785: chown d5/da/db/d17/d3c/le0 7853 1 2024-02-28T16:24:16.889 INFO:tasks.workunit.client.0.smithi023.stdout:6/784: write d1/d18/f8c [2057501,113843] 0 2024-02-28T16:24:16.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:16 smithi153 ceph-mon[35341]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:16.896 INFO:tasks.workunit.client.0.smithi023.stdout:2/786: symlink d5/da/d1b/d3f/d75/lf7 0 2024-02-28T16:24:16.900 INFO:tasks.workunit.client.0.smithi023.stdout:7/661: rename de/d60/f96 to de/d1c/fda 0 2024-02-28T16:24:16.902 INFO:tasks.workunit.client.0.smithi023.stdout:7/662: chown de/d1c/f79 0 1 2024-02-28T16:24:16.905 INFO:tasks.workunit.client.0.smithi023.stdout:2/787: write d5/f7a [1531387,97621] 0 2024-02-28T16:24:16.907 INFO:tasks.workunit.client.0.smithi023.stdout:6/785: link d1/d28/d1e/d2b/d44/d101/f105 d1/d18/dd8/de8/ded/f11a 0 2024-02-28T16:24:16.912 INFO:tasks.workunit.client.0.smithi023.stdout:7/663: mkdir de/d1c/ddb 0 2024-02-28T16:24:16.914 INFO:tasks.workunit.client.0.smithi023.stdout:7/664: fdatasync de/d1c/d76/d7b/dad/dc9/fd8 0 2024-02-28T16:24:16.915 INFO:tasks.workunit.client.0.smithi023.stdout:2/788: write d5/da/db/d17/d73/dd0/d52/fcf [1722641,80556] 0 2024-02-28T16:24:16.917 INFO:tasks.workunit.client.0.smithi023.stdout:6/786: creat d1/d18/f11b x:0 0 0 2024-02-28T16:24:16.918 INFO:tasks.workunit.client.0.smithi023.stdout:8/739: dread d0/d5/d1b/f43 [0,4194304] 0 2024-02-28T16:24:16.922 INFO:tasks.workunit.client.0.smithi023.stdout:6/787: dread d1/d18/d26/d3a/f97 [0,4194304] 0 2024-02-28T16:24:16.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:16 smithi023 ceph-mon[29137]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:16.923 INFO:tasks.workunit.client.0.smithi023.stdout:7/665: creat de/d1c/d76/d7b/dd3/fdc x:0 0 0 2024-02-28T16:24:16.923 INFO:tasks.workunit.client.0.smithi023.stdout:4/655: sync 2024-02-28T16:24:16.923 INFO:tasks.workunit.client.0.smithi023.stdout:2/789: creat d5/da/d8c/ff8 x:0 0 0 2024-02-28T16:24:16.924 INFO:tasks.workunit.client.0.smithi023.stdout:9/671: sync 2024-02-28T16:24:16.924 INFO:tasks.workunit.client.0.smithi023.stdout:3/739: sync 2024-02-28T16:24:16.924 INFO:tasks.workunit.client.0.smithi023.stdout:0/663: sync 2024-02-28T16:24:16.930 INFO:tasks.workunit.client.0.smithi023.stdout:9/672: write d0/d7/de/d34/f35 [3833838,83748] 0 2024-02-28T16:24:16.932 INFO:tasks.workunit.client.0.smithi023.stdout:2/790: unlink d5/f7a 0 2024-02-28T16:24:16.939 INFO:tasks.workunit.client.0.smithi023.stdout:4/656: creat d13/d2b/d9d/fd1 x:0 0 0 2024-02-28T16:24:16.940 INFO:tasks.workunit.client.0.smithi023.stdout:8/740: dwrite d0/d5/f7e [0,4194304] 0 2024-02-28T16:24:16.944 INFO:tasks.workunit.client.0.smithi023.stdout:8/741: dread - d0/d5/ddc/de2/ff3 zero size 2024-02-28T16:24:16.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.955+0000 7fb01c200700 1 -- 172.21.15.23:0/1599782934 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0141003d0 msgr2=0x7fb014100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.955+0000 7fb01c200700 1 --2- 172.21.15.23:0/1599782934 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0141003d0 0x7fb014100840 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb000009910 tx=0x7fb000009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:16.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.956+0000 7fb01c200700 1 -- 172.21.15.23:0/1599782934 shutdown_connections 2024-02-28T16:24:16.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.956+0000 7fb01c200700 1 --2- 172.21.15.23:0/1599782934 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0141003d0 0x7fb014100840 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.956+0000 7fb01c200700 1 --2- 172.21.15.23:0/1599782934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0140ff130 0x7fb0140ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.956+0000 7fb01c200700 1 -- 172.21.15.23:0/1599782934 >> 172.21.15.23:0/1599782934 conn(0x7fb0140fa780 msgr2=0x7fb0140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:16.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.956+0000 7fb01c200700 1 -- 172.21.15.23:0/1599782934 shutdown_connections 2024-02-28T16:24:16.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.957+0000 7fb01c200700 1 -- 172.21.15.23:0/1599782934 wait complete. 2024-02-28T16:24:16.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.958+0000 7fb01c200700 1 Processor -- start 2024-02-28T16:24:16.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.958+0000 7fb01c200700 1 -- start start 2024-02-28T16:24:16.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.959+0000 7fb01c200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0140ff130 0x7fb014193820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:16.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.959+0000 7fb01c200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0141003d0 0x7fb014193d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:16.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.959+0000 7fb01c200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014194380 con 0x7fb0140ff130 2024-02-28T16:24:16.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.960+0000 7fb01c200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0141944c0 con 0x7fb0141003d0 2024-02-28T16:24:16.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.960+0000 7fb018e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0141003d0 0x7fb014193d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:16.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.960+0000 7fb018e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0141003d0 0x7fb014193d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:45942/0 (socket says 172.21.15.23:45942) 2024-02-28T16:24:16.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.960+0000 7fb018e00700 1 -- 172.21.15.23:0/2890244635 learned_addr learned my addr 172.21.15.23:0/2890244635 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:16.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.961+0000 7fb018e00700 1 -- 172.21.15.23:0/2890244635 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0140ff130 msgr2=0x7fb014193820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:16.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.961+0000 7fb018e00700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0140ff130 0x7fb014193820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:16.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.961+0000 7fb018e00700 1 -- 172.21.15.23:0/2890244635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000095f0 con 0x7fb0141003d0 2024-02-28T16:24:16.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.961+0000 7fb018e00700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0141003d0 0x7fb014193d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0000092e0 tx=0x7fb00000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:16.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.962+0000 7fb012000700 1 -- 172.21.15.23:0/2890244635 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00001d070 con 0x7fb0141003d0 2024-02-28T16:24:16.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.962+0000 7fb012000700 1 -- 172.21.15.23:0/2890244635 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb0000052a0 con 0x7fb0141003d0 2024-02-28T16:24:16.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.962+0000 7fb012000700 1 -- 172.21.15.23:0/2890244635 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb000017610 con 0x7fb0141003d0 2024-02-28T16:24:16.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.962+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb014198f10 con 0x7fb0141003d0 2024-02-28T16:24:16.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.962+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb014199380 con 0x7fb0141003d0 2024-02-28T16:24:16.954 INFO:tasks.workunit.client.0.smithi023.stdout:2/791: creat d5/da/db/d17/d3c/d7f/ff9 x:0 0 0 2024-02-28T16:24:16.954 INFO:tasks.workunit.client.0.smithi023.stdout:8/742: dread d0/d5/f26 [0,4194304] 0 2024-02-28T16:24:16.954 INFO:tasks.workunit.client.0.smithi023.stdout:9/673: chown d0/d7/d2c/d84/cd0 743783 1 2024-02-28T16:24:16.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.966+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb014106ae0 con 0x7fb0141003d0 2024-02-28T16:24:16.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.967+0000 7fb012000700 1 -- 172.21.15.23:0/2890244635 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 26) v1 ==== 91442+0+0 (secure 0 0 0) 0x7fb000017830 con 0x7fb0141003d0 2024-02-28T16:24:16.958 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.969+0000 7fb012000700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7faffc06d760 0x7faffc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:16.959 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.969+0000 7fb012000700 1 -- 172.21.15.23:0/2890244635 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb00008e4f0 con 0x7fb0141003d0 2024-02-28T16:24:16.959 INFO:tasks.workunit.client.0.smithi023.stdout:4/657: write d13/fae [2829032,47300] 0 2024-02-28T16:24:16.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.971+0000 7fb019800700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7faffc06d760 0x7faffc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:16.962 INFO:tasks.workunit.client.0.smithi023.stdout:2/792: chown d5/da/l31 89373626 1 2024-02-28T16:24:16.962 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.973+0000 7fb019800700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7faffc06d760 0x7faffc06fc10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb00800bd00 tx=0x7fb00800d040 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:16.962 INFO:tasks.workunit.client.0.smithi023.stdout:6/788: write d1/d18/f90 [1715604,61959] 0 2024-02-28T16:24:16.963 INFO:tasks.workunit.client.0.smithi023.stdout:0/664: unlink d6/db/d3b/l9f 0 2024-02-28T16:24:16.964 INFO:tasks.workunit.client.0.smithi023.stdout:3/740: write d1/fdb [215802,62961] 0 2024-02-28T16:24:16.965 INFO:tasks.workunit.client.0.smithi023.stdout:7/666: dwrite de/d60/f64 [0,4194304] 0 2024-02-28T16:24:16.965 INFO:tasks.workunit.client.0.smithi023.stdout:8/743: unlink d0/d5/d1b/l9b 0 2024-02-28T16:24:16.968 INFO:tasks.workunit.client.0.smithi023.stdout:4/658: write d13/d2b/f4f [2202787,3751] 0 2024-02-28T16:24:16.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:16.979+0000 7fb012000700 1 -- 172.21.15.23:0/2890244635 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb00005bc90 con 0x7fb0141003d0 2024-02-28T16:24:16.970 INFO:tasks.workunit.client.0.smithi023.stdout:0/665: read d6/db/dab/d82/d72/d79/fbb [459906,78096] 0 2024-02-28T16:24:16.973 INFO:tasks.workunit.client.0.smithi023.stdout:0/666: write d6/db/d1a/f80 [3659506,90347] 0 2024-02-28T16:24:16.973 INFO:tasks.workunit.client.0.smithi023.stdout:7/667: stat de/d13/fc1 0 2024-02-28T16:24:16.974 INFO:tasks.workunit.client.0.smithi023.stdout:4/659: chown d13/d2b/d9d/fd1 35725975 1 2024-02-28T16:24:16.979 INFO:tasks.workunit.client.0.smithi023.stdout:3/741: unlink d1/d4a/c80 0 2024-02-28T16:24:16.980 INFO:tasks.workunit.client.0.smithi023.stdout:6/789: symlink d1/d28/d1e/d2b/d44/da4/l11c 0 2024-02-28T16:24:16.987 INFO:tasks.workunit.client.0.smithi023.stdout:7/668: creat de/d1c/d76/d7b/dad/fdd x:0 0 0 2024-02-28T16:24:16.995 INFO:tasks.workunit.client.0.smithi023.stdout:6/790: rename d1/d18/d26/da6 to d1/d18/dd8/de8/ded/d11d 0 2024-02-28T16:24:16.996 INFO:tasks.workunit.client.0.smithi023.stdout:2/793: creat d5/da/ffa x:0 0 0 2024-02-28T16:24:17.001 INFO:tasks.workunit.client.0.smithi023.stdout:9/674: dwrite d0/d7/de/d2a/daf/fa5 [0,4194304] 0 2024-02-28T16:24:17.014 INFO:tasks.workunit.client.0.smithi023.stdout:3/742: rename d1/df/f60 to d1/df/d2d/d45/d52/d65/f105 0 2024-02-28T16:24:17.019 INFO:tasks.workunit.client.0.smithi023.stdout:0/667: getdents d6/db/d3b 0 2024-02-28T16:24:17.019 INFO:tasks.workunit.client.0.smithi023.stdout:5/946: sync 2024-02-28T16:24:17.027 INFO:tasks.workunit.client.0.smithi023.stdout:5/947: chown d1/d2a/d32/d6e/d11f 223427 1 2024-02-28T16:24:17.030 INFO:tasks.workunit.client.0.smithi023.stdout:8/744: dwrite d0/d5/d1a/d63/d90/fae [0,4194304] 0 2024-02-28T16:24:17.031 INFO:tasks.workunit.client.0.smithi023.stdout:4/660: link d13/c21 d13/d2b/d9d/cd2 0 2024-02-28T16:24:17.039 INFO:tasks.workunit.client.0.smithi023.stdout:6/791: rename d1/d28/d1e/d2b/d6d/l83 to d1/d18/d26/d3a/l11e 0 2024-02-28T16:24:17.047 INFO:tasks.workunit.client.0.smithi023.stdout:0/668: write d6/db/d1a/d35/fa7 [471550,41813] 0 2024-02-28T16:24:17.048 INFO:tasks.workunit.client.0.smithi023.stdout:3/743: dwrite d1/df/d33/d38/f43 [0,4194304] 0 2024-02-28T16:24:17.051 INFO:tasks.workunit.client.0.smithi023.stdout:7/669: dread de/d1c/f5a [0,4194304] 0 2024-02-28T16:24:17.052 INFO:tasks.workunit.client.0.smithi023.stdout:9/675: mkdir d0/d7/db/dec 0 2024-02-28T16:24:17.054 INFO:tasks.workunit.client.0.smithi023.stdout:2/794: write d5/da/db/d17/d73/d9e/da0/fa6 [672527,66124] 0 2024-02-28T16:24:17.065 INFO:tasks.workunit.client.0.smithi023.stdout:4/661: chown d13/d1d/d2e/l3d 2465632 1 2024-02-28T16:24:17.066 INFO:tasks.workunit.client.0.smithi023.stdout:8/745: truncate d0/d5/f26 864344 0 2024-02-28T16:24:17.076 INFO:tasks.workunit.client.0.smithi023.stdout:0/669: rename d6/db/d1a/d26/d31/da8/fc7 to d6/d4c/d6a/fe9 0 2024-02-28T16:24:17.079 INFO:tasks.workunit.client.0.smithi023.stdout:9/676: truncate d0/d7/db/fc 5552724 0 2024-02-28T16:24:17.089 INFO:tasks.workunit.client.0.smithi023.stdout:2/795: dread d5/da/db/d17/d73/dd0/f30 [0,4194304] 0 2024-02-28T16:24:17.089 INFO:tasks.workunit.client.0.smithi023.stdout:8/746: creat d0/d5/d1a/d44/ff5 x:0 0 0 2024-02-28T16:24:17.089 INFO:tasks.workunit.client.0.smithi023.stdout:6/792: mkdir d1/d28/d11f 0 2024-02-28T16:24:17.095 INFO:tasks.workunit.client.0.smithi023.stdout:0/670: chown d6/db/d1a/d59/c8d 1068 1 2024-02-28T16:24:17.097 INFO:tasks.workunit.client.0.smithi023.stdout:3/744: dwrite d1/d74/de1/db5/fbf [0,4194304] 0 2024-02-28T16:24:17.101 INFO:tasks.workunit.client.0.smithi023.stdout:5/948: dwrite d1/d2a/d32/d58/d79/fac [0,4194304] 0 2024-02-28T16:24:17.102 INFO:tasks.workunit.client.0.smithi023.stdout:0/671: write d6/db/d3d/f70 [477341,101630] 0 2024-02-28T16:24:17.122 INFO:tasks.workunit.client.0.smithi023.stdout:5/949: unlink d1/d2a/d32/d36/c87 0 2024-02-28T16:24:17.129 INFO:tasks.workunit.client.0.smithi023.stdout:4/662: dwrite d13/d2b/d2c/d31/f48 [0,4194304] 0 2024-02-28T16:24:17.131 INFO:tasks.workunit.client.0.smithi023.stdout:0/672: link d6/db/fd2 d6/db/d1a/d26/fea 0 2024-02-28T16:24:17.132 INFO:tasks.workunit.client.0.smithi023.stdout:8/747: dread d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/f95 [0,4194304] 0 2024-02-28T16:24:17.132 INFO:tasks.workunit.client.0.smithi023.stdout:5/950: write d1/d2a/d32/d37/f59 [2384015,103196] 0 2024-02-28T16:24:17.136 INFO:tasks.workunit.client.0.smithi023.stdout:2/796: link d5/da/d45/f68 d5/da/db/d17/d73/d9e/da0/ffb 0 2024-02-28T16:24:17.142 INFO:tasks.workunit.client.0.smithi023.stdout:8/748: write d0/d5/d1a/d63/fcf [223069,56217] 0 2024-02-28T16:24:17.145 INFO:tasks.workunit.client.0.smithi023.stdout:5/951: creat d1/d2a/d32/d6e/f135 x:0 0 0 2024-02-28T16:24:17.147 INFO:tasks.workunit.client.0.smithi023.stdout:2/797: write d5/da/db/d17/d73/d9e/da0/fc7 [1718237,65931] 0 2024-02-28T16:24:17.148 INFO:tasks.workunit.client.0.smithi023.stdout:5/952: chown d1/d2a/d32/ddc/f100 1103 1 2024-02-28T16:24:17.150 INFO:tasks.workunit.client.0.smithi023.stdout:8/749: write d0/d5/d1a/d44/ff5 [917595,84777] 0 2024-02-28T16:24:17.159 INFO:tasks.workunit.client.0.smithi023.stdout:2/798: rmdir d5/da/db/d17/d73/dd0/d52 39 2024-02-28T16:24:17.161 INFO:tasks.workunit.client.0.smithi023.stdout:3/745: dread d1/df/d33/d38/d6c/df5/df7/fc3 [0,4194304] 0 2024-02-28T16:24:17.166 INFO:tasks.workunit.client.0.smithi023.stdout:9/677: dread d0/d7/db/d18/f25 [0,4194304] 0 2024-02-28T16:24:17.168 INFO:tasks.workunit.client.0.smithi023.stdout:6/793: truncate d1/d3d/f55 1952028 0 2024-02-28T16:24:17.169 INFO:tasks.workunit.client.0.smithi023.stdout:8/750: mknod d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/cf6 0 2024-02-28T16:24:17.181 INFO:tasks.workunit.client.0.smithi023.stdout:9/678: creat d0/d7/d2c/d7d/fed x:0 0 0 2024-02-28T16:24:17.182 INFO:tasks.workunit.client.0.smithi023.stdout:6/794: creat d1/d28/d1e/d2b/d44/d101/f120 x:0 0 0 2024-02-28T16:24:17.186 INFO:tasks.workunit.client.0.smithi023.stdout:6/795: dread - d1/d28/d1e/d2b/d44/da4/ff6 zero size 2024-02-28T16:24:17.186 INFO:tasks.workunit.client.0.smithi023.stdout:8/751: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/fea [0,4194304] 0 2024-02-28T16:24:17.187 INFO:tasks.workunit.client.0.smithi023.stdout:6/796: readlink d1/d28/d1e/l33 0 2024-02-28T16:24:17.189 INFO:tasks.workunit.client.0.smithi023.stdout:6/797: chown d1/d4f/cbb 187 1 2024-02-28T16:24:17.192 INFO:tasks.workunit.client.0.smithi023.stdout:0/673: link d6/db/d3b/l3c d6/db/d1a/d26/d31/d33/leb 0 2024-02-28T16:24:17.193 INFO:tasks.workunit.client.0.smithi023.stdout:0/674: fdatasync f4 0 2024-02-28T16:24:17.196 INFO:tasks.workunit.client.0.smithi023.stdout:4/663: truncate f5 7862324 0 2024-02-28T16:24:17.200 INFO:tasks.workunit.client.0.smithi023.stdout:1/723: sync 2024-02-28T16:24:17.204 INFO:tasks.workunit.client.0.smithi023.stdout:2/799: link d5/da/l29 d5/da/d8c/dd3/lfc 0 2024-02-28T16:24:17.207 INFO:tasks.workunit.client.0.smithi023.stdout:5/953: write d1/d2a/d32/d37/d3a/d7f/d62/dd1/fe9 [2367991,116139] 0 2024-02-28T16:24:17.208 INFO:tasks.workunit.client.0.smithi023.stdout:2/800: read - d5/da/db/d17/d3c/f46 zero size 2024-02-28T16:24:17.210 INFO:tasks.workunit.client.0.smithi023.stdout:6/798: mknod d1/d18/dd8/de8/ded/d11d/da9/c121 0 2024-02-28T16:24:17.213 INFO:tasks.workunit.client.0.smithi023.stdout:0/675: read d6/db/d1a/d35/d9d/f9e [4663603,1693] 0 2024-02-28T16:24:17.216 INFO:tasks.workunit.client.0.smithi023.stdout:9/679: mknod d0/d7/de/d2a/daf/d2f/d4d/cee 0 2024-02-28T16:24:17.217 INFO:tasks.workunit.client.0.smithi023.stdout:8/752: mknod d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/cf7 0 2024-02-28T16:24:17.222 INFO:tasks.workunit.client.0.smithi023.stdout:4/664: dwrite d13/d2b/f5e [12582912,4194304] 0 2024-02-28T16:24:17.222 INFO:tasks.workunit.client.0.smithi023.stdout:8/753: write d0/d5/d1a/d2d/d67/d71/d9e/fa4 [2670318,77496] 0 2024-02-28T16:24:17.223 INFO:tasks.workunit.client.0.smithi023.stdout:1/724: rename df/d11/f90 to df/d11/d13/d1b/d30/d57/d8d/ff6 0 2024-02-28T16:24:17.225 INFO:tasks.workunit.client.0.smithi023.stdout:5/954: rmdir d1/d2a/d32 39 2024-02-28T16:24:17.226 INFO:tasks.workunit.client.0.smithi023.stdout:8/754: write d0/d5/f7e [536678,3310] 0 2024-02-28T16:24:17.229 INFO:tasks.workunit.client.0.smithi023.stdout:8/755: write d0/d5/d1a/f6d [515351,70557] 0 2024-02-28T16:24:17.231 INFO:tasks.workunit.client.0.smithi023.stdout:2/801: read d5/da/db/d17/f57 [55957,128089] 0 2024-02-28T16:24:17.234 INFO:tasks.workunit.client.0.smithi023.stdout:9/680: dread d0/d7/de/d34/f9e [0,4194304] 0 2024-02-28T16:24:17.240 INFO:tasks.workunit.client.0.smithi023.stdout:6/799: rename d1/d28/d1e/d52/c8a to d1/d28/d1e/dbc/c122 0 2024-02-28T16:24:17.249 INFO:tasks.workunit.client.0.smithi023.stdout:5/955: dread - d1/d2a/d32/d37/d3a/d7f/d62/d7b/fcc zero size 2024-02-28T16:24:17.253 INFO:tasks.workunit.client.0.smithi023.stdout:8/756: read d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/f9d [986682,36265] 0 2024-02-28T16:24:17.258 INFO:tasks.workunit.client.0.smithi023.stdout:0/676: rename d6/db/d3b/ca4 to d6/d84/cec 0 2024-02-28T16:24:17.266 INFO:tasks.workunit.client.0.smithi023.stdout:2/802: symlink d5/da/db/d17/d73/d9e/lfd 0 2024-02-28T16:24:17.268 INFO:tasks.workunit.client.0.smithi023.stdout:2/803: dread - d5/da/d45/d6a/faa zero size 2024-02-28T16:24:17.271 INFO:tasks.workunit.client.0.smithi023.stdout:9/681: creat d0/d7/db/dec/fef x:0 0 0 2024-02-28T16:24:17.274 INFO:tasks.workunit.client.0.smithi023.stdout:8/757: symlink d0/d5/d1a/d2d/d67/d71/d9e/ddb/lf8 0 2024-02-28T16:24:17.276 INFO:tasks.workunit.client.0.smithi023.stdout:9/682: read d0/d7/db/d18/d23/d28/d32/d3c/f8e [242805,71002] 0 2024-02-28T16:24:17.279 INFO:tasks.workunit.client.0.smithi023.stdout:1/725: readlink df/d11/d13/d1b/d30/le8 0 2024-02-28T16:24:17.288 INFO:tasks.workunit.client.0.smithi023.stdout:6/800: write d1/d28/d1e/f4e [6323590,6475] 0 2024-02-28T16:24:17.290 INFO:tasks.workunit.client.0.smithi023.stdout:6/801: fdatasync d1/d28/ffe 0 2024-02-28T16:24:17.296 INFO:tasks.workunit.client.0.smithi023.stdout:6/802: chown d1/d18/d26/d6a/ldd 7319339 1 2024-02-28T16:24:17.299 INFO:tasks.workunit.client.0.smithi023.stdout:9/683: dwrite d0/d7/db/d18/d23/fac [0,4194304] 0 2024-02-28T16:24:17.301 INFO:tasks.workunit.client.0.smithi023.stdout:6/803: stat d1/d28/d1e/d2b/d44/d101/f105 0 2024-02-28T16:24:17.308 INFO:tasks.workunit.client.0.smithi023.stdout:5/956: link d1/d2a/lea d1/d2a/l136 0 2024-02-28T16:24:17.309 INFO:tasks.workunit.client.0.smithi023.stdout:2/804: creat d5/da/db/d17/d73/dd0/ffe x:0 0 0 2024-02-28T16:24:17.313 INFO:tasks.workunit.client.0.smithi023.stdout:1/726: rename df/d26/d48/d80/ld1 to df/d26/d48/d80/lf7 0 2024-02-28T16:24:17.319 INFO:tasks.workunit.client.0.smithi023.stdout:6/804: creat d1/d18/dd8/de8/ded/d11d/da9/f123 x:0 0 0 2024-02-28T16:24:17.320 INFO:tasks.workunit.client.0.smithi023.stdout:0/677: getdents d6/db/d1a/d35/d9d/dce 0 2024-02-28T16:24:17.322 INFO:tasks.workunit.client.0.smithi023.stdout:6/805: fsync d1/d28/d1e/d2b/d6d/d7b/fcc 0 2024-02-28T16:24:17.324 INFO:tasks.workunit.client.0.smithi023.stdout:2/805: mknod d5/da/db/d17/d3c/d7f/dc6/dd9/cff 0 2024-02-28T16:24:17.325 INFO:tasks.workunit.client.0.smithi023.stdout:8/758: write d0/d5/d1a/f8b [617821,5242] 0 2024-02-28T16:24:17.328 INFO:tasks.workunit.client.0.smithi023.stdout:2/806: write d5/da/d1b/d3f/d75/d92/fa9 [1864281,94914] 0 2024-02-28T16:24:17.343 INFO:tasks.workunit.client.0.smithi023.stdout:9/684: write d0/d7/db/d18/f96 [373004,95398] 0 2024-02-28T16:24:17.344 INFO:tasks.workunit.client.0.smithi023.stdout:5/957: write d1/d2a/d32/d37/d4e/f57 [2412893,111284] 0 2024-02-28T16:24:17.346 INFO:tasks.workunit.client.0.smithi023.stdout:4/665: dread d13/f1b [0,4194304] 0 2024-02-28T16:24:17.346 INFO:tasks.workunit.client.0.smithi023.stdout:6/806: dread d1/d18/dd8/de8/ded/d11d/da9/fb2 [0,4194304] 0 2024-02-28T16:24:17.354 INFO:tasks.workunit.client.0.smithi023.stdout:8/759: creat d0/d5/d1a/d2d/d67/ff9 x:0 0 0 2024-02-28T16:24:17.356 INFO:tasks.workunit.client.0.smithi023.stdout:9/685: unlink d0/d7/l87 0 2024-02-28T16:24:17.356 INFO:tasks.workunit.client.0.smithi023.stdout:5/958: mkdir d1/d2a/d32/d58/d73/d137 0 2024-02-28T16:24:17.359 INFO:tasks.workunit.client.0.smithi023.stdout:6/807: chown d1/d28/d1e/dbc/c122 273648 1 2024-02-28T16:24:17.366 INFO:tasks.workunit.client.0.smithi023.stdout:5/959: mkdir d1/d2a/d32/ddc/de3/d138 0 2024-02-28T16:24:17.368 INFO:tasks.workunit.client.0.smithi023.stdout:2/807: write d5/da/d67/fc0 [192203,11203] 0 2024-02-28T16:24:17.368 INFO:tasks.workunit.client.0.smithi023.stdout:0/678: dwrite d6/db/d3b/f96 [0,4194304] 0 2024-02-28T16:24:17.369 INFO:tasks.workunit.client.0.smithi023.stdout:8/760: mkdir d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/dfa 0 2024-02-28T16:24:17.370 INFO:tasks.workunit.client.0.smithi023.stdout:5/960: fdatasync d1/d2a/d32/d58/d73/fd2 0 2024-02-28T16:24:17.377 INFO:tasks.workunit.client.0.smithi023.stdout:6/808: mknod d1/d3d/df7/d10d/c124 0 2024-02-28T16:24:17.381 INFO:tasks.workunit.client.0.smithi023.stdout:2/808: mkdir d5/da/d8c/d100 0 2024-02-28T16:24:17.381 INFO:tasks.workunit.client.0.smithi023.stdout:8/761: rename d0/d5/d1a/df1 to d0/d5/d1a/d2d/d67/d71/db4/dfb 0 2024-02-28T16:24:17.387 INFO:tasks.workunit.client.0.smithi023.stdout:4/666: write d13/d2b/d2c/d31/d8d/f94 [3523022,57615] 0 2024-02-28T16:24:17.389 INFO:tasks.workunit.client.0.smithi023.stdout:8/762: write d0/d5/d1a/d2d/d67/d71/db4/d39/ff0 [859080,103068] 0 2024-02-28T16:24:17.392 INFO:tasks.workunit.client.0.smithi023.stdout:4/667: truncate d13/d1d/fbd 201441 0 2024-02-28T16:24:17.393 INFO:tasks.workunit.client.0.smithi023.stdout:9/686: write d0/d7/de/d34/f3b [899270,90399] 0 2024-02-28T16:24:17.395 INFO:tasks.workunit.client.0.smithi023.stdout:2/809: chown d5/da/db/d17/d73/dd0/f34 43137202 1 2024-02-28T16:24:17.405 INFO:tasks.workunit.client.0.smithi023.stdout:8/763: mknod d0/d5/d1a/cfc 0 2024-02-28T16:24:17.406 INFO:tasks.workunit.client.0.smithi023.stdout:5/961: dwrite d1/d2a/d32/d58/d73/df5/f112 [0,4194304] 0 2024-02-28T16:24:17.406 INFO:tasks.workunit.client.0.smithi023.stdout:2/810: write d5/da/db/d17/d73/fc4 [626168,84234] 0 2024-02-28T16:24:17.410 INFO:tasks.workunit.client.0.smithi023.stdout:9/687: creat d0/d7/db/d18/d23/ff0 x:0 0 0 2024-02-28T16:24:17.410 INFO:tasks.workunit.client.0.smithi023.stdout:8/764: fsync d0/d5/d1a/d63/fcf 0 2024-02-28T16:24:17.414 INFO:tasks.workunit.client.0.smithi023.stdout:4/668: creat d13/d2b/d2c/d31/dc4/fd3 x:0 0 0 2024-02-28T16:24:17.418 INFO:tasks.workunit.client.0.smithi023.stdout:4/669: mknod d13/d1d/d2d/da9/cd4 0 2024-02-28T16:24:17.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.429+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb014104d20 con 0x7faffc06d760 2024-02-28T16:24:17.419 INFO:tasks.workunit.client.0.smithi023.stdout:2/811: truncate d5/da/db/d17/d73/d9e/da0/def/fb0 2119615 0 2024-02-28T16:24:17.421 INFO:tasks.workunit.client.0.smithi023.stdout:2/812: stat d5/da/db/d17/d3c/f3d 0 2024-02-28T16:24:17.424 INFO:tasks.workunit.client.0.smithi023.stdout:8/765: rename d0/d5/d1a/d2d/d67/d71/d9e to d0/d5/d1a/d2d/d67/d71/db4/d39/dfd 0 2024-02-28T16:24:17.425 INFO:tasks.workunit.client.0.smithi023.stdout:0/679: write d6/db/d1a/d26/d9c/fdb [697960,2259] 0 2024-02-28T16:24:17.429 INFO:tasks.workunit.client.0.smithi023.stdout:2/813: truncate d5/da/f7c 4239319 0 2024-02-28T16:24:17.435 INFO:tasks.workunit.client.0.smithi023.stdout:4/670: link d13/d1d/d2e/l3d d13/d2b/d2c/d31/dc4/ld5 0 2024-02-28T16:24:17.438 INFO:tasks.workunit.client.0.smithi023.stdout:0/680: creat d6/db/d1a/d26/d31/d33/d6e/db1/fed x:0 0 0 2024-02-28T16:24:17.439 INFO:tasks.workunit.client.0.smithi023.stdout:8/766: rename d0/d5/d1a/cfc to d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/ddb/cfe 0 2024-02-28T16:24:17.442 INFO:tasks.workunit.client.0.smithi023.stdout:6/809: dwrite d1/d18/dd8/de8/ded/d11d/da9/fb2 [0,4194304] 0 2024-02-28T16:24:17.445 INFO:tasks.workunit.client.0.smithi023.stdout:4/671: symlink d13/d1d/dd0/ld6 0 2024-02-28T16:24:17.445 INFO:tasks.workunit.client.0.smithi023.stdout:6/810: write d1/d18/d26/f38 [935018,67725] 0 2024-02-28T16:24:17.449 INFO:tasks.workunit.client.0.smithi023.stdout:4/672: chown d13/d1d/d2d/da9 2007475 1 2024-02-28T16:24:17.449 INFO:tasks.workunit.client.0.smithi023.stdout:9/688: write d0/d7/d2c/f55 [1809389,62624] 0 2024-02-28T16:24:17.451 INFO:tasks.workunit.client.0.smithi023.stdout:2/814: mknod d5/da/db/d17/d39/c101 0 2024-02-28T16:24:17.452 INFO:tasks.workunit.client.0.smithi023.stdout:9/689: fdatasync d0/d7/db/f75 0 2024-02-28T16:24:17.458 INFO:tasks.workunit.client.0.smithi023.stdout:4/673: symlink d13/d1e/d9c/ld7 0 2024-02-28T16:24:17.461 INFO:tasks.workunit.client.0.smithi023.stdout:6/811: mknod d1/d28/d1e/d2b/c125 0 2024-02-28T16:24:17.472 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:24:17.472 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (9m) 10s ago 11m 14.0M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:24:17.472 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (11m) 10s ago 11m 7768k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:24:17.472 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (10m) 61s ago 10m 7402k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (11m) 10s ago 11m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (10m) 61s ago 10m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (9m) 10s ago 10m 75.0M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (3m) 10s ago 3m 131M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (4m) 10s ago 4m 13.6M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (3m) 61s ago 3m 13.4M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (4m) 61s ago 4m 13.4M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (33s) 10s ago 12m 63.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (92s) 61s ago 9m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1b0f874317ec 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (12m) 10s ago 13m 51.7M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (9m) 61s ago 9m 38.2M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (11m) 10s ago 11m 8338k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (9m) 61s ago 9m 7801k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (8m) 10s ago 8m 105M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:24:17.473 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (8m) 10s ago 8m 116M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:24:17.474 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (7m) 10s ago 7m 100M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:24:17.474 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (6m) 61s ago 6m 92.1M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:24:17.474 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (6m) 61s ago 6m 85.6M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:24:17.474 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (5m) 61s ago 5m 83.0M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:24:17.474 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (43s) 10s ago 10m 49.4M - 2.43.0 a07b618ecd1d aaf420dd79e3 2024-02-28T16:24:17.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.482+0000 7fb012000700 1 -- 172.21.15.23:0/2890244635 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb014104d20 con 0x7faffc06d760 2024-02-28T16:24:17.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7faffc06d760 msgr2=0x7faffc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7faffc06d760 0x7faffc06fc10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb00800bd00 tx=0x7fb00800d040 comp rx=0 tx=0).stop 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0141003d0 msgr2=0x7fb014193d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0141003d0 0x7fb014193d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0000092e0 tx=0x7fb00000f740 comp rx=0 tx=0).stop 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 shutdown_connections 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7faffc06d760 0x7faffc06fc10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0140ff130 0x7fb014193820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 --2- 172.21.15.23:0/2890244635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0141003d0 0x7fb014193d60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:17.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 >> 172.21.15.23:0/2890244635 conn(0x7fb0140fa780 msgr2=0x7fb014103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:17.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.486+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 shutdown_connections 2024-02-28T16:24:17.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.487+0000 7fb01c200700 1 -- 172.21.15.23:0/2890244635 wait complete. 2024-02-28T16:24:17.479 INFO:tasks.workunit.client.0.smithi023.stdout:0/681: dread d6/db/dab/d82/d72/d79/f8b [0,4194304] 0 2024-02-28T16:24:17.488 INFO:tasks.workunit.client.0.smithi023.stdout:9/690: link d0/d7/db/d18/f1d d0/d7/db/d18/d23/d28/d6e/ff1 0 2024-02-28T16:24:17.490 INFO:tasks.workunit.client.0.smithi023.stdout:4/674: write d13/d2b/d2c/d31/dc4/d55/f60 [2933722,83248] 0 2024-02-28T16:24:17.498 INFO:tasks.workunit.client.0.smithi023.stdout:8/767: dread d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/fa9 [0,4194304] 0 2024-02-28T16:24:17.501 INFO:tasks.workunit.client.0.smithi023.stdout:0/682: link d6/db/d1a/d35/la5 d6/db/d1a/d26/d31/d33/dbe/lee 0 2024-02-28T16:24:17.502 INFO:tasks.workunit.client.0.smithi023.stdout:9/691: creat d0/d7/d2c/d7d/dd1/ff2 x:0 0 0 2024-02-28T16:24:17.502 INFO:tasks.workunit.client.0.smithi023.stdout:8/768: readlink d0/d5/d1a/d2d/d67/d71/db4/d39/lbd 0 2024-02-28T16:24:17.506 INFO:tasks.workunit.client.0.smithi023.stdout:0/683: fdatasync d6/fb0 0 2024-02-28T16:24:17.517 INFO:tasks.workunit.client.0.smithi023.stdout:6/812: dwrite d1/d18/f73 [0,4194304] 0 2024-02-28T16:24:17.517 INFO:tasks.workunit.client.0.smithi023.stdout:0/684: readlink d6/db/d1a/d26/d31/d33/dbe/le6 0 2024-02-28T16:24:17.518 INFO:tasks.workunit.client.0.smithi023.stdout:4/675: dwrite d13/d2b/d9d/fd1 [0,4194304] 0 2024-02-28T16:24:17.521 INFO:tasks.workunit.client.0.smithi023.stdout:3/746: sync 2024-02-28T16:24:17.521 INFO:tasks.workunit.client.0.smithi023.stdout:7/670: sync 2024-02-28T16:24:17.528 INFO:tasks.workunit.client.0.smithi023.stdout:8/769: link d0/d5/d1b/d36/fa3 d0/d5/d1a/d2d/d67/d71/db4/fff 0 2024-02-28T16:24:17.531 INFO:tasks.workunit.client.0.smithi023.stdout:8/770: chown d0/c74 661722 1 2024-02-28T16:24:17.532 INFO:tasks.workunit.client.0.smithi023.stdout:0/685: symlink d6/db/d1a/d26/d31/d33/d6e/db1/lef 0 2024-02-28T16:24:17.534 INFO:tasks.workunit.client.0.smithi023.stdout:7/671: symlink de/d8b/lde 0 2024-02-28T16:24:17.535 INFO:tasks.workunit.client.0.smithi023.stdout:0/686: chown d6/db/dab/d82/f4f 221499 1 2024-02-28T16:24:17.542 INFO:tasks.workunit.client.0.smithi023.stdout:6/813: mkdir d1/d28/d11f/d126 0 2024-02-28T16:24:17.542 INFO:tasks.workunit.client.0.smithi023.stdout:0/687: dread - d6/db/d1a/d26/d31/da0/fc8 zero size 2024-02-28T16:24:17.547 INFO:tasks.workunit.client.0.smithi023.stdout:3/747: dwrite d1/df/d33/d38/f43 [0,4194304] 0 2024-02-28T16:24:17.547 INFO:tasks.workunit.client.0.smithi023.stdout:9/692: write d0/d7/db/d18/d23/d28/d32/f3f [2222242,44960] 0 2024-02-28T16:24:17.549 INFO:tasks.workunit.client.0.smithi023.stdout:6/814: truncate d1/d18/d26/f84 1325303 0 2024-02-28T16:24:17.552 INFO:tasks.workunit.client.0.smithi023.stdout:9/693: stat d0/d7/db/d18/d23/d28/d9c/c62 0 2024-02-28T16:24:17.553 INFO:tasks.workunit.client.0.smithi023.stdout:0/688: symlink d6/db/d68/lf0 0 2024-02-28T16:24:17.555 INFO:tasks.workunit.client.0.smithi023.stdout:9/694: readlink d0/d7/l5c 0 2024-02-28T16:24:17.559 INFO:tasks.workunit.client.0.smithi023.stdout:6/815: write d1/d18/dd8/de8/ded/d11d/da9/f123 [330261,57248] 0 2024-02-28T16:24:17.559 INFO:tasks.workunit.client.0.smithi023.stdout:0/689: stat d6/db/d1a/d26/d31/d33/d6e/db1/fed 0 2024-02-28T16:24:17.560 INFO:tasks.workunit.client.0.smithi023.stdout:9/695: write d0/d7/de/fe0 [41075,89348] 0 2024-02-28T16:24:17.561 INFO:tasks.workunit.client.0.smithi023.stdout:9/696: stat d0/d7/l5c 0 2024-02-28T16:24:17.562 INFO:tasks.workunit.client.0.smithi023.stdout:6/816: write d1/d28/d1e/dae/fd3 [565719,96366] 0 2024-02-28T16:24:17.562 INFO:tasks.workunit.client.0.smithi023.stdout:4/676: link d13/d2b/fab d13/d2b/d2c/d31/d8d/db3/d90/fd8 0 2024-02-28T16:24:17.568 INFO:tasks.workunit.client.0.smithi023.stdout:4/677: chown d13/d1d/f25 6318 1 2024-02-28T16:24:17.571 INFO:tasks.workunit.client.0.smithi023.stdout:9/697: creat d0/d7/ff3 x:0 0 0 2024-02-28T16:24:17.578 INFO:tasks.workunit.client.0.smithi023.stdout:6/817: read d1/d18/fa5 [3997640,101321] 0 2024-02-28T16:24:17.578 INFO:tasks.workunit.client.0.smithi023.stdout:4/678: chown d13/d1d/d2d/da9/cc6 54439 1 2024-02-28T16:24:17.589 INFO:tasks.workunit.client.0.smithi023.stdout:4/679: creat d13/d1d/d2d/da9/fd9 x:0 0 0 2024-02-28T16:24:17.592 INFO:tasks.workunit.client.0.smithi023.stdout:3/748: dwrite d1/df/d33/dc2/dcc/fe5 [0,4194304] 0 2024-02-28T16:24:17.594 INFO:tasks.workunit.client.0.smithi023.stdout:0/690: dwrite d6/d4c/d6a/fe9 [0,4194304] 0 2024-02-28T16:24:17.598 INFO:tasks.workunit.client.0.smithi023.stdout:3/749: readlink d1/d74/d46/l4d 0 2024-02-28T16:24:17.599 INFO:tasks.workunit.client.0.smithi023.stdout:6/818: creat d1/d3d/f127 x:0 0 0 2024-02-28T16:24:17.611 INFO:tasks.workunit.client.0.smithi023.stdout:9/698: dread d0/d7/de/f8d [0,4194304] 0 2024-02-28T16:24:17.612 INFO:tasks.workunit.client.0.smithi023.stdout:3/750: mkdir d1/df/d33/dc2/d106 0 2024-02-28T16:24:17.615 INFO:tasks.workunit.client.0.smithi023.stdout:3/751: fsync d1/d74/de1/db5/fbf 0 2024-02-28T16:24:17.627 INFO:tasks.workunit.client.0.smithi023.stdout:8/771: dwrite d0/d5/d1b/f33 [0,4194304] 0 2024-02-28T16:24:17.656 INFO:tasks.workunit.client.0.smithi023.stdout:7/672: dread de/d13/d1b/d6c/f71 [0,4194304] 0 2024-02-28T16:24:17.662 INFO:tasks.workunit.client.0.smithi023.stdout:4/680: dread d13/d1d/f33 [0,4194304] 0 2024-02-28T16:24:17.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:17 smithi023 ceph-mon[29137]: pgmap v40: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 35 MiB/s rd, 105 MiB/s wr, 265 op/s 2024-02-28T16:24:17.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:17 smithi023 ceph-mon[29137]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:17.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:17 smithi023 ceph-mon[29137]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:17.681 INFO:tasks.workunit.client.0.smithi023.stdout:1/727: sync 2024-02-28T16:24:17.684 INFO:tasks.workunit.client.0.smithi023.stdout:0/691: dread d6/db/d1a/d35/fa7 [0,4194304] 0 2024-02-28T16:24:17.688 INFO:tasks.workunit.client.0.smithi023.stdout:0/692: fsync d6/db/d1a/d1b/f5a 0 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 -- 172.21.15.23:0/944897143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 msgr2=0x7f2c34103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 --2- 172.21.15.23:0/944897143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c34103930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009910 tx=0x7f2c1c009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 -- 172.21.15.23:0/944897143 shutdown_connections 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 --2- 172.21.15.23:0/944897143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c34103930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 --2- 172.21.15.23:0/944897143 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2c340feb50 0x7f2c34100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 -- 172.21.15.23:0/944897143 >> 172.21.15.23:0/944897143 conn(0x7f2c340fa780 msgr2=0x7f2c340fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 -- 172.21.15.23:0/944897143 shutdown_connections 2024-02-28T16:24:17.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.711+0000 7f2c3b200700 1 -- 172.21.15.23:0/944897143 wait complete. 2024-02-28T16:24:17.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.712+0000 7f2c3b200700 1 Processor -- start 2024-02-28T16:24:17.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.712+0000 7f2c3b200700 1 -- start start 2024-02-28T16:24:17.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.713+0000 7f2c3b200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2c340feb50 0x7f2c34071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:17.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.713+0000 7f2c3b200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c340720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:17.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.713+0000 7f2c3b200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34072720 con 0x7f2c340feb50 2024-02-28T16:24:17.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.713+0000 7f2c3b200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34072890 con 0x7f2c341014b0 2024-02-28T16:24:17.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.713+0000 7f2c33400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c340720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:17.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.714+0000 7f2c33400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c340720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:45962/0 (socket says 172.21.15.23:45962) 2024-02-28T16:24:17.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.714+0000 7f2c33400700 1 -- 172.21.15.23:0/1383085681 learned_addr learned my addr 172.21.15.23:0/1383085681 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:17.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.714+0000 7f2c33e00700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2c340feb50 0x7f2c34071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:17.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.714+0000 7f2c33400700 1 -- 172.21.15.23:0/1383085681 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2c340feb50 msgr2=0x7f2c34071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:17.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.714+0000 7f2c33400700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2c340feb50 0x7f2c34071ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:17.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.714+0000 7f2c33400700 1 -- 172.21.15.23:0/1383085681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0095f0 con 0x7f2c341014b0 2024-02-28T16:24:17.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.715+0000 7f2c33400700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c340720e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006010 tx=0x7f2c1c00fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:17.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.715+0000 7f2c30c00700 1 -- 172.21.15.23:0/1383085681 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1c01d070 con 0x7f2c341014b0 2024-02-28T16:24:17.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.715+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c34198b80 con 0x7f2c341014b0 2024-02-28T16:24:17.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.715+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c34199070 con 0x7f2c341014b0 2024-02-28T16:24:17.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.715+0000 7f2c30c00700 1 -- 172.21.15.23:0/1383085681 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c1c00fe60 con 0x7f2c341014b0 2024-02-28T16:24:17.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.715+0000 7f2c30c00700 1 -- 172.21.15.23:0/1383085681 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1c017790 con 0x7f2c341014b0 2024-02-28T16:24:17.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.717+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3406bf10 con 0x7f2c341014b0 2024-02-28T16:24:17.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.718+0000 7f2c30c00700 1 -- 172.21.15.23:0/1383085681 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 26) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f2c1c003bc0 con 0x7f2c341014b0 2024-02-28T16:24:17.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.719+0000 7f2c30c00700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f2c1806d660 0x7f2c1806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:17.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.719+0000 7f2c30c00700 1 -- 172.21.15.23:0/1383085681 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2c1c08e6f0 con 0x7f2c341014b0 2024-02-28T16:24:17.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.720+0000 7f2c33e00700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f2c1806d660 0x7f2c1806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:17.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.721+0000 7f2c33e00700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f2c1806d660 0x7f2c1806fb10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c341a5bb0 tx=0x7f2c2c009260 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:17.716 INFO:tasks.workunit.client.0.smithi023.stdout:6/819: rename d1/d28/d1e/d52/fc5 to d1/d28/f128 0 2024-02-28T16:24:17.718 INFO:tasks.workunit.client.0.smithi023.stdout:3/752: creat d1/df/d2d/d45/d78/f107 x:0 0 0 2024-02-28T16:24:17.721 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:17.732+0000 7f2c30c00700 1 -- 172.21.15.23:0/1383085681 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f2c1c0582e0 con 0x7f2c341014b0 2024-02-28T16:24:17.765 INFO:tasks.workunit.client.0.smithi023.stdout:5/962: sync 2024-02-28T16:24:17.765 INFO:tasks.workunit.client.0.smithi023.stdout:2/815: sync 2024-02-28T16:24:17.765 INFO:tasks.workunit.client.0.smithi023.stdout:7/673: mknod de/d72/cdf 0 2024-02-28T16:24:17.766 INFO:tasks.workunit.client.0.smithi023.stdout:5/963: readlink d1/l12 0 2024-02-28T16:24:17.778 INFO:tasks.workunit.client.0.smithi023.stdout:0/693: creat d6/db/d1a/d35/d9d/dce/ff1 x:0 0 0 2024-02-28T16:24:17.779 INFO:tasks.workunit.client.0.smithi023.stdout:0/694: dread - d6/db/dab/d82/da3/fe2 zero size 2024-02-28T16:24:17.780 INFO:tasks.workunit.client.0.smithi023.stdout:9/699: mkdir d0/dd2/df4 0 2024-02-28T16:24:17.788 INFO:tasks.workunit.client.0.smithi023.stdout:1/728: dwrite df/d11/d13/f2c [4194304,4194304] 0 2024-02-28T16:24:17.791 INFO:tasks.workunit.client.0.smithi023.stdout:5/964: dwrite d1/d2a/d32/d58/d79/fac [0,4194304] 0 2024-02-28T16:24:17.793 INFO:tasks.workunit.client.0.smithi023.stdout:6/820: rename d1/d28/d1e/d2b/d44/da4/d106/f113 to d1/d4f/d114/f129 0 2024-02-28T16:24:17.794 INFO:tasks.workunit.client.0.smithi023.stdout:1/729: dread - df/dbd/fe3 zero size 2024-02-28T16:24:17.810 INFO:tasks.workunit.client.0.smithi023.stdout:0/695: mknod d6/db/d1a/d35/cf2 0 2024-02-28T16:24:17.812 INFO:tasks.workunit.client.0.smithi023.stdout:3/753: readlink d1/df/d3d/l7d 0 2024-02-28T16:24:17.812 INFO:tasks.workunit.client.0.smithi023.stdout:9/700: dread - d0/d7/db/d18/d23/d28/f99 zero size 2024-02-28T16:24:17.819 INFO:tasks.workunit.client.0.smithi023.stdout:3/754: fdatasync d1/df/d2d/d45/d52/f5b 0 2024-02-28T16:24:17.820 INFO:tasks.workunit.client.0.smithi023.stdout:4/681: creat d13/d2b/d2c/d31/d8d/fda x:0 0 0 2024-02-28T16:24:17.829 INFO:tasks.workunit.client.0.smithi023.stdout:6/821: unlink d1/d28/d1e/dbc/cc4 0 2024-02-28T16:24:17.832 INFO:tasks.workunit.client.0.smithi023.stdout:5/965: creat d1/d2a/d32/ddc/de3/f139 x:0 0 0 2024-02-28T16:24:17.835 INFO:tasks.workunit.client.0.smithi023.stdout:5/966: write d1/d2a/d32/de0/f132 [96631,9269] 0 2024-02-28T16:24:17.840 INFO:tasks.workunit.client.0.smithi023.stdout:0/696: mkdir d6/db/d5d/df3 0 2024-02-28T16:24:17.843 INFO:tasks.workunit.client.0.smithi023.stdout:3/755: symlink d1/df/d2d/d45/d6f/l108 0 2024-02-28T16:24:17.845 INFO:tasks.workunit.client.0.smithi023.stdout:3/756: dread - d1/df/d33/d38/d4c/f7e zero size 2024-02-28T16:24:17.847 INFO:tasks.workunit.client.0.smithi023.stdout:4/682: mkdir d13/d1d/d58/ddb 0 2024-02-28T16:24:17.854 INFO:tasks.workunit.client.0.smithi023.stdout:3/757: dread d1/d74/de1/ff1 [4194304,4194304] 0 2024-02-28T16:24:17.869 INFO:tasks.workunit.client.0.smithi023.stdout:0/697: stat d6/db/dab/d42/c85 0 2024-02-28T16:24:17.871 INFO:tasks.workunit.client.0.smithi023.stdout:7/674: link de/d13/l2c de/d1c/d76/le0 0 2024-02-28T16:24:17.875 INFO:tasks.workunit.client.0.smithi023.stdout:7/675: read de/d13/d1b/d6c/f71 [2273858,80953] 0 2024-02-28T16:24:17.878 INFO:tasks.workunit.client.0.smithi023.stdout:3/758: dwrite d1/d4a/d92/fe3 [0,4194304] 0 2024-02-28T16:24:17.881 INFO:tasks.workunit.client.0.smithi023.stdout:1/730: link df/d11/d13/f15 df/d11/d13/d1b/d2e/ff8 0 2024-02-28T16:24:17.882 INFO:tasks.workunit.client.0.smithi023.stdout:5/967: link d1/d2a/d32/d58/d60/d81/f86 d1/d2a/d32/d37/d4e/d10d/f13a 0 2024-02-28T16:24:17.885 INFO:tasks.workunit.client.0.smithi023.stdout:5/968: write d1/d2a/d32/d37/d3a/f6a [4672772,56503] 0 2024-02-28T16:24:17.894 INFO:tasks.workunit.client.0.smithi023.stdout:6/822: getdents d1/d28/d1e 0 2024-02-28T16:24:17.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:17 smithi153 ceph-mon[35341]: pgmap v40: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 35 MiB/s rd, 105 MiB/s wr, 265 op/s 2024-02-28T16:24:17.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:17 smithi153 ceph-mon[35341]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:17.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:17 smithi153 ceph-mon[35341]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:17.908 INFO:tasks.workunit.client.0.smithi023.stdout:1/731: fdatasync df/d11/d13/f62 0 2024-02-28T16:24:17.911 INFO:tasks.workunit.client.0.smithi023.stdout:1/732: readlink df/d11/d13/d1b/d2e/ld8 0 2024-02-28T16:24:17.918 INFO:tasks.workunit.client.0.smithi023.stdout:6/823: fsync d1/d18/f30 0 2024-02-28T16:24:17.918 INFO:tasks.workunit.client.0.smithi023.stdout:7/676: dwrite de/d1c/fda [0,4194304] 0 2024-02-28T16:24:17.922 INFO:tasks.workunit.client.0.smithi023.stdout:6/824: write d1/d28/d1e/d52/f5b [5163178,18029] 0 2024-02-28T16:24:17.945 INFO:tasks.workunit.client.0.smithi023.stdout:9/701: truncate d0/d7/d2c/d84/fb3 90222 0 2024-02-28T16:24:17.949 INFO:tasks.workunit.client.0.smithi023.stdout:0/698: truncate d6/db/d1a/d35/fa7 7825523 0 2024-02-28T16:24:17.952 INFO:tasks.workunit.client.0.smithi023.stdout:6/825: mkdir d1/d28/d1e/d2b/d76/d9e/d12a 0 2024-02-28T16:24:17.955 INFO:tasks.workunit.client.0.smithi023.stdout:9/702: mknod d0/d7/db/d18/d23/d28/db6/cf5 0 2024-02-28T16:24:17.955 INFO:tasks.workunit.client.0.smithi023.stdout:9/703: readlink d0/l2 0 2024-02-28T16:24:17.963 INFO:tasks.workunit.client.0.smithi023.stdout:0/699: mkdir d6/db/d1a/d26/d31/d33/d37/d8f/ddf/df4 0 2024-02-28T16:24:17.973 INFO:tasks.workunit.client.0.smithi023.stdout:0/700: chown d6/db/d1a/d26/d31/d33/dbe/lee 227052 1 2024-02-28T16:24:17.974 INFO:tasks.workunit.client.0.smithi023.stdout:7/677: dread de/d1c/f79 [4194304,4194304] 0 2024-02-28T16:24:17.979 INFO:tasks.workunit.client.0.smithi023.stdout:7/678: truncate de/d1c/d76/d7b/dad/fdd 540684 0 2024-02-28T16:24:17.980 INFO:tasks.workunit.client.0.smithi023.stdout:7/679: fsync fc 0 2024-02-28T16:24:17.981 INFO:tasks.workunit.client.0.smithi023.stdout:6/826: dread d1/f1c [0,4194304] 0 2024-02-28T16:24:17.986 INFO:tasks.workunit.client.0.smithi023.stdout:7/680: mknod de/d1c/d76/d7b/dd3/ce1 0 2024-02-28T16:24:17.996 INFO:tasks.workunit.client.0.smithi023.stdout:9/704: dread d0/d7/d2c/f55 [0,4194304] 0 2024-02-28T16:24:17.999 INFO:tasks.workunit.client.0.smithi023.stdout:9/705: stat d0/d7/de/f63 0 2024-02-28T16:24:18.001 INFO:tasks.workunit.client.0.smithi023.stdout:9/706: chown d0/d7/de/d34/l53 0 1 2024-02-28T16:24:18.009 INFO:tasks.workunit.client.0.smithi023.stdout:9/707: mkdir d0/d7/db/dec/df6 0 2024-02-28T16:24:18.013 INFO:tasks.workunit.client.0.smithi023.stdout:9/708: chown d0/d7/db/d18/d23/d28/d32/d8b/lb7 0 1 2024-02-28T16:24:18.015 INFO:tasks.workunit.client.0.smithi023.stdout:6/827: dread d1/d28/d1e/d2b/d6d/d7b/fcc [4194304,4194304] 0 2024-02-28T16:24:18.026 INFO:tasks.workunit.client.0.smithi023.stdout:6/828: creat d1/d28/d1e/d80/d109/f12b x:0 0 0 2024-02-28T16:24:18.029 INFO:tasks.workunit.client.0.smithi023.stdout:8/772: dwrite d0/d5/f26 [0,4194304] 0 2024-02-28T16:24:18.043 INFO:tasks.workunit.client.0.smithi023.stdout:6/829: rmdir d1/d28/d1e/d2b/d44/d101 39 2024-02-28T16:24:18.044 INFO:tasks.workunit.client.0.smithi023.stdout:2/816: dwrite d5/da/f5b [0,4194304] 0 2024-02-28T16:24:18.053 INFO:tasks.workunit.client.0.smithi023.stdout:8/773: mkdir d0/d5/d35/dbf/d100 0 2024-02-28T16:24:18.059 INFO:tasks.workunit.client.0.smithi023.stdout:2/817: symlink d5/da/d1b/d3f/d75/d92/dbb/l102 0 2024-02-28T16:24:18.065 INFO:tasks.workunit.client.0.smithi023.stdout:4/683: dwrite d13/d2b/d2c/d31/d6e/f76 [0,4194304] 0 2024-02-28T16:24:18.070 INFO:tasks.workunit.client.0.smithi023.stdout:8/774: unlink d0/f7a 0 2024-02-28T16:24:18.084 INFO:tasks.workunit.client.0.smithi023.stdout:8/775: dread - d0/d5/d1a/d63/fc8 zero size 2024-02-28T16:24:18.091 INFO:tasks.workunit.client.0.smithi023.stdout:2/818: mkdir d5/da/db/d17/d3c/d103 0 2024-02-28T16:24:18.100 INFO:tasks.workunit.client.0.smithi023.stdout:8/776: dread d0/f18 [0,4194304] 0 2024-02-28T16:24:18.100 INFO:tasks.workunit.client.0.smithi023.stdout:3/759: write d1/df/f3e [463243,129217] 0 2024-02-28T16:24:18.105 INFO:tasks.workunit.client.0.smithi023.stdout:5/969: truncate d1/d2a/d32/d37/d3a/f6a 2491052 0 2024-02-28T16:24:18.109 INFO:tasks.workunit.client.0.smithi023.stdout:4/684: link d13/d2b/d2c/d31/d8d/fa1 d13/d2b/d2c/d31/dce/fdc 0 2024-02-28T16:24:18.109 INFO:tasks.workunit.client.0.smithi023.stdout:1/733: write df/d11/d13/d1b/d30/d57/d5a/d68/d7a/fb1 [822429,91694] 0 2024-02-28T16:24:18.122 INFO:tasks.workunit.client.0.smithi023.stdout:0/701: write d6/db/d1a/d26/d31/da8/fad [599911,64071] 0 2024-02-28T16:24:18.123 INFO:tasks.workunit.client.0.smithi023.stdout:7/681: write de/d1c/fd2 [340141,114892] 0 2024-02-28T16:24:18.129 INFO:tasks.workunit.client.0.smithi023.stdout:2/819: rename d5/da/db/d17/d73 to d5/da/d104 0 2024-02-28T16:24:18.135 INFO:tasks.workunit.client.0.smithi023.stdout:8/777: dwrite d0/d5/d1a/d63/d90/fd9 [0,4194304] 0 2024-02-28T16:24:18.143 INFO:tasks.workunit.client.0.smithi023.stdout:1/734: fsync df/d11/d13/d1b/d30/d57/d5a/da6/fad 0 2024-02-28T16:24:18.149 INFO:tasks.workunit.client.0.smithi023.stdout:0/702: creat d6/db/d1a/d26/d31/d33/d6e/ff5 x:0 0 0 2024-02-28T16:24:18.151 INFO:tasks.workunit.client.0.smithi023.stdout:0/703: chown d6/d98/laf 1173 1 2024-02-28T16:24:18.157 INFO:tasks.workunit.client.0.smithi023.stdout:3/760: rename d1/df/d2d/d32/d3f to d1/d74/d94/de4/d109 0 2024-02-28T16:24:18.166 INFO:tasks.workunit.client.0.smithi023.stdout:8/778: creat d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/f101 x:0 0 0 2024-02-28T16:24:18.172 INFO:tasks.workunit.client.0.smithi023.stdout:6/830: write d1/d3d/fab [1481570,26738] 0 2024-02-28T16:24:18.172 INFO:tasks.workunit.client.0.smithi023.stdout:5/970: creat d1/d2a/d32/f13b x:0 0 0 2024-02-28T16:24:18.182 INFO:tasks.workunit.client.0.smithi023.stdout:7/682: link de/d13/d1b/d3d/f7c de/d13/d1b/d6c/db6/fe2 0 2024-02-28T16:24:18.189 INFO:tasks.workunit.client.0.smithi023.stdout:2/820: dwrite d5/da/d104/dd0/d52/fcf [0,4194304] 0 2024-02-28T16:24:18.191 INFO:tasks.workunit.client.0.smithi023.stdout:0/704: mkdir d6/db/d1a/d26/d31/d33/d37/df6 0 2024-02-28T16:24:18.212 INFO:tasks.workunit.client.0.smithi023.stdout:1/735: dread df/d11/d13/d1b/d2e/d5c/f8f [0,4194304] 0 2024-02-28T16:24:18.212 INFO:tasks.workunit.client.0.smithi023.stdout:6/831: rename d1/d18/d26/d3a to d1/d28/d1e/d2b/d44/d86/d12c 0 2024-02-28T16:24:18.214 INFO:tasks.workunit.client.0.smithi023.stdout:1/736: stat df/f16 0 2024-02-28T16:24:18.216 INFO:tasks.workunit.client.0.smithi023.stdout:6/832: chown d1/d28/d1e/d2b/d44/d86/fef 270 1 2024-02-28T16:24:18.224 INFO:tasks.workunit.client.0.smithi023.stdout:7/683: symlink de/d8b/d95/d98/le3 0 2024-02-28T16:24:18.225 INFO:tasks.workunit.client.0.smithi023.stdout:4/685: truncate d13/d2b/d2c/d31/dce/fdc 44558 0 2024-02-28T16:24:18.230 INFO:tasks.workunit.client.0.smithi023.stdout:4/686: write d13/d2b/d2c/d31/dc4/d55/fb2 [28528,120024] 0 2024-02-28T16:24:18.235 INFO:tasks.workunit.client.0.smithi023.stdout:1/737: dwrite df/d11/d13/d1b/d2e/fc9 [0,4194304] 0 2024-02-28T16:24:18.238 INFO:tasks.workunit.client.0.smithi023.stdout:1/738: chown df/d11/d13/d1b/d30/d57/d5a/d68/d7a 10952 1 2024-02-28T16:24:18.243 INFO:tasks.workunit.client.0.smithi023.stdout:0/705: rename d6/db/d1a/d1b/f27 to d6/db/d1a/d35/d9d/dce/ff7 0 2024-02-28T16:24:18.249 INFO:tasks.workunit.client.0.smithi023.stdout:6/833: fsync d1/f11 0 2024-02-28T16:24:18.252 INFO:tasks.workunit.client.0.smithi023.stdout:5/971: unlink d1/d2a/d32/d58/d60/d88/l10c 0 2024-02-28T16:24:18.257 INFO:tasks.workunit.client.0.smithi023.stdout:7/684: dread - de/d9b/fa0 zero size 2024-02-28T16:24:18.258 INFO:tasks.workunit.client.0.smithi023.stdout:7/685: dread - de/fd6 zero size 2024-02-28T16:24:18.261 INFO:tasks.workunit.client.0.smithi023.stdout:2/821: mknod d5/da/db/d17/d3c/d103/c105 0 2024-02-28T16:24:18.266 INFO:tasks.workunit.client.0.smithi023.stdout:1/739: mkdir df/dcf/df9 0 2024-02-28T16:24:18.271 INFO:tasks.workunit.client.0.smithi023.stdout:0/706: read d6/db/d5d/f76 [2958764,46676] 0 2024-02-28T16:24:18.273 INFO:tasks.workunit.client.0.smithi023.stdout:0/707: stat d6/db/d1a/d59/lc0 0 2024-02-28T16:24:18.274 INFO:tasks.workunit.client.0.smithi023.stdout:6/834: dread - d1/d28/d1e/d2b/d44/d101/f105 zero size 2024-02-28T16:24:18.276 INFO:tasks.workunit.client.0.smithi023.stdout:5/972: rmdir d1/d2a/d32/d37/d4e/d10d 39 2024-02-28T16:24:18.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.286+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c3410f3c0 con 0x7f2c341014b0 2024-02-28T16:24:18.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.288+0000 7f2c30c00700 1 -- 172.21.15.23:0/1383085681 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f2c1c05b9a0 con 0x7f2c341014b0 2024-02-28T16:24:18.279 INFO:tasks.workunit.client.0.smithi023.stdout:7/686: truncate de/d9b/fa0 114191 0 2024-02-28T16:24:18.281 INFO:tasks.workunit.client.0.smithi023.stdout:2/822: chown d5/dbe/lb5 7 1 2024-02-28T16:24:18.281 INFO:tasks.workunit.client.0.smithi023.stdout:8/779: write d0/d5/d1b/f70 [913878,117837] 0 2024-02-28T16:24:18.281 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:24:18.281 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:24:18.281 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:24:18.281 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:24:18.282 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:24:18.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.293+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f2c1806d660 msgr2=0x7f2c1806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:18.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.293+0000 7f2c3b200700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f2c1806d660 0x7f2c1806fb10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c341a5bb0 tx=0x7f2c2c009260 comp rx=0 tx=0).stop 2024-02-28T16:24:18.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.293+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 msgr2=0x7f2c340720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:18.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.293+0000 7f2c3b200700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c340720e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006010 tx=0x7f2c1c00fab0 comp rx=0 tx=0).stop 2024-02-28T16:24:18.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.294+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 shutdown_connections 2024-02-28T16:24:18.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.294+0000 7f2c3b200700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f2c1806d660 0x7f2c1806fb10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:18.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.294+0000 7f2c3b200700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2c340feb50 0x7f2c34071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:18.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.294+0000 7f2c3b200700 1 --2- 172.21.15.23:0/1383085681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c341014b0 0x7f2c340720e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:18.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.294+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 >> 172.21.15.23:0/1383085681 conn(0x7f2c340fa780 msgr2=0x7f2c340fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:18.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.295+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 shutdown_connections 2024-02-28T16:24:18.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.296+0000 7f2c3b200700 1 -- 172.21.15.23:0/1383085681 wait complete. 2024-02-28T16:24:18.287 INFO:tasks.workunit.client.0.smithi023.stdout:6/835: unlink d1/l27 0 2024-02-28T16:24:18.290 INFO:tasks.workunit.client.0.smithi023.stdout:0/708: rmdir d6/db/d1a/d26/d31/d33/d6e 39 2024-02-28T16:24:18.299 INFO:tasks.workunit.client.0.smithi023.stdout:1/740: symlink df/d11/lfa 0 2024-02-28T16:24:18.302 INFO:tasks.workunit.client.0.smithi023.stdout:8/780: mknod d0/d5/d1a/d63/d90/dac/dc3/c102 0 2024-02-28T16:24:18.309 INFO:tasks.workunit.client.0.smithi023.stdout:0/709: dwrite d6/d4c/d6a/fe9 [0,4194304] 0 2024-02-28T16:24:18.311 INFO:tasks.workunit.client.0.smithi023.stdout:4/687: getdents d13/d1d/d85 0 2024-02-28T16:24:18.315 INFO:tasks.workunit.client.0.smithi023.stdout:6/836: getdents d1/d28/d1e/d80/dc2/d118 0 2024-02-28T16:24:18.319 INFO:tasks.workunit.client.0.smithi023.stdout:8/781: rmdir d0/d5/d1a/d2d/d67/d71 39 2024-02-28T16:24:18.325 INFO:tasks.workunit.client.0.smithi023.stdout:5/973: creat d1/f13c x:0 0 0 2024-02-28T16:24:18.330 INFO:tasks.workunit.client.0.smithi023.stdout:1/741: creat df/d11/d13/d99/ffb x:0 0 0 2024-02-28T16:24:18.330 INFO:tasks.workunit.client.0.smithi023.stdout:4/688: mknod d13/d1d/cdd 0 2024-02-28T16:24:18.331 INFO:tasks.workunit.client.0.smithi023.stdout:0/710: symlink d6/db/d1a/d26/d31/d33/d37/d8f/lf8 0 2024-02-28T16:24:18.338 INFO:tasks.workunit.client.0.smithi023.stdout:1/742: write df/d11/d13/d1b/f40 [2957328,74285] 0 2024-02-28T16:24:18.345 INFO:tasks.workunit.client.0.smithi023.stdout:8/782: read d0/d5/d1a/fbe [1154847,85434] 0 2024-02-28T16:24:18.351 INFO:tasks.workunit.client.0.smithi023.stdout:5/974: dwrite d1/d2a/d32/d58/d60/d82/ffd [4194304,4194304] 0 2024-02-28T16:24:18.351 INFO:tasks.workunit.client.0.smithi023.stdout:6/837: symlink d1/d18/d26/l12d 0 2024-02-28T16:24:18.351 INFO:tasks.workunit.client.0.smithi023.stdout:0/711: dread d6/db/d1a/d26/d31/da8/fad [0,4194304] 0 2024-02-28T16:24:18.353 INFO:tasks.workunit.client.0.smithi023.stdout:9/709: sync 2024-02-28T16:24:18.355 INFO:tasks.workunit.client.0.smithi023.stdout:4/689: symlink d13/d1d/d2d/lde 0 2024-02-28T16:24:18.362 INFO:tasks.workunit.client.0.smithi023.stdout:8/783: readlink d0/d5/d1a/d63/d90/dac/dc3/lc9 0 2024-02-28T16:24:18.362 INFO:tasks.workunit.client.0.smithi023.stdout:1/743: rename df/dcf to df/d11/d13/d99/dfc 0 2024-02-28T16:24:18.364 INFO:tasks.workunit.client.0.smithi023.stdout:7/687: dread de/d9b/fa0 [0,4194304] 0 2024-02-28T16:24:18.368 INFO:tasks.workunit.client.0.smithi023.stdout:1/744: read - df/d11/d13/d1b/d30/d57/d5a/da6/fad zero size 2024-02-28T16:24:18.374 INFO:tasks.workunit.client.0.smithi023.stdout:7/688: fdatasync de/fbe 0 2024-02-28T16:24:18.374 INFO:tasks.workunit.client.0.smithi023.stdout:8/784: write d0/d5/d1a/d2d/d67/f7c [487862,121867] 0 2024-02-28T16:24:18.377 INFO:tasks.workunit.client.0.smithi023.stdout:7/689: readlink de/l46 0 2024-02-28T16:24:18.380 INFO:tasks.workunit.client.0.smithi023.stdout:8/785: chown d0/fc 48465 1 2024-02-28T16:24:18.380 INFO:tasks.workunit.client.0.smithi023.stdout:6/838: dwrite d1/d28/d1e/d52/feb [0,4194304] 0 2024-02-28T16:24:18.388 INFO:tasks.workunit.client.0.smithi023.stdout:8/786: write d0/d5/d1a/d63/d90/dac/df2/f9a [18816,39321] 0 2024-02-28T16:24:18.389 INFO:tasks.workunit.client.0.smithi023.stdout:0/712: mkdir d6/d98/df9 0 2024-02-28T16:24:18.390 INFO:tasks.workunit.client.0.smithi023.stdout:5/975: dwrite d1/d2a/d32/ddc/de3/f139 [0,4194304] 0 2024-02-28T16:24:18.395 INFO:tasks.workunit.client.0.smithi023.stdout:2/823: write d5/da/f38 [428393,5453] 0 2024-02-28T16:24:18.398 INFO:tasks.workunit.client.0.smithi023.stdout:0/713: chown d6/db/dab/d82/fae 1 1 2024-02-28T16:24:18.404 INFO:tasks.workunit.client.0.smithi023.stdout:0/714: readlink d6/db/d68/lf0 0 2024-02-28T16:24:18.417 INFO:tasks.workunit.client.0.smithi023.stdout:9/710: unlink d0/d7/d2c/d84/cc7 0 2024-02-28T16:24:18.432 INFO:tasks.workunit.client.0.smithi023.stdout:7/690: dread de/d1c/d76/d7b/dab/fbd [0,4194304] 0 2024-02-28T16:24:18.443 INFO:tasks.workunit.client.0.smithi023.stdout:9/711: dwrite d0/d7/de/d2a/daf/d2f/fe8 [0,4194304] 0 2024-02-28T16:24:18.443 INFO:tasks.workunit.client.0.smithi023.stdout:2/824: rmdir d5/da/db/d17/d3c/d7f 39 2024-02-28T16:24:18.448 INFO:tasks.workunit.client.0.smithi023.stdout:1/745: fsync df/d11/d13/f15 0 2024-02-28T16:24:18.448 INFO:tasks.workunit.client.0.smithi023.stdout:2/825: read d5/da/d104/dd0/f30 [2036501,129635] 0 2024-02-28T16:24:18.450 INFO:tasks.workunit.client.0.smithi023.stdout:1/746: dread - df/dbd/fe3 zero size 2024-02-28T16:24:18.460 INFO:tasks.workunit.client.0.smithi023.stdout:8/787: mkdir d0/d5/d35/dbf/d100/d103 0 2024-02-28T16:24:18.469 INFO:tasks.workunit.client.0.smithi023.stdout:5/976: mknod d1/d2a/d32/ddc/de3/d138/c13d 0 2024-02-28T16:24:18.470 INFO:tasks.workunit.client.0.smithi023.stdout:1/747: dread df/d11/d13/d1b/d2e/fc9 [0,4194304] 0 2024-02-28T16:24:18.476 INFO:tasks.workunit.client.0.smithi023.stdout:7/691: dread de/d1c/d76/f86 [0,4194304] 0 2024-02-28T16:24:18.477 INFO:tasks.workunit.client.0.smithi023.stdout:9/712: creat d0/d7/de/d2a/daf/d2f/d44/d95/ff7 x:0 0 0 2024-02-28T16:24:18.479 INFO:tasks.workunit.client.0.smithi023.stdout:9/713: readlink d0/d7/d2c/l7a 0 2024-02-28T16:24:18.480 INFO:tasks.workunit.client.0.smithi023.stdout:9/714: dread - d0/d7/db/d18/d23/fd8 zero size 2024-02-28T16:24:18.483 INFO:tasks.workunit.client.0.smithi023.stdout:0/715: mknod d6/cfa 0 2024-02-28T16:24:18.486 INFO:tasks.workunit.client.0.smithi023.stdout:0/716: write d6/db/d1a/d26/d31/d33/f94 [4777522,48093] 0 2024-02-28T16:24:18.498 INFO:tasks.workunit.client.0.smithi023.stdout:8/788: write d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/f101 [759864,17379] 0 2024-02-28T16:24:18.500 INFO:tasks.workunit.client.0.smithi023.stdout:7/692: dwrite de/d13/d1b/f4c [0,4194304] 0 2024-02-28T16:24:18.502 INFO:tasks.workunit.client.0.smithi023.stdout:9/715: mknod d0/d7/db/dec/cf8 0 2024-02-28T16:24:18.506 INFO:tasks.workunit.client.0.smithi023.stdout:7/693: fdatasync de/d13/d1b/d3d/fd5 0 2024-02-28T16:24:18.511 INFO:tasks.workunit.client.0.smithi023.stdout:6/839: getdents d1/d28/d1e/d2b/d44/d101 0 2024-02-28T16:24:18.519 INFO:tasks.workunit.client.0.smithi023.stdout:5/977: dread d1/d2a/d32/ddc/de3/f107 [0,4194304] 0 2024-02-28T16:24:18.521 INFO:tasks.workunit.client.0.smithi023.stdout:8/789: mkdir d0/d5/d104 0 2024-02-28T16:24:18.525 INFO:tasks.workunit.client.0.smithi023.stdout:2/826: rename d5/da/db/d17/d3c/f3d to d5/da/f106 0 2024-02-28T16:24:18.525 INFO:tasks.workunit.client.0.smithi023.stdout:1/748: dread df/dbd/f50 [0,4194304] 0 2024-02-28T16:24:18.530 INFO:tasks.workunit.client.0.smithi023.stdout:6/840: mkdir d1/d28/d1e/d80/d109/d12e 0 2024-02-28T16:24:18.530 INFO:tasks.workunit.client.0.smithi023.stdout:1/749: write df/d11/d13/d1b/d30/f41 [1160705,102097] 0 2024-02-28T16:24:18.536 INFO:tasks.workunit.client.0.smithi023.stdout:2/827: creat d5/da/d1b/f107 x:0 0 0 2024-02-28T16:24:18.537 INFO:tasks.workunit.client.0.smithi023.stdout:6/841: truncate d1/d28/d1e/d2b/d44/d86/d12c/f4a 1776004 0 2024-02-28T16:24:18.540 INFO:tasks.workunit.client.0.smithi023.stdout:9/716: creat d0/d7/db/ff9 x:0 0 0 2024-02-28T16:24:18.543 INFO:tasks.workunit.client.0.smithi023.stdout:3/761: sync 2024-02-28T16:24:18.544 INFO:tasks.workunit.client.0.smithi023.stdout:1/750: creat df/dbd/d6c/ffd x:0 0 0 2024-02-28T16:24:18.545 INFO:tasks.workunit.client.0.smithi023.stdout:7/694: rmdir de/d13/d1b/dce 0 2024-02-28T16:24:18.548 INFO:tasks.workunit.client.0.smithi023.stdout:0/717: link d6/c7a d6/db/d1a/d35/d9d/cfb 0 2024-02-28T16:24:18.549 INFO:tasks.workunit.client.0.smithi023.stdout:8/790: mkdir d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/dfa/d105 0 2024-02-28T16:24:18.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.566+0000 7fe592000700 1 -- 172.21.15.23:0/2069077492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c0ff130 msgr2=0x7fe58c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:18.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.566+0000 7fe592000700 1 --2- 172.21.15.23:0/2069077492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c0ff130 0x7fe58c0ff540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe578009910 tx=0x7fe578009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:18.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.566+0000 7fe592000700 1 -- 172.21.15.23:0/2069077492 shutdown_connections 2024-02-28T16:24:18.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.566+0000 7fe592000700 1 --2- 172.21.15.23:0/2069077492 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c1003d0 0x7fe58c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:18.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.566+0000 7fe592000700 1 --2- 172.21.15.23:0/2069077492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c0ff130 0x7fe58c0ff540 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:18.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.566+0000 7fe592000700 1 -- 172.21.15.23:0/2069077492 >> 172.21.15.23:0/2069077492 conn(0x7fe58c0fa780 msgr2=0x7fe58c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:18.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.567+0000 7fe592000700 1 -- 172.21.15.23:0/2069077492 shutdown_connections 2024-02-28T16:24:18.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.567+0000 7fe592000700 1 -- 172.21.15.23:0/2069077492 wait complete. 2024-02-28T16:24:18.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.568+0000 7fe592000700 1 Processor -- start 2024-02-28T16:24:18.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.568+0000 7fe592000700 1 -- start start 2024-02-28T16:24:18.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.569+0000 7fe592000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c0ff130 0x7fe58c197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:18.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.569+0000 7fe592000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c1003d0 0x7fe58c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:18.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.569+0000 7fe592000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c1988a0 con 0x7fe58c0ff130 2024-02-28T16:24:18.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.569+0000 7fe592000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c19d2b0 con 0x7fe58c1003d0 2024-02-28T16:24:18.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.570+0000 7fe58b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c0ff130 0x7fe58c197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:18.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.570+0000 7fe58b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c0ff130 0x7fe58c197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57816/0 (socket says 172.21.15.23:57816) 2024-02-28T16:24:18.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.570+0000 7fe58b400700 1 -- 172.21.15.23:0/2273595325 learned_addr learned my addr 172.21.15.23:0/2273595325 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:18.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.570+0000 7fe58aa00700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c1003d0 0x7fe58c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:18.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.571+0000 7fe58b400700 1 -- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c1003d0 msgr2=0x7fe58c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:18.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.571+0000 7fe58b400700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c1003d0 0x7fe58c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:18.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.571+0000 7fe58b400700 1 -- 172.21.15.23:0/2273595325 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780095f0 con 0x7fe58c0ff130 2024-02-28T16:24:18.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.571+0000 7fe58b400700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c0ff130 0x7fe58c197d40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe57800bda0 tx=0x7fe57800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:18.561 INFO:tasks.workunit.client.0.smithi023.stdout:9/717: stat d0/d7/d2c/d84/fb3 0 2024-02-28T16:24:18.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.572+0000 7fe583e00700 1 -- 172.21.15.23:0/2273595325 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57801d070 con 0x7fe58c0ff130 2024-02-28T16:24:18.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.573+0000 7fe592000700 1 -- 172.21.15.23:0/2273595325 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c19d450 con 0x7fe58c0ff130 2024-02-28T16:24:18.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.573+0000 7fe583e00700 1 -- 172.21.15.23:0/2273595325 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe578004bd0 con 0x7fe58c0ff130 2024-02-28T16:24:18.564 INFO:tasks.workunit.client.0.smithi023.stdout:7/695: symlink de/d8b/d95/d98/le4 0 2024-02-28T16:24:18.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.573+0000 7fe592000700 1 -- 172.21.15.23:0/2273595325 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c19d910 con 0x7fe58c0ff130 2024-02-28T16:24:18.565 INFO:tasks.workunit.client.0.smithi023.stdout:2/828: dwrite d5/da/db/d17/d39/d56/fad [0,4194304] 0 2024-02-28T16:24:18.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.573+0000 7fe583e00700 1 -- 172.21.15.23:0/2273595325 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57800f690 con 0x7fe58c0ff130 2024-02-28T16:24:18.566 INFO:tasks.workunit.client.0.smithi023.stdout:7/696: chown de/l9d 436436963 1 2024-02-28T16:24:18.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.577+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5640052f0 con 0x7fe58c0ff130 2024-02-28T16:24:18.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.578+0000 7fe583e00700 1 -- 172.21.15.23:0/2273595325 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 26) v1 ==== 91442+0+0 (secure 0 0 0) 0x7fe578022470 con 0x7fe58c0ff130 2024-02-28T16:24:18.569 INFO:tasks.workunit.client.0.smithi023.stdout:3/762: rename d1/f20 to d1/d74/d94/de4/d109/df9/f10a 0 2024-02-28T16:24:18.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.581+0000 7fe583e00700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe57006d6a0 0x7fe57006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:18.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.581+0000 7fe583e00700 1 -- 172.21.15.23:0/2273595325 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe57808e890 con 0x7fe58c0ff130 2024-02-28T16:24:18.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.582+0000 7fe58aa00700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe57006d6a0 0x7fe57006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:18.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.584+0000 7fe58aa00700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe57006d6a0 0x7fe57006fb50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006fd0 tx=0x7fe57c008040 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:18.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:18.587+0000 7fe583e00700 1 -- 172.21.15.23:0/2273595325 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fe5780585f0 con 0x7fe58c0ff130 2024-02-28T16:24:18.580 INFO:tasks.workunit.client.0.smithi023.stdout:8/791: rmdir d0 39 2024-02-28T16:24:18.581 INFO:tasks.workunit.client.0.smithi023.stdout:6/842: write d1/d28/d1e/d2b/d44/d86/fa2 [1022049,23066] 0 2024-02-28T16:24:18.583 INFO:tasks.workunit.client.0.smithi023.stdout:2/829: readlink d5/da/d8c/dd3/lfc 0 2024-02-28T16:24:18.583 INFO:tasks.workunit.client.0.smithi023.stdout:9/718: creat d0/d7/db/d18/d23/d28/d32/d8b/ffa x:0 0 0 2024-02-28T16:24:18.586 INFO:tasks.workunit.client.0.smithi023.stdout:1/751: write df/d11/d13/d27/f53 [3043453,59993] 0 2024-02-28T16:24:18.590 INFO:tasks.workunit.client.0.smithi023.stdout:5/978: dwrite d1/d2a/d32/d58/d60/d81/f86 [0,4194304] 0 2024-02-28T16:24:18.590 INFO:tasks.workunit.client.0.smithi023.stdout:3/763: creat d1/d74/d46/de9/f10b x:0 0 0 2024-02-28T16:24:18.595 INFO:tasks.workunit.client.0.smithi023.stdout:3/764: chown d1/f41 3681 1 2024-02-28T16:24:18.596 INFO:tasks.workunit.client.0.smithi023.stdout:0/718: symlink d6/db/d1a/d26/d31/d33/d6e/db1/lfc 0 2024-02-28T16:24:18.598 INFO:tasks.workunit.client.0.smithi023.stdout:7/697: dwrite de/d13/f2b [0,4194304] 0 2024-02-28T16:24:18.618 INFO:tasks.workunit.client.0.smithi023.stdout:6/843: mkdir d1/d28/d1e/d80/dc2/d118/d12f 0 2024-02-28T16:24:18.622 INFO:tasks.workunit.client.0.smithi023.stdout:0/719: rmdir d6/db/d1a 39 2024-02-28T16:24:18.622 INFO:tasks.workunit.client.0.smithi023.stdout:5/979: read d1/d2a/d32/d37/d4e/f57 [983815,81696] 0 2024-02-28T16:24:18.623 INFO:tasks.workunit.client.0.smithi023.stdout:7/698: stat de/d13/f2b 0 2024-02-28T16:24:18.625 INFO:tasks.workunit.client.0.smithi023.stdout:8/792: truncate d0/d5/d1a/d2d/d67/ff9 974579 0 2024-02-28T16:24:18.627 INFO:tasks.workunit.client.0.smithi023.stdout:3/765: creat d1/d74/d94/de4/d109/df9/f10c x:0 0 0 2024-02-28T16:24:18.627 INFO:tasks.workunit.client.0.smithi023.stdout:6/844: chown d1/d28/d1e/d2b/d6d/d7b/ldb 168826592 1 2024-02-28T16:24:18.630 INFO:tasks.workunit.client.0.smithi023.stdout:0/720: creat d6/db/dab/d82/ffd x:0 0 0 2024-02-28T16:24:18.634 INFO:tasks.workunit.client.0.smithi023.stdout:6/845: dread - d1/d3d/f127 zero size 2024-02-28T16:24:18.636 INFO:tasks.workunit.client.0.smithi023.stdout:7/699: creat de/d1c/d76/d7b/dab/fe5 x:0 0 0 2024-02-28T16:24:18.639 INFO:tasks.workunit.client.0.smithi023.stdout:7/700: stat de/d13/d1b/d6c/db6 0 2024-02-28T16:24:18.640 INFO:tasks.workunit.client.0.smithi023.stdout:8/793: mkdir d0/d5/d1a/d2d/d67/d71/db4/dfb/d106 0 2024-02-28T16:24:18.643 INFO:tasks.workunit.client.0.smithi023.stdout:3/766: fdatasync d1/df/d2d/d45/d78/fed 0 2024-02-28T16:24:18.643 INFO:tasks.workunit.client.0.smithi023.stdout:7/701: dread - de/d9b/fa8 zero size 2024-02-28T16:24:18.649 INFO:tasks.workunit.client.0.smithi023.stdout:0/721: dread d6/db/dab/d82/d72/d79/f8b [0,4194304] 0 2024-02-28T16:24:18.661 INFO:tasks.workunit.client.0.smithi023.stdout:6/846: creat d1/d18/dd8/de8/ded/d11d/f130 x:0 0 0 2024-02-28T16:24:18.661 INFO:tasks.workunit.client.0.smithi023.stdout:8/794: chown d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/fbc 90 1 2024-02-28T16:24:18.664 INFO:tasks.workunit.client.0.smithi023.stdout:6/847: chown d1/cf 0 1 2024-02-28T16:24:18.664 INFO:tasks.workunit.client.0.smithi023.stdout:7/702: readlink de/d1c/d76/le0 0 2024-02-28T16:24:18.665 INFO:tasks.workunit.client.0.smithi023.stdout:8/795: chown d0/la 1794905 1 2024-02-28T16:24:18.665 INFO:tasks.workunit.client.0.smithi023.stdout:5/980: dwrite d1/d2a/d32/f13b [0,4194304] 0 2024-02-28T16:24:18.666 INFO:tasks.workunit.client.0.smithi023.stdout:1/752: write df/d11/f54 [769009,100470] 0 2024-02-28T16:24:18.671 INFO:tasks.workunit.client.0.smithi023.stdout:1/753: stat df/d11/d13/d99/dfc/dd6 0 2024-02-28T16:24:18.680 INFO:tasks.workunit.client.0.smithi023.stdout:9/719: dread d0/f1f [0,4194304] 0 2024-02-28T16:24:18.680 INFO:tasks.workunit.client.0.smithi023.stdout:0/722: rmdir d6/d4c/d6a 39 2024-02-28T16:24:18.687 INFO:tasks.workunit.client.0.smithi023.stdout:0/723: read - d6/db/dab/d82/da3/fe2 zero size 2024-02-28T16:24:18.713 INFO:tasks.workunit.client.0.smithi023.stdout:4/690: sync 2024-02-28T16:24:18.725 INFO:tasks.workunit.client.0.smithi023.stdout:1/754: chown df/dbd/d6c/cb6 31589579 1 2024-02-28T16:24:18.725 INFO:tasks.workunit.client.0.smithi023.stdout:8/796: chown d0/d5/d1a/d2d/d67/d71/db4/fab 2 1 2024-02-28T16:24:18.727 INFO:tasks.workunit.client.0.smithi023.stdout:8/797: chown d0/d5/d1a/d63/d90 10377039 1 2024-02-28T16:24:18.728 INFO:tasks.workunit.client.0.smithi023.stdout:0/724: write d6/db/dab/d82/fae [1475592,6771] 0 2024-02-28T16:24:18.731 INFO:tasks.workunit.client.0.smithi023.stdout:8/798: write d0/d5/d1a/f4b [1318589,44264] 0 2024-02-28T16:24:18.732 INFO:tasks.workunit.client.0.smithi023.stdout:8/799: readlink d0/d5/d1b/l4a 0 2024-02-28T16:24:18.748 INFO:tasks.workunit.client.0.smithi023.stdout:8/800: mknod d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/c107 0 2024-02-28T16:24:18.749 INFO:tasks.workunit.client.0.smithi023.stdout:5/981: getdents d1/d2a/d32/d58/d60 0 2024-02-28T16:24:18.750 INFO:tasks.workunit.client.0.smithi023.stdout:4/691: getdents d13/d1d/d2d/da9 0 2024-02-28T16:24:18.754 INFO:tasks.workunit.client.0.smithi023.stdout:8/801: truncate d0/d5/d1a/d2d/d67/ff9 1893520 0 2024-02-28T16:24:18.755 INFO:tasks.workunit.client.0.smithi023.stdout:4/692: fsync d13/d1d/d58/f84 0 2024-02-28T16:24:18.763 INFO:tasks.workunit.client.0.smithi023.stdout:0/725: dwrite d6/db/d1a/d26/d9c/fe0 [0,4194304] 0 2024-02-28T16:24:18.766 INFO:tasks.workunit.client.0.smithi023.stdout:4/693: rmdir d13/d1d/d2d/da9 39 2024-02-28T16:24:18.768 INFO:tasks.workunit.client.0.smithi023.stdout:5/982: getdents d1/d2a/d32/d36 0 2024-02-28T16:24:18.772 INFO:tasks.workunit.client.0.smithi023.stdout:5/983: truncate d1/f13c 91442 0 2024-02-28T16:24:18.772 INFO:tasks.workunit.client.0.smithi023.stdout:0/726: fsync d6/db/f39 0 2024-02-28T16:24:18.775 INFO:tasks.workunit.client.0.smithi023.stdout:6/848: write d1/d18/dd8/de8/ded/d11d/fcf [95280,17710] 0 2024-02-28T16:24:18.779 INFO:tasks.workunit.client.0.smithi023.stdout:7/703: write de/d1c/d76/d7b/dad/fc7 [2737529,16719] 0 2024-02-28T16:24:18.782 INFO:tasks.workunit.client.0.smithi023.stdout:1/755: write df/d26/d48/fa1 [32698,28556] 0 2024-02-28T16:24:18.786 INFO:tasks.workunit.client.0.smithi023.stdout:0/727: creat d6/db/d1a/d35/d86/ffe x:0 0 0 2024-02-28T16:24:18.788 INFO:tasks.workunit.client.0.smithi023.stdout:5/984: write d1/d2a/d32/d37/d3a/d7f/f120 [460146,33461] 0 2024-02-28T16:24:18.790 INFO:tasks.workunit.client.0.smithi023.stdout:0/728: chown d6 1040305 1 2024-02-28T16:24:18.792 INFO:tasks.workunit.client.0.smithi023.stdout:3/767: dwrite d1/df/d33/d38/f48 [0,4194304] 0 2024-02-28T16:24:18.794 INFO:tasks.workunit.client.0.smithi023.stdout:7/704: unlink de/d1c/f5a 0 2024-02-28T16:24:18.800 INFO:tasks.workunit.client.0.smithi023.stdout:1/756: creat df/dbd/d6c/ffe x:0 0 0 2024-02-28T16:24:18.801 INFO:tasks.workunit.client.0.smithi023.stdout:5/985: mkdir d1/d2a/d32/d36/da7/d13e 0 2024-02-28T16:24:18.806 INFO:tasks.workunit.client.0.smithi023.stdout:3/768: write d1/d74/d94/de4/d109/fa6 [433593,126396] 0 2024-02-28T16:24:18.806 INFO:tasks.workunit.client.0.smithi023.stdout:4/694: dwrite d13/d2b/d2c/f2f [4194304,4194304] 0 2024-02-28T16:24:18.807 INFO:tasks.workunit.client.0.smithi023.stdout:6/849: write d1/d18/d26/fa8 [18251,64908] 0 2024-02-28T16:24:18.808 INFO:tasks.workunit.client.0.smithi023.stdout:7/705: mknod de/d9b/ce6 0 2024-02-28T16:24:18.809 INFO:tasks.workunit.client.0.smithi023.stdout:5/986: fsync d1/d2a/d32/d6e/f135 0 2024-02-28T16:24:18.811 INFO:tasks.workunit.client.0.smithi023.stdout:0/729: chown d6/db/d3b/l69 214981214 1 2024-02-28T16:24:18.818 INFO:tasks.workunit.client.0.smithi023.stdout:0/730: dread - d6/db/dab/d42/f83 zero size 2024-02-28T16:24:18.820 INFO:tasks.workunit.client.0.smithi023.stdout:3/769: fsync d1/f27 0 2024-02-28T16:24:18.820 INFO:tasks.workunit.client.0.smithi023.stdout:8/802: dwrite d0/d5/d1a/d2d/f61 [0,4194304] 0 2024-02-28T16:24:18.822 INFO:tasks.workunit.client.0.smithi023.stdout:6/850: mkdir d1/d3d/d7d/d131 0 2024-02-28T16:24:18.831 INFO:tasks.workunit.client.0.smithi023.stdout:4/695: symlink d13/d1d/d58/ldf 0 2024-02-28T16:24:18.834 INFO:tasks.workunit.client.0.smithi023.stdout:4/696: read d13/d1d/d85/fb1 [98523,57882] 0 2024-02-28T16:24:18.837 INFO:tasks.workunit.client.0.smithi023.stdout:7/706: rename fc to de/d1c/d76/fe7 0 2024-02-28T16:24:18.842 INFO:tasks.workunit.client.0.smithi023.stdout:5/987: mknod d1/d2a/d32/d6e/c13f 0 2024-02-28T16:24:18.851 INFO:tasks.workunit.client.0.smithi023.stdout:8/803: unlink d0/d5/d1a/d2d/d67/d71/db4/f46 0 2024-02-28T16:24:18.856 INFO:tasks.workunit.client.0.smithi023.stdout:4/697: readlink d13/d2b/l3b 0 2024-02-28T16:24:18.857 INFO:tasks.workunit.client.0.smithi023.stdout:7/707: fsync de/d13/fc1 0 2024-02-28T16:24:18.862 INFO:tasks.workunit.client.0.smithi023.stdout:1/757: getdents df/d26 0 2024-02-28T16:24:18.864 INFO:tasks.workunit.client.0.smithi023.stdout:3/770: creat d1/d4a/d92/dff/f10d x:0 0 0 2024-02-28T16:24:18.871 INFO:tasks.workunit.client.0.smithi023.stdout:5/988: truncate d1/d2a/d32/d37/d3a/d7f/d62/dd1/f10b 861171 0 2024-02-28T16:24:18.871 INFO:tasks.workunit.client.0.smithi023.stdout:6/851: dread d1/d28/f62 [0,4194304] 0 2024-02-28T16:24:18.871 INFO:tasks.workunit.client.0.smithi023.stdout:8/804: rename d0/d5/d1b/f4d to d0/d5/d1a/d2d/d67/d71/db4/dfb/f108 0 2024-02-28T16:24:18.872 INFO:tasks.workunit.client.0.smithi023.stdout:1/758: write df/dbd/d6c/ffe [298827,43938] 0 2024-02-28T16:24:18.873 INFO:tasks.workunit.client.0.smithi023.stdout:3/771: write d1/d74/d94/de4/d109/fe2 [663841,24454] 0 2024-02-28T16:24:18.880 INFO:tasks.workunit.client.0.smithi023.stdout:0/731: getdents d6/db/d1a/d59/dcd 0 2024-02-28T16:24:18.884 INFO:tasks.workunit.client.0.smithi023.stdout:8/805: rename d0/d5/d1a/d63/d90/dac/dc3/lc9 to d0/d5/d1a/d2d/d67/d71/db4/l109 0 2024-02-28T16:24:18.886 INFO:tasks.workunit.client.0.smithi023.stdout:0/732: read d6/db/d5d/f76 [2025358,128906] 0 2024-02-28T16:24:18.887 INFO:tasks.workunit.client.0.smithi023.stdout:3/772: creat d1/df/d2d/d45/d52/f10e x:0 0 0 2024-02-28T16:24:18.891 INFO:tasks.workunit.client.0.smithi023.stdout:0/733: rmdir d6 39 2024-02-28T16:24:18.891 INFO:tasks.workunit.client.0.smithi023.stdout:8/806: truncate d0/d5/d1a/f2e 866365 0 2024-02-28T16:24:18.893 INFO:tasks.workunit.client.0.smithi023.stdout:3/773: fsync d1/df/f104 0 2024-02-28T16:24:18.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:18 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:18.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:18 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1383085681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:18.896 INFO:tasks.workunit.client.0.smithi023.stdout:4/698: dwrite d13/d1d/d2d/da9/fd9 [0,4194304] 0 2024-02-28T16:24:18.900 INFO:tasks.workunit.client.0.smithi023.stdout:8/807: creat d0/d5/d1a/d63/d90/dac/f10a x:0 0 0 2024-02-28T16:24:18.904 INFO:tasks.workunit.client.0.smithi023.stdout:8/808: stat d0/d5/d1a/d2d/d67/d71/f9c 0 2024-02-28T16:24:18.906 INFO:tasks.workunit.client.0.smithi023.stdout:8/809: chown d0/d5/d1b/l16 3900784 1 2024-02-28T16:24:18.906 INFO:tasks.workunit.client.0.smithi023.stdout:3/774: creat d1/d4a/f10f x:0 0 0 2024-02-28T16:24:18.909 INFO:tasks.workunit.client.0.smithi023.stdout:4/699: unlink d13/d1d/d2e/f89 0 2024-02-28T16:24:18.912 INFO:tasks.workunit.client.0.smithi023.stdout:3/775: mkdir d1/d74/d94/de4/d110 0 2024-02-28T16:24:18.920 INFO:tasks.workunit.client.0.smithi023.stdout:0/734: dwrite d6/db/dab/d42/f83 [0,4194304] 0 2024-02-28T16:24:18.923 INFO:tasks.workunit.client.0.smithi023.stdout:0/735: truncate d6/fdd 5127957 0 2024-02-28T16:24:18.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:18 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:18.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:18 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1383085681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:18.924 INFO:tasks.workunit.client.0.smithi023.stdout:3/776: truncate d1/d74/d94/de4/d109/df9/f10c 827772 0 2024-02-28T16:24:18.927 INFO:tasks.workunit.client.0.smithi023.stdout:3/777: write d1/df/d2d/d45/f86 [1992540,85098] 0 2024-02-28T16:24:18.930 INFO:tasks.workunit.client.0.smithi023.stdout:8/810: creat d0/d5/d1a/d2d/d67/f10b x:0 0 0 2024-02-28T16:24:18.933 INFO:tasks.workunit.client.0.smithi023.stdout:0/736: creat d6/db/d1a/d35/d9d/fff x:0 0 0 2024-02-28T16:24:18.935 INFO:tasks.workunit.client.0.smithi023.stdout:4/700: link d13/c86 d13/d1d/d58/ce0 0 2024-02-28T16:24:18.935 INFO:tasks.workunit.client.0.smithi023.stdout:8/811: truncate d0/d5/d1a/fa2 4888281 0 2024-02-28T16:24:18.942 INFO:tasks.workunit.client.0.smithi023.stdout:3/778: mkdir d1/df/d2d/d111 0 2024-02-28T16:24:18.943 INFO:tasks.workunit.client.0.smithi023.stdout:6/852: write d1/f11 [1368682,24403] 0 2024-02-28T16:24:18.944 INFO:tasks.workunit.client.0.smithi023.stdout:7/708: truncate de/d13/d1b/f4c 2752727 0 2024-02-28T16:24:18.945 INFO:tasks.workunit.client.0.smithi023.stdout:6/853: read d1/f1c [696379,122504] 0 2024-02-28T16:24:18.946 INFO:tasks.workunit.client.0.smithi023.stdout:3/779: write d1/d74/d94/de4/d109/fe2 [1508431,38997] 0 2024-02-28T16:24:18.949 INFO:tasks.workunit.client.0.smithi023.stdout:7/709: write de/d1c/d76/f7f [5835889,18859] 0 2024-02-28T16:24:18.957 INFO:tasks.workunit.client.0.smithi023.stdout:1/759: dread df/d11/d13/d1b/d2e/f84 [0,4194304] 0 2024-02-28T16:24:18.963 INFO:tasks.workunit.client.0.smithi023.stdout:8/812: dwrite d0/d5/d1b/f33 [0,4194304] 0 2024-02-28T16:24:18.967 INFO:tasks.workunit.client.0.smithi023.stdout:0/737: creat d6/db/dab/f100 x:0 0 0 2024-02-28T16:24:18.967 INFO:tasks.workunit.client.0.smithi023.stdout:1/760: dread df/dbd/d6c/ffe [0,4194304] 0 2024-02-28T16:24:18.970 INFO:tasks.workunit.client.0.smithi023.stdout:1/761: write df/d11/d13/d1b/d30/dae/fe5 [167876,127598] 0 2024-02-28T16:24:18.973 INFO:tasks.workunit.client.0.smithi023.stdout:6/854: symlink d1/d28/d1e/d2b/d44/d86/d12c/l132 0 2024-02-28T16:24:18.973 INFO:tasks.workunit.client.0.smithi023.stdout:1/762: stat df/dbd/d6c/dd3/cf0 0 2024-02-28T16:24:18.983 INFO:tasks.workunit.client.0.smithi023.stdout:0/738: mkdir d6/db/d1a/d1b/d101 0 2024-02-28T16:24:18.991 INFO:tasks.workunit.client.0.smithi023.stdout:3/780: creat d1/df/d2d/f112 x:0 0 0 2024-02-28T16:24:18.992 INFO:tasks.workunit.client.0.smithi023.stdout:6/855: truncate d1/d28/d1e/d2b/ffa 538239 0 2024-02-28T16:24:18.994 INFO:tasks.workunit.client.0.smithi023.stdout:3/781: chown d1/d4a/l4e 36068594 1 2024-02-28T16:24:18.995 INFO:tasks.workunit.client.0.smithi023.stdout:6/856: stat d1/d28/d1e/d2b/d6d/fc8 0 2024-02-28T16:24:18.999 INFO:tasks.workunit.client.0.smithi023.stdout:1/763: truncate df/d11/d13/d1b/d30/d57/d5a/d68/f89 2304481 0 2024-02-28T16:24:19.001 INFO:tasks.workunit.client.0.smithi023.stdout:6/857: chown d1/d28/d1e/d2b/d6d/d7b/fcc 31486796 1 2024-02-28T16:24:19.003 INFO:tasks.workunit.client.0.smithi023.stdout:4/701: write d13/d1d/d2e/f52 [2717961,19914] 0 2024-02-28T16:24:19.004 INFO:tasks.workunit.client.0.smithi023.stdout:8/813: creat d0/d5/d1a/d2d/d67/d71/f10c x:0 0 0 2024-02-28T16:24:19.007 INFO:tasks.workunit.client.0.smithi023.stdout:1/764: mkdir df/d26/d48/d72/dff 0 2024-02-28T16:24:19.011 INFO:tasks.workunit.client.0.smithi023.stdout:8/814: stat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/f6b 0 2024-02-28T16:24:19.013 INFO:tasks.workunit.client.0.smithi023.stdout:6/858: fsync d1/d28/d1e/f111 0 2024-02-28T16:24:19.015 INFO:tasks.workunit.client.0.smithi023.stdout:7/710: dwrite de/d13/d1b/f4c [0,4194304] 0 2024-02-28T16:24:19.017 INFO:tasks.workunit.client.0.smithi023.stdout:3/782: creat d1/df/d2d/f113 x:0 0 0 2024-02-28T16:24:19.025 INFO:tasks.workunit.client.0.smithi023.stdout:7/711: read de/fae [396831,62098] 0 2024-02-28T16:24:19.030 INFO:tasks.workunit.client.0.smithi023.stdout:1/765: unlink df/d11/d13/d1b/d30/d57/d5a/d68/d7a/fb1 0 2024-02-28T16:24:19.034 INFO:tasks.workunit.client.0.smithi023.stdout:6/859: creat d1/d18/dd8/de8/ded/d11d/f133 x:0 0 0 2024-02-28T16:24:19.040 INFO:tasks.workunit.client.0.smithi023.stdout:6/860: write d1/d28/d1e/d52/feb [1731074,19710] 0 2024-02-28T16:24:19.043 INFO:tasks.workunit.client.0.smithi023.stdout:8/815: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/fa4 [0,4194304] 0 2024-02-28T16:24:19.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.053+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe564005c90 con 0x7fe58c0ff130 2024-02-28T16:24:19.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.055+0000 7fe583e00700 1 -- 172.21.15.23:0/2273595325 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7fe57808e020 con 0x7fe58c0ff130 2024-02-28T16:24:19.045 INFO:tasks.workunit.client.0.smithi023.stdout:3/783: dread d1/d74/d94/de4/d109/fe2 [0,4194304] 0 2024-02-28T16:24:19.051 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:24:19.051 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:24:19.051 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:24:19.051 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:24:19.051 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:19.051 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:24:19.052 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:24:19.053 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:19.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.060+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe57006d6a0 msgr2=0x7fe57006fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.060+0000 7fe581600700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe57006d6a0 0x7fe57006fb50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006fd0 tx=0x7fe57c008040 comp rx=0 tx=0).stop 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.060+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c0ff130 msgr2=0x7fe58c197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.060+0000 7fe581600700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c0ff130 0x7fe58c197d40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe57800bda0 tx=0x7fe57800be80 comp rx=0 tx=0).stop 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.062+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 shutdown_connections 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.062+0000 7fe581600700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7fe57006d6a0 0x7fe57006fb50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.062+0000 7fe581600700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe58c0ff130 0x7fe58c197d40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.062+0000 7fe581600700 1 --2- 172.21.15.23:0/2273595325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58c1003d0 0x7fe58c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.062+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 >> 172.21.15.23:0/2273595325 conn(0x7fe58c0fa780 msgr2=0x7fe58c0fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.055 INFO:tasks.workunit.client.0.smithi023.stdout:9/720: sync 2024-02-28T16:24:19.056 INFO:tasks.workunit.client.0.smithi023.stdout:2/830: sync 2024-02-28T16:24:19.056 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.063+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 shutdown_connections 2024-02-28T16:24:19.056 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.063+0000 7fe581600700 1 -- 172.21.15.23:0/2273595325 wait complete. 2024-02-28T16:24:19.056 INFO:tasks.workunit.client.0.smithi023.stdout:0/739: dwrite d6/db/dab/d82/d72/d79/fbb [0,4194304] 0 2024-02-28T16:24:19.060 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:24:19.061 INFO:tasks.workunit.client.0.smithi023.stdout:2/831: write d5/da/d104/dd0/f95 [515395,27741] 0 2024-02-28T16:24:19.066 INFO:tasks.workunit.client.0.smithi023.stdout:4/702: dwrite d13/d2b/d2c/d31/dc4/fb0 [0,4194304] 0 2024-02-28T16:24:19.069 INFO:tasks.workunit.client.0.smithi023.stdout:8/816: dwrite d0/d5/d1b/d36/f85 [0,4194304] 0 2024-02-28T16:24:19.075 INFO:tasks.workunit.client.0.smithi023.stdout:4/703: write d13/d2b/d2c/f2f [1303697,37966] 0 2024-02-28T16:24:19.090 INFO:tasks.workunit.client.0.smithi023.stdout:3/784: read d1/df/d2d/d45/d6f/f101 [783134,53976] 0 2024-02-28T16:24:19.094 INFO:tasks.workunit.client.0.smithi023.stdout:3/785: write d1/df/d2d/d45/d52/f5b [4000125,15837] 0 2024-02-28T16:24:19.096 INFO:tasks.workunit.client.0.smithi023.stdout:9/721: stat d0/d7/de/d2a/daf/fa9 0 2024-02-28T16:24:19.104 INFO:tasks.workunit.client.0.smithi023.stdout:8/817: rmdir d0/d5/d1a/d2d 39 2024-02-28T16:24:19.110 INFO:tasks.workunit.client.0.smithi023.stdout:1/766: dwrite df/fa0 [0,4194304] 0 2024-02-28T16:24:19.110 INFO:tasks.workunit.client.0.smithi023.stdout:5/989: sync 2024-02-28T16:24:19.116 INFO:tasks.workunit.client.0.smithi023.stdout:3/786: write d1/df/d2d/d45/d52/d65/d89/f100 [2245090,13822] 0 2024-02-28T16:24:19.125 INFO:tasks.workunit.client.0.smithi023.stdout:9/722: rename d0/d7/de/d2a/daf/d2f/d44/dd5 to d0/d7/db/d18/d23/d28/d32/dca/dfb 0 2024-02-28T16:24:19.127 INFO:tasks.workunit.client.0.smithi023.stdout:7/712: truncate de/d13/d1b/d6c/f97 415363 0 2024-02-28T16:24:19.128 INFO:tasks.workunit.client.0.smithi023.stdout:2/832: creat d5/da/db/d17/d3c/d7f/f108 x:0 0 0 2024-02-28T16:24:19.131 INFO:tasks.workunit.client.0.smithi023.stdout:2/833: chown d5/da/db/d17/d39/d56/la8 47877 1 2024-02-28T16:24:19.138 INFO:tasks.workunit.client.0.smithi023.stdout:5/990: mkdir d1/d2a/d32/d37/d4e/d10d/d140 0 2024-02-28T16:24:19.141 INFO:tasks.workunit.client.0.smithi023.stdout:6/861: truncate d1/f2f 1427829 0 2024-02-28T16:24:19.141 INFO:tasks.workunit.client.0.smithi023.stdout:3/787: mkdir d1/df/d33/d38/d6c/df5/d114 0 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 -- 172.21.15.23:0/2184248126 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f94101440 msgr2=0x7f6f94101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 --2- 172.21.15.23:0/2184248126 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f94101440 0x7f6f94101890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009910 tx=0x7f6f80009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 -- 172.21.15.23:0/2184248126 shutdown_connections 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 --2- 172.21.15.23:0/2184248126 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f94101440 0x7f6f94101890 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 --2- 172.21.15.23:0/2184248126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 0x7f6f94100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 -- 172.21.15.23:0/2184248126 >> 172.21.15.23:0/2184248126 conn(0x7f6f940fb7f0 msgr2=0x7f6f940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 -- 172.21.15.23:0/2184248126 shutdown_connections 2024-02-28T16:24:19.233 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.243+0000 7f6f99800700 1 -- 172.21.15.23:0/2184248126 wait complete. 2024-02-28T16:24:19.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.244+0000 7f6f99800700 1 Processor -- start 2024-02-28T16:24:19.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.244+0000 7f6f99800700 1 -- start start 2024-02-28T16:24:19.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.245+0000 7f6f99800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 0x7f6f94195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.245+0000 7f6f99800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f94101440 0x7f6f94196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.234 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.245+0000 7f6f99800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941966b0 con 0x7f6f94101440 2024-02-28T16:24:19.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.245+0000 7f6f99800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941967f0 con 0x7f6f94100240 2024-02-28T16:24:19.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.245+0000 7f6f92a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 0x7f6f94195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.245+0000 7f6f92a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 0x7f6f94195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:45998/0 (socket says 172.21.15.23:45998) 2024-02-28T16:24:19.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.245+0000 7f6f92a00700 1 -- 172.21.15.23:0/1817186136 learned_addr learned my addr 172.21.15.23:0/1817186136 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:19.235 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.246+0000 7f6f92a00700 1 -- 172.21.15.23:0/1817186136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f94101440 msgr2=0x7f6f94196090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:24:19.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.246+0000 7f6f92a00700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f94101440 0x7f6f94196090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.246+0000 7f6f92a00700 1 -- 172.21.15.23:0/1817186136 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800095f0 con 0x7f6f94100240 2024-02-28T16:24:19.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.246+0000 7f6f92a00700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 0x7f6f94195b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400b480 tx=0x7f6f8400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.247+0000 7f6f8b400700 1 -- 172.21.15.23:0/1817186136 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f840118c0 con 0x7f6f94100240 2024-02-28T16:24:19.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.247+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9419b2a0 con 0x7f6f94100240 2024-02-28T16:24:19.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.247+0000 7f6f8b400700 1 -- 172.21.15.23:0/1817186136 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f8401a400 con 0x7f6f94100240 2024-02-28T16:24:19.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.247+0000 7f6f8b400700 1 -- 172.21.15.23:0/1817186136 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f840195a0 con 0x7f6f94100240 2024-02-28T16:24:19.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.248+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9419b7f0 con 0x7f6f94100240 2024-02-28T16:24:19.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.249+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f94108e30 con 0x7f6f94100240 2024-02-28T16:24:19.239 INFO:tasks.workunit.client.0.smithi023.stdout:0/740: creat d6/f102 x:0 0 0 2024-02-28T16:24:19.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.250+0000 7f6f8b400700 1 -- 172.21.15.23:0/1817186136 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 26) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f6f8401aa50 con 0x7f6f94100240 2024-02-28T16:24:19.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.251+0000 7f6f8b400700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f6f7806d650 0x7f6f7806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.251+0000 7f6f8b400700 1 -- 172.21.15.23:0/1817186136 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6f8408ccb0 con 0x7f6f94100240 2024-02-28T16:24:19.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.252+0000 7f6f92000700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f6f7806d650 0x7f6f7806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.253+0000 7f6f92000700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f6f7806d650 0x7f6f7806fb00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6f80005090 tx=0x7f6f80005fb0 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.246 INFO:tasks.workunit.client.0.smithi023.stdout:8/818: mkdir d0/d5/d1a/d10d 0 2024-02-28T16:24:19.249 INFO:tasks.workunit.client.0.smithi023.stdout:7/713: unlink de/d1c/d76/d7b/dad/cb0 0 2024-02-28T16:24:19.251 INFO:tasks.workunit.client.0.smithi023.stdout:4/704: link d13/d1d/d2d/lb8 d13/d1d/d2e/le1 0 2024-02-28T16:24:19.254 INFO:tasks.workunit.client.0.smithi023.stdout:1/767: creat df/d11/d13/d99/dde/de6/f100 x:0 0 0 2024-02-28T16:24:19.254 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.265+0000 7f6f8b400700 1 -- 172.21.15.23:0/1817186136 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f6f8405a560 con 0x7f6f94100240 2024-02-28T16:24:19.255 INFO:tasks.workunit.client.0.smithi023.stdout:4/705: write d13/d2b/d2c/d31/d6e/f76 [705046,38338] 0 2024-02-28T16:24:19.256 INFO:tasks.workunit.client.0.smithi023.stdout:4/706: stat d13/d1d/f20 0 2024-02-28T16:24:19.258 INFO:tasks.workunit.client.0.smithi023.stdout:5/991: rmdir d1/d2a/d32/d37 39 2024-02-28T16:24:19.261 INFO:tasks.workunit.client.0.smithi023.stdout:6/862: fdatasync d1/d28/d1e/d2b/d44/d86/fef 0 2024-02-28T16:24:19.277 INFO:tasks.workunit.client.0.smithi023.stdout:9/723: write d0/d7/db/f9a [1766007,62572] 0 2024-02-28T16:24:19.278 INFO:tasks.workunit.client.0.smithi023.stdout:1/768: creat df/d11/d13/d1b/d30/d57/d5a/da6/f101 x:0 0 0 2024-02-28T16:24:19.287 INFO:tasks.workunit.client.0.smithi023.stdout:9/724: dread - d0/d7/de/d2a/daf/d2f/fd4 zero size 2024-02-28T16:24:19.291 INFO:tasks.workunit.client.0.smithi023.stdout:5/992: chown d1/d2a/d32/d37/d3a/d7f/d62/f9a 6574923 1 2024-02-28T16:24:19.293 INFO:tasks.workunit.client.0.smithi023.stdout:8/819: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fc5 [0,4194304] 0 2024-02-28T16:24:19.310 INFO:tasks.workunit.client.0.smithi023.stdout:7/714: mknod de/d8b/d95/ce8 0 2024-02-28T16:24:19.316 INFO:tasks.workunit.client.0.smithi023.stdout:5/993: dwrite d1/d2a/d32/f13b [0,4194304] 0 2024-02-28T16:24:19.323 INFO:tasks.workunit.client.0.smithi023.stdout:4/707: creat d13/d2b/d2c/d31/d8d/db3/d90/fe2 x:0 0 0 2024-02-28T16:24:19.329 INFO:tasks.workunit.client.0.smithi023.stdout:3/788: dwrite d1/df/d3d/f4f [8388608,4194304] 0 2024-02-28T16:24:19.334 INFO:tasks.workunit.client.0.smithi023.stdout:8/820: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/f10e x:0 0 0 2024-02-28T16:24:19.346 INFO:tasks.workunit.client.0.smithi023.stdout:8/821: dread - d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/f10e zero size 2024-02-28T16:24:19.346 INFO:tasks.workunit.client.0.smithi023.stdout:0/741: dwrite f4 [0,4194304] 0 2024-02-28T16:24:19.349 INFO:tasks.workunit.client.0.smithi023.stdout:1/769: dwrite df/d11/d13/d1b/d2e/fc9 [0,4194304] 0 2024-02-28T16:24:19.349 INFO:tasks.workunit.client.0.smithi023.stdout:3/789: dread d1/df/d33/d38/d6c/df5/df7/ff2 [0,4194304] 0 2024-02-28T16:24:19.349 INFO:tasks.workunit.client.0.smithi023.stdout:5/994: rename d1/d2a/d32/d37/fc8 to d1/d2a/d32/d37/d4e/db5/f141 0 2024-02-28T16:24:19.352 INFO:tasks.workunit.client.0.smithi023.stdout:2/834: sync 2024-02-28T16:24:19.353 INFO:tasks.workunit.client.0.smithi023.stdout:5/995: chown d1/d2a/d32/d58/d73/f119 4709 1 2024-02-28T16:24:19.354 INFO:tasks.workunit.client.0.smithi023.stdout:9/725: unlink d0/d7/de/d2a/daf/c3a 0 2024-02-28T16:24:19.358 INFO:tasks.workunit.client.0.smithi023.stdout:4/708: mkdir d13/d1d/d85/de3 0 2024-02-28T16:24:19.361 INFO:tasks.workunit.client.0.smithi023.stdout:4/709: write d13/d2b/f51 [2161729,131042] 0 2024-02-28T16:24:19.368 INFO:tasks.workunit.client.0.smithi023.stdout:8/822: truncate d0/d5/f41 1578854 0 2024-02-28T16:24:19.370 INFO:tasks.workunit.client.0.smithi023.stdout:8/823: chown d0/d5/d1b/d7f/lb8 0 1 2024-02-28T16:24:19.374 INFO:tasks.workunit.client.0.smithi023.stdout:0/742: dread - d6/db/d1a/d26/d31/d33/d37/d8f/faa zero size 2024-02-28T16:24:19.379 INFO:tasks.workunit.client.0.smithi023.stdout:0/743: chown d6/db/d1a/d26/d31/d33/dbe/lda 564 1 2024-02-28T16:24:19.381 INFO:tasks.workunit.client.0.smithi023.stdout:6/863: getdents d1/d4f 0 2024-02-28T16:24:19.384 INFO:tasks.workunit.client.0.smithi023.stdout:6/864: stat d1/d28/d1e/d2b/d44/da4/d106 0 2024-02-28T16:24:19.387 INFO:tasks.workunit.client.0.smithi023.stdout:1/770: write f2 [3652137,4136] 0 2024-02-28T16:24:19.389 INFO:tasks.workunit.client.0.smithi023.stdout:4/710: mkdir d13/d2b/d2c/d31/d6e/de4 0 2024-02-28T16:24:19.395 INFO:tasks.workunit.client.0.smithi023.stdout:8/824: unlink d0/d5/d1a/d2d/f61 0 2024-02-28T16:24:19.401 INFO:tasks.workunit.client.0.smithi023.stdout:3/790: creat d1/df/d2d/f115 x:0 0 0 2024-02-28T16:24:19.405 INFO:tasks.workunit.client.0.smithi023.stdout:0/744: mknod d6/d4c/d6a/c103 0 2024-02-28T16:24:19.408 INFO:tasks.workunit.client.0.smithi023.stdout:8/825: read d0/d5/d1a/fbe [886769,239] 0 2024-02-28T16:24:19.411 INFO:tasks.workunit.client.0.smithi023.stdout:7/715: dwrite de/d13/d1b/d6c/f97 [0,4194304] 0 2024-02-28T16:24:19.418 INFO:tasks.workunit.client.0.smithi023.stdout:4/711: mkdir d13/d2b/d2c/d31/d8d/db3/de5 0 2024-02-28T16:24:19.426 INFO:tasks.workunit.client.0.smithi023.stdout:5/996: link d1/d2a/d32/ddc/de3/lff d1/d2a/d32/d37/d4e/db5/dc6/l142 0 2024-02-28T16:24:19.426 INFO:tasks.workunit.client.0.smithi023.stdout:9/726: dread d0/f43 [0,4194304] 0 2024-02-28T16:24:19.426 INFO:tasks.workunit.client.0.smithi023.stdout:4/712: read d13/d1d/d2d/f36 [199279,130901] 0 2024-02-28T16:24:19.427 INFO:tasks.workunit.client.0.smithi023.stdout:3/791: unlink d1/df/d2d/d45/d52/d65/ce0 0 2024-02-28T16:24:19.428 INFO:tasks.workunit.client.0.smithi023.stdout:5/997: chown d1/d2a/d32/d37/d4e/d10d/d140 316500 1 2024-02-28T16:24:19.434 INFO:tasks.workunit.client.0.smithi023.stdout:1/771: rename df/d11/d13/d1b/d30/d57/d5a/da6/cd5 to df/dbd/c102 0 2024-02-28T16:24:19.439 INFO:tasks.workunit.client.0.smithi023.stdout:6/865: truncate d1/d28/f5f 666823 0 2024-02-28T16:24:19.446 INFO:tasks.workunit.client.0.smithi023.stdout:7/716: dwrite de/f82 [0,4194304] 0 2024-02-28T16:24:19.446 INFO:tasks.workunit.client.0.smithi023.stdout:0/745: unlink d6/db/d1a/d59/fc6 0 2024-02-28T16:24:19.455 INFO:tasks.workunit.client.0.smithi023.stdout:7/717: dread - de/d1c/d76/fcc zero size 2024-02-28T16:24:19.456 INFO:tasks.workunit.client.0.smithi023.stdout:7/718: chown de/d72/f85 159516329 1 2024-02-28T16:24:19.461 INFO:tasks.workunit.client.0.smithi023.stdout:7/719: write de/d13/d1b/d6c/fd9 [657195,80310] 0 2024-02-28T16:24:19.480 INFO:tasks.workunit.client.0.smithi023.stdout:8/826: creat d0/d5/d1a/d63/d90/dda/f10f x:0 0 0 2024-02-28T16:24:19.481 INFO:tasks.workunit.client.0.smithi023.stdout:2/835: truncate d5/da/db/f51 161336 0 2024-02-28T16:24:19.484 INFO:tasks.workunit.client.0.smithi023.stdout:4/713: mkdir d13/d2b/d2c/d31/de6 0 2024-02-28T16:24:19.489 INFO:tasks.workunit.client.0.smithi023.stdout:9/727: getdents d0/d7/db/dec/df6 0 2024-02-28T16:24:19.491 INFO:tasks.workunit.client.0.smithi023.stdout:9/728: stat d0/d7/db/d18/d23/fa8 0 2024-02-28T16:24:19.494 INFO:tasks.workunit.client.0.smithi023.stdout:7/720: unlink de/d1c/f79 0 2024-02-28T16:24:19.497 INFO:tasks.workunit.client.0.smithi023.stdout:6/866: symlink d1/d18/dd8/df2/l134 0 2024-02-28T16:24:19.501 INFO:tasks.workunit.client.0.smithi023.stdout:6/867: fdatasync d1/d18/f11b 0 2024-02-28T16:24:19.501 INFO:tasks.workunit.client.0.smithi023.stdout:8/827: mkdir d0/d5/d1a/d63/d90/d110 0 2024-02-28T16:24:19.503 INFO:tasks.workunit.client.0.smithi023.stdout:0/746: mknod d6/d4c/c104 0 2024-02-28T16:24:19.507 INFO:tasks.workunit.client.0.smithi023.stdout:0/747: chown d6/db/d1a/d26/d9c/fe0 78588 1 2024-02-28T16:24:19.509 INFO:tasks.workunit.client.0.smithi023.stdout:4/714: dwrite d13/d2b/d2c/d31/d6e/f7b [0,4194304] 0 2024-02-28T16:24:19.511 INFO:tasks.workunit.client.0.smithi023.stdout:5/998: creat d1/d2a/d32/d58/f143 x:0 0 0 2024-02-28T16:24:19.519 INFO:tasks.workunit.client.0.smithi023.stdout:9/729: rename d0/d7/db/d18/d23/d28/l33 to d0/d7/db/d18/d23/d28/d9c/dc4/lfc 0 2024-02-28T16:24:19.523 INFO:tasks.workunit.client.0.smithi023.stdout:9/730: write d0/d7/db/d18/fe3 [357842,15088] 0 2024-02-28T16:24:19.526 INFO:tasks.workunit.client.0.smithi023.stdout:3/792: write d1/d74/d94/de4/d109/f8d [671564,44846] 0 2024-02-28T16:24:19.530 INFO:tasks.workunit.client.0.smithi023.stdout:9/731: write d0/d7/db/d18/d23/d28/d32/f3f [2548450,46031] 0 2024-02-28T16:24:19.538 INFO:tasks.workunit.client.0.smithi023.stdout:2/836: creat d5/da/db/db9/f109 x:0 0 0 2024-02-28T16:24:19.538 INFO:tasks.workunit.client.0.smithi023.stdout:0/748: dwrite f4 [0,4194304] 0 2024-02-28T16:24:19.543 INFO:tasks.workunit.client.0.smithi023.stdout:8/828: rename d0/d5/d1a/d2d/c99 to d0/d5/d35/dbf/d100/d103/c111 0 2024-02-28T16:24:19.545 INFO:tasks.workunit.client.0.smithi023.stdout:7/721: link de/d13/d1b/d6c/fd9 de/d13/d1b/d3f/fe9 0 2024-02-28T16:24:19.547 INFO:tasks.workunit.client.0.smithi023.stdout:9/732: chown d0/d7/de/d2a/daf/d2f/d44/d95/ca7 79917440 1 2024-02-28T16:24:19.548 INFO:tasks.workunit.client.0.smithi023.stdout:2/837: dread - d5/da/d45/fdf zero size 2024-02-28T16:24:19.550 INFO:tasks.workunit.client.0.smithi023.stdout:5/999: rename d1/d2a/d32 to d1/d2a/d32/d58/d79/de5/dfc/d123/d144 22 2024-02-28T16:24:19.553 INFO:tasks.workunit.client.0.smithi023.stdout:1/772: dwrite df/f16 [0,4194304] 0 2024-02-28T16:24:19.554 INFO:tasks.workunit.client.0.smithi023.stdout:6/868: dread d1/d18/dd8/de8/ded/d11d/fd9 [0,4194304] 0 2024-02-28T16:24:19.556 INFO:tasks.workunit.client.0.smithi023.stdout:2/838: chown d5/da/d1b/d3f/d75/f77 799914 1 2024-02-28T16:24:19.558 INFO:tasks.workunit.client.0.smithi023.stdout:2/839: stat d5/da/ffa 0 2024-02-28T16:24:19.562 INFO:tasks.workunit.client.0.smithi023.stdout:4/715: dread d13/f3c [0,4194304] 0 2024-02-28T16:24:19.562 INFO:tasks.workunit.client.0.smithi023.stdout:8/829: symlink d0/d5/d35/l112 0 2024-02-28T16:24:19.570 INFO:tasks.workunit.client.0.smithi023.stdout:4/716: chown d13/d1d/d58/f84 0 1 2024-02-28T16:24:19.575 INFO:tasks.workunit.client.0.smithi023.stdout:3/793: rename d1/df/d33/d38/d6c/df5 to d1/d4a/d92/dff/d116 0 2024-02-28T16:24:19.575 INFO:tasks.workunit.client.0.smithi023.stdout:1/773: write df/d11/d13/d27/f53 [2533088,91148] 0 2024-02-28T16:24:19.606 INFO:tasks.workunit.client.0.smithi023.stdout:6/869: rename d1/d18/fca to d1/d28/d1e/d80/d109/d12e/f135 0 2024-02-28T16:24:19.613 INFO:tasks.workunit.client.0.smithi023.stdout:6/870: write d1/d28/d1e/d2b/d44/d86/d12c/f4a [1633658,74610] 0 2024-02-28T16:24:19.620 INFO:tasks.workunit.client.0.smithi023.stdout:0/749: dwrite d6/db/d1a/d26/d31/d33/d6e/db1/fed [0,4194304] 0 2024-02-28T16:24:19.634 INFO:tasks.workunit.client.0.smithi023.stdout:1/774: creat df/d11/d13/d1b/d30/d57/d78/f103 x:0 0 0 2024-02-28T16:24:19.637 INFO:tasks.workunit.client.0.smithi023.stdout:2/840: dread d5/f76 [0,4194304] 0 2024-02-28T16:24:19.655 INFO:tasks.workunit.client.0.smithi023.stdout:6/871: creat d1/d18/d26/d6a/f136 x:0 0 0 2024-02-28T16:24:19.655 INFO:tasks.workunit.client.0.smithi023.stdout:1/775: dread df/d26/f5b [0,4194304] 0 2024-02-28T16:24:19.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.665+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 --> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f94105d90 con 0x7f6f7806d650 2024-02-28T16:24:19.656 INFO:tasks.workunit.client.0.smithi023.stdout:0/750: rmdir d6/db/d1a/d35/d9d 39 2024-02-28T16:24:19.660 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:19 smithi023 ceph-mon[29137]: pgmap v41: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 49 MiB/s rd, 131 MiB/s wr, 366 op/s 2024-02-28T16:24:19.660 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:19 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2273595325' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:24:19.663 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:24:19.663 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "2/23 daemons upgraded", 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:24:19.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.670+0000 7f6f8b400700 1 -- 172.21.15.23:0/1817186136 <== mgr.24365 v2:172.21.15.153:6828/1832791633 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6f94105d90 con 0x7f6f7806d650 2024-02-28T16:24:19.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f6f7806d650 msgr2=0x7f6f7806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f6f7806d650 0x7f6f7806fb00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6f80005090 tx=0x7f6f80005fb0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 msgr2=0x7f6f94195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 0x7f6f94195b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400b480 tx=0x7f6f8400b840 comp rx=0 tx=0).stop 2024-02-28T16:24:19.665 INFO:tasks.workunit.client.0.smithi023.stdout:2/841: read d5/da/d104/d9e/fac [572488,31839] 0 2024-02-28T16:24:19.665 INFO:tasks.workunit.client.0.smithi023.stdout:9/733: getdents d0/d7/de/d34/dcc 0 2024-02-28T16:24:19.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 shutdown_connections 2024-02-28T16:24:19.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f94100240 0x7f6f94195b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f6f7806d650 0x7f6f7806fb00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 --2- 172.21.15.23:0/1817186136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f94101440 0x7f6f94196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.674+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 >> 172.21.15.23:0/1817186136 conn(0x7f6f940fb7f0 msgr2=0x7f6f94104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.675+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 shutdown_connections 2024-02-28T16:24:19.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.675+0000 7f6f99800700 1 -- 172.21.15.23:0/1817186136 wait complete. 2024-02-28T16:24:19.666 INFO:tasks.workunit.client.0.smithi023.stdout:1/776: fsync df/d11/d13/f14 0 2024-02-28T16:24:19.670 INFO:tasks.workunit.client.0.smithi023.stdout:1/777: truncate df/d11/d13/d1b/d30/dae/fe5 941408 0 2024-02-28T16:24:19.677 INFO:tasks.workunit.client.0.smithi023.stdout:7/722: write de/fa6 [1078197,108622] 0 2024-02-28T16:24:19.688 INFO:tasks.workunit.client.0.smithi023.stdout:8/830: dwrite d0/d5/d1b/d36/f80 [0,4194304] 0 2024-02-28T16:24:19.694 INFO:tasks.workunit.client.0.smithi023.stdout:3/794: truncate d1/f41 270197 0 2024-02-28T16:24:19.704 INFO:tasks.workunit.client.0.smithi023.stdout:8/831: dwrite d0/d5/d1a/f4b [0,4194304] 0 2024-02-28T16:24:19.729 INFO:tasks.workunit.client.0.smithi023.stdout:7/723: mkdir de/d1c/d76/d7b/dad/dea 0 2024-02-28T16:24:19.730 INFO:tasks.workunit.client.0.smithi023.stdout:7/724: stat de/d60/c5b 0 2024-02-28T16:24:19.739 INFO:tasks.workunit.client.0.smithi023.stdout:2/842: link d5/da/d1b/fc8 d5/da/d1b/d3f/d75/d92/f10a 0 2024-02-28T16:24:19.741 INFO:tasks.workunit.client.0.smithi023.stdout:1/778: mknod df/d11/d13/d1b/d30/d57/d5a/d68/c104 0 2024-02-28T16:24:19.743 INFO:tasks.workunit.client.0.smithi023.stdout:7/725: dread - de/d1c/f9c zero size 2024-02-28T16:24:19.747 INFO:tasks.workunit.client.0.smithi023.stdout:0/751: rename d6/db/dab/d82/d72/d79 to d6/db/dab/d105 0 2024-02-28T16:24:19.747 INFO:tasks.workunit.client.0.smithi023.stdout:6/872: getdents d1/d28/d11f 0 2024-02-28T16:24:19.754 INFO:tasks.workunit.client.0.smithi023.stdout:7/726: creat de/d9b/feb x:0 0 0 2024-02-28T16:24:19.756 INFO:tasks.workunit.client.0.smithi023.stdout:9/734: getdents d0/d7/de/d2a/daf/d2f/d44/d95 0 2024-02-28T16:24:19.760 INFO:tasks.workunit.client.0.smithi023.stdout:2/843: dwrite d5/fae [0,4194304] 0 2024-02-28T16:24:19.760 INFO:tasks.workunit.client.0.smithi023.stdout:9/735: readlink d0/d7/de/d2a/daf/d2f/la6 0 2024-02-28T16:24:19.761 INFO:tasks.workunit.client.0.smithi023.stdout:8/832: getdents d0/d5/d1a/d2d/d67/d71/db4 0 2024-02-28T16:24:19.763 INFO:tasks.workunit.client.0.smithi023.stdout:8/833: chown d0/d5/d1a/d44/l8c 1684 1 2024-02-28T16:24:19.764 INFO:tasks.workunit.client.0.smithi023.stdout:7/727: symlink de/d1c/d76/d7b/lec 0 2024-02-28T16:24:19.769 INFO:tasks.workunit.client.0.smithi023.stdout:7/728: creat de/d8b/fed x:0 0 0 2024-02-28T16:24:19.769 INFO:tasks.workunit.client.0.smithi023.stdout:8/834: fsync d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/fea 0 2024-02-28T16:24:19.773 INFO:tasks.workunit.client.0.smithi023.stdout:8/835: chown d0/d5/d1a/d2d/d67/ce6 0 1 2024-02-28T16:24:19.774 INFO:tasks.workunit.client.0.smithi023.stdout:7/729: mknod de/d72/d99/cee 0 2024-02-28T16:24:19.779 INFO:tasks.workunit.client.0.smithi023.stdout:8/836: dread - d0/d5/d1a/d2d/d67/d71/f10c zero size 2024-02-28T16:24:19.781 INFO:tasks.workunit.client.0.smithi023.stdout:7/730: fsync de/d1c/f20 0 2024-02-28T16:24:19.786 INFO:tasks.workunit.client.0.smithi023.stdout:7/731: dread - de/d72/f85 zero size 2024-02-28T16:24:19.791 INFO:tasks.workunit.client.0.smithi023.stdout:8/837: link d0/d5/d1a/d63/l82 d0/d5/d1a/d63/d90/d110/l113 0 2024-02-28T16:24:19.796 INFO:tasks.workunit.client.0.smithi023.stdout:8/838: chown d0/d5/d1a/d63/d90/dda/f10f 2 1 2024-02-28T16:24:19.800 INFO:tasks.workunit.client.0.smithi023.stdout:9/736: dread d0/d7/de/f63 [0,4194304] 0 2024-02-28T16:24:19.805 INFO:tasks.workunit.client.0.smithi023.stdout:8/839: getdents d0/d5/d1a/d63/d90/dda 0 2024-02-28T16:24:19.807 INFO:tasks.workunit.client.0.smithi023.stdout:7/732: dwrite de/d1c/d76/f86 [4194304,4194304] 0 2024-02-28T16:24:19.811 INFO:tasks.workunit.client.0.smithi023.stdout:9/737: mknod d0/d7/d2c/dbe/cfd 0 2024-02-28T16:24:19.815 INFO:tasks.workunit.client.0.smithi023.stdout:7/733: dread de/d1c/fd2 [0,4194304] 0 2024-02-28T16:24:19.822 INFO:tasks.workunit.client.0.smithi023.stdout:8/840: dread d0/d5/d1a/f4b [0,4194304] 0 2024-02-28T16:24:19.825 INFO:tasks.workunit.client.0.smithi023.stdout:7/734: mknod de/d1c/d76/d7b/cef 0 2024-02-28T16:24:19.827 INFO:tasks.workunit.client.0.smithi023.stdout:3/795: dwrite d1/d74/d94/de4/d109/f91 [0,4194304] 0 2024-02-28T16:24:19.828 INFO:tasks.workunit.client.0.smithi023.stdout:7/735: write de/fa6 [1492899,53297] 0 2024-02-28T16:24:19.830 INFO:tasks.workunit.client.0.smithi023.stdout:9/738: rename d0/d7/de/d2a/daf/d2f/l80 to d0/d7/lfe 0 2024-02-28T16:24:19.832 INFO:tasks.workunit.client.0.smithi023.stdout:0/752: truncate d6/db/d1a/d26/d31/d33/d6e/db1/fed 228159 0 2024-02-28T16:24:19.842 INFO:tasks.workunit.client.0.smithi023.stdout:8/841: rename d0/d5/f7e to d0/d5/ddc/de2/f114 0 2024-02-28T16:24:19.842 INFO:tasks.workunit.client.0.smithi023.stdout:9/739: mknod d0/d7/d2c/d7d/cff 0 2024-02-28T16:24:19.846 INFO:tasks.workunit.client.0.smithi023.stdout:7/736: creat de/d1c/ff0 x:0 0 0 2024-02-28T16:24:19.847 INFO:tasks.workunit.client.0.smithi023.stdout:8/842: creat d0/d5/d1a/d63/d90/dac/f115 x:0 0 0 2024-02-28T16:24:19.847 INFO:tasks.workunit.client.0.smithi023.stdout:0/753: mkdir d6/db/d3b/d106 0 2024-02-28T16:24:19.848 INFO:tasks.workunit.client.0.smithi023.stdout:7/737: truncate de/fd6 61312 0 2024-02-28T16:24:19.849 INFO:tasks.workunit.client.0.smithi023.stdout:9/740: symlink d0/d7/de/d2a/daf/d2f/d4d/l100 0 2024-02-28T16:24:19.850 INFO:tasks.workunit.client.0.smithi023.stdout:7/738: stat de/d13/d1b/d6c/fd7 0 2024-02-28T16:24:19.853 INFO:tasks.workunit.client.0.smithi023.stdout:8/843: mkdir d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d116 0 2024-02-28T16:24:19.855 INFO:tasks.workunit.client.0.smithi023.stdout:7/739: fsync de/d72/fc8 0 2024-02-28T16:24:19.860 INFO:tasks.workunit.client.0.smithi023.stdout:9/741: getdents d0/d7/de 0 2024-02-28T16:24:19.860 INFO:tasks.workunit.client.0.smithi023.stdout:0/754: dread d6/db/d3d/f64 [0,4194304] 0 2024-02-28T16:24:19.862 INFO:tasks.workunit.client.0.smithi023.stdout:7/740: truncate de/d13/d1b/d3d/d53/f7e 580524 0 2024-02-28T16:24:19.863 INFO:tasks.workunit.client.0.smithi023.stdout:3/796: write d1/df/d2d/d32/fad [446723,12734] 0 2024-02-28T16:24:19.867 INFO:tasks.workunit.client.0.smithi023.stdout:0/755: unlink d6/db/dab/d82/f57 0 2024-02-28T16:24:19.874 INFO:tasks.workunit.client.0.smithi023.stdout:3/797: creat d1/df/d2d/d111/f117 x:0 0 0 2024-02-28T16:24:19.874 INFO:tasks.workunit.client.0.smithi023.stdout:0/756: mkdir d6/db/d1a/d1b/d101/d107 0 2024-02-28T16:24:19.880 INFO:tasks.workunit.client.0.smithi023.stdout:3/798: unlink d1/df/d2d/d45/d6f/fcb 0 2024-02-28T16:24:19.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.895+0000 7f6425200700 1 -- 172.21.15.23:0/918262129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420069270 msgr2=0x7f6420102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.895+0000 7f6425200700 1 --2- 172.21.15.23:0/918262129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420069270 0x7f6420102dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6410009910 tx=0x7f6410009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:19.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.896+0000 7f6425200700 1 -- 172.21.15.23:0/918262129 shutdown_connections 2024-02-28T16:24:19.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.896+0000 7f6425200700 1 --2- 172.21.15.23:0/918262129 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6420103310 0x7f6420105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.896+0000 7f6425200700 1 --2- 172.21.15.23:0/918262129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420069270 0x7f6420102dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.896+0000 7f6425200700 1 -- 172.21.15.23:0/918262129 >> 172.21.15.23:0/918262129 conn(0x7f64200fa780 msgr2=0x7f64200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.886 INFO:tasks.workunit.client.0.smithi023.stdout:3/799: truncate d1/df/d3d/ffd 900242 0 2024-02-28T16:24:19.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.896+0000 7f6425200700 1 -- 172.21.15.23:0/918262129 shutdown_connections 2024-02-28T16:24:19.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.896+0000 7f6425200700 1 -- 172.21.15.23:0/918262129 wait complete. 2024-02-28T16:24:19.886 INFO:tasks.workunit.client.0.smithi023.stdout:0/757: rmdir d6/db/d1a/d26/d31/d33/d37/d8f 39 2024-02-28T16:24:19.886 INFO:tasks.workunit.client.0.smithi023.stdout:9/742: dwrite d0/d7/db/d18/f96 [0,4194304] 0 2024-02-28T16:24:19.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.898+0000 7f6425200700 1 Processor -- start 2024-02-28T16:24:19.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.898+0000 7f6425200700 1 -- start start 2024-02-28T16:24:19.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.899+0000 7f6425200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420103310 0x7f64201938b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.899+0000 7f6425200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6420193df0 0x7f6420198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.899+0000 7f6425200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201942f0 con 0x7f6420193df0 2024-02-28T16:24:19.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.899+0000 7f6425200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6420194460 con 0x7f6420103310 2024-02-28T16:24:19.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.899+0000 7f641d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6420193df0 0x7f6420198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.901+0000 7f641de00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420103310 0x7f64201938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.901+0000 7f641de00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420103310 0x7f64201938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:41226/0 (socket says 172.21.15.23:41226) 2024-02-28T16:24:19.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.901+0000 7f641de00700 1 -- 172.21.15.23:0/663379680 learned_addr learned my addr 172.21.15.23:0/663379680 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:19.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.902+0000 7f641d400700 1 -- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420103310 msgr2=0x7f64201938b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.902+0000 7f641d400700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420103310 0x7f64201938b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.903+0000 7f641d400700 1 -- 172.21.15.23:0/663379680 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100095f0 con 0x7f6420193df0 2024-02-28T16:24:19.893 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.904+0000 7f641d400700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6420193df0 0x7f6420198e60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f640c00e970 tx=0x7f640c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.905+0000 7f6416a00700 1 -- 172.21.15.23:0/663379680 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f640c00c9d0 con 0x7f6420193df0 2024-02-28T16:24:19.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.905+0000 7f6416a00700 1 -- 172.21.15.23:0/663379680 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f640c010430 con 0x7f6420193df0 2024-02-28T16:24:19.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.905+0000 7f6416a00700 1 -- 172.21.15.23:0/663379680 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f640c018650 con 0x7f6420193df0 2024-02-28T16:24:19.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.905+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6420199400 con 0x7f6420193df0 2024-02-28T16:24:19.895 INFO:tasks.workunit.client.0.smithi023.stdout:9/743: rmdir d0/d7/de/d2a/daf/d2f/d4d 39 2024-02-28T16:24:19.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:19 smithi153 ceph-mon[35341]: pgmap v41: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 49 MiB/s rd, 131 MiB/s wr, 366 op/s 2024-02-28T16:24:19.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:19 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2273595325' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:24:19.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.905+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6420199920 con 0x7f6420193df0 2024-02-28T16:24:19.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.907+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642019ad80 con 0x7f6420193df0 2024-02-28T16:24:19.898 INFO:tasks.workunit.client.0.smithi023.stdout:9/744: chown d0/d7/d2c/d7d 214234591 1 2024-02-28T16:24:19.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.910+0000 7f6416a00700 1 -- 172.21.15.23:0/663379680 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 26) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f640c0105a0 con 0x7f6420193df0 2024-02-28T16:24:19.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.911+0000 7f6416a00700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f640406d690 0x7f640406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.911+0000 7f6416a00700 1 -- 172.21.15.23:0/663379680 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f640c014070 con 0x7f6420193df0 2024-02-28T16:24:19.903 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.913+0000 7f641de00700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f640406d690 0x7f640406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.915+0000 7f641de00700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f640406d690 0x7f640406fb40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6410006010 tx=0x7f6410005a90 comp rx=0 tx=0).ready entity=mgr.24365 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.907 INFO:tasks.workunit.client.0.smithi023.stdout:7/741: dwrite de/d13/d1b/d6c/f89 [0,4194304] 0 2024-02-28T16:24:19.912 INFO:tasks.workunit.client.0.smithi023.stdout:0/758: rename d6/db/dab/f4b to d6/db/d1a/d26/d31/d33/d37/df6/f108 0 2024-02-28T16:24:19.912 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:19.921+0000 7f6416a00700 1 -- 172.21.15.23:0/663379680 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f640c052a50 con 0x7f6420193df0 2024-02-28T16:24:19.913 INFO:tasks.workunit.client.0.smithi023.stdout:3/800: write d1/df/d2d/f31 [946605,42621] 0 2024-02-28T16:24:19.915 INFO:tasks.workunit.client.0.smithi023.stdout:0/759: chown d6/db/d1a/d1b/f5a 71803 1 2024-02-28T16:24:19.920 INFO:tasks.workunit.client.0.smithi023.stdout:7/742: creat de/d1c/d76/ff1 x:0 0 0 2024-02-28T16:24:19.924 INFO:tasks.workunit.client.0.smithi023.stdout:3/801: dread - d1/df/d2d/d45/fa0 zero size 2024-02-28T16:24:19.924 INFO:tasks.workunit.client.0.smithi023.stdout:9/745: write d0/d7/db/d18/d23/f81 [3480812,94615] 0 2024-02-28T16:24:19.935 INFO:tasks.workunit.client.0.smithi023.stdout:3/802: symlink d1/d74/d94/de4/d110/l118 0 2024-02-28T16:24:19.941 INFO:tasks.workunit.client.0.smithi023.stdout:3/803: mkdir d1/df/d3d/d119 0 2024-02-28T16:24:19.948 INFO:tasks.workunit.client.0.smithi023.stdout:0/760: dwrite d6/d84/f8e [0,4194304] 0 2024-02-28T16:24:19.951 INFO:tasks.workunit.client.0.smithi023.stdout:7/743: dread de/d13/d1b/d6c/f71 [0,4194304] 0 2024-02-28T16:24:19.953 INFO:tasks.workunit.client.0.smithi023.stdout:0/761: write d6/db/d1a/f80 [4312847,111871] 0 2024-02-28T16:24:19.956 INFO:tasks.workunit.client.0.smithi023.stdout:7/744: fsync de/d13/d1b/d6c/f97 0 2024-02-28T16:24:19.959 INFO:tasks.workunit.client.0.smithi023.stdout:0/762: creat d6/db/d24/f109 x:0 0 0 2024-02-28T16:24:19.963 INFO:tasks.workunit.client.0.smithi023.stdout:3/804: dread d1/d74/d94/de4/d109/fa6 [0,4194304] 0 2024-02-28T16:24:19.969 INFO:tasks.workunit.client.0.smithi023.stdout:7/745: getdents de/d13 0 2024-02-28T16:24:19.970 INFO:tasks.workunit.client.0.smithi023.stdout:9/746: dread d0/d7/db/d18/d23/d28/f54 [0,4194304] 0 2024-02-28T16:24:19.975 INFO:tasks.workunit.client.0.smithi023.stdout:3/805: stat d1/df/d2d/d45/d52/ce7 0 2024-02-28T16:24:19.981 INFO:tasks.workunit.client.0.smithi023.stdout:3/806: write d1/d74/d94/de4/d109/df9/f10c [958190,38969] 0 2024-02-28T16:24:19.987 INFO:tasks.workunit.client.0.smithi023.stdout:3/807: rmdir d1/d4a/d92/dff 39 2024-02-28T16:24:19.988 INFO:tasks.workunit.client.0.smithi023.stdout:9/747: write d0/d7/db/d18/d23/d28/d32/d8b/f9f [2731524,26738] 0 2024-02-28T16:24:19.995 INFO:tasks.workunit.client.0.smithi023.stdout:3/808: getdents d1/d74 0 2024-02-28T16:24:19.996 INFO:tasks.workunit.client.0.smithi023.stdout:9/748: mknod d0/d7/de/d2a/c101 0 2024-02-28T16:24:19.997 INFO:tasks.workunit.client.0.smithi023.stdout:0/763: dwrite d6/db/d1a/f7f [0,4194304] 0 2024-02-28T16:24:20.001 INFO:tasks.workunit.client.0.smithi023.stdout:7/746: dwrite de/d60/f3c [0,4194304] 0 2024-02-28T16:24:20.003 INFO:tasks.workunit.client.0.smithi023.stdout:3/809: dread - d1/df/d2d/d45/d52/fb2 zero size 2024-02-28T16:24:20.006 INFO:tasks.workunit.client.0.smithi023.stdout:0/764: write d6/db/d1a/d26/f4d [3687443,42993] 0 2024-02-28T16:24:20.021 INFO:tasks.workunit.client.0.smithi023.stdout:7/747: creat de/d13/d1b/ff2 x:0 0 0 2024-02-28T16:24:20.024 INFO:tasks.workunit.client.0.smithi023.stdout:3/810: rename d1/d74/d94/de4/d109/df9/lfa to d1/df/d2d/l11a 0 2024-02-28T16:24:20.027 INFO:tasks.workunit.client.0.smithi023.stdout:3/811: chown d1/df/d2d/d45/d52/f5b 10276001 1 2024-02-28T16:24:20.030 INFO:tasks.workunit.client.0.smithi023.stdout:9/749: write d0/d7/de/d34/f9e [645322,9215] 0 2024-02-28T16:24:20.041 INFO:tasks.workunit.client.0.smithi023.stdout:7/748: rmdir de/d13/d1b/d3d/dd4 0 2024-02-28T16:24:20.042 INFO:tasks.workunit.client.0.smithi023.stdout:0/765: dwrite d6/db/d1a/f6b [0,4194304] 0 2024-02-28T16:24:20.043 INFO:tasks.workunit.client.0.smithi023.stdout:3/812: creat d1/d4a/d92/dff/d116/df7/d9f/f11b x:0 0 0 2024-02-28T16:24:20.045 INFO:tasks.workunit.client.0.smithi023.stdout:0/766: chown d6/db/d24/l4e 101146 1 2024-02-28T16:24:20.048 INFO:tasks.workunit.client.0.smithi023.stdout:0/767: write d6/db/d3b/f96 [3835622,55470] 0 2024-02-28T16:24:20.054 INFO:tasks.workunit.client.0.smithi023.stdout:7/749: creat de/d72/d99/ff3 x:0 0 0 2024-02-28T16:24:20.055 INFO:tasks.workunit.client.0.smithi023.stdout:3/813: creat d1/df/d2d/d45/d78/f11c x:0 0 0 2024-02-28T16:24:20.061 INFO:tasks.workunit.client.0.smithi023.stdout:0/768: mkdir d6/db/d1a/d26/d31/da8/d10a 0 2024-02-28T16:24:20.064 INFO:tasks.workunit.client.0.smithi023.stdout:3/814: fsync d1/d4a/f93 0 2024-02-28T16:24:20.066 INFO:tasks.workunit.client.0.smithi023.stdout:9/750: write d0/d7/de/d2a/daf/fa9 [936347,84677] 0 2024-02-28T16:24:20.086 INFO:tasks.workunit.client.0.smithi023.stdout:0/769: creat d6/db/dab/d82/d72/f10b x:0 0 0 2024-02-28T16:24:20.090 INFO:tasks.workunit.client.0.smithi023.stdout:0/770: chown d6/db/d1a/d26/d31/d33/dbe/le6 1745 1 2024-02-28T16:24:20.091 INFO:tasks.workunit.client.0.smithi023.stdout:7/750: dread de/d13/d1b/d3d/f7c [0,4194304] 0 2024-02-28T16:24:20.094 INFO:tasks.workunit.client.0.smithi023.stdout:0/771: write d6/db/d1a/d26/d9c/fe0 [4617045,78437] 0 2024-02-28T16:24:20.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/772: write d6/db/dab/d82/d72/f10b [122456,49999] 0 2024-02-28T16:24:20.103 INFO:tasks.workunit.client.0.smithi023.stdout:9/751: dread d0/d7/db/f75 [0,4194304] 0 2024-02-28T16:24:20.109 INFO:tasks.workunit.client.0.smithi023.stdout:3/815: dwrite d1/df/d2d/f8c [0,4194304] 0 2024-02-28T16:24:20.112 INFO:tasks.workunit.client.0.smithi023.stdout:4/717: sync 2024-02-28T16:24:20.112 INFO:tasks.workunit.client.0.smithi023.stdout:1/779: sync 2024-02-28T16:24:20.119 INFO:tasks.workunit.client.0.smithi023.stdout:4/718: dread - d13/d2b/d2c/d31/d8d/db3/d90/fe2 zero size 2024-02-28T16:24:20.125 INFO:tasks.workunit.client.0.smithi023.stdout:0/773: dwrite d6/db/d1a/f7f [0,4194304] 0 2024-02-28T16:24:20.126 INFO:tasks.workunit.client.0.smithi023.stdout:9/752: dread d0/d7/db/f9a [0,4194304] 0 2024-02-28T16:24:20.132 INFO:tasks.workunit.client.0.smithi023.stdout:4/719: chown d13/d2b/d2c/d31/dc4/d55/cad 124556266 1 2024-02-28T16:24:20.134 INFO:tasks.workunit.client.0.smithi023.stdout:4/720: readlink d13/l19 0 2024-02-28T16:24:20.137 INFO:tasks.workunit.client.0.smithi023.stdout:9/753: truncate d0/d7/d2c/d7d/fed 990008 0 2024-02-28T16:24:20.138 INFO:tasks.workunit.client.0.smithi023.stdout:4/721: fdatasync d13/d1d/fbd 0 2024-02-28T16:24:20.139 INFO:tasks.workunit.client.0.smithi023.stdout:7/751: truncate de/d13/d1b/d6c/db6/fc2 2057284 0 2024-02-28T16:24:20.143 INFO:tasks.workunit.client.0.smithi023.stdout:0/774: rmdir d6/db/d1a/d26/d31/d33/d37 39 2024-02-28T16:24:20.146 INFO:tasks.workunit.client.0.smithi023.stdout:3/816: dwrite d1/df/d33/d38/f48 [0,4194304] 0 2024-02-28T16:24:20.147 INFO:tasks.workunit.client.0.smithi023.stdout:3/817: fdatasync d1/d4a/d92/fe3 0 2024-02-28T16:24:20.149 INFO:tasks.workunit.client.0.smithi023.stdout:7/752: mkdir de/d13/d1b/d6c/db6/df4 0 2024-02-28T16:24:20.154 INFO:tasks.workunit.client.0.smithi023.stdout:9/754: rmdir d0/d7/db/d18/d23/d28/d32/d8b 39 2024-02-28T16:24:20.164 INFO:tasks.workunit.client.0.smithi023.stdout:9/755: symlink d0/d7/de/d2a/daf/d2f/d44/d95/l102 0 2024-02-28T16:24:20.173 INFO:tasks.workunit.client.0.smithi023.stdout:9/756: chown d0/d7/db/c29 1015 1 2024-02-28T16:24:20.180 INFO:tasks.workunit.client.0.smithi023.stdout:1/780: dread df/d11/d13/d1b/d30/d57/d5a/faa [0,4194304] 0 2024-02-28T16:24:20.182 INFO:tasks.workunit.client.0.smithi023.stdout:0/775: getdents d6/db/d1a/d26/d31/d33/d37/df6 0 2024-02-28T16:24:20.183 INFO:tasks.workunit.client.0.smithi023.stdout:7/753: write de/d72/f85 [387637,49266] 0 2024-02-28T16:24:20.185 INFO:tasks.workunit.client.0.smithi023.stdout:4/722: truncate d13/d2b/f5e 2544084 0 2024-02-28T16:24:20.188 INFO:tasks.workunit.client.0.smithi023.stdout:1/781: creat df/d11/d13/d1b/d2e/d5c/f105 x:0 0 0 2024-02-28T16:24:20.188 INFO:tasks.workunit.client.0.smithi023.stdout:9/757: dread d0/d7/de/d34/f3b [0,4194304] 0 2024-02-28T16:24:20.191 INFO:tasks.workunit.client.0.smithi023.stdout:0/776: stat d6/db/d1a/d35/d9d/f9e 0 2024-02-28T16:24:20.192 INFO:tasks.workunit.client.0.smithi023.stdout:7/754: rmdir de/d13/d1b/d3d/d53 39 2024-02-28T16:24:20.198 INFO:tasks.workunit.client.0.smithi023.stdout:9/758: mknod d0/d7/db/d18/d23/d28/c103 0 2024-02-28T16:24:20.199 INFO:tasks.workunit.client.0.smithi023.stdout:0/777: rmdir d6/db/d1a/d26/d31 39 2024-02-28T16:24:20.202 INFO:tasks.workunit.client.0.smithi023.stdout:3/818: dwrite d1/df/f3e [0,4194304] 0 2024-02-28T16:24:20.202 INFO:tasks.workunit.client.0.smithi023.stdout:7/755: mkdir de/d72/d99/df5 0 2024-02-28T16:24:20.221 INFO:tasks.workunit.client.0.smithi023.stdout:7/756: truncate de/d13/d1b/d6c/db6/fbb 525689 0 2024-02-28T16:24:20.227 INFO:tasks.workunit.client.0.smithi023.stdout:4/723: write d13/d2b/d2c/d31/d8d/f99 [1340153,108608] 0 2024-02-28T16:24:20.227 INFO:tasks.workunit.client.0.smithi023.stdout:1/782: dread df/d11/f54 [0,4194304] 0 2024-02-28T16:24:20.231 INFO:tasks.workunit.client.0.smithi023.stdout:3/819: symlink d1/df/d2d/d45/d52/l11d 0 2024-02-28T16:24:20.239 INFO:tasks.workunit.client.0.smithi023.stdout:0/778: dread d6/db/d1a/d26/f4d [0,4194304] 0 2024-02-28T16:24:20.244 INFO:tasks.workunit.client.0.smithi023.stdout:3/820: rename d1/df/l1f to d1/d4a/d92/dff/d116/df7/l11e 0 2024-02-28T16:24:20.247 INFO:tasks.workunit.client.0.smithi023.stdout:9/759: dread d0/d7/de/d2a/f38 [0,4194304] 0 2024-02-28T16:24:20.249 INFO:tasks.workunit.client.0.smithi023.stdout:0/779: creat d6/d84/f10c x:0 0 0 2024-02-28T16:24:20.250 INFO:tasks.workunit.client.0.smithi023.stdout:4/724: dwrite d13/d2b/d2c/d31/d8d/db3/fc3 [0,4194304] 0 2024-02-28T16:24:20.253 INFO:tasks.workunit.client.0.smithi023.stdout:3/821: creat d1/df/d2d/da8/f11f x:0 0 0 2024-02-28T16:24:20.259 INFO:tasks.workunit.client.0.smithi023.stdout:1/783: write df/d11/d13/d1b/f55 [4344789,24745] 0 2024-02-28T16:24:20.264 INFO:tasks.workunit.client.0.smithi023.stdout:0/780: symlink d6/db/d1a/d26/d31/d33/d6e/db1/l10d 0 2024-02-28T16:24:20.275 INFO:tasks.workunit.client.0.smithi023.stdout:4/725: dwrite d13/d2b/d2c/d31/dc4/d55/fb2 [0,4194304] 0 2024-02-28T16:24:20.279 INFO:tasks.workunit.client.0.smithi023.stdout:4/726: fdatasync d13/d1d/dd0/fc5 0 2024-02-28T16:24:20.286 INFO:tasks.workunit.client.0.smithi023.stdout:4/727: creat d13/d1d/d58/ddb/fe7 x:0 0 0 2024-02-28T16:24:20.294 INFO:tasks.workunit.client.0.smithi023.stdout:4/728: creat d13/d2b/d2c/d31/fe8 x:0 0 0 2024-02-28T16:24:20.298 INFO:tasks.workunit.client.0.smithi023.stdout:3/822: dread d1/df/d2d/d45/f86 [0,4194304] 0 2024-02-28T16:24:20.299 INFO:tasks.workunit.client.0.smithi023.stdout:0/781: dwrite d6/db/d1a/d26/f38 [0,4194304] 0 2024-02-28T16:24:20.299 INFO:tasks.workunit.client.0.smithi023.stdout:1/784: dwrite df/d11/d13/d1b/d30/d57/d8d/ff6 [0,4194304] 0 2024-02-28T16:24:20.308 INFO:tasks.workunit.client.0.smithi023.stdout:4/729: creat d13/d2b/d2c/d31/dc4/fe9 x:0 0 0 2024-02-28T16:24:20.311 INFO:tasks.workunit.client.0.smithi023.stdout:4/730: truncate d13/d1d/dd0/fc5 890021 0 2024-02-28T16:24:20.318 INFO:tasks.workunit.client.0.smithi023.stdout:3/823: rename d1/df to d1/d74/d94/de4/d110/d120 0 2024-02-28T16:24:20.321 INFO:tasks.workunit.client.0.smithi023.stdout:4/731: mknod d13/d1e/cea 0 2024-02-28T16:24:20.323 INFO:tasks.workunit.client.0.smithi023.stdout:1/785: rename df/d11/d13/d1b/lbb to df/d11/d13/d99/dfc/l106 0 2024-02-28T16:24:20.325 INFO:tasks.workunit.client.0.smithi023.stdout:0/782: link d6/d98/laf d6/db/d1a/d35/d86/l10e 0 2024-02-28T16:24:20.327 INFO:tasks.workunit.client.0.smithi023.stdout:4/732: truncate d13/d1d/d58/f84 240595 0 2024-02-28T16:24:20.330 INFO:tasks.workunit.client.0.smithi023.stdout:4/733: fdatasync d13/d2b/f4f 0 2024-02-28T16:24:20.331 INFO:tasks.workunit.client.0.smithi023.stdout:0/783: symlink d6/db/d1a/d59/l10f 0 2024-02-28T16:24:20.332 INFO:tasks.workunit.client.0.smithi023.stdout:4/734: chown d13/d1d/l28 23194959 1 2024-02-28T16:24:20.338 INFO:tasks.workunit.client.0.smithi023.stdout:4/735: rename d13/d1d/f41 to d13/d2b/d2c/d31/d8d/db3/de5/feb 0 2024-02-28T16:24:20.340 INFO:tasks.workunit.client.0.smithi023.stdout:4/736: chown d13/d2b/d2c/d31/l95 32368091 1 2024-02-28T16:24:20.342 INFO:tasks.workunit.client.0.smithi023.stdout:4/737: dread - d13/d2b/d2c/d31/d8d/fda zero size 2024-02-28T16:24:20.344 INFO:tasks.workunit.client.0.smithi023.stdout:4/738: chown d13/d1d/f6d 19213837 1 2024-02-28T16:24:20.357 INFO:tasks.workunit.client.0.smithi023.stdout:1/786: dread df/d11/d13/d1b/d2e/f6d [4194304,4194304] 0 2024-02-28T16:24:20.363 INFO:tasks.workunit.client.0.smithi023.stdout:3/824: dwrite d1/d74/d94/de4/d110/d120/d33/d38/d4c/f55 [0,4194304] 0 2024-02-28T16:24:20.363 INFO:tasks.workunit.client.0.smithi023.stdout:1/787: mknod df/d26/d48/d72/dff/c107 0 2024-02-28T16:24:20.372 INFO:tasks.workunit.client.0.smithi023.stdout:1/788: creat df/d11/d13/d1b/d30/dae/dea/f108 x:0 0 0 2024-02-28T16:24:20.372 INFO:tasks.workunit.client.0.smithi023.stdout:4/739: dread d13/d2b/d9d/fd1 [0,4194304] 0 2024-02-28T16:24:20.381 INFO:tasks.workunit.client.0.smithi023.stdout:1/789: rename df/dbd/d6c/dd3/cf0 to df/d11/d13/d1b/d30/d57/d5a/d68/d7a/c109 0 2024-02-28T16:24:20.383 INFO:tasks.workunit.client.0.smithi023.stdout:3/825: dwrite d1/d4a/d92/dff/d116/df7/d9f/f11b [0,4194304] 0 2024-02-28T16:24:20.387 INFO:tasks.workunit.client.0.smithi023.stdout:6/873: sync 2024-02-28T16:24:20.389 INFO:tasks.workunit.client.0.smithi023.stdout:1/790: creat df/d11/d13/d99/dfc/df9/f10a x:0 0 0 2024-02-28T16:24:20.390 INFO:tasks.workunit.client.0.smithi023.stdout:6/874: chown d1/d28/d1e/d2b/d44/da4/f10a 27115082 1 2024-02-28T16:24:20.392 INFO:tasks.workunit.client.0.smithi023.stdout:1/791: write df/f16 [2955287,98962] 0 2024-02-28T16:24:20.396 INFO:tasks.workunit.client.0.smithi023.stdout:1/792: stat df/d11/d13/d1b/d30/f4b 0 2024-02-28T16:24:20.400 INFO:tasks.workunit.client.0.smithi023.stdout:6/875: fdatasync d1/d18/dd8/de8/ded/f11a 0 2024-02-28T16:24:20.406 INFO:tasks.workunit.client.0.smithi023.stdout:6/876: mknod d1/d28/d1e/d80/c137 0 2024-02-28T16:24:20.410 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:24:20.410 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.419+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6420069270 con 0x7f6420193df0 2024-02-28T16:24:20.410 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.420+0000 7f6416a00700 1 -- 172.21.15.23:0/663379680 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f640c05a970 con 0x7f6420193df0 2024-02-28T16:24:20.410 INFO:tasks.workunit.client.0.smithi023.stdout:3/826: dwrite d1/d74/de1/ff1 [0,4194304] 0 2024-02-28T16:24:20.414 INFO:tasks.workunit.client.0.smithi023.stdout:4/740: dwrite d13/d1d/d58/f5c [0,4194304] 0 2024-02-28T16:24:20.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.424+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f640406d690 msgr2=0x7f640406fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.424+0000 7f6425200700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f640406d690 0x7f640406fb40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6410006010 tx=0x7f6410005a90 comp rx=0 tx=0).stop 2024-02-28T16:24:20.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.424+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6420193df0 msgr2=0x7f6420198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.424+0000 7f6425200700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6420193df0 0x7f6420198e60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f640c00e970 tx=0x7f640c00ec80 comp rx=0 tx=0).stop 2024-02-28T16:24:20.414 INFO:tasks.workunit.client.0.smithi023.stdout:6/877: mknod d1/d28/d1e/d2b/d44/d86/d12c/c138 0 2024-02-28T16:24:20.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.425+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 shutdown_connections 2024-02-28T16:24:20.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.425+0000 7f6425200700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6420103310 0x7f64201938b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.425+0000 7f6425200700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.153:6828/1832791633,v1:172.21.15.153:6829/1832791633] conn(0x7f640406d690 0x7f640406fb40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.425+0000 7f6425200700 1 --2- 172.21.15.23:0/663379680 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6420193df0 0x7f6420198e60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.425+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 >> 172.21.15.23:0/663379680 conn(0x7f64200fa780 msgr2=0x7f64200ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:20.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.427+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 shutdown_connections 2024-02-28T16:24:20.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:20.428+0000 7f6425200700 1 -- 172.21.15.23:0/663379680 wait complete. 2024-02-28T16:24:20.429 INFO:tasks.workunit.client.0.smithi023.stdout:4/741: link d13/d2b/c71 d13/d2b/d2c/d31/d8d/db3/d90/cec 0 2024-02-28T16:24:20.432 INFO:tasks.workunit.client.0.smithi023.stdout:6/878: dread d1/d3d/f112 [0,4194304] 0 2024-02-28T16:24:20.434 INFO:tasks.workunit.client.0.smithi023.stdout:4/742: creat d13/d2b/d2c/d31/d8d/db3/fed x:0 0 0 2024-02-28T16:24:20.435 INFO:tasks.workunit.client.0.smithi023.stdout:4/743: stat d13/d1d/dd0 0 2024-02-28T16:24:20.443 INFO:tasks.workunit.client.0.smithi023.stdout:4/744: symlink d13/d1d/d58/lee 0 2024-02-28T16:24:20.443 INFO:tasks.workunit.client.0.smithi023.stdout:4/745: stat fe 0 2024-02-28T16:24:20.448 INFO:tasks.workunit.client.0.smithi023.stdout:3/827: write d1/d74/d94/de4/d110/d120/f29 [4584560,115952] 0 2024-02-28T16:24:20.450 INFO:tasks.workunit.client.0.smithi023.stdout:3/828: readlink d1/d4a/l7b 0 2024-02-28T16:24:20.453 INFO:tasks.workunit.client.0.smithi023.stdout:1/793: dwrite df/d11/d13/d1b/d30/d57/d5a/d68/ddd/ff2 [0,4194304] 0 2024-02-28T16:24:20.457 INFO:tasks.workunit.client.0.smithi023.stdout:4/746: getdents d13/d1d/d58/ddb 0 2024-02-28T16:24:20.463 INFO:tasks.workunit.client.0.smithi023.stdout:3/829: write d1/f11 [5822104,112487] 0 2024-02-28T16:24:20.463 INFO:tasks.workunit.client.0.smithi023.stdout:4/747: creat d13/d1e/d9c/fef x:0 0 0 2024-02-28T16:24:20.464 INFO:tasks.workunit.client.0.smithi023.stdout:6/879: dwrite d1/d28/d1e/dae/fb4 [4194304,4194304] 0 2024-02-28T16:24:20.469 INFO:tasks.workunit.client.0.smithi023.stdout:3/830: dread - d1/d74/d94/de4/d109/fdf zero size 2024-02-28T16:24:20.475 INFO:tasks.workunit.client.0.smithi023.stdout:4/748: creat d13/d1d/d85/de3/ff0 x:0 0 0 2024-02-28T16:24:20.476 INFO:tasks.workunit.client.0.smithi023.stdout:3/831: mknod d1/d74/d46/de9/c121 0 2024-02-28T16:24:20.478 INFO:tasks.workunit.client.0.smithi023.stdout:6/880: getdents d1/d3d/df7/d10d 0 2024-02-28T16:24:20.481 INFO:tasks.workunit.client.0.smithi023.stdout:6/881: write d1/d28/d1e/d2b/fdf [1360319,55097] 0 2024-02-28T16:24:20.483 INFO:tasks.workunit.client.0.smithi023.stdout:4/749: getdents d13/d2b/d2c/d31/dc4/dc0 0 2024-02-28T16:24:20.489 INFO:tasks.workunit.client.0.smithi023.stdout:6/882: mknod d1/d28/d1e/d2b/d44/da4/c139 0 2024-02-28T16:24:20.491 INFO:tasks.workunit.client.0.smithi023.stdout:3/832: dread d1/d74/d94/de4/d110/d120/f3e [0,4194304] 0 2024-02-28T16:24:20.491 INFO:tasks.workunit.client.0.smithi023.stdout:6/883: readlink d1/d18/d26/d6a/l9c 0 2024-02-28T16:24:20.495 INFO:tasks.workunit.client.0.smithi023.stdout:3/833: write d1/d74/d94/de4/d110/d120/d3d/ffd [1592428,70605] 0 2024-02-28T16:24:20.502 INFO:tasks.workunit.client.0.smithi023.stdout:4/750: truncate d13/d2b/f5a 397486 0 2024-02-28T16:24:20.504 INFO:tasks.workunit.client.0.smithi023.stdout:4/751: chown d13/d2b/d2c/d31/d8d/db3/d90 87552 1 2024-02-28T16:24:20.508 INFO:tasks.workunit.client.0.smithi023.stdout:4/752: mkdir d13/d1e/df1 0 2024-02-28T16:24:20.509 INFO:tasks.workunit.client.0.smithi023.stdout:4/753: mknod d13/d1d/cf2 0 2024-02-28T16:24:20.510 INFO:tasks.workunit.client.0.smithi023.stdout:4/754: chown d13/d1e/df1 221986 1 2024-02-28T16:24:20.512 INFO:tasks.workunit.client.0.smithi023.stdout:4/755: write d13/fae [2894216,79135] 0 2024-02-28T16:24:20.518 INFO:tasks.workunit.client.0.smithi023.stdout:4/756: creat d13/d2b/d9d/ff3 x:0 0 0 2024-02-28T16:24:20.519 INFO:tasks.workunit.client.0.smithi023.stdout:4/757: readlink d13/d2b/d2c/d31/l3e 0 2024-02-28T16:24:20.521 INFO:tasks.workunit.client.0.smithi023.stdout:4/758: stat d13/d2b/d2c/d31/dc4/d67 0 2024-02-28T16:24:20.521 INFO:tasks.workunit.client.0.smithi023.stdout:6/884: dread d1/d28/d1e/d2b/d44/d86/f8f [0,4194304] 0 2024-02-28T16:24:20.522 INFO:tasks.workunit.client.0.smithi023.stdout:4/759: stat d13/d1d/d85/de3/ff0 0 2024-02-28T16:24:20.524 INFO:tasks.workunit.client.0.smithi023.stdout:2/844: sync 2024-02-28T16:24:20.525 INFO:tasks.workunit.client.0.smithi023.stdout:8/844: sync 2024-02-28T16:24:20.525 INFO:tasks.workunit.client.0.smithi023.stdout:6/885: write d1/d3d/fab [2701087,16422] 0 2024-02-28T16:24:20.526 INFO:tasks.workunit.client.0.smithi023.stdout:4/760: unlink cc 0 2024-02-28T16:24:20.529 INFO:tasks.workunit.client.0.smithi023.stdout:3/834: dread d1/d74/d94/de4/d110/d120/d33/d38/f6a [0,4194304] 0 2024-02-28T16:24:20.529 INFO:tasks.workunit.client.0.smithi023.stdout:6/886: fdatasync d1/d28/d1e/d2b/d44/d86/d12c/de0/f119 0 2024-02-28T16:24:20.530 INFO:tasks.workunit.client.0.smithi023.stdout:4/761: dread - d13/d2b/d2c/d31/d8d/fda zero size 2024-02-28T16:24:20.534 INFO:tasks.workunit.client.0.smithi023.stdout:4/762: mknod d13/d1e/d9c/cf4 0 2024-02-28T16:24:20.539 INFO:tasks.workunit.client.0.smithi023.stdout:4/763: chown d13/d2b/d2c/d31/c66 350368 1 2024-02-28T16:24:20.544 INFO:tasks.workunit.client.0.smithi023.stdout:6/887: rename d1/d18/dd8/de8/ded/d11d/da9/f123 to d1/d28/d1e/d2b/d44/d86/d12c/de0/f13a 0 2024-02-28T16:24:20.547 INFO:tasks.workunit.client.0.smithi023.stdout:8/845: dwrite d0/d5/d1b/f43 [4194304,4194304] 0 2024-02-28T16:24:20.551 INFO:tasks.workunit.client.0.smithi023.stdout:2/845: write d5/da/db/d17/d39/d56/f63 [433871,120732] 0 2024-02-28T16:24:20.553 INFO:tasks.workunit.client.0.smithi023.stdout:6/888: write d1/d28/d1e/d2b/d44/d86/d12c/f3f [2110131,95150] 0 2024-02-28T16:24:20.555 INFO:tasks.workunit.client.0.smithi023.stdout:4/764: symlink d13/d2b/d2c/lf5 0 2024-02-28T16:24:20.565 INFO:tasks.workunit.client.0.smithi023.stdout:8/846: fdatasync d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/fca 0 2024-02-28T16:24:20.568 INFO:tasks.workunit.client.0.smithi023.stdout:2/846: mkdir d5/da/db/d17/d3c/d7f/dc6/dd9/d10b 0 2024-02-28T16:24:20.568 INFO:tasks.workunit.client.0.smithi023.stdout:3/835: dwrite d1/d74/d94/de4/d110/d120/d2d/d45/d52/d65/d89/faa [0,4194304] 0 2024-02-28T16:24:20.573 INFO:tasks.workunit.client.0.smithi023.stdout:8/847: fsync d0/d5/d1a/d2d/d67/d71/f9c 0 2024-02-28T16:24:20.579 INFO:tasks.workunit.client.0.smithi023.stdout:4/765: link d13/d2b/d9d/ff3 d13/d2b/ff6 0 2024-02-28T16:24:20.581 INFO:tasks.workunit.client.0.smithi023.stdout:6/889: dread d1/d3d/f55 [0,4194304] 0 2024-02-28T16:24:20.587 INFO:tasks.workunit.client.0.smithi023.stdout:8/848: symlink d0/d5/d1a/d2d/l117 0 2024-02-28T16:24:20.595 INFO:tasks.workunit.client.0.smithi023.stdout:3/836: write d1/d74/d94/de4/d110/d120/d33/d38/d4c/f50 [743970,61169] 0 2024-02-28T16:24:20.595 INFO:tasks.workunit.client.0.smithi023.stdout:2/847: write d5/da/db/f71 [1112034,24274] 0 2024-02-28T16:24:20.597 INFO:tasks.workunit.client.0.smithi023.stdout:8/849: write d0/d5/d1a/d2d/d67/d71/fb7 [830319,47584] 0 2024-02-28T16:24:20.598 INFO:tasks.workunit.client.0.smithi023.stdout:8/850: stat d0/d5/d1b/de1/ce5 0 2024-02-28T16:24:20.600 INFO:tasks.workunit.client.0.smithi023.stdout:8/851: chown d0/d5/d104 428 1 2024-02-28T16:24:20.603 INFO:tasks.workunit.client.0.smithi023.stdout:2/848: symlink d5/da/db/d17/d3c/l10c 0 2024-02-28T16:24:20.605 INFO:tasks.workunit.client.0.smithi023.stdout:2/849: readlink d5/da/d1b/d3f/l4d 0 2024-02-28T16:24:20.605 INFO:tasks.workunit.client.0.smithi023.stdout:3/837: creat d1/d74/d94/de4/d110/d120/d33/d38/d4c/f122 x:0 0 0 2024-02-28T16:24:20.606 INFO:tasks.workunit.client.0.smithi023.stdout:8/852: truncate d0/d5/d1a/d44/fed 1706647 0 2024-02-28T16:24:20.607 INFO:tasks.workunit.client.0.smithi023.stdout:4/766: dread d13/d2b/f5d [0,4194304] 0 2024-02-28T16:24:20.608 INFO:tasks.workunit.client.0.smithi023.stdout:2/850: fdatasync d5/da/db/f49 0 2024-02-28T16:24:20.611 INFO:tasks.workunit.client.0.smithi023.stdout:3/838: write d1/d74/d94/de4/d110/d120/d2d/d45/d78/fed [57093,50574] 0 2024-02-28T16:24:20.611 INFO:tasks.workunit.client.0.smithi023.stdout:8/853: symlink d0/l118 0 2024-02-28T16:24:20.618 INFO:tasks.workunit.client.0.smithi023.stdout:2/851: chown d5/da/db/d17/d3c/f4c 50043 1 2024-02-28T16:24:20.618 INFO:tasks.workunit.client.0.smithi023.stdout:3/839: fsync d1/d74/d94/de4/d110/d120/d2d/d45/d52/d65/d89/f100 0 2024-02-28T16:24:20.627 INFO:tasks.workunit.client.0.smithi023.stdout:3/840: mkdir d1/d4a/d92/dff/d116/d114/d123 0 2024-02-28T16:24:20.629 INFO:tasks.workunit.client.0.smithi023.stdout:2/852: mknod d5/da/d104/dd0/c10d 0 2024-02-28T16:24:20.631 INFO:tasks.workunit.client.0.smithi023.stdout:4/767: dwrite d13/d2b/f5d [4194304,4194304] 0 2024-02-28T16:24:20.635 INFO:tasks.workunit.client.0.smithi023.stdout:2/853: readlink d5/le 0 2024-02-28T16:24:20.637 INFO:tasks.workunit.client.0.smithi023.stdout:4/768: fdatasync d13/d2b/d2c/d31/dc4/d55/f6c 0 2024-02-28T16:24:20.640 INFO:tasks.workunit.client.0.smithi023.stdout:4/769: fdatasync d13/d2b/d2c/d31/dc4/fd3 0 2024-02-28T16:24:20.645 INFO:tasks.workunit.client.0.smithi023.stdout:3/841: dread d1/d4a/d92/dff/d116/df7/d9f/f11b [0,4194304] 0 2024-02-28T16:24:20.657 INFO:tasks.workunit.client.0.smithi023.stdout:8/854: dread d0/d5/d1a/d63/fb5 [0,4194304] 0 2024-02-28T16:24:20.657 INFO:tasks.workunit.client.0.smithi023.stdout:4/770: dwrite d13/d1d/f33 [0,4194304] 0 2024-02-28T16:24:20.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:20 smithi023 ceph-mon[29137]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:20.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:20 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/663379680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:24:20.678 INFO:tasks.workunit.client.0.smithi023.stdout:3/842: dwrite d1/d4a/fd7 [0,4194304] 0 2024-02-28T16:24:20.681 INFO:tasks.workunit.client.0.smithi023.stdout:8/855: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/fa9 [0,4194304] 0 2024-02-28T16:24:20.685 INFO:tasks.workunit.client.0.smithi023.stdout:8/856: chown d0/d5/d1a/d2d/d67/d71/db4/l60 452380 1 2024-02-28T16:24:20.699 INFO:tasks.workunit.client.0.smithi023.stdout:4/771: dread d13/d2b/d2c/f57 [0,4194304] 0 2024-02-28T16:24:20.715 INFO:tasks.workunit.client.0.smithi023.stdout:3/843: creat d1/d4a/f124 x:0 0 0 2024-02-28T16:24:20.716 INFO:tasks.workunit.client.0.smithi023.stdout:9/760: sync 2024-02-28T16:24:20.716 INFO:tasks.workunit.client.0.smithi023.stdout:7/757: sync 2024-02-28T16:24:20.717 INFO:tasks.workunit.client.0.smithi023.stdout:4/772: stat d13/d2b/d2c/d31/dc4/ld5 0 2024-02-28T16:24:20.718 INFO:tasks.workunit.client.0.smithi023.stdout:9/761: readlink d0/d7/d2c/l7a 0 2024-02-28T16:24:20.721 INFO:tasks.workunit.client.0.smithi023.stdout:9/762: chown d0/d7/db/d18/d23/d28/d6e/f7f 6169297 1 2024-02-28T16:24:20.723 INFO:tasks.workunit.client.0.smithi023.stdout:8/857: dread d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fc5 [0,4194304] 0 2024-02-28T16:24:20.723 INFO:tasks.workunit.client.0.smithi023.stdout:3/844: creat d1/d74/d94/de4/d110/d120/d2d/d45/d78/f125 x:0 0 0 2024-02-28T16:24:20.728 INFO:tasks.workunit.client.0.smithi023.stdout:7/758: getdents de/d13/d1b/d40 0 2024-02-28T16:24:20.731 INFO:tasks.workunit.client.0.smithi023.stdout:3/845: creat d1/d74/d94/de4/d109/df9/f126 x:0 0 0 2024-02-28T16:24:20.732 INFO:tasks.workunit.client.0.smithi023.stdout:8/858: rename d0/d5/d1b/de1/ce5 to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/c119 0 2024-02-28T16:24:20.733 INFO:tasks.workunit.client.0.smithi023.stdout:9/763: getdents d0/d7/db/d18/d23/d28/d9c 0 2024-02-28T16:24:20.735 INFO:tasks.workunit.client.0.smithi023.stdout:9/764: dread - d0/d7/de/d2a/daf/d2f/d44/d95/ff7 zero size 2024-02-28T16:24:20.736 INFO:tasks.workunit.client.0.smithi023.stdout:7/759: symlink de/d8b/d95/d98/lf6 0 2024-02-28T16:24:20.756 INFO:tasks.workunit.client.0.smithi023.stdout:8/859: dread d0/d5/ddc/de2/f114 [0,4194304] 0 2024-02-28T16:24:20.757 INFO:tasks.workunit.client.0.smithi023.stdout:7/760: write f4 [5054547,82911] 0 2024-02-28T16:24:20.757 INFO:tasks.workunit.client.0.smithi023.stdout:8/860: stat d0/c4 0 2024-02-28T16:24:20.758 INFO:tasks.workunit.client.0.smithi023.stdout:7/761: stat de/d8b 0 2024-02-28T16:24:20.759 INFO:tasks.workunit.client.0.smithi023.stdout:7/762: fdatasync de/d60/f64 0 2024-02-28T16:24:20.759 INFO:tasks.workunit.client.0.smithi023.stdout:8/861: read - d0/d5/ddc/de2/ff3 zero size 2024-02-28T16:24:20.763 INFO:tasks.workunit.client.0.smithi023.stdout:7/763: creat de/d1c/ddb/ff7 x:0 0 0 2024-02-28T16:24:20.764 INFO:tasks.workunit.client.0.smithi023.stdout:8/862: unlink d0/d5/d1b/d36/l94 0 2024-02-28T16:24:20.765 INFO:tasks.workunit.client.0.smithi023.stdout:7/764: chown de/d8b/fed 248797678 1 2024-02-28T16:24:20.767 INFO:tasks.workunit.client.0.smithi023.stdout:3/846: dread d1/d74/d94/de4/d110/d120/d33/d38/d6c/fa9 [0,4194304] 0 2024-02-28T16:24:20.767 INFO:tasks.workunit.client.0.smithi023.stdout:7/765: creat de/d13/d1b/d40/ff8 x:0 0 0 2024-02-28T16:24:20.769 INFO:tasks.workunit.client.0.smithi023.stdout:7/766: stat de/d1c/ca5 0 2024-02-28T16:24:20.771 INFO:tasks.workunit.client.0.smithi023.stdout:8/863: getdents d0/d5/d1a/d2d/d67/d71/db4/d39 0 2024-02-28T16:24:20.771 INFO:tasks.workunit.client.0.smithi023.stdout:3/847: readlink d1/d74/d94/de4/d110/d120/d2d/l11a 0 2024-02-28T16:24:20.772 INFO:tasks.workunit.client.0.smithi023.stdout:8/864: write d0/d5/d1b/f70 [1226987,66841] 0 2024-02-28T16:24:20.775 INFO:tasks.workunit.client.0.smithi023.stdout:8/865: write d0/d5/d1a/d2d/d67/f10b [182002,6721] 0 2024-02-28T16:24:20.777 INFO:tasks.workunit.client.0.smithi023.stdout:3/848: fsync d1/d74/d94/de4/d110/d120/d2d/da8/fb6 0 2024-02-28T16:24:20.781 INFO:tasks.workunit.client.0.smithi023.stdout:3/849: fsync d1/d74/d94/de4/d109/f6b 0 2024-02-28T16:24:20.787 INFO:tasks.workunit.client.0.smithi023.stdout:7/767: dwrite de/d1c/f68 [0,4194304] 0 2024-02-28T16:24:20.790 INFO:tasks.workunit.client.0.smithi023.stdout:8/866: rename d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/f88 to d0/d5/d1b/f11a 0 2024-02-28T16:24:20.794 INFO:tasks.workunit.client.0.smithi023.stdout:3/850: getdents d1/d4a/d92/dff/d116/df7 0 2024-02-28T16:24:20.804 INFO:tasks.workunit.client.0.smithi023.stdout:3/851: link d1/d4a/d92/dff/d116/df7/cd9 d1/d74/d94/de4/d109/df9/c127 0 2024-02-28T16:24:20.805 INFO:tasks.workunit.client.0.smithi023.stdout:7/768: dwrite de/d60/f3c [0,4194304] 0 2024-02-28T16:24:20.807 INFO:tasks.workunit.client.0.smithi023.stdout:7/769: fsync de/fd6 0 2024-02-28T16:24:20.813 INFO:tasks.workunit.client.0.smithi023.stdout:3/852: creat d1/d74/d94/de4/d110/d120/d3d/d119/f128 x:0 0 0 2024-02-28T16:24:20.814 INFO:tasks.workunit.client.0.smithi023.stdout:8/867: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/ff4 [0,4194304] 0 2024-02-28T16:24:20.818 INFO:tasks.workunit.client.0.smithi023.stdout:7/770: rename de/d1c/c80 to de/d1c/d76/d7b/dad/dc9/cf9 0 2024-02-28T16:24:20.820 INFO:tasks.workunit.client.0.smithi023.stdout:3/853: creat d1/d4a/d92/dff/d116/d114/d123/f129 x:0 0 0 2024-02-28T16:24:20.823 INFO:tasks.workunit.client.0.smithi023.stdout:7/771: creat de/d13/d1b/d6c/db6/ffa x:0 0 0 2024-02-28T16:24:20.827 INFO:tasks.workunit.client.0.smithi023.stdout:3/854: creat d1/d4a/d92/dff/d116/df7/f12a x:0 0 0 2024-02-28T16:24:20.829 INFO:tasks.workunit.client.0.smithi023.stdout:7/772: unlink de/d60/c42 0 2024-02-28T16:24:20.888 INFO:tasks.workunit.client.0.smithi023.stdout:0/784: sync 2024-02-28T16:24:20.888 INFO:tasks.workunit.client.0.smithi023.stdout:1/794: sync 2024-02-28T16:24:20.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:20 smithi153 ceph-mon[35341]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:20.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:20 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/663379680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:24:20.898 INFO:tasks.workunit.client.0.smithi023.stdout:3/855: rmdir d1/d74/d94/de4/d110/d120/d2d 39 2024-02-28T16:24:20.901 INFO:tasks.workunit.client.0.smithi023.stdout:1/795: stat df/d11/d8a/cb0 0 2024-02-28T16:24:20.905 INFO:tasks.workunit.client.0.smithi023.stdout:1/796: rmdir df/d11/d13/d99/dfc/df9 39 2024-02-28T16:24:20.909 INFO:tasks.workunit.client.0.smithi023.stdout:3/856: rename d1/d74/de1/db5/db9/fec to d1/d74/d94/f12b 0 2024-02-28T16:24:20.911 INFO:tasks.workunit.client.0.smithi023.stdout:0/785: creat d6/db/d1a/d26/d31/d33/d37/f110 x:0 0 0 2024-02-28T16:24:20.913 INFO:tasks.workunit.client.0.smithi023.stdout:1/797: creat df/d11/d13/d1b/d30/d57/d5a/f10b x:0 0 0 2024-02-28T16:24:20.915 INFO:tasks.workunit.client.0.smithi023.stdout:3/857: symlink d1/d74/l12c 0 2024-02-28T16:24:20.916 INFO:tasks.workunit.client.0.smithi023.stdout:0/786: creat d6/db/d24/f111 x:0 0 0 2024-02-28T16:24:20.921 INFO:tasks.workunit.client.0.smithi023.stdout:1/798: symlink df/d26/d48/l10c 0 2024-02-28T16:24:20.922 INFO:tasks.workunit.client.0.smithi023.stdout:0/787: mkdir d6/db/d1a/d26/d31/d33/d6e/db1/d112 0 2024-02-28T16:24:20.926 INFO:tasks.workunit.client.0.smithi023.stdout:0/788: dread - d6/db/d1a/d35/d9d/dce/fd4 zero size 2024-02-28T16:24:20.927 INFO:tasks.workunit.client.0.smithi023.stdout:0/789: chown d6/db/d5d/df3 11 1 2024-02-28T16:24:20.927 INFO:tasks.workunit.client.0.smithi023.stdout:1/799: creat df/f10d x:0 0 0 2024-02-28T16:24:20.929 INFO:tasks.workunit.client.0.smithi023.stdout:0/790: chown d6/db/d1a/d26/fea 620 1 2024-02-28T16:24:20.931 INFO:tasks.workunit.client.0.smithi023.stdout:1/800: unlink df/d26/d48/f9d 0 2024-02-28T16:24:20.931 INFO:tasks.workunit.client.0.smithi023.stdout:7/773: write de/d13/d1b/d3d/d53/f90 [222013,102947] 0 2024-02-28T16:24:20.936 INFO:tasks.workunit.client.0.smithi023.stdout:0/791: unlink d6/db/d1a/d26/lb6 0 2024-02-28T16:24:20.937 INFO:tasks.workunit.client.0.smithi023.stdout:1/801: fsync df/d26/f35 0 2024-02-28T16:24:20.943 INFO:tasks.workunit.client.0.smithi023.stdout:0/792: mkdir d6/d84/d113 0 2024-02-28T16:24:20.946 INFO:tasks.workunit.client.0.smithi023.stdout:1/802: mknod df/d11/d8a/c10e 0 2024-02-28T16:24:20.952 INFO:tasks.workunit.client.0.smithi023.stdout:7/774: truncate de/d1c/f26 3166380 0 2024-02-28T16:24:20.956 INFO:tasks.workunit.client.0.smithi023.stdout:1/803: dread df/d11/d13/d1b/d30/f60 [0,4194304] 0 2024-02-28T16:24:20.959 INFO:tasks.workunit.client.0.smithi023.stdout:7/775: mkdir de/d8b/d95/d98/dfb 0 2024-02-28T16:24:20.961 INFO:tasks.workunit.client.0.smithi023.stdout:3/858: link d1/d74/d94/de4/d109/lf3 d1/d74/d94/de4/d110/d120/d33/dc2/d106/l12d 0 2024-02-28T16:24:20.962 INFO:tasks.workunit.client.0.smithi023.stdout:7/776: chown de/c16 12 1 2024-02-28T16:24:20.963 INFO:tasks.workunit.client.0.smithi023.stdout:0/793: dwrite d6/db/dab/d82/f44 [0,4194304] 0 2024-02-28T16:24:20.964 INFO:tasks.workunit.client.0.smithi023.stdout:1/804: truncate df/d11/d13/f15 3239456 0 2024-02-28T16:24:20.964 INFO:tasks.workunit.client.0.smithi023.stdout:3/859: fdatasync d1/fdc 0 2024-02-28T16:24:20.967 INFO:tasks.workunit.client.0.smithi023.stdout:1/805: stat df/d11/d13/d1b/d30/d57/d8d 0 2024-02-28T16:24:20.969 INFO:tasks.workunit.client.0.smithi023.stdout:3/860: rmdir d1/d4a/d92/dff/d116/d114 39 2024-02-28T16:24:20.971 INFO:tasks.workunit.client.0.smithi023.stdout:3/861: readlink d1/d74/d94/de4/d110/d120/l42 0 2024-02-28T16:24:20.973 INFO:tasks.workunit.client.0.smithi023.stdout:0/794: link d6/db/d1a/d35/fa7 d6/db/d1a/d59/f114 0 2024-02-28T16:24:20.981 INFO:tasks.workunit.client.0.smithi023.stdout:3/862: chown d1/d74/d94/de4/d110/d120/d2d/d45/d52 2944024 1 2024-02-28T16:24:20.983 INFO:tasks.workunit.client.0.smithi023.stdout:1/806: link df/d11/d13/d1b/d2e/d5c/cc5 df/d11/d13/d1b/d30/d57/d5a/d68/c10f 0 2024-02-28T16:24:20.986 INFO:tasks.workunit.client.0.smithi023.stdout:7/777: dwrite de/d1c/d76/fe7 [0,4194304] 0 2024-02-28T16:24:20.990 INFO:tasks.workunit.client.0.smithi023.stdout:1/807: write df/d11/d8a/fa8 [4522388,124688] 0 2024-02-28T16:24:20.991 INFO:tasks.workunit.client.0.smithi023.stdout:3/863: fsync d1/d74/d94/de4/d110/d120/d2d/f84 0 2024-02-28T16:24:20.998 INFO:tasks.workunit.client.0.smithi023.stdout:3/864: write d1/d74/d94/de4/d110/d120/d2d/d45/d52/d65/d89/faa [2859144,10109] 0 2024-02-28T16:24:21.007 INFO:tasks.workunit.client.0.smithi023.stdout:3/865: symlink d1/d4a/l12e 0 2024-02-28T16:24:21.007 INFO:tasks.workunit.client.0.smithi023.stdout:7/778: link de/d1c/d76/f7f de/d13/d1b/d6c/db6/df4/ffc 0 2024-02-28T16:24:21.010 INFO:tasks.workunit.client.0.smithi023.stdout:0/795: write d6/db/d1a/d26/d31/da8/fad [511828,123122] 0 2024-02-28T16:24:21.010 INFO:tasks.workunit.client.0.smithi023.stdout:3/866: dread - d1/d74/d94/de4/d110/d120/d2d/f113 zero size 2024-02-28T16:24:21.013 INFO:tasks.workunit.client.0.smithi023.stdout:7/779: symlink de/d1c/d76/d7b/lfd 0 2024-02-28T16:24:21.014 INFO:tasks.workunit.client.0.smithi023.stdout:3/867: chown d1/d74/d94/de4/d110/d120/d33/dfb 912863 1 2024-02-28T16:24:21.020 INFO:tasks.workunit.client.0.smithi023.stdout:7/780: rename de/d1c/d76/f8e to de/d13/d1b/d40/ffe 0 2024-02-28T16:24:21.025 INFO:tasks.workunit.client.0.smithi023.stdout:3/868: rename d1/d74/d94/de4/d110/d120/d2d/lfe to d1/d74/d94/de4/d110/d120/d2d/d32/l12f 0 2024-02-28T16:24:21.027 INFO:tasks.workunit.client.0.smithi023.stdout:1/808: truncate df/d11/d13/d1b/d30/f41 1132100 0 2024-02-28T16:24:21.030 INFO:tasks.workunit.client.0.smithi023.stdout:7/781: mknod de/d1c/d76/d7b/dad/dea/cff 0 2024-02-28T16:24:21.032 INFO:tasks.workunit.client.0.smithi023.stdout:7/782: readlink de/d13/d1b/d40/l7d 0 2024-02-28T16:24:21.033 INFO:tasks.workunit.client.0.smithi023.stdout:1/809: creat df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f110 x:0 0 0 2024-02-28T16:24:21.035 INFO:tasks.workunit.client.0.smithi023.stdout:3/869: mkdir d1/d74/d94/de4/d110/d120/d3d/d130 0 2024-02-28T16:24:21.037 INFO:tasks.workunit.client.0.smithi023.stdout:0/796: dwrite d6/db/d1a/d26/d31/da0/fb3 [0,4194304] 0 2024-02-28T16:24:21.042 INFO:tasks.workunit.client.0.smithi023.stdout:7/783: mknod de/d1c/d76/d7b/dd3/c100 0 2024-02-28T16:24:21.042 INFO:tasks.workunit.client.0.smithi023.stdout:1/810: truncate df/dbd/fc7 925473 0 2024-02-28T16:24:21.044 INFO:tasks.workunit.client.0.smithi023.stdout:1/811: dread - df/f10d zero size 2024-02-28T16:24:21.047 INFO:tasks.workunit.client.0.smithi023.stdout:7/784: symlink de/d60/l101 0 2024-02-28T16:24:21.052 INFO:tasks.workunit.client.0.smithi023.stdout:0/797: mknod d6/db/d1a/d26/d31/d33/d37/df6/c115 0 2024-02-28T16:24:21.056 INFO:tasks.workunit.client.0.smithi023.stdout:7/785: mkdir de/d72/d99/d102 0 2024-02-28T16:24:21.057 INFO:tasks.workunit.client.0.smithi023.stdout:3/870: dwrite d1/d74/d94/de4/d110/d120/f19 [4194304,4194304] 0 2024-02-28T16:24:21.060 INFO:tasks.workunit.client.0.smithi023.stdout:7/786: write de/d13/d1b/d6c/f97 [4808256,72521] 0 2024-02-28T16:24:21.063 INFO:tasks.workunit.client.0.smithi023.stdout:3/871: write d1/d74/d94/de4/d110/d120/d33/d38/d4c/f50 [2075059,105972] 0 2024-02-28T16:24:21.063 INFO:tasks.workunit.client.0.smithi023.stdout:1/812: rename df/d11/c52 to df/d11/d13/d1b/d30/d57/d5a/d68/ddd/c111 0 2024-02-28T16:24:21.067 INFO:tasks.workunit.client.0.smithi023.stdout:0/798: dread d6/db/d1a/d26/f4d [0,4194304] 0 2024-02-28T16:24:21.068 INFO:tasks.workunit.client.0.smithi023.stdout:7/787: unlink de/d60/f3c 0 2024-02-28T16:24:21.071 INFO:tasks.workunit.client.0.smithi023.stdout:1/813: mkdir df/d11/d13/d1b/d30/d57/d8d/de4/d112 0 2024-02-28T16:24:21.073 INFO:tasks.workunit.client.0.smithi023.stdout:0/799: mknod d6/d4c/d6a/c116 0 2024-02-28T16:24:21.078 INFO:tasks.workunit.client.0.smithi023.stdout:1/814: unlink df/d11/d13/d1b/d30/d57/d5a/d68/d7a/ccd 0 2024-02-28T16:24:21.080 INFO:tasks.workunit.client.0.smithi023.stdout:0/800: creat d6/db/d1a/d59/dcd/f117 x:0 0 0 2024-02-28T16:24:21.080 INFO:tasks.workunit.client.0.smithi023.stdout:1/815: chown df/d11/d13/d1b/d30/dae 16194282 1 2024-02-28T16:24:21.086 INFO:tasks.workunit.client.0.smithi023.stdout:0/801: mknod d6/db/d1a/d26/d31/d33/d37/d8f/c118 0 2024-02-28T16:24:21.090 INFO:tasks.workunit.client.0.smithi023.stdout:6/890: sync 2024-02-28T16:24:21.092 INFO:tasks.workunit.client.0.smithi023.stdout:1/816: link df/d26/d48/d72/dff/c107 df/d11/d13/d1b/d30/d57/d5a/d68/d7a/c113 0 2024-02-28T16:24:21.092 INFO:tasks.workunit.client.0.smithi023.stdout:0/802: creat d6/db/dab/d82/d72/f119 x:0 0 0 2024-02-28T16:24:21.095 INFO:tasks.workunit.client.0.smithi023.stdout:6/891: creat d1/d28/d1e/d80/d109/f13b x:0 0 0 2024-02-28T16:24:21.097 INFO:tasks.workunit.client.0.smithi023.stdout:6/892: dread - d1/d3d/f127 zero size 2024-02-28T16:24:21.101 INFO:tasks.workunit.client.0.smithi023.stdout:1/817: fdatasync df/d11/d13/d1b/d30/f60 0 2024-02-28T16:24:21.101 INFO:tasks.workunit.client.0.smithi023.stdout:6/893: read d1/d28/d1e/dae/fb4 [1466187,60347] 0 2024-02-28T16:24:21.103 INFO:tasks.workunit.client.0.smithi023.stdout:6/894: write d1/d18/f73 [4411748,11947] 0 2024-02-28T16:24:21.112 INFO:tasks.workunit.client.0.smithi023.stdout:1/818: creat df/d11/d13/d1b/d2e/d5c/f114 x:0 0 0 2024-02-28T16:24:21.114 INFO:tasks.workunit.client.0.smithi023.stdout:6/895: dread - d1/d28/d1e/d2b/d44/da4/fba zero size 2024-02-28T16:24:21.114 INFO:tasks.workunit.client.0.smithi023.stdout:1/819: chown df/d11/d13/d1b/d30/f60 199676655 1 2024-02-28T16:24:21.116 INFO:tasks.workunit.client.0.smithi023.stdout:6/896: chown d1/d28/d1e 1561209 1 2024-02-28T16:24:21.117 INFO:tasks.workunit.client.0.smithi023.stdout:0/803: link d6/db/d24/l43 d6/db/d3b/l11a 0 2024-02-28T16:24:21.118 INFO:tasks.workunit.client.0.smithi023.stdout:6/897: fdatasync d1/d28/d1e/d2b/fd1 0 2024-02-28T16:24:21.123 INFO:tasks.workunit.client.0.smithi023.stdout:6/898: unlink d1/d28/d1e/d80/c82 0 2024-02-28T16:24:21.126 INFO:tasks.workunit.client.0.smithi023.stdout:1/820: rename df/d11/d13/d1b/d2e/f87 to df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f115 0 2024-02-28T16:24:21.130 INFO:tasks.workunit.client.0.smithi023.stdout:3/872: write d1/d74/d94/fea [718445,97731] 0 2024-02-28T16:24:21.132 INFO:tasks.workunit.client.0.smithi023.stdout:3/873: chown d1/f2b 1363 1 2024-02-28T16:24:21.136 INFO:tasks.workunit.client.0.smithi023.stdout:3/874: creat d1/d74/d94/de4/d109/f131 x:0 0 0 2024-02-28T16:24:21.137 INFO:tasks.workunit.client.0.smithi023.stdout:7/788: truncate de/d1c/d76/d7b/f92 3425815 0 2024-02-28T16:24:21.137 INFO:tasks.workunit.client.0.smithi023.stdout:1/821: link df/dbd/cb7 df/d11/d13/d1b/c116 0 2024-02-28T16:24:21.137 INFO:tasks.workunit.client.0.smithi023.stdout:7/789: readlink de/l29 0 2024-02-28T16:24:21.145 INFO:tasks.workunit.client.0.smithi023.stdout:3/875: link d1/d74/d94/de4/d110/d120/f8e d1/d4a/d92/dff/d116/df7/f132 0 2024-02-28T16:24:21.156 INFO:tasks.workunit.client.0.smithi023.stdout:0/804: write d6/db/d3d/f55 [654845,74382] 0 2024-02-28T16:24:21.160 INFO:tasks.workunit.client.0.smithi023.stdout:6/899: write d1/d28/d1e/d2b/d6d/f92 [987093,1603] 0 2024-02-28T16:24:21.162 INFO:tasks.workunit.client.0.smithi023.stdout:0/805: fdatasync d6/db/d1a/d26/f52 0 2024-02-28T16:24:21.165 INFO:tasks.workunit.client.0.smithi023.stdout:2/854: sync 2024-02-28T16:24:21.166 INFO:tasks.workunit.client.0.smithi023.stdout:1/822: dread df/dbd/d7b/fc1 [0,4194304] 0 2024-02-28T16:24:21.168 INFO:tasks.workunit.client.0.smithi023.stdout:0/806: dread - d6/db/d3d/fd0 zero size 2024-02-28T16:24:21.174 INFO:tasks.workunit.client.0.smithi023.stdout:3/876: dwrite d1/d74/d94/de4/d110/d120/d33/d38/f48 [0,4194304] 0 2024-02-28T16:24:21.176 INFO:tasks.workunit.client.0.smithi023.stdout:7/790: dread de/d1c/d76/f86 [0,4194304] 0 2024-02-28T16:24:21.177 INFO:tasks.workunit.client.0.smithi023.stdout:2/855: creat d5/da/db/db9/f10e x:0 0 0 2024-02-28T16:24:21.178 INFO:tasks.workunit.client.0.smithi023.stdout:2/856: readlink d5/l59 0 2024-02-28T16:24:21.181 INFO:tasks.workunit.client.0.smithi023.stdout:7/791: mknod de/d13/d1b/d40/c103 0 2024-02-28T16:24:21.183 INFO:tasks.workunit.client.0.smithi023.stdout:6/900: write d1/d18/d26/f58 [2209987,88668] 0 2024-02-28T16:24:21.184 INFO:tasks.workunit.client.0.smithi023.stdout:3/877: creat d1/d74/d94/de4/d110/d120/d33/dc2/f133 x:0 0 0 2024-02-28T16:24:21.192 INFO:tasks.workunit.client.0.smithi023.stdout:3/878: read d1/d74/d94/de4/d110/d120/d33/d38/d4c/f50 [15675,21970] 0 2024-02-28T16:24:21.195 INFO:tasks.workunit.client.0.smithi023.stdout:1/823: truncate df/d93/fec 1290548 0 2024-02-28T16:24:21.198 INFO:tasks.workunit.client.0.smithi023.stdout:2/857: mknod d5/da/db/d17/d3c/d103/c10f 0 2024-02-28T16:24:21.200 INFO:tasks.workunit.client.0.smithi023.stdout:6/901: mkdir d1/d28/d1e/d80/d13c 0 2024-02-28T16:24:21.201 INFO:tasks.workunit.client.0.smithi023.stdout:4/773: sync 2024-02-28T16:24:21.201 INFO:tasks.workunit.client.0.smithi023.stdout:9/765: sync 2024-02-28T16:24:21.201 INFO:tasks.workunit.client.0.smithi023.stdout:8/868: sync 2024-02-28T16:24:21.201 INFO:tasks.workunit.client.0.smithi023.stdout:3/879: write d1/d74/d94/de4/d110/d120/d2d/d111/f117 [669801,109071] 0 2024-02-28T16:24:21.204 INFO:tasks.workunit.client.0.smithi023.stdout:2/858: chown d5/da/d1b/d3f/d75/fb7 30640 1 2024-02-28T16:24:21.209 INFO:tasks.workunit.client.0.smithi023.stdout:4/774: stat d13/d2b/f4f 0 2024-02-28T16:24:21.210 INFO:tasks.workunit.client.0.smithi023.stdout:9/766: readlink d0/d7/de/d34/l53 0 2024-02-28T16:24:21.299 INFO:tasks.workunit.client.0.smithi023.stdout:8/869: rename d0/d5/c25 to d0/d5/d1b/d7f/c11b 0 2024-02-28T16:24:21.299 INFO:tasks.workunit.client.0.smithi023.stdout:1/824: dwrite f2 [0,4194304] 0 2024-02-28T16:24:21.304 INFO:tasks.workunit.client.0.smithi023.stdout:6/902: dwrite d1/d28/d1e/d2b/fdf [4194304,4194304] 0 2024-02-28T16:24:21.308 INFO:tasks.workunit.client.0.smithi023.stdout:3/880: rename d1/d74/de1/faf to d1/d4a/d92/dff/d116/df7/f134 0 2024-02-28T16:24:21.309 INFO:tasks.workunit.client.0.smithi023.stdout:9/767: write d0/f1f [1690158,129254] 0 2024-02-28T16:24:21.316 INFO:tasks.workunit.client.0.smithi023.stdout:6/903: readlink d1/d18/d26/d6a/l9c 0 2024-02-28T16:24:21.317 INFO:tasks.workunit.client.0.smithi023.stdout:8/870: creat d0/f11c x:0 0 0 2024-02-28T16:24:21.317 INFO:tasks.workunit.client.0.smithi023.stdout:4/775: dwrite d13/d2b/d2c/d31/d6e/f7b [0,4194304] 0 2024-02-28T16:24:21.318 INFO:tasks.workunit.client.0.smithi023.stdout:0/807: dwrite d6/db/dab/d42/fc2 [0,4194304] 0 2024-02-28T16:24:21.318 INFO:tasks.workunit.client.0.smithi023.stdout:3/881: read - d1/d4a/d92/dff/f10d zero size 2024-02-28T16:24:21.320 INFO:tasks.workunit.client.0.smithi023.stdout:1/825: dread - df/d11/d13/d1b/d30/d57/d5a/da6/fad zero size 2024-02-28T16:24:21.328 INFO:tasks.workunit.client.0.smithi023.stdout:7/792: dwrite de/d60/f5e [0,4194304] 0 2024-02-28T16:24:21.333 INFO:tasks.workunit.client.0.smithi023.stdout:0/808: chown d6/db/d1a/d26 259145 1 2024-02-28T16:24:21.339 INFO:tasks.workunit.client.0.smithi023.stdout:3/882: fsync d1/d74/d94/de4/d110/d120/d2d/d45/d52/f10e 0 2024-02-28T16:24:21.340 INFO:tasks.workunit.client.0.smithi023.stdout:4/776: fsync d13/d2b/f5e 0 2024-02-28T16:24:21.344 INFO:tasks.workunit.client.0.smithi023.stdout:1/826: rename df/f75 to df/d11/d13/d1b/d30/d57/d5a/d68/d7a/f117 0 2024-02-28T16:24:21.347 INFO:tasks.workunit.client.0.smithi023.stdout:0/809: chown d6/db/d1a/d26/d31/d33/d6e/fd7 107 1 2024-02-28T16:24:21.348 INFO:tasks.workunit.client.0.smithi023.stdout:7/793: fdatasync de/d1c/d76/d7b/f92 0 2024-02-28T16:24:21.352 INFO:tasks.workunit.client.0.smithi023.stdout:9/768: dwrite d0/d7/db/d18/f9d [0,4194304] 0 2024-02-28T16:24:21.357 INFO:tasks.workunit.client.0.smithi023.stdout:1/827: mkdir df/d11/d13/d118 0 2024-02-28T16:24:21.358 INFO:tasks.workunit.client.0.smithi023.stdout:0/810: rename d6/d4c/d6a/fe9 to d6/db/d1a/d1b/d101/f11b 0 2024-02-28T16:24:21.361 INFO:tasks.workunit.client.0.smithi023.stdout:9/769: creat d0/d7/db/dec/f104 x:0 0 0 2024-02-28T16:24:21.364 INFO:tasks.workunit.client.0.smithi023.stdout:0/811: symlink d6/db/d1a/d26/d31/d33/dbe/l11c 0 2024-02-28T16:24:21.367 INFO:tasks.workunit.client.0.smithi023.stdout:9/770: mkdir d0/d7/db/d18/d23/d28/d32/d105 0 2024-02-28T16:24:21.372 INFO:tasks.workunit.client.0.smithi023.stdout:9/771: read d0/f43 [2121092,25572] 0 2024-02-28T16:24:21.374 INFO:tasks.workunit.client.0.smithi023.stdout:9/772: chown d0/d7/db/d18/fe7 0 1 2024-02-28T16:24:21.375 INFO:tasks.workunit.client.0.smithi023.stdout:9/773: chown d0/d7/de/d2a/daf/d2f 36473900 1 2024-02-28T16:24:21.389 INFO:tasks.workunit.client.0.smithi023.stdout:9/774: getdents d0/d7/db/d18/d23/d28 0 2024-02-28T16:24:21.395 INFO:tasks.workunit.client.0.smithi023.stdout:8/871: write d0/d5/f5e [6077124,48096] 0 2024-02-28T16:24:21.399 INFO:tasks.workunit.client.0.smithi023.stdout:0/812: dread d6/db/d1a/f6b [0,4194304] 0 2024-02-28T16:24:21.403 INFO:tasks.workunit.client.0.smithi023.stdout:8/872: mknod d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/c11d 0 2024-02-28T16:24:21.407 INFO:tasks.workunit.client.0.smithi023.stdout:0/813: rename d6/d84/fc5 to d6/db/d3b/d106/f11d 0 2024-02-28T16:24:21.409 INFO:tasks.workunit.client.0.smithi023.stdout:4/777: truncate d13/f3c 1867805 0 2024-02-28T16:24:21.420 INFO:tasks.workunit.client.0.smithi023.stdout:0/814: symlink d6/db/d24/l11e 0 2024-02-28T16:24:21.420 INFO:tasks.workunit.client.0.smithi023.stdout:8/873: mkdir d0/d5/d1a/d2d/d67/d11e 0 2024-02-28T16:24:21.420 INFO:tasks.workunit.client.0.smithi023.stdout:1/828: write df/d26/d48/db3/fb8 [497461,66245] 0 2024-02-28T16:24:21.420 INFO:tasks.workunit.client.0.smithi023.stdout:9/775: dwrite d0/d7/de/d2a/daf/d2f/d4d/f7b [0,4194304] 0 2024-02-28T16:24:21.421 INFO:tasks.workunit.client.0.smithi023.stdout:6/904: dread d1/d28/d1e/d52/f5b [0,4194304] 0 2024-02-28T16:24:21.424 INFO:tasks.workunit.client.0.smithi023.stdout:0/815: write d6/db/d1a/d26/d31/da0/fb3 [2393469,58615] 0 2024-02-28T16:24:21.434 INFO:tasks.workunit.client.0.smithi023.stdout:6/905: mkdir d1/d3d/df7/d13d 0 2024-02-28T16:24:21.435 INFO:tasks.workunit.client.0.smithi023.stdout:8/874: mkdir d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d116/d11f 0 2024-02-28T16:24:21.440 INFO:tasks.workunit.client.0.smithi023.stdout:9/776: creat d0/d7/de/d2a/daf/d2f/db0/dd9/f106 x:0 0 0 2024-02-28T16:24:21.440 INFO:tasks.workunit.client.0.smithi023.stdout:6/906: mkdir d1/d28/d1e/d2b/d6d/d7b/d13e 0 2024-02-28T16:24:21.442 INFO:tasks.workunit.client.0.smithi023.stdout:8/875: chown d0/d5/d1b/d36/fa3 307 1 2024-02-28T16:24:21.442 INFO:tasks.workunit.client.0.smithi023.stdout:4/778: dwrite d13/d1d/d2e/f52 [0,4194304] 0 2024-02-28T16:24:21.446 INFO:tasks.workunit.client.0.smithi023.stdout:6/907: readlink d1/d28/d1e/d2b/d44/da4/lb0 0 2024-02-28T16:24:21.448 INFO:tasks.workunit.client.0.smithi023.stdout:4/779: readlink d13/d2b/d2c/lf5 0 2024-02-28T16:24:21.449 INFO:tasks.workunit.client.0.smithi023.stdout:0/816: getdents d6/db/d1a 0 2024-02-28T16:24:21.453 INFO:tasks.workunit.client.0.smithi023.stdout:0/817: chown d6/db/dab/d42/f83 6 1 2024-02-28T16:24:21.455 INFO:tasks.workunit.client.0.smithi023.stdout:9/777: dread - d0/d7/de/d2a/daf/d2f/d4d/fdb zero size 2024-02-28T16:24:21.457 INFO:tasks.workunit.client.0.smithi023.stdout:4/780: fsync f5 0 2024-02-28T16:24:21.466 INFO:tasks.workunit.client.0.smithi023.stdout:8/876: rename d0/f11c to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/f120 0 2024-02-28T16:24:21.471 INFO:tasks.workunit.client.0.smithi023.stdout:8/877: read d0/d5/f27 [1061933,92743] 0 2024-02-28T16:24:21.477 INFO:tasks.workunit.client.0.smithi023.stdout:1/829: dread df/d11/d13/f62 [0,4194304] 0 2024-02-28T16:24:21.481 INFO:tasks.workunit.client.0.smithi023.stdout:0/818: unlink d6/db/d1a/d26/d66/cde 0 2024-02-28T16:24:21.482 INFO:tasks.workunit.client.0.smithi023.stdout:6/908: write d1/d28/d1e/d2b/d76/d9e/fce [613189,126040] 0 2024-02-28T16:24:21.484 INFO:tasks.workunit.client.0.smithi023.stdout:9/778: write d0/d7/db/d18/d23/d28/d6e/fb8 [342088,23665] 0 2024-02-28T16:24:21.487 INFO:tasks.workunit.client.0.smithi023.stdout:4/781: unlink d13/d1e/l70 0 2024-02-28T16:24:21.490 INFO:tasks.workunit.client.0.smithi023.stdout:0/819: creat d6/db/d1a/d26/d31/d33/d37/df6/f11f x:0 0 0 2024-02-28T16:24:21.491 INFO:tasks.workunit.client.0.smithi023.stdout:0/820: stat d6/c7c 0 2024-02-28T16:24:21.492 INFO:tasks.workunit.client.0.smithi023.stdout:1/830: symlink df/d11/d13/l119 0 2024-02-28T16:24:21.492 INFO:tasks.workunit.client.0.smithi023.stdout:8/878: dread d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/fa9 [0,4194304] 0 2024-02-28T16:24:21.493 INFO:tasks.workunit.client.0.smithi023.stdout:9/779: write d0/d7/de/d2a/daf/d2f/db0/dd9/f106 [283493,63409] 0 2024-02-28T16:24:21.496 INFO:tasks.workunit.client.0.smithi023.stdout:8/879: chown d0/d5/d1a/f6d 600 1 2024-02-28T16:24:21.498 INFO:tasks.workunit.client.0.smithi023.stdout:0/821: chown d6/db/d1a/d26/d9c/fe0 1 1 2024-02-28T16:24:21.499 INFO:tasks.workunit.client.0.smithi023.stdout:9/780: fsync d0/d7/db/d18/fe3 0 2024-02-28T16:24:21.509 INFO:tasks.workunit.client.0.smithi023.stdout:0/822: creat d6/db/d1a/d26/d9c/f120 x:0 0 0 2024-02-28T16:24:21.512 INFO:tasks.workunit.client.0.smithi023.stdout:0/823: readlink d6/d4c/d6a/l99 0 2024-02-28T16:24:21.520 INFO:tasks.workunit.client.0.smithi023.stdout:4/782: dwrite d13/d2b/fab [0,4194304] 0 2024-02-28T16:24:21.523 INFO:tasks.workunit.client.0.smithi023.stdout:6/909: dread d1/d3d/fab [0,4194304] 0 2024-02-28T16:24:21.524 INFO:tasks.workunit.client.0.smithi023.stdout:0/824: creat d6/db/d1a/d26/d31/da8/f121 x:0 0 0 2024-02-28T16:24:21.533 INFO:tasks.workunit.client.0.smithi023.stdout:1/831: dwrite df/d26/f35 [0,4194304] 0 2024-02-28T16:24:21.534 INFO:tasks.workunit.client.0.smithi023.stdout:8/880: dwrite d0/d5/d1b/d7f/fb3 [0,4194304] 0 2024-02-28T16:24:21.541 INFO:tasks.workunit.client.0.smithi023.stdout:6/910: stat d1/d28/d1e/d2b/d44/d86/d12c/c138 0 2024-02-28T16:24:21.542 INFO:tasks.workunit.client.0.smithi023.stdout:9/781: dwrite d0/d7/db/d18/d23/d28/d32/f3f [4194304,4194304] 0 2024-02-28T16:24:21.553 INFO:tasks.workunit.client.0.smithi023.stdout:6/911: write d1/d28/d1e/d2b/d76/d9e/fce [859486,8266] 0 2024-02-28T16:24:21.556 INFO:tasks.workunit.client.0.smithi023.stdout:0/825: rename d6/db/d1a/f7f to d6/db/d1a/d26/d31/d33/d37/d8f/f122 0 2024-02-28T16:24:21.562 INFO:tasks.workunit.client.0.smithi023.stdout:6/912: dread - d1/d18/dd8/de8/ded/d11d/f133 zero size 2024-02-28T16:24:21.568 INFO:tasks.workunit.client.0.smithi023.stdout:6/913: chown d1/d3d/l8d 8901411 1 2024-02-28T16:24:21.569 INFO:tasks.workunit.client.0.smithi023.stdout:4/783: dwrite d13/d2b/f5a [0,4194304] 0 2024-02-28T16:24:21.576 INFO:tasks.workunit.client.0.smithi023.stdout:9/782: dread d0/d7/de/d34/f3b [0,4194304] 0 2024-02-28T16:24:21.585 INFO:tasks.workunit.client.0.smithi023.stdout:8/881: dwrite d0/d5/d1b/d7f/f91 [0,4194304] 0 2024-02-28T16:24:21.600 INFO:tasks.workunit.client.0.smithi023.stdout:9/783: mknod d0/d7/db/d18/d23/d28/d32/d8b/c107 0 2024-02-28T16:24:21.601 INFO:tasks.workunit.client.0.smithi023.stdout:4/784: link d13/d1d/c5f d13/d1d/d58/cf7 0 2024-02-28T16:24:21.601 INFO:tasks.workunit.client.0.smithi023.stdout:6/914: link d1/d28/d1e/d2b/d6d/d7b/c117 d1/d28/d1e/dbc/dfb/c13f 0 2024-02-28T16:24:21.603 INFO:tasks.workunit.client.0.smithi023.stdout:9/784: dread - d0/d7/ff3 zero size 2024-02-28T16:24:21.605 INFO:tasks.workunit.client.0.smithi023.stdout:4/785: stat d13/d2b/d2c/d31/d8d/db3/fed 0 2024-02-28T16:24:21.609 INFO:tasks.workunit.client.0.smithi023.stdout:6/915: fdatasync d1/d28/d1e/d2b/d44/da4/fba 0 2024-02-28T16:24:21.613 INFO:tasks.workunit.client.0.smithi023.stdout:4/786: unlink d13/d2b/d2c/d31/dc4/d55/cad 0 2024-02-28T16:24:21.626 INFO:tasks.workunit.client.0.smithi023.stdout:8/882: truncate d0/d5/d1b/f43 7199343 0 2024-02-28T16:24:21.626 INFO:tasks.workunit.client.0.smithi023.stdout:0/826: write d6/db/d1a/d26/d31/f90 [765749,44541] 0 2024-02-28T16:24:21.631 INFO:tasks.workunit.client.0.smithi023.stdout:4/787: write d13/d2b/d2c/f30 [2610177,104668] 0 2024-02-28T16:24:21.632 INFO:tasks.workunit.client.0.smithi023.stdout:6/916: dwrite d1/d28/f19 [0,4194304] 0 2024-02-28T16:24:21.632 INFO:tasks.workunit.client.0.smithi023.stdout:8/883: read - d0/d5/d1a/d2d/d67/d71/fd7 zero size 2024-02-28T16:24:21.638 INFO:tasks.workunit.client.0.smithi023.stdout:4/788: write d13/d1d/d85/de3/ff0 [671364,128742] 0 2024-02-28T16:24:21.639 INFO:tasks.workunit.client.0.smithi023.stdout:9/785: dwrite d0/d7/d2c/d84/fb3 [0,4194304] 0 2024-02-28T16:24:21.640 INFO:tasks.workunit.client.0.smithi023.stdout:0/827: symlink d6/db/d1a/d26/d31/d33/d37/d8f/l123 0 2024-02-28T16:24:21.645 INFO:tasks.workunit.client.0.smithi023.stdout:6/917: mknod d1/d28/d1e/d2b/d44/da4/d106/c140 0 2024-02-28T16:24:21.651 INFO:tasks.workunit.client.0.smithi023.stdout:9/786: mknod d0/d7/de/d2a/c108 0 2024-02-28T16:24:21.657 INFO:tasks.workunit.client.0.smithi023.stdout:4/789: link d13/fae d13/d2b/d2c/d31/d8d/db3/d90/ff8 0 2024-02-28T16:24:21.660 INFO:tasks.workunit.client.0.smithi023.stdout:9/787: write d0/d7/db/d18/d23/d28/f54 [783402,9499] 0 2024-02-28T16:24:21.660 INFO:tasks.workunit.client.0.smithi023.stdout:6/918: symlink d1/d28/d1e/d2b/d44/l141 0 2024-02-28T16:24:21.664 INFO:tasks.workunit.client.0.smithi023.stdout:8/884: getdents d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d116 0 2024-02-28T16:24:21.669 INFO:tasks.workunit.client.0.smithi023.stdout:4/790: creat d13/d1d/d2d/da9/ff9 x:0 0 0 2024-02-28T16:24:21.669 INFO:tasks.workunit.client.0.smithi023.stdout:8/885: mkdir d0/d5/ddc/d121 0 2024-02-28T16:24:21.669 INFO:tasks.workunit.client.0.smithi023.stdout:9/788: truncate d0/d7/db/d18/d23/fa8 4926838 0 2024-02-28T16:24:21.679 INFO:tasks.workunit.client.0.smithi023.stdout:9/789: write d0/d7/db/d18/d23/d28/f54 [3554517,18589] 0 2024-02-28T16:24:21.693 INFO:tasks.workunit.client.0.smithi023.stdout:6/919: dread d1/f40 [4194304,4194304] 0 2024-02-28T16:24:21.695 INFO:tasks.workunit.client.0.smithi023.stdout:6/920: read d1/d3d/fab [1258039,81916] 0 2024-02-28T16:24:21.707 INFO:tasks.workunit.client.0.smithi023.stdout:8/886: fdatasync d0/fc 0 2024-02-28T16:24:21.708 INFO:tasks.workunit.client.0.smithi023.stdout:4/791: chown d13/d1d/d58/f84 132 1 2024-02-28T16:24:21.710 INFO:tasks.workunit.client.0.smithi023.stdout:4/792: chown d13/d1d/d85/la4 75754 1 2024-02-28T16:24:21.711 INFO:tasks.workunit.client.0.smithi023.stdout:9/790: creat d0/d7/db/d18/d23/d28/d32/dca/f109 x:0 0 0 2024-02-28T16:24:21.712 INFO:tasks.workunit.client.0.smithi023.stdout:6/921: mknod d1/d28/d1e/d80/c142 0 2024-02-28T16:24:21.715 INFO:tasks.workunit.client.0.smithi023.stdout:4/793: mkdir d13/d2b/d2c/d31/dc4/dc0/dfa 0 2024-02-28T16:24:21.719 INFO:tasks.workunit.client.0.smithi023.stdout:8/887: creat d0/d5/d104/f122 x:0 0 0 2024-02-28T16:24:21.725 INFO:tasks.workunit.client.0.smithi023.stdout:4/794: symlink d13/d2b/d2c/d31/de6/lfb 0 2024-02-28T16:24:21.728 INFO:tasks.workunit.client.0.smithi023.stdout:8/888: creat d0/d5/d1a/d2d/d67/f123 x:0 0 0 2024-02-28T16:24:21.736 INFO:tasks.workunit.client.0.smithi023.stdout:4/795: getdents d13/d1e 0 2024-02-28T16:24:21.739 INFO:tasks.workunit.client.0.smithi023.stdout:4/796: creat d13/d1d/d85/ffc x:0 0 0 2024-02-28T16:24:21.754 INFO:tasks.workunit.client.0.smithi023.stdout:9/791: write d0/d7/db/d18/fc5 [282525,50905] 0 2024-02-28T16:24:21.756 INFO:tasks.workunit.client.0.smithi023.stdout:6/922: write d1/d28/d1e/d2b/d44/d86/d12c/f97 [692651,35770] 0 2024-02-28T16:24:21.760 INFO:tasks.workunit.client.0.smithi023.stdout:4/797: dwrite d13/d1d/d2d/da9/fd9 [0,4194304] 0 2024-02-28T16:24:21.765 INFO:tasks.workunit.client.0.smithi023.stdout:6/923: unlink d1/d28/d1e/d2b/d44/d86/d12c/f3f 0 2024-02-28T16:24:21.768 INFO:tasks.workunit.client.0.smithi023.stdout:6/924: chown d1/d18/f107 0 1 2024-02-28T16:24:21.771 INFO:tasks.workunit.client.0.smithi023.stdout:8/889: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/f4c [0,4194304] 0 2024-02-28T16:24:21.780 INFO:tasks.workunit.client.0.smithi023.stdout:8/890: stat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/cf6 0 2024-02-28T16:24:21.784 INFO:tasks.workunit.client.0.smithi023.stdout:4/798: dread d13/d2b/d2c/d31/d8d/db3/d90/fd8 [0,4194304] 0 2024-02-28T16:24:21.784 INFO:tasks.workunit.client.0.smithi023.stdout:9/792: dwrite d0/d7/db/d18/d23/d28/d9c/f5f [0,4194304] 0 2024-02-28T16:24:21.787 INFO:tasks.workunit.client.0.smithi023.stdout:4/799: chown d13/d1d/f6d 756 1 2024-02-28T16:24:21.790 INFO:tasks.workunit.client.0.smithi023.stdout:3/883: sync 2024-02-28T16:24:21.790 INFO:tasks.workunit.client.0.smithi023.stdout:2/859: sync 2024-02-28T16:24:21.790 INFO:tasks.workunit.client.0.smithi023.stdout:7/794: sync 2024-02-28T16:24:21.792 INFO:tasks.workunit.client.0.smithi023.stdout:8/891: rmdir d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/dfa 39 2024-02-28T16:24:21.794 INFO:tasks.workunit.client.0.smithi023.stdout:9/793: fsync d0/d7/d2c/d7d/fdf 0 2024-02-28T16:24:21.794 INFO:tasks.workunit.client.0.smithi023.stdout:7/795: chown de/d13/d1b/d40 474095 1 2024-02-28T16:24:21.795 INFO:tasks.workunit.client.0.smithi023.stdout:4/800: symlink d13/d2b/d2c/d31/dc4/d67/lfd 0 2024-02-28T16:24:21.795 INFO:tasks.workunit.client.0.smithi023.stdout:2/860: dread - d5/da/d104/dd0/ffe zero size 2024-02-28T16:24:21.797 INFO:tasks.workunit.client.0.smithi023.stdout:8/892: read d0/d5/d1b/d36/f85 [296002,7952] 0 2024-02-28T16:24:21.799 INFO:tasks.workunit.client.0.smithi023.stdout:7/796: dread - de/d13/d1b/d3d/fd5 zero size 2024-02-28T16:24:21.799 INFO:tasks.workunit.client.0.smithi023.stdout:4/801: truncate d13/d2b/d9d/ff3 1016273 0 2024-02-28T16:24:21.803 INFO:tasks.workunit.client.0.smithi023.stdout:9/794: unlink d0/d7/db/d18/l20 0 2024-02-28T16:24:21.805 INFO:tasks.workunit.client.0.smithi023.stdout:2/861: symlink d5/da/db/d17/d3c/d7f/dc6/l110 0 2024-02-28T16:24:21.810 INFO:tasks.workunit.client.0.smithi023.stdout:3/884: write d1/d74/d94/de4/d110/d120/d33/d38/d4c/f63 [251192,46199] 0 2024-02-28T16:24:21.812 INFO:tasks.workunit.client.0.smithi023.stdout:7/797: unlink de/d1c/d76/d7b/dad/dc9/cf9 0 2024-02-28T16:24:21.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:21 smithi153 ceph-mon[35341]: pgmap v42: 65 pgs: 65 active+clean; 1.7 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 45 MiB/s rd, 119 MiB/s wr, 318 op/s 2024-02-28T16:24:21.901 INFO:tasks.workunit.client.0.smithi023.stdout:7/798: creat de/d13/d1b/d3d/d53/f104 x:0 0 0 2024-02-28T16:24:21.903 INFO:tasks.workunit.client.0.smithi023.stdout:9/795: getdents d0/d7/de/d2a/daf/d2f/db0 0 2024-02-28T16:24:21.905 INFO:tasks.workunit.client.0.smithi023.stdout:7/799: write de/d60/f5e [1867010,29089] 0 2024-02-28T16:24:21.906 INFO:tasks.workunit.client.0.smithi023.stdout:3/885: truncate d1/d74/d94/de4/d110/d120/f104 713470 0 2024-02-28T16:24:21.913 INFO:tasks.workunit.client.0.smithi023.stdout:4/802: dwrite d13/d1d/f6d [0,4194304] 0 2024-02-28T16:24:21.918 INFO:tasks.workunit.client.0.smithi023.stdout:4/803: chown d13/d2b/d2c/d31/l8c 557719 1 2024-02-28T16:24:21.920 INFO:tasks.workunit.client.0.smithi023.stdout:2/862: dwrite d5/da/d62/f90 [0,4194304] 0 2024-02-28T16:24:21.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:21 smithi023 ceph-mon[29137]: pgmap v42: 65 pgs: 65 active+clean; 1.7 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 45 MiB/s rd, 119 MiB/s wr, 318 op/s 2024-02-28T16:24:21.924 INFO:tasks.workunit.client.0.smithi023.stdout:4/804: creat d13/d1d/d58/ddb/ffe x:0 0 0 2024-02-28T16:24:21.933 INFO:tasks.workunit.client.0.smithi023.stdout:7/800: dwrite de/d13/d1b/d6c/fd7 [0,4194304] 0 2024-02-28T16:24:21.934 INFO:tasks.workunit.client.0.smithi023.stdout:1/832: sync 2024-02-28T16:24:21.934 INFO:tasks.workunit.client.0.smithi023.stdout:0/828: sync 2024-02-28T16:24:21.936 INFO:tasks.workunit.client.0.smithi023.stdout:7/801: stat de/d1c/d76/f86 0 2024-02-28T16:24:21.940 INFO:tasks.workunit.client.0.smithi023.stdout:3/886: rename d1/d74/d94/de4/d110/d120/d2d/d32/c34 to d1/d74/d94/de4/d110/d120/d2d/d45/d52/c135 0 2024-02-28T16:24:21.945 INFO:tasks.workunit.client.0.smithi023.stdout:3/887: write d1/d74/d94/de4/d110/d120/f29 [5064312,58828] 0 2024-02-28T16:24:21.954 INFO:tasks.workunit.client.0.smithi023.stdout:0/829: write d6/db/d1a/d1b/d101/f11b [4717431,43878] 0 2024-02-28T16:24:21.956 INFO:tasks.workunit.client.0.smithi023.stdout:1/833: rename df/d11/d13/d1b/f7f to df/d11/d13/d99/dfc/df9/f11a 0 2024-02-28T16:24:21.960 INFO:tasks.workunit.client.0.smithi023.stdout:3/888: mknod d1/d74/d94/de4/d110/d120/d3d/d119/c136 0 2024-02-28T16:24:21.965 INFO:tasks.workunit.client.0.smithi023.stdout:0/830: creat d6/db/d1a/d26/d31/d33/d37/df6/f124 x:0 0 0 2024-02-28T16:24:21.968 INFO:tasks.workunit.client.0.smithi023.stdout:0/831: chown d6/d84/f10c 125 1 2024-02-28T16:24:21.969 INFO:tasks.workunit.client.0.smithi023.stdout:1/834: mkdir df/d11/d13/d99/dde/de6/d11b 0 2024-02-28T16:24:21.972 INFO:tasks.workunit.client.0.smithi023.stdout:7/802: getdents de/d1c 0 2024-02-28T16:24:21.973 INFO:tasks.workunit.client.0.smithi023.stdout:3/889: dread - d1/d74/d94/de4/d110/d120/d2d/fee zero size 2024-02-28T16:24:21.974 INFO:tasks.workunit.client.0.smithi023.stdout:0/832: readlink d6/db/d1a/d26/d31/d33/dbe/lda 0 2024-02-28T16:24:21.975 INFO:tasks.workunit.client.0.smithi023.stdout:9/796: dwrite d0/d7/db/d18/d23/d28/d32/d8b/fce [0,4194304] 0 2024-02-28T16:24:21.977 INFO:tasks.workunit.client.0.smithi023.stdout:6/925: sync 2024-02-28T16:24:21.979 INFO:tasks.workunit.client.0.smithi023.stdout:7/803: write de/d1c/f68 [4128548,51239] 0 2024-02-28T16:24:21.987 INFO:tasks.workunit.client.0.smithi023.stdout:7/804: chown de/d13/d1b/d3d/d53/c8d 3111677 1 2024-02-28T16:24:21.988 INFO:tasks.workunit.client.0.smithi023.stdout:4/805: dread d13/d1d/d58/f68 [0,4194304] 0 2024-02-28T16:24:21.990 INFO:tasks.workunit.client.0.smithi023.stdout:3/890: write d1/d4a/fae [2826492,78195] 0 2024-02-28T16:24:21.992 INFO:tasks.workunit.client.0.smithi023.stdout:7/805: chown de/d8b/d95/d98 18613 1 2024-02-28T16:24:21.994 INFO:tasks.workunit.client.0.smithi023.stdout:0/833: mknod d6/db/d1a/d26/d31/da0/c125 0 2024-02-28T16:24:22.001 INFO:tasks.workunit.client.0.smithi023.stdout:2/863: dwrite d5/da/d8c/fcc [0,4194304] 0 2024-02-28T16:24:22.010 INFO:tasks.workunit.client.0.smithi023.stdout:7/806: mknod de/d72/d99/d102/c105 0 2024-02-28T16:24:22.010 INFO:tasks.workunit.client.0.smithi023.stdout:0/834: fdatasync d6/db/d1a/d26/d31/fcf 0 2024-02-28T16:24:22.011 INFO:tasks.workunit.client.0.smithi023.stdout:1/835: dread df/d26/d48/f79 [0,4194304] 0 2024-02-28T16:24:22.012 INFO:tasks.workunit.client.0.smithi023.stdout:4/806: dwrite fb [0,4194304] 0 2024-02-28T16:24:22.015 INFO:tasks.workunit.client.0.smithi023.stdout:2/864: truncate d5/da/db/d17/f65 1055233 0 2024-02-28T16:24:22.022 INFO:tasks.workunit.client.0.smithi023.stdout:4/807: mknod d13/d2b/d2c/d31/d8d/db3/d90/cff 0 2024-02-28T16:24:22.023 INFO:tasks.workunit.client.0.smithi023.stdout:4/808: stat d13/d2b/d2c/d31 0 2024-02-28T16:24:22.025 INFO:tasks.workunit.client.0.smithi023.stdout:1/836: rename df/d11/d13/d1b/f55 to df/d11/d13/d27/f11c 0 2024-02-28T16:24:22.026 INFO:tasks.workunit.client.0.smithi023.stdout:9/797: dread d0/d7/de/d34/f35 [0,4194304] 0 2024-02-28T16:24:22.027 INFO:tasks.workunit.client.0.smithi023.stdout:0/835: creat d6/db/dab/d82/da3/f126 x:0 0 0 2024-02-28T16:24:22.030 INFO:tasks.workunit.client.0.smithi023.stdout:7/807: dread de/d13/d1b/d6c/fd9 [0,4194304] 0 2024-02-28T16:24:22.030 INFO:tasks.workunit.client.0.smithi023.stdout:4/809: readlink d13/d1e/l23 0 2024-02-28T16:24:22.035 INFO:tasks.workunit.client.0.smithi023.stdout:9/798: symlink d0/d7/de/d2a/daf/d2f/d44/d95/l10a 0 2024-02-28T16:24:22.036 INFO:tasks.workunit.client.0.smithi023.stdout:7/808: creat de/d1c/f106 x:0 0 0 2024-02-28T16:24:22.039 INFO:tasks.workunit.client.0.smithi023.stdout:1/837: fdatasync df/dbd/d7b/fc1 0 2024-02-28T16:24:22.040 INFO:tasks.workunit.client.0.smithi023.stdout:7/809: read - de/d13/d1b/d3d/d53/f73 zero size 2024-02-28T16:24:22.041 INFO:tasks.workunit.client.0.smithi023.stdout:0/836: creat d6/db/d1a/d35/d9d/dce/f127 x:0 0 0 2024-02-28T16:24:22.043 INFO:tasks.workunit.client.0.smithi023.stdout:0/837: chown d6/d4c/d6a/c103 212429374 1 2024-02-28T16:24:22.046 INFO:tasks.workunit.client.0.smithi023.stdout:0/838: stat d6/d4c/d6a/cbc 0 2024-02-28T16:24:22.046 INFO:tasks.workunit.client.0.smithi023.stdout:2/865: rename d5/da/d1b/d3f/d75/d92/f96 to d5/da/db/d17/d3c/f111 0 2024-02-28T16:24:22.048 INFO:tasks.workunit.client.0.smithi023.stdout:4/810: unlink d13/d1d/d58/ce0 0 2024-02-28T16:24:22.060 INFO:tasks.workunit.client.0.smithi023.stdout:4/811: fsync d13/d2b/d2c/f35 0 2024-02-28T16:24:22.062 INFO:tasks.workunit.client.0.smithi023.stdout:2/866: creat d5/da/d45/d6a/f112 x:0 0 0 2024-02-28T16:24:22.074 INFO:tasks.workunit.client.0.smithi023.stdout:4/812: symlink d13/d1e/l100 0 2024-02-28T16:24:22.078 INFO:tasks.workunit.client.0.smithi023.stdout:1/838: creat df/d11/d13/d1b/d30/d57/d5a/d68/f11d x:0 0 0 2024-02-28T16:24:22.079 INFO:tasks.workunit.client.0.smithi023.stdout:3/891: dwrite d1/d74/d94/de4/d110/d120/fa1 [0,4194304] 0 2024-02-28T16:24:22.085 INFO:tasks.workunit.client.0.smithi023.stdout:4/813: mknod d13/d1d/d58/ddb/c101 0 2024-02-28T16:24:22.091 INFO:tasks.workunit.client.0.smithi023.stdout:4/814: readlink d13/d2b/d2c/d31/dc4/lc2 0 2024-02-28T16:24:22.092 INFO:tasks.workunit.client.0.smithi023.stdout:2/867: dwrite d5/da/d104/dd0/ffe [0,4194304] 0 2024-02-28T16:24:22.097 INFO:tasks.workunit.client.0.smithi023.stdout:3/892: write d1/d74/d46/de9/f10b [747760,75789] 0 2024-02-28T16:24:22.109 INFO:tasks.workunit.client.0.smithi023.stdout:9/799: write d0/d7/db/d18/d23/d28/d32/d3c/f83 [960149,81951] 0 2024-02-28T16:24:22.111 INFO:tasks.workunit.client.0.smithi023.stdout:1/839: dread df/d26/f35 [0,4194304] 0 2024-02-28T16:24:22.120 INFO:tasks.workunit.client.0.smithi023.stdout:7/810: rename de/d1c/f87 to de/d1c/d76/d7b/f107 0 2024-02-28T16:24:22.121 INFO:tasks.workunit.client.0.smithi023.stdout:1/840: dread df/d26/f35 [0,4194304] 0 2024-02-28T16:24:22.122 INFO:tasks.workunit.client.0.smithi023.stdout:7/811: fdatasync de/d13/d1b/d6c/db6/ffa 0 2024-02-28T16:24:22.122 INFO:tasks.workunit.client.0.smithi023.stdout:3/893: creat d1/d4a/d92/dff/d116/d114/f137 x:0 0 0 2024-02-28T16:24:22.126 INFO:tasks.workunit.client.0.smithi023.stdout:4/815: mknod d13/d2b/d2c/d31/d6e/de4/c102 0 2024-02-28T16:24:22.128 INFO:tasks.workunit.client.0.smithi023.stdout:9/800: mknod d0/d7/d2c/d7d/dd1/c10b 0 2024-02-28T16:24:22.130 INFO:tasks.workunit.client.0.smithi023.stdout:2/868: creat d5/da/db/d17/d3c/d7f/dc6/dd9/d10b/f113 x:0 0 0 2024-02-28T16:24:22.137 INFO:tasks.workunit.client.0.smithi023.stdout:0/839: dwrite d6/db/dab/d82/f4f [0,4194304] 0 2024-02-28T16:24:22.137 INFO:tasks.workunit.client.0.smithi023.stdout:1/841: rename df/d11/d13/d99/dfc/df9/f10a to df/d93/f11e 0 2024-02-28T16:24:22.141 INFO:tasks.workunit.client.0.smithi023.stdout:3/894: unlink d1/d74/d94/de4/d109/f70 0 2024-02-28T16:24:22.153 INFO:tasks.workunit.client.0.smithi023.stdout:2/869: dread d5/da/d104/dd0/ffe [0,4194304] 0 2024-02-28T16:24:22.155 INFO:tasks.workunit.client.0.smithi023.stdout:7/812: fsync de/d72/fc8 0 2024-02-28T16:24:22.163 INFO:tasks.workunit.client.0.smithi023.stdout:4/816: rename d13/d1e/c2a to d13/d2b/d2c/d31/dc4/d67/c103 0 2024-02-28T16:24:22.165 INFO:tasks.workunit.client.0.smithi023.stdout:0/840: dread d6/db/d1a/d35/fa7 [4194304,4194304] 0 2024-02-28T16:24:22.173 INFO:tasks.workunit.client.0.smithi023.stdout:9/801: dread d0/d7/db/d18/d23/d28/d6e/f7f [0,4194304] 0 2024-02-28T16:24:22.174 INFO:tasks.workunit.client.0.smithi023.stdout:1/842: dread df/d11/d13/d1b/d30/d57/d5a/d68/d7a/f117 [0,4194304] 0 2024-02-28T16:24:22.175 INFO:tasks.workunit.client.0.smithi023.stdout:8/893: sync 2024-02-28T16:24:22.179 INFO:tasks.workunit.client.0.smithi023.stdout:4/817: mkdir d13/d1d/d58/d104 0 2024-02-28T16:24:22.190 INFO:tasks.workunit.client.0.smithi023.stdout:1/843: mkdir df/d11/d13/d1b/d30/d11f 0 2024-02-28T16:24:22.195 INFO:tasks.workunit.client.0.smithi023.stdout:4/818: chown d13/d2b/d2c/d31/d8d/lb4 46312984 1 2024-02-28T16:24:22.199 INFO:tasks.workunit.client.0.smithi023.stdout:8/894: mknod d0/d5/d1a/d2d/d67/d11e/c124 0 2024-02-28T16:24:22.201 INFO:tasks.workunit.client.0.smithi023.stdout:2/870: link d5/da/db/d17/d3c/d7f/fd5 d5/da/db/d17/f114 0 2024-02-28T16:24:22.203 INFO:tasks.workunit.client.0.smithi023.stdout:6/926: sync 2024-02-28T16:24:22.205 INFO:tasks.workunit.client.0.smithi023.stdout:3/895: creat d1/d74/d94/de4/d110/d120/d3d/d57/f138 x:0 0 0 2024-02-28T16:24:22.208 INFO:tasks.workunit.client.0.smithi023.stdout:7/813: getdents de/d72 0 2024-02-28T16:24:22.211 INFO:tasks.workunit.client.0.smithi023.stdout:0/841: getdents d6/db/d1a/d35/d9d/dce 0 2024-02-28T16:24:22.212 INFO:tasks.workunit.client.0.smithi023.stdout:8/895: dread - d0/d5/d1a/d2d/d67/d71/db4/dd3/fd6 zero size 2024-02-28T16:24:22.215 INFO:tasks.workunit.client.0.smithi023.stdout:2/871: chown d5/da/db/d17/l44 10 1 2024-02-28T16:24:22.217 INFO:tasks.workunit.client.0.smithi023.stdout:6/927: write d1/d18/fa5 [3352266,28377] 0 2024-02-28T16:24:22.221 INFO:tasks.workunit.client.0.smithi023.stdout:9/802: getdents d0/d7/de/d2a/daf 0 2024-02-28T16:24:22.224 INFO:tasks.workunit.client.0.smithi023.stdout:9/803: chown d0/d7/db/d18/d23/d28/d32/d3c/f8e 5 1 2024-02-28T16:24:22.225 INFO:tasks.workunit.client.0.smithi023.stdout:8/896: symlink d0/d5/d1a/d2d/d67/d11e/l125 0 2024-02-28T16:24:22.228 INFO:tasks.workunit.client.0.smithi023.stdout:2/872: creat d5/da/d1b/d3f/d75/f115 x:0 0 0 2024-02-28T16:24:22.231 INFO:tasks.workunit.client.0.smithi023.stdout:2/873: chown d5/da/db/fbc 130525876 1 2024-02-28T16:24:22.232 INFO:tasks.workunit.client.0.smithi023.stdout:6/928: dread d1/d3d/fab [0,4194304] 0 2024-02-28T16:24:22.233 INFO:tasks.workunit.client.0.smithi023.stdout:7/814: dread de/d13/f2b [0,4194304] 0 2024-02-28T16:24:22.233 INFO:tasks.workunit.client.0.smithi023.stdout:2/874: write d5/da/d1b/f35 [1499217,99006] 0 2024-02-28T16:24:22.233 INFO:tasks.workunit.client.0.smithi023.stdout:9/804: stat d0/d7/de/d2a/daf/d2f/d44/d95/cbc 0 2024-02-28T16:24:22.240 INFO:tasks.workunit.client.0.smithi023.stdout:7/815: chown de/d60/c78 6 1 2024-02-28T16:24:22.242 INFO:tasks.workunit.client.0.smithi023.stdout:9/805: dread d0/d7/d2c/d7d/fed [0,4194304] 0 2024-02-28T16:24:22.246 INFO:tasks.workunit.client.0.smithi023.stdout:6/929: rename d1/d18/d26/c2d to d1/d28/d1e/c143 0 2024-02-28T16:24:22.248 INFO:tasks.workunit.client.0.smithi023.stdout:4/819: write d13/d1d/d85/fb1 [335891,101052] 0 2024-02-28T16:24:22.249 INFO:tasks.workunit.client.0.smithi023.stdout:9/806: dread d0/d7/db/d18/fc5 [0,4194304] 0 2024-02-28T16:24:22.250 INFO:tasks.workunit.client.0.smithi023.stdout:1/844: symlink df/d11/d13/d1b/d30/dae/l120 0 2024-02-28T16:24:22.251 INFO:tasks.workunit.client.0.smithi023.stdout:1/845: readlink df/d11/lfa 0 2024-02-28T16:24:22.262 INFO:tasks.workunit.client.0.smithi023.stdout:2/875: link d5/da/d104/fc4 d5/da/db/d17/d3c/d7f/dc6/dd9/d10b/f116 0 2024-02-28T16:24:22.262 INFO:tasks.workunit.client.0.smithi023.stdout:8/897: dread d0/d5/d1a/d2d/d67/d71/db4/fab [0,4194304] 0 2024-02-28T16:24:22.266 INFO:tasks.workunit.client.0.smithi023.stdout:8/898: truncate d0/d5/d35/fc7 955112 0 2024-02-28T16:24:22.268 INFO:tasks.workunit.client.0.smithi023.stdout:7/816: rename de/d8b/d95/d98/lb8 to de/d13/d1b/d3d/l108 0 2024-02-28T16:24:22.269 INFO:tasks.workunit.client.0.smithi023.stdout:4/820: creat d13/d2b/d2c/f105 x:0 0 0 2024-02-28T16:24:22.271 INFO:tasks.workunit.client.0.smithi023.stdout:9/807: creat d0/d7/db/d18/d23/d28/d32/f10c x:0 0 0 2024-02-28T16:24:22.272 INFO:tasks.workunit.client.0.smithi023.stdout:1/846: creat df/d11/d13/d1b/d30/f121 x:0 0 0 2024-02-28T16:24:22.277 INFO:tasks.workunit.client.0.smithi023.stdout:8/899: symlink d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/de7/l126 0 2024-02-28T16:24:22.279 INFO:tasks.workunit.client.0.smithi023.stdout:1/847: rename f2 to df/d11/d13/d118/f122 0 2024-02-28T16:24:22.281 INFO:tasks.workunit.client.0.smithi023.stdout:4/821: creat d13/d2b/d2c/d31/dc4/dc0/dfa/f106 x:0 0 0 2024-02-28T16:24:22.281 INFO:tasks.workunit.client.0.smithi023.stdout:8/900: stat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/ff4 0 2024-02-28T16:24:22.281 INFO:tasks.workunit.client.0.smithi023.stdout:1/848: chown df/dbd/f6e 63322 1 2024-02-28T16:24:22.283 INFO:tasks.workunit.client.0.smithi023.stdout:9/808: mknod d0/d7/db/c10d 0 2024-02-28T16:24:22.284 INFO:tasks.workunit.client.0.smithi023.stdout:7/817: mkdir de/d1c/d76/d109 0 2024-02-28T16:24:22.285 INFO:tasks.workunit.client.0.smithi023.stdout:9/809: chown d0/d7/de/d2a/daf/fa9 0 1 2024-02-28T16:24:22.289 INFO:tasks.workunit.client.0.smithi023.stdout:8/901: symlink d0/d5/d1b/d7f/l127 0 2024-02-28T16:24:22.290 INFO:tasks.workunit.client.0.smithi023.stdout:1/849: rmdir df/d11/d13/d99/dfc/df9 39 2024-02-28T16:24:22.292 INFO:tasks.workunit.client.0.smithi023.stdout:8/902: chown d0/d5/d1a/d2d/d67/d71/db4/d39/fdd 1024 1 2024-02-28T16:24:22.296 INFO:tasks.workunit.client.0.smithi023.stdout:9/810: mknod d0/d7/de/d2a/daf/d2f/db0/c10e 0 2024-02-28T16:24:22.300 INFO:tasks.workunit.client.0.smithi023.stdout:1/850: creat df/d11/d13/d1b/d30/de9/f123 x:0 0 0 2024-02-28T16:24:22.301 INFO:tasks.workunit.client.0.smithi023.stdout:4/822: dwrite d13/d2b/fab [0,4194304] 0 2024-02-28T16:24:22.302 INFO:tasks.workunit.client.0.smithi023.stdout:6/930: rename d1/d28/d1e/d80/dc2/d118 to d1/d28/d1e/dbc/d144 0 2024-02-28T16:24:22.303 INFO:tasks.workunit.client.0.smithi023.stdout:9/811: chown d0/d7/db/d18/d23/d28/d32/d8b/c8c 6 1 2024-02-28T16:24:22.305 INFO:tasks.workunit.client.0.smithi023.stdout:1/851: rmdir df/d11/d13/d27 39 2024-02-28T16:24:22.305 INFO:tasks.workunit.client.0.smithi023.stdout:6/931: readlink d1/d18/d26/l115 0 2024-02-28T16:24:22.308 INFO:tasks.workunit.client.0.smithi023.stdout:6/932: chown d1/c93 194540120 1 2024-02-28T16:24:22.309 INFO:tasks.workunit.client.0.smithi023.stdout:7/818: dwrite de/d13/d1b/d6c/db6/fe2 [0,4194304] 0 2024-02-28T16:24:22.314 INFO:tasks.workunit.client.0.smithi023.stdout:9/812: write d0/d7/de/d34/f3b [1367925,92349] 0 2024-02-28T16:24:22.317 INFO:tasks.workunit.client.0.smithi023.stdout:7/819: mkdir de/d72/d99/d10a 0 2024-02-28T16:24:22.318 INFO:tasks.workunit.client.0.smithi023.stdout:9/813: chown d0/d7/de/d2a/daf/d2f/d44 294681 1 2024-02-28T16:24:22.318 INFO:tasks.workunit.client.0.smithi023.stdout:1/852: mknod df/d11/d13/d1b/d30/d57/d5a/d68/d6f/c124 0 2024-02-28T16:24:22.320 INFO:tasks.workunit.client.0.smithi023.stdout:6/933: mknod d1/d28/d1e/d2b/d6d/d7b/c145 0 2024-02-28T16:24:22.323 INFO:tasks.workunit.client.0.smithi023.stdout:1/853: chown df/d11/d13/d1b/d30/d57/d5a/d68/d6f/l9f 0 1 2024-02-28T16:24:22.330 INFO:tasks.workunit.client.0.smithi023.stdout:6/934: chown d1/d28/d1e/d2b/d44/d86/d12c/l11e 12878619 1 2024-02-28T16:24:22.332 INFO:tasks.workunit.client.0.smithi023.stdout:1/854: mknod df/d11/d13/d99/dfc/c125 0 2024-02-28T16:24:22.350 INFO:tasks.workunit.client.0.smithi023.stdout:6/935: dwrite d1/d28/d1e/d52/f5b [0,4194304] 0 2024-02-28T16:24:22.350 INFO:tasks.workunit.client.0.smithi023.stdout:9/814: write d0/d7/db/d18/f56 [1187306,72487] 0 2024-02-28T16:24:22.351 INFO:tasks.workunit.client.0.smithi023.stdout:4/823: dwrite d13/d2b/d2c/d31/dc4/d67/f7d [0,4194304] 0 2024-02-28T16:24:22.355 INFO:tasks.workunit.client.0.smithi023.stdout:4/824: read fb [721215,9131] 0 2024-02-28T16:24:22.364 INFO:tasks.workunit.client.0.smithi023.stdout:7/820: dwrite de/d13/d1b/d40/faa [0,4194304] 0 2024-02-28T16:24:22.367 INFO:tasks.workunit.client.0.smithi023.stdout:1/855: dwrite df/d11/d13/d1b/d30/d57/d5a/f64 [4194304,4194304] 0 2024-02-28T16:24:22.370 INFO:tasks.workunit.client.0.smithi023.stdout:7/821: write de/d1c/d76/fe7 [5144528,104939] 0 2024-02-28T16:24:22.374 INFO:tasks.workunit.client.0.smithi023.stdout:1/856: chown df/d11/d13/d1b/d2e/c4d 420089 1 2024-02-28T16:24:22.376 INFO:tasks.workunit.client.0.smithi023.stdout:7/822: fsync de/d1c/d76/d7b/dad/fdd 0 2024-02-28T16:24:22.380 INFO:tasks.workunit.client.0.smithi023.stdout:6/936: dwrite d1/d28/d1e/d2b/d44/d101/f120 [0,4194304] 0 2024-02-28T16:24:22.383 INFO:tasks.workunit.client.0.smithi023.stdout:6/937: read d1/d28/d1e/d52/f5b [5134536,87265] 0 2024-02-28T16:24:22.479 INFO:tasks.workunit.client.0.smithi023.stdout:7/823: symlink de/d13/d1b/d40/l10b 0 2024-02-28T16:24:22.488 INFO:tasks.workunit.client.0.smithi023.stdout:9/815: dwrite d0/d7/db/d18/d23/d28/d9c/fb1 [0,4194304] 0 2024-02-28T16:24:22.489 INFO:tasks.workunit.client.0.smithi023.stdout:4/825: dwrite d13/d2b/d2c/f57 [0,4194304] 0 2024-02-28T16:24:22.491 INFO:tasks.workunit.client.0.smithi023.stdout:7/824: truncate de/d1c/d76/d7b/dab/fe5 959829 0 2024-02-28T16:24:22.492 INFO:tasks.workunit.client.0.smithi023.stdout:6/938: mkdir d1/d146 0 2024-02-28T16:24:22.497 INFO:tasks.workunit.client.0.smithi023.stdout:1/857: truncate df/dbd/f50 3515264 0 2024-02-28T16:24:22.499 INFO:tasks.workunit.client.0.smithi023.stdout:1/858: fsync df/f10d 0 2024-02-28T16:24:22.499 INFO:tasks.workunit.client.0.smithi023.stdout:6/939: chown d1/d18/l89 15 1 2024-02-28T16:24:22.507 INFO:tasks.workunit.client.0.smithi023.stdout:1/859: mknod df/d11/d13/d99/c126 0 2024-02-28T16:24:22.510 INFO:tasks.workunit.client.0.smithi023.stdout:9/816: creat d0/f10f x:0 0 0 2024-02-28T16:24:22.515 INFO:tasks.workunit.client.0.smithi023.stdout:4/826: creat d13/f107 x:0 0 0 2024-02-28T16:24:22.519 INFO:tasks.workunit.client.0.smithi023.stdout:7/825: dwrite de/d13/d1b/d40/faa [0,4194304] 0 2024-02-28T16:24:22.521 INFO:tasks.workunit.client.0.smithi023.stdout:7/826: stat de/d60/c84 0 2024-02-28T16:24:22.528 INFO:tasks.workunit.client.0.smithi023.stdout:6/940: write d1/d28/d1e/d2b/d44/d86/d12c/fd2 [284286,21033] 0 2024-02-28T16:24:22.529 INFO:tasks.workunit.client.0.smithi023.stdout:1/860: write df/dbd/f98 [1302196,96467] 0 2024-02-28T16:24:22.530 INFO:tasks.workunit.client.0.smithi023.stdout:9/817: creat d0/d7/db/d18/d23/d28/d32/f110 x:0 0 0 2024-02-28T16:24:22.532 INFO:tasks.workunit.client.0.smithi023.stdout:7/827: symlink de/d1c/ddb/l10c 0 2024-02-28T16:24:22.535 INFO:tasks.workunit.client.0.smithi023.stdout:1/861: write df/d93/f11e [493410,56771] 0 2024-02-28T16:24:22.537 INFO:tasks.workunit.client.0.smithi023.stdout:4/827: getdents d13/d1d/d2d 0 2024-02-28T16:24:22.537 INFO:tasks.workunit.client.0.smithi023.stdout:7/828: chown de/d13/d1b/c2a 3417498 1 2024-02-28T16:24:22.539 INFO:tasks.workunit.client.0.smithi023.stdout:1/862: chown df/d11/d13/d1b/d30/d57/d8d/ff6 0 1 2024-02-28T16:24:22.541 INFO:tasks.workunit.client.0.smithi023.stdout:4/828: dread - d13/d1d/dd0/f92 zero size 2024-02-28T16:24:22.541 INFO:tasks.workunit.client.0.smithi023.stdout:9/818: getdents d0/d7/d2c/d7d/dd1 0 2024-02-28T16:24:22.544 INFO:tasks.workunit.client.0.smithi023.stdout:4/829: chown d13/d2b/f5e 52 1 2024-02-28T16:24:22.546 INFO:tasks.workunit.client.0.smithi023.stdout:4/830: fdatasync d13/d1d/f33 0 2024-02-28T16:24:22.546 INFO:tasks.workunit.client.0.smithi023.stdout:7/829: creat de/f10d x:0 0 0 2024-02-28T16:24:22.548 INFO:tasks.workunit.client.0.smithi023.stdout:9/819: truncate d0/d7/db/d18/d23/d28/d32/f10c 382132 0 2024-02-28T16:24:22.554 INFO:tasks.workunit.client.0.smithi023.stdout:4/831: link d13/f17 d13/d2b/d2c/d31/d8d/db3/f108 0 2024-02-28T16:24:22.556 INFO:tasks.workunit.client.0.smithi023.stdout:9/820: creat d0/d7/db/d18/d23/d28/d32/d3c/f111 x:0 0 0 2024-02-28T16:24:22.560 INFO:tasks.workunit.client.0.smithi023.stdout:9/821: write d0/d7/db/d18/d23/d28/d32/f3f [1515249,69924] 0 2024-02-28T16:24:22.563 INFO:tasks.workunit.client.0.smithi023.stdout:4/832: dread d13/d1d/d2d/f36 [0,4194304] 0 2024-02-28T16:24:22.564 INFO:tasks.workunit.client.0.smithi023.stdout:9/822: rmdir d0/d7/db/d18/d23 39 2024-02-28T16:24:22.569 INFO:tasks.workunit.client.0.smithi023.stdout:4/833: mkdir d13/d2b/d109 0 2024-02-28T16:24:22.571 INFO:tasks.workunit.client.0.smithi023.stdout:1/863: dwrite df/d11/d13/d1b/d2e/d5c/f8f [0,4194304] 0 2024-02-28T16:24:22.573 INFO:tasks.workunit.client.0.smithi023.stdout:9/823: write d0/d7/db/d18/d23/d28/d6e/fb8 [2221076,122958] 0 2024-02-28T16:24:22.574 INFO:tasks.workunit.client.0.smithi023.stdout:9/824: chown d0/dd2/df4 56540892 1 2024-02-28T16:24:22.578 INFO:tasks.workunit.client.0.smithi023.stdout:1/864: unlink df/d26/c33 0 2024-02-28T16:24:22.580 INFO:tasks.workunit.client.0.smithi023.stdout:7/830: dread de/d1c/f68 [0,4194304] 0 2024-02-28T16:24:22.583 INFO:tasks.workunit.client.0.smithi023.stdout:1/865: mkdir df/dbd/d7b/d127 0 2024-02-28T16:24:22.589 INFO:tasks.workunit.client.0.smithi023.stdout:7/831: link de/fa6 de/d72/d99/d10a/f10e 0 2024-02-28T16:24:22.590 INFO:tasks.workunit.client.0.smithi023.stdout:4/834: dwrite d13/d1d/d2e/f52 [0,4194304] 0 2024-02-28T16:24:22.592 INFO:tasks.workunit.client.0.smithi023.stdout:4/835: chown d13/d1d/d2d/c44 2 1 2024-02-28T16:24:22.594 INFO:tasks.workunit.client.0.smithi023.stdout:7/832: dread de/d13/d1b/d6c/fd9 [0,4194304] 0 2024-02-28T16:24:22.594 INFO:tasks.workunit.client.0.smithi023.stdout:7/833: chown de/d72 10384419 1 2024-02-28T16:24:22.601 INFO:tasks.workunit.client.0.smithi023.stdout:9/825: dwrite d0/d7/db/fc [0,4194304] 0 2024-02-28T16:24:22.603 INFO:tasks.workunit.client.0.smithi023.stdout:7/834: symlink de/d9b/l10f 0 2024-02-28T16:24:22.605 INFO:tasks.workunit.client.0.smithi023.stdout:1/866: fsync df/d26/d48/f94 0 2024-02-28T16:24:22.607 INFO:tasks.workunit.client.0.smithi023.stdout:9/826: rmdir d0/d7/de/d2a 39 2024-02-28T16:24:22.608 INFO:tasks.workunit.client.0.smithi023.stdout:1/867: read df/dbd/f98 [621008,115312] 0 2024-02-28T16:24:22.612 INFO:tasks.workunit.client.0.smithi023.stdout:7/835: mkdir de/d72/d99/d10a/d110 0 2024-02-28T16:24:22.614 INFO:tasks.workunit.client.0.smithi023.stdout:4/836: write fe [1515588,37633] 0 2024-02-28T16:24:22.616 INFO:tasks.workunit.client.0.smithi023.stdout:4/837: readlink d13/d1d/d85/l73 0 2024-02-28T16:24:22.621 INFO:tasks.workunit.client.0.smithi023.stdout:4/838: mknod d13/d1e/c10a 0 2024-02-28T16:24:22.623 INFO:tasks.workunit.client.0.smithi023.stdout:7/836: mkdir de/d13/d1b/d40/d111 0 2024-02-28T16:24:22.625 INFO:tasks.workunit.client.0.smithi023.stdout:1/868: rename df/d11/d13/d1b/d30/le8 to df/d11/d13/d1b/d2e/d5c/l128 0 2024-02-28T16:24:22.625 INFO:tasks.workunit.client.0.smithi023.stdout:7/837: readlink de/d13/d1b/d40/l7d 0 2024-02-28T16:24:22.644 INFO:tasks.workunit.client.0.smithi023.stdout:7/838: dwrite de/d13/d1b/d3d/f7c [0,4194304] 0 2024-02-28T16:24:22.687 INFO:tasks.workunit.client.0.smithi023.stdout:0/842: sync 2024-02-28T16:24:22.687 INFO:tasks.workunit.client.0.smithi023.stdout:3/896: sync 2024-02-28T16:24:22.701 INFO:tasks.workunit.client.0.smithi023.stdout:9/827: creat d0/d7/de/d2a/f112 x:0 0 0 2024-02-28T16:24:22.705 INFO:tasks.workunit.client.0.smithi023.stdout:4/839: fdatasync d13/d1d/f25 0 2024-02-28T16:24:22.708 INFO:tasks.workunit.client.0.smithi023.stdout:7/839: creat de/d72/d99/d102/f112 x:0 0 0 2024-02-28T16:24:22.761 INFO:tasks.workunit.client.0.smithi023.stdout:8/903: sync 2024-02-28T16:24:22.761 INFO:tasks.workunit.client.0.smithi023.stdout:6/941: sync 2024-02-28T16:24:22.761 INFO:tasks.workunit.client.0.smithi023.stdout:2/876: sync 2024-02-28T16:24:22.764 INFO:tasks.workunit.client.0.smithi023.stdout:2/877: chown d5/da/d104/d9e/da0/def/fb0 107603 1 2024-02-28T16:24:22.765 INFO:tasks.workunit.client.0.smithi023.stdout:2/878: readlink d5/da/d1b/d3f/l58 0 2024-02-28T16:24:22.790 INFO:tasks.workunit.client.0.smithi023.stdout:0/843: dread - d6/db/d24/fd9 zero size 2024-02-28T16:24:22.795 INFO:tasks.workunit.client.0.smithi023.stdout:9/828: mkdir d0/d7/de/d2a/daf/d2f/db0/d113 0 2024-02-28T16:24:22.798 INFO:tasks.workunit.client.0.smithi023.stdout:1/869: mkdir df/d11/d13/d129 0 2024-02-28T16:24:22.807 INFO:tasks.workunit.client.0.smithi023.stdout:6/942: chown d1/d28/d1e/dae/fd3 258073347 1 2024-02-28T16:24:22.810 INFO:tasks.workunit.client.0.smithi023.stdout:6/943: chown d1/d28/d1e/dae/ce7 1 1 2024-02-28T16:24:22.811 INFO:tasks.workunit.client.0.smithi023.stdout:8/904: creat d0/d5/d1a/d2d/d67/d71/db4/d39/f128 x:0 0 0 2024-02-28T16:24:22.812 INFO:tasks.workunit.client.0.smithi023.stdout:2/879: dread - d5/da/d1b/d3f/f48 zero size 2024-02-28T16:24:22.814 INFO:tasks.workunit.client.0.smithi023.stdout:6/944: read d1/d28/d1e/d2b/d44/d86/d12c/f97 [523372,68295] 0 2024-02-28T16:24:22.818 INFO:tasks.workunit.client.0.smithi023.stdout:0/844: dread d6/db/d1a/d26/d31/da0/fb3 [0,4194304] 0 2024-02-28T16:24:22.827 INFO:tasks.workunit.client.0.smithi023.stdout:8/905: creat d0/d5/d1a/d63/d90/dac/df2/f129 x:0 0 0 2024-02-28T16:24:22.828 INFO:tasks.workunit.client.0.smithi023.stdout:6/945: mknod d1/d28/d1e/d2b/d76/c147 0 2024-02-28T16:24:22.834 INFO:tasks.workunit.client.0.smithi023.stdout:2/880: mkdir d5/da/db/d17/d3c/d117 0 2024-02-28T16:24:22.838 INFO:tasks.workunit.client.0.smithi023.stdout:2/881: chown d5/da/db/d17/d3c/l10c 111 1 2024-02-28T16:24:22.839 INFO:tasks.workunit.client.0.smithi023.stdout:8/906: mkdir d0/d5/d1a/d2d/d67/d71/db4/dfb/d12a 0 2024-02-28T16:24:22.845 INFO:tasks.workunit.client.0.smithi023.stdout:1/870: fdatasync df/d11/d13/d27/f5f 0 2024-02-28T16:24:22.851 INFO:tasks.workunit.client.0.smithi023.stdout:9/829: getdents d0/d7/db/d18/d23/d28/d9c/dc4 0 2024-02-28T16:24:22.852 INFO:tasks.workunit.client.0.smithi023.stdout:8/907: creat d0/d5/d1a/d63/d90/dac/f12b x:0 0 0 2024-02-28T16:24:22.852 INFO:tasks.workunit.client.0.smithi023.stdout:0/845: link d6/db/d1a/d26/d31/fcf d6/db/d5d/f128 0 2024-02-28T16:24:23.012 INFO:tasks.workunit.client.0.smithi023.stdout:7/840: write de/d9b/fa0 [904904,16285] 0 2024-02-28T16:24:23.018 INFO:tasks.workunit.client.0.smithi023.stdout:1/871: creat df/d11/d13/d99/dfc/dd6/f12a x:0 0 0 2024-02-28T16:24:23.019 INFO:tasks.workunit.client.0.smithi023.stdout:8/908: mknod d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/c12c 0 2024-02-28T16:24:23.021 INFO:tasks.workunit.client.0.smithi023.stdout:9/830: truncate d0/d7/db/d18/f1d 4487370 0 2024-02-28T16:24:23.023 INFO:tasks.workunit.client.0.smithi023.stdout:7/841: mknod de/d13/c113 0 2024-02-28T16:24:23.032 INFO:tasks.workunit.client.0.smithi023.stdout:4/840: dwrite d13/fb9 [0,4194304] 0 2024-02-28T16:24:23.034 INFO:tasks.workunit.client.0.smithi023.stdout:3/897: dwrite d1/d74/d94/de4/d110/d120/d2d/d45/f14 [0,4194304] 0 2024-02-28T16:24:23.041 INFO:tasks.workunit.client.0.smithi023.stdout:2/882: dwrite d5/da/d1b/d3f/d75/fb4 [0,4194304] 0 2024-02-28T16:24:23.043 INFO:tasks.workunit.client.0.smithi023.stdout:3/898: write d1/d4a/d92/dff/d116/d114/d123/f129 [1023620,62413] 0 2024-02-28T16:24:23.043 INFO:tasks.workunit.client.0.smithi023.stdout:0/846: dwrite d6/db/d1a/d26/d9c/f120 [0,4194304] 0 2024-02-28T16:24:23.045 INFO:tasks.workunit.client.0.smithi023.stdout:1/872: creat df/d11/d13/d1b/d30/d57/d8d/f12b x:0 0 0 2024-02-28T16:24:23.048 INFO:tasks.workunit.client.0.smithi023.stdout:0/847: read - d6/db/d1a/d26/fea zero size 2024-02-28T16:24:23.050 INFO:tasks.workunit.client.0.smithi023.stdout:4/841: rename d13/fb9 to d13/d2b/d2c/d31/de6/f10b 0 2024-02-28T16:24:23.052 INFO:tasks.workunit.client.0.smithi023.stdout:0/848: dread - d6/db/d1a/d35/d9d/dce/fd4 zero size 2024-02-28T16:24:23.060 INFO:tasks.workunit.client.0.smithi023.stdout:7/842: mkdir de/d72/d99/d10a/d110/d114 0 2024-02-28T16:24:23.063 INFO:tasks.workunit.client.0.smithi023.stdout:3/899: mknod d1/d4a/c139 0 2024-02-28T16:24:23.068 INFO:tasks.workunit.client.0.smithi023.stdout:1/873: creat df/d11/d13/d118/f12c x:0 0 0 2024-02-28T16:24:23.071 INFO:tasks.workunit.client.0.smithi023.stdout:1/874: read - df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f110 zero size 2024-02-28T16:24:23.072 INFO:tasks.workunit.client.0.smithi023.stdout:2/883: dread d5/ff [4194304,4194304] 0 2024-02-28T16:24:23.080 INFO:tasks.workunit.client.0.smithi023.stdout:7/843: dread de/d1c/d76/d7b/dab/fe5 [0,4194304] 0 2024-02-28T16:24:23.082 INFO:tasks.workunit.client.0.smithi023.stdout:7/844: fsync de/d1c/d76/ff1 0 2024-02-28T16:24:23.083 INFO:tasks.workunit.client.0.smithi023.stdout:4/842: mkdir d13/d2b/d2c/d31/dc4/d10c 0 2024-02-28T16:24:23.087 INFO:tasks.workunit.client.0.smithi023.stdout:4/843: write d13/d2b/d2c/f105 [908206,101550] 0 2024-02-28T16:24:23.091 INFO:tasks.workunit.client.0.smithi023.stdout:9/831: dread d0/d7/db/d18/f1d [4194304,4194304] 0 2024-02-28T16:24:23.094 INFO:tasks.workunit.client.0.smithi023.stdout:0/849: mkdir d6/db/d1a/d26/d31/d33/d37/d8f/ddf/df4/d129 0 2024-02-28T16:24:23.094 INFO:tasks.workunit.client.0.smithi023.stdout:9/832: write d0/f50 [1181313,88748] 0 2024-02-28T16:24:23.094 INFO:tasks.workunit.client.0.smithi023.stdout:3/900: dread d1/d4a/d92/dff/d116/df7/d9f/fc8 [0,4194304] 0 2024-02-28T16:24:23.097 INFO:tasks.workunit.client.0.smithi023.stdout:3/901: fsync d1/d74/d94/de4/d110/d120/d33/d38/f6a 0 2024-02-28T16:24:23.097 INFO:tasks.workunit.client.0.smithi023.stdout:7/845: mkdir de/d9b/d115 0 2024-02-28T16:24:23.103 INFO:tasks.workunit.client.0.smithi023.stdout:8/909: dwrite d0/d5/d1a/d63/d90/fae [0,4194304] 0 2024-02-28T16:24:23.116 INFO:tasks.workunit.client.0.smithi023.stdout:1/875: link df/d26/d48/d80/lba df/d26/d48/db3/l12d 0 2024-02-28T16:24:23.124 INFO:tasks.workunit.client.0.smithi023.stdout:8/910: symlink d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/ddb/l12d 0 2024-02-28T16:24:23.126 INFO:tasks.workunit.client.0.smithi023.stdout:0/850: symlink d6/db/l12a 0 2024-02-28T16:24:23.128 INFO:tasks.workunit.client.0.smithi023.stdout:3/902: dread d1/d74/d94/de4/d110/d120/d2d/d45/d52/d65/d89/faa [0,4194304] 0 2024-02-28T16:24:23.135 INFO:tasks.workunit.client.0.smithi023.stdout:1/876: dwrite df/d11/d13/d1b/d30/de9/f123 [0,4194304] 0 2024-02-28T16:24:23.146 INFO:tasks.workunit.client.0.smithi023.stdout:2/884: dwrite d5/da/d104/d9e/da0/fe3 [0,4194304] 0 2024-02-28T16:24:23.147 INFO:tasks.workunit.client.0.smithi023.stdout:0/851: dwrite d6/db/dab/d42/f83 [0,4194304] 0 2024-02-28T16:24:23.151 INFO:tasks.workunit.client.0.smithi023.stdout:3/903: symlink d1/d74/d46/l13a 0 2024-02-28T16:24:23.160 INFO:tasks.workunit.client.0.smithi023.stdout:0/852: chown d6/db/dab/d82/l6c 203 1 2024-02-28T16:24:23.167 INFO:tasks.workunit.client.0.smithi023.stdout:2/885: creat d5/da/db/d17/d3c/d7f/dc6/dd9/d10b/f118 x:0 0 0 2024-02-28T16:24:23.168 INFO:tasks.workunit.client.0.smithi023.stdout:3/904: mknod d1/d74/d94/de4/d110/d120/d33/d38/d6c/c13b 0 2024-02-28T16:24:23.171 INFO:tasks.workunit.client.0.smithi023.stdout:4/844: dwrite d13/d2b/d2c/d31/d6e/f97 [0,4194304] 0 2024-02-28T16:24:23.172 INFO:tasks.workunit.client.0.smithi023.stdout:1/877: rename df/d11/d13/d1b/d2e/f84 to df/d11/d13/d1b/d30/dae/dea/f12e 0 2024-02-28T16:24:23.173 INFO:tasks.workunit.client.0.smithi023.stdout:8/911: link d0/d5/d1a/d44/ff5 d0/f12e 0 2024-02-28T16:24:23.179 INFO:tasks.workunit.client.0.smithi023.stdout:0/853: creat d6/db/d1a/d26/d31/d33/d37/d8f/ddf/df4/f12b x:0 0 0 2024-02-28T16:24:23.179 INFO:tasks.workunit.client.0.smithi023.stdout:1/878: write df/d11/d13/d1b/d2e/d5c/f8f [2358205,112133] 0 2024-02-28T16:24:23.181 INFO:tasks.workunit.client.0.smithi023.stdout:2/886: truncate d5/da/db/d17/d3c/d7f/ff9 153992 0 2024-02-28T16:24:23.188 INFO:tasks.workunit.client.0.smithi023.stdout:8/912: read d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/ddb/fe3 [1893398,25553] 0 2024-02-28T16:24:23.192 INFO:tasks.workunit.client.0.smithi023.stdout:0/854: truncate d6/d4c/d6a/f88 225095 0 2024-02-28T16:24:23.193 INFO:tasks.workunit.client.0.smithi023.stdout:4/845: dread d13/d2b/d2c/d31/dc4/d67/f7d [0,4194304] 0 2024-02-28T16:24:23.197 INFO:tasks.workunit.client.0.smithi023.stdout:2/887: creat d5/da/db/d17/d3c/d7f/dc6/dd9/f119 x:0 0 0 2024-02-28T16:24:23.199 INFO:tasks.workunit.client.0.smithi023.stdout:7/846: dwrite de/d13/f4d [0,4194304] 0 2024-02-28T16:24:23.205 INFO:tasks.workunit.client.0.smithi023.stdout:1/879: dwrite df/d11/d13/d1b/f40 [0,4194304] 0 2024-02-28T16:24:23.207 INFO:tasks.workunit.client.0.smithi023.stdout:4/846: symlink d13/d1d/d58/ddb/l10d 0 2024-02-28T16:24:23.208 INFO:tasks.workunit.client.0.smithi023.stdout:3/905: link d1/d74/d94/de4/d110/d120/d2d/d45/c12 d1/d74/d94/de4/d110/d120/d33/d38/d4c/c13c 0 2024-02-28T16:24:23.218 INFO:tasks.workunit.client.0.smithi023.stdout:3/906: write d1/d74/d94/de4/d109/df9/f10a [108834,51181] 0 2024-02-28T16:24:23.232 INFO:tasks.workunit.client.0.smithi023.stdout:8/913: write d0/d5/d1b/d36/fd4 [608154,64219] 0 2024-02-28T16:24:23.239 INFO:tasks.workunit.client.0.smithi023.stdout:8/914: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/f12f x:0 0 0 2024-02-28T16:24:23.240 INFO:tasks.workunit.client.0.smithi023.stdout:3/907: dwrite d1/d74/d94/de4/d109/fe2 [0,4194304] 0 2024-02-28T16:24:23.242 INFO:tasks.workunit.client.0.smithi023.stdout:8/915: write d0/d5/d1a/d2d/d67/f7c [5109348,89520] 0 2024-02-28T16:24:23.249 INFO:tasks.workunit.client.0.smithi023.stdout:7/847: write de/d13/d1b/d6c/db6/fb9 [88891,20335] 0 2024-02-28T16:24:23.250 INFO:tasks.workunit.client.0.smithi023.stdout:1/880: truncate df/d11/d13/f2c 684440 0 2024-02-28T16:24:23.260 INFO:tasks.workunit.client.0.smithi023.stdout:7/848: mknod de/d1c/d76/d7b/c116 0 2024-02-28T16:24:23.262 INFO:tasks.workunit.client.0.smithi023.stdout:1/881: creat df/d11/d13/d129/f12f x:0 0 0 2024-02-28T16:24:23.266 INFO:tasks.workunit.client.0.smithi023.stdout:8/916: write d0/d5/d1a/d63/fcf [210618,24387] 0 2024-02-28T16:24:23.268 INFO:tasks.workunit.client.0.smithi023.stdout:3/908: dwrite d1/d74/d94/de4/d110/d120/d2d/d45/d78/f11c [0,4194304] 0 2024-02-28T16:24:23.270 INFO:tasks.workunit.client.0.smithi023.stdout:0/855: dwrite d6/d4c/d6a/f88 [0,4194304] 0 2024-02-28T16:24:23.273 INFO:tasks.workunit.client.0.smithi023.stdout:4/847: dread d13/d2b/d2c/f30 [0,4194304] 0 2024-02-28T16:24:23.278 INFO:tasks.workunit.client.0.smithi023.stdout:8/917: stat d0/d5/d1a/d2d/d67/d71/db4/dfb/d12a 0 2024-02-28T16:24:23.279 INFO:tasks.workunit.client.0.smithi023.stdout:3/909: chown d1/d74/d94/de4/d110/d120/d33/d38/d4c/f7e 11 1 2024-02-28T16:24:23.280 INFO:tasks.workunit.client.0.smithi023.stdout:0/856: fsync d6/db/d1a/d26/d31/d33/d37/d8f/ddf/df4/f12b 0 2024-02-28T16:24:23.282 INFO:tasks.workunit.client.0.smithi023.stdout:1/882: unlink df/d11/d13/d1b/d30/d57/d5a/d68/ddd/c111 0 2024-02-28T16:24:23.286 INFO:tasks.workunit.client.0.smithi023.stdout:8/918: write d0/d5/d1a/d63/d90/dac/df2/f129 [738177,36668] 0 2024-02-28T16:24:23.290 INFO:tasks.workunit.client.0.smithi023.stdout:0/857: unlink d6/db/d3b/f96 0 2024-02-28T16:24:23.292 INFO:tasks.workunit.client.0.smithi023.stdout:3/910: unlink d1/d74/d94/de4/d110/d120/f3e 0 2024-02-28T16:24:23.295 INFO:tasks.workunit.client.0.smithi023.stdout:7/849: dwrite de/fd0 [0,4194304] 0 2024-02-28T16:24:23.299 INFO:tasks.workunit.client.0.smithi023.stdout:0/858: fsync d6/db/f50 0 2024-02-28T16:24:23.309 INFO:tasks.workunit.client.0.smithi023.stdout:0/859: mkdir d6/db/d5d/d12c 0 2024-02-28T16:24:23.311 INFO:tasks.workunit.client.0.smithi023.stdout:4/848: dread d13/d1d/d2d/da9/fd9 [0,4194304] 0 2024-02-28T16:24:23.312 INFO:tasks.workunit.client.0.smithi023.stdout:8/919: link d0/d5/d1a/d2d/d67/d71/db4/l8a d0/d5/d1a/d63/d90/dac/dc3/l130 0 2024-02-28T16:24:23.315 INFO:tasks.workunit.client.0.smithi023.stdout:7/850: rename de/d1c/ddb/ff7 to de/d8b/d95/d98/dfb/f117 0 2024-02-28T16:24:23.317 INFO:tasks.workunit.client.0.smithi023.stdout:4/849: mknod d13/d1d/d85/c10e 0 2024-02-28T16:24:23.319 INFO:tasks.workunit.client.0.smithi023.stdout:1/883: dread df/fa0 [0,4194304] 0 2024-02-28T16:24:23.319 INFO:tasks.workunit.client.0.smithi023.stdout:7/851: truncate de/d9b/feb 683434 0 2024-02-28T16:24:23.322 INFO:tasks.workunit.client.0.smithi023.stdout:8/920: mknod d0/d5/d1a/d2d/c131 0 2024-02-28T16:24:23.328 INFO:tasks.workunit.client.0.smithi023.stdout:0/860: rename d6/d84 to d6/db/d1a/d26/d31/d33/d37/df6/d12d 0 2024-02-28T16:24:23.328 INFO:tasks.workunit.client.0.smithi023.stdout:4/850: chown d13/f3c 1 1 2024-02-28T16:24:23.329 INFO:tasks.workunit.client.0.smithi023.stdout:4/851: write d13/d2b/d2c/f105 [1096761,79363] 0 2024-02-28T16:24:23.329 INFO:tasks.workunit.client.0.smithi023.stdout:7/852: chown de/d1c/l21 495217 1 2024-02-28T16:24:23.331 INFO:tasks.workunit.client.0.smithi023.stdout:1/884: symlink df/d11/d8a/l130 0 2024-02-28T16:24:23.333 INFO:tasks.workunit.client.0.smithi023.stdout:8/921: unlink d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/ddb/lf8 0 2024-02-28T16:24:23.341 INFO:tasks.workunit.client.0.smithi023.stdout:3/911: dwrite d1/d74/d94/de4/d110/d120/d2d/d32/f76 [0,4194304] 0 2024-02-28T16:24:23.341 INFO:tasks.workunit.client.0.smithi023.stdout:7/853: unlink de/d13/d1b/d6c/fd7 0 2024-02-28T16:24:23.342 INFO:tasks.workunit.client.0.smithi023.stdout:7/854: readlink de/d9b/l10f 0 2024-02-28T16:24:23.343 INFO:tasks.workunit.client.0.smithi023.stdout:4/852: truncate d13/d1e/fa6 3208347 0 2024-02-28T16:24:23.346 INFO:tasks.workunit.client.0.smithi023.stdout:8/922: creat d0/d5/d1a/d63/d90/f132 x:0 0 0 2024-02-28T16:24:23.350 INFO:tasks.workunit.client.0.smithi023.stdout:1/885: dwrite df/d11/d13/d99/dde/de6/f100 [0,4194304] 0 2024-02-28T16:24:23.357 INFO:tasks.workunit.client.0.smithi023.stdout:0/861: write d6/db/d1a/d26/d31/d33/d37/fb2 [747326,120221] 0 2024-02-28T16:24:23.358 INFO:tasks.workunit.client.0.smithi023.stdout:3/912: truncate d1/d4a/d92/fbb 986888 0 2024-02-28T16:24:23.359 INFO:tasks.workunit.client.0.smithi023.stdout:7/855: truncate de/d1c/d76/d7b/dd3/fdc 111413 0 2024-02-28T16:24:23.363 INFO:tasks.workunit.client.0.smithi023.stdout:0/862: rmdir d6/db/d1a/d35/d86 39 2024-02-28T16:24:23.363 INFO:tasks.workunit.client.0.smithi023.stdout:6/946: sync 2024-02-28T16:24:23.365 INFO:tasks.workunit.client.0.smithi023.stdout:8/923: symlink d0/d5/d1a/d2d/d67/l133 0 2024-02-28T16:24:23.367 INFO:tasks.workunit.client.0.smithi023.stdout:7/856: read de/d60/f64 [3195385,13389] 0 2024-02-28T16:24:23.369 INFO:tasks.workunit.client.0.smithi023.stdout:3/913: symlink d1/d74/d94/de4/d109/df9/l13d 0 2024-02-28T16:24:23.373 INFO:tasks.workunit.client.0.smithi023.stdout:6/947: creat d1/d18/d26/d6a/f148 x:0 0 0 2024-02-28T16:24:23.375 INFO:tasks.workunit.client.0.smithi023.stdout:0/863: mknod d6/db/d1a/d35/c12e 0 2024-02-28T16:24:23.376 INFO:tasks.workunit.client.0.smithi023.stdout:3/914: chown d1/d74/d94/de4/d109/l4b 350 1 2024-02-28T16:24:23.380 INFO:tasks.workunit.client.0.smithi023.stdout:6/948: readlink d1/d18/d26/l12d 0 2024-02-28T16:24:23.382 INFO:tasks.workunit.client.0.smithi023.stdout:7/857: mkdir de/d13/d1b/d3d/d118 0 2024-02-28T16:24:23.383 INFO:tasks.workunit.client.0.smithi023.stdout:1/886: dwrite df/d11/d13/d1b/d30/d57/d5a/d68/f11d [0,4194304] 0 2024-02-28T16:24:23.386 INFO:tasks.workunit.client.0.smithi023.stdout:3/915: fsync d1/d74/de1/db5/fd2 0 2024-02-28T16:24:23.387 INFO:tasks.workunit.client.0.smithi023.stdout:8/924: rename d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/fc5 to d0/d5/d1b/d36/f134 0 2024-02-28T16:24:23.389 INFO:tasks.workunit.client.0.smithi023.stdout:7/858: readlink de/d13/d1b/d3f/lc6 0 2024-02-28T16:24:23.389 INFO:tasks.workunit.client.0.smithi023.stdout:1/887: write df/f16 [1011533,130142] 0 2024-02-28T16:24:23.396 INFO:tasks.workunit.client.0.smithi023.stdout:4/853: dwrite d13/fae [0,4194304] 0 2024-02-28T16:24:23.400 INFO:tasks.workunit.client.0.smithi023.stdout:8/925: write d0/d5/d1a/d63/d90/dac/f115 [603788,123240] 0 2024-02-28T16:24:23.400 INFO:tasks.workunit.client.0.smithi023.stdout:7/859: chown de/d1c/d76/d7b/f107 62589858 1 2024-02-28T16:24:23.403 INFO:tasks.workunit.client.0.smithi023.stdout:7/860: read - de/d1c/d76/fcc zero size 2024-02-28T16:24:23.403 INFO:tasks.workunit.client.0.smithi023.stdout:6/949: rename d1/d18/dd8/de8/ded/d11d/da9/c121 to d1/d3d/df7/d13d/c149 0 2024-02-28T16:24:23.406 INFO:tasks.workunit.client.0.smithi023.stdout:4/854: stat d13/d2b/d2c/d31/d8d/db3/fc3 0 2024-02-28T16:24:23.406 INFO:tasks.workunit.client.0.smithi023.stdout:7/861: dread - de/f10d zero size 2024-02-28T16:24:23.407 INFO:tasks.workunit.client.0.smithi023.stdout:6/950: readlink d1/d28/d1e/d2b/d6d/d7b/ldb 0 2024-02-28T16:24:23.407 INFO:tasks.workunit.client.0.smithi023.stdout:1/888: unlink df/d11/d13/d1b/d30/d57/d5a/d68/lb5 0 2024-02-28T16:24:23.411 INFO:tasks.workunit.client.0.smithi023.stdout:0/864: link d6/db/d5d/ld1 d6/db/d1a/d26/d31/d33/d37/l12f 0 2024-02-28T16:24:23.414 INFO:tasks.workunit.client.0.smithi023.stdout:7/862: creat de/d13/d1b/d3d/d53/f119 x:0 0 0 2024-02-28T16:24:23.414 INFO:tasks.workunit.client.0.smithi023.stdout:4/855: mkdir d13/d2b/d2c/d31/dc4/d10f 0 2024-02-28T16:24:23.420 INFO:tasks.workunit.client.0.smithi023.stdout:0/865: rename d6/db/l12a to d6/db/d5d/l130 0 2024-02-28T16:24:23.422 INFO:tasks.workunit.client.0.smithi023.stdout:7/863: mknod de/d72/d99/d102/c11a 0 2024-02-28T16:24:23.426 INFO:tasks.workunit.client.0.smithi023.stdout:7/864: readlink de/d13/d1b/d40/l10b 0 2024-02-28T16:24:23.428 INFO:tasks.workunit.client.0.smithi023.stdout:0/866: write d6/db/d1a/d26/d31/d33/d37/f110 [271868,85992] 0 2024-02-28T16:24:23.432 INFO:tasks.workunit.client.0.smithi023.stdout:1/889: dwrite df/d11/d13/d99/dfc/dd6/f12a [0,4194304] 0 2024-02-28T16:24:23.434 INFO:tasks.workunit.client.0.smithi023.stdout:3/916: dread d1/d74/d94/de4/d110/d120/d33/d38/f6a [0,4194304] 0 2024-02-28T16:24:23.435 INFO:tasks.workunit.client.0.smithi023.stdout:1/890: fdatasync df/d11/d8a/fa8 0 2024-02-28T16:24:23.443 INFO:tasks.workunit.client.0.smithi023.stdout:6/951: write d1/d28/f77 [566531,21922] 0 2024-02-28T16:24:23.447 INFO:tasks.workunit.client.0.smithi023.stdout:4/856: dwrite d13/d2b/d2c/d31/de6/f10b [0,4194304] 0 2024-02-28T16:24:23.451 INFO:tasks.workunit.client.0.smithi023.stdout:1/891: mknod df/d11/d13/d1b/d30/d57/d78/c131 0 2024-02-28T16:24:23.451 INFO:tasks.workunit.client.0.smithi023.stdout:4/857: fdatasync d13/d2b/d2c/d31/dc4/d55/f6c 0 2024-02-28T16:24:23.456 INFO:tasks.workunit.client.0.smithi023.stdout:6/952: creat d1/d18/dd8/de8/ded/f14a x:0 0 0 2024-02-28T16:24:23.458 INFO:tasks.workunit.client.0.smithi023.stdout:6/953: fsync d1/d18/d26/fa8 0 2024-02-28T16:24:23.464 INFO:tasks.workunit.client.0.smithi023.stdout:0/867: dwrite d6/fb0 [0,4194304] 0 2024-02-28T16:24:23.464 INFO:tasks.workunit.client.0.smithi023.stdout:0/868: stat d6/db/d1a/d26/d9c/fe0 0 2024-02-28T16:24:23.464 INFO:tasks.workunit.client.0.smithi023.stdout:1/892: mknod df/d11/d13/d1b/d30/de9/c132 0 2024-02-28T16:24:23.470 INFO:tasks.workunit.client.0.smithi023.stdout:7/865: link de/d13/c4b de/d13/d1b/c11b 0 2024-02-28T16:24:23.472 INFO:tasks.workunit.client.0.smithi023.stdout:3/917: dwrite d1/f4 [4194304,4194304] 0 2024-02-28T16:24:23.472 INFO:tasks.workunit.client.0.smithi023.stdout:1/893: chown df/d11/d13/d1b/d30/d57/d5a/l63 2598 1 2024-02-28T16:24:23.478 INFO:tasks.workunit.client.0.smithi023.stdout:0/869: symlink d6/db/d1a/d26/d31/d33/d37/l131 0 2024-02-28T16:24:23.478 INFO:tasks.workunit.client.0.smithi023.stdout:3/918: dread - d1/d74/d94/de4/d109/df9/f126 zero size 2024-02-28T16:24:23.481 INFO:tasks.workunit.client.0.smithi023.stdout:6/954: dwrite d1/d18/dd8/de8/ded/d11d/f130 [0,4194304] 0 2024-02-28T16:24:23.486 INFO:tasks.workunit.client.0.smithi023.stdout:6/955: chown d1/f100 737 1 2024-02-28T16:24:23.486 INFO:tasks.workunit.client.0.smithi023.stdout:1/894: rename df/d11/d13/d1b/d30/d57/d5a/faa to df/d11/d13/d99/dde/f133 0 2024-02-28T16:24:23.491 INFO:tasks.workunit.client.0.smithi023.stdout:3/919: unlink d1/d74/d94/de4/d110/d120/d33/d38/f48 0 2024-02-28T16:24:23.495 INFO:tasks.workunit.client.0.smithi023.stdout:6/956: mknod d1/d28/d1e/d2b/d44/da4/c14b 0 2024-02-28T16:24:23.495 INFO:tasks.workunit.client.0.smithi023.stdout:0/870: creat d6/db/d1a/d26/d31/d33/f132 x:0 0 0 2024-02-28T16:24:23.496 INFO:tasks.workunit.client.0.smithi023.stdout:0/871: stat d6/db/d1a/d1b 0 2024-02-28T16:24:23.497 INFO:tasks.workunit.client.0.smithi023.stdout:6/957: chown d1/d28/d1e/d2b/l7a 18309 1 2024-02-28T16:24:23.498 INFO:tasks.workunit.client.0.smithi023.stdout:7/866: dwrite de/d13/d1b/d6c/db6/fb9 [0,4194304] 0 2024-02-28T16:24:23.500 INFO:tasks.workunit.client.0.smithi023.stdout:6/958: dread - d1/d18/dd8/de8/ded/d11d/f133 zero size 2024-02-28T16:24:23.502 INFO:tasks.workunit.client.0.smithi023.stdout:6/959: stat d1/cf 0 2024-02-28T16:24:23.503 INFO:tasks.workunit.client.0.smithi023.stdout:3/920: mkdir d1/d74/d94/de4/d110/d120/d13e 0 2024-02-28T16:24:23.505 INFO:tasks.workunit.client.0.smithi023.stdout:3/921: stat d1/d74/d46 0 2024-02-28T16:24:23.505 INFO:tasks.workunit.client.0.smithi023.stdout:7/867: rename de/d9b/fa0 to de/d72/d99/d10a/d110/d114/f11c 0 2024-02-28T16:24:23.507 INFO:tasks.workunit.client.0.smithi023.stdout:4/858: write d13/d1d/f20 [4241706,47034] 0 2024-02-28T16:24:23.513 INFO:tasks.workunit.client.0.smithi023.stdout:6/960: creat d1/d28/d1e/d80/d109/d12e/f14c x:0 0 0 2024-02-28T16:24:23.515 INFO:tasks.workunit.client.0.smithi023.stdout:7/868: symlink de/d72/d99/l11d 0 2024-02-28T16:24:23.519 INFO:tasks.workunit.client.0.smithi023.stdout:2/888: sync 2024-02-28T16:24:23.519 INFO:tasks.workunit.client.0.smithi023.stdout:9/833: sync 2024-02-28T16:24:23.521 INFO:tasks.workunit.client.0.smithi023.stdout:3/922: symlink d1/d4a/d92/l13f 0 2024-02-28T16:24:23.523 INFO:tasks.workunit.client.0.smithi023.stdout:7/869: rmdir de/d1c/d76/d7b/dd3 39 2024-02-28T16:24:23.524 INFO:tasks.workunit.client.0.smithi023.stdout:6/961: write d1/d28/d1e/d2b/d44/d86/d12c/de0/fe6 [1859098,115049] 0 2024-02-28T16:24:23.525 INFO:tasks.workunit.client.0.smithi023.stdout:0/872: dread d6/db/dab/d42/f83 [0,4194304] 0 2024-02-28T16:24:23.526 INFO:tasks.workunit.client.0.smithi023.stdout:7/870: stat de/d13/d1b/d40/d111 0 2024-02-28T16:24:23.527 INFO:tasks.workunit.client.0.smithi023.stdout:6/962: dread - d1/d18/f11b zero size 2024-02-28T16:24:23.530 INFO:tasks.workunit.client.0.smithi023.stdout:2/889: mknod d5/da/d1b/d3f/c11a 0 2024-02-28T16:24:23.536 INFO:tasks.workunit.client.0.smithi023.stdout:2/890: write d5/da/f55 [5115286,81260] 0 2024-02-28T16:24:23.541 INFO:tasks.workunit.client.0.smithi023.stdout:7/871: unlink de/d13/d1b/d3d/d53/l69 0 2024-02-28T16:24:23.541 INFO:tasks.workunit.client.0.smithi023.stdout:1/895: dread df/d11/d13/d27/f53 [0,4194304] 0 2024-02-28T16:24:23.548 INFO:tasks.workunit.client.0.smithi023.stdout:4/859: dwrite d13/f107 [0,4194304] 0 2024-02-28T16:24:23.548 INFO:tasks.workunit.client.0.smithi023.stdout:6/963: creat d1/d3d/d7d/f14d x:0 0 0 2024-02-28T16:24:23.553 INFO:tasks.workunit.client.0.smithi023.stdout:7/872: truncate de/d13/d1b/d6c/db6/fb9 4649711 0 2024-02-28T16:24:23.554 INFO:tasks.workunit.client.0.smithi023.stdout:8/926: sync 2024-02-28T16:24:23.556 INFO:tasks.workunit.client.0.smithi023.stdout:9/834: dwrite d0/d7/db/d18/f22 [4194304,4194304] 0 2024-02-28T16:24:23.559 INFO:tasks.workunit.client.0.smithi023.stdout:7/873: write de/fd0 [2967069,82156] 0 2024-02-28T16:24:23.564 INFO:tasks.workunit.client.0.smithi023.stdout:6/964: truncate d1/d18/f8c 1227000 0 2024-02-28T16:24:23.567 INFO:tasks.workunit.client.0.smithi023.stdout:0/873: dwrite d6/db/d1a/f80 [0,4194304] 0 2024-02-28T16:24:23.570 INFO:tasks.workunit.client.0.smithi023.stdout:1/896: rename df/d11/d13/d99/c126 to df/d11/d13/d1b/d30/d57/d5a/c134 0 2024-02-28T16:24:23.571 INFO:tasks.workunit.client.0.smithi023.stdout:6/965: dread d1/d18/d26/fa8 [0,4194304] 0 2024-02-28T16:24:23.572 INFO:tasks.workunit.client.0.smithi023.stdout:2/891: link d5/da/d1b/d3f/f53 d5/da/db/d17/d3c/d7f/dc6/f11b 0 2024-02-28T16:24:23.575 INFO:tasks.workunit.client.0.smithi023.stdout:3/923: write d1/d74/de1/f103 [68442,85419] 0 2024-02-28T16:24:23.576 INFO:tasks.workunit.client.0.smithi023.stdout:7/874: chown de/d13/cb7 0 1 2024-02-28T16:24:23.577 INFO:tasks.workunit.client.0.smithi023.stdout:0/874: creat d6/db/d1a/d1b/d101/f133 x:0 0 0 2024-02-28T16:24:23.580 INFO:tasks.workunit.client.0.smithi023.stdout:6/966: fsync d1/d28/d1e/d80/d109/d12e/f14c 0 2024-02-28T16:24:23.581 INFO:tasks.workunit.client.0.smithi023.stdout:8/927: rename d0/d5/d1a/d2d/d67/d71/fb7 to d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/ddb/f135 0 2024-02-28T16:24:23.581 INFO:tasks.workunit.client.0.smithi023.stdout:3/924: chown d1/d74/d94/de4/d110/d120/fa1 198982228 1 2024-02-28T16:24:23.582 INFO:tasks.workunit.client.0.smithi023.stdout:9/835: symlink d0/d7/de/d34/dcc/l114 0 2024-02-28T16:24:23.585 INFO:tasks.workunit.client.0.smithi023.stdout:6/967: write d1/d28/f62 [1620314,65039] 0 2024-02-28T16:24:23.589 INFO:tasks.workunit.client.0.smithi023.stdout:2/892: unlink d5/da/db/d17/d3c/d7f/lea 0 2024-02-28T16:24:23.598 INFO:tasks.workunit.client.0.smithi023.stdout:4/860: write d13/d1e/fa6 [3327350,93615] 0 2024-02-28T16:24:23.610 INFO:tasks.workunit.client.0.smithi023.stdout:1/897: rmdir df/dbd/d7b/d127 0 2024-02-28T16:24:23.614 INFO:tasks.workunit.client.0.smithi023.stdout:3/925: fsync d1/d4a/d92/fbb 0 2024-02-28T16:24:23.615 INFO:tasks.workunit.client.0.smithi023.stdout:1/898: readlink df/d11/d13/d1b/d2e/d5c/l7c 0 2024-02-28T16:24:23.615 INFO:tasks.workunit.client.0.smithi023.stdout:6/968: dread d1/d3d/fea [0,4194304] 0 2024-02-28T16:24:23.615 INFO:tasks.workunit.client.0.smithi023.stdout:8/928: mkdir d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d136 0 2024-02-28T16:24:23.618 INFO:tasks.workunit.client.0.smithi023.stdout:6/969: stat d1/d18/l89 0 2024-02-28T16:24:23.623 INFO:tasks.workunit.client.0.smithi023.stdout:6/970: truncate d1/d18/d26/fa8 708027 0 2024-02-28T16:24:23.624 INFO:tasks.workunit.client.0.smithi023.stdout:2/893: symlink d5/de6/l11c 0 2024-02-28T16:24:23.624 INFO:tasks.workunit.client.0.smithi023.stdout:7/875: dwrite de/d13/d1b/d40/f44 [0,4194304] 0 2024-02-28T16:24:23.625 INFO:tasks.workunit.client.0.smithi023.stdout:4/861: mknod d13/d2b/d109/c110 0 2024-02-28T16:24:23.628 INFO:tasks.workunit.client.0.smithi023.stdout:7/876: chown de/d8b/d95 6 1 2024-02-28T16:24:23.628 INFO:tasks.workunit.client.0.smithi023.stdout:9/836: link d0/d7/db/d18/d23/d28/l2d d0/d7/de/d2a/daf/d2f/db0/l115 0 2024-02-28T16:24:23.632 INFO:tasks.workunit.client.0.smithi023.stdout:8/929: creat d0/d5/d1b/d36/dba/f137 x:0 0 0 2024-02-28T16:24:23.634 INFO:tasks.workunit.client.0.smithi023.stdout:6/971: mknod d1/d28/d1e/d2b/d6d/c14e 0 2024-02-28T16:24:23.636 INFO:tasks.workunit.client.0.smithi023.stdout:0/875: getdents d6/db/dab/d105 0 2024-02-28T16:24:23.636 INFO:tasks.workunit.client.0.smithi023.stdout:1/899: dread df/dbd/fc7 [0,4194304] 0 2024-02-28T16:24:23.641 INFO:tasks.workunit.client.0.smithi023.stdout:7/877: mkdir de/d13/d1b/d6c/d11e 0 2024-02-28T16:24:23.644 INFO:tasks.workunit.client.0.smithi023.stdout:2/894: truncate d5/da/d104/d9e/da0/def/fb0 1190332 0 2024-02-28T16:24:23.646 INFO:tasks.workunit.client.0.smithi023.stdout:1/900: write df/d11/d13/d1b/d30/d57/d8d/f12b [55719,48819] 0 2024-02-28T16:24:23.649 INFO:tasks.workunit.client.0.smithi023.stdout:6/972: mknod d1/d18/dd8/de8/c14f 0 2024-02-28T16:24:23.652 INFO:tasks.workunit.client.0.smithi023.stdout:8/930: truncate d0/d5/d1a/d2d/d67/d71/f9c 3910314 0 2024-02-28T16:24:23.653 INFO:tasks.workunit.client.0.smithi023.stdout:7/878: symlink de/d1c/d76/d109/l11f 0 2024-02-28T16:24:23.657 INFO:tasks.workunit.client.0.smithi023.stdout:7/879: mkdir de/d60/d120 0 2024-02-28T16:24:23.657 INFO:tasks.workunit.client.0.smithi023.stdout:3/926: dread d1/d4a/f93 [0,4194304] 0 2024-02-28T16:24:23.665 INFO:tasks.workunit.client.0.smithi023.stdout:9/837: write d0/d7/d2c/d7d/fb4 [2911197,63239] 0 2024-02-28T16:24:23.669 INFO:tasks.workunit.client.0.smithi023.stdout:8/931: creat d0/d5/ddc/de2/f138 x:0 0 0 2024-02-28T16:24:23.673 INFO:tasks.workunit.client.0.smithi023.stdout:1/901: dwrite df/d11/d13/d1b/d30/dae/fe5 [0,4194304] 0 2024-02-28T16:24:23.677 INFO:tasks.workunit.client.0.smithi023.stdout:9/838: symlink d0/d7/db/d18/d23/l116 0 2024-02-28T16:24:23.684 INFO:tasks.workunit.client.0.smithi023.stdout:7/880: dwrite de/d9b/feb [0,4194304] 0 2024-02-28T16:24:23.690 INFO:tasks.workunit.client.0.smithi023.stdout:8/932: rename d0/fc to d0/d5/f139 0 2024-02-28T16:24:23.692 INFO:tasks.workunit.client.0.smithi023.stdout:3/927: dread d1/d74/d94/de4/d110/d120/d2d/d45/d78/f79 [0,4194304] 0 2024-02-28T16:24:23.693 INFO:tasks.workunit.client.0.smithi023.stdout:0/876: truncate d6/db/d1a/d26/d31/d33/d37/fb2 699543 0 2024-02-28T16:24:23.704 INFO:tasks.workunit.client.0.smithi023.stdout:6/973: dwrite d1/d28/d1e/d2b/d44/d86/fef [0,4194304] 0 2024-02-28T16:24:23.732 INFO:tasks.workunit.client.0.smithi023.stdout:7/881: rmdir de/d8b 39 2024-02-28T16:24:23.733 INFO:tasks.workunit.client.0.smithi023.stdout:9/839: rename d0/l67 to d0/d7/db/d18/d23/d28/l117 0 2024-02-28T16:24:23.734 INFO:tasks.workunit.client.0.smithi023.stdout:8/933: mknod d0/d5/d1a/d63/c13a 0 2024-02-28T16:24:23.736 INFO:tasks.workunit.client.0.smithi023.stdout:9/840: dread - d0/d7/db/d18/d23/d28/d32/d3c/f111 zero size 2024-02-28T16:24:23.737 INFO:tasks.workunit.client.0.smithi023.stdout:0/877: mknod d6/db/dab/d82/d72/c134 0 2024-02-28T16:24:23.741 INFO:tasks.workunit.client.0.smithi023.stdout:7/882: chown de/d8b/d95/d98 757714595 1 2024-02-28T16:24:23.746 INFO:tasks.workunit.client.0.smithi023.stdout:1/902: creat df/d11/d13/d99/dfc/f135 x:0 0 0 2024-02-28T16:24:23.748 INFO:tasks.workunit.client.0.smithi023.stdout:9/841: mknod d0/d7/d2c/dbe/c118 0 2024-02-28T16:24:23.749 INFO:tasks.workunit.client.0.smithi023.stdout:1/903: stat df/d11/d13/d1b/d30/d57/d5a/d68/l77 0 2024-02-28T16:24:23.749 INFO:tasks.workunit.client.0.smithi023.stdout:9/842: chown d0/l2 1 1 2024-02-28T16:24:23.753 INFO:tasks.workunit.client.0.smithi023.stdout:6/974: link d1/d18/l89 d1/d28/d1e/d2b/d76/d9e/l150 0 2024-02-28T16:24:23.755 INFO:tasks.workunit.client.0.smithi023.stdout:3/928: link d1/d74/d94/de4/d109/c6e d1/d74/d94/de4/d110/d120/d2d/c140 0 2024-02-28T16:24:23.756 INFO:tasks.workunit.client.0.smithi023.stdout:7/883: dread de/d1c/d76/d7b/dab/fe5 [0,4194304] 0 2024-02-28T16:24:23.758 INFO:tasks.workunit.client.0.smithi023.stdout:1/904: unlink df/d11/d8a/fa8 0 2024-02-28T16:24:23.765 INFO:tasks.workunit.client.0.smithi023.stdout:0/878: getdents d6/db/dab 0 2024-02-28T16:24:23.768 INFO:tasks.workunit.client.0.smithi023.stdout:0/879: chown d6/db/d1a/d26/d31/d33/dbe 3 1 2024-02-28T16:24:23.774 INFO:tasks.workunit.client.0.smithi023.stdout:6/975: dwrite d1/d18/d26/fa8 [0,4194304] 0 2024-02-28T16:24:23.776 INFO:tasks.workunit.client.0.smithi023.stdout:8/934: dread d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/f48 [0,4194304] 0 2024-02-28T16:24:23.776 INFO:tasks.workunit.client.0.smithi023.stdout:6/976: stat d1/d28/d1e/d80/d109/d12e/f135 0 2024-02-28T16:24:23.779 INFO:tasks.workunit.client.0.smithi023.stdout:6/977: dread - d1/d18/dd8/de8/ded/f14a zero size 2024-02-28T16:24:23.780 INFO:tasks.workunit.client.0.smithi023.stdout:3/929: rename d1/d74/de1/ff1 to d1/d74/d94/de4/d110/d120/f141 0 2024-02-28T16:24:23.783 INFO:tasks.workunit.client.0.smithi023.stdout:8/935: write d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/ff4 [4495901,88362] 0 2024-02-28T16:24:23.790 INFO:tasks.workunit.client.0.smithi023.stdout:3/930: read d1/d74/d94/de4/d110/d120/d2d/d45/f1b [6790613,100943] 0 2024-02-28T16:24:23.790 INFO:tasks.workunit.client.0.smithi023.stdout:0/880: symlink d6/db/d1a/d26/d31/d33/d37/l135 0 2024-02-28T16:24:23.790 INFO:tasks.workunit.client.0.smithi023.stdout:1/905: getdents df/d26/d48/d72/dff 0 2024-02-28T16:24:23.791 INFO:tasks.workunit.client.0.smithi023.stdout:6/978: symlink d1/d28/d1e/dbc/dfb/l151 0 2024-02-28T16:24:23.791 INFO:tasks.workunit.client.0.smithi023.stdout:3/931: fdatasync d1/d74/d94/de4/d110/d120/d2d/d45/d52/f5b 0 2024-02-28T16:24:23.798 INFO:tasks.workunit.client.0.smithi023.stdout:3/932: dread d1/d4a/d92/dff/d116/df7/ff2 [0,4194304] 0 2024-02-28T16:24:23.800 INFO:tasks.workunit.client.0.smithi023.stdout:0/881: mkdir d6/db/d1a/d1b/d136 0 2024-02-28T16:24:23.802 INFO:tasks.workunit.client.0.smithi023.stdout:8/936: dwrite d0/d5/d1b/d7f/f91 [0,4194304] 0 2024-02-28T16:24:23.814 INFO:tasks.workunit.client.0.smithi023.stdout:6/979: dread d1/d18/f8c [0,4194304] 0 2024-02-28T16:24:23.816 INFO:tasks.workunit.client.0.smithi023.stdout:8/937: mkdir d0/d5/d1a/d63/d90/dda/d13b 0 2024-02-28T16:24:23.819 INFO:tasks.workunit.client.0.smithi023.stdout:6/980: write d1/d18/dd8/de8/ded/d11d/f130 [627339,58217] 0 2024-02-28T16:24:23.821 INFO:tasks.workunit.client.0.smithi023.stdout:1/906: getdents df/d11/d13/d1b/d30/de9 0 2024-02-28T16:24:23.823 INFO:tasks.workunit.client.0.smithi023.stdout:8/938: mknod d0/d5/d35/dbf/c13c 0 2024-02-28T16:24:23.824 INFO:tasks.workunit.client.0.smithi023.stdout:7/884: write de/d1c/f9c [785510,122768] 0 2024-02-28T16:24:23.828 INFO:tasks.workunit.client.0.smithi023.stdout:6/981: read d1/d28/d1e/d2b/d44/d101/f120 [3340790,54291] 0 2024-02-28T16:24:23.830 INFO:tasks.workunit.client.0.smithi023.stdout:1/907: chown df/d26/d48/db3/l12d 4278 1 2024-02-28T16:24:23.830 INFO:tasks.workunit.client.0.smithi023.stdout:6/982: readlink d1/d18/d26/l39 0 2024-02-28T16:24:23.837 INFO:tasks.workunit.client.0.smithi023.stdout:6/983: mkdir d1/d4f/d114/d152 0 2024-02-28T16:24:23.840 INFO:tasks.workunit.client.0.smithi023.stdout:1/908: chown df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f115 102028 1 2024-02-28T16:24:23.843 INFO:tasks.workunit.client.0.smithi023.stdout:6/984: mkdir d1/d28/d1e/d80/dc2/d153 0 2024-02-28T16:24:23.843 INFO:tasks.workunit.client.0.smithi023.stdout:8/939: dwrite d0/d5/d104/f122 [0,4194304] 0 2024-02-28T16:24:23.849 INFO:tasks.workunit.client.0.smithi023.stdout:8/940: readlink d0/d5/d1a/d2d/leb 0 2024-02-28T16:24:23.850 INFO:tasks.workunit.client.0.smithi023.stdout:0/882: dread d6/f10 [0,4194304] 0 2024-02-28T16:24:23.854 INFO:tasks.workunit.client.0.smithi023.stdout:0/883: write d6/fb0 [3062015,93596] 0 2024-02-28T16:24:23.858 INFO:tasks.workunit.client.0.smithi023.stdout:3/933: dwrite d1/d74/d94/de4/d110/d120/d33/d38/d4c/f50 [0,4194304] 0 2024-02-28T16:24:23.859 INFO:tasks.workunit.client.0.smithi023.stdout:0/884: chown d6/db/d1a/d26/d31/d33/d37/df6 48 1 2024-02-28T16:24:23.863 INFO:tasks.workunit.client.0.smithi023.stdout:1/909: dread df/d11/d13/d1b/d30/dae/fe5 [0,4194304] 0 2024-02-28T16:24:23.865 INFO:tasks.workunit.client.0.smithi023.stdout:0/885: write d6/db/d1a/d59/dcd/f117 [411271,89550] 0 2024-02-28T16:24:23.867 INFO:tasks.workunit.client.0.smithi023.stdout:8/941: write d0/d5/d1a/d63/fb5 [1388108,10791] 0 2024-02-28T16:24:23.869 INFO:tasks.workunit.client.0.smithi023.stdout:3/934: write d1/d4a/d92/f102 [3336345,40967] 0 2024-02-28T16:24:23.870 INFO:tasks.workunit.client.0.smithi023.stdout:0/886: dread - d6/db/dab/d82/fd6 zero size 2024-02-28T16:24:23.870 INFO:tasks.workunit.client.0.smithi023.stdout:3/935: stat c0 0 2024-02-28T16:24:23.871 INFO:tasks.workunit.client.0.smithi023.stdout:1/910: truncate df/d26/d48/db3/fb8 860711 0 2024-02-28T16:24:23.876 INFO:tasks.workunit.client.0.smithi023.stdout:0/887: dread - d6/db/d1a/d26/d31/d33/d37/df6/f124 zero size 2024-02-28T16:24:23.878 INFO:tasks.workunit.client.0.smithi023.stdout:1/911: symlink df/d11/d13/d1b/d30/d57/d5a/d68/ddd/l136 0 2024-02-28T16:24:23.880 INFO:tasks.workunit.client.0.smithi023.stdout:8/942: getdents d0/d5/d1b/d36/dba 0 2024-02-28T16:24:23.883 INFO:tasks.workunit.client.0.smithi023.stdout:0/888: mkdir d6/db/d1a/d26/d137 0 2024-02-28T16:24:23.884 INFO:tasks.workunit.client.0.smithi023.stdout:6/985: dread d1/d28/d1e/d2b/d44/d86/d12c/f4a [0,4194304] 0 2024-02-28T16:24:23.888 INFO:tasks.workunit.client.0.smithi023.stdout:3/936: link d1/d74/d94/de4/d110/d120/d3d/d119/f128 d1/d74/d94/de4/d110/d120/d2d/d45/d6f/f142 0 2024-02-28T16:24:23.890 INFO:tasks.workunit.client.0.smithi023.stdout:1/912: mknod df/dbd/d6c/dd3/c137 0 2024-02-28T16:24:23.894 INFO:tasks.workunit.client.0.smithi023.stdout:6/986: fdatasync d1/d18/d26/d6a/f98 0 2024-02-28T16:24:23.896 INFO:tasks.workunit.client.0.smithi023.stdout:1/913: creat df/d26/d48/db3/f138 x:0 0 0 2024-02-28T16:24:23.897 INFO:tasks.workunit.client.0.smithi023.stdout:6/987: chown d1/d3d/df7 132851717 1 2024-02-28T16:24:23.900 INFO:tasks.workunit.client.0.smithi023.stdout:8/943: mknod d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/dfa/c13d 0 2024-02-28T16:24:23.905 INFO:tasks.workunit.client.0.smithi023.stdout:8/944: rmdir d0/d5/d1a/d44 39 2024-02-28T16:24:23.905 INFO:tasks.workunit.client.0.smithi023.stdout:6/988: read d1/d18/d26/d6a/f98 [2285235,50213] 0 2024-02-28T16:24:23.906 INFO:tasks.workunit.client.0.smithi023.stdout:0/889: dwrite d6/db/d1a/d26/d31/d33/d37/df6/d12d/f8e [0,4194304] 0 2024-02-28T16:24:23.907 INFO:tasks.workunit.client.0.smithi023.stdout:6/989: readlink d1/d3d/d7d/l103 0 2024-02-28T16:24:23.908 INFO:tasks.workunit.client.0.smithi023.stdout:6/990: chown d1/d28/d1e 3 1 2024-02-28T16:24:23.910 INFO:tasks.workunit.client.0.smithi023.stdout:1/914: dread df/dbd/d6c/fed [0,4194304] 0 2024-02-28T16:24:23.913 INFO:tasks.workunit.client.0.smithi023.stdout:6/991: write d1/d18/dd8/de8/ded/d11d/f133 [56012,63132] 0 2024-02-28T16:24:23.914 INFO:tasks.workunit.client.0.smithi023.stdout:0/890: creat d6/db/d3b/d106/f138 x:0 0 0 2024-02-28T16:24:23.918 INFO:tasks.workunit.client.0.smithi023.stdout:1/915: fdatasync df/d11/d13/d1b/d30/d57/f85 0 2024-02-28T16:24:23.922 INFO:tasks.workunit.client.0.smithi023.stdout:0/891: mknod d6/db/d1a/d26/d137/c139 0 2024-02-28T16:24:23.924 INFO:tasks.workunit.client.0.smithi023.stdout:3/937: dwrite d1/d74/d94/de4/d110/d120/d2d/d45/f1b [4194304,4194304] 0 2024-02-28T16:24:23.930 INFO:tasks.workunit.client.0.smithi023.stdout:6/992: write d1/d28/d1e/d2b/d44/da4/fba [567735,21607] 0 2024-02-28T16:24:23.934 INFO:tasks.workunit.client.0.smithi023.stdout:8/945: dwrite d0/d5/d1a/d2d/d67/d71/fa0 [0,4194304] 0 2024-02-28T16:24:23.944 INFO:tasks.workunit.client.0.smithi023.stdout:3/938: rename d1/d74/d94/de4/d110/d120/d2d/f8c to d1/d74/d94/de4/d110/d120/d33/dfb/f143 0 2024-02-28T16:24:23.944 INFO:tasks.workunit.client.0.smithi023.stdout:6/993: symlink d1/d28/d1e/dbc/d144/d12f/l154 0 2024-02-28T16:24:23.955 INFO:tasks.workunit.client.0.smithi023.stdout:6/994: creat d1/d28/d1e/d2b/d44/f155 x:0 0 0 2024-02-28T16:24:23.961 INFO:tasks.workunit.client.0.smithi023.stdout:8/946: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/ff4 [4194304,4194304] 0 2024-02-28T16:24:23.963 INFO:tasks.workunit.client.0.smithi023.stdout:6/995: mknod d1/d28/d1e/d2b/d76/d9e/c156 0 2024-02-28T16:24:23.963 INFO:tasks.workunit.client.0.smithi023.stdout:0/892: dread d6/db/d1a/d26/d31/d33/d6e/f6f [0,4194304] 0 2024-02-28T16:24:23.970 INFO:tasks.workunit.client.0.smithi023.stdout:3/939: write d1/d74/d94/de4/d110/d120/d2d/d45/d78/fc7 [4832644,1970] 0 2024-02-28T16:24:23.971 INFO:tasks.workunit.client.0.smithi023.stdout:6/996: mknod d1/d28/d1e/d80/dc2/d153/c157 0 2024-02-28T16:24:23.974 INFO:tasks.workunit.client.0.smithi023.stdout:0/893: creat d6/db/dab/d82/da3/f13a x:0 0 0 2024-02-28T16:24:23.974 INFO:tasks.workunit.client.0.smithi023.stdout:8/947: read d0/d5/d1a/d63/fcf [172984,94186] 0 2024-02-28T16:24:23.977 INFO:tasks.workunit.client.0.smithi023.stdout:6/997: truncate d1/d18/d26/f58 2617388 0 2024-02-28T16:24:23.977 INFO:tasks.workunit.client.0.smithi023.stdout:1/916: dread df/d11/d13/d27/f11c [0,4194304] 0 2024-02-28T16:24:23.977 INFO:tasks.workunit.client.0.smithi023.stdout:3/940: symlink d1/d74/d46/l144 0 2024-02-28T16:24:23.981 INFO:tasks.workunit.client.0.smithi023.stdout:4/862: sync 2024-02-28T16:24:23.981 INFO:tasks.workunit.client.0.smithi023.stdout:2/895: sync 2024-02-28T16:24:23.982 INFO:tasks.workunit.client.0.smithi023.stdout:1/917: truncate df/d11/d13/d99/dfc/f135 48819 0 2024-02-28T16:24:23.983 INFO:tasks.workunit.client.0.smithi023.stdout:9/843: sync 2024-02-28T16:24:23.984 INFO:tasks.workunit.client.0.smithi023.stdout:8/948: creat d0/d5/d1a/d63/d90/dda/f13e x:0 0 0 2024-02-28T16:24:23.986 INFO:tasks.workunit.client.0.smithi023.stdout:6/998: creat d1/d28/d1e/d80/d13c/f158 x:0 0 0 2024-02-28T16:24:23.986 INFO:tasks.workunit.client.0.smithi023.stdout:4/863: fsync d13/d1d/d58/ddb/ffe 0 2024-02-28T16:24:23.989 INFO:tasks.workunit.client.0.smithi023.stdout:3/941: creat d1/f145 x:0 0 0 2024-02-28T16:24:23.991 INFO:tasks.workunit.client.0.smithi023.stdout:1/918: rmdir df/d11/d13/d1b/d30/d57/d8d 39 2024-02-28T16:24:23.992 INFO:tasks.workunit.client.0.smithi023.stdout:8/949: write d0/f18 [435515,89266] 0 2024-02-28T16:24:23.994 INFO:tasks.workunit.client.0.smithi023.stdout:4/864: fdatasync d13/d2b/d2c/d31/f48 0 2024-02-28T16:24:23.997 INFO:tasks.workunit.client.0.smithi023.stdout:3/942: symlink d1/d74/d94/l146 0 2024-02-28T16:24:23.997 INFO:tasks.workunit.client.0.smithi023.stdout:6/999: write d1/d28/d1e/d2b/d44/d101/f120 [3636591,6939] 0 2024-02-28T16:24:24.002 INFO:tasks.workunit.client.0.smithi023.stdout:9/844: truncate d0/d7/de/f8d 62478 0 2024-02-28T16:24:24.004 INFO:tasks.workunit.client.0.smithi023.stdout:0/894: dwrite d6/db/d1a/d26/d31/d33/d37/d8f/f122 [0,4194304] 0 2024-02-28T16:24:24.004 INFO:tasks.workunit.client.0.smithi023.stdout:8/950: truncate d0/d5/d1a/d2d/d67/d71/db4/fab 6993462 0 2024-02-28T16:24:24.006 INFO:tasks.workunit.client.0.smithi023.stdout:9/845: write d0/d7/ff3 [679603,73455] 0 2024-02-28T16:24:24.012 INFO:tasks.workunit.client.0.smithi023.stdout:9/846: write d0/d7/de/d2a/daf/fa9 [1460628,28370] 0 2024-02-28T16:24:24.017 INFO:tasks.workunit.client.0.smithi023.stdout:0/895: rmdir d6/db/d1a/d26/d31/da8 39 2024-02-28T16:24:24.022 INFO:tasks.workunit.client.0.smithi023.stdout:2/896: write d5/da/db/d17/d3c/f4c [1057865,30968] 0 2024-02-28T16:24:24.026 INFO:tasks.workunit.client.0.smithi023.stdout:3/943: getdents d1/d74/d94/de4/d109/df9 0 2024-02-28T16:24:24.030 INFO:tasks.workunit.client.0.smithi023.stdout:8/951: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/fa4 [0,4194304] 0 2024-02-28T16:24:24.031 INFO:tasks.workunit.client.0.smithi023.stdout:1/919: write df/fc3 [749820,104866] 0 2024-02-28T16:24:24.036 INFO:tasks.workunit.client.0.smithi023.stdout:3/944: chown d1/d74/d94/de4/d110/d120/d3d/f4f 2132838221 1 2024-02-28T16:24:24.036 INFO:tasks.workunit.client.0.smithi023.stdout:2/897: mknod d5/da/db/d17/c11d 0 2024-02-28T16:24:24.036 INFO:tasks.workunit.client.0.smithi023.stdout:4/865: write f5 [2692528,86301] 0 2024-02-28T16:24:24.043 INFO:tasks.workunit.client.0.smithi023.stdout:4/866: dread - d13/d2b/d2c/d31/d8d/db3/fed zero size 2024-02-28T16:24:24.049 INFO:tasks.workunit.client.0.smithi023.stdout:8/952: creat d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/ddb/f13f x:0 0 0 2024-02-28T16:24:24.049 INFO:tasks.workunit.client.0.smithi023.stdout:1/920: write df/d11/d13/d27/f53 [4083985,121987] 0 2024-02-28T16:24:24.051 INFO:tasks.workunit.client.0.smithi023.stdout:4/867: fdatasync d13/d2b/d2c/d31/dc4/d55/f6c 0 2024-02-28T16:24:24.053 INFO:tasks.workunit.client.0.smithi023.stdout:9/847: dwrite d0/d7/fc9 [0,4194304] 0 2024-02-28T16:24:24.054 INFO:tasks.workunit.client.0.smithi023.stdout:7/885: sync 2024-02-28T16:24:24.067 INFO:tasks.workunit.client.0.smithi023.stdout:0/896: dread d6/db/d1a/d26/d31/da0/fb3 [0,4194304] 0 2024-02-28T16:24:24.068 INFO:tasks.workunit.client.0.smithi023.stdout:9/848: creat d0/d7/d2c/f119 x:0 0 0 2024-02-28T16:24:24.070 INFO:tasks.workunit.client.0.smithi023.stdout:4/868: fsync d13/d2b/d2c/d31/d8d/db3/de5/feb 0 2024-02-28T16:24:24.071 INFO:tasks.workunit.client.0.smithi023.stdout:2/898: write d5/da/d1b/d3f/d75/f77 [505283,69333] 0 2024-02-28T16:24:24.072 INFO:tasks.workunit.client.0.smithi023.stdout:0/897: write d6/db/d1a/d26/f38 [4259122,107621] 0 2024-02-28T16:24:24.075 INFO:tasks.workunit.client.0.smithi023.stdout:3/945: rename d1/d74/d94/de4/d110/d120/d2d/d45/d52/f9a to d1/d4a/d92/f147 0 2024-02-28T16:24:24.075 INFO:tasks.workunit.client.0.smithi023.stdout:9/849: write d0/d7/db/d18/d23/d28/d32/f110 [845152,46226] 0 2024-02-28T16:24:24.077 INFO:tasks.workunit.client.0.smithi023.stdout:8/953: dwrite d0/d5/d1a/f4b [0,4194304] 0 2024-02-28T16:24:24.080 INFO:tasks.workunit.client.0.smithi023.stdout:7/886: symlink de/d13/d1b/d3d/d118/l121 0 2024-02-28T16:24:24.086 INFO:tasks.workunit.client.0.smithi023.stdout:2/899: truncate d5/da/f5b 3745216 0 2024-02-28T16:24:24.088 INFO:tasks.workunit.client.0.smithi023.stdout:2/900: read - d5/da/d1b/d3f/d75/f115 zero size 2024-02-28T16:24:24.089 INFO:tasks.workunit.client.0.smithi023.stdout:3/946: read d1/d74/de1/fce [3723464,24121] 0 2024-02-28T16:24:24.093 INFO:tasks.workunit.client.0.smithi023.stdout:8/954: creat d0/d5/d35/f140 x:0 0 0 2024-02-28T16:24:24.094 INFO:tasks.workunit.client.0.smithi023.stdout:9/850: dread - d0/d7/db/d18/d23/fc2 zero size 2024-02-28T16:24:24.096 INFO:tasks.workunit.client.0.smithi023.stdout:9/851: chown d0/d7/db/d18/d23/d28/d9c/fb1 78953 1 2024-02-28T16:24:24.097 INFO:tasks.workunit.client.0.smithi023.stdout:7/887: mknod de/d13/d1b/d40/c122 0 2024-02-28T16:24:24.097 INFO:tasks.workunit.client.0.smithi023.stdout:1/921: write df/d11/d13/d1b/d30/f4b [2103442,19101] 0 2024-02-28T16:24:24.098 INFO:tasks.workunit.client.0.smithi023.stdout:9/852: read d0/f1f [4627810,101257] 0 2024-02-28T16:24:24.099 INFO:tasks.workunit.client.0.smithi023.stdout:4/869: creat d13/d1d/d58/d104/f111 x:0 0 0 2024-02-28T16:24:24.101 INFO:tasks.workunit.client.0.smithi023.stdout:0/898: creat d6/db/d1a/d26/d31/d33/d6e/db1/d112/f13b x:0 0 0 2024-02-28T16:24:24.102 INFO:tasks.workunit.client.0.smithi023.stdout:4/870: write d13/d2b/d2c/d31/d8d/f99 [665894,128229] 0 2024-02-28T16:24:24.104 INFO:tasks.workunit.client.0.smithi023.stdout:3/947: rmdir d1/d74/d94/de4/d110/d120/d2d/d32 39 2024-02-28T16:24:24.107 INFO:tasks.workunit.client.0.smithi023.stdout:3/948: write d1/d74/d94/de4/d110/d120/d3d/ffd [1556250,10272] 0 2024-02-28T16:24:24.108 INFO:tasks.workunit.client.0.smithi023.stdout:7/888: creat de/d1c/d76/f123 x:0 0 0 2024-02-28T16:24:24.109 INFO:tasks.workunit.client.0.smithi023.stdout:1/922: stat df/d11/d13/d1b/d30/d57/d8d/ff6 0 2024-02-28T16:24:24.110 INFO:tasks.workunit.client.0.smithi023.stdout:9/853: fsync d0/d7/db/d18/d23/d28/d32/d3c/f51 0 2024-02-28T16:24:24.112 INFO:tasks.workunit.client.0.smithi023.stdout:1/923: chown df/dbd/d6c/dd3/c137 48013231 1 2024-02-28T16:24:24.115 INFO:tasks.workunit.client.0.smithi023.stdout:4/871: rename fe to d13/d2b/d2c/d31/d6e/f112 0 2024-02-28T16:24:24.120 INFO:tasks.workunit.client.0.smithi023.stdout:0/899: dread d6/db/d3d/f70 [0,4194304] 0 2024-02-28T16:24:24.123 INFO:tasks.workunit.client.0.smithi023.stdout:3/949: dread - d1/d4a/d92/f147 zero size 2024-02-28T16:24:24.125 INFO:tasks.workunit.client.0.smithi023.stdout:7/889: symlink de/d13/d1b/d3f/l124 0 2024-02-28T16:24:24.127 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:23 smithi023 ceph-mon[29137]: pgmap v43: 65 pgs: 65 active+clean; 1.7 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 100 MiB/s wr, 268 op/s 2024-02-28T16:24:24.131 INFO:tasks.workunit.client.0.smithi023.stdout:9/854: fsync d0/d7/db/d18/f22 0 2024-02-28T16:24:24.136 INFO:tasks.workunit.client.0.smithi023.stdout:1/924: chown df/d26/f5b 1 1 2024-02-28T16:24:24.139 INFO:tasks.workunit.client.0.smithi023.stdout:4/872: symlink d13/d2b/d2c/d31/dc4/d55/l113 0 2024-02-28T16:24:24.141 INFO:tasks.workunit.client.0.smithi023.stdout:8/955: dread d0/d5/d1a/f6d [0,4194304] 0 2024-02-28T16:24:24.141 INFO:tasks.workunit.client.0.smithi023.stdout:2/901: write d5/da/d104/fdd [360612,79824] 0 2024-02-28T16:24:24.145 INFO:tasks.workunit.client.0.smithi023.stdout:0/900: read d6/db/f71 [1984983,9919] 0 2024-02-28T16:24:24.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:23 smithi153 ceph-mon[35341]: pgmap v43: 65 pgs: 65 active+clean; 1.7 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 100 MiB/s wr, 268 op/s 2024-02-28T16:24:24.148 INFO:tasks.workunit.client.0.smithi023.stdout:3/950: chown d1/d74/d94/de4/d109/c6e 313169 1 2024-02-28T16:24:24.150 INFO:tasks.workunit.client.0.smithi023.stdout:9/855: creat d0/d7/db/d18/d23/f11a x:0 0 0 2024-02-28T16:24:24.151 INFO:tasks.workunit.client.0.smithi023.stdout:1/925: dread df/d11/d13/d27/f53 [0,4194304] 0 2024-02-28T16:24:24.152 INFO:tasks.workunit.client.0.smithi023.stdout:3/951: write d1/d74/d94/de4/d110/d120/d2d/d45/d78/fc7 [5643573,5802] 0 2024-02-28T16:24:24.157 INFO:tasks.workunit.client.0.smithi023.stdout:4/873: chown d13/l18 40175 1 2024-02-28T16:24:24.159 INFO:tasks.workunit.client.0.smithi023.stdout:7/890: fsync de/d1c/fd2 0 2024-02-28T16:24:24.161 INFO:tasks.workunit.client.0.smithi023.stdout:8/956: rename d0/d5/d1b/d36/fa3 to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/f141 0 2024-02-28T16:24:24.162 INFO:tasks.workunit.client.0.smithi023.stdout:7/891: chown de/d8b/d95/d98/le3 1037 1 2024-02-28T16:24:24.167 INFO:tasks.workunit.client.0.smithi023.stdout:1/926: fdatasync df/d26/d48/f94 0 2024-02-28T16:24:24.169 INFO:tasks.workunit.client.0.smithi023.stdout:3/952: dread d1/d74/d94/de4/d110/d120/f19 [4194304,4194304] 0 2024-02-28T16:24:24.173 INFO:tasks.workunit.client.0.smithi023.stdout:3/953: write d1/d74/d94/de4/d110/d120/d2d/d45/d78/fc7 [5592589,79549] 0 2024-02-28T16:24:24.177 INFO:tasks.workunit.client.0.smithi023.stdout:3/954: chown d1/d4a/d92/dff/d116/df7/f12a 5739764 1 2024-02-28T16:24:24.179 INFO:tasks.workunit.client.0.smithi023.stdout:4/874: mkdir d13/d2b/d2c/d31/d8d/d114 0 2024-02-28T16:24:24.180 INFO:tasks.workunit.client.0.smithi023.stdout:3/955: readlink d1/d74/d94/de4/d110/d120/d2d/da8/lbd 0 2024-02-28T16:24:24.182 INFO:tasks.workunit.client.0.smithi023.stdout:3/956: chown d1/d74/d94/de4/d109/f91 508291487 1 2024-02-28T16:24:24.183 INFO:tasks.workunit.client.0.smithi023.stdout:9/856: rename d0/d7/de/c10 to d0/d7/de/d34/dcc/c11b 0 2024-02-28T16:24:24.185 INFO:tasks.workunit.client.0.smithi023.stdout:1/927: mknod df/d11/c139 0 2024-02-28T16:24:24.190 INFO:tasks.workunit.client.0.smithi023.stdout:3/957: unlink d1/d74/d46/l13a 0 2024-02-28T16:24:24.191 INFO:tasks.workunit.client.0.smithi023.stdout:4/875: creat d13/d2b/d2c/d31/dc4/d10f/f115 x:0 0 0 2024-02-28T16:24:24.192 INFO:tasks.workunit.client.0.smithi023.stdout:3/958: chown d1/d74/d94/de4/d109/df9/f10a 3970917 1 2024-02-28T16:24:24.193 INFO:tasks.workunit.client.0.smithi023.stdout:7/892: rename de/d13/c4b to de/d72/d99/df5/c125 0 2024-02-28T16:24:24.198 INFO:tasks.workunit.client.0.smithi023.stdout:4/876: write d13/d2b/d2c/d31/d6e/f112 [3357973,60312] 0 2024-02-28T16:24:24.200 INFO:tasks.workunit.client.0.smithi023.stdout:8/957: rename d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/ddb/f13f to d0/d5/d35/dec/f142 0 2024-02-28T16:24:24.201 INFO:tasks.workunit.client.0.smithi023.stdout:8/958: chown d0/c4 161472046 1 2024-02-28T16:24:24.204 INFO:tasks.workunit.client.0.smithi023.stdout:7/893: unlink de/d13/d1b/d3f/f9a 0 2024-02-28T16:24:24.204 INFO:tasks.workunit.client.0.smithi023.stdout:8/959: stat d0/d5/d1a/d63/d90/dac 0 2024-02-28T16:24:24.208 INFO:tasks.workunit.client.0.smithi023.stdout:2/902: dwrite d5/da/d1b/fc8 [0,4194304] 0 2024-02-28T16:24:24.208 INFO:tasks.workunit.client.0.smithi023.stdout:3/959: dread d1/d74/d94/de4/d110/d120/d33/d38/f6a [0,4194304] 0 2024-02-28T16:24:24.208 INFO:tasks.workunit.client.0.smithi023.stdout:7/894: write de/d13/d1b/d40/f44 [477214,129256] 0 2024-02-28T16:24:24.213 INFO:tasks.workunit.client.0.smithi023.stdout:9/857: rename d0/d7/db/d18/d23/d28/d32/d8b/f9f to d0/d7/db/dec/df6/f11c 0 2024-02-28T16:24:24.213 INFO:tasks.workunit.client.0.smithi023.stdout:1/928: link df/d11/d13/d1b/d30/de9/ff1 df/d11/d13/d1b/d30/de9/f13a 0 2024-02-28T16:24:24.225 INFO:tasks.workunit.client.0.smithi023.stdout:1/929: rmdir df/d11/d13/d129 39 2024-02-28T16:24:24.226 INFO:tasks.workunit.client.0.smithi023.stdout:7/895: mknod de/c126 0 2024-02-28T16:24:24.228 INFO:tasks.workunit.client.0.smithi023.stdout:1/930: stat df/d11/d13 0 2024-02-28T16:24:24.229 INFO:tasks.workunit.client.0.smithi023.stdout:0/901: dwrite d6/db/dab/d82/ffd [0,4194304] 0 2024-02-28T16:24:24.231 INFO:tasks.workunit.client.0.smithi023.stdout:3/960: dwrite d1/d74/d46/de9/f10b [0,4194304] 0 2024-02-28T16:24:24.231 INFO:tasks.workunit.client.0.smithi023.stdout:7/896: readlink de/d13/d1b/d40/l7d 0 2024-02-28T16:24:24.242 INFO:tasks.workunit.client.0.smithi023.stdout:2/903: dwrite d5/da/db/d17/d39/d56/f63 [0,4194304] 0 2024-02-28T16:24:24.247 INFO:tasks.workunit.client.0.smithi023.stdout:1/931: mkdir df/d11/d13/d1b/d30/d57/d8d/d13b 0 2024-02-28T16:24:24.247 INFO:tasks.workunit.client.0.smithi023.stdout:3/961: creat d1/d74/d94/de4/d110/d120/d33/dc2/f148 x:0 0 0 2024-02-28T16:24:24.252 INFO:tasks.workunit.client.0.smithi023.stdout:1/932: write df/d11/d13/d1b/f40 [4787594,6029] 0 2024-02-28T16:24:24.260 INFO:tasks.workunit.client.0.smithi023.stdout:0/902: link d6/db/dab/d42/l5f d6/db/d5d/l13c 0 2024-02-28T16:24:24.261 INFO:tasks.workunit.client.0.smithi023.stdout:8/960: write d0/d5/d1b/f11a [632406,34736] 0 2024-02-28T16:24:24.261 INFO:tasks.workunit.client.0.smithi023.stdout:1/933: chown df/d11/d13/d1b/d30/dae/l120 345945915 1 2024-02-28T16:24:24.262 INFO:tasks.workunit.client.0.smithi023.stdout:2/904: rename d5/da/db/d17/d3c/d7f/dc6/dd9/lf2 to d5/da/d1b/d3f/d75/d8a/l11e 0 2024-02-28T16:24:24.267 INFO:tasks.workunit.client.0.smithi023.stdout:7/897: dwrite de/d60/f64 [0,4194304] 0 2024-02-28T16:24:24.276 INFO:tasks.workunit.client.0.smithi023.stdout:9/858: dwrite d0/d7/db/d18/d23/d28/d6e/f7f [0,4194304] 0 2024-02-28T16:24:24.279 INFO:tasks.workunit.client.0.smithi023.stdout:8/961: creat d0/d5/d1a/d63/d90/dda/d13b/f143 x:0 0 0 2024-02-28T16:24:24.288 INFO:tasks.workunit.client.0.smithi023.stdout:0/903: dwrite d6/db/d3b/d106/f138 [0,4194304] 0 2024-02-28T16:24:24.289 INFO:tasks.workunit.client.0.smithi023.stdout:8/962: creat d0/d5/d1a/d63/d90/dac/dc3/f144 x:0 0 0 2024-02-28T16:24:24.291 INFO:tasks.workunit.client.0.smithi023.stdout:3/962: dread d1/d74/d94/de4/d110/d120/d33/d38/f6a [0,4194304] 0 2024-02-28T16:24:24.293 INFO:tasks.workunit.client.0.smithi023.stdout:9/859: link d0/d7/de/d2a/daf/d2f/db0/dd9/f106 d0/d7/de/d34/dcc/f11d 0 2024-02-28T16:24:24.299 INFO:tasks.workunit.client.0.smithi023.stdout:0/904: unlink d6/db/d1a/d35/d86/ffe 0 2024-02-28T16:24:24.303 INFO:tasks.workunit.client.0.smithi023.stdout:3/963: creat d1/d74/de1/d9e/f149 x:0 0 0 2024-02-28T16:24:24.311 INFO:tasks.workunit.client.0.smithi023.stdout:0/905: rename d6/d4c/d6a/l99 to d6/db/d68/l13d 0 2024-02-28T16:24:24.311 INFO:tasks.workunit.client.0.smithi023.stdout:2/905: write d5/da/db/d17/f114 [257670,24543] 0 2024-02-28T16:24:24.313 INFO:tasks.workunit.client.0.smithi023.stdout:2/906: chown d5/da/l37 0 1 2024-02-28T16:24:24.316 INFO:tasks.workunit.client.0.smithi023.stdout:9/860: getdents d0/d7/db/d18/d23 0 2024-02-28T16:24:24.320 INFO:tasks.workunit.client.0.smithi023.stdout:0/906: creat d6/db/d1a/d35/d9d/dce/f13e x:0 0 0 2024-02-28T16:24:24.321 INFO:tasks.workunit.client.0.smithi023.stdout:2/907: dread - d5/da/d8c/ff8 zero size 2024-02-28T16:24:24.326 INFO:tasks.workunit.client.0.smithi023.stdout:0/907: stat d6/db/dab/d82/fd6 0 2024-02-28T16:24:24.328 INFO:tasks.workunit.client.0.smithi023.stdout:9/861: symlink d0/d7/db/d18/d23/d28/db6/l11e 0 2024-02-28T16:24:24.331 INFO:tasks.workunit.client.0.smithi023.stdout:2/908: fsync d5/da/d1b/d3f/f66 0 2024-02-28T16:24:24.331 INFO:tasks.workunit.client.0.smithi023.stdout:1/934: dwrite df/d11/d13/d1b/d30/dae/dea/f12e [0,4194304] 0 2024-02-28T16:24:24.334 INFO:tasks.workunit.client.0.smithi023.stdout:3/964: dwrite d1/d74/d94/de4/d110/d120/d33/d38/d4c/f50 [0,4194304] 0 2024-02-28T16:24:24.336 INFO:tasks.workunit.client.0.smithi023.stdout:0/908: chown d6/db/d1a/d26/d31/da0/fc8 56747 1 2024-02-28T16:24:24.337 INFO:tasks.workunit.client.0.smithi023.stdout:2/909: read d5/da/db/f49 [273489,12017] 0 2024-02-28T16:24:24.343 INFO:tasks.workunit.client.0.smithi023.stdout:8/963: dwrite d0/d5/d1a/d2d/d67/d71/db4/d39/dfd/fc2 [0,4194304] 0 2024-02-28T16:24:24.343 INFO:tasks.workunit.client.0.smithi023.stdout:1/935: mknod df/d11/d13/c13c 0 2024-02-28T16:24:24.344 INFO:tasks.workunit.client.0.smithi023.stdout:0/909: fsync d6/db/d5d/f93 0 2024-02-28T16:24:24.346 INFO:tasks.workunit.client.0.smithi023.stdout:3/965: unlink d1/d74/d94/de4/d110/d120/d3d/lf0 0 2024-02-28T16:24:24.349 INFO:tasks.workunit.client.0.smithi023.stdout:3/966: chown d1/d74/d94/de4/d109 397010 1 2024-02-28T16:24:24.349 INFO:tasks.workunit.client.0.smithi023.stdout:1/936: rmdir df/d11/d13/d1b/d30/d57/d5a/d68/ddd 39 2024-02-28T16:24:24.352 INFO:tasks.workunit.client.0.smithi023.stdout:8/964: unlink d0/d5/l65 0 2024-02-28T16:24:24.358 INFO:tasks.workunit.client.0.smithi023.stdout:0/910: mknod d6/db/d1a/d26/d31/d33/d37/d8f/ddf/df4/d129/c13f 0 2024-02-28T16:24:24.358 INFO:tasks.workunit.client.0.smithi023.stdout:3/967: creat d1/d74/d94/de4/d110/d120/d2d/d45/f14a x:0 0 0 2024-02-28T16:24:24.359 INFO:tasks.workunit.client.0.smithi023.stdout:8/965: dread - d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/d6e/f12f zero size 2024-02-28T16:24:24.361 INFO:tasks.workunit.client.0.smithi023.stdout:8/966: readlink d0/d5/l1d 0 2024-02-28T16:24:24.362 INFO:tasks.workunit.client.0.smithi023.stdout:2/910: write d5/da/d1b/d3f/d75/d92/fa9 [167950,8473] 0 2024-02-28T16:24:24.362 INFO:tasks.workunit.client.0.smithi023.stdout:1/937: write df/d11/d13/d1b/d2e/fc9 [2464851,79016] 0 2024-02-28T16:24:24.364 INFO:tasks.workunit.client.0.smithi023.stdout:0/911: mknod d6/db/d1a/d1b/d101/c140 0 2024-02-28T16:24:24.365 INFO:tasks.workunit.client.0.smithi023.stdout:9/862: dwrite d0/d7/de/d2a/f38 [0,4194304] 0 2024-02-28T16:24:24.369 INFO:tasks.workunit.client.0.smithi023.stdout:2/911: stat d5/da/d45/d6a/l8d 0 2024-02-28T16:24:24.370 INFO:tasks.workunit.client.0.smithi023.stdout:3/968: creat d1/d74/d94/de4/d110/d120/d2d/d45/d6f/f14b x:0 0 0 2024-02-28T16:24:24.377 INFO:tasks.workunit.client.0.smithi023.stdout:8/967: unlink d0/d5/d1a/d44/ff5 0 2024-02-28T16:24:24.383 INFO:tasks.workunit.client.0.smithi023.stdout:9/863: dread d0/d7/f5d [0,4194304] 0 2024-02-28T16:24:24.384 INFO:tasks.workunit.client.0.smithi023.stdout:2/912: fsync d5/da/d1b/f107 0 2024-02-28T16:24:24.385 INFO:tasks.workunit.client.0.smithi023.stdout:0/912: read d6/db/dab/d105/fbb [1006411,128899] 0 2024-02-28T16:24:24.389 INFO:tasks.workunit.client.0.smithi023.stdout:9/864: creat d0/d7/d2c/d7d/dd1/f11f x:0 0 0 2024-02-28T16:24:24.391 INFO:tasks.workunit.client.0.smithi023.stdout:2/913: creat d5/da/d45/f11f x:0 0 0 2024-02-28T16:24:24.396 INFO:tasks.workunit.client.0.smithi023.stdout:0/913: dread - d6/db/d1a/d26/d31/da0/fc8 zero size 2024-02-28T16:24:24.398 INFO:tasks.workunit.client.0.smithi023.stdout:1/938: dwrite df/d93/f11e [0,4194304] 0 2024-02-28T16:24:24.401 INFO:tasks.workunit.client.0.smithi023.stdout:8/968: dread d0/d5/d1a/f4b [0,4194304] 0 2024-02-28T16:24:24.407 INFO:tasks.workunit.client.0.smithi023.stdout:3/969: write d1/f2b [748938,2136] 0 2024-02-28T16:24:24.407 INFO:tasks.workunit.client.0.smithi023.stdout:8/969: chown d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/f120 9550 1 2024-02-28T16:24:24.411 INFO:tasks.workunit.client.0.smithi023.stdout:3/970: chown d1 377924915 1 2024-02-28T16:24:24.412 INFO:tasks.workunit.client.0.smithi023.stdout:9/865: dread d0/d7/db/d18/d23/fa8 [0,4194304] 0 2024-02-28T16:24:24.419 INFO:tasks.workunit.client.0.smithi023.stdout:1/939: dread df/d26/f3c [0,4194304] 0 2024-02-28T16:24:24.419 INFO:tasks.workunit.client.0.smithi023.stdout:9/866: creat d0/d7/de/d2a/daf/f120 x:0 0 0 2024-02-28T16:24:24.423 INFO:tasks.workunit.client.0.smithi023.stdout:0/914: dwrite d6/db/d1a/d1b/d101/f11b [0,4194304] 0 2024-02-28T16:24:24.432 INFO:tasks.workunit.client.0.smithi023.stdout:3/971: write d1/d74/d94/de4/d110/d120/d2d/d45/fa0 [212309,12607] 0 2024-02-28T16:24:24.434 INFO:tasks.workunit.client.0.smithi023.stdout:3/972: fsync d1/f2b 0 2024-02-28T16:24:24.437 INFO:tasks.workunit.client.0.smithi023.stdout:2/914: dwrite d5/da/d62/f82 [0,4194304] 0 2024-02-28T16:24:24.439 INFO:tasks.workunit.client.0.smithi023.stdout:3/973: write d1/d4a/d92/f102 [113581,52666] 0 2024-02-28T16:24:24.439 INFO:tasks.workunit.client.0.smithi023.stdout:1/940: creat df/d11/d13/d1b/d30/d57/d5a/d68/d7a/f13d x:0 0 0 2024-02-28T16:24:24.443 INFO:tasks.workunit.client.0.smithi023.stdout:0/915: mknod d6/db/d1a/d26/d31/d33/d6e/db1/c141 0 2024-02-28T16:24:24.443 INFO:tasks.workunit.client.0.smithi023.stdout:1/941: chown df/d11/d13/c13c 52568413 1 2024-02-28T16:24:24.449 INFO:tasks.workunit.client.0.smithi023.stdout:0/916: readlink d6/db/d24/l11e 0 2024-02-28T16:24:24.462 INFO:tasks.workunit.client.0.smithi023.stdout:9/867: dwrite d0/d7/db/d18/d23/d28/d6e/fb8 [0,4194304] 0 2024-02-28T16:24:24.462 INFO:tasks.workunit.client.0.smithi023.stdout:1/942: unlink df/d11/d13/l119 0 2024-02-28T16:24:24.462 INFO:tasks.workunit.client.0.smithi023.stdout:2/915: rename d5/da/d1b/d3f/d75/d8a/cc3 to d5/da/d1b/d3f/d75/d92/c120 0 2024-02-28T16:24:24.462 INFO:tasks.workunit.client.0.smithi023.stdout:8/970: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/f145 x:0 0 0 2024-02-28T16:24:24.462 INFO:tasks.workunit.client.0.smithi023.stdout:9/868: creat d0/d7/db/d18/d23/d28/d6e/f121 x:0 0 0 2024-02-28T16:24:24.462 INFO:tasks.workunit.client.0.smithi023.stdout:0/917: fsync d6/db/d1a/d26/d31/da8/f121 0 2024-02-28T16:24:24.473 INFO:tasks.workunit.client.0.smithi023.stdout:9/869: creat d0/d7/db/d18/d23/d28/db6/f122 x:0 0 0 2024-02-28T16:24:24.479 INFO:tasks.workunit.client.0.smithi023.stdout:0/918: getdents d6/db/d68 0 2024-02-28T16:24:24.484 INFO:tasks.workunit.client.0.smithi023.stdout:9/870: creat d0/d7/db/dec/f123 x:0 0 0 2024-02-28T16:24:24.490 INFO:tasks.workunit.client.0.smithi023.stdout:3/974: dwrite d1/d74/d94/de4/d110/d120/d33/d38/d4c/f122 [0,4194304] 0 2024-02-28T16:24:24.493 INFO:tasks.workunit.client.0.smithi023.stdout:8/971: dwrite d0/d5/d1a/d63/fb5 [0,4194304] 0 2024-02-28T16:24:24.501 INFO:tasks.workunit.client.0.smithi023.stdout:2/916: dwrite d5/da/db/d17/f2a [4194304,4194304] 0 2024-02-28T16:24:24.508 INFO:tasks.workunit.client.0.smithi023.stdout:8/972: chown d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d69/fbc 45991 1 2024-02-28T16:24:24.511 INFO:tasks.workunit.client.0.smithi023.stdout:9/871: dread d0/d7/db/d18/d23/d28/d32/d3c/f8e [0,4194304] 0 2024-02-28T16:24:24.511 INFO:tasks.workunit.client.0.smithi023.stdout:1/943: dwrite df/d11/d13/f2c [0,4194304] 0 2024-02-28T16:24:24.515 INFO:tasks.workunit.client.0.smithi023.stdout:2/917: creat d5/da/d1b/d3f/d75/d92/dbb/f121 x:0 0 0 2024-02-28T16:24:24.523 INFO:tasks.workunit.client.0.smithi023.stdout:9/872: chown d0/d7/de/d34/f35 27 1 2024-02-28T16:24:24.526 INFO:tasks.workunit.client.0.smithi023.stdout:3/975: dwrite d1/d4a/d92/f102 [0,4194304] 0 2024-02-28T16:24:24.529 INFO:tasks.workunit.client.0.smithi023.stdout:2/918: getdents d5/da/d1b/d3f/d75/d92 0 2024-02-28T16:24:24.529 INFO:tasks.workunit.client.0.smithi023.stdout:9/873: mkdir d0/d7/d2c/d84/d124 0 2024-02-28T16:24:24.531 INFO:tasks.workunit.client.0.smithi023.stdout:2/919: chown d5/da/d45/d6a/l87 27774 1 2024-02-28T16:24:24.536 INFO:tasks.workunit.client.0.smithi023.stdout:3/976: symlink d1/d4a/d92/dff/d116/d114/l14c 0 2024-02-28T16:24:24.541 INFO:tasks.workunit.client.0.smithi023.stdout:9/874: creat d0/d7/db/d18/d23/d28/d6e/f125 x:0 0 0 2024-02-28T16:24:24.545 INFO:tasks.workunit.client.0.smithi023.stdout:8/973: dwrite d0/d5/d1a/d63/d90/dac/df2/f129 [0,4194304] 0 2024-02-28T16:24:24.558 INFO:tasks.workunit.client.0.smithi023.stdout:0/919: dread d6/db/d1a/d59/f114 [0,4194304] 0 2024-02-28T16:24:24.561 INFO:tasks.workunit.client.0.smithi023.stdout:9/875: chown d0/d7/de/d2a/daf/d2f/d44/ldc 627584 1 2024-02-28T16:24:24.564 INFO:tasks.workunit.client.0.smithi023.stdout:3/977: dwrite d1/d4a/d92/dff/d116/df7/f12a [0,4194304] 0 2024-02-28T16:24:24.566 INFO:tasks.workunit.client.0.smithi023.stdout:8/974: rename d0/d5/d1a/d2d/d67/d71/db4/d39/ff0 to d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/f146 0 2024-02-28T16:24:24.576 INFO:tasks.workunit.client.0.smithi023.stdout:9/876: write d0/d7/de/f14 [60455,7687] 0 2024-02-28T16:24:24.579 INFO:tasks.workunit.client.0.smithi023.stdout:8/975: dread - d0/d5/d1a/d63/fc8 zero size 2024-02-28T16:24:24.579 INFO:tasks.workunit.client.0.smithi023.stdout:3/978: truncate d1/d74/d94/de4/d110/d120/f19 3251668 0 2024-02-28T16:24:24.583 INFO:tasks.workunit.client.0.smithi023.stdout:2/920: dwrite d5/da/f106 [0,4194304] 0 2024-02-28T16:24:24.586 INFO:tasks.workunit.client.0.smithi023.stdout:8/976: chown d0/d5/d1a/d2d/d67/d71/db4/dfb/f108 108262 1 2024-02-28T16:24:24.593 INFO:tasks.workunit.client.0.smithi023.stdout:2/921: write d5/da/db/d17/d3c/d7f/f108 [766655,49279] 0 2024-02-28T16:24:24.600 INFO:tasks.workunit.client.0.smithi023.stdout:8/977: mkdir d0/d147 0 2024-02-28T16:24:24.600 INFO:tasks.workunit.client.0.smithi023.stdout:0/920: dwrite d6/db/d1a/d35/d9d/f9e [0,4194304] 0 2024-02-28T16:24:24.603 INFO:tasks.workunit.client.0.smithi023.stdout:9/877: write d0/d7/de/d2a/daf/f7e [835370,126891] 0 2024-02-28T16:24:24.609 INFO:tasks.workunit.client.0.smithi023.stdout:3/979: dwrite d1/d4a/d92/dff/d116/d114/d123/f129 [0,4194304] 0 2024-02-28T16:24:24.615 INFO:tasks.workunit.client.0.smithi023.stdout:0/921: rename d6/db/d1a/d26/d31/d33/f132 to d6/db/d24/f142 0 2024-02-28T16:24:24.616 INFO:tasks.workunit.client.0.smithi023.stdout:9/878: creat d0/d7/de/d2a/daf/d2f/d44/d95/f126 x:0 0 0 2024-02-28T16:24:24.618 INFO:tasks.workunit.client.0.smithi023.stdout:2/922: link d5/da/d62/l89 d5/da/d67/l122 0 2024-02-28T16:24:24.621 INFO:tasks.workunit.client.0.smithi023.stdout:3/980: unlink d1/d74/d94/de4/d109/f131 0 2024-02-28T16:24:24.628 INFO:tasks.workunit.client.0.smithi023.stdout:2/923: creat d5/de6/f123 x:0 0 0 2024-02-28T16:24:24.631 INFO:tasks.workunit.client.0.smithi023.stdout:2/924: chown d5/da/d62/f69 121922951 1 2024-02-28T16:24:24.634 INFO:tasks.workunit.client.0.smithi023.stdout:2/925: dread - d5/da/db/d17/d3c/f111 zero size 2024-02-28T16:24:24.635 INFO:tasks.workunit.client.0.smithi023.stdout:0/922: getdents d6/db/d1a/d26/d31/d33/d6e/db1 0 2024-02-28T16:24:24.642 INFO:tasks.workunit.client.0.smithi023.stdout:2/926: rmdir d5/da/d104/d9e 39 2024-02-28T16:24:24.645 INFO:tasks.workunit.client.0.smithi023.stdout:2/927: rmdir d5/da/d1b/d3f/d75/d8a 39 2024-02-28T16:24:24.649 INFO:tasks.workunit.client.0.smithi023.stdout:9/879: write d0/d7/db/d18/f7c [1464765,77600] 0 2024-02-28T16:24:24.649 INFO:tasks.workunit.client.0.smithi023.stdout:8/978: dwrite d0/fb9 [0,4194304] 0 2024-02-28T16:24:24.652 INFO:tasks.workunit.client.0.smithi023.stdout:2/928: mknod d5/da/d104/dd0/d52/c124 0 2024-02-28T16:24:24.654 INFO:tasks.workunit.client.0.smithi023.stdout:3/981: write d1/d74/d94/de4/d110/d120/d2d/d45/f1b [1128170,58299] 0 2024-02-28T16:24:24.655 INFO:tasks.workunit.client.0.smithi023.stdout:9/880: dread - d0/d7/db/d18/d23/d28/d32/d3c/f111 zero size 2024-02-28T16:24:24.656 INFO:tasks.workunit.client.0.smithi023.stdout:9/881: fsync d0/f1f 0 2024-02-28T16:24:24.659 INFO:tasks.workunit.client.0.smithi023.stdout:9/882: write d0/d7/de/d34/f9e [92318,4571] 0 2024-02-28T16:24:24.662 INFO:tasks.workunit.client.0.smithi023.stdout:3/982: creat d1/d74/d94/de4/d110/d120/d33/d38/f14d x:0 0 0 2024-02-28T16:24:24.666 INFO:tasks.workunit.client.0.smithi023.stdout:9/883: symlink d0/d7/db/d18/d23/d28/db6/l127 0 2024-02-28T16:24:24.667 INFO:tasks.workunit.client.0.smithi023.stdout:2/929: getdents d5/da/db/d17/d39/d56 0 2024-02-28T16:24:24.667 INFO:tasks.workunit.client.0.smithi023.stdout:8/979: dread d0/f12e [0,4194304] 0 2024-02-28T16:24:24.670 INFO:tasks.workunit.client.0.smithi023.stdout:3/983: dread - d1/d74/d94/de4/d110/d120/d3d/f54 zero size 2024-02-28T16:24:24.672 INFO:tasks.workunit.client.0.smithi023.stdout:3/984: dread - d1/f145 zero size 2024-02-28T16:24:24.673 INFO:tasks.workunit.client.0.smithi023.stdout:8/980: creat d0/d5/d1a/d63/f148 x:0 0 0 2024-02-28T16:24:24.675 INFO:tasks.workunit.client.0.smithi023.stdout:8/981: stat d0/d5/d1b/l49 0 2024-02-28T16:24:24.679 INFO:tasks.workunit.client.0.smithi023.stdout:2/930: getdents d5/da/d1b 0 2024-02-28T16:24:24.683 INFO:tasks.workunit.client.0.smithi023.stdout:8/982: read - d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/f120 zero size 2024-02-28T16:24:24.685 INFO:tasks.workunit.client.0.smithi023.stdout:2/931: dread - d5/da/d1b/d3f/d75/fab zero size 2024-02-28T16:24:24.688 INFO:tasks.workunit.client.0.smithi023.stdout:9/884: link d0/d7/db/d18/d23/d28/d9c/dc4/lfc d0/d7/db/d18/d23/d28/d9c/dc4/l128 0 2024-02-28T16:24:24.694 INFO:tasks.workunit.client.0.smithi023.stdout:8/983: mkdir d0/d5/d1b/d149 0 2024-02-28T16:24:24.698 INFO:tasks.workunit.client.0.smithi023.stdout:8/984: chown d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d3e/d62/fca 510215906 1 2024-02-28T16:24:24.700 INFO:tasks.workunit.client.0.smithi023.stdout:3/985: dwrite d1/d74/d94/de4/d110/d120/d2d/d45/d78/f125 [0,4194304] 0 2024-02-28T16:24:24.710 INFO:tasks.workunit.client.0.smithi023.stdout:4/877: sync 2024-02-28T16:24:24.715 INFO:tasks.workunit.client.0.smithi023.stdout:9/885: dread d0/d7/de/d34/f35 [0,4194304] 0 2024-02-28T16:24:24.731 INFO:tasks.workunit.client.0.smithi023.stdout:3/986: symlink d1/d4a/d92/dff/d116/df7/l14e 0 2024-02-28T16:24:24.732 INFO:tasks.workunit.client.0.smithi023.stdout:4/878: symlink d13/d1d/d58/d104/l116 0 2024-02-28T16:24:24.733 INFO:tasks.workunit.client.0.smithi023.stdout:9/886: creat d0/d7/de/d2a/daf/d2f/d44/d95/deb/f129 x:0 0 0 2024-02-28T16:24:24.735 INFO:tasks.workunit.client.0.smithi023.stdout:9/887: rmdir d0 39 2024-02-28T16:24:24.744 INFO:tasks.workunit.client.0.smithi023.stdout:8/985: link d0/d5/d35/dbf/le9 d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d116/d11f/l14a 0 2024-02-28T16:24:24.748 INFO:tasks.workunit.client.0.smithi023.stdout:9/888: rename d0/d7/d2c/d7d/dd1 to d0/d7/de/d2a/daf/d2f/db0/d113/d12a 0 2024-02-28T16:24:24.751 INFO:tasks.workunit.client.0.smithi023.stdout:3/987: dwrite d1/d74/d94/de4/d109/df9/f10a [0,4194304] 0 2024-02-28T16:24:24.753 INFO:tasks.workunit.client.0.smithi023.stdout:3/988: chown d1/d4a/fae 1105603 1 2024-02-28T16:24:24.762 INFO:tasks.workunit.client.0.smithi023.stdout:3/989: mknod d1/d74/d94/de4/d110/d120/d3d/d57/c14f 0 2024-02-28T16:24:24.766 INFO:tasks.workunit.client.0.smithi023.stdout:3/990: creat d1/d74/d94/de4/d110/d120/d2d/d45/d6f/f150 x:0 0 0 2024-02-28T16:24:24.772 INFO:tasks.workunit.client.0.smithi023.stdout:3/991: dread d1/fdb [0,4194304] 0 2024-02-28T16:24:24.773 INFO:tasks.workunit.client.0.smithi023.stdout:8/986: dread d0/d5/d1b/d7f/fb3 [0,4194304] 0 2024-02-28T16:24:24.776 INFO:tasks.workunit.client.0.smithi023.stdout:3/992: dread - d1/d74/d94/de4/d110/d120/d2d/f112 zero size 2024-02-28T16:24:24.777 INFO:tasks.workunit.client.0.smithi023.stdout:8/987: dread d0/d5/d1a/d2d/d67/f10b [0,4194304] 0 2024-02-28T16:24:24.780 INFO:tasks.workunit.client.0.smithi023.stdout:4/879: truncate d13/d2b/d2c/d31/d6e/f7b 1924504 0 2024-02-28T16:24:24.782 INFO:tasks.workunit.client.0.smithi023.stdout:3/993: creat d1/d4a/d92/dff/f151 x:0 0 0 2024-02-28T16:24:24.785 INFO:tasks.workunit.client.0.smithi023.stdout:8/988: truncate d0/d5/d1a/d2d/d67/ff9 1153549 0 2024-02-28T16:24:24.787 INFO:tasks.workunit.client.0.smithi023.stdout:4/880: mkdir d13/d2b/d9d/d117 0 2024-02-28T16:24:24.787 INFO:tasks.workunit.client.0.smithi023.stdout:3/994: truncate d1/d74/d94/de4/d110/d120/d33/dc2/f133 722204 0 2024-02-28T16:24:24.788 INFO:tasks.workunit.client.0.smithi023.stdout:8/989: chown d0/d5/d1a/d63/d90/dac/df2/f129 62170129 1 2024-02-28T16:24:24.792 INFO:tasks.workunit.client.0.smithi023.stdout:4/881: fsync d13/d2b/d2c/d31/dce/fdc 0 2024-02-28T16:24:24.793 INFO:tasks.workunit.client.0.smithi023.stdout:3/995: creat d1/d74/d94/de4/d110/d120/d2d/d45/f152 x:0 0 0 2024-02-28T16:24:24.797 INFO:tasks.workunit.client.0.smithi023.stdout:4/882: mknod d13/d2b/d2c/c118 0 2024-02-28T16:24:24.804 INFO:tasks.workunit.client.0.smithi023.stdout:8/990: write d0/d5/d35/dbf/fe4 [1310742,21533] 0 2024-02-28T16:24:24.807 INFO:tasks.workunit.client.0.smithi023.stdout:3/996: dread d1/d74/d94/de4/fe6 [0,4194304] 0 2024-02-28T16:24:24.809 INFO:tasks.workunit.client.0.smithi023.stdout:3/997: chown d1/d4a/f124 14639 1 2024-02-28T16:24:24.812 INFO:tasks.workunit.client.0.smithi023.stdout:8/991: creat d0/d5/d1a/d2d/d67/d71/db4/d39/d3d/d116/f14b x:0 0 0 2024-02-28T16:24:24.814 INFO:tasks.workunit.client.0.smithi023.stdout:8/992: chown d0/d5/d1a/d2d/d67/d71/db4/dfb 118308919 1 2024-02-28T16:24:24.815 INFO:tasks.workunit.client.0.smithi023.stdout:4/883: dwrite f5 [0,4194304] 0 2024-02-28T16:24:24.818 INFO:tasks.workunit.client.0.smithi023.stdout:3/998: rename d1/d74/d94/de4/d110/d120/d33/d38/d6c/f87 to d1/d74/f153 0 2024-02-28T16:24:24.822 INFO:tasks.workunit.client.0.smithi023.stdout:4/884: mkdir d13/d1d/d58/ddb/d119 0 2024-02-28T16:24:24.826 INFO:tasks.workunit.client.0.smithi023.stdout:3/999: write d1/d74/d94/de4/d110/d120/d2d/d45/fa0 [400553,68547] 0 2024-02-28T16:24:24.838 INFO:tasks.workunit.client.0.smithi023.stdout:8/993: dwrite d0/d5/d1a/d63/fc8 [0,4194304] 0 2024-02-28T16:24:24.841 INFO:tasks.workunit.client.0.smithi023.stdout:8/994: dread - d0/d5/d1a/d63/d90/dda/f10f zero size 2024-02-28T16:24:24.847 INFO:tasks.workunit.client.0.smithi023.stdout:4/885: dread d13/d1d/d58/f5c [0,4194304] 0 2024-02-28T16:24:24.860 INFO:tasks.workunit.client.0.smithi023.stdout:8/995: dwrite d0/d5/d35/dbf/fe4 [0,4194304] 0 2024-02-28T16:24:24.870 INFO:tasks.workunit.client.0.smithi023.stdout:4/886: dwrite d13/d2b/d2c/d31/dc4/fd3 [0,4194304] 0 2024-02-28T16:24:24.870 INFO:tasks.workunit.client.0.smithi023.stdout:8/996: rename d0/d5/d1a/d63/c13a to d0/d5/d35/dec/c14c 0 2024-02-28T16:24:24.875 INFO:tasks.workunit.client.0.smithi023.stdout:4/887: chown d13/d1d/d2d/da9/cc6 236 1 2024-02-28T16:24:24.879 INFO:tasks.workunit.client.0.smithi023.stdout:4/888: mknod d13/d2b/d2c/d31/dc4/d55/c11a 0 2024-02-28T16:24:24.885 INFO:tasks.workunit.client.0.smithi023.stdout:7/898: sync 2024-02-28T16:24:24.885 INFO:tasks.workunit.client.0.smithi023.stdout:8/997: write d0/d5/d1a/d63/d90/dda/f10f [481920,16340] 0 2024-02-28T16:24:24.890 INFO:tasks.workunit.client.0.smithi023.stdout:8/998: creat d0/d5/d1b/d8d/f14d x:0 0 0 2024-02-28T16:24:24.891 INFO:tasks.workunit.client.0.smithi023.stdout:7/899: fdatasync de/d1c/fda 0 2024-02-28T16:24:24.901 INFO:tasks.workunit.client.0.smithi023.stdout:7/900: creat de/d13/d1b/d3d/d118/f127 x:0 0 0 2024-02-28T16:24:24.901 INFO:tasks.workunit.client.0.smithi023.stdout:8/999: getdents d0/d5/d1b/d149 0 2024-02-28T16:24:24.901 INFO:tasks.workunit.client.0.smithi023.stdout:4/889: dwrite d13/d2b/d9d/fd1 [0,4194304] 0 2024-02-28T16:24:24.904 INFO:tasks.workunit.client.0.smithi023.stdout:7/901: chown de/d8b/d95/cbc 176801 1 2024-02-28T16:24:24.907 INFO:tasks.workunit.client.0.smithi023.stdout:4/890: mkdir d13/d2b/d2c/d31/dc4/dc0/d11b 0 2024-02-28T16:24:24.913 INFO:tasks.workunit.client.0.smithi023.stdout:7/902: write de/d13/d1b/d40/f44 [3638664,123015] 0 2024-02-28T16:24:24.920 INFO:tasks.workunit.client.0.smithi023.stdout:7/903: truncate de/d13/d1b/d3d/faf 459980 0 2024-02-28T16:24:24.935 INFO:tasks.workunit.client.0.smithi023.stdout:7/904: dread de/d72/fc8 [0,4194304] 0 2024-02-28T16:24:24.940 INFO:tasks.workunit.client.0.smithi023.stdout:7/905: creat de/d1c/f128 x:0 0 0 2024-02-28T16:24:24.942 INFO:tasks.workunit.client.0.smithi023.stdout:7/906: symlink de/d13/d1b/d40/l129 0 2024-02-28T16:24:24.945 INFO:tasks.workunit.client.0.smithi023.stdout:7/907: mknod de/d1c/d76/d7b/dad/c12a 0 2024-02-28T16:24:24.948 INFO:tasks.workunit.client.0.smithi023.stdout:7/908: truncate de/d13/f8f 3901850 0 2024-02-28T16:24:24.974 INFO:tasks.workunit.client.0.smithi023.stdout:7/909: dwrite de/d1c/d76/f7f [4194304,4194304] 0 2024-02-28T16:24:24.977 INFO:tasks.workunit.client.0.smithi023.stdout:7/910: fdatasync de/d72/d99/d10a/d110/d114/f11c 0 2024-02-28T16:24:24.979 INFO:tasks.workunit.client.0.smithi023.stdout:7/911: dread - de/d13/d1b/d3d/fd5 zero size 2024-02-28T16:24:24.982 INFO:tasks.workunit.client.0.smithi023.stdout:7/912: symlink de/d13/d1b/d6c/l12b 0 2024-02-28T16:24:24.989 INFO:tasks.workunit.client.0.smithi023.stdout:7/913: dread de/d72/d99/d10a/d110/d114/f11c [0,4194304] 0 2024-02-28T16:24:24.992 INFO:tasks.workunit.client.0.smithi023.stdout:7/914: creat de/d1c/d76/d7b/dad/dc9/f12c x:0 0 0 2024-02-28T16:24:24.995 INFO:tasks.workunit.client.0.smithi023.stdout:7/915: unlink de/d13/d1b/d3d/d53/f119 0 2024-02-28T16:24:25.000 INFO:tasks.workunit.client.0.smithi023.stdout:7/916: rename de/d1c/d76/d7b/dd3 to de/d13/d1b/d3d/d118/d12d 0 2024-02-28T16:24:25.001 INFO:tasks.workunit.client.0.smithi023.stdout:7/917: fsync de/d1c/d76/fe7 0 2024-02-28T16:24:25.003 INFO:tasks.workunit.client.0.smithi023.stdout:7/918: readlink de/d13/l39 0 2024-02-28T16:24:25.006 INFO:tasks.workunit.client.0.smithi023.stdout:7/919: unlink de/d13/d1b/d40/ff8 0 2024-02-28T16:24:25.009 INFO:tasks.workunit.client.0.smithi023.stdout:7/920: creat de/d9b/d115/f12e x:0 0 0 2024-02-28T16:24:25.057 INFO:tasks.workunit.client.0.smithi023.stdout:1/944: sync 2024-02-28T16:24:25.057 INFO:tasks.workunit.client.0.smithi023.stdout:0/923: sync 2024-02-28T16:24:25.059 INFO:tasks.workunit.client.0.smithi023.stdout:1/945: stat df/d11/d13/d99/dfc/dd6 0 2024-02-28T16:24:25.064 INFO:tasks.workunit.client.0.smithi023.stdout:0/924: rename d6/db/d1a/d59 to d6/db/dab/d82/d72/d143 0 2024-02-28T16:24:25.121 INFO:tasks.workunit.client.0.smithi023.stdout:0/925: fdatasync d6/db/d1a/d35/d9d/f9e 0 2024-02-28T16:24:25.123 INFO:tasks.workunit.client.0.smithi023.stdout:1/946: truncate df/dbd/f6e 3927355 0 2024-02-28T16:24:25.128 INFO:tasks.workunit.client.0.smithi023.stdout:0/926: creat d6/db/d1a/d1b/d136/f144 x:0 0 0 2024-02-28T16:24:25.132 INFO:tasks.workunit.client.0.smithi023.stdout:0/927: rmdir d6/db/d1a/d26/d137 39 2024-02-28T16:24:25.138 INFO:tasks.workunit.client.0.smithi023.stdout:0/928: mknod d6/db/d1a/d26/d31/da8/d10a/c145 0 2024-02-28T16:24:25.142 INFO:tasks.workunit.client.0.smithi023.stdout:0/929: mkdir d6/db/d1a/d26/d9c/d146 0 2024-02-28T16:24:25.145 INFO:tasks.workunit.client.0.smithi023.stdout:0/930: write d6/db/d3b/d106/f138 [2528111,55175] 0 2024-02-28T16:24:25.149 INFO:tasks.workunit.client.0.smithi023.stdout:0/931: mknod d6/db/dab/c147 0 2024-02-28T16:24:25.150 INFO:tasks.workunit.client.0.smithi023.stdout:1/947: dwrite df/dbd/d6c/ffd [0,4194304] 0 2024-02-28T16:24:25.153 INFO:tasks.workunit.client.0.smithi023.stdout:0/932: fdatasync d6/db/d1a/d26/d31/d33/d37/df6/f108 0 2024-02-28T16:24:25.156 INFO:tasks.workunit.client.0.smithi023.stdout:1/948: creat df/d11/d13/d99/dfc/dd6/f13e x:0 0 0 2024-02-28T16:24:25.169 INFO:tasks.workunit.client.0.smithi023.stdout:1/949: dread df/d11/d13/f2c [0,4194304] 0 2024-02-28T16:24:25.173 INFO:tasks.workunit.client.0.smithi023.stdout:1/950: read - df/d11/d13/d129/f12f zero size 2024-02-28T16:24:25.179 INFO:tasks.workunit.client.0.smithi023.stdout:0/933: write d6/db/dab/d82/d72/d143/f114 [7695385,63590] 0 2024-02-28T16:24:25.184 INFO:tasks.workunit.client.0.smithi023.stdout:0/934: symlink d6/db/d1a/d26/d31/d33/d6e/db1/d112/l148 0 2024-02-28T16:24:25.188 INFO:tasks.workunit.client.0.smithi023.stdout:0/935: creat d6/db/d1a/f149 x:0 0 0 2024-02-28T16:24:25.193 INFO:tasks.workunit.client.0.smithi023.stdout:0/936: unlink d6/db/d5d/f128 0 2024-02-28T16:24:25.195 INFO:tasks.workunit.client.0.smithi023.stdout:1/951: dwrite df/d11/d13/d1b/d30/d57/d5a/d68/d6f/fd9 [0,4194304] 0 2024-02-28T16:24:25.196 INFO:tasks.workunit.client.0.smithi023.stdout:0/937: mknod d6/d4c/c14a 0 2024-02-28T16:24:25.201 INFO:tasks.workunit.client.0.smithi023.stdout:0/938: truncate d6/db/f50 2051790 0 2024-02-28T16:24:25.201 INFO:tasks.workunit.client.0.smithi023.stdout:9/889: sync 2024-02-28T16:24:25.201 INFO:tasks.workunit.client.0.smithi023.stdout:2/932: sync 2024-02-28T16:24:25.202 INFO:tasks.workunit.client.0.smithi023.stdout:4/891: sync 2024-02-28T16:24:25.207 INFO:tasks.workunit.client.0.smithi023.stdout:2/933: mknod d5/da/db/d17/d39/c125 0 2024-02-28T16:24:25.208 INFO:tasks.workunit.client.0.smithi023.stdout:9/890: mkdir d0/d7/de/d2a/daf/d2f/db0/d113/d12b 0 2024-02-28T16:24:25.225 INFO:tasks.workunit.client.0.smithi023.stdout:1/952: dread df/d11/d13/f15 [0,4194304] 0 2024-02-28T16:24:25.230 INFO:tasks.workunit.client.0.smithi023.stdout:9/891: dread d0/d7/db/d18/f7c [0,4194304] 0 2024-02-28T16:24:25.232 INFO:tasks.workunit.client.0.smithi023.stdout:9/892: dread - d0/d7/db/d18/d23/f11a zero size 2024-02-28T16:24:25.234 INFO:tasks.workunit.client.0.smithi023.stdout:9/893: chown d0/d7/de/d2a/daf/d2f 7 1 2024-02-28T16:24:25.237 INFO:tasks.workunit.client.0.smithi023.stdout:9/894: chown d0/d7/de/c13 2424 1 2024-02-28T16:24:25.240 INFO:tasks.workunit.client.0.smithi023.stdout:2/934: dread d5/da/db/d17/d3c/d7f/dc6/f11b [0,4194304] 0 2024-02-28T16:24:25.246 INFO:tasks.workunit.client.0.smithi023.stdout:2/935: getdents d5/da/d8c/dd3 0 2024-02-28T16:24:25.254 INFO:tasks.workunit.client.0.smithi023.stdout:2/936: rename d5/da/db/d17/d3c/le0 to d5/l126 0 2024-02-28T16:24:25.256 INFO:tasks.workunit.client.0.smithi023.stdout:2/937: fsync d5/da/d45/d6a/f112 0 2024-02-28T16:24:25.259 INFO:tasks.workunit.client.0.smithi023.stdout:2/938: chown d5/da/d104/d9e/da0/fa6 3171593 1 2024-02-28T16:24:25.262 INFO:tasks.workunit.client.0.smithi023.stdout:9/895: dread d0/d7/db/d18/d23/d28/d32/d8b/fce [0,4194304] 0 2024-02-28T16:24:25.264 INFO:tasks.workunit.client.0.smithi023.stdout:2/939: link d5/ff d5/da/db/db9/f127 0 2024-02-28T16:24:25.265 INFO:tasks.workunit.client.0.smithi023.stdout:9/896: mknod d0/d7/d2c/dbe/c12c 0 2024-02-28T16:24:25.266 INFO:tasks.workunit.client.0.smithi023.stdout:2/940: stat d5/da/db/d17/d3c/d7f/dc6/dd9/d10b/f113 0 2024-02-28T16:24:25.268 INFO:tasks.workunit.client.0.smithi023.stdout:2/941: chown d5/da/db/d17/d3c/d103/c10f 12230841 1 2024-02-28T16:24:25.271 INFO:tasks.workunit.client.0.smithi023.stdout:2/942: fdatasync d5/da/db/d17/d39/d56/fad 0 2024-02-28T16:24:25.276 INFO:tasks.workunit.client.0.smithi023.stdout:2/943: rmdir d5/da/db/d17/d3c/d7f/dc6/dd9/d10b 39 2024-02-28T16:24:25.281 INFO:tasks.workunit.client.0.smithi023.stdout:9/897: dwrite d0/d7/db/d18/d23/d28/d32/dca/f109 [0,4194304] 0 2024-02-28T16:24:25.288 INFO:tasks.workunit.client.0.smithi023.stdout:9/898: link d0/d7/db/d18/d23/d28/d32/d3c/f83 d0/d7/de/d34/f12d 0 2024-02-28T16:24:25.291 INFO:tasks.workunit.client.0.smithi023.stdout:9/899: creat d0/d7/db/d18/d23/f12e x:0 0 0 2024-02-28T16:24:25.294 INFO:tasks.workunit.client.0.smithi023.stdout:2/944: dwrite d5/da/d1b/f9b [0,4194304] 0 2024-02-28T16:24:25.295 INFO:tasks.workunit.client.0.smithi023.stdout:9/900: write d0/d7/db/d18/d23/d28/d32/d3c/f111 [293997,53674] 0 2024-02-28T16:24:25.298 INFO:tasks.workunit.client.0.smithi023.stdout:9/901: chown d0/d7/db/d18/f7c 52371 1 2024-02-28T16:24:25.316 INFO:tasks.workunit.client.0.smithi023.stdout:9/902: write d0/d7/f5d [1493870,57036] 0 2024-02-28T16:24:25.325 INFO:tasks.workunit.client.0.smithi023.stdout:2/945: dread d5/f98 [0,4194304] 0 2024-02-28T16:24:25.327 INFO:tasks.workunit.client.0.smithi023.stdout:2/946: fsync d5/da/d1b/f36 0 2024-02-28T16:24:25.330 INFO:tasks.workunit.client.0.smithi023.stdout:2/947: fdatasync d5/da/db/f71 0 2024-02-28T16:24:25.332 INFO:tasks.workunit.client.0.smithi023.stdout:9/903: dwrite d0/d7/db/d18/f22 [0,4194304] 0 2024-02-28T16:24:25.333 INFO:tasks.workunit.client.0.smithi023.stdout:2/948: mknod d5/da/d45/c128 0 2024-02-28T16:24:25.377 INFO:tasks.workunit.client.0.smithi023.stdout:7/921: sync 2024-02-28T16:24:25.388 INFO:tasks.workunit.client.0.smithi023.stdout:9/904: chown d0/d7/d2c/f97 1275871 1 2024-02-28T16:24:25.390 INFO:tasks.workunit.client.0.smithi023.stdout:2/949: read d5/da/db/f51 [110886,99322] 0 2024-02-28T16:24:25.396 INFO:tasks.workunit.client.0.smithi023.stdout:2/950: fdatasync d5/da/db/d17/d3c/d7f/dc6/dd9/fdb 0 2024-02-28T16:24:25.396 INFO:tasks.workunit.client.0.smithi023.stdout:7/922: link de/d72/d99/fc5 de/d1c/ddb/f12f 0 2024-02-28T16:24:25.398 INFO:tasks.workunit.client.0.smithi023.stdout:2/951: readlink d5/dbe/ld8 0 2024-02-28T16:24:25.400 INFO:tasks.workunit.client.0.smithi023.stdout:7/923: rmdir de/d72/d99/d102 39 2024-02-28T16:24:25.403 INFO:tasks.workunit.client.0.smithi023.stdout:2/952: creat d5/da/d8c/dd3/f129 x:0 0 0 2024-02-28T16:24:25.403 INFO:tasks.workunit.client.0.smithi023.stdout:7/924: rmdir de/d72/d99/d10a/d110 39 2024-02-28T16:24:25.405 INFO:tasks.workunit.client.0.smithi023.stdout:7/925: stat de/d13/d1b/d3d/d53/c55 0 2024-02-28T16:24:25.413 INFO:tasks.workunit.client.0.smithi023.stdout:7/926: getdents de/d8b 0 2024-02-28T16:24:25.417 INFO:tasks.workunit.client.0.smithi023.stdout:7/927: mkdir de/d8b/d130 0 2024-02-28T16:24:25.419 INFO:tasks.workunit.client.0.smithi023.stdout:7/928: readlink de/d13/d1b/l47 0 2024-02-28T16:24:25.420 INFO:tasks.workunit.client.0.smithi023.stdout:7/929: fsync de/d60/f5e 0 2024-02-28T16:24:25.423 INFO:tasks.workunit.client.0.smithi023.stdout:7/930: fsync de/d1c/d76/d7b/dad/fdd 0 2024-02-28T16:24:25.426 INFO:tasks.workunit.client.0.smithi023.stdout:7/931: mknod de/d72/d99/c131 0 2024-02-28T16:24:25.427 INFO:tasks.workunit.client.0.smithi023.stdout:2/953: dread d5/da/f7c [0,4194304] 0 2024-02-28T16:24:25.427 INFO:tasks.workunit.client.0.smithi023.stdout:7/932: dread - de/f10d zero size 2024-02-28T16:24:25.429 INFO:tasks.workunit.client.0.smithi023.stdout:7/933: chown de/d1c/d76/fcc 9226965 1 2024-02-28T16:24:25.431 INFO:tasks.workunit.client.0.smithi023.stdout:7/934: chown de/d13/d1b/d6c/f89 374 1 2024-02-28T16:24:25.432 INFO:tasks.workunit.client.0.smithi023.stdout:2/954: fsync d5/da/d104/d9e/da0/def/fb0 0 2024-02-28T16:24:25.439 INFO:tasks.workunit.client.0.smithi023.stdout:7/935: dread de/d72/fc8 [0,4194304] 0 2024-02-28T16:24:25.441 INFO:tasks.workunit.client.0.smithi023.stdout:7/936: dread - de/d1c/ddb/f12f zero size 2024-02-28T16:24:25.444 INFO:tasks.workunit.client.0.smithi023.stdout:2/955: write d5/da/d104/fc4 [445335,92508] 0 2024-02-28T16:24:25.445 INFO:tasks.workunit.client.0.smithi023.stdout:7/937: creat de/d13/d1b/d3d/d53/f132 x:0 0 0 2024-02-28T16:24:25.446 INFO:tasks.workunit.client.0.smithi023.stdout:2/956: rmdir d5 39 2024-02-28T16:24:25.448 INFO:tasks.workunit.client.0.smithi023.stdout:7/938: mknod de/d8b/c133 0 2024-02-28T16:24:25.449 INFO:tasks.workunit.client.0.smithi023.stdout:2/957: chown d5/da/d1b/d3f/d75/f115 11924 1 2024-02-28T16:24:25.450 INFO:tasks.workunit.client.0.smithi023.stdout:2/958: chown d5/da/db/l61 3110928 1 2024-02-28T16:24:25.451 INFO:tasks.workunit.client.0.smithi023.stdout:7/939: read de/d1c/d76/d7b/dab/fe5 [580470,29156] 0 2024-02-28T16:24:25.452 INFO:tasks.workunit.client.0.smithi023.stdout:2/959: symlink d5/dbe/l12a 0 2024-02-28T16:24:25.454 INFO:tasks.workunit.client.0.smithi023.stdout:7/940: creat de/d8b/d95/d98/f134 x:0 0 0 2024-02-28T16:24:25.456 INFO:tasks.workunit.client.0.smithi023.stdout:2/960: creat d5/da/d8c/f12b x:0 0 0 2024-02-28T16:24:25.456 INFO:tasks.workunit.client.0.smithi023.stdout:7/941: creat de/d9b/f135 x:0 0 0 2024-02-28T16:24:25.460 INFO:tasks.workunit.client.0.smithi023.stdout:2/961: rename d5/da/d1b/d3f/d75 to d5/de6/d12c 0 2024-02-28T16:24:25.468 INFO:tasks.workunit.client.0.smithi023.stdout:2/962: dread d5/da/db/d17/d3c/fb1 [0,4194304] 0 2024-02-28T16:24:25.470 INFO:tasks.workunit.client.0.smithi023.stdout:2/963: stat d5/da/db/d17/d3c/d7f/dc6/l110 0 2024-02-28T16:24:25.472 INFO:tasks.workunit.client.0.smithi023.stdout:2/964: mkdir d5/da/db/d12d 0 2024-02-28T16:24:25.487 INFO:tasks.workunit.client.0.smithi023.stdout:2/965: dread d5/da/db/f71 [0,4194304] 0 2024-02-28T16:24:25.489 INFO:tasks.workunit.client.0.smithi023.stdout:2/966: write d5/de6/d12c/fb4 [3565226,24162] 0 2024-02-28T16:24:25.493 INFO:tasks.workunit.client.0.smithi023.stdout:2/967: chown d5/da/db/d17/d3c/d7f/dc6/f11b 5745 1 2024-02-28T16:24:25.510 INFO:tasks.workunit.client.0.smithi023.stdout:2/968: dwrite d5/da/db/d17/d3c/f4c [0,4194304] 0 2024-02-28T16:24:25.520 INFO:tasks.workunit.client.0.smithi023.stdout:2/969: dread d5/da/d104/d9e/da0/def/fb0 [0,4194304] 0 2024-02-28T16:24:25.521 INFO:tasks.workunit.client.0.smithi023.stdout:2/970: fsync d5/da/d104/fdd 0 2024-02-28T16:24:25.523 INFO:tasks.workunit.client.0.smithi023.stdout:2/971: dread - d5/da/d45/f11f zero size 2024-02-28T16:24:25.525 INFO:tasks.workunit.client.0.smithi023.stdout:2/972: read - d5/da/db/d17/d39/d56/f97 zero size 2024-02-28T16:24:25.538 INFO:tasks.workunit.client.0.smithi023.stdout:2/973: dread d5/da/db/d17/d3c/d7f/dc6/f11b [0,4194304] 0 2024-02-28T16:24:25.554 INFO:tasks.workunit.client.0.smithi023.stdout:2/974: write d5/da/d104/dd0/f21 [1196470,14139] 0 2024-02-28T16:24:25.569 INFO:tasks.workunit.client.0.smithi023.stdout:2/975: dwrite d5/da/d8c/f12b [0,4194304] 0 2024-02-28T16:24:25.572 INFO:tasks.workunit.client.0.smithi023.stdout:2/976: chown d5/da/d8c/dd3/f129 272441 1 2024-02-28T16:24:25.578 INFO:tasks.workunit.client.0.smithi023.stdout:2/977: creat d5/da/db/d17/d3c/d117/f12e x:0 0 0 2024-02-28T16:24:25.589 INFO:tasks.workunit.client.0.smithi023.stdout:2/978: rename d5/de6/d12c/fb4 to d5/da/db/d17/d3c/d7f/dc6/dd9/d10b/f12f 0 2024-02-28T16:24:25.593 INFO:tasks.workunit.client.0.smithi023.stdout:2/979: symlink d5/da/d1b/d3f/l130 0 2024-02-28T16:24:25.607 INFO:tasks.workunit.client.0.smithi023.stdout:2/980: write d5/da/db/d17/d39/d56/fad [70338,54834] 0 2024-02-28T16:24:25.611 INFO:tasks.workunit.client.0.smithi023.stdout:2/981: mkdir d5/da/d8c/d100/d131 0 2024-02-28T16:24:25.615 INFO:tasks.workunit.client.0.smithi023.stdout:2/982: mkdir d5/da/db/d17/d3c/d7f/dc6/dd9/d132 0 2024-02-28T16:24:25.618 INFO:tasks.workunit.client.0.smithi023.stdout:2/983: mknod d5/da/d104/dd0/c133 0 2024-02-28T16:24:25.620 INFO:tasks.workunit.client.0.smithi023.stdout:2/984: mknod d5/de6/c134 0 2024-02-28T16:24:25.626 INFO:tasks.workunit.client.0.smithi023.stdout:2/985: rename d5/da/db/db9/f127 to d5/da/d1b/d3f/f135 0 2024-02-28T16:24:25.632 INFO:tasks.workunit.client.0.smithi023.stdout:2/986: rename d5/da/db/fbc to d5/da/d104/dd0/f136 0 2024-02-28T16:24:25.634 INFO:tasks.workunit.client.0.smithi023.stdout:0/939: sync 2024-02-28T16:24:25.635 INFO:tasks.workunit.client.0.smithi023.stdout:2/987: fsync d5/da/d8c/ff8 0 2024-02-28T16:24:25.640 INFO:tasks.workunit.client.0.smithi023.stdout:2/988: fsync d5/dbe/fc2 0 2024-02-28T16:24:25.647 INFO:tasks.workunit.client.0.smithi023.stdout:2/989: read d5/da/d8c/fcc [3523313,83570] 0 2024-02-28T16:24:25.648 INFO:tasks.workunit.client.0.smithi023.stdout:2/990: stat d5/da/db/d17/d39/d56 0 2024-02-28T16:24:25.651 INFO:tasks.workunit.client.0.smithi023.stdout:2/991: mknod d5/da/db/d17/d3c/d103/c137 0 2024-02-28T16:24:25.652 INFO:tasks.workunit.client.0.smithi023.stdout:0/940: truncate d6/db/d1a/d26/d9c/f120 2710955 0 2024-02-28T16:24:25.656 INFO:tasks.workunit.client.0.smithi023.stdout:2/992: creat d5/da/d104/dd0/d52/f138 x:0 0 0 2024-02-28T16:24:25.657 INFO:tasks.workunit.client.0.smithi023.stdout:0/941: write d6/db/d1a/f6b [4367986,8495] 0 2024-02-28T16:24:25.660 INFO:tasks.workunit.client.0.smithi023.stdout:0/942: read d6/db/d1a/d26/d31/da8/fad [540954,56910] 0 2024-02-28T16:24:25.665 INFO:tasks.workunit.client.0.smithi023.stdout:2/993: link d5/da/db/f49 d5/de6/d12c/d8a/f139 0 2024-02-28T16:24:25.666 INFO:tasks.workunit.client.0.smithi023.stdout:2/994: chown d5/dbe/l12a 32326018 1 2024-02-28T16:24:25.678 INFO:tasks.workunit.client.0.smithi023.stdout:2/995: dread d5/f7d [0,4194304] 0 2024-02-28T16:24:25.683 INFO:tasks.workunit.client.0.smithi023.stdout:1/953: sync 2024-02-28T16:24:25.684 INFO:tasks.workunit.client.0.smithi023.stdout:4/892: sync 2024-02-28T16:24:25.684 INFO:tasks.workunit.client.0.smithi023.stdout:9/905: sync 2024-02-28T16:24:25.684 INFO:tasks.workunit.client.0.smithi023.stdout:7/942: sync 2024-02-28T16:24:25.685 INFO:tasks.workunit.client.0.smithi023.stdout:2/996: symlink d5/da/d104/dd0/d52/l13a 0 2024-02-28T16:24:25.691 INFO:tasks.workunit.client.0.smithi023.stdout:4/893: chown d13/d2b/d2c/d31/d8d/f94 247659 1 2024-02-28T16:24:25.691 INFO:tasks.workunit.client.0.smithi023.stdout:1/954: symlink df/d11/d13/d1b/d30/d57/d5a/l13f 0 2024-02-28T16:24:25.694 INFO:tasks.workunit.client.0.smithi023.stdout:4/894: creat d13/d1d/d2d/da9/f11c x:0 0 0 2024-02-28T16:24:25.694 INFO:tasks.workunit.client.0.smithi023.stdout:0/943: dread d6/db/d1a/d26/d31/d33/d37/df6/f108 [0,4194304] 0 2024-02-28T16:24:25.699 INFO:tasks.workunit.client.0.smithi023.stdout:1/955: stat df/d11/d13/d1b/d30/d57/d5a/d68/d6f/f110 0 2024-02-28T16:24:25.703 INFO:tasks.workunit.client.0.smithi023.stdout:4/895: chown d13/d1d/f33 61468772 1 2024-02-28T16:24:25.709 INFO:tasks.workunit.client.0.smithi023.stdout:7/943: dwrite de/d1c/f68 [0,4194304] 0 2024-02-28T16:24:25.711 INFO:tasks.workunit.client.0.smithi023.stdout:9/906: dread d0/d7/d2c/d7d/fb4 [0,4194304] 0 2024-02-28T16:24:25.736 INFO:tasks.workunit.client.0.smithi023.stdout:4/896: rmdir d13/d2b/d109 39 2024-02-28T16:24:25.738 INFO:tasks.workunit.client.0.smithi023.stdout:7/944: creat de/d9b/d115/f136 x:0 0 0 2024-02-28T16:24:25.738 INFO:tasks.workunit.client.0.smithi023.stdout:2/997: link d5/da/d104/d9e/da0/ffb d5/da/d45/d6a/f13b 0 2024-02-28T16:24:25.740 INFO:tasks.workunit.client.0.smithi023.stdout:0/944: symlink d6/db/d3b/l14b 0 2024-02-28T16:24:25.740 INFO:tasks.workunit.client.0.smithi023.stdout:4/897: chown d13/d2b/d2c/d31/d8d/db3/d90/ff8 1749942 1 2024-02-28T16:24:25.740 INFO:tasks.workunit.client.0.smithi023.stdout:1/956: getdents df/d11/d13/d99/dde/de6/d11b 0 2024-02-28T16:24:25.743 INFO:tasks.workunit.client.0.smithi023.stdout:9/907: link d0/d7/d2c/d84/fb3 d0/d7/de/d34/dcc/f12f 0 2024-02-28T16:24:25.743 INFO:tasks.workunit.client.0.smithi023.stdout:7/945: dread - de/fbe zero size 2024-02-28T16:24:25.746 INFO:tasks.workunit.client.0.smithi023.stdout:2/998: read d5/f76 [154874,10809] 0 2024-02-28T16:24:25.746 INFO:tasks.workunit.client.0.smithi023.stdout:0/945: symlink d6/db/d1a/d26/d9c/l14c 0 2024-02-28T16:24:25.749 INFO:tasks.workunit.client.0.smithi023.stdout:4/898: mkdir d13/d2b/d109/d11d 0 2024-02-28T16:24:25.751 INFO:tasks.workunit.client.1.smithi153.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T16:24:25.754 INFO:tasks.workunit.client.0.smithi023.stdout:9/908: getdents d0/d7/db/d18/d23/d28/d32/dca/dfb 0 2024-02-28T16:24:25.754 INFO:tasks.workunit.client.0.smithi023.stdout:4/899: chown d13/d2b/d2c/d31/d6e/f112 182 1 2024-02-28T16:24:25.756 INFO:tasks.workunit.client.0.smithi023.stdout:7/946: creat de/d72/d99/d10a/f137 x:0 0 0 2024-02-28T16:24:25.756 INFO:tasks.workunit.client.0.smithi023.stdout:1/957: getdents df/d26/d48/d80 0 2024-02-28T16:24:25.757 INFO:tasks.workunit.client.0.smithi023.stdout:9/909: stat d0/d7/db/dec/df6/f11c 0 2024-02-28T16:24:25.762 INFO:tasks.workunit.client.0.smithi023.stdout:4/900: symlink d13/d2b/d9d/d117/l11e 0 2024-02-28T16:24:25.763 INFO:tasks.workunit.client.0.smithi023.stdout:7/947: creat de/f138 x:0 0 0 2024-02-28T16:24:25.764 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:24:25.764 INFO:tasks.workunit.client.1.smithi153.stderr:+ make 2024-02-28T16:24:25.766 INFO:tasks.workunit.client.0.smithi023.stdout:1/958: truncate df/d26/d48/fa1 775575 0 2024-02-28T16:24:25.767 INFO:tasks.workunit.client.0.smithi023.stdout:9/910: dread d0/d7/de/d34/f9e [0,4194304] 0 2024-02-28T16:24:25.767 INFO:tasks.workunit.client.0.smithi023.stdout:0/946: dwrite d6/db/dab/d82/f4f [0,4194304] 0 2024-02-28T16:24:25.769 INFO:tasks.workunit.client.0.smithi023.stdout:7/948: write de/d13/d1b/d40/f44 [474992,14245] 0 2024-02-28T16:24:25.772 INFO:tasks.workunit.client.0.smithi023.stdout:2/999: dwrite d5/da/db/d17/d3c/d7f/dc6/dd9/d10b/f116 [0,4194304] 0 2024-02-28T16:24:25.774 INFO:tasks.workunit.client.0.smithi023.stdout:0/947: chown d6/db/d1a/d26/d31/d33/d37/df6/f124 118 1 2024-02-28T16:24:25.779 INFO:tasks.workunit.client.0.smithi023.stdout:7/949: fdatasync de/f82 0 2024-02-28T16:24:25.782 INFO:tasks.workunit.client.0.smithi023.stdout:9/911: creat d0/d7/db/d18/d23/d28/f130 x:0 0 0 2024-02-28T16:24:25.784 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:25 smithi153 ceph-mon[35341]: pgmap v44: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 57 MiB/s rd, 146 MiB/s wr, 406 op/s 2024-02-28T16:24:25.796 INFO:tasks.workunit.client.0.smithi023.stdout:1/959: rename df/d11/d13/d1b/f40 to df/d26/f140 0 2024-02-28T16:24:25.798 INFO:tasks.workunit.client.0.smithi023.stdout:7/950: mknod de/d1c/d76/d7b/c139 0 2024-02-28T16:24:25.805 INFO:tasks.workunit.client.0.smithi023.stdout:0/948: getdents d6/db/dab/d82/d72/d143 0 2024-02-28T16:24:25.809 INFO:tasks.workunit.client.0.smithi023.stdout:0/949: chown d6/db/d1a/d26/d31/fcc 225331 1 2024-02-28T16:24:25.811 INFO:tasks.workunit.client.0.smithi023.stdout:9/912: dwrite d0/d7/db/d18/f49 [0,4194304] 0 2024-02-28T16:24:25.811 INFO:tasks.workunit.client.0.smithi023.stdout:7/951: creat de/d13/d1b/d6c/db6/f13a x:0 0 0 2024-02-28T16:24:25.818 INFO:tasks.workunit.client.0.smithi023.stdout:1/960: dwrite df/d11/d13/d99/dde/de6/f100 [0,4194304] 0 2024-02-28T16:24:25.820 INFO:tasks.workunit.client.0.smithi023.stdout:7/952: rename de/d13/d1b/d3d/f5c to de/d1c/d76/d7b/dad/dea/f13b 0 2024-02-28T16:24:25.827 INFO:tasks.workunit.client.0.smithi023.stdout:1/961: creat df/d11/d13/d99/dde/de6/f141 x:0 0 0 2024-02-28T16:24:25.831 INFO:tasks.workunit.client.0.smithi023.stdout:7/953: mknod de/d13/d1b/d3d/c13c 0 2024-02-28T16:24:25.835 INFO:tasks.workunit.client.0.smithi023.stdout:1/962: dread df/d11/d8a/f96 [0,4194304] 0 2024-02-28T16:24:25.836 INFO:tasks.workunit.client.0.smithi023.stdout:9/913: dwrite d0/d7/d2c/f119 [0,4194304] 0 2024-02-28T16:24:25.837 INFO:tasks.workunit.client.0.smithi023.stdout:7/954: creat de/d13/d1b/d3d/d118/d12d/f13d x:0 0 0 2024-02-28T16:24:25.837 INFO:tasks.workunit.client.0.smithi023.stdout:1/963: chown df/d11/d13/d99/dfc 166051424 1 2024-02-28T16:24:25.839 INFO:tasks.workunit.client.0.smithi023.stdout:9/914: stat d0/d7/db/d18/d23/d28/d32/d8b 0 2024-02-28T16:24:25.845 INFO:tasks.workunit.client.0.smithi023.stdout:1/964: dread - df/d11/d13/d1b/d30/de9/f13a zero size 2024-02-28T16:24:25.845 INFO:tasks.workunit.client.0.smithi023.stdout:7/955: mkdir de/d72/d99/d102/d13e 0 2024-02-28T16:24:25.847 INFO:tasks.workunit.client.0.smithi023.stdout:7/956: chown de/f82 6913262 1 2024-02-28T16:24:25.847 INFO:tasks.workunit.client.0.smithi023.stdout:9/915: symlink d0/d7/db/dec/l131 0 2024-02-28T16:24:25.852 INFO:tasks.workunit.client.0.smithi023.stdout:1/965: dread df/d26/d48/f94 [0,4194304] 0 2024-02-28T16:24:25.852 INFO:tasks.workunit.client.0.smithi023.stdout:7/957: mkdir de/d72/d99/d13f 0 2024-02-28T16:24:25.853 INFO:tasks.workunit.client.0.smithi023.stdout:9/916: getdents d0/d7/d2c/d84/d124 0 2024-02-28T16:24:25.856 INFO:tasks.workunit.client.0.smithi023.stdout:1/966: creat df/d11/d13/d1b/d30/dae/dea/f142 x:0 0 0 2024-02-28T16:24:25.857 INFO:tasks.workunit.client.0.smithi023.stdout:7/958: rmdir de/d72/d99/d10a/d110 39 2024-02-28T16:24:25.860 INFO:tasks.workunit.client.0.smithi023.stdout:1/967: creat df/d93/f143 x:0 0 0 2024-02-28T16:24:25.861 INFO:tasks.workunit.client.0.smithi023.stdout:7/959: creat de/d13/d1b/d6c/db6/f140 x:0 0 0 2024-02-28T16:24:25.863 INFO:tasks.workunit.client.0.smithi023.stdout:1/968: readlink df/d11/d13/d1b/d30/d57/d5a/d68/d6f/l9f 0 2024-02-28T16:24:25.873 INFO:tasks.workunit.client.0.smithi023.stdout:4/901: dwrite d13/d1d/d2d/f36 [0,4194304] 0 2024-02-28T16:24:25.874 INFO:tasks.workunit.client.0.smithi023.stdout:1/969: getdents df/d11/d13/d99/dfc 0 2024-02-28T16:24:25.877 INFO:tasks.workunit.client.0.smithi023.stdout:0/950: write d6/db/d5d/f76 [1454022,93561] 0 2024-02-28T16:24:25.879 INFO:tasks.workunit.client.0.smithi023.stdout:1/970: write df/d11/f12 [2330900,112598] 0 2024-02-28T16:24:25.889 INFO:tasks.workunit.client.0.smithi023.stdout:0/951: creat d6/db/d1a/f14d x:0 0 0 2024-02-28T16:24:25.890 INFO:tasks.workunit.client.0.smithi023.stdout:1/971: fsync df/d11/d13/d1b/d30/dae/dea/f142 0 2024-02-28T16:24:25.891 INFO:tasks.workunit.client.0.smithi023.stdout:9/917: write d0/d7/de/d2a/daf/d2f/f60 [4484660,43709] 0 2024-02-28T16:24:25.894 INFO:tasks.workunit.client.0.smithi023.stdout:1/972: chown df/d11/d13/c13c 146 1 2024-02-28T16:24:25.896 INFO:tasks.workunit.client.0.smithi023.stdout:0/952: unlink d6/db/c7e 0 2024-02-28T16:24:25.899 INFO:tasks.workunit.client.0.smithi023.stdout:9/918: truncate d0/d7/d2c/f77 835528 0 2024-02-28T16:24:25.901 INFO:tasks.workunit.client.0.smithi023.stdout:1/973: mknod df/d11/d13/d1b/d30/d57/d78/c144 0 2024-02-28T16:24:25.903 INFO:tasks.workunit.client.0.smithi023.stdout:0/953: stat d6/d4c/d6a/l89 0 2024-02-28T16:24:25.906 INFO:tasks.workunit.client.0.smithi023.stdout:7/960: dwrite de/d13/d1b/d3d/d118/d12d/fdc [0,4194304] 0 2024-02-28T16:24:25.907 INFO:tasks.workunit.client.0.smithi023.stdout:9/919: mknod d0/d7/db/c132 0 2024-02-28T16:24:25.910 INFO:tasks.workunit.client.1.smithi153.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T16:24:25.911 INFO:tasks.workunit.client.0.smithi023.stdout:1/974: dread - df/d11/d13/d1b/d30/dae/dea/f108 zero size 2024-02-28T16:24:25.912 INFO:tasks.workunit.client.0.smithi023.stdout:4/902: dwrite d13/d2b/d2c/d31/dc4/fb0 [0,4194304] 0 2024-02-28T16:24:25.913 INFO:tasks.workunit.client.0.smithi023.stdout:7/961: unlink de/d13/d1b/d6c/f97 0 2024-02-28T16:24:25.916 INFO:tasks.workunit.client.0.smithi023.stdout:9/920: symlink d0/d7/db/d18/d23/d28/d32/d3c/l133 0 2024-02-28T16:24:25.916 INFO:tasks.workunit.client.0.smithi023.stdout:7/962: write de/d13/d1b/d6c/db6/ffa [541331,22283] 0 2024-02-28T16:24:25.919 INFO:tasks.workunit.client.0.smithi023.stdout:0/954: dread d6/db/d1a/d1b/d101/f11b [4194304,4194304] 0 2024-02-28T16:24:25.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:25 smithi023 ceph-mon[29137]: pgmap v44: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 57 MiB/s rd, 146 MiB/s wr, 406 op/s 2024-02-28T16:24:25.926 INFO:tasks.workunit.client.0.smithi023.stdout:7/963: write de/d13/d1b/d6c/db6/ffa [368148,126668] 0 2024-02-28T16:24:25.929 INFO:tasks.workunit.client.0.smithi023.stdout:4/903: creat d13/d2b/f11f x:0 0 0 2024-02-28T16:24:25.930 INFO:tasks.workunit.client.0.smithi023.stdout:9/921: creat d0/d7/db/d18/d23/d28/d32/d3c/f134 x:0 0 0 2024-02-28T16:24:25.934 INFO:tasks.workunit.client.0.smithi023.stdout:9/922: write d0/d7/db/d18/d23/d28/d32/dca/f109 [427358,1749] 0 2024-02-28T16:24:25.937 INFO:tasks.workunit.client.0.smithi023.stdout:7/964: creat de/d1c/d76/d7b/dad/dea/f141 x:0 0 0 2024-02-28T16:24:25.938 INFO:tasks.workunit.client.0.smithi023.stdout:1/975: write df/d11/d13/d1b/f86 [3790421,43217] 0 2024-02-28T16:24:25.941 INFO:tasks.workunit.client.0.smithi023.stdout:1/976: chown df/d11/d13/ca7 1234752 1 2024-02-28T16:24:25.941 INFO:tasks.workunit.client.0.smithi023.stdout:9/923: unlink d0/d7/db/dec/l131 0 2024-02-28T16:24:25.943 INFO:tasks.workunit.client.0.smithi023.stdout:7/965: creat de/d13/d1b/d3d/d118/d12d/f142 x:0 0 0 2024-02-28T16:24:25.946 INFO:tasks.workunit.client.0.smithi023.stdout:0/955: getdents d6/db/d1a/d26/d31/da8/d10a 0 2024-02-28T16:24:25.951 INFO:tasks.workunit.client.0.smithi023.stdout:0/956: mkdir d6/db/d1a/d26/d31/d33/d37/d8f/d14e 0 2024-02-28T16:24:25.951 INFO:tasks.workunit.client.0.smithi023.stdout:4/904: write d13/f3c [776616,29928] 0 2024-02-28T16:24:25.953 INFO:tasks.workunit.client.0.smithi023.stdout:7/966: unlink de/d13/d1b/d3d/faf 0 2024-02-28T16:24:25.954 INFO:tasks.workunit.client.0.smithi023.stdout:4/905: write d13/d2b/fab [1355885,113374] 0 2024-02-28T16:24:25.957 INFO:tasks.workunit.client.0.smithi023.stdout:4/906: dread - d13/d1d/d2d/da9/f11c zero size 2024-02-28T16:24:25.957 INFO:tasks.workunit.client.0.smithi023.stdout:1/977: write df/dbd/d6c/ffe [1318721,45451] 0 2024-02-28T16:24:25.960 INFO:tasks.workunit.client.0.smithi023.stdout:9/924: truncate d0/f43 1272334 0 2024-02-28T16:24:25.960 INFO:tasks.workunit.client.0.smithi023.stdout:0/957: creat d6/db/dab/d82/d72/d143/dcd/f14f x:0 0 0 2024-02-28T16:24:25.961 INFO:tasks.workunit.client.0.smithi023.stdout:7/967: dread - de/d1c/f83 zero size 2024-02-28T16:24:25.963 INFO:tasks.workunit.client.0.smithi023.stdout:1/978: mkdir df/d93/d145 0 2024-02-28T16:24:25.964 INFO:tasks.workunit.client.0.smithi023.stdout:7/968: stat de/d13/d1b/d3d/d118/d12d/fdc 0 2024-02-28T16:24:25.967 INFO:tasks.workunit.client.0.smithi023.stdout:9/925: chown d0/d7/db/d18/d23/d28/d32/l41 84048 1 2024-02-28T16:24:25.976 INFO:tasks.workunit.client.0.smithi023.stdout:4/907: dwrite d13/d1d/d85/de3/ff0 [0,4194304] 0 2024-02-28T16:24:25.980 INFO:tasks.workunit.client.0.smithi023.stdout:1/979: link df/dbd/cb7 df/dbd/d7b/c146 0 2024-02-28T16:24:25.981 INFO:tasks.workunit.client.0.smithi023.stdout:7/969: getdents de/d72/d99/d102 0 2024-02-28T16:24:25.983 INFO:tasks.workunit.client.0.smithi023.stdout:4/908: symlink d13/d2b/d9d/d117/l120 0 2024-02-28T16:24:25.986 INFO:tasks.workunit.client.0.smithi023.stdout:0/958: dwrite d6/db/d24/f109 [0,4194304] 0 2024-02-28T16:24:25.992 INFO:tasks.workunit.client.0.smithi023.stdout:1/980: mkdir df/d11/d13/d1b/d30/d57/d5a/d68/d7a/d147 0 2024-02-28T16:24:25.992 INFO:tasks.workunit.client.0.smithi023.stdout:4/909: symlink d13/d1d/d2d/l121 0 2024-02-28T16:24:25.996 INFO:tasks.workunit.client.0.smithi023.stdout:4/910: dread - d13/d1d/d58/ddb/ffe zero size 2024-02-28T16:24:25.997 INFO:tasks.workunit.client.0.smithi023.stdout:1/981: symlink df/d11/d8a/l148 0 2024-02-28T16:24:26.000 INFO:tasks.workunit.client.0.smithi023.stdout:4/911: rmdir d13/d1d/d58 39 2024-02-28T16:24:26.002 INFO:tasks.workunit.client.0.smithi023.stdout:9/926: dwrite d0/d7/d2c/d7d/fed [0,4194304] 0 2024-02-28T16:24:26.007 INFO:tasks.workunit.client.0.smithi023.stdout:0/959: write d6/db/d5d/f93 [594674,107738] 0 2024-02-28T16:24:26.007 INFO:tasks.workunit.client.0.smithi023.stdout:4/912: write d13/f107 [154947,98391] 0 2024-02-28T16:24:26.017 INFO:tasks.workunit.client.0.smithi023.stdout:1/982: write df/d26/d48/f79 [4090827,48309] 0 2024-02-28T16:24:26.019 INFO:tasks.workunit.client.0.smithi023.stdout:0/960: write d6/db/d24/fd9 [686220,1812] 0 2024-02-28T16:24:26.024 INFO:tasks.workunit.client.0.smithi023.stdout:7/970: dwrite de/d13/d1b/d3d/d53/f90 [0,4194304] 0 2024-02-28T16:24:26.028 INFO:tasks.workunit.client.0.smithi023.stdout:0/961: creat d6/db/d1a/d26/d9c/d146/f150 x:0 0 0 2024-02-28T16:24:26.028 INFO:tasks.workunit.client.0.smithi023.stdout:1/983: truncate df/d11/d13/d1b/d30/d57/d5a/d68/d7a/f117 438009 0 2024-02-28T16:24:26.067 INFO:tasks.workunit.client.0.smithi023.stdout:7/971: write de/d1c/d76/d7b/f91 [395110,76143] 0 2024-02-28T16:24:26.069 INFO:tasks.workunit.client.0.smithi023.stdout:1/984: chown df/d11/d13/d1b/d30/d57/d5a/f64 4 1 2024-02-28T16:24:26.076 INFO:tasks.workunit.client.0.smithi023.stdout:9/927: dwrite d0/d7/db/d18/d23/f12e [0,4194304] 0 2024-02-28T16:24:26.094 INFO:tasks.workunit.client.0.smithi023.stdout:9/928: symlink d0/d7/db/d18/d23/d28/d32/d105/l135 0 2024-02-28T16:24:26.099 INFO:tasks.workunit.client.0.smithi023.stdout:9/929: mkdir d0/d7/db/dec/d136 0 2024-02-28T16:24:26.100 INFO:tasks.workunit.client.0.smithi023.stdout:9/930: write d0/d7/db/d18/fe3 [353124,10311] 0 2024-02-28T16:24:26.104 INFO:tasks.workunit.client.0.smithi023.stdout:9/931: write d0/d7/db/d18/d23/d28/d6e/fb8 [651116,32728] 0 2024-02-28T16:24:26.111 INFO:tasks.workunit.client.0.smithi023.stdout:9/932: creat d0/d7/de/d2a/daf/d2f/d4d/f137 x:0 0 0 2024-02-28T16:24:26.124 INFO:tasks.workunit.client.0.smithi023.stdout:9/933: dwrite d0/d7/db/dec/f104 [0,4194304] 0 2024-02-28T16:24:26.130 INFO:tasks.workunit.client.0.smithi023.stdout:9/934: symlink d0/d7/d2c/d84/l138 0 2024-02-28T16:24:26.135 INFO:tasks.workunit.client.0.smithi023.stdout:9/935: dread - d0/d7/de/d2a/daf/d2f/db0/d113/d12a/f11f zero size 2024-02-28T16:24:26.136 INFO:tasks.workunit.client.0.smithi023.stdout:0/962: dwrite d6/db/dab/d82/da3/fe2 [0,4194304] 0 2024-02-28T16:24:26.138 INFO:tasks.workunit.client.0.smithi023.stdout:9/936: fsync d0/d7/db/d18/d23/d28/d32/f110 0 2024-02-28T16:24:26.141 INFO:tasks.workunit.client.0.smithi023.stdout:1/985: write df/d11/d13/d99/dfc/df9/f11a [421719,78578] 0 2024-02-28T16:24:26.142 INFO:tasks.workunit.client.0.smithi023.stdout:9/937: stat d0/d7/de 0 2024-02-28T16:24:26.144 INFO:tasks.workunit.client.0.smithi023.stdout:0/963: dread - d6/db/d1a/d35/d9d/dce/f127 zero size 2024-02-28T16:24:26.147 INFO:tasks.workunit.client.0.smithi023.stdout:1/986: chown df/d11/d13/l51 1565819 1 2024-02-28T16:24:26.153 INFO:tasks.workunit.client.0.smithi023.stdout:7/972: dwrite de/d13/d1b/d3d/d53/f7e [0,4194304] 0 2024-02-28T16:24:26.163 INFO:tasks.workunit.client.0.smithi023.stdout:1/987: rmdir df/d11/d13/d1b 39 2024-02-28T16:24:26.164 INFO:tasks.workunit.client.0.smithi023.stdout:9/938: mkdir d0/d7/db/d18/d23/d28/d32/dca/d139 0 2024-02-28T16:24:26.167 INFO:tasks.workunit.client.0.smithi023.stdout:7/973: write de/d1c/d76/f86 [9022524,77417] 0 2024-02-28T16:24:26.167 INFO:tasks.workunit.client.0.smithi023.stdout:9/939: chown d0/d7/db/d18/d23/d28/d32/dca/d139 6 1 2024-02-28T16:24:26.170 INFO:tasks.workunit.client.0.smithi023.stdout:7/974: mknod de/d60/c143 0 2024-02-28T16:24:26.173 INFO:tasks.workunit.client.0.smithi023.stdout:9/940: truncate d0/d7/db/ff9 681498 0 2024-02-28T16:24:26.180 INFO:tasks.workunit.client.0.smithi023.stdout:9/941: creat d0/d7/db/d18/d23/d28/d32/d8b/f13a x:0 0 0 2024-02-28T16:24:26.187 INFO:tasks.workunit.client.0.smithi023.stdout:0/964: dread d6/db/dab/d82/fae [0,4194304] 0 2024-02-28T16:24:26.188 INFO:tasks.workunit.client.0.smithi023.stdout:9/942: creat d0/d7/f13b x:0 0 0 2024-02-28T16:24:26.191 INFO:tasks.workunit.client.0.smithi023.stdout:7/975: dwrite de/d1c/d76/fcc [0,4194304] 0 2024-02-28T16:24:26.195 INFO:tasks.workunit.client.0.smithi023.stdout:0/965: rmdir d6/db/dab/d82/d72/d143 39 2024-02-28T16:24:26.198 INFO:tasks.workunit.client.0.smithi023.stdout:1/988: dread df/d11/d13/d1b/d2e/fc9 [0,4194304] 0 2024-02-28T16:24:26.199 INFO:tasks.workunit.client.0.smithi023.stdout:0/966: symlink d6/db/d1a/d1b/d101/d107/l151 0 2024-02-28T16:24:26.201 INFO:tasks.workunit.client.0.smithi023.stdout:1/989: rmdir df/d26/d48/d72 39 2024-02-28T16:24:26.208 INFO:tasks.workunit.client.0.smithi023.stdout:1/990: mkdir df/d11/d13/d1b/d30/d57/d8d/d13b/d149 0 2024-02-28T16:24:26.210 INFO:tasks.workunit.client.0.smithi023.stdout:7/976: dwrite de/fd6 [0,4194304] 0 2024-02-28T16:24:26.216 INFO:tasks.workunit.client.0.smithi023.stdout:7/977: chown de/d1c/f26 140 1 2024-02-28T16:24:26.220 INFO:tasks.workunit.client.0.smithi023.stdout:7/978: creat de/d13/d1b/d3f/f144 x:0 0 0 2024-02-28T16:24:26.221 INFO:tasks.workunit.client.0.smithi023.stdout:1/991: dread df/d11/d13/f15 [0,4194304] 0 2024-02-28T16:24:26.221 INFO:tasks.workunit.client.0.smithi023.stdout:9/943: dread d0/d7/db/d18/d23/d28/d6e/f7f [0,4194304] 0 2024-02-28T16:24:26.226 INFO:tasks.workunit.client.0.smithi023.stdout:1/992: creat df/d26/d48/db3/f14a x:0 0 0 2024-02-28T16:24:26.232 INFO:tasks.workunit.client.0.smithi023.stdout:1/993: getdents df/d26/d48 0 2024-02-28T16:24:26.236 INFO:tasks.workunit.client.0.smithi023.stdout:1/994: write df/d11/d13/d1b/d30/d57/d8d/f12b [244501,93797] 0 2024-02-28T16:24:26.237 INFO:tasks.workunit.client.0.smithi023.stdout:9/944: dread d0/f50 [0,4194304] 0 2024-02-28T16:24:26.242 INFO:tasks.workunit.client.0.smithi023.stdout:7/979: dwrite de/d1c/f128 [0,4194304] 0 2024-02-28T16:24:26.245 INFO:tasks.workunit.client.0.smithi023.stdout:1/995: mkdir df/d11/d13/d99/d14b 0 2024-02-28T16:24:26.247 INFO:tasks.workunit.client.0.smithi023.stdout:7/980: mkdir de/d1c/d76/d7b/d145 0 2024-02-28T16:24:26.249 INFO:tasks.workunit.client.0.smithi023.stdout:0/967: dread d6/db/d1a/d26/d31/fb8 [0,4194304] 0 2024-02-28T16:24:26.251 INFO:tasks.workunit.client.0.smithi023.stdout:7/981: write de/d13/d1b/d6c/db6/f140 [350325,92387] 0 2024-02-28T16:24:26.254 INFO:tasks.workunit.client.0.smithi023.stdout:0/968: symlink d6/db/d1a/d26/d31/da0/l152 0 2024-02-28T16:24:26.254 INFO:tasks.workunit.client.0.smithi023.stdout:7/982: write de/d13/d1b/d6c/db6/ffa [1549545,7268] 0 2024-02-28T16:24:26.256 INFO:tasks.workunit.client.0.smithi023.stdout:9/945: write d0/d7/db/d18/d23/fac [810597,3018] 0 2024-02-28T16:24:26.260 INFO:tasks.workunit.client.0.smithi023.stdout:7/983: rename de/d13/d1b/d3d/d118 to de/d9b/d146 0 2024-02-28T16:24:26.262 INFO:tasks.workunit.client.0.smithi023.stdout:9/946: creat d0/d7/db/dec/d136/f13c x:0 0 0 2024-02-28T16:24:26.262 INFO:tasks.workunit.client.0.smithi023.stdout:1/996: dread df/d26/f5b [0,4194304] 0 2024-02-28T16:24:26.268 INFO:tasks.workunit.client.0.smithi023.stdout:1/997: read df/d11/d13/d1b/d30/d57/d8d/f12b [157017,24676] 0 2024-02-28T16:24:26.270 INFO:tasks.workunit.client.0.smithi023.stdout:9/947: getdents d0/d7/de/d2a/daf 0 2024-02-28T16:24:26.274 INFO:tasks.workunit.client.0.smithi023.stdout:1/998: creat df/dbd/d6c/dd3/f14c x:0 0 0 2024-02-28T16:24:26.274 INFO:tasks.workunit.client.0.smithi023.stdout:0/969: dwrite d6/db/d1a/d35/d9d/dce/f13e [0,4194304] 0 2024-02-28T16:24:26.274 INFO:tasks.workunit.client.0.smithi023.stdout:7/984: write de/d1c/d76/d7b/dab/fbd [356081,35269] 0 2024-02-28T16:24:26.280 INFO:tasks.workunit.client.0.smithi023.stdout:7/985: creat de/d13/d1b/d3d/f147 x:0 0 0 2024-02-28T16:24:26.282 INFO:tasks.workunit.client.0.smithi023.stdout:7/986: creat de/d72/f148 x:0 0 0 2024-02-28T16:24:26.285 INFO:tasks.workunit.client.0.smithi023.stdout:7/987: creat de/d13/d1b/d40/d111/f149 x:0 0 0 2024-02-28T16:24:26.297 INFO:tasks.workunit.client.0.smithi023.stdout:0/970: dwrite d6/db/d68/fc4 [0,4194304] 0 2024-02-28T16:24:26.300 INFO:tasks.workunit.client.0.smithi023.stdout:7/988: dwrite de/d72/f148 [0,4194304] 0 2024-02-28T16:24:26.380 INFO:tasks.workunit.client.0.smithi023.stdout:7/989: rmdir de/d13 39 2024-02-28T16:24:26.381 INFO:tasks.workunit.client.0.smithi023.stdout:0/971: truncate d6/db/d1a/d26/d31/da8/fad 493936 0 2024-02-28T16:24:26.388 INFO:tasks.workunit.client.0.smithi023.stdout:0/972: symlink d6/db/d1a/d26/d31/d33/d37/d8f/l153 0 2024-02-28T16:24:26.389 INFO:tasks.workunit.client.0.smithi023.stdout:0/973: dread - d6/db/d3d/fd0 zero size 2024-02-28T16:24:26.410 INFO:tasks.workunit.client.0.smithi023.stdout:7/990: dread de/d13/d1b/f49 [0,4194304] 0 2024-02-28T16:24:26.418 INFO:tasks.workunit.client.0.smithi023.stdout:7/991: write de/d1c/ff0 [548693,50448] 0 2024-02-28T16:24:26.419 INFO:tasks.workunit.client.0.smithi023.stdout:0/974: dread d6/db/dab/d42/f83 [0,4194304] 0 2024-02-28T16:24:26.421 INFO:tasks.workunit.client.0.smithi023.stdout:7/992: creat de/d72/d99/d102/f14a x:0 0 0 2024-02-28T16:24:26.428 INFO:tasks.workunit.client.0.smithi023.stdout:0/975: write d6/db/d1a/d26/d9c/fe0 [4469062,55854] 0 2024-02-28T16:24:26.433 INFO:tasks.workunit.client.0.smithi023.stdout:0/976: dread d6/db/d1a/d35/d9d/fa9 [0,4194304] 0 2024-02-28T16:24:26.440 INFO:tasks.workunit.client.0.smithi023.stdout:7/993: dwrite de/d9b/fba [0,4194304] 0 2024-02-28T16:24:26.447 INFO:tasks.workunit.client.0.smithi023.stdout:4/913: sync 2024-02-28T16:24:26.451 INFO:tasks.workunit.client.0.smithi023.stdout:4/914: mkdir d13/d2b/d2c/d31/d6e/de4/d122 0 2024-02-28T16:24:26.453 INFO:tasks.workunit.client.0.smithi023.stdout:4/915: symlink d13/d2b/d2c/d31/dc4/dc0/dfa/l123 0 2024-02-28T16:24:26.457 INFO:tasks.workunit.client.0.smithi023.stdout:4/916: dread d13/d1d/d58/f84 [0,4194304] 0 2024-02-28T16:24:26.460 INFO:tasks.workunit.client.0.smithi023.stdout:4/917: mkdir d13/d2b/d109/d11d/d124 0 2024-02-28T16:24:26.461 INFO:tasks.workunit.client.0.smithi023.stdout:4/918: write d13/d1d/d58/d104/f111 [121828,277] 0 2024-02-28T16:24:26.474 INFO:tasks.workunit.client.0.smithi023.stdout:4/919: truncate d13/d2b/d2c/d31/d6e/f112 1378136 0 2024-02-28T16:24:26.493 INFO:tasks.workunit.client.0.smithi023.stdout:4/920: dread d13/d1d/d2d/f47 [0,4194304] 0 2024-02-28T16:24:26.497 INFO:tasks.workunit.client.0.smithi023.stdout:4/921: creat d13/d1e/f125 x:0 0 0 2024-02-28T16:24:26.503 INFO:tasks.workunit.client.0.smithi023.stdout:4/922: link d13/d1d/d2e/f52 d13/d2b/d2c/d31/d6e/de4/d122/f126 0 2024-02-28T16:24:26.514 INFO:tasks.workunit.client.0.smithi023.stdout:4/923: write d13/d2b/d2c/d31/d8d/fa1 [1068299,54757] 0 2024-02-28T16:24:26.532 INFO:tasks.workunit.client.0.smithi023.stdout:4/924: dread d13/d2b/d2c/d31/d6e/f7b [0,4194304] 0 2024-02-28T16:24:26.547 INFO:tasks.workunit.client.0.smithi023.stdout:4/925: dwrite d13/f1b [4194304,4194304] 0 2024-02-28T16:24:26.679 INFO:tasks.workunit.client.0.smithi023.stdout:9/948: sync 2024-02-28T16:24:26.679 INFO:tasks.workunit.client.0.smithi023.stdout:1/999: sync 2024-02-28T16:24:26.683 INFO:tasks.workunit.client.0.smithi023.stdout:9/949: fdatasync d0/d7/db/d18/f49 0 2024-02-28T16:24:26.685 INFO:tasks.workunit.client.0.smithi023.stdout:9/950: stat d0/d7/db/d18/d23/d28/d32/d8b/ffa 0 2024-02-28T16:24:26.695 INFO:tasks.workunit.client.0.smithi023.stdout:9/951: write d0/d7/de/d2a/daf/d2f/fe8 [4486629,86944] 0 2024-02-28T16:24:26.716 INFO:tasks.workunit.client.0.smithi023.stdout:9/952: dwrite d0/d7/f13b [0,4194304] 0 2024-02-28T16:24:26.723 INFO:tasks.workunit.client.1.smithi153.stderr:++ readlink -f fsstress 2024-02-28T16:24:26.729 INFO:tasks.workunit.client.1.smithi153.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T16:24:27.089 INFO:tasks.workunit.client.1.smithi153.stderr:+ popd 2024-02-28T16:24:27.090 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:24:27.090 INFO:tasks.workunit.client.1.smithi153.stderr:+ popd 2024-02-28T16:24:27.091 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:24:27.091 INFO:tasks.workunit.client.1.smithi153.stderr:++ mktemp -d -p . 2024-02-28T16:24:27.092 INFO:tasks.workunit.client.1.smithi153.stderr:+ T=./tmp.a6iQeXmTmI 2024-02-28T16:24:27.092 INFO:tasks.workunit.client.1.smithi153.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.a6iQeXmTmI -l 1 -n 1000 -p 10 -v 2024-02-28T16:24:27.097 INFO:tasks.workunit.client.0.smithi023.stdout:9/953: symlink d0/d7/db/d18/d23/d28/d32/l13d 0 2024-02-28T16:24:27.097 INFO:tasks.workunit.client.0.smithi023.stdout:7/994: sync 2024-02-28T16:24:27.097 INFO:tasks.workunit.client.0.smithi023.stdout:0/977: sync 2024-02-28T16:24:27.097 INFO:tasks.workunit.client.0.smithi023.stdout:4/926: sync 2024-02-28T16:24:27.097 INFO:tasks.workunit.client.0.smithi023.stdout:0/978: dread - d6/db/dab/d82/d72/f119 zero size 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:7/995: symlink de/d72/d99/d10a/d110/l14b 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:4/927: creat d13/d1e/df1/f127 x:0 0 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:7/996: mknod de/d1c/d76/d7b/dad/dc9/c14c 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:4/928: mkdir d13/d2b/d2c/d31/dce/d128 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:9/954: write d0/d7/db/d18/f6f [1676793,98411] 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:0/979: dwrite d6/db/d1a/d26/d31/d33/d37/d8f/ddf/df4/f12b [0,4194304] 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:7/997: symlink de/d9b/l14d 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:7/998: mkdir de/d60/d14e 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:0/980: getdents d6/db/d1a/d26/d31/d33/d37/df6 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:0/981: dread - d6/db/d1a/d26/d31/d33/d6e/ff5 zero size 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:9/955: dread d0/d7/db/d18/f56 [0,4194304] 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:0/982: write d6/db/d1a/f14d [203032,109222] 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:9/956: rmdir d0/d7/d2c/d84/d124 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:0/983: getdents d6/db/dab/d82/d72/d143/dcd 0 2024-02-28T16:24:27.098 INFO:tasks.workunit.client.0.smithi023.stdout:9/957: getdents d0/d7/de 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/984: symlink d6/db/d1a/d26/l154 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/985: truncate d6/db/d1a/d35/d9d/fa9 1151254 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/986: mkdir d6/db/d1a/d26/d31/d33/d37/d8f/d14e/d155 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/987: dwrite d6/db/d1a/d1b/d136/f144 [0,4194304] 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/988: symlink d6/db/dab/d82/d72/l156 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:7/999: dread de/d13/d1b/d3f/fe9 [0,4194304] 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:9/958: write d0/d7/db/d18/f9d [1069369,101892] 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/989: dwrite d6/f21 [0,4194304] 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:4/929: sync 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:9/959: dwrite d0/d7/db/d18/d23/d28/d6e/f72 [0,4194304] 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:4/930: rename d13/d1e/d9c to d13/d2b/d2c/d31/d8d/db3/de5/d129 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:4/931: truncate d13/d1d/d58/f68 5039520 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:9/960: creat d0/d7/de/d2a/daf/d2f/f13e x:0 0 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:9/961: creat d0/dd2/df4/f13f x:0 0 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:4/932: link d13/d2b/d2c/d31/fb6 d13/f12a 0 2024-02-28T16:24:27.099 INFO:tasks.workunit.client.0.smithi023.stdout:0/990: dread d6/db/d3b/f58 [0,4194304] 0 2024-02-28T16:24:27.100 INFO:tasks.workunit.client.0.smithi023.stdout:4/933: symlink d13/d2b/d109/l12b 0 2024-02-28T16:24:27.100 INFO:tasks.workunit.client.0.smithi023.stdout:0/991: rmdir d6/d98 39 2024-02-28T16:24:27.100 INFO:tasks.workunit.client.0.smithi023.stdout:0/992: readlink d6/db/dab/d82/d72/d143/l67 0 2024-02-28T16:24:27.100 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:27.100 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr fail", "who": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr fail", "who": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd='[{"prefix": "mgr fail", "who": "smithi153.qlkchp"}]': finished 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: mgrmap e27: smithi023.bbebnt(active, starting, since 0.0125969s) 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:24:27.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:27.102 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:27.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:24:27.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:24:27.104 INFO:tasks.workunit.client.0.smithi023.stdout:9/962: rename d0/d7/de to d0/d7/db/dec/d140 0 2024-02-28T16:24:27.104 INFO:tasks.workunit.client.0.smithi023.stdout:4/934: write d13/d2b/d2c/d31/d8d/db3/d90/fe2 [331843,21714] 0 2024-02-28T16:24:27.104 INFO:tasks.workunit.client.0.smithi023.stdout:0/993: write d6/db/d1a/d35/d9d/dce/ff7 [3760790,129043] 0 2024-02-28T16:24:27.104 INFO:tasks.workunit.client.0.smithi023.stdout:0/994: mkdir d6/db/d1a/d26/d31/d33/d37/d8f/d14e/d157 0 2024-02-28T16:24:27.105 INFO:tasks.workunit.client.0.smithi023.stdout:9/963: dwrite d0/d7/db/d18/d23/d28/d32/d3c/f51 [0,4194304] 0 2024-02-28T16:24:27.105 INFO:tasks.workunit.client.0.smithi023.stdout:4/935: link d13/d1d/cf2 d13/c12c 0 2024-02-28T16:24:27.105 INFO:tasks.workunit.client.0.smithi023.stdout:9/964: chown d0/d7/d2c/d7d/cff 7351 1 2024-02-28T16:24:27.105 INFO:tasks.workunit.client.0.smithi023.stdout:4/936: write d13/d2b/d2c/d31/d6e/f97 [1637919,109462] 0 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:seed = 1708457271 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/0: unlink - no file 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/1: readlink - no filename 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/2: rmdir - no directory 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/3: readlink - no filename 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/4: fsync - no filename 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/5: rmdir - no directory 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/6: dwrite - no filename 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:2/0: dwrite - no filename 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:2/1: rename - no filename 2024-02-28T16:24:27.109 INFO:tasks.workunit.client.1.smithi153.stdout:2/2: truncate - no filename 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:2/3: fsync - no filename 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:2/4: read - no filename 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:2/5: write - no filename 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:0/7: creat f0 x:0 0 0 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:0/8: rmdir - no directory 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/0: mkdir d0 0 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/1: rename d0 to d0/d1 22 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/2: stat d0 0 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:3/0: truncate - no filename 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:3/1: truncate - no filename 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:3/2: write - no filename 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:4/0: chown . 7801154 1 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/3: mknod d0/c2 0 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:3/3: creat f0 x:0 0 0 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:4/1: creat f0 x:0 0 0 2024-02-28T16:24:27.110 INFO:tasks.workunit.client.1.smithi153.stdout:5/0: truncate - no filename 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:0/9: dwrite f0 [0,4194304] 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:0/10: write f0 [3827286,89868] 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:5/1: creat f0 x:0 0 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:0/11: creat f1 x:0 0 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/0: mkdir d0 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:3/4: getdents . 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/1: write - no filename 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/2: write - no filename 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/3: rename d0 to d0/d1 22 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/4: truncate - no filename 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:8/0: unlink - no file 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:8/1: dwrite - no filename 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:0/12: rename f0 to f2 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:3/5: write f0 [481872,107297] 0 2024-02-28T16:24:27.111 INFO:tasks.workunit.client.1.smithi153.stdout:0/13: dread - f1 zero size 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:8/2: mkdir d0 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:6/5: symlink d0/l2 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:6/6: rmdir d0 39 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:4/2: dwrite f0 [0,4194304] 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:8/3: mknod d0/c1 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:0/14: symlink l3 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:4/3: write f0 [810927,98886] 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:3/6: link f0 f1 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:9/0: symlink l0 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:9/1: dread - no filename 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:8/4: mknod d0/c2 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:0/15: unlink l3 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:0/16: stat f1 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:5/2: dwrite f0 [0,4194304] 0 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:8/5: chown d0/c2 298 1 2024-02-28T16:24:27.112 INFO:tasks.workunit.client.1.smithi153.stdout:8/6: write - no filename 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:8/7: chown d0/c2 3 1 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:8/8: dwrite - no filename 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:8/9: fdatasync - no filename 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:5/3: write f0 [2563239,6128] 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:4/4: creat f1 x:0 0 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:9/2: mkdir d1 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:9/3: dread - no filename 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:3/7: symlink l2 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:0/17: mkdir d4 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:8/10: symlink d0/l3 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:5/4: rename f0 to f1 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:8/11: creat d0/f4 x:0 0 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:0/18: dread f2 [0,4194304] 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:3/8: write f0 [747929,22150] 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:8/12: fdatasync d0/f4 0 2024-02-28T16:24:27.113 INFO:tasks.workunit.client.1.smithi153.stdout:9/4: mkdir d1/d2 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/9: write f1 [714027,849] 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:4/5: dwrite f0 [0,4194304] 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:0/19: unlink f2 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/7: getdents d0 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/8: stat d0 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/9: write - no filename 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/10: dread - no filename 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:4/6: write f0 [4933789,110417] 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:0/20: write f1 [904318,83629] 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:8/13: symlink d0/l5 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/10: dread f1 [0,4194304] 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/11: symlink d0/l3 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/12: dread - no filename 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:5/5: dwrite f1 [0,4194304] 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:4/7: creat f2 x:0 0 0 2024-02-28T16:24:27.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/11: dread f0 [0,4194304] 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/6: creat f2 x:0 0 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/13: mknod d0/c4 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/7: write f2 [777175,23231] 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/12: mknod c3 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:0/21: dwrite f1 [0,4194304] 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/14: symlink d0/l5 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:4/8: link f2 f3 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/8: rename f2 to f3 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/13: mkdir d4 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/15: rmdir d0 39 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:4/9: mkdir d4 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:8/14: getdents d0 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:8/15: dread - d0/f4 zero size 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/9: unlink f3 0 2024-02-28T16:24:27.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/10: stat f1 0 2024-02-28T16:24:27.116 INFO:tasks.workunit.client.1.smithi153.stdout:0/22: fdatasync f1 0 2024-02-28T16:24:27.116 INFO:tasks.workunit.client.1.smithi153.stdout:0/23: stat f1 0 2024-02-28T16:24:27.116 INFO:tasks.workunit.client.1.smithi153.stdout:0/24: chown f1 142 1 2024-02-28T16:24:27.116 INFO:tasks.workunit.client.0.smithi023.stdout:9/965: symlink d0/d7/db/d18/d23/d28/l141 0 2024-02-28T16:24:27.116 INFO:tasks.workunit.client.0.smithi023.stdout:9/966: write d0/d7/db/dec/d140/d2a/f112 [506100,18050] 0 2024-02-28T16:24:27.116 INFO:tasks.workunit.client.0.smithi023.stdout:9/967: fsync d0/d7/f5d 0 2024-02-28T16:24:27.117 INFO:tasks.workunit.client.0.smithi023.stdout:9/968: symlink d0/d7/db/dec/d140/d34/l142 0 2024-02-28T16:24:27.119 INFO:tasks.workunit.client.0.smithi023.stdout:9/969: creat d0/dd2/f143 x:0 0 0 2024-02-28T16:24:27.122 INFO:tasks.workunit.client.0.smithi023.stdout:0/995: dwrite d6/db/dab/d105/f8b [0,4194304] 0 2024-02-28T16:24:27.128 INFO:tasks.workunit.client.0.smithi023.stdout:0/996: dread - d6/db/d1a/d26/d31/d33/d6e/db1/d112/f13b zero size 2024-02-28T16:24:27.139 INFO:tasks.workunit.client.0.smithi023.stdout:0/997: unlink d6/db/d1a/d26/d31/d33/d6e/db1/lfc 0 2024-02-28T16:24:27.143 INFO:tasks.workunit.client.0.smithi023.stdout:4/937: dwrite d13/d2b/d2c/d31/d6e/f82 [4194304,4194304] 0 2024-02-28T16:24:27.146 INFO:tasks.workunit.client.0.smithi023.stdout:0/998: stat d6/db/d1a/d26/d31/d33/d37/df6/d12d/lba 0 2024-02-28T16:24:27.153 INFO:tasks.workunit.client.0.smithi023.stdout:0/999: mknod d6/db/d1a/d1b/d101/d107/c158 0 2024-02-28T16:24:27.156 INFO:tasks.workunit.client.0.smithi023.stdout:4/938: rename d13/d2b/d2c/d31/dc4/d55/l62 to d13/d2b/d109/d11d/d124/l12d 0 2024-02-28T16:24:27.163 INFO:tasks.workunit.client.0.smithi023.stdout:4/939: mkdir d13/d2b/d2c/d12e 0 2024-02-28T16:24:27.166 INFO:tasks.workunit.client.0.smithi023.stdout:4/940: fsync d13/d1d/d2e/fcc 0 2024-02-28T16:24:27.168 INFO:tasks.workunit.client.0.smithi023.stdout:4/941: chown d13/d1d/d2e/fcc 472 1 2024-02-28T16:24:27.173 INFO:tasks.workunit.client.0.smithi023.stdout:4/942: truncate d13/d2b/d2c/d31/d8d/db3/fed 141262 0 2024-02-28T16:24:27.177 INFO:tasks.workunit.client.0.smithi023.stdout:4/943: chown d13/d2b/d109/d11d/d124/l12d 15519 1 2024-02-28T16:24:27.215 INFO:tasks.workunit.client.0.smithi023.stdout:4/944: dwrite d13/d1d/d58/f68 [0,4194304] 0 2024-02-28T16:24:27.219 INFO:tasks.workunit.client.0.smithi023.stdout:4/945: fsync d13/d1d/d58/f84 0 2024-02-28T16:24:27.220 INFO:tasks.workunit.client.0.smithi023.stdout:4/946: dread - d13/d1e/f125 zero size 2024-02-28T16:24:27.223 INFO:tasks.workunit.client.1.smithi153.stdout:3/14: creat d4/f5 x:0 0 0 2024-02-28T16:24:27.223 INFO:tasks.workunit.client.0.smithi023.stdout:4/947: chown d13/d2b/d2c/f105 226294 1 2024-02-28T16:24:27.224 INFO:tasks.workunit.client.1.smithi153.stdout:6/16: unlink d0/l5 0 2024-02-28T16:24:27.224 INFO:tasks.workunit.client.1.smithi153.stdout:6/17: write - no filename 2024-02-28T16:24:27.224 INFO:tasks.workunit.client.1.smithi153.stdout:6/18: dread - no filename 2024-02-28T16:24:27.226 INFO:tasks.workunit.client.1.smithi153.stdout:6/19: chown d0 58291748 1 2024-02-28T16:24:27.227 INFO:tasks.workunit.client.0.smithi023.stdout:4/948: dread d13/d1d/d58/d104/f111 [0,4194304] 0 2024-02-28T16:24:27.228 INFO:tasks.workunit.client.1.smithi153.stdout:8/16: creat d0/f6 x:0 0 0 2024-02-28T16:24:27.229 INFO:tasks.workunit.client.1.smithi153.stdout:5/11: creat f4 x:0 0 0 2024-02-28T16:24:27.231 INFO:tasks.workunit.client.0.smithi023.stdout:4/949: write d13/d1d/d85/de3/ff0 [4558516,110284] 0 2024-02-28T16:24:27.233 INFO:tasks.workunit.client.1.smithi153.stdout:4/10: creat d4/f5 x:0 0 0 2024-02-28T16:24:27.233 INFO:tasks.workunit.client.1.smithi153.stdout:8/17: truncate d0/f6 131933 0 2024-02-28T16:24:27.234 INFO:tasks.workunit.client.1.smithi153.stdout:0/25: symlink d4/l5 0 2024-02-28T16:24:27.234 INFO:tasks.workunit.client.1.smithi153.stdout:6/20: symlink d0/l6 0 2024-02-28T16:24:27.234 INFO:tasks.workunit.client.1.smithi153.stdout:6/21: dread - no filename 2024-02-28T16:24:27.234 INFO:tasks.workunit.client.1.smithi153.stdout:6/22: dread - no filename 2024-02-28T16:24:27.236 INFO:tasks.workunit.client.1.smithi153.stdout:8/18: chown d0/f6 3 1 2024-02-28T16:24:27.237 INFO:tasks.workunit.client.1.smithi153.stdout:4/11: creat d4/f6 x:0 0 0 2024-02-28T16:24:27.238 INFO:tasks.workunit.client.1.smithi153.stdout:8/19: chown d0/f4 1061 1 2024-02-28T16:24:27.239 INFO:tasks.workunit.client.1.smithi153.stdout:0/26: creat d4/f6 x:0 0 0 2024-02-28T16:24:27.242 INFO:tasks.workunit.client.1.smithi153.stdout:6/23: unlink d0/c4 0 2024-02-28T16:24:27.245 INFO:tasks.workunit.client.1.smithi153.stdout:8/20: mkdir d0/d7 0 2024-02-28T16:24:27.247 INFO:tasks.workunit.client.1.smithi153.stdout:6/24: symlink d0/l7 0 2024-02-28T16:24:27.247 INFO:tasks.workunit.client.1.smithi153.stdout:6/25: write - no filename 2024-02-28T16:24:27.251 INFO:tasks.workunit.client.1.smithi153.stdout:4/12: link f3 d4/f7 0 2024-02-28T16:24:27.251 INFO:tasks.workunit.client.1.smithi153.stdout:0/27: truncate f1 3198620 0 2024-02-28T16:24:27.257 INFO:tasks.workunit.client.1.smithi153.stdout:6/26: creat d0/f8 x:0 0 0 2024-02-28T16:24:27.257 INFO:tasks.workunit.client.1.smithi153.stdout:4/13: fsync f0 0 2024-02-28T16:24:27.260 INFO:tasks.workunit.client.1.smithi153.stdout:6/27: rename d0 to d0/d9 22 2024-02-28T16:24:27.264 INFO:tasks.workunit.client.1.smithi153.stdout:3/15: dwrite f1 [0,4194304] 0 2024-02-28T16:24:27.270 INFO:tasks.workunit.client.0.smithi023.stdout:4/950: dread d13/d2b/d2c/d31/dc4/fd3 [0,4194304] 0 2024-02-28T16:24:27.274 INFO:tasks.workunit.client.1.smithi153.stdout:8/21: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:24:27.274 INFO:tasks.workunit.client.1.smithi153.stdout:0/28: read f1 [1625197,12410] 0 2024-02-28T16:24:27.276 INFO:tasks.workunit.client.0.smithi023.stdout:4/951: readlink d13/d2b/d2c/d31/d8d/db3/de5/d129/ld7 0 2024-02-28T16:24:27.276 INFO:tasks.workunit.client.1.smithi153.stdout:5/12: dwrite f4 [0,4194304] 0 2024-02-28T16:24:27.276 INFO:tasks.workunit.client.1.smithi153.stdout:3/16: creat d4/f6 x:0 0 0 2024-02-28T16:24:27.279 INFO:tasks.workunit.client.1.smithi153.stdout:3/17: write f0 [2265738,61282] 0 2024-02-28T16:24:27.280 INFO:tasks.workunit.client.1.smithi153.stdout:3/18: read f1 [2047978,56708] 0 2024-02-28T16:24:27.281 INFO:tasks.workunit.client.0.smithi023.stdout:4/952: dread - d13/d2b/d2c/d31/dc4/fe9 zero size 2024-02-28T16:24:27.285 INFO:tasks.workunit.client.1.smithi153.stdout:3/19: chown f1 46 1 2024-02-28T16:24:27.285 INFO:tasks.workunit.client.1.smithi153.stdout:5/13: write f1 [4575896,36198] 0 2024-02-28T16:24:27.287 INFO:tasks.workunit.client.0.smithi023.stdout:4/953: mkdir d13/d2b/d2c/d31/dce/d12f 0 2024-02-28T16:24:27.288 INFO:tasks.workunit.client.1.smithi153.stdout:5/14: chown f4 1558852535 1 2024-02-28T16:24:27.299 INFO:tasks.workunit.client.0.smithi023.stdout:9/970: sync 2024-02-28T16:24:27.301 INFO:tasks.workunit.client.1.smithi153.stdout:5/15: chown f4 387 1 2024-02-28T16:24:27.301 INFO:tasks.workunit.client.1.smithi153.stdout:8/22: link d0/f4 d0/f8 0 2024-02-28T16:24:27.304 INFO:tasks.workunit.client.1.smithi153.stdout:3/20: dread - d4/f6 zero size 2024-02-28T16:24:27.310 INFO:tasks.workunit.client.0.smithi023.stdout:9/971: link d0/d7/d2c/d7d/cbb d0/d7/db/dec/d140/d2a/daf/d2f/d44/d95/c144 0 2024-02-28T16:24:27.313 INFO:tasks.workunit.client.1.smithi153.stdout:5/16: creat f5 x:0 0 0 2024-02-28T16:24:27.324 INFO:tasks.workunit.client.1.smithi153.stdout:0/29: dwrite d4/f6 [0,4194304] 0 2024-02-28T16:24:27.324 INFO:tasks.workunit.client.1.smithi153.stdout:3/21: truncate f1 4039368 0 2024-02-28T16:24:27.330 INFO:tasks.workunit.client.0.smithi023.stdout:4/954: dwrite d13/d2b/d2c/d31/dc4/d55/fb2 [0,4194304] 0 2024-02-28T16:24:27.334 INFO:tasks.workunit.client.0.smithi023.stdout:4/955: chown d13/d1d/d2e/l3d 10 1 2024-02-28T16:24:27.335 INFO:tasks.workunit.client.1.smithi153.stdout:0/30: creat d4/f7 x:0 0 0 2024-02-28T16:24:27.337 INFO:tasks.workunit.client.0.smithi023.stdout:4/956: truncate d13/d1e/fa6 3480301 0 2024-02-28T16:24:27.341 INFO:tasks.workunit.client.0.smithi023.stdout:4/957: symlink d13/d2b/d2c/l130 0 2024-02-28T16:24:27.342 INFO:tasks.workunit.client.0.smithi023.stdout:4/958: dread - d13/d1d/d2e/fcc zero size 2024-02-28T16:24:27.344 INFO:tasks.workunit.client.1.smithi153.stdout:6/28: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:24:27.348 INFO:tasks.workunit.client.0.smithi023.stdout:9/972: dread d0/d7/db/dec/d140/f26 [0,4194304] 0 2024-02-28T16:24:27.348 INFO:tasks.workunit.client.1.smithi153.stdout:0/31: creat d4/f8 x:0 0 0 2024-02-28T16:24:27.351 INFO:tasks.workunit.client.0.smithi023.stdout:9/973: read d0/d7/d2c/d84/fb3 [1498516,37977] 0 2024-02-28T16:24:27.352 INFO:tasks.workunit.client.1.smithi153.stdout:6/29: rename d0 to d0/da 22 2024-02-28T16:24:27.354 INFO:tasks.workunit.client.1.smithi153.stdout:4/14: dwrite d4/f7 [0,4194304] 0 2024-02-28T16:24:27.355 INFO:tasks.workunit.client.0.smithi023.stdout:9/974: readlink d0/d7/db/d18/d23/d28/d9c/lb9 0 2024-02-28T16:24:27.359 INFO:tasks.workunit.client.1.smithi153.stdout:8/23: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:27.361 INFO:tasks.workunit.client.1.smithi153.stdout:8/24: stat d0/d7 0 2024-02-28T16:24:27.364 INFO:tasks.workunit.client.0.smithi023.stdout:9/975: mkdir d0/d7/db/dec/d140/d2a/daf/d2f/db0/d113/d12b/d145 0 2024-02-28T16:24:27.371 INFO:tasks.workunit.client.1.smithi153.stdout:8/25: unlink d0/c1 0 2024-02-28T16:24:27.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/26: write d0/f4 [3584143,120034] 0 2024-02-28T16:24:27.383 INFO:tasks.workunit.client.1.smithi153.stdout:4/15: dread f0 [0,4194304] 0 2024-02-28T16:24:27.385 INFO:tasks.workunit.client.1.smithi153.stdout:6/30: fsync d0/f8 0 2024-02-28T16:24:27.390 INFO:tasks.workunit.client.1.smithi153.stdout:8/27: creat d0/f9 x:0 0 0 2024-02-28T16:24:27.390 INFO:tasks.workunit.client.1.smithi153.stdout:0/32: dwrite d4/f6 [0,4194304] 0 2024-02-28T16:24:27.392 INFO:tasks.workunit.client.0.smithi023.stdout:9/976: truncate d0/d7/db/d18/f7c 2324486 0 2024-02-28T16:24:27.392 INFO:tasks.workunit.client.1.smithi153.stdout:3/22: truncate f1 2732326 0 2024-02-28T16:24:27.394 INFO:tasks.workunit.client.1.smithi153.stdout:0/33: creat d4/f9 x:0 0 0 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 172.21.15.153:0/3684309624' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr fail", "who": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "mgr fail", "who": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:24:27.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24365 ' entity='mgr.smithi153.qlkchp' cmd='[{"prefix": "mgr fail", "who": "smithi153.qlkchp"}]': finished 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: mgrmap e27: smithi023.bbebnt(active, starting, since 0.0125969s) 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:24:27.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:24:27.399 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:24:27.400 INFO:tasks.workunit.client.0.smithi023.stdout:9/977: mknod d0/d7/db/d18/d23/d28/c146 0 2024-02-28T16:24:27.400 INFO:tasks.workunit.client.1.smithi153.stdout:8/28: rename d0/c2 to d0/ca 0 2024-02-28T16:24:27.402 INFO:tasks.workunit.client.1.smithi153.stdout:3/23: truncate d4/f5 745510 0 2024-02-28T16:24:27.405 INFO:tasks.workunit.client.1.smithi153.stdout:8/29: read - d0/f9 zero size 2024-02-28T16:24:27.405 INFO:tasks.workunit.client.0.smithi023.stdout:9/978: fsync d0/d7/db/d18/d23/d28/d6e/ff1 0 2024-02-28T16:24:27.406 INFO:tasks.workunit.client.1.smithi153.stdout:4/16: truncate f3 995176 0 2024-02-28T16:24:27.409 INFO:tasks.workunit.client.1.smithi153.stdout:3/24: creat d4/f7 x:0 0 0 2024-02-28T16:24:27.411 INFO:tasks.workunit.client.0.smithi023.stdout:9/979: readlink d0/d7/db/d18/d23/d28/db6/ld3 0 2024-02-28T16:24:27.412 INFO:tasks.workunit.client.1.smithi153.stdout:4/17: write f1 [201224,125867] 0 2024-02-28T16:24:27.413 INFO:tasks.workunit.client.0.smithi023.stdout:9/980: dread - d0/d7/db/d18/d23/d28/d6e/f121 zero size 2024-02-28T16:24:27.414 INFO:tasks.workunit.client.1.smithi153.stdout:3/25: mkdir d4/d8 0 2024-02-28T16:24:27.414 INFO:tasks.workunit.client.1.smithi153.stdout:6/31: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:27.416 INFO:tasks.workunit.client.1.smithi153.stdout:4/18: write f0 [3763470,23602] 0 2024-02-28T16:24:27.416 INFO:tasks.workunit.client.0.smithi023.stdout:9/981: read d0/d7/d2c/d7d/fdf [508107,17321] 0 2024-02-28T16:24:27.417 INFO:tasks.workunit.client.1.smithi153.stdout:3/26: mknod d4/c9 0 2024-02-28T16:24:27.418 INFO:tasks.workunit.client.0.smithi023.stdout:9/982: stat d0/d7/db/dec/d140/d34/f3b 0 2024-02-28T16:24:27.420 INFO:tasks.workunit.client.1.smithi153.stdout:6/32: write d0/f8 [2833747,70801] 0 2024-02-28T16:24:27.426 INFO:tasks.workunit.client.0.smithi023.stdout:9/983: dread d0/d7/d2c/f77 [0,4194304] 0 2024-02-28T16:24:27.426 INFO:tasks.workunit.client.1.smithi153.stdout:6/33: creat d0/fb x:0 0 0 2024-02-28T16:24:27.427 INFO:tasks.workunit.client.1.smithi153.stdout:0/34: dwrite d4/f9 [0,4194304] 0 2024-02-28T16:24:27.427 INFO:tasks.workunit.client.1.smithi153.stdout:3/27: symlink d4/d8/la 0 2024-02-28T16:24:27.436 INFO:tasks.workunit.client.1.smithi153.stdout:6/34: creat d0/fc x:0 0 0 2024-02-28T16:24:27.436 INFO:tasks.workunit.client.1.smithi153.stdout:0/35: creat d4/fa x:0 0 0 2024-02-28T16:24:27.440 INFO:tasks.workunit.client.1.smithi153.stdout:6/35: creat d0/fd x:0 0 0 2024-02-28T16:24:27.443 INFO:tasks.workunit.client.1.smithi153.stdout:0/36: fdatasync d4/f6 0 2024-02-28T16:24:27.445 INFO:tasks.workunit.client.0.smithi023.stdout:9/984: dwrite d0/d7/db/d18/f9d [0,4194304] 0 2024-02-28T16:24:27.447 INFO:tasks.workunit.client.1.smithi153.stdout:8/30: dwrite d0/f9 [0,4194304] 0 2024-02-28T16:24:27.448 INFO:tasks.workunit.client.0.smithi023.stdout:9/985: chown d0/d7/d2c/d7d/cbb 679 1 2024-02-28T16:24:27.448 INFO:tasks.workunit.client.1.smithi153.stdout:0/37: truncate d4/fa 297723 0 2024-02-28T16:24:27.453 INFO:tasks.workunit.client.1.smithi153.stdout:0/38: dread d4/fa [0,4194304] 0 2024-02-28T16:24:27.461 INFO:tasks.workunit.client.0.smithi023.stdout:9/986: dwrite d0/d7/db/dec/f104 [0,4194304] 0 2024-02-28T16:24:27.464 INFO:tasks.workunit.client.1.smithi153.stdout:8/31: link d0/l5 d0/lb 0 2024-02-28T16:24:27.464 INFO:tasks.workunit.client.1.smithi153.stdout:3/28: dread f0 [0,4194304] 0 2024-02-28T16:24:27.465 INFO:tasks.workunit.client.0.smithi023.stdout:9/987: mknod d0/d7/db/d18/d23/d28/d9c/c147 0 2024-02-28T16:24:27.486 INFO:tasks.workunit.client.1.smithi153.stdout:6/36: dwrite d0/fb [0,4194304] 0 2024-02-28T16:24:27.490 INFO:tasks.workunit.client.0.smithi023.stdout:9/988: dwrite d0/d7/db/d18/d23/fc2 [0,4194304] 0 2024-02-28T16:24:27.497 INFO:tasks.workunit.client.0.smithi023.stdout:9/989: getdents d0/d7/db/d18/d23/d28/d32 0 2024-02-28T16:24:27.501 INFO:tasks.workunit.client.0.smithi023.stdout:9/990: getdents d0/dd2/df4 0 2024-02-28T16:24:27.502 INFO:tasks.workunit.client.0.smithi023.stdout:9/991: readlink d0/d7/l5c 0 2024-02-28T16:24:27.502 INFO:tasks.workunit.client.1.smithi153.stdout:0/39: dwrite d4/f9 [4194304,4194304] 0 2024-02-28T16:24:27.507 INFO:tasks.workunit.client.0.smithi023.stdout:9/992: getdents d0/d7/db/dec/d136 0 2024-02-28T16:24:27.509 INFO:tasks.workunit.client.0.smithi023.stdout:4/959: sync 2024-02-28T16:24:27.511 INFO:tasks.workunit.client.1.smithi153.stdout:3/29: dwrite d4/f6 [0,4194304] 0 2024-02-28T16:24:27.513 INFO:tasks.workunit.client.0.smithi023.stdout:9/993: getdents d0/d7/db/dec/d140/d2a/daf/d2f/db0/d113/d12b/d145 0 2024-02-28T16:24:27.515 INFO:tasks.workunit.client.0.smithi023.stdout:4/960: fsync d13/d2b/d2c/d31/d8d/db3/de5/d129/faa 0 2024-02-28T16:24:27.520 INFO:tasks.workunit.client.1.smithi153.stdout:0/40: link d4/f9 d4/fb 0 2024-02-28T16:24:27.520 INFO:tasks.workunit.client.0.smithi023.stdout:9/994: symlink d0/d7/db/dec/d140/l148 0 2024-02-28T16:24:27.521 INFO:tasks.workunit.client.1.smithi153.stdout:3/30: mknod d4/d8/cb 0 2024-02-28T16:24:27.524 INFO:tasks.workunit.client.0.smithi023.stdout:4/961: truncate d13/d2b/d2c/d31/dc4/d10f/f115 155355 0 2024-02-28T16:24:27.528 INFO:tasks.workunit.client.0.smithi023.stdout:4/962: mknod d13/d1d/d85/c131 0 2024-02-28T16:24:27.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/41: fdatasync d4/f6 0 2024-02-28T16:24:27.529 INFO:tasks.workunit.client.0.smithi023.stdout:9/995: symlink d0/d7/db/dec/d140/d2a/l149 0 2024-02-28T16:24:27.532 INFO:tasks.workunit.client.0.smithi023.stdout:9/996: stat d0/d7/db/dec/d140/d2a/daf/d2f/d4d/c58 0 2024-02-28T16:24:27.535 INFO:tasks.workunit.client.1.smithi153.stdout:6/37: dwrite d0/fc [0,4194304] 0 2024-02-28T16:24:27.538 INFO:tasks.workunit.client.1.smithi153.stdout:6/38: write d0/f8 [3783001,114018] 0 2024-02-28T16:24:27.540 INFO:tasks.workunit.client.1.smithi153.stdout:0/42: rmdir d4 39 2024-02-28T16:24:27.545 INFO:tasks.workunit.client.0.smithi023.stdout:4/963: creat d13/d1d/d2d/f132 x:0 0 0 2024-02-28T16:24:27.548 INFO:tasks.workunit.client.0.smithi023.stdout:4/964: unlink d13/d2b/f51 0 2024-02-28T16:24:27.551 INFO:tasks.workunit.client.0.smithi023.stdout:4/965: unlink d13/d2b/d2c/lf5 0 2024-02-28T16:24:27.553 INFO:tasks.workunit.client.0.smithi023.stdout:4/966: mkdir d13/d1d/d133 0 2024-02-28T16:24:27.557 INFO:tasks.workunit.client.0.smithi023.stdout:4/967: creat d13/d1d/d58/ddb/d119/f134 x:0 0 0 2024-02-28T16:24:27.560 INFO:tasks.workunit.client.0.smithi023.stdout:4/968: fdatasync d13/d2b/d2c/d31/d8d/db3/de5/d129/faa 0 2024-02-28T16:24:27.563 INFO:tasks.workunit.client.0.smithi023.stdout:4/969: creat d13/d2b/d2c/d31/d8d/d114/f135 x:0 0 0 2024-02-28T16:24:27.573 INFO:tasks.workunit.client.0.smithi023.stdout:4/970: getdents d13/d2b 0 2024-02-28T16:24:27.577 INFO:tasks.workunit.client.0.smithi023.stdout:4/971: mkdir d13/d2b/d2c/d31/dce/d12f/d136 0 2024-02-28T16:24:27.579 INFO:tasks.workunit.client.0.smithi023.stdout:4/972: fsync d13/d1d/d58/ddb/d119/f134 0 2024-02-28T16:24:27.584 INFO:tasks.workunit.client.0.smithi023.stdout:4/973: write d13/d2b/ff6 [681682,13700] 0 2024-02-28T16:24:27.588 INFO:tasks.workunit.client.0.smithi023.stdout:9/997: dread d0/d7/db/d18/d23/d28/d9c/fb1 [0,4194304] 0 2024-02-28T16:24:27.594 INFO:tasks.workunit.client.0.smithi023.stdout:9/998: rename d0/d7/db/dec/d140/d2a/daf/d2f/db0/d113 to d0/d7/db/d18/d23/d28/d6e/d14a 0 2024-02-28T16:24:27.595 INFO:tasks.workunit.client.1.smithi153.stdout:0/43: write d4/f6 [5029306,908] 0 2024-02-28T16:24:27.597 INFO:tasks.workunit.client.0.smithi023.stdout:9/999: chown d0/d7/d2c/c73 5548607 1 2024-02-28T16:24:27.598 INFO:tasks.workunit.client.0.smithi023.stdout:4/974: dwrite fb [0,4194304] 0 2024-02-28T16:24:27.602 INFO:tasks.workunit.client.1.smithi153.stdout:3/31: dwrite d4/f5 [0,4194304] 0 2024-02-28T16:24:27.607 INFO:tasks.workunit.client.1.smithi153.stdout:3/32: rmdir d4 39 2024-02-28T16:24:27.616 INFO:tasks.workunit.client.1.smithi153.stdout:0/44: dread f1 [0,4194304] 0 2024-02-28T16:24:27.618 INFO:tasks.workunit.client.1.smithi153.stdout:0/45: rmdir d4 39 2024-02-28T16:24:27.620 INFO:tasks.workunit.client.0.smithi023.stdout:4/975: dwrite d13/d2b/d2c/d31/dce/fdc [0,4194304] 0 2024-02-28T16:24:27.628 INFO:tasks.workunit.client.0.smithi023.stdout:4/976: symlink d13/d2b/d2c/l137 0 2024-02-28T16:24:27.664 INFO:tasks.workunit.client.0.smithi023.stdout:4/977: symlink d13/d1d/d85/l138 0 2024-02-28T16:24:27.703 INFO:tasks.workunit.client.1.smithi153.stdout:0/46: mkdir d4/dc 0 2024-02-28T16:24:27.703 INFO:tasks.workunit.client.1.smithi153.stdout:3/33: dwrite f1 [0,4194304] 0 2024-02-28T16:24:27.711 INFO:tasks.workunit.client.1.smithi153.stdout:3/34: chown d4/d8/cb 43 1 2024-02-28T16:24:27.725 INFO:tasks.workunit.client.1.smithi153.stdout:3/35: rename d4/c9 to d4/cc 0 2024-02-28T16:24:27.726 INFO:tasks.workunit.client.1.smithi153.stdout:0/47: dread d4/f9 [4194304,4194304] 0 2024-02-28T16:24:27.734 INFO:tasks.workunit.client.1.smithi153.stdout:3/36: rename f1 to d4/d8/fd 0 2024-02-28T16:24:27.735 INFO:tasks.workunit.client.1.smithi153.stdout:0/48: creat d4/fd x:0 0 0 2024-02-28T16:24:27.740 INFO:tasks.workunit.client.1.smithi153.stdout:0/49: unlink d4/fd 0 2024-02-28T16:24:27.745 INFO:tasks.workunit.client.1.smithi153.stdout:3/37: write d4/d8/fd [3278200,124740] 0 2024-02-28T16:24:27.747 INFO:tasks.workunit.client.1.smithi153.stdout:0/50: creat d4/fe x:0 0 0 2024-02-28T16:24:27.767 INFO:tasks.workunit.client.1.smithi153.stdout:3/38: dwrite f0 [4194304,4194304] 0 2024-02-28T16:24:27.777 INFO:tasks.workunit.client.1.smithi153.stdout:0/51: dwrite d4/f9 [4194304,4194304] 0 2024-02-28T16:24:27.785 INFO:tasks.workunit.client.1.smithi153.stdout:0/52: creat d4/dc/ff x:0 0 0 2024-02-28T16:24:27.790 INFO:tasks.workunit.client.1.smithi153.stdout:0/53: symlink d4/dc/l10 0 2024-02-28T16:24:27.791 INFO:tasks.workunit.client.1.smithi153.stdout:0/54: readlink d4/dc/l10 0 2024-02-28T16:24:27.804 INFO:tasks.workunit.client.0.smithi023.stdout:4/978: truncate d13/d1d/d58/f5c 838744 0 2024-02-28T16:24:27.808 INFO:tasks.workunit.client.0.smithi023.stdout:4/979: write d13/d2b/d2c/d31/dc4/d55/f6c [2117485,45743] 0 2024-02-28T16:24:27.812 INFO:tasks.workunit.client.0.smithi023.stdout:4/980: write d13/d2b/d2c/d31/d8d/db3/de5/feb [4139159,31524] 0 2024-02-28T16:24:27.815 INFO:tasks.workunit.client.0.smithi023.stdout:4/981: mkdir d13/d1e/d139 0 2024-02-28T16:24:27.816 INFO:tasks.workunit.client.0.smithi023.stdout:4/982: read d13/d2b/d2c/d31/dc4/fd3 [1717594,95174] 0 2024-02-28T16:24:27.832 INFO:tasks.workunit.client.0.smithi023.stdout:4/983: dwrite d13/d2b/d2c/d31/d8d/db3/fed [0,4194304] 0 2024-02-28T16:24:27.838 INFO:tasks.workunit.client.0.smithi023.stdout:4/984: link d13/d2b/d2c/d31/d6e/f82 d13/d1d/d85/de3/f13a 0 2024-02-28T16:24:27.957 INFO:tasks.workunit.client.1.smithi153.stdout:3/39: getdents d4 0 2024-02-28T16:24:27.964 INFO:tasks.workunit.client.1.smithi153.stdout:3/40: symlink d4/le 0 2024-02-28T16:24:27.968 INFO:tasks.workunit.client.1.smithi153.stdout:3/41: link d4/f5 d4/ff 0 2024-02-28T16:24:27.970 INFO:tasks.workunit.client.1.smithi153.stdout:3/42: chown d4/d8/la 16517 1 2024-02-28T16:24:27.972 INFO:tasks.workunit.client.1.smithi153.stdout:3/43: chown d4/d8/cb 217 1 2024-02-28T16:24:27.975 INFO:tasks.workunit.client.1.smithi153.stdout:3/44: creat d4/d8/f10 x:0 0 0 2024-02-28T16:24:27.976 INFO:tasks.workunit.client.1.smithi153.stdout:3/45: chown d4/d8/f10 196 1 2024-02-28T16:24:27.978 INFO:tasks.workunit.client.1.smithi153.stdout:3/46: read d4/f5 [956660,117350] 0 2024-02-28T16:24:27.980 INFO:tasks.workunit.client.1.smithi153.stdout:3/47: rename d4 to d4/d11 22 2024-02-28T16:24:27.983 INFO:tasks.workunit.client.1.smithi153.stdout:3/48: mknod d4/d8/c12 0 2024-02-28T16:24:27.985 INFO:tasks.workunit.client.1.smithi153.stdout:3/49: mkdir d4/d13 0 2024-02-28T16:24:27.992 INFO:tasks.workunit.client.0.smithi023.stdout:4/985: rmdir d13/d2b/d2c/d31 39 2024-02-28T16:24:28.000 INFO:tasks.workunit.client.0.smithi023.stdout:4/986: unlink d13/d2b/d2c/d31/dc4/fe9 0 2024-02-28T16:24:28.001 INFO:tasks.workunit.client.1.smithi153.stdout:0/55: dwrite d4/fa [0,4194304] 0 2024-02-28T16:24:28.006 INFO:tasks.workunit.client.1.smithi153.stdout:0/56: truncate f1 3549992 0 2024-02-28T16:24:28.010 INFO:tasks.workunit.client.1.smithi153.stdout:0/57: symlink d4/dc/l11 0 2024-02-28T16:24:28.010 INFO:tasks.workunit.client.1.smithi153.stdout:3/50: truncate d4/d8/fd 5989961 0 2024-02-28T16:24:28.012 INFO:tasks.workunit.client.1.smithi153.stdout:3/51: chown d4/d8/c12 15304 1 2024-02-28T16:24:28.019 INFO:tasks.workunit.client.1.smithi153.stdout:0/58: rename f1 to d4/f12 0 2024-02-28T16:24:28.022 INFO:tasks.workunit.client.0.smithi023.stdout:4/987: dwrite d13/d1d/d85/de3/f13a [0,4194304] 0 2024-02-28T16:24:28.026 INFO:tasks.workunit.client.0.smithi023.stdout:4/988: unlink d13/d2b/f4f 0 2024-02-28T16:24:28.029 INFO:tasks.workunit.client.1.smithi153.stdout:0/59: dread d4/fb [4194304,4194304] 0 2024-02-28T16:24:28.032 INFO:tasks.workunit.client.0.smithi023.stdout:4/989: mknod d13/d2b/d2c/d31/dce/d128/c13b 0 2024-02-28T16:24:28.033 INFO:tasks.workunit.client.0.smithi023.stdout:4/990: chown d13/fae 16439935 1 2024-02-28T16:24:28.035 INFO:tasks.workunit.client.1.smithi153.stdout:0/60: rename d4/dc/ff to d4/f13 0 2024-02-28T16:24:28.038 INFO:tasks.workunit.client.0.smithi023.stdout:4/991: creat d13/d1d/d2d/da9/f13c x:0 0 0 2024-02-28T16:24:28.044 INFO:tasks.workunit.client.0.smithi023.stdout:4/992: getdents d13/d2b/d2c/d31/dce/d128 0 2024-02-28T16:24:28.047 INFO:tasks.workunit.client.1.smithi153.stdout:0/61: getdents d4/dc 0 2024-02-28T16:24:28.048 INFO:tasks.workunit.client.0.smithi023.stdout:4/993: rmdir d13/d1d/d58/d104 39 2024-02-28T16:24:28.050 INFO:tasks.workunit.client.1.smithi153.stdout:0/62: creat d4/f14 x:0 0 0 2024-02-28T16:24:28.050 INFO:tasks.workunit.client.1.smithi153.stdout:0/63: read - d4/fe zero size 2024-02-28T16:24:28.053 INFO:tasks.workunit.client.1.smithi153.stdout:0/64: mknod d4/dc/c15 0 2024-02-28T16:24:28.053 INFO:tasks.workunit.client.1.smithi153.stdout:0/65: fdatasync d4/fe 0 2024-02-28T16:24:28.056 INFO:tasks.workunit.client.1.smithi153.stdout:0/66: rmdir d4/dc 39 2024-02-28T16:24:28.059 INFO:tasks.workunit.client.0.smithi023.stdout:4/994: truncate d13/d2b/d2c/d31/d6e/f97 2175192 0 2024-02-28T16:24:28.060 INFO:tasks.workunit.client.0.smithi023.stdout:4/995: readlink d13/d1d/d2d/l121 0 2024-02-28T16:24:28.064 INFO:tasks.workunit.client.0.smithi023.stdout:4/996: symlink d13/d2b/d2c/d31/d6e/de4/d122/l13d 0 2024-02-28T16:24:28.067 INFO:tasks.workunit.client.0.smithi023.stdout:4/997: mknod d13/d2b/d2c/d31/d8d/db3/de5/c13e 0 2024-02-28T16:24:28.068 INFO:tasks.workunit.client.1.smithi153.stdout:0/67: dwrite d4/f9 [4194304,4194304] 0 2024-02-28T16:24:28.072 INFO:tasks.workunit.client.0.smithi023.stdout:4/998: creat d13/d2b/d109/d11d/d124/f13f x:0 0 0 2024-02-28T16:24:28.089 INFO:tasks.workunit.client.0.smithi023.stdout:4/999: rename d13/d2b/d2c/d31/d6e/de4/d122 to d13/d1d/d58/d104/d140 0 2024-02-28T16:24:28.098 INFO:tasks.workunit.client.0.smithi023.stderr:+ rm -rf -- ./tmp.gAGHJj6wpM 2024-02-28T16:24:28.139 INFO:tasks.workunit.client.1.smithi153.stdout:0/68: mknod d4/c16 0 2024-02-28T16:24:28.155 INFO:tasks.workunit.client.1.smithi153.stdout:0/69: dwrite d4/f6 [4194304,4194304] 0 2024-02-28T16:24:28.180 INFO:tasks.workunit.client.1.smithi153.stdout:2/6: sync 2024-02-28T16:24:28.180 INFO:tasks.workunit.client.1.smithi153.stdout:2/7: write - no filename 2024-02-28T16:24:28.181 INFO:tasks.workunit.client.1.smithi153.stdout:1/4: sync 2024-02-28T16:24:28.181 INFO:tasks.workunit.client.1.smithi153.stdout:7/0: sync 2024-02-28T16:24:28.181 INFO:tasks.workunit.client.1.smithi153.stdout:7/1: write - no filename 2024-02-28T16:24:28.181 INFO:tasks.workunit.client.1.smithi153.stdout:2/8: chown . 388702378 1 2024-02-28T16:24:28.181 INFO:tasks.workunit.client.1.smithi153.stdout:7/2: chown . 11378101 1 2024-02-28T16:24:28.184 INFO:tasks.workunit.client.1.smithi153.stdout:1/5: mknod d0/c3 0 2024-02-28T16:24:28.189 INFO:tasks.workunit.client.1.smithi153.stdout:2/9: symlink l0 0 2024-02-28T16:24:28.189 INFO:tasks.workunit.client.1.smithi153.stdout:2/10: truncate - no filename 2024-02-28T16:24:28.191 INFO:tasks.workunit.client.1.smithi153.stdout:1/6: creat d0/f4 x:0 0 0 2024-02-28T16:24:28.191 INFO:tasks.workunit.client.1.smithi153.stdout:7/3: mknod c0 0 2024-02-28T16:24:28.193 INFO:tasks.workunit.client.1.smithi153.stdout:7/4: chown c0 474285057 1 2024-02-28T16:24:28.193 INFO:tasks.workunit.client.1.smithi153.stdout:1/7: dread - d0/f4 zero size 2024-02-28T16:24:28.195 INFO:tasks.workunit.client.1.smithi153.stdout:7/5: chown c0 56013411 1 2024-02-28T16:24:28.195 INFO:tasks.workunit.client.1.smithi153.stdout:7/6: rmdir - no directory 2024-02-28T16:24:28.195 INFO:tasks.workunit.client.1.smithi153.stdout:7/7: dread - no filename 2024-02-28T16:24:28.195 INFO:tasks.workunit.client.1.smithi153.stdout:7/8: dread - no filename 2024-02-28T16:24:28.195 INFO:tasks.workunit.client.1.smithi153.stdout:7/9: write - no filename 2024-02-28T16:24:28.198 INFO:tasks.workunit.client.1.smithi153.stdout:1/8: symlink d0/l5 0 2024-02-28T16:24:28.199 INFO:tasks.workunit.client.1.smithi153.stdout:2/11: link l0 l1 0 2024-02-28T16:24:28.199 INFO:tasks.workunit.client.1.smithi153.stdout:2/12: truncate - no filename 2024-02-28T16:24:28.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/9: fdatasync d0/f4 0 2024-02-28T16:24:28.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/10: unlink c0 0 2024-02-28T16:24:28.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/11: unlink - no file 2024-02-28T16:24:28.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/12: rename - no filename 2024-02-28T16:24:28.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/13: dread - no filename 2024-02-28T16:24:28.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/14: chown . 14464267 1 2024-02-28T16:24:28.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/15: rename - no filename 2024-02-28T16:24:28.202 INFO:tasks.workunit.client.1.smithi153.stdout:2/13: mkdir d2 0 2024-02-28T16:24:28.202 INFO:tasks.workunit.client.1.smithi153.stdout:2/14: dread - no filename 2024-02-28T16:24:28.204 INFO:tasks.workunit.client.1.smithi153.stdout:1/10: symlink d0/l6 0 2024-02-28T16:24:28.205 INFO:tasks.workunit.client.1.smithi153.stdout:7/16: mkdir d1 0 2024-02-28T16:24:28.206 INFO:tasks.workunit.client.1.smithi153.stdout:1/11: dread - d0/f4 zero size 2024-02-28T16:24:28.208 INFO:tasks.workunit.client.1.smithi153.stdout:2/15: creat d2/f3 x:0 0 0 2024-02-28T16:24:28.209 INFO:tasks.workunit.client.1.smithi153.stdout:7/17: creat d1/f2 x:0 0 0 2024-02-28T16:24:28.210 INFO:tasks.workunit.client.1.smithi153.stdout:1/12: symlink d0/l7 0 2024-02-28T16:24:28.211 INFO:tasks.workunit.client.1.smithi153.stdout:2/16: creat d2/f4 x:0 0 0 2024-02-28T16:24:28.211 INFO:tasks.workunit.client.1.smithi153.stdout:7/18: fdatasync d1/f2 0 2024-02-28T16:24:28.217 INFO:tasks.workunit.client.1.smithi153.stdout:7/19: write d1/f2 [301596,73825] 0 2024-02-28T16:24:28.217 INFO:tasks.workunit.client.1.smithi153.stdout:7/20: readlink - no filename 2024-02-28T16:24:28.221 INFO:tasks.workunit.client.1.smithi153.stdout:7/21: creat d1/f3 x:0 0 0 2024-02-28T16:24:28.231 INFO:tasks.workunit.client.1.smithi153.stdout:1/13: rmdir d0 39 2024-02-28T16:24:28.241 INFO:tasks.workunit.client.1.smithi153.stdout:1/14: creat d0/f8 x:0 0 0 2024-02-28T16:24:28.246 INFO:tasks.workunit.client.1.smithi153.stdout:1/15: fdatasync d0/f4 0 2024-02-28T16:24:28.255 INFO:tasks.workunit.client.1.smithi153.stdout:2/17: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:24:28.259 INFO:tasks.workunit.client.1.smithi153.stdout:7/22: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:24:28.260 INFO:tasks.workunit.client.1.smithi153.stdout:2/18: mknod d2/c5 0 2024-02-28T16:24:28.262 INFO:tasks.workunit.client.1.smithi153.stdout:2/19: dread - d2/f4 zero size 2024-02-28T16:24:28.270 INFO:tasks.workunit.client.1.smithi153.stdout:2/20: rename d2/f4 to d2/f6 0 2024-02-28T16:24:28.272 INFO:tasks.workunit.client.1.smithi153.stdout:7/23: dread d1/f2 [0,4194304] 0 2024-02-28T16:24:28.273 INFO:tasks.workunit.client.1.smithi153.stdout:2/21: chown l0 26249825 1 2024-02-28T16:24:28.276 INFO:tasks.workunit.client.1.smithi153.stdout:7/24: unlink d1/f2 0 2024-02-28T16:24:28.279 INFO:tasks.workunit.client.1.smithi153.stdout:2/22: link d2/f3 d2/f7 0 2024-02-28T16:24:28.282 INFO:tasks.workunit.client.1.smithi153.stdout:2/23: mknod d2/c8 0 2024-02-28T16:24:28.287 INFO:tasks.workunit.client.1.smithi153.stdout:3/52: sync 2024-02-28T16:24:28.287 INFO:tasks.workunit.client.1.smithi153.stdout:5/17: sync 2024-02-28T16:24:28.287 INFO:tasks.workunit.client.1.smithi153.stdout:9/5: sync 2024-02-28T16:24:28.287 INFO:tasks.workunit.client.1.smithi153.stdout:6/39: sync 2024-02-28T16:24:28.287 INFO:tasks.workunit.client.1.smithi153.stdout:8/32: sync 2024-02-28T16:24:28.287 INFO:tasks.workunit.client.1.smithi153.stdout:4/19: sync 2024-02-28T16:24:28.288 INFO:tasks.workunit.client.1.smithi153.stdout:6/40: chown d0 2047580 1 2024-02-28T16:24:28.293 INFO:tasks.workunit.client.1.smithi153.stdout:5/18: creat f6 x:0 0 0 2024-02-28T16:24:28.294 INFO:tasks.workunit.client.1.smithi153.stdout:6/41: fsync d0/fb 0 2024-02-28T16:24:28.297 INFO:tasks.workunit.client.1.smithi153.stdout:2/24: link l0 d2/l9 0 2024-02-28T16:24:28.300 INFO:tasks.workunit.client.1.smithi153.stdout:9/6: creat d1/d2/f3 x:0 0 0 2024-02-28T16:24:28.300 INFO:tasks.workunit.client.1.smithi153.stdout:6/42: read - d0/fd zero size 2024-02-28T16:24:28.301 INFO:tasks.workunit.client.1.smithi153.stdout:7/25: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:24:28.302 INFO:tasks.workunit.client.1.smithi153.stdout:7/26: readlink - no filename 2024-02-28T16:24:28.304 INFO:tasks.workunit.client.1.smithi153.stdout:5/19: rename f6 to f7 0 2024-02-28T16:24:28.305 INFO:tasks.workunit.client.1.smithi153.stdout:7/27: chown d1 293550037 1 2024-02-28T16:24:28.305 INFO:tasks.workunit.client.1.smithi153.stdout:3/53: link d4/d8/f10 d4/d13/f14 0 2024-02-28T16:24:28.306 INFO:tasks.workunit.client.1.smithi153.stdout:5/20: fdatasync f1 0 2024-02-28T16:24:28.308 INFO:tasks.workunit.client.1.smithi153.stdout:7/28: chown d1/f3 65338 1 2024-02-28T16:24:28.310 INFO:tasks.workunit.client.1.smithi153.stdout:7/29: stat d1/f3 0 2024-02-28T16:24:28.314 INFO:tasks.workunit.client.1.smithi153.stdout:4/20: dwrite f3 [0,4194304] 0 2024-02-28T16:24:28.326 INFO:tasks.workunit.client.1.smithi153.stdout:8/33: dread d0/f4 [0,4194304] 0 2024-02-28T16:24:28.327 INFO:tasks.workunit.client.1.smithi153.stdout:0/70: sync 2024-02-28T16:24:28.328 INFO:tasks.workunit.client.1.smithi153.stdout:1/16: sync 2024-02-28T16:24:28.328 INFO:tasks.workunit.client.1.smithi153.stdout:7/30: getdents d1 0 2024-02-28T16:24:28.340 INFO:tasks.workunit.client.1.smithi153.stdout:5/21: dwrite f5 [0,4194304] 0 2024-02-28T16:24:28.340 INFO:tasks.workunit.client.1.smithi153.stdout:7/31: mkdir d1/d4 0 2024-02-28T16:24:28.344 INFO:tasks.workunit.client.1.smithi153.stdout:5/22: stat f1 0 2024-02-28T16:24:28.345 INFO:tasks.workunit.client.1.smithi153.stdout:1/17: truncate d0/f4 626780 0 2024-02-28T16:24:28.346 INFO:tasks.workunit.client.1.smithi153.stdout:9/7: fsync d1/d2/f3 0 2024-02-28T16:24:28.348 INFO:tasks.workunit.client.1.smithi153.stdout:8/34: rmdir d0/d7 0 2024-02-28T16:24:28.351 INFO:tasks.workunit.client.1.smithi153.stdout:7/32: symlink d1/l5 0 2024-02-28T16:24:28.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/71: creat d4/dc/f17 x:0 0 0 2024-02-28T16:24:28.358 INFO:tasks.workunit.client.1.smithi153.stdout:8/35: chown d0/f6 0 1 2024-02-28T16:24:28.358 INFO:tasks.workunit.client.1.smithi153.stdout:6/43: truncate d0/fc 2024939 0 2024-02-28T16:24:28.360 INFO:tasks.workunit.client.1.smithi153.stdout:9/8: dread - d1/d2/f3 zero size 2024-02-28T16:24:28.362 INFO:tasks.workunit.client.1.smithi153.stdout:1/18: rename d0/f4 to d0/f9 0 2024-02-28T16:24:28.363 INFO:tasks.workunit.client.1.smithi153.stdout:7/33: chown d1/f3 268211 1 2024-02-28T16:24:28.364 INFO:tasks.workunit.client.1.smithi153.stdout:0/72: dread - d4/f8 zero size 2024-02-28T16:24:28.365 INFO:tasks.workunit.client.1.smithi153.stdout:5/23: link f5 f8 0 2024-02-28T16:24:28.367 INFO:tasks.workunit.client.1.smithi153.stdout:7/34: fsync d1/f3 0 2024-02-28T16:24:28.367 INFO:tasks.workunit.client.1.smithi153.stdout:4/21: dwrite f0 [0,4194304] 0 2024-02-28T16:24:28.371 INFO:tasks.workunit.client.1.smithi153.stdout:9/9: unlink d1/d2/f3 0 2024-02-28T16:24:28.376 INFO:tasks.workunit.client.1.smithi153.stdout:7/35: chown d1/f3 0 1 2024-02-28T16:24:28.376 INFO:tasks.workunit.client.1.smithi153.stdout:4/22: dread - d4/f6 zero size 2024-02-28T16:24:28.376 INFO:tasks.workunit.client.1.smithi153.stdout:2/25: dwrite d2/f7 [4194304,4194304] 0 2024-02-28T16:24:28.378 INFO:tasks.workunit.client.1.smithi153.stdout:3/54: dwrite d4/ff [0,4194304] 0 2024-02-28T16:24:28.378 INFO:tasks.workunit.client.1.smithi153.stdout:1/19: fdatasync d0/f9 0 2024-02-28T16:24:28.382 INFO:tasks.workunit.client.1.smithi153.stdout:5/24: rename f5 to f9 0 2024-02-28T16:24:28.384 INFO:tasks.workunit.client.1.smithi153.stdout:0/73: creat d4/dc/f18 x:0 0 0 2024-02-28T16:24:28.385 INFO:tasks.workunit.client.1.smithi153.stdout:0/74: chown d4/f8 175346751 1 2024-02-28T16:24:28.387 INFO:tasks.workunit.client.1.smithi153.stdout:0/75: write d4/f9 [7054320,85784] 0 2024-02-28T16:24:28.388 INFO:tasks.workunit.client.1.smithi153.stdout:8/36: link d0/f8 d0/fc 0 2024-02-28T16:24:28.394 INFO:tasks.workunit.client.1.smithi153.stdout:9/10: creat d1/f4 x:0 0 0 2024-02-28T16:24:28.395 INFO:tasks.workunit.client.1.smithi153.stdout:9/11: stat d1/d2 0 2024-02-28T16:24:28.398 INFO:tasks.workunit.client.1.smithi153.stdout:4/23: mknod d4/c8 0 2024-02-28T16:24:28.398 INFO:tasks.workunit.client.1.smithi153.stdout:2/26: symlink d2/la 0 2024-02-28T16:24:28.400 INFO:tasks.workunit.client.1.smithi153.stdout:3/55: unlink d4/ff 0 2024-02-28T16:24:28.401 INFO:tasks.workunit.client.1.smithi153.stdout:1/20: creat d0/fa x:0 0 0 2024-02-28T16:24:28.403 INFO:tasks.workunit.client.1.smithi153.stdout:3/56: rename d4/d8 to d4/d8/d15 22 2024-02-28T16:24:28.403 INFO:tasks.workunit.client.1.smithi153.stdout:5/25: mkdir da 0 2024-02-28T16:24:28.406 INFO:tasks.workunit.client.1.smithi153.stdout:1/21: chown d0/l5 1085 1 2024-02-28T16:24:28.407 INFO:tasks.workunit.client.1.smithi153.stdout:0/76: dread d4/fa [0,4194304] 0 2024-02-28T16:24:28.408 INFO:tasks.workunit.client.1.smithi153.stdout:8/37: mknod d0/cd 0 2024-02-28T16:24:28.409 INFO:tasks.workunit.client.1.smithi153.stdout:1/22: write d0/fa [175385,95754] 0 2024-02-28T16:24:28.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/38: stat d0/f8 0 2024-02-28T16:24:28.409 INFO:tasks.workunit.client.1.smithi153.stdout:9/12: mkdir d1/d5 0 2024-02-28T16:24:28.410 INFO:tasks.workunit.client.1.smithi153.stdout:1/23: dread - d0/f8 zero size 2024-02-28T16:24:28.413 INFO:tasks.workunit.client.1.smithi153.stdout:9/13: write d1/f4 [157996,61914] 0 2024-02-28T16:24:28.413 INFO:tasks.workunit.client.1.smithi153.stdout:1/24: dread - d0/f8 zero size 2024-02-28T16:24:28.417 INFO:tasks.workunit.client.1.smithi153.stdout:3/57: symlink d4/d8/l16 0 2024-02-28T16:24:28.417 INFO:tasks.workunit.client.1.smithi153.stdout:6/44: sync 2024-02-28T16:24:28.418 INFO:tasks.workunit.client.1.smithi153.stdout:2/27: dread d2/f3 [0,4194304] 0 2024-02-28T16:24:28.421 INFO:tasks.workunit.client.1.smithi153.stdout:7/36: link d1/l5 d1/d4/l6 0 2024-02-28T16:24:28.421 INFO:tasks.workunit.client.1.smithi153.stdout:1/25: dread d0/fa [0,4194304] 0 2024-02-28T16:24:28.421 INFO:tasks.workunit.client.1.smithi153.stdout:0/77: write d4/fa [5203315,86534] 0 2024-02-28T16:24:28.422 INFO:tasks.workunit.client.1.smithi153.stdout:2/28: chown d2/c8 7 1 2024-02-28T16:24:28.422 INFO:tasks.workunit.client.1.smithi153.stdout:8/39: readlink d0/l5 0 2024-02-28T16:24:28.422 INFO:tasks.workunit.client.1.smithi153.stdout:9/14: fsync d1/f4 0 2024-02-28T16:24:28.425 INFO:tasks.workunit.client.1.smithi153.stdout:4/24: rmdir d4 39 2024-02-28T16:24:28.425 INFO:tasks.workunit.client.1.smithi153.stdout:1/26: write d0/f9 [1314507,62609] 0 2024-02-28T16:24:28.427 INFO:tasks.workunit.client.1.smithi153.stdout:5/26: creat da/fb x:0 0 0 2024-02-28T16:24:28.430 INFO:tasks.workunit.client.1.smithi153.stdout:7/37: write d1/f3 [4702443,50208] 0 2024-02-28T16:24:28.430 INFO:tasks.workunit.client.1.smithi153.stdout:2/29: rmdir d2 39 2024-02-28T16:24:28.431 INFO:tasks.workunit.client.1.smithi153.stdout:7/38: chown d1/d4 26 1 2024-02-28T16:24:28.439 INFO:tasks.workunit.client.1.smithi153.stdout:7/39: dread d1/f3 [4194304,4194304] 0 2024-02-28T16:24:28.439 INFO:tasks.workunit.client.1.smithi153.stdout:6/45: dread d0/fb [0,4194304] 0 2024-02-28T16:24:28.440 INFO:tasks.workunit.client.1.smithi153.stdout:1/27: fdatasync d0/fa 0 2024-02-28T16:24:28.441 INFO:tasks.workunit.client.1.smithi153.stdout:5/27: creat da/fc x:0 0 0 2024-02-28T16:24:28.449 INFO:tasks.workunit.client.1.smithi153.stdout:4/25: creat d4/f9 x:0 0 0 2024-02-28T16:24:28.450 INFO:tasks.workunit.client.1.smithi153.stdout:6/46: mknod d0/ce 0 2024-02-28T16:24:28.450 INFO:tasks.workunit.client.1.smithi153.stdout:1/28: symlink d0/lb 0 2024-02-28T16:24:28.456 INFO:tasks.workunit.client.1.smithi153.stdout:0/78: write d4/f12 [2116319,120812] 0 2024-02-28T16:24:28.461 INFO:tasks.workunit.client.1.smithi153.stdout:7/40: dread d1/f3 [0,4194304] 0 2024-02-28T16:24:28.462 INFO:tasks.workunit.client.1.smithi153.stdout:1/29: rename d0/l6 to d0/lc 0 2024-02-28T16:24:28.463 INFO:tasks.workunit.client.1.smithi153.stdout:9/15: getdents d1/d2 0 2024-02-28T16:24:28.463 INFO:tasks.workunit.client.1.smithi153.stdout:8/40: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:24:28.465 INFO:tasks.workunit.client.1.smithi153.stdout:6/47: rmdir d0 39 2024-02-28T16:24:28.467 INFO:tasks.workunit.client.1.smithi153.stdout:0/79: dread - d4/dc/f18 zero size 2024-02-28T16:24:28.468 INFO:tasks.workunit.client.1.smithi153.stdout:2/30: link d2/la d2/lb 0 2024-02-28T16:24:28.469 INFO:tasks.workunit.client.1.smithi153.stdout:5/28: getdents da 0 2024-02-28T16:24:28.472 INFO:tasks.workunit.client.1.smithi153.stdout:6/48: dread - d0/fd zero size 2024-02-28T16:24:28.475 INFO:tasks.workunit.client.1.smithi153.stdout:5/29: fsync f8 0 2024-02-28T16:24:28.476 INFO:tasks.workunit.client.1.smithi153.stdout:7/41: creat d1/d4/f7 x:0 0 0 2024-02-28T16:24:28.480 INFO:tasks.workunit.client.1.smithi153.stdout:2/31: write d2/f7 [8064451,53395] 0 2024-02-28T16:24:28.481 INFO:tasks.workunit.client.1.smithi153.stdout:4/26: dwrite d4/f7 [0,4194304] 0 2024-02-28T16:24:28.485 INFO:tasks.workunit.client.1.smithi153.stdout:6/49: symlink d0/lf 0 2024-02-28T16:24:28.486 INFO:tasks.workunit.client.1.smithi153.stdout:0/80: rename d4/dc/f17 to d4/dc/f19 0 2024-02-28T16:24:28.491 INFO:tasks.workunit.client.1.smithi153.stdout:7/42: fdatasync d1/f3 0 2024-02-28T16:24:28.493 INFO:tasks.workunit.client.1.smithi153.stdout:9/16: link l0 d1/d2/l6 0 2024-02-28T16:24:28.494 INFO:tasks.workunit.client.1.smithi153.stdout:5/30: dread f9 [0,4194304] 0 2024-02-28T16:24:28.494 INFO:tasks.workunit.client.1.smithi153.stdout:9/17: fsync d1/f4 0 2024-02-28T16:24:28.494 INFO:tasks.workunit.client.1.smithi153.stdout:5/31: dread - da/fb zero size 2024-02-28T16:24:28.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/27: mknod d4/ca 0 2024-02-28T16:24:28.495 INFO:tasks.workunit.client.1.smithi153.stdout:3/58: sync 2024-02-28T16:24:28.496 INFO:tasks.workunit.client.1.smithi153.stdout:2/32: mknod d2/cc 0 2024-02-28T16:24:28.498 INFO:tasks.workunit.client.1.smithi153.stdout:9/18: truncate d1/f4 1178364 0 2024-02-28T16:24:28.499 INFO:tasks.workunit.client.1.smithi153.stdout:2/33: chown d2/f7 173541445 1 2024-02-28T16:24:28.499 INFO:tasks.workunit.client.1.smithi153.stdout:3/59: write d4/f7 [57042,71114] 0 2024-02-28T16:24:28.499 INFO:tasks.workunit.client.1.smithi153.stdout:4/28: write f1 [223684,69047] 0 2024-02-28T16:24:28.503 INFO:tasks.workunit.client.1.smithi153.stdout:1/30: getdents d0 0 2024-02-28T16:24:28.505 INFO:tasks.workunit.client.1.smithi153.stdout:6/50: creat d0/f10 x:0 0 0 2024-02-28T16:24:28.507 INFO:tasks.workunit.client.1.smithi153.stdout:8/41: truncate d0/f8 84392 0 2024-02-28T16:24:28.513 INFO:tasks.workunit.client.1.smithi153.stdout:4/29: mknod d4/cb 0 2024-02-28T16:24:28.514 INFO:tasks.workunit.client.1.smithi153.stdout:1/31: rmdir d0 39 2024-02-28T16:24:28.516 INFO:tasks.workunit.client.1.smithi153.stdout:6/51: symlink d0/l11 0 2024-02-28T16:24:28.519 INFO:tasks.workunit.client.1.smithi153.stdout:5/32: dwrite f4 [4194304,4194304] 0 2024-02-28T16:24:28.528 INFO:tasks.workunit.client.1.smithi153.stdout:4/30: creat d4/fc x:0 0 0 2024-02-28T16:24:28.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/52: symlink d0/l12 0 2024-02-28T16:24:28.530 INFO:tasks.workunit.client.1.smithi153.stdout:8/42: dwrite d0/f6 [0,4194304] 0 2024-02-28T16:24:28.533 INFO:tasks.workunit.client.1.smithi153.stdout:5/33: mkdir da/dd 0 2024-02-28T16:24:28.533 INFO:tasks.workunit.client.1.smithi153.stdout:0/81: getdents d4 0 2024-02-28T16:24:28.535 INFO:tasks.workunit.client.1.smithi153.stdout:5/34: read f1 [1690005,106189] 0 2024-02-28T16:24:28.537 INFO:tasks.workunit.client.1.smithi153.stdout:1/32: mkdir d0/dd 0 2024-02-28T16:24:28.537 INFO:tasks.workunit.client.1.smithi153.stdout:9/19: link d1/d2/l6 d1/d5/l7 0 2024-02-28T16:24:28.541 INFO:tasks.workunit.client.1.smithi153.stdout:2/34: getdents d2 0 2024-02-28T16:24:28.541 INFO:tasks.workunit.client.1.smithi153.stdout:6/53: mkdir d0/d13 0 2024-02-28T16:24:28.543 INFO:tasks.workunit.client.1.smithi153.stdout:0/82: mkdir d4/d1a 0 2024-02-28T16:24:28.545 INFO:tasks.workunit.client.1.smithi153.stdout:2/35: readlink l1 0 2024-02-28T16:24:28.545 INFO:tasks.workunit.client.1.smithi153.stdout:3/60: write f0 [3212183,65764] 0 2024-02-28T16:24:28.548 INFO:tasks.workunit.client.1.smithi153.stdout:6/54: symlink d0/l14 0 2024-02-28T16:24:28.551 INFO:tasks.workunit.client.1.smithi153.stdout:1/33: link d0/fa d0/fe 0 2024-02-28T16:24:28.552 INFO:tasks.workunit.client.1.smithi153.stdout:9/20: rename d1/d2/l6 to d1/d2/l8 0 2024-02-28T16:24:28.552 INFO:tasks.workunit.client.1.smithi153.stdout:5/35: truncate f9 1167031 0 2024-02-28T16:24:28.554 INFO:tasks.workunit.client.1.smithi153.stdout:2/36: creat d2/fd x:0 0 0 2024-02-28T16:24:28.555 INFO:tasks.workunit.client.1.smithi153.stdout:6/55: dread - d0/fd zero size 2024-02-28T16:24:28.558 INFO:tasks.workunit.client.1.smithi153.stdout:8/43: dread d0/f9 [0,4194304] 0 2024-02-28T16:24:28.561 INFO:tasks.workunit.client.1.smithi153.stdout:1/34: fdatasync d0/fa 0 2024-02-28T16:24:28.562 INFO:tasks.workunit.client.1.smithi153.stdout:3/61: creat d4/f17 x:0 0 0 2024-02-28T16:24:28.564 INFO:tasks.workunit.client.1.smithi153.stdout:2/37: creat d2/fe x:0 0 0 2024-02-28T16:24:28.567 INFO:tasks.workunit.client.1.smithi153.stdout:5/36: creat da/dd/fe x:0 0 0 2024-02-28T16:24:28.567 INFO:tasks.workunit.client.1.smithi153.stdout:9/21: unlink l0 0 2024-02-28T16:24:28.568 INFO:tasks.workunit.client.1.smithi153.stdout:4/31: dwrite f0 [0,4194304] 0 2024-02-28T16:24:28.568 INFO:tasks.workunit.client.1.smithi153.stdout:8/44: write d0/f8 [991217,16178] 0 2024-02-28T16:24:28.570 INFO:tasks.workunit.client.1.smithi153.stdout:6/56: rename d0/d13 to d0/d15 0 2024-02-28T16:24:28.574 INFO:tasks.workunit.client.1.smithi153.stdout:3/62: rmdir d4/d8 39 2024-02-28T16:24:28.580 INFO:tasks.workunit.client.1.smithi153.stdout:5/37: creat da/dd/ff x:0 0 0 2024-02-28T16:24:28.589 INFO:tasks.workunit.client.1.smithi153.stdout:1/35: dread d0/f9 [0,4194304] 0 2024-02-28T16:24:28.590 INFO:tasks.workunit.client.1.smithi153.stdout:9/22: rmdir d1 39 2024-02-28T16:24:28.593 INFO:tasks.workunit.client.1.smithi153.stdout:8/45: rename d0/cd to d0/ce 0 2024-02-28T16:24:28.597 INFO:tasks.workunit.client.1.smithi153.stdout:6/57: rename d0/l14 to d0/d15/l16 0 2024-02-28T16:24:28.597 INFO:tasks.workunit.client.1.smithi153.stdout:5/38: mknod da/c10 0 2024-02-28T16:24:28.602 INFO:tasks.workunit.client.1.smithi153.stdout:8/46: creat d0/ff x:0 0 0 2024-02-28T16:24:28.602 INFO:tasks.workunit.client.1.smithi153.stdout:5/39: write da/fb [190503,1199] 0 2024-02-28T16:24:28.602 INFO:tasks.workunit.client.1.smithi153.stdout:3/63: dwrite d4/f6 [4194304,4194304] 0 2024-02-28T16:24:28.606 INFO:tasks.workunit.client.1.smithi153.stdout:1/36: mknod d0/dd/cf 0 2024-02-28T16:24:28.606 INFO:tasks.workunit.client.1.smithi153.stdout:8/47: chown d0/fc 45026 1 2024-02-28T16:24:28.611 INFO:tasks.workunit.client.1.smithi153.stdout:4/32: getdents d4 0 2024-02-28T16:24:28.611 INFO:tasks.workunit.client.1.smithi153.stdout:5/40: rename f4 to da/dd/f11 0 2024-02-28T16:24:28.614 INFO:tasks.workunit.client.1.smithi153.stdout:8/48: fsync d0/f9 0 2024-02-28T16:24:28.618 INFO:tasks.workunit.client.1.smithi153.stdout:1/37: symlink d0/dd/l10 0 2024-02-28T16:24:28.621 INFO:tasks.workunit.client.1.smithi153.stdout:4/33: chown d4/fc 86145 1 2024-02-28T16:24:28.621 INFO:tasks.workunit.client.1.smithi153.stdout:2/38: truncate d2/f3 3123096 0 2024-02-28T16:24:28.622 INFO:tasks.workunit.client.1.smithi153.stdout:5/41: fsync da/fc 0 2024-02-28T16:24:28.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/83: dwrite d4/f14 [0,4194304] 0 2024-02-28T16:24:28.635 INFO:tasks.workunit.client.1.smithi153.stdout:0/84: dread - d4/fe zero size 2024-02-28T16:24:28.641 INFO:tasks.workunit.client.1.smithi153.stdout:8/49: link d0/l3 d0/l10 0 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: [28/Feb/2024:16:24:27] ENGINE Bus STARTING 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: mgrmap e28: smithi023.bbebnt(active, since 1.03117s) 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: pgmap v3: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: [28/Feb/2024:16:24:27] ENGINE Serving on http://172.21.15.23:8765 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: [28/Feb/2024:16:24:27] ENGINE Serving on https://172.21.15.23:7150 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: [28/Feb/2024:16:24:27] ENGINE Bus STARTED 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:28 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:28.650 INFO:tasks.workunit.client.1.smithi153.stdout:8/50: rename d0/fc to d0/f11 0 2024-02-28T16:24:28.652 INFO:tasks.workunit.client.1.smithi153.stdout:9/23: link d1/d5/l7 d1/d5/l9 0 2024-02-28T16:24:28.654 INFO:tasks.workunit.client.1.smithi153.stdout:5/42: getdents da/dd 0 2024-02-28T16:24:28.661 INFO:tasks.workunit.client.1.smithi153.stdout:8/51: dread - d0/ff zero size 2024-02-28T16:24:28.662 INFO:tasks.workunit.client.1.smithi153.stdout:4/34: dwrite f1 [0,4194304] 0 2024-02-28T16:24:28.662 INFO:tasks.workunit.client.1.smithi153.stdout:9/24: fsync d1/f4 0 2024-02-28T16:24:28.664 INFO:tasks.workunit.client.1.smithi153.stdout:3/64: dwrite d4/f5 [0,4194304] 0 2024-02-28T16:24:28.664 INFO:tasks.workunit.client.1.smithi153.stdout:5/43: creat da/f12 x:0 0 0 2024-02-28T16:24:28.668 INFO:tasks.workunit.client.1.smithi153.stdout:2/39: dwrite d2/fd [0,4194304] 0 2024-02-28T16:24:28.668 INFO:tasks.workunit.client.1.smithi153.stdout:5/44: fdatasync da/fb 0 2024-02-28T16:24:28.671 INFO:tasks.workunit.client.1.smithi153.stdout:4/35: mknod d4/cd 0 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: [28/Feb/2024:16:24:27] ENGINE Bus STARTING 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: mgrmap e28: smithi023.bbebnt(active, since 1.03117s) 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: pgmap v3: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: [28/Feb/2024:16:24:27] ENGINE Serving on http://172.21.15.23:8765 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: [28/Feb/2024:16:24:27] ENGINE Serving on https://172.21.15.23:7150 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: [28/Feb/2024:16:24:27] ENGINE Bus STARTED 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:28 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:28.673 INFO:tasks.workunit.client.1.smithi153.stdout:0/85: dread d4/f14 [0,4194304] 0 2024-02-28T16:24:28.675 INFO:tasks.workunit.client.1.smithi153.stdout:5/45: chown da/dd 210416547 1 2024-02-28T16:24:28.677 INFO:tasks.workunit.client.1.smithi153.stdout:8/52: write d0/f4 [75313,13052] 0 2024-02-28T16:24:28.677 INFO:tasks.workunit.client.1.smithi153.stdout:5/46: stat da/fb 0 2024-02-28T16:24:28.679 INFO:tasks.workunit.client.1.smithi153.stdout:7/43: sync 2024-02-28T16:24:28.679 INFO:tasks.workunit.client.1.smithi153.stdout:8/53: dread - d0/ff zero size 2024-02-28T16:24:28.683 INFO:tasks.workunit.client.1.smithi153.stdout:0/86: unlink d4/fb 0 2024-02-28T16:24:28.688 INFO:tasks.workunit.client.1.smithi153.stdout:2/40: getdents d2 0 2024-02-28T16:24:28.689 INFO:tasks.workunit.client.1.smithi153.stdout:8/54: mkdir d0/d12 0 2024-02-28T16:24:28.692 INFO:tasks.workunit.client.1.smithi153.stdout:2/41: fsync d2/f6 0 2024-02-28T16:24:28.695 INFO:tasks.workunit.client.1.smithi153.stdout:0/87: mkdir d4/d1b 0 2024-02-28T16:24:28.696 INFO:tasks.workunit.client.1.smithi153.stdout:2/42: read - d2/fe zero size 2024-02-28T16:24:28.697 INFO:tasks.workunit.client.1.smithi153.stdout:9/25: dread d1/f4 [0,4194304] 0 2024-02-28T16:24:28.698 INFO:tasks.workunit.client.1.smithi153.stdout:8/55: mknod d0/d12/c13 0 2024-02-28T16:24:28.700 INFO:tasks.workunit.client.1.smithi153.stdout:2/43: readlink l0 0 2024-02-28T16:24:28.702 INFO:tasks.workunit.client.1.smithi153.stdout:0/88: read d4/f14 [1580650,16232] 0 2024-02-28T16:24:28.707 INFO:tasks.workunit.client.1.smithi153.stdout:9/26: mknod d1/d5/ca 0 2024-02-28T16:24:28.708 INFO:tasks.workunit.client.1.smithi153.stdout:3/65: dwrite f0 [0,4194304] 0 2024-02-28T16:24:28.709 INFO:tasks.workunit.client.1.smithi153.stdout:0/89: mknod d4/d1a/c1c 0 2024-02-28T16:24:28.716 INFO:tasks.workunit.client.1.smithi153.stdout:5/47: dwrite da/fc [0,4194304] 0 2024-02-28T16:24:28.741 INFO:tasks.workunit.client.1.smithi153.stdout:5/48: readlink - no filename 2024-02-28T16:24:28.744 INFO:tasks.workunit.client.1.smithi153.stdout:5/49: read - da/dd/ff zero size 2024-02-28T16:24:28.760 INFO:tasks.workunit.client.1.smithi153.stdout:5/50: creat da/dd/f13 x:0 0 0 2024-02-28T16:24:28.784 INFO:tasks.workunit.client.1.smithi153.stdout:9/27: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:24:28.784 INFO:tasks.workunit.client.1.smithi153.stdout:8/56: dwrite d0/f11 [0,4194304] 0 2024-02-28T16:24:28.789 INFO:tasks.workunit.client.1.smithi153.stdout:6/58: sync 2024-02-28T16:24:28.795 INFO:tasks.workunit.client.1.smithi153.stdout:5/51: getdents da 0 2024-02-28T16:24:28.795 INFO:tasks.workunit.client.1.smithi153.stdout:9/28: readlink d1/d5/l9 0 2024-02-28T16:24:28.796 INFO:tasks.workunit.client.1.smithi153.stdout:3/66: dwrite d4/d8/fd [4194304,4194304] 0 2024-02-28T16:24:28.799 INFO:tasks.workunit.client.1.smithi153.stdout:5/52: creat da/f14 x:0 0 0 2024-02-28T16:24:28.801 INFO:tasks.workunit.client.1.smithi153.stdout:9/29: rmdir d1/d5 39 2024-02-28T16:24:28.801 INFO:tasks.workunit.client.1.smithi153.stdout:0/90: dwrite d4/f13 [0,4194304] 0 2024-02-28T16:24:28.811 INFO:tasks.workunit.client.1.smithi153.stdout:0/91: rmdir d4/d1b 0 2024-02-28T16:24:28.824 INFO:tasks.workunit.client.1.smithi153.stdout:9/30: creat d1/d5/fb x:0 0 0 2024-02-28T16:24:28.825 INFO:tasks.workunit.client.1.smithi153.stdout:6/59: truncate d0/f8 2046542 0 2024-02-28T16:24:28.827 INFO:tasks.workunit.client.1.smithi153.stdout:8/57: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:28.827 INFO:tasks.workunit.client.1.smithi153.stdout:5/53: truncate da/dd/f11 5281979 0 2024-02-28T16:24:28.829 INFO:tasks.workunit.client.1.smithi153.stdout:6/60: mkdir d0/d17 0 2024-02-28T16:24:28.830 INFO:tasks.workunit.client.1.smithi153.stdout:0/92: getdents d4/d1a 0 2024-02-28T16:24:28.833 INFO:tasks.workunit.client.1.smithi153.stdout:6/61: creat d0/f18 x:0 0 0 2024-02-28T16:24:28.834 INFO:tasks.workunit.client.1.smithi153.stdout:0/93: fsync d4/fa 0 2024-02-28T16:24:28.834 INFO:tasks.workunit.client.1.smithi153.stdout:3/67: dwrite d4/f17 [0,4194304] 0 2024-02-28T16:24:28.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/62: rename d0/fc to d0/f19 0 2024-02-28T16:24:28.867 INFO:tasks.workunit.client.1.smithi153.stdout:8/58: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:24:28.872 INFO:tasks.workunit.client.1.smithi153.stdout:8/59: write d0/f9 [1455466,88720] 0 2024-02-28T16:24:28.875 INFO:tasks.workunit.client.1.smithi153.stdout:3/68: write d4/d13/f14 [862070,85985] 0 2024-02-28T16:24:28.881 INFO:tasks.workunit.client.1.smithi153.stdout:0/94: dread d4/f6 [4194304,4194304] 0 2024-02-28T16:24:28.881 INFO:tasks.workunit.client.1.smithi153.stdout:3/69: dread d4/f7 [0,4194304] 0 2024-02-28T16:24:28.883 INFO:tasks.workunit.client.1.smithi153.stdout:3/70: chown d4/d13/f14 244 1 2024-02-28T16:24:28.885 INFO:tasks.workunit.client.1.smithi153.stdout:6/63: read d0/f19 [738950,20045] 0 2024-02-28T16:24:28.886 INFO:tasks.workunit.client.1.smithi153.stdout:8/60: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:28.888 INFO:tasks.workunit.client.1.smithi153.stdout:0/95: write d4/f12 [3044465,122688] 0 2024-02-28T16:24:28.889 INFO:tasks.workunit.client.1.smithi153.stdout:6/64: creat d0/d15/f1a x:0 0 0 2024-02-28T16:24:28.891 INFO:tasks.workunit.client.1.smithi153.stdout:1/38: sync 2024-02-28T16:24:28.891 INFO:tasks.workunit.client.1.smithi153.stdout:4/36: sync 2024-02-28T16:24:28.891 INFO:tasks.workunit.client.1.smithi153.stdout:7/44: sync 2024-02-28T16:24:28.891 INFO:tasks.workunit.client.1.smithi153.stdout:2/44: sync 2024-02-28T16:24:28.893 INFO:tasks.workunit.client.1.smithi153.stdout:4/37: write d4/f7 [1978528,11098] 0 2024-02-28T16:24:28.893 INFO:tasks.workunit.client.1.smithi153.stdout:1/39: write d0/fa [113097,50936] 0 2024-02-28T16:24:28.897 INFO:tasks.workunit.client.1.smithi153.stdout:3/71: link d4/d13/f14 d4/f18 0 2024-02-28T16:24:28.899 INFO:tasks.workunit.client.1.smithi153.stdout:6/65: rename d0/l6 to d0/d17/l1b 0 2024-02-28T16:24:28.900 INFO:tasks.workunit.client.1.smithi153.stdout:6/66: readlink d0/l11 0 2024-02-28T16:24:28.900 INFO:tasks.workunit.client.1.smithi153.stdout:6/67: readlink d0/l12 0 2024-02-28T16:24:28.903 INFO:tasks.workunit.client.1.smithi153.stdout:2/45: creat d2/ff x:0 0 0 2024-02-28T16:24:28.903 INFO:tasks.workunit.client.1.smithi153.stdout:7/45: chown d1/d4/l6 732212 1 2024-02-28T16:24:28.906 INFO:tasks.workunit.client.1.smithi153.stdout:4/38: unlink d4/fc 0 2024-02-28T16:24:28.908 INFO:tasks.workunit.client.1.smithi153.stdout:1/40: mknod d0/dd/c11 0 2024-02-28T16:24:28.911 INFO:tasks.workunit.client.1.smithi153.stdout:1/41: rename d0 to d0/d12 22 2024-02-28T16:24:28.912 INFO:tasks.workunit.client.1.smithi153.stdout:7/46: write d1/d4/f7 [134617,20310] 0 2024-02-28T16:24:28.913 INFO:tasks.workunit.client.1.smithi153.stdout:3/72: unlink d4/f6 0 2024-02-28T16:24:28.916 INFO:tasks.workunit.client.1.smithi153.stdout:6/68: symlink d0/d15/l1c 0 2024-02-28T16:24:28.917 INFO:tasks.workunit.client.1.smithi153.stdout:3/73: unlink l2 0 2024-02-28T16:24:28.919 INFO:tasks.workunit.client.1.smithi153.stdout:8/61: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:24:28.920 INFO:tasks.workunit.client.1.smithi153.stdout:7/47: chown d1/f3 135855 1 2024-02-28T16:24:28.921 INFO:tasks.workunit.client.1.smithi153.stdout:2/46: rename d2/f3 to d2/f10 0 2024-02-28T16:24:28.921 INFO:tasks.workunit.client.1.smithi153.stdout:6/69: fdatasync d0/fb 0 2024-02-28T16:24:28.930 INFO:tasks.workunit.client.1.smithi153.stdout:1/42: creat d0/dd/f13 x:0 0 0 2024-02-28T16:24:28.934 INFO:tasks.workunit.client.1.smithi153.stdout:7/48: symlink d1/l8 0 2024-02-28T16:24:28.934 INFO:tasks.workunit.client.1.smithi153.stdout:1/43: fsync d0/fe 0 2024-02-28T16:24:28.936 INFO:tasks.workunit.client.1.smithi153.stdout:8/62: truncate d0/f8 4758995 0 2024-02-28T16:24:28.938 INFO:tasks.workunit.client.1.smithi153.stdout:2/47: creat d2/f11 x:0 0 0 2024-02-28T16:24:28.938 INFO:tasks.workunit.client.1.smithi153.stdout:0/96: dwrite d4/dc/f18 [0,4194304] 0 2024-02-28T16:24:28.938 INFO:tasks.workunit.client.1.smithi153.stdout:5/54: sync 2024-02-28T16:24:28.938 INFO:tasks.workunit.client.1.smithi153.stdout:9/31: sync 2024-02-28T16:24:28.940 INFO:tasks.workunit.client.1.smithi153.stdout:4/39: dwrite d4/f9 [0,4194304] 0 2024-02-28T16:24:28.941 INFO:tasks.workunit.client.1.smithi153.stdout:7/49: readlink d1/d4/l6 0 2024-02-28T16:24:28.941 INFO:tasks.workunit.client.1.smithi153.stdout:3/74: symlink d4/d13/l19 0 2024-02-28T16:24:28.946 INFO:tasks.workunit.client.1.smithi153.stdout:1/44: write d0/fa [590994,28213] 0 2024-02-28T16:24:28.949 INFO:tasks.workunit.client.1.smithi153.stdout:2/48: fsync d2/ff 0 2024-02-28T16:24:28.959 INFO:tasks.workunit.client.1.smithi153.stdout:4/40: mkdir d4/de 0 2024-02-28T16:24:28.964 INFO:tasks.workunit.client.1.smithi153.stdout:0/97: chown d4/dc/f18 5 1 2024-02-28T16:24:28.964 INFO:tasks.workunit.client.1.smithi153.stdout:5/55: read f8 [348080,32493] 0 2024-02-28T16:24:28.972 INFO:tasks.workunit.client.1.smithi153.stdout:1/45: creat d0/f14 x:0 0 0 2024-02-28T16:24:28.972 INFO:tasks.workunit.client.1.smithi153.stdout:5/56: chown f9 8 1 2024-02-28T16:24:28.974 INFO:tasks.workunit.client.1.smithi153.stdout:4/41: mknod d4/cf 0 2024-02-28T16:24:28.977 INFO:tasks.workunit.client.1.smithi153.stdout:6/70: dwrite d0/f10 [0,4194304] 0 2024-02-28T16:24:28.978 INFO:tasks.workunit.client.1.smithi153.stdout:3/75: creat d4/f1a x:0 0 0 2024-02-28T16:24:28.980 INFO:tasks.workunit.client.1.smithi153.stdout:1/46: rename d0/dd to d0/dd/d15 22 2024-02-28T16:24:28.982 INFO:tasks.workunit.client.1.smithi153.stdout:4/42: chown f0 8002198 1 2024-02-28T16:24:28.984 INFO:tasks.workunit.client.1.smithi153.stdout:3/76: stat d4/d8/la 0 2024-02-28T16:24:28.988 INFO:tasks.workunit.client.1.smithi153.stdout:0/98: creat d4/d1a/f1d x:0 0 0 2024-02-28T16:24:28.988 INFO:tasks.workunit.client.1.smithi153.stdout:8/63: dwrite d0/f11 [0,4194304] 0 2024-02-28T16:24:28.988 INFO:tasks.workunit.client.1.smithi153.stdout:5/57: dread f9 [0,4194304] 0 2024-02-28T16:24:28.989 INFO:tasks.workunit.client.1.smithi153.stdout:4/43: write d4/f9 [903108,21034] 0 2024-02-28T16:24:28.992 INFO:tasks.workunit.client.1.smithi153.stdout:6/71: mkdir d0/d1d 0 2024-02-28T16:24:28.992 INFO:tasks.workunit.client.1.smithi153.stdout:1/47: write d0/fe [933515,44941] 0 2024-02-28T16:24:28.997 INFO:tasks.workunit.client.1.smithi153.stdout:2/49: link d2/lb d2/l12 0 2024-02-28T16:24:29.001 INFO:tasks.workunit.client.1.smithi153.stdout:1/48: dread - d0/f8 zero size 2024-02-28T16:24:29.001 INFO:tasks.workunit.client.1.smithi153.stdout:0/99: mknod d4/dc/c1e 0 2024-02-28T16:24:29.001 INFO:tasks.workunit.client.1.smithi153.stdout:2/50: chown d2/fd 3455 1 2024-02-28T16:24:29.001 INFO:tasks.workunit.client.1.smithi153.stdout:7/50: dread d1/f3 [0,4194304] 0 2024-02-28T16:24:29.003 INFO:tasks.workunit.client.1.smithi153.stdout:5/58: truncate f9 1608668 0 2024-02-28T16:24:29.003 INFO:tasks.workunit.client.1.smithi153.stdout:8/64: mknod d0/d12/c14 0 2024-02-28T16:24:29.003 INFO:tasks.workunit.client.1.smithi153.stdout:4/44: creat d4/f10 x:0 0 0 2024-02-28T16:24:29.004 INFO:tasks.workunit.client.1.smithi153.stdout:2/51: fdatasync d2/ff 0 2024-02-28T16:24:29.005 INFO:tasks.workunit.client.1.smithi153.stdout:5/59: stat da/f12 0 2024-02-28T16:24:29.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/49: creat d0/f16 x:0 0 0 2024-02-28T16:24:29.007 INFO:tasks.workunit.client.1.smithi153.stdout:6/72: creat d0/d1d/f1e x:0 0 0 2024-02-28T16:24:29.009 INFO:tasks.workunit.client.1.smithi153.stdout:1/50: fdatasync d0/f14 0 2024-02-28T16:24:29.009 INFO:tasks.workunit.client.1.smithi153.stdout:6/73: chown d0/fb 0 1 2024-02-28T16:24:29.009 INFO:tasks.workunit.client.1.smithi153.stdout:2/52: truncate d2/f11 784849 0 2024-02-28T16:24:29.011 INFO:tasks.workunit.client.1.smithi153.stdout:2/53: dread - d2/fe zero size 2024-02-28T16:24:29.011 INFO:tasks.workunit.client.1.smithi153.stdout:8/65: mkdir d0/d12/d15 0 2024-02-28T16:24:29.013 INFO:tasks.workunit.client.1.smithi153.stdout:7/51: creat d1/d4/f9 x:0 0 0 2024-02-28T16:24:29.015 INFO:tasks.workunit.client.1.smithi153.stdout:7/52: dread - d1/d4/f9 zero size 2024-02-28T16:24:29.015 INFO:tasks.workunit.client.1.smithi153.stdout:4/45: rename f3 to d4/de/f11 0 2024-02-28T16:24:29.017 INFO:tasks.workunit.client.1.smithi153.stdout:4/46: chown f2 25639744 1 2024-02-28T16:24:29.021 INFO:tasks.workunit.client.1.smithi153.stdout:7/53: write d1/d4/f7 [936290,58276] 0 2024-02-28T16:24:29.023 INFO:tasks.workunit.client.1.smithi153.stdout:8/66: creat d0/f16 x:0 0 0 2024-02-28T16:24:29.025 INFO:tasks.workunit.client.1.smithi153.stdout:4/47: write d4/f6 [852714,45102] 0 2024-02-28T16:24:29.025 INFO:tasks.workunit.client.1.smithi153.stdout:2/54: chown d2/f10 9751104 1 2024-02-28T16:24:29.027 INFO:tasks.workunit.client.1.smithi153.stdout:3/77: link d4/d13/f14 d4/f1b 0 2024-02-28T16:24:29.029 INFO:tasks.workunit.client.1.smithi153.stdout:7/54: write d1/d4/f9 [263823,79484] 0 2024-02-28T16:24:29.030 INFO:tasks.workunit.client.1.smithi153.stdout:5/60: rename da/f14 to da/dd/f15 0 2024-02-28T16:24:29.035 INFO:tasks.workunit.client.1.smithi153.stdout:8/67: creat d0/f17 x:0 0 0 2024-02-28T16:24:29.039 INFO:tasks.workunit.client.1.smithi153.stdout:0/100: truncate d4/dc/f18 333292 0 2024-02-28T16:24:29.042 INFO:tasks.workunit.client.1.smithi153.stdout:3/78: creat d4/d8/f1c x:0 0 0 2024-02-28T16:24:29.043 INFO:tasks.workunit.client.1.smithi153.stdout:4/48: creat d4/de/f12 x:0 0 0 2024-02-28T16:24:29.043 INFO:tasks.workunit.client.1.smithi153.stdout:6/74: dwrite d0/d1d/f1e [0,4194304] 0 2024-02-28T16:24:29.044 INFO:tasks.workunit.client.1.smithi153.stdout:8/68: write d0/f16 [360698,50721] 0 2024-02-28T16:24:29.044 INFO:tasks.workunit.client.1.smithi153.stdout:1/51: dwrite d0/dd/f13 [0,4194304] 0 2024-02-28T16:24:29.046 INFO:tasks.workunit.client.1.smithi153.stdout:7/55: dread d1/d4/f9 [0,4194304] 0 2024-02-28T16:24:29.047 INFO:tasks.workunit.client.1.smithi153.stdout:8/69: fsync d0/f4 0 2024-02-28T16:24:29.049 INFO:tasks.workunit.client.1.smithi153.stdout:0/101: creat d4/d1a/f1f x:0 0 0 2024-02-28T16:24:29.054 INFO:tasks.workunit.client.1.smithi153.stdout:7/56: unlink d1/f3 0 2024-02-28T16:24:29.055 INFO:tasks.workunit.client.1.smithi153.stdout:4/49: mkdir d4/de/d13 0 2024-02-28T16:24:29.055 INFO:tasks.workunit.client.1.smithi153.stdout:2/55: dread d2/f7 [0,4194304] 0 2024-02-28T16:24:29.060 INFO:tasks.workunit.client.1.smithi153.stdout:1/52: rename d0/dd/cf to d0/dd/c17 0 2024-02-28T16:24:29.064 INFO:tasks.workunit.client.1.smithi153.stdout:3/79: dread d4/f17 [0,4194304] 0 2024-02-28T16:24:29.065 INFO:tasks.workunit.client.1.smithi153.stdout:0/102: dread d4/fa [0,4194304] 0 2024-02-28T16:24:29.068 INFO:tasks.workunit.client.1.smithi153.stdout:4/50: rename f2 to d4/de/d13/f14 0 2024-02-28T16:24:29.068 INFO:tasks.workunit.client.1.smithi153.stdout:4/51: stat d4/f10 0 2024-02-28T16:24:29.070 INFO:tasks.workunit.client.1.smithi153.stdout:2/56: rename d2/l9 to d2/l13 0 2024-02-28T16:24:29.070 INFO:tasks.workunit.client.1.smithi153.stdout:0/103: chown d4/dc/c1e 1991494 1 2024-02-28T16:24:29.070 INFO:tasks.workunit.client.1.smithi153.stdout:8/70: getdents d0/d12/d15 0 2024-02-28T16:24:29.075 INFO:tasks.workunit.client.1.smithi153.stdout:3/80: creat d4/d13/f1d x:0 0 0 2024-02-28T16:24:29.075 INFO:tasks.workunit.client.1.smithi153.stdout:4/52: creat d4/f15 x:0 0 0 2024-02-28T16:24:29.075 INFO:tasks.workunit.client.1.smithi153.stdout:0/104: readlink d4/l5 0 2024-02-28T16:24:29.082 INFO:tasks.workunit.client.1.smithi153.stdout:9/32: sync 2024-02-28T16:24:29.084 INFO:tasks.workunit.client.1.smithi153.stdout:2/57: stat d2/la 0 2024-02-28T16:24:29.085 INFO:tasks.workunit.client.1.smithi153.stdout:3/81: write f0 [4941323,110636] 0 2024-02-28T16:24:29.085 INFO:tasks.workunit.client.1.smithi153.stdout:9/33: fdatasync d1/f4 0 2024-02-28T16:24:29.089 INFO:tasks.workunit.client.1.smithi153.stdout:3/82: read d4/f7 [36099,100926] 0 2024-02-28T16:24:29.094 INFO:tasks.workunit.client.1.smithi153.stdout:7/57: truncate d1/d4/f7 405874 0 2024-02-28T16:24:29.103 INFO:tasks.workunit.client.1.smithi153.stdout:9/34: dwrite d1/d5/fb [0,4194304] 0 2024-02-28T16:24:29.179 INFO:tasks.workunit.client.1.smithi153.stdout:5/61: sync 2024-02-28T16:24:29.180 INFO:tasks.workunit.client.1.smithi153.stdout:5/62: dread - da/f12 zero size 2024-02-28T16:24:29.180 INFO:tasks.workunit.client.1.smithi153.stdout:5/63: fsync da/fc 0 2024-02-28T16:24:29.186 INFO:tasks.workunit.client.1.smithi153.stdout:8/71: creat d0/d12/d15/f18 x:0 0 0 2024-02-28T16:24:29.186 INFO:tasks.workunit.client.1.smithi153.stdout:4/53: creat d4/de/f16 x:0 0 0 2024-02-28T16:24:29.187 INFO:tasks.workunit.client.1.smithi153.stdout:4/54: read f0 [1299253,32808] 0 2024-02-28T16:24:29.188 INFO:tasks.workunit.client.1.smithi153.stdout:8/72: write d0/f6 [3572822,118646] 0 2024-02-28T16:24:29.192 INFO:tasks.workunit.client.1.smithi153.stdout:3/83: mkdir d4/d8/d1e 0 2024-02-28T16:24:29.201 INFO:tasks.workunit.client.1.smithi153.stdout:0/105: link d4/fe d4/dc/f20 0 2024-02-28T16:24:29.204 INFO:tasks.workunit.client.1.smithi153.stdout:8/73: mkdir d0/d19 0 2024-02-28T16:24:29.209 INFO:tasks.workunit.client.1.smithi153.stdout:9/35: mknod d1/d5/cc 0 2024-02-28T16:24:29.211 INFO:tasks.workunit.client.1.smithi153.stdout:5/64: rename f8 to da/f16 0 2024-02-28T16:24:29.215 INFO:tasks.workunit.client.1.smithi153.stdout:0/106: creat d4/d1a/f21 x:0 0 0 2024-02-28T16:24:29.225 INFO:tasks.workunit.client.1.smithi153.stdout:8/74: mkdir d0/d12/d15/d1a 0 2024-02-28T16:24:29.225 INFO:tasks.workunit.client.1.smithi153.stdout:5/65: unlink da/f12 0 2024-02-28T16:24:29.231 INFO:tasks.workunit.client.1.smithi153.stdout:7/58: getdents d1/d4 0 2024-02-28T16:24:29.232 INFO:tasks.workunit.client.1.smithi153.stdout:3/84: creat d4/f1f x:0 0 0 2024-02-28T16:24:29.234 INFO:tasks.workunit.client.1.smithi153.stdout:9/36: mknod d1/d2/cd 0 2024-02-28T16:24:29.239 INFO:tasks.workunit.client.1.smithi153.stdout:7/59: write d1/d4/f9 [823975,72276] 0 2024-02-28T16:24:29.245 INFO:tasks.workunit.client.1.smithi153.stdout:7/60: fsync d1/d4/f9 0 2024-02-28T16:24:29.250 INFO:tasks.workunit.client.1.smithi153.stdout:3/85: getdents d4/d13 0 2024-02-28T16:24:29.252 INFO:tasks.workunit.client.1.smithi153.stdout:5/66: dwrite da/fb [0,4194304] 0 2024-02-28T16:24:29.258 INFO:tasks.workunit.client.1.smithi153.stdout:0/107: dwrite d4/fe [0,4194304] 0 2024-02-28T16:24:29.262 INFO:tasks.workunit.client.1.smithi153.stdout:5/67: creat da/dd/f17 x:0 0 0 2024-02-28T16:24:29.264 INFO:tasks.workunit.client.1.smithi153.stdout:7/61: link d1/l5 d1/la 0 2024-02-28T16:24:29.269 INFO:tasks.workunit.client.1.smithi153.stdout:9/37: dwrite d1/f4 [4194304,4194304] 0 2024-02-28T16:24:29.270 INFO:tasks.workunit.client.1.smithi153.stdout:3/86: creat d4/f20 x:0 0 0 2024-02-28T16:24:29.270 INFO:tasks.workunit.client.1.smithi153.stdout:5/68: write da/dd/f17 [886111,75043] 0 2024-02-28T16:24:29.271 INFO:tasks.workunit.client.1.smithi153.stdout:0/108: mknod d4/c22 0 2024-02-28T16:24:29.275 INFO:tasks.workunit.client.1.smithi153.stdout:7/62: getdents d1/d4 0 2024-02-28T16:24:29.275 INFO:tasks.workunit.client.1.smithi153.stdout:0/109: rmdir d4 39 2024-02-28T16:24:29.279 INFO:tasks.workunit.client.1.smithi153.stdout:5/69: creat da/dd/f18 x:0 0 0 2024-02-28T16:24:29.279 INFO:tasks.workunit.client.1.smithi153.stdout:5/70: readlink - no filename 2024-02-28T16:24:29.279 INFO:tasks.workunit.client.1.smithi153.stdout:3/87: getdents d4/d13 0 2024-02-28T16:24:29.283 INFO:tasks.workunit.client.1.smithi153.stdout:3/88: write d4/f1f [949927,96046] 0 2024-02-28T16:24:29.283 INFO:tasks.workunit.client.1.smithi153.stdout:7/63: symlink d1/lb 0 2024-02-28T16:24:29.285 INFO:tasks.workunit.client.1.smithi153.stdout:2/58: write d2/f10 [92531,83130] 0 2024-02-28T16:24:29.287 INFO:tasks.workunit.client.1.smithi153.stdout:2/59: fdatasync d2/f11 0 2024-02-28T16:24:29.287 INFO:tasks.workunit.client.1.smithi153.stdout:0/110: chown d4/dc/f18 1710 1 2024-02-28T16:24:29.288 INFO:tasks.workunit.client.1.smithi153.stdout:2/60: stat d2/ff 0 2024-02-28T16:24:29.291 INFO:tasks.workunit.client.1.smithi153.stdout:3/89: unlink d4/d8/la 0 2024-02-28T16:24:29.292 INFO:tasks.workunit.client.1.smithi153.stdout:1/53: sync 2024-02-28T16:24:29.292 INFO:tasks.workunit.client.1.smithi153.stdout:6/75: sync 2024-02-28T16:24:29.293 INFO:tasks.workunit.client.1.smithi153.stdout:1/54: stat d0/dd/f13 0 2024-02-28T16:24:29.296 INFO:tasks.workunit.client.1.smithi153.stdout:2/61: symlink d2/l14 0 2024-02-28T16:24:29.298 INFO:tasks.workunit.client.1.smithi153.stdout:6/76: creat d0/d17/f1f x:0 0 0 2024-02-28T16:24:29.299 INFO:tasks.workunit.client.1.smithi153.stdout:2/62: write d2/f10 [1270572,6465] 0 2024-02-28T16:24:29.302 INFO:tasks.workunit.client.1.smithi153.stdout:0/111: creat d4/f23 x:0 0 0 2024-02-28T16:24:29.303 INFO:tasks.workunit.client.1.smithi153.stdout:8/75: getdents d0/d12/d15 0 2024-02-28T16:24:29.306 INFO:tasks.workunit.client.1.smithi153.stdout:5/71: dread da/dd/f17 [0,4194304] 0 2024-02-28T16:24:29.306 INFO:tasks.workunit.client.1.smithi153.stdout:9/38: fdatasync d1/f4 0 2024-02-28T16:24:29.306 INFO:tasks.workunit.client.1.smithi153.stdout:2/63: mknod d2/c15 0 2024-02-28T16:24:29.310 INFO:tasks.workunit.client.1.smithi153.stdout:8/76: rmdir d0/d12/d15 39 2024-02-28T16:24:29.310 INFO:tasks.workunit.client.1.smithi153.stdout:0/112: creat d4/d1a/f24 x:0 0 0 2024-02-28T16:24:29.314 INFO:tasks.workunit.client.1.smithi153.stdout:3/90: rmdir d4/d8 39 2024-02-28T16:24:29.314 INFO:tasks.workunit.client.1.smithi153.stdout:8/77: truncate d0/f9 4637808 0 2024-02-28T16:24:29.317 INFO:tasks.workunit.client.1.smithi153.stdout:7/64: write d1/d4/f7 [1067486,8539] 0 2024-02-28T16:24:29.317 INFO:tasks.workunit.client.1.smithi153.stdout:9/39: symlink d1/le 0 2024-02-28T16:24:29.317 INFO:tasks.workunit.client.1.smithi153.stdout:8/78: fdatasync d0/f9 0 2024-02-28T16:24:29.323 INFO:tasks.workunit.client.1.smithi153.stdout:6/77: dread d0/f10 [0,4194304] 0 2024-02-28T16:24:29.326 INFO:tasks.workunit.client.1.smithi153.stdout:2/64: getdents d2 0 2024-02-28T16:24:29.327 INFO:tasks.workunit.client.1.smithi153.stdout:3/91: creat d4/d13/f21 x:0 0 0 2024-02-28T16:24:29.327 INFO:tasks.workunit.client.1.smithi153.stdout:1/55: dwrite d0/fa [0,4194304] 0 2024-02-28T16:24:29.330 INFO:tasks.workunit.client.1.smithi153.stdout:2/65: truncate d2/f6 116016 0 2024-02-28T16:24:29.331 INFO:tasks.workunit.client.1.smithi153.stdout:7/65: mkdir d1/d4/dc 0 2024-02-28T16:24:29.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/56: creat d0/f18 x:0 0 0 2024-02-28T16:24:29.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/72: dread da/fc [0,4194304] 0 2024-02-28T16:24:29.335 INFO:tasks.workunit.client.1.smithi153.stdout:0/113: dread d4/f12 [0,4194304] 0 2024-02-28T16:24:29.339 INFO:tasks.workunit.client.1.smithi153.stdout:9/40: creat d1/ff x:0 0 0 2024-02-28T16:24:29.339 INFO:tasks.workunit.client.1.smithi153.stdout:5/73: fdatasync da/dd/ff 0 2024-02-28T16:24:29.341 INFO:tasks.workunit.client.1.smithi153.stdout:9/41: dread - d1/ff zero size 2024-02-28T16:24:29.341 INFO:tasks.workunit.client.1.smithi153.stdout:3/92: fsync d4/d13/f14 0 2024-02-28T16:24:29.341 INFO:tasks.workunit.client.1.smithi153.stdout:5/74: dread - da/dd/f18 zero size 2024-02-28T16:24:29.344 INFO:tasks.workunit.client.1.smithi153.stdout:5/75: write da/fb [2308177,69216] 0 2024-02-28T16:24:29.344 INFO:tasks.workunit.client.1.smithi153.stdout:8/79: getdents d0/d12/d15 0 2024-02-28T16:24:29.348 INFO:tasks.workunit.client.1.smithi153.stdout:2/66: dread d2/f10 [0,4194304] 0 2024-02-28T16:24:29.356 INFO:tasks.workunit.client.1.smithi153.stdout:4/55: sync 2024-02-28T16:24:29.358 INFO:tasks.workunit.client.1.smithi153.stdout:4/56: chown d4/de/f11 1 1 2024-02-28T16:24:29.358 INFO:tasks.workunit.client.1.smithi153.stdout:6/78: dwrite d0/f19 [0,4194304] 0 2024-02-28T16:24:29.362 INFO:tasks.workunit.client.1.smithi153.stdout:1/57: truncate d0/fa 1798302 0 2024-02-28T16:24:29.363 INFO:tasks.workunit.client.1.smithi153.stdout:8/80: rmdir d0/d12/d15 39 2024-02-28T16:24:29.365 INFO:tasks.workunit.client.1.smithi153.stdout:5/76: write da/dd/f15 [303153,126801] 0 2024-02-28T16:24:29.365 INFO:tasks.workunit.client.1.smithi153.stdout:2/67: mknod d2/c16 0 2024-02-28T16:24:29.371 INFO:tasks.workunit.client.1.smithi153.stdout:4/57: creat d4/de/f17 x:0 0 0 2024-02-28T16:24:29.371 INFO:tasks.workunit.client.1.smithi153.stdout:7/66: getdents d1 0 2024-02-28T16:24:29.376 INFO:tasks.workunit.client.1.smithi153.stdout:6/79: rename d0/fd to d0/f20 0 2024-02-28T16:24:29.376 INFO:tasks.workunit.client.1.smithi153.stdout:9/42: creat d1/f10 x:0 0 0 2024-02-28T16:24:29.376 INFO:tasks.workunit.client.1.smithi153.stdout:1/58: rename d0/lb to d0/l19 0 2024-02-28T16:24:29.378 INFO:tasks.workunit.client.1.smithi153.stdout:1/59: write d0/f8 [289451,55329] 0 2024-02-28T16:24:29.380 INFO:tasks.workunit.client.1.smithi153.stdout:5/77: creat da/f19 x:0 0 0 2024-02-28T16:24:29.381 INFO:tasks.workunit.client.1.smithi153.stdout:0/114: link d4/dc/f18 d4/f25 0 2024-02-28T16:24:29.382 INFO:tasks.workunit.client.1.smithi153.stdout:3/93: creat d4/f22 x:0 0 0 2024-02-28T16:24:29.383 INFO:tasks.workunit.client.1.smithi153.stdout:4/58: creat d4/de/d13/f18 x:0 0 0 2024-02-28T16:24:29.384 INFO:tasks.workunit.client.1.smithi153.stdout:6/80: readlink d0/d17/l1b 0 2024-02-28T16:24:29.386 INFO:tasks.workunit.client.1.smithi153.stdout:8/81: creat d0/d12/d15/f1b x:0 0 0 2024-02-28T16:24:29.387 INFO:tasks.workunit.client.1.smithi153.stdout:5/78: creat da/dd/f1a x:0 0 0 2024-02-28T16:24:29.387 INFO:tasks.workunit.client.1.smithi153.stdout:5/79: readlink - no filename 2024-02-28T16:24:29.388 INFO:tasks.workunit.client.1.smithi153.stdout:7/67: mknod d1/d4/dc/cd 0 2024-02-28T16:24:29.389 INFO:tasks.workunit.client.1.smithi153.stdout:4/59: creat d4/de/f19 x:0 0 0 2024-02-28T16:24:29.390 INFO:tasks.workunit.client.1.smithi153.stdout:9/43: unlink d1/d2/cd 0 2024-02-28T16:24:29.391 INFO:tasks.workunit.client.1.smithi153.stdout:6/81: mknod d0/d15/c21 0 2024-02-28T16:24:29.393 INFO:tasks.workunit.client.1.smithi153.stdout:9/44: dread - d1/f10 zero size 2024-02-28T16:24:29.393 INFO:tasks.workunit.client.1.smithi153.stdout:4/60: write d4/f5 [658476,59336] 0 2024-02-28T16:24:29.394 INFO:tasks.workunit.client.1.smithi153.stdout:5/80: creat da/f1b x:0 0 0 2024-02-28T16:24:29.396 INFO:tasks.workunit.client.1.smithi153.stdout:6/82: fsync d0/f10 0 2024-02-28T16:24:29.397 INFO:tasks.workunit.client.1.smithi153.stdout:9/45: stat d1/d5/l9 0 2024-02-28T16:24:29.398 INFO:tasks.workunit.client.1.smithi153.stdout:8/82: mkdir d0/d19/d1c 0 2024-02-28T16:24:29.401 INFO:tasks.workunit.client.1.smithi153.stdout:2/68: getdents d2 0 2024-02-28T16:24:29.403 INFO:tasks.workunit.client.1.smithi153.stdout:3/94: mkdir d4/d8/d1e/d23 0 2024-02-28T16:24:29.406 INFO:tasks.workunit.client.1.smithi153.stdout:4/61: symlink d4/de/l1a 0 2024-02-28T16:24:29.406 INFO:tasks.workunit.client.1.smithi153.stdout:6/83: dread - d0/f20 zero size 2024-02-28T16:24:29.408 INFO:tasks.workunit.client.1.smithi153.stdout:9/46: truncate d1/f10 33603 0 2024-02-28T16:24:29.411 INFO:tasks.workunit.client.1.smithi153.stdout:2/69: chown l0 97 1 2024-02-28T16:24:29.415 INFO:tasks.workunit.client.1.smithi153.stdout:8/83: mkdir d0/d19/d1c/d1d 0 2024-02-28T16:24:29.417 INFO:tasks.workunit.client.1.smithi153.stdout:6/84: mknod d0/d15/c22 0 2024-02-28T16:24:29.420 INFO:tasks.workunit.client.1.smithi153.stdout:5/81: rmdir da 39 2024-02-28T16:24:29.421 INFO:tasks.workunit.client.1.smithi153.stdout:4/62: mkdir d4/de/d13/d1b 0 2024-02-28T16:24:29.422 INFO:tasks.workunit.client.1.smithi153.stdout:0/115: dwrite d4/dc/f19 [0,4194304] 0 2024-02-28T16:24:29.424 INFO:tasks.workunit.client.1.smithi153.stdout:1/60: dwrite d0/fe [0,4194304] 0 2024-02-28T16:24:29.429 INFO:tasks.workunit.client.1.smithi153.stdout:8/84: truncate d0/f17 99454 0 2024-02-28T16:24:29.430 INFO:tasks.workunit.client.1.smithi153.stdout:2/70: mknod d2/c17 0 2024-02-28T16:24:29.431 INFO:tasks.workunit.client.1.smithi153.stdout:3/95: creat d4/d8/d1e/d23/f24 x:0 0 0 2024-02-28T16:24:29.434 INFO:tasks.workunit.client.1.smithi153.stdout:7/68: dwrite d1/d4/f9 [0,4194304] 0 2024-02-28T16:24:29.434 INFO:tasks.workunit.client.1.smithi153.stdout:4/63: symlink d4/l1c 0 2024-02-28T16:24:29.436 INFO:tasks.workunit.client.1.smithi153.stdout:3/96: read d4/f7 [118302,21060] 0 2024-02-28T16:24:29.437 INFO:tasks.workunit.client.1.smithi153.stdout:6/85: mkdir d0/d1d/d23 0 2024-02-28T16:24:29.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/71: truncate d2/ff 373207 0 2024-02-28T16:24:29.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/116: mknod d4/d1a/c26 0 2024-02-28T16:24:29.444 INFO:tasks.workunit.client.1.smithi153.stdout:5/82: mknod da/dd/c1c 0 2024-02-28T16:24:29.444 INFO:tasks.workunit.client.1.smithi153.stdout:8/85: rename d0/d12/d15/d1a to d0/d19/d1e 0 2024-02-28T16:24:29.445 INFO:tasks.workunit.client.1.smithi153.stdout:4/64: mknod d4/de/d13/c1d 0 2024-02-28T16:24:29.447 INFO:tasks.workunit.client.1.smithi153.stdout:2/72: rename d2/fe to d2/f18 0 2024-02-28T16:24:29.448 INFO:tasks.workunit.client.1.smithi153.stdout:6/86: symlink d0/d15/l24 0 2024-02-28T16:24:29.448 INFO:tasks.workunit.client.1.smithi153.stdout:0/117: chown d4/d1a/c1c 186494 1 2024-02-28T16:24:29.448 INFO:tasks.workunit.client.1.smithi153.stdout:7/69: creat d1/d4/fe x:0 0 0 2024-02-28T16:24:29.449 INFO:tasks.workunit.client.1.smithi153.stdout:9/47: getdents d1/d2 0 2024-02-28T16:24:29.457 INFO:tasks.workunit.client.1.smithi153.stdout:3/97: rename d4/d13/l19 to d4/d8/d1e/d23/l25 0 2024-02-28T16:24:29.457 INFO:tasks.workunit.client.1.smithi153.stdout:8/86: creat d0/d19/f1f x:0 0 0 2024-02-28T16:24:29.457 INFO:tasks.workunit.client.1.smithi153.stdout:5/83: read f9 [605909,127457] 0 2024-02-28T16:24:29.458 INFO:tasks.workunit.client.1.smithi153.stdout:5/84: readlink - no filename 2024-02-28T16:24:29.463 INFO:tasks.workunit.client.1.smithi153.stdout:1/61: dwrite d0/fa [4194304,4194304] 0 2024-02-28T16:24:29.471 INFO:tasks.workunit.client.1.smithi153.stdout:3/98: mkdir d4/d8/d26 0 2024-02-28T16:24:29.472 INFO:tasks.workunit.client.1.smithi153.stdout:4/65: rename d4/l1c to d4/de/l1e 0 2024-02-28T16:24:29.474 INFO:tasks.workunit.client.1.smithi153.stdout:5/85: dread - da/dd/f13 zero size 2024-02-28T16:24:29.475 INFO:tasks.workunit.client.1.smithi153.stdout:2/73: write d2/f18 [812462,93817] 0 2024-02-28T16:24:29.482 INFO:tasks.workunit.client.1.smithi153.stdout:4/66: dread - d4/de/d13/f18 zero size 2024-02-28T16:24:29.485 INFO:tasks.workunit.client.1.smithi153.stdout:2/74: mkdir d2/d19 0 2024-02-28T16:24:29.487 INFO:tasks.workunit.client.1.smithi153.stdout:1/62: mknod d0/c1a 0 2024-02-28T16:24:29.490 INFO:tasks.workunit.client.1.smithi153.stdout:8/87: getdents d0/d19/d1e 0 2024-02-28T16:24:29.498 INFO:tasks.workunit.client.1.smithi153.stdout:4/67: unlink d4/de/f17 0 2024-02-28T16:24:29.499 INFO:tasks.workunit.client.1.smithi153.stdout:3/99: truncate d4/d13/f1d 713229 0 2024-02-28T16:24:29.499 INFO:tasks.workunit.client.1.smithi153.stdout:8/88: chown d0/d19 10 1 2024-02-28T16:24:29.503 INFO:tasks.workunit.client.1.smithi153.stdout:1/63: mknod d0/dd/c1b 0 2024-02-28T16:24:29.503 INFO:tasks.workunit.client.1.smithi153.stdout:2/75: mknod d2/d19/c1a 0 2024-02-28T16:24:29.506 INFO:tasks.workunit.client.1.smithi153.stdout:7/70: dwrite d1/d4/f7 [0,4194304] 0 2024-02-28T16:24:29.509 INFO:tasks.workunit.client.1.smithi153.stdout:4/68: dread - d4/de/f19 zero size 2024-02-28T16:24:29.515 INFO:tasks.workunit.client.1.smithi153.stdout:8/89: dread - d0/d19/f1f zero size 2024-02-28T16:24:29.516 INFO:tasks.workunit.client.1.smithi153.stdout:3/100: creat d4/d13/f27 x:0 0 0 2024-02-28T16:24:29.516 INFO:tasks.workunit.client.1.smithi153.stdout:4/69: fsync d4/f9 0 2024-02-28T16:24:29.520 INFO:tasks.workunit.client.1.smithi153.stdout:9/48: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:24:29.521 INFO:tasks.workunit.client.1.smithi153.stdout:0/118: dwrite d4/fa [4194304,4194304] 0 2024-02-28T16:24:29.522 INFO:tasks.workunit.client.1.smithi153.stdout:7/71: stat d1/la 0 2024-02-28T16:24:29.525 INFO:tasks.workunit.client.1.smithi153.stdout:7/72: chown d1/d4/fe 913082 1 2024-02-28T16:24:29.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/87: dwrite d0/f20 [0,4194304] 0 2024-02-28T16:24:29.533 INFO:tasks.workunit.client.1.smithi153.stdout:1/64: creat d0/dd/f1c x:0 0 0 2024-02-28T16:24:29.538 INFO:tasks.workunit.client.1.smithi153.stdout:0/119: dread - d4/f8 zero size 2024-02-28T16:24:29.542 INFO:tasks.workunit.client.1.smithi153.stdout:9/49: read d1/f10 [7024,40588] 0 2024-02-28T16:24:29.542 INFO:tasks.workunit.client.1.smithi153.stdout:8/90: unlink d0/l3 0 2024-02-28T16:24:29.545 INFO:tasks.workunit.client.1.smithi153.stdout:4/70: creat d4/de/f1f x:0 0 0 2024-02-28T16:24:29.545 INFO:tasks.workunit.client.1.smithi153.stdout:2/76: link d2/d19/c1a d2/d19/c1b 0 2024-02-28T16:24:29.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/86: dwrite da/f19 [0,4194304] 0 2024-02-28T16:24:29.549 INFO:tasks.workunit.client.1.smithi153.stdout:6/88: rename d0/l11 to d0/d1d/l25 0 2024-02-28T16:24:29.553 INFO:tasks.workunit.client.1.smithi153.stdout:6/89: stat d0/l2 0 2024-02-28T16:24:29.554 INFO:tasks.workunit.client.1.smithi153.stdout:3/101: dread d4/d13/f1d [0,4194304] 0 2024-02-28T16:24:29.554 INFO:tasks.workunit.client.1.smithi153.stdout:2/77: dread d2/ff [0,4194304] 0 2024-02-28T16:24:29.555 INFO:tasks.workunit.client.1.smithi153.stdout:8/91: creat d0/d19/d1e/f20 x:0 0 0 2024-02-28T16:24:29.555 INFO:tasks.workunit.client.1.smithi153.stdout:1/65: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:29.557 INFO:tasks.workunit.client.1.smithi153.stdout:9/50: chown d1/d5/l7 16668028 1 2024-02-28T16:24:29.557 INFO:tasks.workunit.client.1.smithi153.stdout:0/120: mkdir d4/d27 0 2024-02-28T16:24:29.560 INFO:tasks.workunit.client.1.smithi153.stdout:3/102: chown d4/d8/cb 3024 1 2024-02-28T16:24:29.560 INFO:tasks.workunit.client.1.smithi153.stdout:8/92: chown d0/lb 22904 1 2024-02-28T16:24:29.561 INFO:tasks.workunit.client.1.smithi153.stdout:5/87: symlink da/dd/l1d 0 2024-02-28T16:24:29.561 INFO:tasks.workunit.client.1.smithi153.stdout:3/103: readlink d4/le 0 2024-02-28T16:24:29.562 INFO:tasks.workunit.client.1.smithi153.stdout:8/93: chown d0/f8 1 1 2024-02-28T16:24:29.562 INFO:tasks.workunit.client.1.smithi153.stdout:0/121: truncate d4/d1a/f21 386028 0 2024-02-28T16:24:29.564 INFO:tasks.workunit.client.1.smithi153.stdout:0/122: chown d4/f14 32050620 1 2024-02-28T16:24:29.564 INFO:tasks.workunit.client.1.smithi153.stdout:8/94: fdatasync d0/f9 0 2024-02-28T16:24:29.572 INFO:tasks.workunit.client.1.smithi153.stdout:7/73: dwrite d1/d4/f7 [0,4194304] 0 2024-02-28T16:24:29.575 INFO:tasks.workunit.client.1.smithi153.stdout:1/66: mknod d0/dd/c1d 0 2024-02-28T16:24:29.576 INFO:tasks.workunit.client.1.smithi153.stdout:4/71: creat d4/de/d13/f20 x:0 0 0 2024-02-28T16:24:29.578 INFO:tasks.workunit.client.1.smithi153.stdout:6/90: fdatasync d0/f8 0 2024-02-28T16:24:29.580 INFO:tasks.workunit.client.1.smithi153.stdout:5/88: creat da/f1e x:0 0 0 2024-02-28T16:24:29.585 INFO:tasks.workunit.client.1.smithi153.stdout:6/91: truncate d0/d17/f1f 673214 0 2024-02-28T16:24:29.587 INFO:tasks.workunit.client.1.smithi153.stdout:7/74: mkdir d1/d4/df 0 2024-02-28T16:24:29.588 INFO:tasks.workunit.client.1.smithi153.stdout:2/78: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:24:29.589 INFO:tasks.workunit.client.1.smithi153.stdout:6/92: fsync d0/d17/f1f 0 2024-02-28T16:24:29.590 INFO:tasks.workunit.client.1.smithi153.stdout:6/93: readlink d0/l3 0 2024-02-28T16:24:29.591 INFO:tasks.workunit.client.1.smithi153.stdout:6/94: chown d0/f18 20753167 1 2024-02-28T16:24:29.594 INFO:tasks.workunit.client.1.smithi153.stdout:0/123: mknod d4/d27/c28 0 2024-02-28T16:24:29.596 INFO:tasks.workunit.client.1.smithi153.stdout:4/72: rmdir d4/de/d13 39 2024-02-28T16:24:29.599 INFO:tasks.workunit.client.1.smithi153.stdout:5/89: creat da/f1f x:0 0 0 2024-02-28T16:24:29.602 INFO:tasks.workunit.client.1.smithi153.stdout:2/79: creat d2/f1c x:0 0 0 2024-02-28T16:24:29.612 INFO:tasks.workunit.client.1.smithi153.stdout:5/90: creat da/dd/f20 x:0 0 0 2024-02-28T16:24:29.613 INFO:tasks.workunit.client.1.smithi153.stdout:7/75: symlink d1/d4/df/l10 0 2024-02-28T16:24:29.615 INFO:tasks.workunit.client.1.smithi153.stdout:3/104: truncate d4/f17 1627587 0 2024-02-28T16:24:29.624 INFO:tasks.workunit.client.1.smithi153.stdout:7/76: truncate d1/d4/f7 4657265 0 2024-02-28T16:24:29.626 INFO:tasks.workunit.client.1.smithi153.stdout:6/95: link d0/f8 d0/d1d/d23/f26 0 2024-02-28T16:24:29.626 INFO:tasks.workunit.client.1.smithi153.stdout:0/124: dwrite d4/dc/f19 [4194304,4194304] 0 2024-02-28T16:24:29.627 INFO:tasks.workunit.client.1.smithi153.stdout:5/91: symlink da/l21 0 2024-02-28T16:24:29.633 INFO:tasks.workunit.client.1.smithi153.stdout:4/73: creat d4/de/f21 x:0 0 0 2024-02-28T16:24:29.637 INFO:tasks.workunit.client.1.smithi153.stdout:1/67: getdents d0/dd 0 2024-02-28T16:24:29.639 INFO:tasks.workunit.client.1.smithi153.stdout:6/96: mkdir d0/d27 0 2024-02-28T16:24:29.640 INFO:tasks.workunit.client.1.smithi153.stdout:2/80: dwrite d2/f11 [0,4194304] 0 2024-02-28T16:24:29.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:29 smithi153 ceph-mon[35341]: pgmap v4: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:29.647 INFO:tasks.workunit.client.1.smithi153.stdout:6/97: truncate d0/fb 4411239 0 2024-02-28T16:24:29.648 INFO:tasks.workunit.client.1.smithi153.stdout:4/74: write d4/de/f1f [720067,8363] 0 2024-02-28T16:24:29.648 INFO:tasks.workunit.client.1.smithi153.stdout:0/125: symlink d4/d1a/l29 0 2024-02-28T16:24:29.651 INFO:tasks.workunit.client.1.smithi153.stdout:7/77: write d1/d4/f9 [1957928,26195] 0 2024-02-28T16:24:29.656 INFO:tasks.workunit.client.1.smithi153.stdout:4/75: chown d4/de/f16 1362617 1 2024-02-28T16:24:29.658 INFO:tasks.workunit.client.1.smithi153.stdout:8/95: dwrite d0/f6 [0,4194304] 0 2024-02-28T16:24:29.661 INFO:tasks.workunit.client.1.smithi153.stdout:3/105: dwrite f0 [4194304,4194304] 0 2024-02-28T16:24:29.661 INFO:tasks.workunit.client.1.smithi153.stdout:0/126: symlink d4/dc/l2a 0 2024-02-28T16:24:29.663 INFO:tasks.workunit.client.1.smithi153.stdout:2/81: dread d2/f18 [0,4194304] 0 2024-02-28T16:24:29.670 INFO:tasks.workunit.client.1.smithi153.stdout:7/78: fdatasync d1/d4/f9 0 2024-02-28T16:24:29.672 INFO:tasks.workunit.client.1.smithi153.stdout:4/76: readlink d4/de/l1a 0 2024-02-28T16:24:29.673 INFO:tasks.workunit.client.1.smithi153.stdout:6/98: rmdir d0/d1d/d23 39 2024-02-28T16:24:29.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:29 smithi023 ceph-mon[29137]: pgmap v4: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:29.679 INFO:tasks.workunit.client.1.smithi153.stdout:0/127: write d4/d1a/f24 [885141,43254] 0 2024-02-28T16:24:29.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/96: readlink d0/lb 0 2024-02-28T16:24:29.683 INFO:tasks.workunit.client.1.smithi153.stdout:2/82: rmdir d2 39 2024-02-28T16:24:29.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/79: creat d1/d4/f11 x:0 0 0 2024-02-28T16:24:29.687 INFO:tasks.workunit.client.1.smithi153.stdout:6/99: creat d0/d17/f28 x:0 0 0 2024-02-28T16:24:29.688 INFO:tasks.workunit.client.1.smithi153.stdout:1/68: dwrite d0/fe [4194304,4194304] 0 2024-02-28T16:24:29.690 INFO:tasks.workunit.client.1.smithi153.stdout:5/92: dwrite da/dd/f13 [0,4194304] 0 2024-02-28T16:24:29.699 INFO:tasks.workunit.client.1.smithi153.stdout:2/83: write d2/f1c [87357,120741] 0 2024-02-28T16:24:29.699 INFO:tasks.workunit.client.1.smithi153.stdout:7/80: readlink d1/l8 0 2024-02-28T16:24:29.700 INFO:tasks.workunit.client.1.smithi153.stdout:4/77: truncate d4/de/d13/f20 957421 0 2024-02-28T16:24:29.700 INFO:tasks.workunit.client.1.smithi153.stdout:5/93: chown da 18 1 2024-02-28T16:24:29.702 INFO:tasks.workunit.client.1.smithi153.stdout:1/69: dread - d0/f16 zero size 2024-02-28T16:24:29.702 INFO:tasks.workunit.client.1.smithi153.stdout:0/128: link d4/dc/c1e d4/d1a/c2b 0 2024-02-28T16:24:29.716 INFO:tasks.workunit.client.1.smithi153.stdout:3/106: dwrite d4/d8/f1c [0,4194304] 0 2024-02-28T16:24:29.718 INFO:tasks.workunit.client.1.smithi153.stdout:1/70: symlink d0/l1e 0 2024-02-28T16:24:29.719 INFO:tasks.workunit.client.1.smithi153.stdout:0/129: chown d4/dc/f20 196084493 1 2024-02-28T16:24:29.725 INFO:tasks.workunit.client.1.smithi153.stdout:6/100: dread d0/f20 [0,4194304] 0 2024-02-28T16:24:29.725 INFO:tasks.workunit.client.1.smithi153.stdout:7/81: truncate d1/d4/f11 38663 0 2024-02-28T16:24:29.730 INFO:tasks.workunit.client.1.smithi153.stdout:3/107: truncate d4/f20 567748 0 2024-02-28T16:24:29.735 INFO:tasks.workunit.client.1.smithi153.stdout:4/78: dread d4/f6 [0,4194304] 0 2024-02-28T16:24:29.738 INFO:tasks.workunit.client.1.smithi153.stdout:1/71: symlink d0/dd/l1f 0 2024-02-28T16:24:29.742 INFO:tasks.workunit.client.1.smithi153.stdout:7/82: write d1/d4/f11 [655418,75272] 0 2024-02-28T16:24:29.743 INFO:tasks.workunit.client.1.smithi153.stdout:8/97: dwrite d0/f4 [4194304,4194304] 0 2024-02-28T16:24:29.748 INFO:tasks.workunit.client.1.smithi153.stdout:3/108: mkdir d4/d13/d28 0 2024-02-28T16:24:29.751 INFO:tasks.workunit.client.1.smithi153.stdout:5/94: dwrite da/dd/fe [0,4194304] 0 2024-02-28T16:24:29.753 INFO:tasks.workunit.client.1.smithi153.stdout:0/130: rename d4/f7 to d4/dc/f2c 0 2024-02-28T16:24:29.759 INFO:tasks.workunit.client.1.smithi153.stdout:1/72: mknod d0/dd/c20 0 2024-02-28T16:24:29.764 INFO:tasks.workunit.client.1.smithi153.stdout:4/79: rename d4/de/d13/f14 to d4/de/d13/f22 0 2024-02-28T16:24:29.765 INFO:tasks.workunit.client.1.smithi153.stdout:1/73: truncate d0/f9 2398283 0 2024-02-28T16:24:29.768 INFO:tasks.workunit.client.1.smithi153.stdout:6/101: dwrite d0/f19 [0,4194304] 0 2024-02-28T16:24:29.775 INFO:tasks.workunit.client.1.smithi153.stdout:0/131: symlink d4/dc/l2d 0 2024-02-28T16:24:29.775 INFO:tasks.workunit.client.1.smithi153.stdout:2/84: dwrite d2/ff [0,4194304] 0 2024-02-28T16:24:29.776 INFO:tasks.workunit.client.1.smithi153.stdout:6/102: chown d0/f20 2046013403 1 2024-02-28T16:24:29.777 INFO:tasks.workunit.client.1.smithi153.stdout:7/83: creat d1/d4/df/f12 x:0 0 0 2024-02-28T16:24:29.779 INFO:tasks.workunit.client.1.smithi153.stdout:6/103: fsync d0/f18 0 2024-02-28T16:24:29.781 INFO:tasks.workunit.client.1.smithi153.stdout:3/109: creat d4/d8/d26/f29 x:0 0 0 2024-02-28T16:24:29.784 INFO:tasks.workunit.client.1.smithi153.stdout:0/132: chown d4/d1a/f24 818 1 2024-02-28T16:24:29.787 INFO:tasks.workunit.client.1.smithi153.stdout:4/80: mkdir d4/de/d23 0 2024-02-28T16:24:29.787 INFO:tasks.workunit.client.1.smithi153.stdout:3/110: chown d4/d8/d1e 364753 1 2024-02-28T16:24:29.788 INFO:tasks.workunit.client.1.smithi153.stdout:2/85: symlink d2/d19/l1d 0 2024-02-28T16:24:29.788 INFO:tasks.workunit.client.1.smithi153.stdout:4/81: stat d4/cd 0 2024-02-28T16:24:29.791 INFO:tasks.workunit.client.1.smithi153.stdout:8/98: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:29.792 INFO:tasks.workunit.client.1.smithi153.stdout:5/95: getdents da 0 2024-02-28T16:24:29.795 INFO:tasks.workunit.client.1.smithi153.stdout:5/96: chown da/c10 6498489 1 2024-02-28T16:24:29.796 INFO:tasks.workunit.client.1.smithi153.stdout:6/104: chown d0/d1d/d23/f26 8342066 1 2024-02-28T16:24:29.799 INFO:tasks.workunit.client.1.smithi153.stdout:0/133: creat d4/dc/f2e x:0 0 0 2024-02-28T16:24:29.805 INFO:tasks.workunit.client.1.smithi153.stdout:4/82: mkdir d4/d24 0 2024-02-28T16:24:29.808 INFO:tasks.workunit.client.1.smithi153.stdout:5/97: symlink da/l22 0 2024-02-28T16:24:29.809 INFO:tasks.workunit.client.1.smithi153.stdout:2/86: dread d2/f7 [0,4194304] 0 2024-02-28T16:24:29.815 INFO:tasks.workunit.client.1.smithi153.stdout:2/87: chown d2/c17 946212537 1 2024-02-28T16:24:29.816 INFO:tasks.workunit.client.1.smithi153.stdout:7/84: dwrite d1/d4/f7 [0,4194304] 0 2024-02-28T16:24:29.817 INFO:tasks.workunit.client.1.smithi153.stdout:9/51: sync 2024-02-28T16:24:29.819 INFO:tasks.workunit.client.1.smithi153.stdout:2/88: stat d2/c15 0 2024-02-28T16:24:29.819 INFO:tasks.workunit.client.1.smithi153.stdout:5/98: creat da/f23 x:0 0 0 2024-02-28T16:24:29.823 INFO:tasks.workunit.client.1.smithi153.stdout:4/83: dread d4/f5 [0,4194304] 0 2024-02-28T16:24:29.824 INFO:tasks.workunit.client.1.smithi153.stdout:3/111: dwrite d4/f5 [0,4194304] 0 2024-02-28T16:24:29.826 INFO:tasks.workunit.client.1.smithi153.stdout:3/112: stat d4/d13/f1d 0 2024-02-28T16:24:29.828 INFO:tasks.workunit.client.1.smithi153.stdout:3/113: stat d4/d8/c12 0 2024-02-28T16:24:29.828 INFO:tasks.workunit.client.1.smithi153.stdout:3/114: chown d4 158229748 1 2024-02-28T16:24:29.830 INFO:tasks.workunit.client.1.smithi153.stdout:6/105: dwrite d0/f20 [0,4194304] 0 2024-02-28T16:24:29.836 INFO:tasks.workunit.client.1.smithi153.stdout:2/89: mknod d2/c1e 0 2024-02-28T16:24:29.838 INFO:tasks.workunit.client.1.smithi153.stdout:5/99: creat da/f24 x:0 0 0 2024-02-28T16:24:29.847 INFO:tasks.workunit.client.1.smithi153.stdout:7/85: dwrite d1/d4/f11 [0,4194304] 0 2024-02-28T16:24:29.847 INFO:tasks.workunit.client.1.smithi153.stdout:0/134: creat d4/f2f x:0 0 0 2024-02-28T16:24:29.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/100: dread da/dd/f17 [0,4194304] 0 2024-02-28T16:24:29.852 INFO:tasks.workunit.client.1.smithi153.stdout:8/99: rmdir d0/d19/d1c/d1d 0 2024-02-28T16:24:29.862 INFO:tasks.workunit.client.1.smithi153.stdout:5/101: chown da/dd/f15 0 1 2024-02-28T16:24:29.862 INFO:tasks.workunit.client.1.smithi153.stdout:9/52: mkdir d1/d5/d11 0 2024-02-28T16:24:29.862 INFO:tasks.workunit.client.1.smithi153.stdout:3/115: mkdir d4/d8/d1e/d2a 0 2024-02-28T16:24:29.867 INFO:tasks.workunit.client.1.smithi153.stdout:1/74: truncate d0/dd/f13 2218063 0 2024-02-28T16:24:29.869 INFO:tasks.workunit.client.1.smithi153.stdout:2/90: symlink d2/l1f 0 2024-02-28T16:24:29.869 INFO:tasks.workunit.client.1.smithi153.stdout:6/106: dwrite d0/f20 [0,4194304] 0 2024-02-28T16:24:29.870 INFO:tasks.workunit.client.1.smithi153.stdout:1/75: fsync d0/f18 0 2024-02-28T16:24:29.874 INFO:tasks.workunit.client.1.smithi153.stdout:6/107: chown d0/d17/l1b 2502223 1 2024-02-28T16:24:29.878 INFO:tasks.workunit.client.1.smithi153.stdout:1/76: unlink d0/l5 0 2024-02-28T16:24:29.881 INFO:tasks.workunit.client.1.smithi153.stdout:1/77: readlink d0/lc 0 2024-02-28T16:24:29.884 INFO:tasks.workunit.client.1.smithi153.stdout:2/91: link d2/f7 d2/f20 0 2024-02-28T16:24:29.888 INFO:tasks.workunit.client.1.smithi153.stdout:0/135: dwrite d4/fa [4194304,4194304] 0 2024-02-28T16:24:29.889 INFO:tasks.workunit.client.1.smithi153.stdout:7/86: dwrite d1/d4/f11 [0,4194304] 0 2024-02-28T16:24:29.893 INFO:tasks.workunit.client.1.smithi153.stdout:2/92: creat d2/f21 x:0 0 0 2024-02-28T16:24:29.893 INFO:tasks.workunit.client.1.smithi153.stdout:1/78: creat d0/dd/f21 x:0 0 0 2024-02-28T16:24:29.896 INFO:tasks.workunit.client.1.smithi153.stdout:0/136: dread - d4/d1a/f1d zero size 2024-02-28T16:24:29.902 INFO:tasks.workunit.client.1.smithi153.stdout:0/137: stat d4/d27 0 2024-02-28T16:24:29.907 INFO:tasks.workunit.client.1.smithi153.stdout:7/87: creat d1/d4/dc/f13 x:0 0 0 2024-02-28T16:24:29.909 INFO:tasks.workunit.client.1.smithi153.stdout:0/138: readlink d4/dc/l2d 0 2024-02-28T16:24:29.916 INFO:tasks.workunit.client.1.smithi153.stdout:7/88: dread - d1/d4/df/f12 zero size 2024-02-28T16:24:29.919 INFO:tasks.workunit.client.1.smithi153.stdout:0/139: write d4/dc/f19 [7217720,97120] 0 2024-02-28T16:24:29.921 INFO:tasks.workunit.client.1.smithi153.stdout:6/108: dwrite d0/f19 [0,4194304] 0 2024-02-28T16:24:29.930 INFO:tasks.workunit.client.1.smithi153.stdout:5/102: rmdir da 39 2024-02-28T16:24:29.930 INFO:tasks.workunit.client.1.smithi153.stdout:8/100: dwrite d0/f8 [8388608,4194304] 0 2024-02-28T16:24:29.931 INFO:tasks.workunit.client.1.smithi153.stdout:0/140: chown d4/c22 8792 1 2024-02-28T16:24:29.931 INFO:tasks.workunit.client.1.smithi153.stdout:3/116: rmdir d4 39 2024-02-28T16:24:29.932 INFO:tasks.workunit.client.1.smithi153.stdout:2/93: dwrite d2/f20 [0,4194304] 0 2024-02-28T16:24:29.938 INFO:tasks.workunit.client.1.smithi153.stdout:7/89: rename d1/d4/dc/cd to d1/d4/c14 0 2024-02-28T16:24:29.940 INFO:tasks.workunit.client.1.smithi153.stdout:5/103: mkdir da/dd/d25 0 2024-02-28T16:24:29.940 INFO:tasks.workunit.client.1.smithi153.stdout:8/101: chown d0/ca 887 1 2024-02-28T16:24:29.945 INFO:tasks.workunit.client.1.smithi153.stdout:0/141: creat d4/d1a/f30 x:0 0 0 2024-02-28T16:24:29.947 INFO:tasks.workunit.client.1.smithi153.stdout:6/109: rename d0/l3 to d0/d1d/l29 0 2024-02-28T16:24:29.951 INFO:tasks.workunit.client.1.smithi153.stdout:6/110: stat d0/d1d/d23 0 2024-02-28T16:24:29.958 INFO:tasks.workunit.client.1.smithi153.stdout:7/90: rename d1/d4/df/f12 to d1/d4/dc/f15 0 2024-02-28T16:24:29.963 INFO:tasks.workunit.client.1.smithi153.stdout:1/79: getdents d0 0 2024-02-28T16:24:29.969 INFO:tasks.workunit.client.1.smithi153.stdout:5/104: rename da/f23 to da/dd/d25/f26 0 2024-02-28T16:24:29.974 INFO:tasks.workunit.client.1.smithi153.stdout:9/53: dwrite d1/f10 [0,4194304] 0 2024-02-28T16:24:29.974 INFO:tasks.workunit.client.1.smithi153.stdout:7/91: creat d1/d4/f16 x:0 0 0 2024-02-28T16:24:29.977 INFO:tasks.workunit.client.1.smithi153.stdout:8/102: fsync d0/f11 0 2024-02-28T16:24:29.978 INFO:tasks.workunit.client.1.smithi153.stdout:1/80: unlink d0/f9 0 2024-02-28T16:24:29.979 INFO:tasks.workunit.client.1.smithi153.stdout:6/111: fsync d0/f19 0 2024-02-28T16:24:29.983 INFO:tasks.workunit.client.1.smithi153.stdout:5/105: unlink da/f1f 0 2024-02-28T16:24:29.987 INFO:tasks.workunit.client.1.smithi153.stdout:2/94: dwrite d2/f20 [0,4194304] 0 2024-02-28T16:24:29.987 INFO:tasks.workunit.client.1.smithi153.stdout:0/142: rename d4/f6 to d4/d1a/f31 0 2024-02-28T16:24:29.989 INFO:tasks.workunit.client.1.smithi153.stdout:8/103: dread - d0/ff zero size 2024-02-28T16:24:29.989 INFO:tasks.workunit.client.1.smithi153.stdout:2/95: fdatasync d2/fd 0 2024-02-28T16:24:29.990 INFO:tasks.workunit.client.1.smithi153.stdout:8/104: dread - d0/ff zero size 2024-02-28T16:24:29.991 INFO:tasks.workunit.client.1.smithi153.stdout:7/92: symlink d1/d4/df/l17 0 2024-02-28T16:24:30.001 INFO:tasks.workunit.client.1.smithi153.stdout:8/105: creat d0/d19/d1e/f21 x:0 0 0 2024-02-28T16:24:30.002 INFO:tasks.workunit.client.1.smithi153.stdout:7/93: symlink d1/l18 0 2024-02-28T16:24:30.003 INFO:tasks.workunit.client.1.smithi153.stdout:0/143: mkdir d4/d32 0 2024-02-28T16:24:30.008 INFO:tasks.workunit.client.1.smithi153.stdout:9/54: rename d1/d2/l8 to d1/l12 0 2024-02-28T16:24:30.011 INFO:tasks.workunit.client.1.smithi153.stdout:7/94: mknod d1/d4/c19 0 2024-02-28T16:24:30.015 INFO:tasks.workunit.client.1.smithi153.stdout:9/55: mknod d1/d5/d11/c13 0 2024-02-28T16:24:30.017 INFO:tasks.workunit.client.1.smithi153.stdout:7/95: symlink d1/d4/dc/l1a 0 2024-02-28T16:24:30.020 INFO:tasks.workunit.client.1.smithi153.stdout:1/81: dread d0/dd/f13 [0,4194304] 0 2024-02-28T16:24:30.021 INFO:tasks.workunit.client.1.smithi153.stdout:4/84: sync 2024-02-28T16:24:30.021 INFO:tasks.workunit.client.1.smithi153.stdout:9/56: mknod d1/d5/d11/c14 0 2024-02-28T16:24:30.038 INFO:tasks.workunit.client.1.smithi153.stdout:1/82: mknod d0/c22 0 2024-02-28T16:24:30.038 INFO:tasks.workunit.client.1.smithi153.stdout:6/112: rename d0/d1d/l29 to d0/d1d/d23/l2a 0 2024-02-28T16:24:30.048 INFO:tasks.workunit.client.1.smithi153.stdout:0/144: dwrite d4/dc/f2e [0,4194304] 0 2024-02-28T16:24:30.050 INFO:tasks.workunit.client.1.smithi153.stdout:8/106: dread d0/f9 [0,4194304] 0 2024-02-28T16:24:30.057 INFO:tasks.workunit.client.1.smithi153.stdout:5/106: rename da/dd/f20 to da/f27 0 2024-02-28T16:24:30.062 INFO:tasks.workunit.client.1.smithi153.stdout:3/117: dwrite d4/f17 [0,4194304] 0 2024-02-28T16:24:30.062 INFO:tasks.workunit.client.1.smithi153.stdout:2/96: truncate d2/f18 422806 0 2024-02-28T16:24:30.065 INFO:tasks.workunit.client.1.smithi153.stdout:5/107: fsync da/fc 0 2024-02-28T16:24:30.068 INFO:tasks.workunit.client.1.smithi153.stdout:6/113: mknod d0/d1d/c2b 0 2024-02-28T16:24:30.075 INFO:tasks.workunit.client.1.smithi153.stdout:4/85: dwrite d4/de/d13/f20 [0,4194304] 0 2024-02-28T16:24:30.076 INFO:tasks.workunit.client.1.smithi153.stdout:9/57: dwrite d1/f4 [4194304,4194304] 0 2024-02-28T16:24:30.077 INFO:tasks.workunit.client.1.smithi153.stdout:3/118: readlink d4/le 0 2024-02-28T16:24:30.078 INFO:tasks.workunit.client.1.smithi153.stdout:0/145: creat d4/dc/f33 x:0 0 0 2024-02-28T16:24:30.082 INFO:tasks.workunit.client.1.smithi153.stdout:8/107: fdatasync d0/f16 0 2024-02-28T16:24:30.113 INFO:tasks.workunit.client.1.smithi153.stdout:6/114: creat d0/d15/f2c x:0 0 0 2024-02-28T16:24:30.113 INFO:tasks.workunit.client.1.smithi153.stdout:5/108: fdatasync f7 0 2024-02-28T16:24:30.113 INFO:tasks.workunit.client.1.smithi153.stdout:7/96: dwrite d1/d4/dc/f13 [0,4194304] 0 2024-02-28T16:24:30.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/97: chown d1/la 1 1 2024-02-28T16:24:30.119 INFO:tasks.workunit.client.1.smithi153.stdout:7/98: dread - d1/d4/dc/f15 zero size 2024-02-28T16:24:30.121 INFO:tasks.workunit.client.1.smithi153.stdout:7/99: rename d1 to d1/d1b 22 2024-02-28T16:24:30.123 INFO:tasks.workunit.client.1.smithi153.stdout:3/119: truncate d4/d8/d1e/d23/f24 734799 0 2024-02-28T16:24:30.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/83: getdents d0 0 2024-02-28T16:24:30.137 INFO:tasks.workunit.client.1.smithi153.stdout:6/115: dwrite d0/d1d/f1e [0,4194304] 0 2024-02-28T16:24:30.138 INFO:tasks.workunit.client.1.smithi153.stdout:1/84: stat d0/dd 0 2024-02-28T16:24:30.145 INFO:tasks.workunit.client.1.smithi153.stdout:1/85: chown d0/f16 1 1 2024-02-28T16:24:30.146 INFO:tasks.workunit.client.1.smithi153.stdout:6/116: readlink d0/d17/l1b 0 2024-02-28T16:24:30.155 INFO:tasks.workunit.client.1.smithi153.stdout:0/146: dwrite d4/d1a/f30 [0,4194304] 0 2024-02-28T16:24:30.156 INFO:tasks.workunit.client.1.smithi153.stdout:3/120: dwrite d4/f20 [0,4194304] 0 2024-02-28T16:24:30.156 INFO:tasks.workunit.client.1.smithi153.stdout:0/147: readlink d4/dc/l10 0 2024-02-28T16:24:30.159 INFO:tasks.workunit.client.1.smithi153.stdout:0/148: read - d4/f23 zero size 2024-02-28T16:24:30.230 INFO:tasks.workunit.client.1.smithi153.stdout:4/86: unlink d4/de/d13/f22 0 2024-02-28T16:24:30.230 INFO:tasks.workunit.client.1.smithi153.stdout:2/97: dwrite d2/f18 [0,4194304] 0 2024-02-28T16:24:30.232 INFO:tasks.workunit.client.1.smithi153.stdout:4/87: write d4/f10 [864166,112975] 0 2024-02-28T16:24:30.232 INFO:tasks.workunit.client.1.smithi153.stdout:5/109: symlink da/dd/l28 0 2024-02-28T16:24:30.234 INFO:tasks.workunit.client.1.smithi153.stdout:4/88: stat d4/de/f16 0 2024-02-28T16:24:30.234 INFO:tasks.workunit.client.1.smithi153.stdout:7/100: rename d1/d4/f11 to d1/f1c 0 2024-02-28T16:24:30.236 INFO:tasks.workunit.client.1.smithi153.stdout:4/89: readlink d4/de/l1a 0 2024-02-28T16:24:30.243 INFO:tasks.workunit.client.1.smithi153.stdout:5/110: mkdir da/d29 0 2024-02-28T16:24:30.245 INFO:tasks.workunit.client.1.smithi153.stdout:9/58: creat d1/f15 x:0 0 0 2024-02-28T16:24:30.248 INFO:tasks.workunit.client.1.smithi153.stdout:4/90: unlink d4/cb 0 2024-02-28T16:24:30.250 INFO:tasks.workunit.client.1.smithi153.stdout:4/91: readlink d4/de/l1a 0 2024-02-28T16:24:30.253 INFO:tasks.workunit.client.1.smithi153.stdout:4/92: fsync d4/de/d13/f20 0 2024-02-28T16:24:30.258 INFO:tasks.workunit.client.1.smithi153.stdout:9/59: mknod d1/d5/d11/c16 0 2024-02-28T16:24:30.261 INFO:tasks.workunit.client.1.smithi153.stdout:8/108: dwrite d0/d12/d15/f1b [0,4194304] 0 2024-02-28T16:24:30.264 INFO:tasks.workunit.client.1.smithi153.stdout:8/109: stat d0/ff 0 2024-02-28T16:24:30.267 INFO:tasks.workunit.client.1.smithi153.stdout:7/101: dwrite d1/d4/f16 [0,4194304] 0 2024-02-28T16:24:30.268 INFO:tasks.workunit.client.1.smithi153.stdout:0/149: rename d4/f9 to d4/f34 0 2024-02-28T16:24:30.280 INFO:tasks.workunit.client.1.smithi153.stdout:2/98: getdents d2/d19 0 2024-02-28T16:24:30.281 INFO:tasks.workunit.client.1.smithi153.stdout:6/117: getdents d0/d17 0 2024-02-28T16:24:30.282 INFO:tasks.workunit.client.1.smithi153.stdout:8/110: mkdir d0/d19/d1e/d22 0 2024-02-28T16:24:30.286 INFO:tasks.workunit.client.1.smithi153.stdout:4/93: write d4/de/f11 [403641,12597] 0 2024-02-28T16:24:30.287 INFO:tasks.workunit.client.1.smithi153.stdout:7/102: dread d1/d4/f16 [0,4194304] 0 2024-02-28T16:24:30.288 INFO:tasks.workunit.client.1.smithi153.stdout:4/94: fdatasync d4/f10 0 2024-02-28T16:24:30.289 INFO:tasks.workunit.client.1.smithi153.stdout:4/95: chown d4/de 0 1 2024-02-28T16:24:30.290 INFO:tasks.workunit.client.1.smithi153.stdout:4/96: stat d4/c8 0 2024-02-28T16:24:30.292 INFO:tasks.workunit.client.1.smithi153.stdout:6/118: mknod d0/d1d/c2d 0 2024-02-28T16:24:30.293 INFO:tasks.workunit.client.1.smithi153.stdout:4/97: read - d4/de/d13/f18 zero size 2024-02-28T16:24:30.298 INFO:tasks.workunit.client.1.smithi153.stdout:7/103: mknod d1/c1d 0 2024-02-28T16:24:30.303 INFO:tasks.workunit.client.1.smithi153.stdout:2/99: getdents d2 0 2024-02-28T16:24:30.303 INFO:tasks.workunit.client.1.smithi153.stdout:5/111: dread da/dd/f11 [0,4194304] 0 2024-02-28T16:24:30.304 INFO:tasks.workunit.client.1.smithi153.stdout:7/104: symlink d1/l1e 0 2024-02-28T16:24:30.306 INFO:tasks.workunit.client.1.smithi153.stdout:4/98: rmdir d4/d24 0 2024-02-28T16:24:30.308 INFO:tasks.workunit.client.1.smithi153.stdout:4/99: dread - d4/de/f21 zero size 2024-02-28T16:24:30.310 INFO:tasks.workunit.client.1.smithi153.stdout:6/119: dread d0/f10 [0,4194304] 0 2024-02-28T16:24:30.312 INFO:tasks.workunit.client.1.smithi153.stdout:6/120: write d0/d17/f1f [364922,122697] 0 2024-02-28T16:24:30.313 INFO:tasks.workunit.client.1.smithi153.stdout:7/105: rename d1/l1e to d1/d4/dc/l1f 0 2024-02-28T16:24:30.314 INFO:tasks.workunit.client.1.smithi153.stdout:7/106: chown d1/d4/dc 1673 1 2024-02-28T16:24:30.319 INFO:tasks.workunit.client.1.smithi153.stdout:3/121: truncate d4/d8/fd 3305007 0 2024-02-28T16:24:30.320 INFO:tasks.workunit.client.1.smithi153.stdout:5/112: getdents da/dd/d25 0 2024-02-28T16:24:30.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/113: chown da/f19 175 1 2024-02-28T16:24:30.324 INFO:tasks.workunit.client.1.smithi153.stdout:9/60: truncate d1/d5/fb 3065299 0 2024-02-28T16:24:30.324 INFO:tasks.workunit.client.1.smithi153.stdout:3/122: chown d4/d8/l16 229087 1 2024-02-28T16:24:30.327 INFO:tasks.workunit.client.1.smithi153.stdout:1/86: dwrite d0/dd/f13 [0,4194304] 0 2024-02-28T16:24:30.329 INFO:tasks.workunit.client.1.smithi153.stdout:2/100: dwrite d2/f18 [4194304,4194304] 0 2024-02-28T16:24:30.343 INFO:tasks.workunit.client.1.smithi153.stdout:6/121: dwrite d0/d15/f2c [0,4194304] 0 2024-02-28T16:24:30.343 INFO:tasks.workunit.client.1.smithi153.stdout:2/101: rename d2/c17 to d2/c22 0 2024-02-28T16:24:30.348 INFO:tasks.workunit.client.1.smithi153.stdout:4/100: readlink d4/de/l1e 0 2024-02-28T16:24:30.356 INFO:tasks.workunit.client.1.smithi153.stdout:1/87: dread d0/dd/f13 [0,4194304] 0 2024-02-28T16:24:30.365 INFO:tasks.workunit.client.1.smithi153.stdout:9/61: link d1/d5/cc d1/d5/c17 0 2024-02-28T16:24:30.369 INFO:tasks.workunit.client.1.smithi153.stdout:1/88: unlink d0/dd/l1f 0 2024-02-28T16:24:30.369 INFO:tasks.workunit.client.1.smithi153.stdout:3/123: dwrite d4/d13/f14 [0,4194304] 0 2024-02-28T16:24:30.371 INFO:tasks.workunit.client.1.smithi153.stdout:2/102: dread d2/f6 [0,4194304] 0 2024-02-28T16:24:30.377 INFO:tasks.workunit.client.1.smithi153.stdout:1/89: write d0/f8 [188228,82446] 0 2024-02-28T16:24:30.377 INFO:tasks.workunit.client.1.smithi153.stdout:9/62: creat d1/d2/f18 x:0 0 0 2024-02-28T16:24:30.379 INFO:tasks.workunit.client.1.smithi153.stdout:9/63: dread - d1/ff zero size 2024-02-28T16:24:30.384 INFO:tasks.workunit.client.1.smithi153.stdout:2/103: rmdir d2/d19 39 2024-02-28T16:24:30.387 INFO:tasks.workunit.client.1.smithi153.stdout:4/101: getdents d4/de 0 2024-02-28T16:24:30.388 INFO:tasks.workunit.client.1.smithi153.stdout:1/90: creat d0/f23 x:0 0 0 2024-02-28T16:24:30.390 INFO:tasks.workunit.client.1.smithi153.stdout:6/122: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:24:30.400 INFO:tasks.workunit.client.1.smithi153.stdout:4/102: read f0 [4998020,52454] 0 2024-02-28T16:24:30.404 INFO:tasks.workunit.client.1.smithi153.stdout:1/91: link d0/dd/c17 d0/c24 0 2024-02-28T16:24:30.404 INFO:tasks.workunit.client.1.smithi153.stdout:9/64: dwrite d1/f15 [0,4194304] 0 2024-02-28T16:24:30.415 INFO:tasks.workunit.client.1.smithi153.stdout:3/124: write d4/d8/fd [2229990,62241] 0 2024-02-28T16:24:30.416 INFO:tasks.workunit.client.1.smithi153.stdout:9/65: chown d1/d5/d11/c16 70 1 2024-02-28T16:24:30.417 INFO:tasks.workunit.client.1.smithi153.stdout:1/92: rename d0/f18 to d0/f25 0 2024-02-28T16:24:30.418 INFO:tasks.workunit.client.1.smithi153.stdout:2/104: dwrite d2/f18 [4194304,4194304] 0 2024-02-28T16:24:30.419 INFO:tasks.workunit.client.1.smithi153.stdout:9/66: write d1/f4 [3288786,8235] 0 2024-02-28T16:24:30.422 INFO:tasks.workunit.client.1.smithi153.stdout:9/67: dread - d1/ff zero size 2024-02-28T16:24:30.423 INFO:tasks.workunit.client.1.smithi153.stdout:6/123: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:30.425 INFO:tasks.workunit.client.1.smithi153.stdout:3/125: link d4/f17 d4/d8/d1e/f2b 0 2024-02-28T16:24:30.428 INFO:tasks.workunit.client.1.smithi153.stdout:6/124: write d0/fb [4989450,98802] 0 2024-02-28T16:24:30.428 INFO:tasks.workunit.client.1.smithi153.stdout:9/68: rmdir d1 39 2024-02-28T16:24:30.433 INFO:tasks.workunit.client.1.smithi153.stdout:3/126: mkdir d4/d2c 0 2024-02-28T16:24:30.434 INFO:tasks.workunit.client.1.smithi153.stdout:6/125: rename d0/d27 to d0/d15/d2e 0 2024-02-28T16:24:30.445 INFO:tasks.workunit.client.1.smithi153.stdout:3/127: symlink d4/d8/d1e/l2d 0 2024-02-28T16:24:30.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/126: truncate d0/d15/f2c 4329640 0 2024-02-28T16:24:30.446 INFO:tasks.workunit.client.1.smithi153.stdout:9/69: creat d1/d5/f19 x:0 0 0 2024-02-28T16:24:30.446 INFO:tasks.workunit.client.1.smithi153.stdout:6/127: chown d0/f19 18572 1 2024-02-28T16:24:30.446 INFO:tasks.workunit.client.1.smithi153.stdout:3/128: chown d4/d13/f27 14407491 1 2024-02-28T16:24:30.446 INFO:tasks.workunit.client.1.smithi153.stdout:9/70: rmdir d1/d5/d11 39 2024-02-28T16:24:30.446 INFO:tasks.workunit.client.1.smithi153.stdout:6/128: fdatasync d0/d1d/f1e 0 2024-02-28T16:24:30.447 INFO:tasks.workunit.client.1.smithi153.stdout:2/105: dread d2/f7 [0,4194304] 0 2024-02-28T16:24:30.452 INFO:tasks.workunit.client.1.smithi153.stdout:1/93: dwrite d0/dd/f13 [4194304,4194304] 0 2024-02-28T16:24:30.452 INFO:tasks.workunit.client.1.smithi153.stdout:3/129: mknod d4/d2c/c2e 0 2024-02-28T16:24:30.454 INFO:tasks.workunit.client.1.smithi153.stdout:3/130: fsync d4/f1b 0 2024-02-28T16:24:30.456 INFO:tasks.workunit.client.1.smithi153.stdout:2/106: rmdir d2/d19 39 2024-02-28T16:24:30.458 INFO:tasks.workunit.client.1.smithi153.stdout:1/94: mknod d0/dd/c26 0 2024-02-28T16:24:30.462 INFO:tasks.workunit.client.1.smithi153.stdout:2/107: mkdir d2/d23 0 2024-02-28T16:24:30.472 INFO:tasks.workunit.client.1.smithi153.stdout:6/129: dwrite d0/f19 [0,4194304] 0 2024-02-28T16:24:30.474 INFO:tasks.workunit.client.1.smithi153.stdout:4/103: dread d4/f9 [0,4194304] 0 2024-02-28T16:24:30.478 INFO:tasks.workunit.client.1.smithi153.stdout:6/130: write d0/d17/f1f [1501703,8720] 0 2024-02-28T16:24:30.478 INFO:tasks.workunit.client.1.smithi153.stdout:9/71: write d1/d5/fb [3426803,21759] 0 2024-02-28T16:24:30.480 INFO:tasks.workunit.client.1.smithi153.stdout:6/131: chown d0/d15/l24 182890 1 2024-02-28T16:24:30.484 INFO:tasks.workunit.client.1.smithi153.stdout:2/108: dread d2/f18 [4194304,4194304] 0 2024-02-28T16:24:30.489 INFO:tasks.workunit.client.1.smithi153.stdout:6/132: mknod d0/d1d/c2f 0 2024-02-28T16:24:30.492 INFO:tasks.workunit.client.1.smithi153.stdout:3/131: dread f0 [0,4194304] 0 2024-02-28T16:24:30.496 INFO:tasks.workunit.client.1.smithi153.stdout:3/132: creat d4/d13/d28/f2f x:0 0 0 2024-02-28T16:24:30.498 INFO:tasks.workunit.client.1.smithi153.stdout:9/72: dread d1/f15 [0,4194304] 0 2024-02-28T16:24:30.499 INFO:tasks.workunit.client.1.smithi153.stdout:3/133: rmdir d4/d13 39 2024-02-28T16:24:30.499 INFO:tasks.workunit.client.1.smithi153.stdout:2/109: dread d2/f18 [0,4194304] 0 2024-02-28T16:24:30.501 INFO:tasks.workunit.client.1.smithi153.stdout:4/104: dwrite d4/f9 [0,4194304] 0 2024-02-28T16:24:30.503 INFO:tasks.workunit.client.1.smithi153.stdout:4/105: write d4/de/f21 [543883,93862] 0 2024-02-28T16:24:30.521 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:30 smithi153 ceph-mon[35341]: mgrmap e29: smithi023.bbebnt(active, since 3s) 2024-02-28T16:24:30.583 INFO:tasks.workunit.client.1.smithi153.stdout:3/134: symlink d4/d8/d1e/d2a/l30 0 2024-02-28T16:24:30.589 INFO:tasks.workunit.client.1.smithi153.stdout:9/73: rename d1/d5/l9 to d1/d5/d11/l1a 0 2024-02-28T16:24:30.591 INFO:tasks.workunit.client.1.smithi153.stdout:4/106: truncate d4/de/f11 2150535 0 2024-02-28T16:24:30.591 INFO:tasks.workunit.client.1.smithi153.stdout:2/110: dwrite d2/fd [0,4194304] 0 2024-02-28T16:24:30.596 INFO:tasks.workunit.client.1.smithi153.stdout:9/74: mknod d1/d5/d11/c1b 0 2024-02-28T16:24:30.600 INFO:tasks.workunit.client.1.smithi153.stdout:4/107: rename d4/c8 to d4/de/c25 0 2024-02-28T16:24:30.601 INFO:tasks.workunit.client.1.smithi153.stdout:4/108: chown d4/f6 54 1 2024-02-28T16:24:30.613 INFO:tasks.workunit.client.1.smithi153.stdout:2/111: dwrite d2/f11 [4194304,4194304] 0 2024-02-28T16:24:30.615 INFO:tasks.workunit.client.1.smithi153.stdout:3/135: getdents d4/d8/d1e/d2a 0 2024-02-28T16:24:30.616 INFO:tasks.workunit.client.1.smithi153.stdout:2/112: write d2/f21 [387882,35456] 0 2024-02-28T16:24:30.624 INFO:tasks.workunit.client.1.smithi153.stdout:9/75: dwrite d1/d5/f19 [0,4194304] 0 2024-02-28T16:24:30.626 INFO:tasks.workunit.client.1.smithi153.stdout:2/113: write d2/f10 [2855205,17668] 0 2024-02-28T16:24:30.627 INFO:tasks.workunit.client.1.smithi153.stdout:3/136: rename d4/d8/c12 to d4/d8/d1e/c31 0 2024-02-28T16:24:30.629 INFO:tasks.workunit.client.1.smithi153.stdout:2/114: write d2/f10 [453200,8200] 0 2024-02-28T16:24:30.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/137: write d4/d8/d26/f29 [972648,77499] 0 2024-02-28T16:24:30.632 INFO:tasks.workunit.client.1.smithi153.stdout:9/76: fdatasync d1/d2/f18 0 2024-02-28T16:24:30.632 INFO:tasks.workunit.client.1.smithi153.stdout:4/109: write d4/f7 [2223411,8173] 0 2024-02-28T16:24:30.633 INFO:tasks.workunit.client.1.smithi153.stdout:2/115: fsync d2/fd 0 2024-02-28T16:24:30.633 INFO:tasks.workunit.client.1.smithi153.stdout:4/110: chown f1 112 1 2024-02-28T16:24:30.635 INFO:tasks.workunit.client.1.smithi153.stdout:9/77: chown d1/f4 84634 1 2024-02-28T16:24:30.639 INFO:tasks.workunit.client.1.smithi153.stdout:3/138: unlink d4/f1a 0 2024-02-28T16:24:30.648 INFO:tasks.workunit.client.1.smithi153.stdout:2/116: dread d2/ff [0,4194304] 0 2024-02-28T16:24:30.649 INFO:tasks.workunit.client.1.smithi153.stdout:9/78: mkdir d1/d1c 0 2024-02-28T16:24:30.650 INFO:tasks.workunit.client.1.smithi153.stdout:3/139: rmdir d4/d13/d28 39 2024-02-28T16:24:30.652 INFO:tasks.workunit.client.1.smithi153.stdout:9/79: dread - d1/d2/f18 zero size 2024-02-28T16:24:30.654 INFO:tasks.workunit.client.1.smithi153.stdout:3/140: readlink d4/d8/d1e/d2a/l30 0 2024-02-28T16:24:30.655 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:30 smithi023 ceph-mon[29137]: mgrmap e29: smithi023.bbebnt(active, since 3s) 2024-02-28T16:24:30.655 INFO:tasks.workunit.client.1.smithi153.stdout:4/111: dwrite d4/de/f16 [0,4194304] 0 2024-02-28T16:24:30.662 INFO:tasks.workunit.client.1.smithi153.stdout:4/112: creat d4/de/d13/f26 x:0 0 0 2024-02-28T16:24:30.662 INFO:tasks.workunit.client.1.smithi153.stdout:7/107: sync 2024-02-28T16:24:30.663 INFO:tasks.workunit.client.1.smithi153.stdout:8/111: sync 2024-02-28T16:24:30.663 INFO:tasks.workunit.client.1.smithi153.stdout:0/150: sync 2024-02-28T16:24:30.665 INFO:tasks.workunit.client.1.smithi153.stdout:7/108: readlink d1/l18 0 2024-02-28T16:24:30.668 INFO:tasks.workunit.client.1.smithi153.stdout:0/151: rmdir d4/d1a 39 2024-02-28T16:24:30.671 INFO:tasks.workunit.client.1.smithi153.stdout:7/109: stat d1/d4/l6 0 2024-02-28T16:24:30.672 INFO:tasks.workunit.client.1.smithi153.stdout:9/80: truncate d1/f10 1795411 0 2024-02-28T16:24:30.674 INFO:tasks.workunit.client.1.smithi153.stdout:8/112: rename d0/f4 to d0/d19/d1e/d22/f23 0 2024-02-28T16:24:30.676 INFO:tasks.workunit.client.1.smithi153.stdout:7/110: unlink d1/c1d 0 2024-02-28T16:24:30.676 INFO:tasks.workunit.client.1.smithi153.stdout:3/141: dwrite d4/f1b [0,4194304] 0 2024-02-28T16:24:30.678 INFO:tasks.workunit.client.1.smithi153.stdout:2/117: dwrite d2/ff [0,4194304] 0 2024-02-28T16:24:30.680 INFO:tasks.workunit.client.1.smithi153.stdout:9/81: symlink d1/l1d 0 2024-02-28T16:24:30.681 INFO:tasks.workunit.client.1.smithi153.stdout:8/113: write d0/d19/f1f [430806,102867] 0 2024-02-28T16:24:30.686 INFO:tasks.workunit.client.1.smithi153.stdout:8/114: chown d0/f9 5486 1 2024-02-28T16:24:30.686 INFO:tasks.workunit.client.1.smithi153.stdout:8/115: readlink d0/lb 0 2024-02-28T16:24:30.690 INFO:tasks.workunit.client.1.smithi153.stdout:4/113: dwrite d4/f9 [0,4194304] 0 2024-02-28T16:24:30.698 INFO:tasks.workunit.client.1.smithi153.stdout:3/142: mknod d4/d8/d1e/d23/c32 0 2024-02-28T16:24:30.698 INFO:tasks.workunit.client.1.smithi153.stdout:9/82: mknod d1/d5/c1e 0 2024-02-28T16:24:30.703 INFO:tasks.workunit.client.1.smithi153.stdout:4/114: write d4/de/f1f [176051,110735] 0 2024-02-28T16:24:30.705 INFO:tasks.workunit.client.1.smithi153.stdout:7/111: dwrite d1/f1c [0,4194304] 0 2024-02-28T16:24:30.708 INFO:tasks.workunit.client.1.smithi153.stdout:2/118: dread d2/f10 [0,4194304] 0 2024-02-28T16:24:30.713 INFO:tasks.workunit.client.1.smithi153.stdout:2/119: stat l0 0 2024-02-28T16:24:30.717 INFO:tasks.workunit.client.1.smithi153.stdout:8/116: dread d0/d19/d1e/d22/f23 [4194304,4194304] 0 2024-02-28T16:24:30.721 INFO:tasks.workunit.client.1.smithi153.stdout:2/120: creat d2/d23/f24 x:0 0 0 2024-02-28T16:24:30.721 INFO:tasks.workunit.client.1.smithi153.stdout:2/121: readlink l1 0 2024-02-28T16:24:30.722 INFO:tasks.workunit.client.1.smithi153.stdout:4/115: dread d4/f10 [0,4194304] 0 2024-02-28T16:24:30.724 INFO:tasks.workunit.client.1.smithi153.stdout:8/117: unlink d0/ca 0 2024-02-28T16:24:30.726 INFO:tasks.workunit.client.1.smithi153.stdout:2/122: write d2/f21 [145664,75516] 0 2024-02-28T16:24:30.727 INFO:tasks.workunit.client.1.smithi153.stdout:3/143: dwrite d4/f20 [0,4194304] 0 2024-02-28T16:24:30.733 INFO:tasks.workunit.client.1.smithi153.stdout:4/116: unlink d4/de/d13/f26 0 2024-02-28T16:24:30.734 INFO:tasks.workunit.client.1.smithi153.stdout:7/112: dwrite d1/d4/dc/f13 [0,4194304] 0 2024-02-28T16:24:30.740 INFO:tasks.workunit.client.1.smithi153.stdout:2/123: mkdir d2/d25 0 2024-02-28T16:24:30.744 INFO:tasks.workunit.client.1.smithi153.stdout:2/124: chown d2/lb 28341 1 2024-02-28T16:24:30.756 INFO:tasks.workunit.client.1.smithi153.stdout:9/83: dread d1/d5/fb [0,4194304] 0 2024-02-28T16:24:30.765 INFO:tasks.workunit.client.1.smithi153.stdout:3/144: dread d4/d13/f14 [0,4194304] 0 2024-02-28T16:24:30.766 INFO:tasks.workunit.client.1.smithi153.stdout:8/118: dwrite d0/d12/d15/f1b [0,4194304] 0 2024-02-28T16:24:30.770 INFO:tasks.workunit.client.1.smithi153.stdout:7/113: dwrite d1/d4/fe [0,4194304] 0 2024-02-28T16:24:30.771 INFO:tasks.workunit.client.1.smithi153.stdout:8/119: fdatasync d0/d19/d1e/f21 0 2024-02-28T16:24:30.772 INFO:tasks.workunit.client.1.smithi153.stdout:7/114: write d1/d4/f7 [1365342,22622] 0 2024-02-28T16:24:30.773 INFO:tasks.workunit.client.1.smithi153.stdout:7/115: chown d1/d4/df 8 1 2024-02-28T16:24:30.778 INFO:tasks.workunit.client.1.smithi153.stdout:8/120: read d0/f17 [15962,69951] 0 2024-02-28T16:24:30.778 INFO:tasks.workunit.client.1.smithi153.stdout:7/116: fsync d1/d4/f16 0 2024-02-28T16:24:30.785 INFO:tasks.workunit.client.1.smithi153.stdout:7/117: rmdir d1/d4/dc 39 2024-02-28T16:24:30.786 INFO:tasks.workunit.client.1.smithi153.stdout:5/114: sync 2024-02-28T16:24:30.786 INFO:tasks.workunit.client.1.smithi153.stdout:6/133: sync 2024-02-28T16:24:30.786 INFO:tasks.workunit.client.1.smithi153.stdout:1/95: sync 2024-02-28T16:24:30.788 INFO:tasks.workunit.client.1.smithi153.stdout:8/121: rename d0/f16 to d0/d12/d15/f24 0 2024-02-28T16:24:30.791 INFO:tasks.workunit.client.1.smithi153.stdout:1/96: truncate d0/f16 846136 0 2024-02-28T16:24:30.794 INFO:tasks.workunit.client.1.smithi153.stdout:3/145: dwrite d4/d8/d1e/d23/f24 [0,4194304] 0 2024-02-28T16:24:30.795 INFO:tasks.workunit.client.1.smithi153.stdout:5/115: mknod da/c2a 0 2024-02-28T16:24:30.800 INFO:tasks.workunit.client.1.smithi153.stdout:6/134: mkdir d0/d1d/d30 0 2024-02-28T16:24:30.800 INFO:tasks.workunit.client.1.smithi153.stdout:4/117: truncate d4/f7 1657538 0 2024-02-28T16:24:30.803 INFO:tasks.workunit.client.1.smithi153.stdout:3/146: symlink d4/d8/l33 0 2024-02-28T16:24:30.806 INFO:tasks.workunit.client.1.smithi153.stdout:3/147: readlink d4/le 0 2024-02-28T16:24:30.809 INFO:tasks.workunit.client.1.smithi153.stdout:5/116: creat da/d29/f2b x:0 0 0 2024-02-28T16:24:30.809 INFO:tasks.workunit.client.1.smithi153.stdout:4/118: creat d4/de/f27 x:0 0 0 2024-02-28T16:24:30.810 INFO:tasks.workunit.client.1.smithi153.stdout:1/97: link d0/c2 d0/c27 0 2024-02-28T16:24:30.811 INFO:tasks.workunit.client.1.smithi153.stdout:8/122: dread d0/f9 [0,4194304] 0 2024-02-28T16:24:30.812 INFO:tasks.workunit.client.1.smithi153.stdout:3/148: mknod d4/d8/c34 0 2024-02-28T16:24:30.812 INFO:tasks.workunit.client.1.smithi153.stdout:7/118: dwrite d1/f1c [0,4194304] 0 2024-02-28T16:24:30.814 INFO:tasks.workunit.client.1.smithi153.stdout:5/117: creat da/f2c x:0 0 0 2024-02-28T16:24:30.814 INFO:tasks.workunit.client.1.smithi153.stdout:1/98: chown d0/l1e 5 1 2024-02-28T16:24:30.817 INFO:tasks.workunit.client.1.smithi153.stdout:2/125: truncate d2/f18 6237278 0 2024-02-28T16:24:30.819 INFO:tasks.workunit.client.1.smithi153.stdout:3/149: chown d4/cc 1636327 1 2024-02-28T16:24:30.820 INFO:tasks.workunit.client.1.smithi153.stdout:0/152: sync 2024-02-28T16:24:30.822 INFO:tasks.workunit.client.1.smithi153.stdout:5/118: truncate da/f16 1693131 0 2024-02-28T16:24:30.824 INFO:tasks.workunit.client.1.smithi153.stdout:6/135: dread d0/f19 [0,4194304] 0 2024-02-28T16:24:30.831 INFO:tasks.workunit.client.1.smithi153.stdout:4/119: getdents d4 0 2024-02-28T16:24:30.833 INFO:tasks.workunit.client.1.smithi153.stdout:8/123: rename d0/d19/d1e/d22 to d0/d25 0 2024-02-28T16:24:30.836 INFO:tasks.workunit.client.1.smithi153.stdout:5/119: truncate da/dd/f11 3099877 0 2024-02-28T16:24:30.838 INFO:tasks.workunit.client.1.smithi153.stdout:1/99: getdents d0 0 2024-02-28T16:24:30.841 INFO:tasks.workunit.client.1.smithi153.stdout:2/126: creat d2/f26 x:0 0 0 2024-02-28T16:24:30.841 INFO:tasks.workunit.client.1.smithi153.stdout:5/120: dread - da/f1e zero size 2024-02-28T16:24:30.843 INFO:tasks.workunit.client.1.smithi153.stdout:6/136: creat d0/d1d/d30/f31 x:0 0 0 2024-02-28T16:24:30.843 INFO:tasks.workunit.client.1.smithi153.stdout:9/84: dwrite d1/f10 [0,4194304] 0 2024-02-28T16:24:30.845 INFO:tasks.workunit.client.1.smithi153.stdout:4/120: truncate f0 4430666 0 2024-02-28T16:24:30.845 INFO:tasks.workunit.client.1.smithi153.stdout:6/137: fsync d0/d1d/f1e 0 2024-02-28T16:24:30.851 INFO:tasks.workunit.client.1.smithi153.stdout:5/121: truncate da/d29/f2b 89410 0 2024-02-28T16:24:30.851 INFO:tasks.workunit.client.1.smithi153.stdout:4/121: mkdir d4/de/d28 0 2024-02-28T16:24:30.854 INFO:tasks.workunit.client.1.smithi153.stdout:2/127: rename d2/cc to d2/d19/c27 0 2024-02-28T16:24:30.855 INFO:tasks.workunit.client.1.smithi153.stdout:4/122: stat d4/de/d13/d1b 0 2024-02-28T16:24:30.857 INFO:tasks.workunit.client.1.smithi153.stdout:9/85: mkdir d1/d5/d11/d1f 0 2024-02-28T16:24:30.858 INFO:tasks.workunit.client.1.smithi153.stdout:3/150: dread d4/f1b [0,4194304] 0 2024-02-28T16:24:30.861 INFO:tasks.workunit.client.1.smithi153.stdout:4/123: fsync d4/de/f1f 0 2024-02-28T16:24:30.863 INFO:tasks.workunit.client.1.smithi153.stdout:7/119: truncate d1/d4/dc/f13 3661862 0 2024-02-28T16:24:30.864 INFO:tasks.workunit.client.1.smithi153.stdout:3/151: chown d4/d13/f14 769075848 1 2024-02-28T16:24:30.864 INFO:tasks.workunit.client.1.smithi153.stdout:6/138: symlink d0/d15/d2e/l32 0 2024-02-28T16:24:30.867 INFO:tasks.workunit.client.1.smithi153.stdout:9/86: dread - d1/d2/f18 zero size 2024-02-28T16:24:30.868 INFO:tasks.workunit.client.1.smithi153.stdout:8/124: truncate d0/f9 3037774 0 2024-02-28T16:24:30.871 INFO:tasks.workunit.client.1.smithi153.stdout:2/128: mknod d2/d19/c28 0 2024-02-28T16:24:30.872 INFO:tasks.workunit.client.1.smithi153.stdout:4/124: creat d4/f29 x:0 0 0 2024-02-28T16:24:30.874 INFO:tasks.workunit.client.1.smithi153.stdout:0/153: dread d4/f12 [0,4194304] 0 2024-02-28T16:24:30.875 INFO:tasks.workunit.client.1.smithi153.stdout:2/129: fsync d2/ff 0 2024-02-28T16:24:30.883 INFO:tasks.workunit.client.1.smithi153.stdout:1/100: dwrite d0/f23 [0,4194304] 0 2024-02-28T16:24:30.883 INFO:tasks.workunit.client.1.smithi153.stdout:9/87: write d1/f15 [4000779,43608] 0 2024-02-28T16:24:30.885 INFO:tasks.workunit.client.1.smithi153.stdout:9/88: write d1/f4 [681,41985] 0 2024-02-28T16:24:30.885 INFO:tasks.workunit.client.1.smithi153.stdout:6/139: mkdir d0/d1d/d33 0 2024-02-28T16:24:30.887 INFO:tasks.workunit.client.1.smithi153.stdout:9/89: stat d1/d5 0 2024-02-28T16:24:30.888 INFO:tasks.workunit.client.1.smithi153.stdout:1/101: write d0/dd/f1c [311539,75654] 0 2024-02-28T16:24:30.889 INFO:tasks.workunit.client.1.smithi153.stdout:2/130: creat d2/d23/f29 x:0 0 0 2024-02-28T16:24:30.891 INFO:tasks.workunit.client.1.smithi153.stdout:5/122: truncate da/fb 1368750 0 2024-02-28T16:24:30.895 INFO:tasks.workunit.client.1.smithi153.stdout:0/154: rename d4/dc/l2d to d4/d27/l35 0 2024-02-28T16:24:30.896 INFO:tasks.workunit.client.1.smithi153.stdout:3/152: write d4/f17 [3430778,10826] 0 2024-02-28T16:24:30.898 INFO:tasks.workunit.client.1.smithi153.stdout:8/125: write d0/f9 [793981,86184] 0 2024-02-28T16:24:30.903 INFO:tasks.workunit.client.1.smithi153.stdout:9/90: chown d1/l12 14 1 2024-02-28T16:24:30.905 INFO:tasks.workunit.client.1.smithi153.stdout:4/125: fsync d4/de/f11 0 2024-02-28T16:24:30.908 INFO:tasks.workunit.client.1.smithi153.stdout:2/131: mkdir d2/d19/d2a 0 2024-02-28T16:24:30.909 INFO:tasks.workunit.client.1.smithi153.stdout:1/102: mknod d0/c28 0 2024-02-28T16:24:30.917 INFO:tasks.workunit.client.1.smithi153.stdout:7/120: link d1/d4/df/l10 d1/d4/df/l20 0 2024-02-28T16:24:30.918 INFO:tasks.workunit.client.1.smithi153.stdout:3/153: mkdir d4/d8/d1e/d2a/d35 0 2024-02-28T16:24:30.922 INFO:tasks.workunit.client.1.smithi153.stdout:8/126: rmdir d0/d19 39 2024-02-28T16:24:30.923 INFO:tasks.workunit.client.1.smithi153.stdout:6/140: mkdir d0/d1d/d34 0 2024-02-28T16:24:30.925 INFO:tasks.workunit.client.1.smithi153.stdout:1/103: creat d0/dd/f29 x:0 0 0 2024-02-28T16:24:30.931 INFO:tasks.workunit.client.1.smithi153.stdout:0/155: dread d4/d1a/f30 [0,4194304] 0 2024-02-28T16:24:30.932 INFO:tasks.workunit.client.1.smithi153.stdout:9/91: mkdir d1/d5/d11/d1f/d20 0 2024-02-28T16:24:30.933 INFO:tasks.workunit.client.1.smithi153.stdout:4/126: creat d4/de/d13/d1b/f2a x:0 0 0 2024-02-28T16:24:30.935 INFO:tasks.workunit.client.1.smithi153.stdout:1/104: unlink d0/dd/f13 0 2024-02-28T16:24:30.938 INFO:tasks.workunit.client.1.smithi153.stdout:9/92: rmdir d1/d5/d11 39 2024-02-28T16:24:30.938 INFO:tasks.workunit.client.1.smithi153.stdout:3/154: mkdir d4/d13/d28/d36 0 2024-02-28T16:24:30.938 INFO:tasks.workunit.client.1.smithi153.stdout:8/127: mknod d0/c26 0 2024-02-28T16:24:30.940 INFO:tasks.workunit.client.1.smithi153.stdout:7/121: truncate d1/d4/f16 545725 0 2024-02-28T16:24:30.942 INFO:tasks.workunit.client.1.smithi153.stdout:2/132: getdents d2/d23 0 2024-02-28T16:24:30.943 INFO:tasks.workunit.client.1.smithi153.stdout:0/156: creat d4/d32/f36 x:0 0 0 2024-02-28T16:24:30.945 INFO:tasks.workunit.client.1.smithi153.stdout:3/155: symlink d4/d8/l37 0 2024-02-28T16:24:30.949 INFO:tasks.workunit.client.1.smithi153.stdout:6/141: dwrite d0/d15/f2c [0,4194304] 0 2024-02-28T16:24:30.950 INFO:tasks.workunit.client.1.smithi153.stdout:8/128: write d0/d19/d1e/f20 [598727,131015] 0 2024-02-28T16:24:30.953 INFO:tasks.workunit.client.1.smithi153.stdout:8/129: chown d0/lb 415892 1 2024-02-28T16:24:30.956 INFO:tasks.workunit.client.1.smithi153.stdout:4/127: dwrite f1 [0,4194304] 0 2024-02-28T16:24:30.958 INFO:tasks.workunit.client.1.smithi153.stdout:9/93: dread d1/f15 [0,4194304] 0 2024-02-28T16:24:30.959 INFO:tasks.workunit.client.1.smithi153.stdout:2/133: mknod d2/c2b 0 2024-02-28T16:24:30.963 INFO:tasks.workunit.client.1.smithi153.stdout:7/122: dread d1/d4/f7 [0,4194304] 0 2024-02-28T16:24:30.963 INFO:tasks.workunit.client.1.smithi153.stdout:3/156: write d4/d13/f14 [1907974,101091] 0 2024-02-28T16:24:30.971 INFO:tasks.workunit.client.1.smithi153.stdout:8/130: write d0/f11 [950091,84892] 0 2024-02-28T16:24:30.973 INFO:tasks.workunit.client.1.smithi153.stdout:6/142: dwrite d0/fb [0,4194304] 0 2024-02-28T16:24:30.974 INFO:tasks.workunit.client.1.smithi153.stdout:4/128: fdatasync d4/f5 0 2024-02-28T16:24:30.975 INFO:tasks.workunit.client.1.smithi153.stdout:5/123: write da/fb [480450,30168] 0 2024-02-28T16:24:30.976 INFO:tasks.workunit.client.1.smithi153.stdout:1/105: getdents d0/dd 0 2024-02-28T16:24:30.979 INFO:tasks.workunit.client.1.smithi153.stdout:2/134: creat d2/d19/f2c x:0 0 0 2024-02-28T16:24:30.979 INFO:tasks.workunit.client.1.smithi153.stdout:1/106: fdatasync d0/dd/f29 0 2024-02-28T16:24:30.986 INFO:tasks.workunit.client.1.smithi153.stdout:9/94: mknod d1/d2/c21 0 2024-02-28T16:24:30.986 INFO:tasks.workunit.client.1.smithi153.stdout:3/157: readlink d4/d8/d1e/d23/l25 0 2024-02-28T16:24:30.986 INFO:tasks.workunit.client.1.smithi153.stdout:5/124: mknod da/c2d 0 2024-02-28T16:24:30.988 INFO:tasks.workunit.client.1.smithi153.stdout:6/143: rename d0/d15/c21 to d0/d17/c35 0 2024-02-28T16:24:30.989 INFO:tasks.workunit.client.1.smithi153.stdout:3/158: stat d4/d13/d28/f2f 0 2024-02-28T16:24:30.991 INFO:tasks.workunit.client.1.smithi153.stdout:3/159: chown d4/d8/d1e/d23 322057886 1 2024-02-28T16:24:30.992 INFO:tasks.workunit.client.1.smithi153.stdout:1/107: mknod d0/dd/c2a 0 2024-02-28T16:24:30.992 INFO:tasks.workunit.client.1.smithi153.stdout:5/125: dread da/dd/f17 [0,4194304] 0 2024-02-28T16:24:30.995 INFO:tasks.workunit.client.1.smithi153.stdout:8/131: dread d0/d25/f23 [0,4194304] 0 2024-02-28T16:24:30.996 INFO:tasks.workunit.client.1.smithi153.stdout:5/126: write da/dd/f15 [1367473,31766] 0 2024-02-28T16:24:30.996 INFO:tasks.workunit.client.1.smithi153.stdout:0/157: getdents d4/d1a 0 2024-02-28T16:24:30.996 INFO:tasks.workunit.client.1.smithi153.stdout:1/108: chown d0/dd/c26 877 1 2024-02-28T16:24:30.999 INFO:tasks.workunit.client.1.smithi153.stdout:8/132: chown d0/ff 17696 1 2024-02-28T16:24:31.002 INFO:tasks.workunit.client.1.smithi153.stdout:4/129: mkdir d4/de/d23/d2b 0 2024-02-28T16:24:31.003 INFO:tasks.workunit.client.1.smithi153.stdout:6/144: unlink d0/ce 0 2024-02-28T16:24:31.004 INFO:tasks.workunit.client.1.smithi153.stdout:2/135: rename d2/fd to d2/d25/f2d 0 2024-02-28T16:24:31.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/109: creat d0/dd/f2b x:0 0 0 2024-02-28T16:24:31.006 INFO:tasks.workunit.client.1.smithi153.stdout:7/123: link d1/d4/df/l10 d1/d4/dc/l21 0 2024-02-28T16:24:31.009 INFO:tasks.workunit.client.1.smithi153.stdout:4/130: creat d4/de/d13/f2c x:0 0 0 2024-02-28T16:24:31.013 INFO:tasks.workunit.client.1.smithi153.stdout:0/158: rename d4/f23 to d4/d1a/f37 0 2024-02-28T16:24:31.015 INFO:tasks.workunit.client.1.smithi153.stdout:6/145: creat d0/d1d/d30/f36 x:0 0 0 2024-02-28T16:24:31.017 INFO:tasks.workunit.client.1.smithi153.stdout:2/136: mknod d2/d23/c2e 0 2024-02-28T16:24:31.018 INFO:tasks.workunit.client.1.smithi153.stdout:6/146: stat d0/lf 0 2024-02-28T16:24:31.021 INFO:tasks.workunit.client.1.smithi153.stdout:9/95: dwrite d1/f10 [0,4194304] 0 2024-02-28T16:24:31.023 INFO:tasks.workunit.client.1.smithi153.stdout:3/160: getdents d4/d13/d28 0 2024-02-28T16:24:31.027 INFO:tasks.workunit.client.1.smithi153.stdout:7/124: truncate d1/d4/dc/f15 658502 0 2024-02-28T16:24:31.027 INFO:tasks.workunit.client.1.smithi153.stdout:4/131: creat d4/f2d x:0 0 0 2024-02-28T16:24:31.027 INFO:tasks.workunit.client.1.smithi153.stdout:2/137: chown d2/d19/l1d 1582 1 2024-02-28T16:24:31.031 INFO:tasks.workunit.client.1.smithi153.stdout:5/127: dwrite da/f2c [0,4194304] 0 2024-02-28T16:24:31.032 INFO:tasks.workunit.client.1.smithi153.stdout:8/133: dwrite d0/d19/d1e/f20 [0,4194304] 0 2024-02-28T16:24:31.040 INFO:tasks.workunit.client.1.smithi153.stdout:3/161: mkdir d4/d8/d1e/d23/d38 0 2024-02-28T16:24:31.040 INFO:tasks.workunit.client.1.smithi153.stdout:7/125: chown d1/d4/l6 821784 1 2024-02-28T16:24:31.040 INFO:tasks.workunit.client.1.smithi153.stdout:0/159: write d4/f12 [152446,127700] 0 2024-02-28T16:24:31.044 INFO:tasks.workunit.client.1.smithi153.stdout:5/128: creat da/dd/d25/f2e x:0 0 0 2024-02-28T16:24:31.047 INFO:tasks.workunit.client.1.smithi153.stdout:8/134: fsync d0/d19/d1e/f21 0 2024-02-28T16:24:31.049 INFO:tasks.workunit.client.1.smithi153.stdout:6/147: link d0/f18 d0/d15/d2e/f37 0 2024-02-28T16:24:31.050 INFO:tasks.workunit.client.1.smithi153.stdout:7/126: chown d1/d4/dc/l1a 1705192 1 2024-02-28T16:24:31.050 INFO:tasks.workunit.client.1.smithi153.stdout:9/96: symlink d1/d2/l22 0 2024-02-28T16:24:31.053 INFO:tasks.workunit.client.1.smithi153.stdout:1/110: dwrite d0/dd/f29 [0,4194304] 0 2024-02-28T16:24:31.061 INFO:tasks.workunit.client.1.smithi153.stdout:6/148: readlink d0/d17/l1b 0 2024-02-28T16:24:31.064 INFO:tasks.workunit.client.1.smithi153.stdout:3/162: creat d4/d8/d1e/d2a/d35/f39 x:0 0 0 2024-02-28T16:24:31.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/135: chown d0/c26 10 1 2024-02-28T16:24:31.068 INFO:tasks.workunit.client.1.smithi153.stdout:5/129: link f7 da/f2f 0 2024-02-28T16:24:31.073 INFO:tasks.workunit.client.1.smithi153.stdout:1/111: mknod d0/dd/c2c 0 2024-02-28T16:24:31.075 INFO:tasks.workunit.client.1.smithi153.stdout:9/97: mknod d1/d5/d11/d1f/c23 0 2024-02-28T16:24:31.081 INFO:tasks.workunit.client.1.smithi153.stdout:7/127: rmdir d1/d4/dc 39 2024-02-28T16:24:31.081 INFO:tasks.workunit.client.1.smithi153.stdout:3/163: read d4/d8/d26/f29 [323458,20415] 0 2024-02-28T16:24:31.083 INFO:tasks.workunit.client.1.smithi153.stdout:4/132: dwrite d4/de/f19 [0,4194304] 0 2024-02-28T16:24:31.083 INFO:tasks.workunit.client.1.smithi153.stdout:6/149: mkdir d0/d1d/d34/d38 0 2024-02-28T16:24:31.086 INFO:tasks.workunit.client.1.smithi153.stdout:1/112: creat d0/dd/f2d x:0 0 0 2024-02-28T16:24:31.087 INFO:tasks.workunit.client.1.smithi153.stdout:0/160: write d4/dc/f18 [735523,16923] 0 2024-02-28T16:24:31.088 INFO:tasks.workunit.client.1.smithi153.stdout:2/138: dwrite d2/f26 [0,4194304] 0 2024-02-28T16:24:31.095 INFO:tasks.workunit.client.1.smithi153.stdout:8/136: write d0/d25/f23 [2555989,94549] 0 2024-02-28T16:24:31.101 INFO:tasks.workunit.client.1.smithi153.stdout:4/133: dread d4/f10 [0,4194304] 0 2024-02-28T16:24:31.101 INFO:tasks.workunit.client.1.smithi153.stdout:0/161: write d4/d32/f36 [751198,724] 0 2024-02-28T16:24:31.101 INFO:tasks.workunit.client.1.smithi153.stdout:3/164: symlink d4/d8/l3a 0 2024-02-28T16:24:31.102 INFO:tasks.workunit.client.1.smithi153.stdout:1/113: symlink d0/dd/l2e 0 2024-02-28T16:24:31.104 INFO:tasks.workunit.client.1.smithi153.stdout:7/128: mknod d1/d4/dc/c22 0 2024-02-28T16:24:31.126 INFO:tasks.workunit.client.1.smithi153.stdout:4/134: mknod d4/de/d23/c2e 0 2024-02-28T16:24:31.127 INFO:tasks.workunit.client.1.smithi153.stdout:8/137: unlink d0/d19/d1e/f21 0 2024-02-28T16:24:31.127 INFO:tasks.workunit.client.1.smithi153.stdout:1/114: write d0/dd/f2d [498332,48515] 0 2024-02-28T16:24:31.128 INFO:tasks.workunit.client.1.smithi153.stdout:9/98: dread d1/f10 [0,4194304] 0 2024-02-28T16:24:31.129 INFO:tasks.workunit.client.1.smithi153.stdout:2/139: rename d2/f18 to d2/d19/d2a/f2f 0 2024-02-28T16:24:31.131 INFO:tasks.workunit.client.1.smithi153.stdout:1/115: dread - d0/dd/f21 zero size 2024-02-28T16:24:31.134 INFO:tasks.workunit.client.1.smithi153.stdout:6/150: dread d0/d1d/f1e [0,4194304] 0 2024-02-28T16:24:31.137 INFO:tasks.workunit.client.1.smithi153.stdout:6/151: read d0/f8 [769658,100068] 0 2024-02-28T16:24:31.137 INFO:tasks.workunit.client.1.smithi153.stdout:5/130: dwrite da/f16 [0,4194304] 0 2024-02-28T16:24:31.148 INFO:tasks.workunit.client.1.smithi153.stdout:2/140: dread d2/f20 [0,4194304] 0 2024-02-28T16:24:31.149 INFO:tasks.workunit.client.1.smithi153.stdout:2/141: stat d2/f11 0 2024-02-28T16:24:31.200 INFO:tasks.workunit.client.1.smithi153.stdout:0/162: mknod d4/c38 0 2024-02-28T16:24:31.203 INFO:tasks.workunit.client.1.smithi153.stdout:3/165: mknod d4/d13/d28/d36/c3b 0 2024-02-28T16:24:31.209 INFO:tasks.workunit.client.1.smithi153.stdout:5/131: rmdir da/dd/d25 39 2024-02-28T16:24:31.210 INFO:tasks.workunit.client.1.smithi153.stdout:5/132: write da/f19 [4580644,113803] 0 2024-02-28T16:24:31.210 INFO:tasks.workunit.client.1.smithi153.stdout:2/142: creat d2/d19/d2a/f30 x:0 0 0 2024-02-28T16:24:31.211 INFO:tasks.workunit.client.1.smithi153.stdout:5/133: stat da/f1b 0 2024-02-28T16:24:31.212 INFO:tasks.workunit.client.1.smithi153.stdout:2/143: chown d2/c2b 11 1 2024-02-28T16:24:31.212 INFO:tasks.workunit.client.1.smithi153.stdout:0/163: creat d4/d1a/f39 x:0 0 0 2024-02-28T16:24:31.213 INFO:tasks.workunit.client.1.smithi153.stdout:8/138: mkdir d0/d12/d27 0 2024-02-28T16:24:31.215 INFO:tasks.workunit.client.1.smithi153.stdout:3/166: creat d4/d8/d1e/f3c x:0 0 0 2024-02-28T16:24:31.216 INFO:tasks.workunit.client.1.smithi153.stdout:8/139: write d0/f9 [1676966,68502] 0 2024-02-28T16:24:31.217 INFO:tasks.workunit.client.1.smithi153.stdout:4/135: getdents d4/de/d28 0 2024-02-28T16:24:31.224 INFO:tasks.workunit.client.1.smithi153.stdout:2/144: mkdir d2/d19/d31 0 2024-02-28T16:24:31.227 INFO:tasks.workunit.client.1.smithi153.stdout:5/134: rename da/dd/f18 to da/d29/f30 0 2024-02-28T16:24:31.228 INFO:tasks.workunit.client.1.smithi153.stdout:9/99: symlink d1/d2/l24 0 2024-02-28T16:24:31.230 INFO:tasks.workunit.client.1.smithi153.stdout:3/167: unlink d4/d8/d26/f29 0 2024-02-28T16:24:31.231 INFO:tasks.workunit.client.1.smithi153.stdout:1/116: link d0/l1e d0/l2f 0 2024-02-28T16:24:31.233 INFO:tasks.workunit.client.1.smithi153.stdout:4/136: symlink d4/de/l2f 0 2024-02-28T16:24:31.234 INFO:tasks.workunit.client.1.smithi153.stdout:4/137: fdatasync d4/de/f27 0 2024-02-28T16:24:31.235 INFO:tasks.workunit.client.1.smithi153.stdout:2/145: symlink d2/d19/l32 0 2024-02-28T16:24:31.241 INFO:tasks.workunit.client.1.smithi153.stdout:0/164: link d4/dc/f20 d4/d27/f3a 0 2024-02-28T16:24:31.244 INFO:tasks.workunit.client.1.smithi153.stdout:6/152: getdents d0/d15/d2e 0 2024-02-28T16:24:31.244 INFO:tasks.workunit.client.1.smithi153.stdout:1/117: chown d0/dd/c17 384005783 1 2024-02-28T16:24:31.248 INFO:tasks.workunit.client.1.smithi153.stdout:3/168: dwrite d4/d13/d28/f2f [0,4194304] 0 2024-02-28T16:24:31.254 INFO:tasks.workunit.client.1.smithi153.stdout:9/100: dwrite d1/f10 [0,4194304] 0 2024-02-28T16:24:31.255 INFO:tasks.workunit.client.1.smithi153.stdout:4/138: link d4/f2d d4/de/d23/f30 0 2024-02-28T16:24:31.255 INFO:tasks.workunit.client.1.smithi153.stdout:2/146: symlink d2/d19/d31/l33 0 2024-02-28T16:24:31.256 INFO:tasks.workunit.client.1.smithi153.stdout:4/139: fsync d4/de/d13/f2c 0 2024-02-28T16:24:31.256 INFO:tasks.workunit.client.1.smithi153.stdout:2/147: chown d2/d25 221606 1 2024-02-28T16:24:31.260 INFO:tasks.workunit.client.1.smithi153.stdout:1/118: creat d0/dd/f30 x:0 0 0 2024-02-28T16:24:31.260 INFO:tasks.workunit.client.1.smithi153.stdout:6/153: symlink d0/d17/l39 0 2024-02-28T16:24:31.263 INFO:tasks.workunit.client.1.smithi153.stdout:5/135: rename da/dd/f17 to da/dd/f31 0 2024-02-28T16:24:31.264 INFO:tasks.workunit.client.1.smithi153.stdout:3/169: creat d4/d8/d26/f3d x:0 0 0 2024-02-28T16:24:31.267 INFO:tasks.workunit.client.1.smithi153.stdout:3/170: write d4/f17 [2890002,68766] 0 2024-02-28T16:24:31.269 INFO:tasks.workunit.client.1.smithi153.stdout:2/148: creat d2/d25/f34 x:0 0 0 2024-02-28T16:24:31.271 INFO:tasks.workunit.client.1.smithi153.stdout:1/119: symlink d0/l31 0 2024-02-28T16:24:31.273 INFO:tasks.workunit.client.1.smithi153.stdout:6/154: creat d0/d15/f3a x:0 0 0 2024-02-28T16:24:31.273 INFO:tasks.workunit.client.1.smithi153.stdout:3/171: write d4/f18 [342952,68687] 0 2024-02-28T16:24:31.276 INFO:tasks.workunit.client.1.smithi153.stdout:0/165: link d4/dc/f20 d4/f3b 0 2024-02-28T16:24:31.279 INFO:tasks.workunit.client.1.smithi153.stdout:7/129: dwrite d1/d4/f16 [0,4194304] 0 2024-02-28T16:24:31.279 INFO:tasks.workunit.client.1.smithi153.stdout:3/172: write d4/d8/d1e/f3c [729544,110813] 0 2024-02-28T16:24:31.281 INFO:tasks.workunit.client.1.smithi153.stdout:4/140: mkdir d4/de/d23/d2b/d31 0 2024-02-28T16:24:31.284 INFO:tasks.workunit.client.1.smithi153.stdout:7/130: write d1/d4/fe [4440118,130193] 0 2024-02-28T16:24:31.285 INFO:tasks.workunit.client.1.smithi153.stdout:3/173: write d4/d8/d26/f3d [411122,21288] 0 2024-02-28T16:24:31.288 INFO:tasks.workunit.client.1.smithi153.stdout:2/149: write d2/f6 [925287,15206] 0 2024-02-28T16:24:31.289 INFO:tasks.workunit.client.1.smithi153.stdout:3/174: fsync d4/f1f 0 2024-02-28T16:24:31.291 INFO:tasks.workunit.client.1.smithi153.stdout:9/101: truncate d1/d2/f18 597110 0 2024-02-28T16:24:31.291 INFO:tasks.workunit.client.1.smithi153.stdout:1/120: creat d0/dd/f32 x:0 0 0 2024-02-28T16:24:31.301 INFO:tasks.workunit.client.1.smithi153.stdout:7/131: creat d1/f23 x:0 0 0 2024-02-28T16:24:31.305 INFO:tasks.workunit.client.1.smithi153.stdout:6/155: creat d0/d1d/d33/f3b x:0 0 0 2024-02-28T16:24:31.306 INFO:tasks.workunit.client.1.smithi153.stdout:6/156: dread - d0/d1d/d33/f3b zero size 2024-02-28T16:24:31.314 INFO:tasks.workunit.client.1.smithi153.stdout:5/136: rename da/dd/f11 to da/dd/d25/f32 0 2024-02-28T16:24:31.315 INFO:tasks.workunit.client.1.smithi153.stdout:6/157: rename d0/d1d/d23 to d0/d1d/d23/d3c 22 2024-02-28T16:24:31.318 INFO:tasks.workunit.client.1.smithi153.stdout:2/150: dwrite d2/d25/f2d [0,4194304] 0 2024-02-28T16:24:31.324 INFO:tasks.workunit.client.1.smithi153.stdout:7/132: chown d1/d4/dc/l1f 259259 1 2024-02-28T16:24:31.325 INFO:tasks.workunit.client.1.smithi153.stdout:5/137: mknod da/c33 0 2024-02-28T16:24:31.332 INFO:tasks.workunit.client.1.smithi153.stdout:9/102: creat d1/d2/f25 x:0 0 0 2024-02-28T16:24:31.332 INFO:tasks.workunit.client.1.smithi153.stdout:9/103: readlink d1/le 0 2024-02-28T16:24:31.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/121: link d0/dd/c2c d0/dd/c33 0 2024-02-28T16:24:31.333 INFO:tasks.workunit.client.1.smithi153.stdout:0/166: getdents d4/dc 0 2024-02-28T16:24:31.334 INFO:tasks.workunit.client.1.smithi153.stdout:6/158: unlink d0/d1d/l25 0 2024-02-28T16:24:31.334 INFO:tasks.workunit.client.1.smithi153.stdout:9/104: write d1/f4 [2724191,19953] 0 2024-02-28T16:24:31.334 INFO:tasks.workunit.client.1.smithi153.stdout:1/122: stat d0/c22 0 2024-02-28T16:24:31.335 INFO:tasks.workunit.client.1.smithi153.stdout:6/159: fsync d0/d15/f2c 0 2024-02-28T16:24:31.335 INFO:tasks.workunit.client.1.smithi153.stdout:9/105: stat d1/d2/f25 0 2024-02-28T16:24:31.336 INFO:tasks.workunit.client.1.smithi153.stdout:6/160: write d0/d1d/f1e [3904484,10658] 0 2024-02-28T16:24:31.343 INFO:tasks.workunit.client.1.smithi153.stdout:1/123: fdatasync d0/f25 0 2024-02-28T16:24:31.347 INFO:tasks.workunit.client.1.smithi153.stdout:9/106: dread d1/d5/fb [0,4194304] 0 2024-02-28T16:24:31.349 INFO:tasks.workunit.client.1.smithi153.stdout:2/151: rename d2/l12 to d2/l35 0 2024-02-28T16:24:31.349 INFO:tasks.workunit.client.1.smithi153.stdout:3/175: truncate d4/d13/d28/f2f 3405307 0 2024-02-28T16:24:31.350 INFO:tasks.workunit.client.1.smithi153.stdout:4/141: dwrite f0 [0,4194304] 0 2024-02-28T16:24:31.352 INFO:tasks.workunit.client.1.smithi153.stdout:3/176: fdatasync d4/d8/d1e/d2a/d35/f39 0 2024-02-28T16:24:31.354 INFO:tasks.workunit.client.1.smithi153.stdout:7/133: link d1/l5 d1/l24 0 2024-02-28T16:24:31.355 INFO:tasks.workunit.client.1.smithi153.stdout:5/138: creat da/dd/f34 x:0 0 0 2024-02-28T16:24:31.355 INFO:tasks.workunit.client.1.smithi153.stdout:2/152: fdatasync d2/f20 0 2024-02-28T16:24:31.355 INFO:tasks.workunit.client.1.smithi153.stdout:4/142: creat d4/f32 x:0 0 0 2024-02-28T16:24:31.358 INFO:tasks.workunit.client.1.smithi153.stdout:9/107: mknod d1/d2/c26 0 2024-02-28T16:24:31.359 INFO:tasks.workunit.client.1.smithi153.stdout:0/167: creat d4/f3c x:0 0 0 2024-02-28T16:24:31.362 INFO:tasks.workunit.client.1.smithi153.stdout:4/143: write d4/de/f19 [3573116,47248] 0 2024-02-28T16:24:31.363 INFO:tasks.workunit.client.1.smithi153.stdout:0/168: fsync d4/d1a/f39 0 2024-02-28T16:24:31.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/139: creat da/f35 x:0 0 0 2024-02-28T16:24:31.367 INFO:tasks.workunit.client.1.smithi153.stdout:3/177: chown d4/d13/d28/f2f 20 1 2024-02-28T16:24:31.368 INFO:tasks.workunit.client.1.smithi153.stdout:8/140: sync 2024-02-28T16:24:31.368 INFO:tasks.workunit.client.1.smithi153.stdout:4/144: rmdir d4/de 39 2024-02-28T16:24:31.375 INFO:tasks.workunit.client.1.smithi153.stdout:0/169: truncate d4/f2f 538106 0 2024-02-28T16:24:31.375 INFO:tasks.workunit.client.1.smithi153.stdout:8/141: write d0/f6 [2498791,107274] 0 2024-02-28T16:24:31.380 INFO:tasks.workunit.client.1.smithi153.stdout:1/124: dwrite d0/dd/f21 [0,4194304] 0 2024-02-28T16:24:31.380 INFO:tasks.workunit.client.1.smithi153.stdout:5/140: creat da/dd/d25/f36 x:0 0 0 2024-02-28T16:24:31.393 INFO:tasks.workunit.client.1.smithi153.stdout:5/141: write da/f35 [620308,106524] 0 2024-02-28T16:24:31.397 INFO:tasks.workunit.client.1.smithi153.stdout:3/178: creat d4/d8/d1e/d23/d38/f3e x:0 0 0 2024-02-28T16:24:31.400 INFO:tasks.workunit.client.1.smithi153.stdout:5/142: stat da/c2d 0 2024-02-28T16:24:31.406 INFO:tasks.workunit.client.1.smithi153.stdout:3/179: chown d4/f20 20474921 1 2024-02-28T16:24:31.409 INFO:tasks.workunit.client.1.smithi153.stdout:2/153: dwrite d2/f11 [0,4194304] 0 2024-02-28T16:24:31.411 INFO:tasks.workunit.client.1.smithi153.stdout:8/142: creat d0/d12/f28 x:0 0 0 2024-02-28T16:24:31.413 INFO:tasks.workunit.client.1.smithi153.stdout:6/161: dwrite d0/d15/d2e/f37 [0,4194304] 0 2024-02-28T16:24:31.414 INFO:tasks.workunit.client.1.smithi153.stdout:4/145: creat d4/de/d23/d2b/d31/f33 x:0 0 0 2024-02-28T16:24:31.420 INFO:tasks.workunit.client.1.smithi153.stdout:5/143: write da/f1b [167295,53722] 0 2024-02-28T16:24:31.421 INFO:tasks.workunit.client.1.smithi153.stdout:4/146: readlink d4/de/l1e 0 2024-02-28T16:24:31.423 INFO:tasks.workunit.client.1.smithi153.stdout:9/108: dwrite d1/d5/fb [0,4194304] 0 2024-02-28T16:24:31.426 INFO:tasks.workunit.client.1.smithi153.stdout:2/154: truncate d2/f6 4474173 0 2024-02-28T16:24:31.426 INFO:tasks.workunit.client.1.smithi153.stdout:3/180: creat d4/d13/f3f x:0 0 0 2024-02-28T16:24:31.428 INFO:tasks.workunit.client.1.smithi153.stdout:6/162: rmdir d0/d1d/d33 39 2024-02-28T16:24:31.429 INFO:tasks.workunit.client.1.smithi153.stdout:9/109: fsync d1/f10 0 2024-02-28T16:24:31.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/155: write d2/f11 [4437165,58505] 0 2024-02-28T16:24:31.439 INFO:tasks.workunit.client.1.smithi153.stdout:7/134: dread d1/d4/f9 [0,4194304] 0 2024-02-28T16:24:31.440 INFO:tasks.workunit.client.1.smithi153.stdout:2/156: fsync d2/f10 0 2024-02-28T16:24:31.440 INFO:tasks.workunit.client.1.smithi153.stdout:1/125: dread d0/dd/f29 [0,4194304] 0 2024-02-28T16:24:31.446 INFO:tasks.workunit.client.1.smithi153.stdout:1/126: write d0/dd/f21 [3879430,88414] 0 2024-02-28T16:24:31.450 INFO:tasks.workunit.client.1.smithi153.stdout:2/157: rmdir d2/d23 39 2024-02-28T16:24:31.456 INFO:tasks.workunit.client.1.smithi153.stdout:1/127: rename d0/fa to d0/dd/f34 0 2024-02-28T16:24:31.457 INFO:tasks.workunit.client.1.smithi153.stdout:2/158: rmdir d2 39 2024-02-28T16:24:31.462 INFO:tasks.workunit.client.1.smithi153.stdout:8/143: getdents d0/d19 0 2024-02-28T16:24:31.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/128: chown d0/dd/f2d 1284677 1 2024-02-28T16:24:31.465 INFO:tasks.workunit.client.1.smithi153.stdout:8/144: dread - d0/ff zero size 2024-02-28T16:24:31.470 INFO:tasks.workunit.client.1.smithi153.stdout:4/147: dwrite d4/de/d13/d1b/f2a [0,4194304] 0 2024-02-28T16:24:31.470 INFO:tasks.workunit.client.1.smithi153.stdout:3/181: getdents d4/d8/d1e/d23/d38 0 2024-02-28T16:24:31.470 INFO:tasks.workunit.client.1.smithi153.stdout:0/170: dread d4/dc/f19 [4194304,4194304] 0 2024-02-28T16:24:31.474 INFO:tasks.workunit.client.1.smithi153.stdout:6/163: truncate d0/f18 1551470 0 2024-02-28T16:24:31.476 INFO:tasks.workunit.client.1.smithi153.stdout:9/110: getdents d1/d5 0 2024-02-28T16:24:31.477 INFO:tasks.workunit.client.1.smithi153.stdout:3/182: chown d4/d8/d1e/d23/l25 3667 1 2024-02-28T16:24:31.483 INFO:tasks.workunit.client.1.smithi153.stdout:8/145: creat d0/d12/d15/f29 x:0 0 0 2024-02-28T16:24:31.483 INFO:tasks.workunit.client.1.smithi153.stdout:7/135: write d1/d4/dc/f13 [443421,111087] 0 2024-02-28T16:24:31.483 INFO:tasks.workunit.client.1.smithi153.stdout:5/144: dwrite da/d29/f30 [0,4194304] 0 2024-02-28T16:24:31.490 INFO:tasks.workunit.client.1.smithi153.stdout:6/164: creat d0/d1d/d23/f3d x:0 0 0 2024-02-28T16:24:31.490 INFO:tasks.workunit.client.1.smithi153.stdout:9/111: mkdir d1/d5/d27 0 2024-02-28T16:24:31.491 INFO:tasks.workunit.client.1.smithi153.stdout:0/171: symlink d4/l3d 0 2024-02-28T16:24:31.495 INFO:tasks.workunit.client.1.smithi153.stdout:9/112: dread - d1/ff zero size 2024-02-28T16:24:31.500 INFO:tasks.workunit.client.1.smithi153.stdout:1/129: dread d0/dd/f29 [0,4194304] 0 2024-02-28T16:24:31.500 INFO:tasks.workunit.client.1.smithi153.stdout:7/136: rename d1/d4 to d1/d25 0 2024-02-28T16:24:31.503 INFO:tasks.workunit.client.1.smithi153.stdout:7/137: chown d1/d25/fe 191536305 1 2024-02-28T16:24:31.504 INFO:tasks.workunit.client.1.smithi153.stdout:2/159: dwrite d2/d25/f2d [0,4194304] 0 2024-02-28T16:24:31.506 INFO:tasks.workunit.client.1.smithi153.stdout:3/183: dread f0 [0,4194304] 0 2024-02-28T16:24:31.507 INFO:tasks.workunit.client.1.smithi153.stdout:6/165: link d0/fb d0/d15/f3e 0 2024-02-28T16:24:31.516 INFO:tasks.workunit.client.1.smithi153.stdout:8/146: getdents d0/d12 0 2024-02-28T16:24:31.516 INFO:tasks.workunit.client.1.smithi153.stdout:1/130: chown d0/c2 778555 1 2024-02-28T16:24:31.520 INFO:tasks.workunit.client.1.smithi153.stdout:2/160: truncate d2/f20 4395443 0 2024-02-28T16:24:31.521 INFO:tasks.workunit.client.1.smithi153.stdout:1/131: dread - d0/f14 zero size 2024-02-28T16:24:31.525 INFO:tasks.workunit.client.1.smithi153.stdout:3/184: chown d4/d8/d1e/d23/f24 69 1 2024-02-28T16:24:31.525 INFO:tasks.workunit.client.1.smithi153.stdout:6/166: dread - d0/d1d/d30/f31 zero size 2024-02-28T16:24:31.529 INFO:tasks.workunit.client.1.smithi153.stdout:5/145: truncate f9 2812574 0 2024-02-28T16:24:31.536 INFO:tasks.workunit.client.1.smithi153.stdout:4/148: dwrite d4/de/d23/f30 [0,4194304] 0 2024-02-28T16:24:31.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/161: dread - d2/d23/f29 zero size 2024-02-28T16:24:31.543 INFO:tasks.workunit.client.1.smithi153.stdout:8/147: write d0/d12/d15/f1b [4721760,115668] 0 2024-02-28T16:24:31.544 INFO:tasks.workunit.client.1.smithi153.stdout:5/146: chown da/c2a 38769 1 2024-02-28T16:24:31.545 INFO:tasks.workunit.client.1.smithi153.stdout:0/172: dwrite d4/d32/f36 [0,4194304] 0 2024-02-28T16:24:31.550 INFO:tasks.workunit.client.1.smithi153.stdout:7/138: dwrite d1/f23 [0,4194304] 0 2024-02-28T16:24:31.550 INFO:tasks.workunit.client.1.smithi153.stdout:0/173: stat d4/d1a 0 2024-02-28T16:24:31.555 INFO:tasks.workunit.client.1.smithi153.stdout:8/148: chown d0/d12/d15/f29 215748483 1 2024-02-28T16:24:31.557 INFO:tasks.workunit.client.1.smithi153.stdout:9/113: dwrite d1/f15 [0,4194304] 0 2024-02-28T16:24:31.561 INFO:tasks.workunit.client.1.smithi153.stdout:5/147: write da/fc [2813053,34744] 0 2024-02-28T16:24:31.561 INFO:tasks.workunit.client.1.smithi153.stdout:4/149: creat d4/de/d23/d2b/d31/f34 x:0 0 0 2024-02-28T16:24:31.562 INFO:tasks.workunit.client.1.smithi153.stdout:8/149: write d0/d19/d1e/f20 [1360251,45669] 0 2024-02-28T16:24:31.567 INFO:tasks.workunit.client.1.smithi153.stdout:5/148: read - da/f27 zero size 2024-02-28T16:24:31.568 INFO:tasks.workunit.client.1.smithi153.stdout:8/150: readlink d0/l5 0 2024-02-28T16:24:31.569 INFO:tasks.workunit.client.1.smithi153.stdout:9/114: chown d1/ff 155389 1 2024-02-28T16:24:31.570 INFO:tasks.workunit.client.1.smithi153.stdout:4/150: creat d4/de/d13/f35 x:0 0 0 2024-02-28T16:24:31.574 INFO:tasks.workunit.client.1.smithi153.stdout:8/151: creat d0/d19/f2a x:0 0 0 2024-02-28T16:24:31.576 INFO:tasks.workunit.client.1.smithi153.stdout:4/151: chown d4/de/d13/f35 14538885 1 2024-02-28T16:24:31.579 INFO:tasks.workunit.client.1.smithi153.stdout:9/115: symlink d1/d5/d11/l28 0 2024-02-28T16:24:31.580 INFO:tasks.workunit.client.1.smithi153.stdout:8/152: mkdir d0/d19/d2b 0 2024-02-28T16:24:31.583 INFO:tasks.workunit.client.1.smithi153.stdout:1/132: truncate d0/f16 829978 0 2024-02-28T16:24:31.587 INFO:tasks.workunit.client.1.smithi153.stdout:7/139: truncate d1/d25/f7 356449 0 2024-02-28T16:24:31.589 INFO:tasks.workunit.client.1.smithi153.stdout:8/153: fdatasync d0/d19/d1e/f20 0 2024-02-28T16:24:31.589 INFO:tasks.workunit.client.1.smithi153.stdout:2/162: dread d2/f26 [0,4194304] 0 2024-02-28T16:24:31.589 INFO:tasks.workunit.client.1.smithi153.stdout:9/116: mkdir d1/d5/d11/d29 0 2024-02-28T16:24:31.591 INFO:tasks.workunit.client.1.smithi153.stdout:4/152: rmdir d4/de/d28 0 2024-02-28T16:24:31.592 INFO:tasks.workunit.client.1.smithi153.stdout:6/167: dwrite d0/d1d/d33/f3b [0,4194304] 0 2024-02-28T16:24:31.594 INFO:tasks.workunit.client.1.smithi153.stdout:2/163: chown d2/d23/f29 327407815 1 2024-02-28T16:24:31.594 INFO:tasks.workunit.client.1.smithi153.stdout:0/174: dwrite d4/d32/f36 [4194304,4194304] 0 2024-02-28T16:24:31.596 INFO:tasks.workunit.client.1.smithi153.stdout:1/133: rename d0/c28 to d0/c35 0 2024-02-28T16:24:31.600 INFO:tasks.workunit.client.1.smithi153.stdout:7/140: mkdir d1/d25/df/d26 0 2024-02-28T16:24:31.607 INFO:tasks.workunit.client.1.smithi153.stdout:4/153: rmdir d4/de/d23 39 2024-02-28T16:24:31.607 INFO:tasks.workunit.client.1.smithi153.stdout:8/154: write d0/d12/d15/f24 [780248,11683] 0 2024-02-28T16:24:31.616 INFO:tasks.workunit.client.1.smithi153.stdout:5/149: truncate da/f16 221525 0 2024-02-28T16:24:31.620 INFO:tasks.workunit.client.1.smithi153.stdout:9/117: mkdir d1/d2a 0 2024-02-28T16:24:31.621 INFO:tasks.workunit.client.1.smithi153.stdout:2/164: dwrite d2/d23/f29 [0,4194304] 0 2024-02-28T16:24:31.624 INFO:tasks.workunit.client.1.smithi153.stdout:6/168: dwrite d0/d1d/d23/f3d [0,4194304] 0 2024-02-28T16:24:31.628 INFO:tasks.workunit.client.1.smithi153.stdout:2/165: mkdir d2/d23/d36 0 2024-02-28T16:24:31.630 INFO:tasks.workunit.client.1.smithi153.stdout:7/141: mkdir d1/d25/d27 0 2024-02-28T16:24:31.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/175: creat d4/f3e x:0 0 0 2024-02-28T16:24:31.633 INFO:tasks.workunit.client.1.smithi153.stdout:1/134: link d0/l19 d0/dd/l36 0 2024-02-28T16:24:31.635 INFO:tasks.workunit.client.1.smithi153.stdout:9/118: symlink d1/d5/d11/d1f/d20/l2b 0 2024-02-28T16:24:31.636 INFO:tasks.workunit.client.1.smithi153.stdout:5/150: chown da/f16 2732 1 2024-02-28T16:24:31.637 INFO:tasks.workunit.client.1.smithi153.stdout:2/166: rmdir d2/d25 39 2024-02-28T16:24:31.643 INFO:tasks.workunit.client.1.smithi153.stdout:0/176: chown d4/d1a/f1f 24 1 2024-02-28T16:24:31.644 INFO:tasks.workunit.client.1.smithi153.stdout:2/167: chown d2/c1e 182 1 2024-02-28T16:24:31.644 INFO:tasks.workunit.client.1.smithi153.stdout:1/135: chown d0/c35 702827 1 2024-02-28T16:24:31.645 INFO:tasks.workunit.client.1.smithi153.stdout:8/155: dwrite d0/d12/d15/f18 [0,4194304] 0 2024-02-28T16:24:31.645 INFO:tasks.workunit.client.1.smithi153.stdout:1/136: chown d0/dd/f32 10554 1 2024-02-28T16:24:31.647 INFO:tasks.workunit.client.1.smithi153.stdout:5/151: mknod da/d29/c37 0 2024-02-28T16:24:31.649 INFO:tasks.workunit.client.1.smithi153.stdout:7/142: symlink d1/d25/d27/l28 0 2024-02-28T16:24:31.650 INFO:tasks.workunit.client.1.smithi153.stdout:4/154: dwrite d4/f32 [0,4194304] 0 2024-02-28T16:24:31.652 INFO:tasks.workunit.client.1.smithi153.stdout:9/119: symlink d1/l2c 0 2024-02-28T16:24:31.652 INFO:tasks.workunit.client.1.smithi153.stdout:7/143: mknod d1/c29 0 2024-02-28T16:24:31.652 INFO:tasks.workunit.client.1.smithi153.stdout:2/168: read d2/f11 [4597957,130861] 0 2024-02-28T16:24:31.654 INFO:tasks.workunit.client.1.smithi153.stdout:0/177: chown d4/d1a/c2b 303753 1 2024-02-28T16:24:31.654 INFO:tasks.workunit.client.1.smithi153.stdout:1/137: creat d0/dd/f37 x:0 0 0 2024-02-28T16:24:31.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/144: write d1/d25/fe [2645198,64814] 0 2024-02-28T16:24:31.660 INFO:tasks.workunit.client.1.smithi153.stdout:5/152: read da/f19 [4400989,54350] 0 2024-02-28T16:24:31.662 INFO:tasks.workunit.client.1.smithi153.stdout:4/155: truncate d4/de/d13/f35 786567 0 2024-02-28T16:24:31.664 INFO:tasks.workunit.client.1.smithi153.stdout:4/156: write d4/f15 [350864,67381] 0 2024-02-28T16:24:31.666 INFO:tasks.workunit.client.1.smithi153.stdout:1/138: stat d0/l2f 0 2024-02-28T16:24:31.666 INFO:tasks.workunit.client.1.smithi153.stdout:0/178: creat d4/dc/f3f x:0 0 0 2024-02-28T16:24:31.670 INFO:tasks.workunit.client.1.smithi153.stdout:5/153: rename da/d29/f2b to da/f38 0 2024-02-28T16:24:31.672 INFO:tasks.workunit.client.1.smithi153.stdout:9/120: creat d1/d1c/f2d x:0 0 0 2024-02-28T16:24:31.676 INFO:tasks.workunit.client.1.smithi153.stdout:4/157: mknod d4/de/d13/c36 0 2024-02-28T16:24:31.676 INFO:tasks.workunit.client.1.smithi153.stdout:7/145: dread d1/d25/f9 [0,4194304] 0 2024-02-28T16:24:31.677 INFO:tasks.workunit.client.1.smithi153.stdout:0/179: symlink d4/d32/l40 0 2024-02-28T16:24:31.678 INFO:tasks.workunit.client.1.smithi153.stdout:7/146: stat d1 0 2024-02-28T16:24:31.679 INFO:tasks.workunit.client.1.smithi153.stdout:5/154: creat da/f39 x:0 0 0 2024-02-28T16:24:31.679 INFO:tasks.workunit.client.1.smithi153.stdout:4/158: write f1 [1102417,95637] 0 2024-02-28T16:24:31.681 INFO:tasks.workunit.client.1.smithi153.stdout:8/156: getdents d0/d19/d1c 0 2024-02-28T16:24:31.685 INFO:tasks.workunit.client.1.smithi153.stdout:5/155: creat da/f3a x:0 0 0 2024-02-28T16:24:31.685 INFO:tasks.workunit.client.1.smithi153.stdout:0/180: symlink d4/d27/l41 0 2024-02-28T16:24:31.687 INFO:tasks.workunit.client.1.smithi153.stdout:5/156: chown da/d29 99833 1 2024-02-28T16:24:31.688 INFO:tasks.workunit.client.1.smithi153.stdout:9/121: creat d1/f2e x:0 0 0 2024-02-28T16:24:31.690 INFO:tasks.workunit.client.1.smithi153.stdout:8/157: creat d0/d19/d1c/f2c x:0 0 0 2024-02-28T16:24:31.691 INFO:tasks.workunit.client.1.smithi153.stdout:1/139: dwrite d0/dd/f2b [0,4194304] 0 2024-02-28T16:24:31.697 INFO:tasks.workunit.client.1.smithi153.stdout:7/147: dwrite d1/f23 [0,4194304] 0 2024-02-28T16:24:31.698 INFO:tasks.workunit.client.1.smithi153.stdout:5/157: rename da/f24 to da/dd/d25/f3b 0 2024-02-28T16:24:31.701 INFO:tasks.workunit.client.1.smithi153.stdout:5/158: write da/d29/f30 [1274077,10704] 0 2024-02-28T16:24:31.707 INFO:tasks.workunit.client.1.smithi153.stdout:4/159: link d4/f9 d4/de/d23/f37 0 2024-02-28T16:24:31.711 INFO:tasks.workunit.client.1.smithi153.stdout:4/160: chown d4/de/l2f 10 1 2024-02-28T16:24:31.711 INFO:tasks.workunit.client.1.smithi153.stdout:0/181: link d4/d1a/f24 d4/d27/f42 0 2024-02-28T16:24:31.714 INFO:tasks.workunit.client.1.smithi153.stdout:1/140: dwrite d0/dd/f37 [0,4194304] 0 2024-02-28T16:24:31.715 INFO:tasks.workunit.client.1.smithi153.stdout:7/148: dread d1/f23 [0,4194304] 0 2024-02-28T16:24:31.715 INFO:tasks.workunit.client.1.smithi153.stdout:8/158: mkdir d0/d19/d2b/d2d 0 2024-02-28T16:24:31.716 INFO:tasks.workunit.client.1.smithi153.stdout:0/182: chown d4/dc/c15 168992357 1 2024-02-28T16:24:31.717 INFO:tasks.workunit.client.1.smithi153.stdout:4/161: dread - d4/de/d23/d2b/d31/f33 zero size 2024-02-28T16:24:31.718 INFO:tasks.workunit.client.1.smithi153.stdout:8/159: fdatasync d0/d12/d15/f1b 0 2024-02-28T16:24:31.724 INFO:tasks.workunit.client.1.smithi153.stdout:1/141: creat d0/f38 x:0 0 0 2024-02-28T16:24:31.724 INFO:tasks.workunit.client.1.smithi153.stdout:0/183: mknod d4/d27/c43 0 2024-02-28T16:24:31.725 INFO:tasks.workunit.client.1.smithi153.stdout:7/149: unlink d1/f1c 0 2024-02-28T16:24:31.725 INFO:tasks.workunit.client.1.smithi153.stdout:1/142: dread - d0/f14 zero size 2024-02-28T16:24:31.726 INFO:tasks.workunit.client.1.smithi153.stdout:0/184: dread - d4/f8 zero size 2024-02-28T16:24:31.730 INFO:tasks.workunit.client.1.smithi153.stdout:9/122: dread d1/d5/f19 [0,4194304] 0 2024-02-28T16:24:31.730 INFO:tasks.workunit.client.1.smithi153.stdout:4/162: write d4/f9 [2967702,74037] 0 2024-02-28T16:24:31.733 INFO:tasks.workunit.client.1.smithi153.stdout:9/123: chown d1/d5/d11/c16 1951 1 2024-02-28T16:24:31.733 INFO:tasks.workunit.client.1.smithi153.stdout:4/163: fdatasync d4/de/f16 0 2024-02-28T16:24:31.735 INFO:tasks.workunit.client.1.smithi153.stdout:8/160: rmdir d0/d25 39 2024-02-28T16:24:31.737 INFO:tasks.workunit.client.1.smithi153.stdout:5/159: truncate da/f16 77363 0 2024-02-28T16:24:31.739 INFO:tasks.workunit.client.1.smithi153.stdout:5/160: dread - da/dd/f34 zero size 2024-02-28T16:24:31.741 INFO:tasks.workunit.client.1.smithi153.stdout:5/161: write da/dd/d25/f2e [954605,115250] 0 2024-02-28T16:24:31.742 INFO:tasks.workunit.client.1.smithi153.stdout:4/164: dread d4/f6 [0,4194304] 0 2024-02-28T16:24:31.743 INFO:tasks.workunit.client.1.smithi153.stdout:1/143: mknod d0/dd/c39 0 2024-02-28T16:24:31.744 INFO:tasks.workunit.client.1.smithi153.stdout:5/162: write f1 [2576435,75696] 0 2024-02-28T16:24:31.745 INFO:tasks.workunit.client.1.smithi153.stdout:1/144: write d0/f25 [261444,130215] 0 2024-02-28T16:24:31.746 INFO:tasks.workunit.client.1.smithi153.stdout:0/185: write d4/dc/f19 [7494875,49549] 0 2024-02-28T16:24:31.750 INFO:tasks.workunit.client.1.smithi153.stdout:0/186: chown d4/f3c 169123127 1 2024-02-28T16:24:31.750 INFO:tasks.workunit.client.1.smithi153.stdout:8/161: creat d0/d19/d1e/f2e x:0 0 0 2024-02-28T16:24:31.751 INFO:tasks.workunit.client.1.smithi153.stdout:0/187: chown d4/d1a/f1d 2284177 1 2024-02-28T16:24:31.752 INFO:tasks.workunit.client.1.smithi153.stdout:4/165: unlink d4/de/f1f 0 2024-02-28T16:24:31.752 INFO:tasks.workunit.client.1.smithi153.stdout:9/124: symlink d1/d2/l2f 0 2024-02-28T16:24:31.758 INFO:tasks.workunit.client.1.smithi153.stdout:1/145: symlink d0/l3a 0 2024-02-28T16:24:31.758 INFO:tasks.workunit.client.1.smithi153.stdout:1/146: stat d0/l31 0 2024-02-28T16:24:31.759 INFO:tasks.workunit.client.1.smithi153.stdout:1/147: chown d0/c3 66 1 2024-02-28T16:24:31.759 INFO:tasks.workunit.client.1.smithi153.stdout:7/150: creat d1/d25/f2a x:0 0 0 2024-02-28T16:24:31.761 INFO:tasks.workunit.client.1.smithi153.stdout:7/151: write d1/d25/fe [2768154,47735] 0 2024-02-28T16:24:31.762 INFO:tasks.workunit.client.1.smithi153.stdout:8/162: symlink d0/d19/d2b/l2f 0 2024-02-28T16:24:31.765 INFO:tasks.workunit.client.1.smithi153.stdout:8/163: write d0/f6 [4875977,23865] 0 2024-02-28T16:24:31.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/188: dwrite d4/d1a/f39 [0,4194304] 0 2024-02-28T16:24:31.769 INFO:tasks.workunit.client.1.smithi153.stdout:8/164: chown d0/d12 21 1 2024-02-28T16:24:31.770 INFO:tasks.workunit.client.1.smithi153.stdout:1/148: rename d0/l1e to d0/l3b 0 2024-02-28T16:24:31.773 INFO:tasks.workunit.client.1.smithi153.stdout:8/165: fsync d0/d19/d1e/f20 0 2024-02-28T16:24:31.776 INFO:tasks.workunit.client.1.smithi153.stdout:4/166: dwrite d4/de/d13/d1b/f2a [4194304,4194304] 0 2024-02-28T16:24:31.778 INFO:tasks.workunit.client.1.smithi153.stdout:7/152: mkdir d1/d25/dc/d2b 0 2024-02-28T16:24:31.779 INFO:tasks.workunit.client.1.smithi153.stdout:4/167: fdatasync d4/de/d23/d2b/d31/f34 0 2024-02-28T16:24:31.781 INFO:tasks.workunit.client.1.smithi153.stdout:4/168: readlink d4/de/l1e 0 2024-02-28T16:24:31.782 INFO:tasks.workunit.client.1.smithi153.stdout:1/149: creat d0/f3c x:0 0 0 2024-02-28T16:24:31.787 INFO:tasks.workunit.client.1.smithi153.stdout:1/150: read d0/dd/f2b [3957762,91922] 0 2024-02-28T16:24:31.788 INFO:tasks.workunit.client.1.smithi153.stdout:4/169: truncate d4/de/f27 367544 0 2024-02-28T16:24:31.789 INFO:tasks.workunit.client.1.smithi153.stdout:9/125: dwrite d1/d5/f19 [0,4194304] 0 2024-02-28T16:24:31.791 INFO:tasks.workunit.client.1.smithi153.stdout:4/170: read d4/de/f27 [334637,86331] 0 2024-02-28T16:24:31.795 INFO:tasks.workunit.client.1.smithi153.stdout:8/166: mkdir d0/d12/d27/d30 0 2024-02-28T16:24:31.796 INFO:tasks.workunit.client.1.smithi153.stdout:5/163: truncate da/dd/f15 166100 0 2024-02-28T16:24:31.801 INFO:tasks.workunit.client.1.smithi153.stdout:3/185: sync 2024-02-28T16:24:31.802 INFO:tasks.workunit.client.1.smithi153.stdout:8/167: rmdir d0/d12/d27 39 2024-02-28T16:24:31.804 INFO:tasks.workunit.client.1.smithi153.stdout:0/189: dwrite d4/f14 [0,4194304] 0 2024-02-28T16:24:31.804 INFO:tasks.workunit.client.1.smithi153.stdout:5/164: rename da/l22 to da/l3c 0 2024-02-28T16:24:31.807 INFO:tasks.workunit.client.1.smithi153.stdout:0/190: chown d4/dc 100 1 2024-02-28T16:24:31.807 INFO:tasks.workunit.client.1.smithi153.stdout:5/165: chown da/d29/f30 355 1 2024-02-28T16:24:31.810 INFO:tasks.workunit.client.1.smithi153.stdout:8/168: symlink d0/d19/l31 0 2024-02-28T16:24:31.810 INFO:tasks.workunit.client.1.smithi153.stdout:9/126: creat d1/d5/d27/f30 x:0 0 0 2024-02-28T16:24:31.822 INFO:tasks.workunit.client.1.smithi153.stdout:9/127: creat d1/d5/d11/d1f/d20/f31 x:0 0 0 2024-02-28T16:24:31.826 INFO:tasks.workunit.client.1.smithi153.stdout:8/169: mknod d0/d12/c32 0 2024-02-28T16:24:31.830 INFO:tasks.workunit.client.1.smithi153.stdout:9/128: write d1/d5/d27/f30 [839264,40149] 0 2024-02-28T16:24:31.830 INFO:tasks.workunit.client.1.smithi153.stdout:3/186: dwrite d4/d8/d1e/d2a/d35/f39 [0,4194304] 0 2024-02-28T16:24:31.834 INFO:tasks.workunit.client.1.smithi153.stdout:9/129: chown d1/d5/d27 1445934845 1 2024-02-28T16:24:31.837 INFO:tasks.workunit.client.1.smithi153.stdout:5/166: dwrite da/dd/f31 [0,4194304] 0 2024-02-28T16:24:31.839 INFO:tasks.workunit.client.1.smithi153.stdout:7/153: dread d1/d25/dc/f13 [0,4194304] 0 2024-02-28T16:24:31.848 INFO:tasks.workunit.client.1.smithi153.stdout:3/187: rename d4/d8/l3a to d4/d8/d1e/d23/d38/l40 0 2024-02-28T16:24:31.849 INFO:tasks.workunit.client.1.smithi153.stdout:1/151: truncate d0/dd/f29 745928 0 2024-02-28T16:24:31.849 INFO:tasks.workunit.client.1.smithi153.stdout:7/154: rmdir d1/d25/dc 39 2024-02-28T16:24:31.849 INFO:tasks.workunit.client.1.smithi153.stdout:7/155: chown d1/d25/df 5 1 2024-02-28T16:24:31.851 INFO:tasks.workunit.client.1.smithi153.stdout:1/152: mkdir d0/d3d 0 2024-02-28T16:24:31.855 INFO:tasks.workunit.client.1.smithi153.stdout:0/191: truncate d4/f25 69930 0 2024-02-28T16:24:31.856 INFO:tasks.workunit.client.1.smithi153.stdout:9/130: creat d1/d2/f32 x:0 0 0 2024-02-28T16:24:31.857 INFO:tasks.workunit.client.1.smithi153.stdout:9/131: dread - d1/f2e zero size 2024-02-28T16:24:31.861 INFO:tasks.workunit.client.1.smithi153.stdout:5/167: rename da/dd/f34 to da/dd/f3d 0 2024-02-28T16:24:31.863 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:31 smithi023 ceph-mon[29137]: pgmap v5: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:31.863 INFO:tasks.workunit.client.1.smithi153.stdout:7/156: dread d1/d25/dc/f15 [0,4194304] 0 2024-02-28T16:24:31.865 INFO:tasks.workunit.client.1.smithi153.stdout:0/192: unlink d4/d1a/c26 0 2024-02-28T16:24:31.866 INFO:tasks.workunit.client.1.smithi153.stdout:0/193: fdatasync d4/dc/f2e 0 2024-02-28T16:24:31.868 INFO:tasks.workunit.client.1.smithi153.stdout:9/132: mknod d1/d1c/c33 0 2024-02-28T16:24:31.872 INFO:tasks.workunit.client.1.smithi153.stdout:5/168: read da/f16 [67155,62370] 0 2024-02-28T16:24:31.873 INFO:tasks.workunit.client.1.smithi153.stdout:7/157: creat d1/f2c x:0 0 0 2024-02-28T16:24:31.878 INFO:tasks.workunit.client.1.smithi153.stdout:0/194: creat d4/d27/f44 x:0 0 0 2024-02-28T16:24:31.879 INFO:tasks.workunit.client.1.smithi153.stdout:7/158: readlink d1/la 0 2024-02-28T16:24:31.880 INFO:tasks.workunit.client.1.smithi153.stdout:5/169: creat da/d29/f3e x:0 0 0 2024-02-28T16:24:31.882 INFO:tasks.workunit.client.1.smithi153.stdout:7/159: chown d1/d25/f2a 2 1 2024-02-28T16:24:31.883 INFO:tasks.workunit.client.1.smithi153.stdout:5/170: read da/f16 [43615,99604] 0 2024-02-28T16:24:31.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/133: dwrite d1/d1c/f2d [0,4194304] 0 2024-02-28T16:24:31.885 INFO:tasks.workunit.client.1.smithi153.stdout:3/188: rename d4/d8/d1e/d23/d38 to d4/d8/d26/d41 0 2024-02-28T16:24:31.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:31 smithi153 ceph-mon[35341]: pgmap v5: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:31.906 INFO:tasks.workunit.client.1.smithi153.stdout:9/134: dwrite d1/d2/f25 [0,4194304] 0 2024-02-28T16:24:31.907 INFO:tasks.workunit.client.1.smithi153.stdout:9/135: chown d1/d5/d27 234 1 2024-02-28T16:24:31.911 INFO:tasks.workunit.client.1.smithi153.stdout:7/160: getdents d1 0 2024-02-28T16:24:31.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/169: sync 2024-02-28T16:24:31.913 INFO:tasks.workunit.client.1.smithi153.stdout:2/169: sync 2024-02-28T16:24:31.915 INFO:tasks.workunit.client.1.smithi153.stdout:6/170: chown d0/d1d/d23/f3d 1531 1 2024-02-28T16:24:31.916 INFO:tasks.workunit.client.1.smithi153.stdout:1/153: truncate d0/dd/f1c 78272 0 2024-02-28T16:24:31.917 INFO:tasks.workunit.client.1.smithi153.stdout:6/171: truncate d0/d17/f1f 1692360 0 2024-02-28T16:24:31.923 INFO:tasks.workunit.client.1.smithi153.stdout:6/172: dread - d0/d1d/d30/f31 zero size 2024-02-28T16:24:31.927 INFO:tasks.workunit.client.1.smithi153.stdout:1/154: truncate d0/dd/f2d 728444 0 2024-02-28T16:24:31.927 INFO:tasks.workunit.client.1.smithi153.stdout:6/173: chown d0 269 1 2024-02-28T16:24:31.930 INFO:tasks.workunit.client.1.smithi153.stdout:0/195: dread d4/fe [0,4194304] 0 2024-02-28T16:24:31.931 INFO:tasks.workunit.client.1.smithi153.stdout:9/136: dwrite d1/f10 [0,4194304] 0 2024-02-28T16:24:31.933 INFO:tasks.workunit.client.1.smithi153.stdout:2/170: mknod d2/c37 0 2024-02-28T16:24:31.939 INFO:tasks.workunit.client.1.smithi153.stdout:6/174: rmdir d0 39 2024-02-28T16:24:31.939 INFO:tasks.workunit.client.1.smithi153.stdout:1/155: rename d0/f38 to d0/d3d/f3e 0 2024-02-28T16:24:31.943 INFO:tasks.workunit.client.1.smithi153.stdout:2/171: dread - d2/d25/f34 zero size 2024-02-28T16:24:31.948 INFO:tasks.workunit.client.1.smithi153.stdout:0/196: creat d4/f45 x:0 0 0 2024-02-28T16:24:31.949 INFO:tasks.workunit.client.1.smithi153.stdout:6/175: stat d0/d15/f1a 0 2024-02-28T16:24:31.950 INFO:tasks.workunit.client.1.smithi153.stdout:0/197: chown d4/l3d 203081629 1 2024-02-28T16:24:31.956 INFO:tasks.workunit.client.1.smithi153.stdout:3/189: dread d4/d8/f1c [0,4194304] 0 2024-02-28T16:24:31.957 INFO:tasks.workunit.client.1.smithi153.stdout:2/172: creat d2/d19/f38 x:0 0 0 2024-02-28T16:24:31.958 INFO:tasks.workunit.client.1.smithi153.stdout:0/198: symlink d4/d32/l46 0 2024-02-28T16:24:31.960 INFO:tasks.workunit.client.1.smithi153.stdout:0/199: chown d4/d1a/c1c 42874 1 2024-02-28T16:24:31.960 INFO:tasks.workunit.client.1.smithi153.stdout:2/173: chown d2/f26 225 1 2024-02-28T16:24:31.963 INFO:tasks.workunit.client.1.smithi153.stdout:3/190: write d4/d8/d1e/d23/f24 [1057743,50420] 0 2024-02-28T16:24:31.964 INFO:tasks.workunit.client.1.smithi153.stdout:1/156: rmdir d0/dd 39 2024-02-28T16:24:31.968 INFO:tasks.workunit.client.1.smithi153.stdout:5/171: dread da/dd/fe [0,4194304] 0 2024-02-28T16:24:31.971 INFO:tasks.workunit.client.1.smithi153.stdout:3/191: fdatasync f0 0 2024-02-28T16:24:31.972 INFO:tasks.workunit.client.1.smithi153.stdout:4/171: sync 2024-02-28T16:24:31.973 INFO:tasks.workunit.client.1.smithi153.stdout:5/172: symlink da/d29/l3f 0 2024-02-28T16:24:31.975 INFO:tasks.workunit.client.1.smithi153.stdout:3/192: chown d4/le 97678 1 2024-02-28T16:24:31.976 INFO:tasks.workunit.client.1.smithi153.stdout:8/170: sync 2024-02-28T16:24:31.979 INFO:tasks.workunit.client.1.smithi153.stdout:3/193: chown d4/d8/d1e/d23/f24 743023567 1 2024-02-28T16:24:31.979 INFO:tasks.workunit.client.1.smithi153.stdout:4/172: truncate d4/de/f12 400454 0 2024-02-28T16:24:31.981 INFO:tasks.workunit.client.1.smithi153.stdout:4/173: readlink d4/de/l2f 0 2024-02-28T16:24:31.987 INFO:tasks.workunit.client.1.smithi153.stdout:8/171: creat d0/d19/d2b/f33 x:0 0 0 2024-02-28T16:24:31.990 INFO:tasks.workunit.client.1.smithi153.stdout:3/194: creat d4/d8/d1e/f42 x:0 0 0 2024-02-28T16:24:31.994 INFO:tasks.workunit.client.1.smithi153.stdout:6/176: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:24:31.998 INFO:tasks.workunit.client.1.smithi153.stdout:9/137: dread d1/f4 [4194304,4194304] 0 2024-02-28T16:24:31.999 INFO:tasks.workunit.client.1.smithi153.stdout:8/172: chown d0/d25/f23 170870631 1 2024-02-28T16:24:32.001 INFO:tasks.workunit.client.1.smithi153.stdout:4/174: rename d4/de/f27 to d4/f38 0 2024-02-28T16:24:32.004 INFO:tasks.workunit.client.1.smithi153.stdout:0/200: getdents d4 0 2024-02-28T16:24:32.006 INFO:tasks.workunit.client.1.smithi153.stdout:5/173: dread da/dd/d25/f2e [0,4194304] 0 2024-02-28T16:24:32.009 INFO:tasks.workunit.client.1.smithi153.stdout:9/138: chown d1/d5/d11/d29 28252 1 2024-02-28T16:24:32.013 INFO:tasks.workunit.client.1.smithi153.stdout:8/173: dread - d0/d19/d1c/f2c zero size 2024-02-28T16:24:32.014 INFO:tasks.workunit.client.1.smithi153.stdout:2/174: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:24:32.014 INFO:tasks.workunit.client.1.smithi153.stdout:1/157: dwrite d0/dd/f34 [4194304,4194304] 0 2024-02-28T16:24:32.014 INFO:tasks.workunit.client.1.smithi153.stdout:0/201: read - d4/d1a/f1d zero size 2024-02-28T16:24:32.014 INFO:tasks.workunit.client.1.smithi153.stdout:4/175: mknod d4/de/c39 0 2024-02-28T16:24:32.016 INFO:tasks.workunit.client.1.smithi153.stdout:7/161: sync 2024-02-28T16:24:32.029 INFO:tasks.workunit.client.1.smithi153.stdout:7/162: fsync d1/d25/dc/f13 0 2024-02-28T16:24:32.029 INFO:tasks.workunit.client.1.smithi153.stdout:4/176: write d4/de/d13/f20 [442590,52501] 0 2024-02-28T16:24:32.029 INFO:tasks.workunit.client.1.smithi153.stdout:3/195: dwrite d4/d13/f3f [0,4194304] 0 2024-02-28T16:24:32.030 INFO:tasks.workunit.client.1.smithi153.stdout:8/174: mkdir d0/d34 0 2024-02-28T16:24:32.032 INFO:tasks.workunit.client.1.smithi153.stdout:5/174: creat da/dd/f40 x:0 0 0 2024-02-28T16:24:32.033 INFO:tasks.workunit.client.1.smithi153.stdout:8/175: fsync d0/d19/d1e/f2e 0 2024-02-28T16:24:32.035 INFO:tasks.workunit.client.1.smithi153.stdout:9/139: creat d1/f34 x:0 0 0 2024-02-28T16:24:32.040 INFO:tasks.workunit.client.1.smithi153.stdout:9/140: chown d1/d2/f25 11618328 1 2024-02-28T16:24:32.041 INFO:tasks.workunit.client.1.smithi153.stdout:4/177: creat d4/de/d23/f3a x:0 0 0 2024-02-28T16:24:32.043 INFO:tasks.workunit.client.1.smithi153.stdout:0/202: dread d4/d27/f42 [0,4194304] 0 2024-02-28T16:24:32.043 INFO:tasks.workunit.client.1.smithi153.stdout:9/141: readlink d1/l2c 0 2024-02-28T16:24:32.044 INFO:tasks.workunit.client.1.smithi153.stdout:7/163: fdatasync d1/d25/dc/f15 0 2024-02-28T16:24:32.044 INFO:tasks.workunit.client.1.smithi153.stdout:8/176: readlink d0/l10 0 2024-02-28T16:24:32.051 INFO:tasks.workunit.client.1.smithi153.stdout:0/203: chown d4/dc 14547472 1 2024-02-28T16:24:32.053 INFO:tasks.workunit.client.1.smithi153.stdout:1/158: getdents d0/d3d 0 2024-02-28T16:24:32.055 INFO:tasks.workunit.client.1.smithi153.stdout:7/164: read d1/d25/f9 [366628,13539] 0 2024-02-28T16:24:32.055 INFO:tasks.workunit.client.1.smithi153.stdout:9/142: write d1/d5/f19 [2434875,93295] 0 2024-02-28T16:24:32.055 INFO:tasks.workunit.client.1.smithi153.stdout:5/175: mkdir da/dd/d25/d41 0 2024-02-28T16:24:32.063 INFO:tasks.workunit.client.1.smithi153.stdout:4/178: mknod d4/de/d13/d1b/c3b 0 2024-02-28T16:24:32.064 INFO:tasks.workunit.client.1.smithi153.stdout:9/143: dread - d1/ff zero size 2024-02-28T16:24:32.072 INFO:tasks.workunit.client.1.smithi153.stdout:9/144: read - d1/d2/f32 zero size 2024-02-28T16:24:32.076 INFO:tasks.workunit.client.1.smithi153.stdout:2/175: dwrite d2/f21 [0,4194304] 0 2024-02-28T16:24:32.082 INFO:tasks.workunit.client.1.smithi153.stdout:5/176: write da/f38 [1052295,109436] 0 2024-02-28T16:24:32.082 INFO:tasks.workunit.client.1.smithi153.stdout:7/165: write d1/f23 [87221,62849] 0 2024-02-28T16:24:32.082 INFO:tasks.workunit.client.1.smithi153.stdout:8/177: stat d0/d12/d27/d30 0 2024-02-28T16:24:32.087 INFO:tasks.workunit.client.1.smithi153.stdout:5/177: readlink da/dd/l28 0 2024-02-28T16:24:32.091 INFO:tasks.workunit.client.1.smithi153.stdout:6/177: dread d0/f10 [0,4194304] 0 2024-02-28T16:24:32.094 INFO:tasks.workunit.client.1.smithi153.stdout:7/166: mknod d1/d25/dc/c2d 0 2024-02-28T16:24:32.098 INFO:tasks.workunit.client.1.smithi153.stdout:0/204: dwrite d4/d1a/f39 [0,4194304] 0 2024-02-28T16:24:32.099 INFO:tasks.workunit.client.1.smithi153.stdout:7/167: stat d1/d25/d27 0 2024-02-28T16:24:32.102 INFO:tasks.workunit.client.1.smithi153.stdout:6/178: symlink d0/d1d/l3f 0 2024-02-28T16:24:32.103 INFO:tasks.workunit.client.1.smithi153.stdout:3/196: dwrite d4/d8/f1c [0,4194304] 0 2024-02-28T16:24:32.106 INFO:tasks.workunit.client.1.smithi153.stdout:3/197: fsync d4/f22 0 2024-02-28T16:24:32.107 INFO:tasks.workunit.client.1.smithi153.stdout:0/205: creat d4/d27/f47 x:0 0 0 2024-02-28T16:24:32.108 INFO:tasks.workunit.client.1.smithi153.stdout:9/145: getdents d1/d2 0 2024-02-28T16:24:32.109 INFO:tasks.workunit.client.1.smithi153.stdout:5/178: rmdir da/dd 39 2024-02-28T16:24:32.112 INFO:tasks.workunit.client.1.smithi153.stdout:6/179: mknod d0/c40 0 2024-02-28T16:24:32.112 INFO:tasks.workunit.client.1.smithi153.stdout:3/198: write d4/f22 [708119,48269] 0 2024-02-28T16:24:32.113 INFO:tasks.workunit.client.1.smithi153.stdout:7/168: mknod d1/d25/d27/c2e 0 2024-02-28T16:24:32.115 INFO:tasks.workunit.client.1.smithi153.stdout:1/159: truncate d0/dd/f21 2568129 0 2024-02-28T16:24:32.118 INFO:tasks.workunit.client.1.smithi153.stdout:8/178: dread d0/d12/d15/f24 [0,4194304] 0 2024-02-28T16:24:32.119 INFO:tasks.workunit.client.1.smithi153.stdout:3/199: write d4/d8/d1e/f3c [988886,40901] 0 2024-02-28T16:24:32.120 INFO:tasks.workunit.client.1.smithi153.stdout:2/176: dread d2/f21 [0,4194304] 0 2024-02-28T16:24:32.120 INFO:tasks.workunit.client.1.smithi153.stdout:7/169: stat d1/d25/c19 0 2024-02-28T16:24:32.123 INFO:tasks.workunit.client.1.smithi153.stdout:2/177: stat l0 0 2024-02-28T16:24:32.125 INFO:tasks.workunit.client.1.smithi153.stdout:0/206: creat d4/d32/f48 x:0 0 0 2024-02-28T16:24:32.125 INFO:tasks.workunit.client.1.smithi153.stdout:6/180: mknod d0/c41 0 2024-02-28T16:24:32.126 INFO:tasks.workunit.client.1.smithi153.stdout:1/160: write d0/f25 [1286620,36986] 0 2024-02-28T16:24:32.126 INFO:tasks.workunit.client.1.smithi153.stdout:8/179: chown d0/d25/f23 151939 1 2024-02-28T16:24:32.130 INFO:tasks.workunit.client.1.smithi153.stdout:9/146: rename d1/d5/ca to d1/d2/c35 0 2024-02-28T16:24:32.132 INFO:tasks.workunit.client.1.smithi153.stdout:4/179: dwrite d4/f32 [4194304,4194304] 0 2024-02-28T16:24:32.132 INFO:tasks.workunit.client.1.smithi153.stdout:5/179: creat da/f42 x:0 0 0 2024-02-28T16:24:32.135 INFO:tasks.workunit.client.1.smithi153.stdout:3/200: readlink d4/d8/d26/d41/l40 0 2024-02-28T16:24:32.136 INFO:tasks.workunit.client.1.smithi153.stdout:7/170: rename d1/l8 to d1/l2f 0 2024-02-28T16:24:32.138 INFO:tasks.workunit.client.1.smithi153.stdout:0/207: mknod d4/dc/c49 0 2024-02-28T16:24:32.138 INFO:tasks.workunit.client.1.smithi153.stdout:6/181: fdatasync d0/d1d/d33/f3b 0 2024-02-28T16:24:32.142 INFO:tasks.workunit.client.1.smithi153.stdout:1/161: mknod d0/d3d/c3f 0 2024-02-28T16:24:32.145 INFO:tasks.workunit.client.1.smithi153.stdout:1/162: write d0/dd/f34 [3189254,39739] 0 2024-02-28T16:24:32.146 INFO:tasks.workunit.client.1.smithi153.stdout:8/180: rename d0/d19/f1f to d0/d19/d2b/d2d/f35 0 2024-02-28T16:24:32.176 INFO:tasks.workunit.client.1.smithi153.stdout:6/182: rename d0/d1d/f1e to d0/d15/d2e/f42 0 2024-02-28T16:24:32.177 INFO:tasks.workunit.client.1.smithi153.stdout:2/178: write d2/d19/d2a/f2f [4970534,26561] 0 2024-02-28T16:24:32.180 INFO:tasks.workunit.client.1.smithi153.stdout:8/181: creat d0/d12/d15/f36 x:0 0 0 2024-02-28T16:24:32.180 INFO:tasks.workunit.client.1.smithi153.stdout:5/180: unlink da/dd/d25/f3b 0 2024-02-28T16:24:32.182 INFO:tasks.workunit.client.1.smithi153.stdout:8/182: stat d0/d19/d1c 0 2024-02-28T16:24:32.183 INFO:tasks.workunit.client.1.smithi153.stdout:8/183: readlink d0/l10 0 2024-02-28T16:24:32.183 INFO:tasks.workunit.client.1.smithi153.stdout:9/147: write d1/d2/f32 [99,25607] 0 2024-02-28T16:24:32.184 INFO:tasks.workunit.client.1.smithi153.stdout:3/201: rename d4/d8/d1e/f2b to d4/d8/d1e/d2a/f43 0 2024-02-28T16:24:32.185 INFO:tasks.workunit.client.1.smithi153.stdout:7/171: dread d1/d25/f9 [0,4194304] 0 2024-02-28T16:24:32.186 INFO:tasks.workunit.client.1.smithi153.stdout:9/148: readlink d1/d2/l24 0 2024-02-28T16:24:32.188 INFO:tasks.workunit.client.1.smithi153.stdout:2/179: symlink d2/d25/l39 0 2024-02-28T16:24:32.189 INFO:tasks.workunit.client.1.smithi153.stdout:1/163: creat d0/f40 x:0 0 0 2024-02-28T16:24:32.191 INFO:tasks.workunit.client.1.smithi153.stdout:5/181: mkdir da/d29/d43 0 2024-02-28T16:24:32.191 INFO:tasks.workunit.client.1.smithi153.stdout:3/202: rmdir d4/d13 39 2024-02-28T16:24:32.193 INFO:tasks.workunit.client.1.smithi153.stdout:1/164: write d0/dd/f37 [276466,21491] 0 2024-02-28T16:24:32.197 INFO:tasks.workunit.client.1.smithi153.stdout:9/149: rename d1/d1c to d1/d5/d11/d1f/d20/d36 0 2024-02-28T16:24:32.199 INFO:tasks.workunit.client.1.smithi153.stdout:2/180: readlink d2/la 0 2024-02-28T16:24:32.205 INFO:tasks.workunit.client.1.smithi153.stdout:3/203: chown d4/d13/f14 11096023 1 2024-02-28T16:24:32.206 INFO:tasks.workunit.client.1.smithi153.stdout:6/183: dwrite d0/f10 [0,4194304] 0 2024-02-28T16:24:32.212 INFO:tasks.workunit.client.1.smithi153.stdout:8/184: dwrite d0/ff [0,4194304] 0 2024-02-28T16:24:32.214 INFO:tasks.workunit.client.1.smithi153.stdout:9/150: creat d1/d5/d11/d1f/d20/d36/f37 x:0 0 0 2024-02-28T16:24:32.217 INFO:tasks.workunit.client.1.smithi153.stdout:2/181: mknod d2/d23/d36/c3a 0 2024-02-28T16:24:32.219 INFO:tasks.workunit.client.1.smithi153.stdout:5/182: dwrite da/f38 [0,4194304] 0 2024-02-28T16:24:32.220 INFO:tasks.workunit.client.1.smithi153.stdout:1/165: rename d0/f3c to d0/f41 0 2024-02-28T16:24:32.223 INFO:tasks.workunit.client.1.smithi153.stdout:6/184: mkdir d0/d43 0 2024-02-28T16:24:32.223 INFO:tasks.workunit.client.1.smithi153.stdout:8/185: dread d0/d12/d15/f24 [0,4194304] 0 2024-02-28T16:24:32.226 INFO:tasks.workunit.client.1.smithi153.stdout:3/204: unlink d4/d8/d1e/d2a/f43 0 2024-02-28T16:24:32.234 INFO:tasks.workunit.client.1.smithi153.stdout:7/172: link d1/d25/dc/c2d d1/d25/c30 0 2024-02-28T16:24:32.239 INFO:tasks.workunit.client.1.smithi153.stdout:8/186: symlink d0/d34/l37 0 2024-02-28T16:24:32.241 INFO:tasks.workunit.client.1.smithi153.stdout:5/183: rename da/dd/d25/f26 to da/f44 0 2024-02-28T16:24:32.243 INFO:tasks.workunit.client.1.smithi153.stdout:6/185: rmdir d0/d43 0 2024-02-28T16:24:32.246 INFO:tasks.workunit.client.1.smithi153.stdout:9/151: dwrite d1/d5/d11/d1f/d20/d36/f37 [0,4194304] 0 2024-02-28T16:24:32.246 INFO:tasks.workunit.client.1.smithi153.stdout:1/166: dread d0/dd/f21 [0,4194304] 0 2024-02-28T16:24:32.248 INFO:tasks.workunit.client.1.smithi153.stdout:5/184: mkdir da/d29/d45 0 2024-02-28T16:24:32.251 INFO:tasks.workunit.client.1.smithi153.stdout:7/173: truncate d1/d25/dc/f15 491503 0 2024-02-28T16:24:32.256 INFO:tasks.workunit.client.1.smithi153.stdout:1/167: write d0/dd/f2d [1170137,87978] 0 2024-02-28T16:24:32.256 INFO:tasks.workunit.client.1.smithi153.stdout:8/187: rename d0/d12/d15/f24 to d0/d19/f38 0 2024-02-28T16:24:32.256 INFO:tasks.workunit.client.1.smithi153.stdout:6/186: creat d0/d1d/d33/f44 x:0 0 0 2024-02-28T16:24:32.261 INFO:tasks.workunit.client.1.smithi153.stdout:9/152: write d1/f4 [9170831,75125] 0 2024-02-28T16:24:32.265 INFO:tasks.workunit.client.1.smithi153.stdout:7/174: dread d1/d25/dc/f13 [0,4194304] 0 2024-02-28T16:24:32.270 INFO:tasks.workunit.client.1.smithi153.stdout:3/205: truncate d4/f20 1858205 0 2024-02-28T16:24:32.273 INFO:tasks.workunit.client.1.smithi153.stdout:5/185: rename f7 to da/dd/d25/d41/f46 0 2024-02-28T16:24:32.276 INFO:tasks.workunit.client.1.smithi153.stdout:1/168: dread d0/dd/f2b [0,4194304] 0 2024-02-28T16:24:32.276 INFO:tasks.workunit.client.1.smithi153.stdout:7/175: mknod d1/c31 0 2024-02-28T16:24:32.277 INFO:tasks.workunit.client.1.smithi153.stdout:8/188: symlink d0/l39 0 2024-02-28T16:24:32.277 INFO:tasks.workunit.client.1.smithi153.stdout:1/169: chown d0/dd/c2a 0 1 2024-02-28T16:24:32.279 INFO:tasks.workunit.client.1.smithi153.stdout:1/170: read d0/f8 [309237,2468] 0 2024-02-28T16:24:32.279 INFO:tasks.workunit.client.1.smithi153.stdout:8/189: dread - d0/d12/d15/f36 zero size 2024-02-28T16:24:32.292 INFO:tasks.workunit.client.1.smithi153.stdout:7/176: rename d1/l5 to d1/d25/dc/l32 0 2024-02-28T16:24:32.295 INFO:tasks.workunit.client.1.smithi153.stdout:3/206: link d4/f5 d4/d8/d26/f44 0 2024-02-28T16:24:32.296 INFO:tasks.workunit.client.1.smithi153.stdout:6/187: truncate d0/d1d/d33/f3b 3726732 0 2024-02-28T16:24:32.299 INFO:tasks.workunit.client.1.smithi153.stdout:8/190: rename d0/d12/d15/f1b to d0/d12/d27/d30/f3a 0 2024-02-28T16:24:32.302 INFO:tasks.workunit.client.1.smithi153.stdout:5/186: creat da/dd/f47 x:0 0 0 2024-02-28T16:24:32.303 INFO:tasks.workunit.client.1.smithi153.stdout:6/188: creat d0/f45 x:0 0 0 2024-02-28T16:24:32.304 INFO:tasks.workunit.client.1.smithi153.stdout:6/189: read d0/f8 [1070817,79596] 0 2024-02-28T16:24:32.308 INFO:tasks.workunit.client.1.smithi153.stdout:8/191: symlink d0/d19/d1e/l3b 0 2024-02-28T16:24:32.312 INFO:tasks.workunit.client.1.smithi153.stdout:6/190: mkdir d0/d46 0 2024-02-28T16:24:32.316 INFO:tasks.workunit.client.1.smithi153.stdout:1/171: link d0/dd/l36 d0/d3d/l42 0 2024-02-28T16:24:32.318 INFO:tasks.workunit.client.1.smithi153.stdout:5/187: creat da/d29/d43/f48 x:0 0 0 2024-02-28T16:24:32.326 INFO:tasks.workunit.client.1.smithi153.stdout:6/191: readlink d0/d15/l16 0 2024-02-28T16:24:32.327 INFO:tasks.workunit.client.1.smithi153.stdout:3/207: rename d4/d8/d1e/d23/c32 to d4/c45 0 2024-02-28T16:24:32.330 INFO:tasks.workunit.client.1.smithi153.stdout:1/172: creat d0/d3d/f43 x:0 0 0 2024-02-28T16:24:32.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/173: write d0/fe [6747989,57151] 0 2024-02-28T16:24:32.333 INFO:tasks.workunit.client.1.smithi153.stdout:5/188: dwrite da/dd/f47 [0,4194304] 0 2024-02-28T16:24:32.338 INFO:tasks.workunit.client.1.smithi153.stdout:3/208: symlink d4/d8/d26/l46 0 2024-02-28T16:24:32.338 INFO:tasks.workunit.client.1.smithi153.stdout:8/192: link d0/l10 d0/d12/d27/d30/l3c 0 2024-02-28T16:24:32.340 INFO:tasks.workunit.client.1.smithi153.stdout:1/174: mknod d0/dd/c44 0 2024-02-28T16:24:32.342 INFO:tasks.workunit.client.1.smithi153.stdout:7/177: dwrite d1/d25/dc/f15 [0,4194304] 0 2024-02-28T16:24:32.343 INFO:tasks.workunit.client.1.smithi153.stdout:3/209: fsync d4/d13/f27 0 2024-02-28T16:24:32.346 INFO:tasks.workunit.client.1.smithi153.stdout:1/175: chown d0/l2f 0 1 2024-02-28T16:24:32.352 INFO:tasks.workunit.client.1.smithi153.stdout:7/178: dread - d1/d25/f2a zero size 2024-02-28T16:24:32.355 INFO:tasks.workunit.client.1.smithi153.stdout:7/179: chown d1/f23 1 1 2024-02-28T16:24:32.363 INFO:tasks.workunit.client.1.smithi153.stdout:5/189: dread da/d29/f30 [0,4194304] 0 2024-02-28T16:24:32.366 INFO:tasks.workunit.client.1.smithi153.stdout:7/180: creat d1/d25/f33 x:0 0 0 2024-02-28T16:24:32.366 INFO:tasks.workunit.client.1.smithi153.stdout:6/192: dwrite d0/fb [0,4194304] 0 2024-02-28T16:24:32.366 INFO:tasks.workunit.client.1.smithi153.stdout:1/176: getdents d0/d3d 0 2024-02-28T16:24:32.371 INFO:tasks.workunit.client.1.smithi153.stdout:7/181: write d1/d25/f9 [3519133,101005] 0 2024-02-28T16:24:32.371 INFO:tasks.workunit.client.1.smithi153.stdout:1/177: mknod d0/c45 0 2024-02-28T16:24:32.381 INFO:tasks.workunit.client.1.smithi153.stdout:7/182: mknod d1/d25/df/c34 0 2024-02-28T16:24:32.383 INFO:tasks.workunit.client.1.smithi153.stdout:1/178: readlink d0/l19 0 2024-02-28T16:24:32.383 INFO:tasks.workunit.client.1.smithi153.stdout:7/183: dread - d1/d25/f33 zero size 2024-02-28T16:24:32.385 INFO:tasks.workunit.client.1.smithi153.stdout:6/193: creat d0/d1d/f47 x:0 0 0 2024-02-28T16:24:32.387 INFO:tasks.workunit.client.1.smithi153.stdout:7/184: readlink d1/la 0 2024-02-28T16:24:32.390 INFO:tasks.workunit.client.1.smithi153.stdout:5/190: dwrite da/dd/d25/f36 [0,4194304] 0 2024-02-28T16:24:32.391 INFO:tasks.workunit.client.1.smithi153.stdout:6/194: mkdir d0/d15/d48 0 2024-02-28T16:24:32.392 INFO:tasks.workunit.client.1.smithi153.stdout:7/185: rmdir d1 39 2024-02-28T16:24:32.392 INFO:tasks.workunit.client.1.smithi153.stdout:1/179: link d0/c35 d0/d3d/c46 0 2024-02-28T16:24:32.394 INFO:tasks.workunit.client.1.smithi153.stdout:0/208: sync 2024-02-28T16:24:32.394 INFO:tasks.workunit.client.1.smithi153.stdout:4/180: sync 2024-02-28T16:24:32.396 INFO:tasks.workunit.client.1.smithi153.stdout:5/191: unlink da/d29/c37 0 2024-02-28T16:24:32.399 INFO:tasks.workunit.client.1.smithi153.stdout:7/186: chown d1/f2c 35 1 2024-02-28T16:24:32.401 INFO:tasks.workunit.client.1.smithi153.stdout:5/192: dread f9 [0,4194304] 0 2024-02-28T16:24:32.401 INFO:tasks.workunit.client.1.smithi153.stdout:0/209: fdatasync d4/f3c 0 2024-02-28T16:24:32.406 INFO:tasks.workunit.client.1.smithi153.stdout:4/181: mkdir d4/d3c 0 2024-02-28T16:24:32.406 INFO:tasks.workunit.client.1.smithi153.stdout:8/193: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:32.407 INFO:tasks.workunit.client.1.smithi153.stdout:6/195: rmdir d0/d1d/d34/d38 0 2024-02-28T16:24:32.407 INFO:tasks.workunit.client.1.smithi153.stdout:5/193: creat da/dd/d25/d41/f49 x:0 0 0 2024-02-28T16:24:32.409 INFO:tasks.workunit.client.1.smithi153.stdout:3/210: dread d4/f1b [0,4194304] 0 2024-02-28T16:24:32.409 INFO:tasks.workunit.client.1.smithi153.stdout:5/194: fdatasync da/f3a 0 2024-02-28T16:24:32.410 INFO:tasks.workunit.client.1.smithi153.stdout:0/210: rmdir d4/d27 39 2024-02-28T16:24:32.497 INFO:tasks.workunit.client.1.smithi153.stdout:5/195: read f9 [38315,17130] 0 2024-02-28T16:24:32.500 INFO:tasks.workunit.client.1.smithi153.stdout:1/180: dwrite d0/f23 [0,4194304] 0 2024-02-28T16:24:32.502 INFO:tasks.workunit.client.1.smithi153.stdout:6/196: rename d0/d1d/d33/f44 to d0/d15/f49 0 2024-02-28T16:24:32.503 INFO:tasks.workunit.client.1.smithi153.stdout:4/182: getdents d4/d3c 0 2024-02-28T16:24:32.504 INFO:tasks.workunit.client.1.smithi153.stdout:4/183: stat d4/f10 0 2024-02-28T16:24:32.507 INFO:tasks.workunit.client.1.smithi153.stdout:4/184: chown d4/de/d23/d2b/d31 68956561 1 2024-02-28T16:24:32.513 INFO:tasks.workunit.client.1.smithi153.stdout:5/196: symlink da/d29/d43/l4a 0 2024-02-28T16:24:32.514 INFO:tasks.workunit.client.1.smithi153.stdout:3/211: rename f0 to d4/d8/d1e/d2a/d35/f47 0 2024-02-28T16:24:32.515 INFO:tasks.workunit.client.1.smithi153.stdout:8/194: dwrite d0/d12/d15/f18 [0,4194304] 0 2024-02-28T16:24:32.517 INFO:tasks.workunit.client.1.smithi153.stdout:5/197: fsync da/fb 0 2024-02-28T16:24:32.517 INFO:tasks.workunit.client.1.smithi153.stdout:8/195: chown d0/d19 1 1 2024-02-28T16:24:32.528 INFO:tasks.workunit.client.1.smithi153.stdout:8/196: creat d0/d34/f3d x:0 0 0 2024-02-28T16:24:32.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/197: link d0/d15/l16 d0/d15/l4a 0 2024-02-28T16:24:32.531 INFO:tasks.workunit.client.1.smithi153.stdout:6/198: fsync d0/f10 0 2024-02-28T16:24:32.534 INFO:tasks.workunit.client.1.smithi153.stdout:5/198: dwrite da/dd/f13 [0,4194304] 0 2024-02-28T16:24:32.536 INFO:tasks.workunit.client.1.smithi153.stdout:4/185: link d4/de/l2f d4/de/l3d 0 2024-02-28T16:24:32.536 INFO:tasks.workunit.client.1.smithi153.stdout:2/182: sync 2024-02-28T16:24:32.536 INFO:tasks.workunit.client.1.smithi153.stdout:9/153: sync 2024-02-28T16:24:32.538 INFO:tasks.workunit.client.1.smithi153.stdout:5/199: dread - da/dd/f1a zero size 2024-02-28T16:24:32.539 INFO:tasks.workunit.client.1.smithi153.stdout:1/181: rename d0/d3d/c46 to d0/c47 0 2024-02-28T16:24:32.540 INFO:tasks.workunit.client.1.smithi153.stdout:4/186: stat d4/de/f11 0 2024-02-28T16:24:32.546 INFO:tasks.workunit.client.1.smithi153.stdout:5/200: read da/dd/d25/f2e [70134,78192] 0 2024-02-28T16:24:32.548 INFO:tasks.workunit.client.1.smithi153.stdout:3/212: dwrite d4/d8/d1e/f42 [0,4194304] 0 2024-02-28T16:24:32.554 INFO:tasks.workunit.client.1.smithi153.stdout:2/183: mkdir d2/d19/d2a/d3b 0 2024-02-28T16:24:32.555 INFO:tasks.workunit.client.1.smithi153.stdout:2/184: readlink d2/l35 0 2024-02-28T16:24:32.559 INFO:tasks.workunit.client.1.smithi153.stdout:8/197: dwrite d0/d34/f3d [0,4194304] 0 2024-02-28T16:24:32.559 INFO:tasks.workunit.client.1.smithi153.stdout:9/154: dread d1/d5/d27/f30 [0,4194304] 0 2024-02-28T16:24:32.560 INFO:tasks.workunit.client.1.smithi153.stdout:0/211: rename d4/dc/f20 to d4/d27/f4a 0 2024-02-28T16:24:32.563 INFO:tasks.workunit.client.1.smithi153.stdout:4/187: mknod d4/de/d23/c3e 0 2024-02-28T16:24:32.565 INFO:tasks.workunit.client.1.smithi153.stdout:5/201: creat da/d29/f4b x:0 0 0 2024-02-28T16:24:32.565 INFO:tasks.workunit.client.1.smithi153.stdout:4/188: write d4/f5 [1581,51717] 0 2024-02-28T16:24:32.572 INFO:tasks.workunit.client.1.smithi153.stdout:3/213: rename d4/d8/l33 to d4/d8/d26/d41/l48 0 2024-02-28T16:24:32.574 INFO:tasks.workunit.client.1.smithi153.stdout:9/155: dread d1/d5/f19 [0,4194304] 0 2024-02-28T16:24:32.578 INFO:tasks.workunit.client.1.smithi153.stdout:8/198: dread d0/d19/d2b/d2d/f35 [0,4194304] 0 2024-02-28T16:24:32.580 INFO:tasks.workunit.client.1.smithi153.stdout:8/199: write d0/ff [3596079,75596] 0 2024-02-28T16:24:32.582 INFO:tasks.workunit.client.1.smithi153.stdout:8/200: fdatasync d0/d19/f2a 0 2024-02-28T16:24:32.588 INFO:tasks.workunit.client.1.smithi153.stdout:9/156: dwrite d1/f10 [0,4194304] 0 2024-02-28T16:24:32.593 INFO:tasks.workunit.client.1.smithi153.stdout:6/199: truncate d0/d17/f1f 1103763 0 2024-02-28T16:24:32.599 INFO:tasks.workunit.client.1.smithi153.stdout:4/189: rename d4/de/d13/d1b/c3b to d4/de/d23/d2b/d31/c3f 0 2024-02-28T16:24:32.600 INFO:tasks.workunit.client.1.smithi153.stdout:4/190: chown d4/de/d23/c3e 447 1 2024-02-28T16:24:32.602 INFO:tasks.workunit.client.1.smithi153.stdout:4/191: stat d4/de/d13/f20 0 2024-02-28T16:24:32.607 INFO:tasks.workunit.client.1.smithi153.stdout:8/201: mknod d0/d19/d2b/d2d/c3e 0 2024-02-28T16:24:32.608 INFO:tasks.workunit.client.1.smithi153.stdout:9/157: dwrite d1/d5/d11/d1f/d20/d36/f37 [0,4194304] 0 2024-02-28T16:24:32.616 INFO:tasks.workunit.client.1.smithi153.stdout:1/182: truncate d0/dd/f37 1984605 0 2024-02-28T16:24:32.616 INFO:tasks.workunit.client.1.smithi153.stdout:9/158: write d1/d2/f18 [1527827,78733] 0 2024-02-28T16:24:32.616 INFO:tasks.workunit.client.1.smithi153.stdout:3/214: mkdir d4/d49 0 2024-02-28T16:24:32.616 INFO:tasks.workunit.client.1.smithi153.stdout:6/200: mknod d0/d1d/d30/c4b 0 2024-02-28T16:24:32.617 INFO:tasks.workunit.client.1.smithi153.stdout:2/185: truncate d2/f7 3928636 0 2024-02-28T16:24:32.618 INFO:tasks.workunit.client.1.smithi153.stdout:0/212: write d4/f25 [626722,31287] 0 2024-02-28T16:24:32.621 INFO:tasks.workunit.client.1.smithi153.stdout:7/187: sync 2024-02-28T16:24:32.621 INFO:tasks.workunit.client.1.smithi153.stdout:6/201: creat d0/f4c x:0 0 0 2024-02-28T16:24:32.624 INFO:tasks.workunit.client.1.smithi153.stdout:4/192: mkdir d4/de/d40 0 2024-02-28T16:24:32.628 INFO:tasks.workunit.client.1.smithi153.stdout:3/215: creat d4/d8/d26/d41/f4a x:0 0 0 2024-02-28T16:24:32.628 INFO:tasks.workunit.client.1.smithi153.stdout:7/188: chown d1/d25/dc/l1a 3206 1 2024-02-28T16:24:32.632 INFO:tasks.workunit.client.1.smithi153.stdout:3/216: chown d4/d8 456 1 2024-02-28T16:24:32.633 INFO:tasks.workunit.client.1.smithi153.stdout:5/202: dwrite da/dd/d25/d41/f46 [0,4194304] 0 2024-02-28T16:24:32.640 INFO:tasks.workunit.client.1.smithi153.stdout:1/183: dread d0/dd/f29 [0,4194304] 0 2024-02-28T16:24:32.643 INFO:tasks.workunit.client.1.smithi153.stdout:8/202: dwrite d0/d12/d15/f36 [0,4194304] 0 2024-02-28T16:24:32.645 INFO:tasks.workunit.client.1.smithi153.stdout:2/186: dwrite d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:32.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/203: write d0/d19/d2b/f33 [320458,120741] 0 2024-02-28T16:24:32.667 INFO:tasks.workunit.client.1.smithi153.stdout:1/184: dwrite d0/f25 [0,4194304] 0 2024-02-28T16:24:32.704 INFO:tasks.workunit.client.1.smithi153.stdout:7/189: creat d1/d25/dc/f35 x:0 0 0 2024-02-28T16:24:32.705 INFO:tasks.workunit.client.1.smithi153.stdout:7/190: fdatasync d1/f2c 0 2024-02-28T16:24:32.708 INFO:tasks.workunit.client.1.smithi153.stdout:4/193: symlink d4/de/d23/d2b/d31/l41 0 2024-02-28T16:24:32.712 INFO:tasks.workunit.client.1.smithi153.stdout:3/217: rename d4/d8/d26/l46 to d4/d8/d1e/d23/l4b 0 2024-02-28T16:24:32.719 INFO:tasks.workunit.client.1.smithi153.stdout:6/202: dwrite d0/f19 [0,4194304] 0 2024-02-28T16:24:32.719 INFO:tasks.workunit.client.1.smithi153.stdout:8/204: write d0/d19/f38 [1605878,122477] 0 2024-02-28T16:24:32.721 INFO:tasks.workunit.client.1.smithi153.stdout:0/213: creat d4/d1a/f4b x:0 0 0 2024-02-28T16:24:32.724 INFO:tasks.workunit.client.1.smithi153.stdout:8/205: write d0/d12/d15/f29 [490496,7334] 0 2024-02-28T16:24:32.731 INFO:tasks.workunit.client.1.smithi153.stdout:7/191: symlink d1/d25/dc/l36 0 2024-02-28T16:24:32.747 INFO:tasks.workunit.client.1.smithi153.stdout:6/203: mknod d0/d17/c4d 0 2024-02-28T16:24:32.747 INFO:tasks.workunit.client.1.smithi153.stdout:0/214: mknod d4/dc/c4c 0 2024-02-28T16:24:32.752 INFO:tasks.workunit.client.1.smithi153.stdout:6/204: chown d0/d1d/c2f 23 1 2024-02-28T16:24:32.752 INFO:tasks.workunit.client.1.smithi153.stdout:8/206: mkdir d0/d19/d2b/d2d/d3f 0 2024-02-28T16:24:32.753 INFO:tasks.workunit.client.1.smithi153.stdout:5/203: rmdir da/d29/d45 0 2024-02-28T16:24:32.756 INFO:tasks.workunit.client.1.smithi153.stdout:7/192: mknod d1/d25/d27/c37 0 2024-02-28T16:24:32.758 INFO:tasks.workunit.client.1.smithi153.stdout:4/194: dwrite d4/f6 [0,4194304] 0 2024-02-28T16:24:32.762 INFO:tasks.workunit.client.1.smithi153.stdout:4/195: chown d4/de/d23 60200950 1 2024-02-28T16:24:32.764 INFO:tasks.workunit.client.1.smithi153.stdout:0/215: stat d4/f3b 0 2024-02-28T16:24:32.765 INFO:tasks.workunit.client.1.smithi153.stdout:1/185: creat d0/f48 x:0 0 0 2024-02-28T16:24:32.767 INFO:tasks.workunit.client.1.smithi153.stdout:0/216: dread - d4/d1a/f1f zero size 2024-02-28T16:24:32.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/217: fsync d4/dc/f3f 0 2024-02-28T16:24:32.772 INFO:tasks.workunit.client.1.smithi153.stdout:6/205: unlink d0/d15/l1c 0 2024-02-28T16:24:32.775 INFO:tasks.workunit.client.1.smithi153.stdout:8/207: unlink d0/d19/d1e/f20 0 2024-02-28T16:24:32.778 INFO:tasks.workunit.client.1.smithi153.stdout:9/159: sync 2024-02-28T16:24:32.779 INFO:tasks.workunit.client.1.smithi153.stdout:7/193: rename d1/d25/l6 to d1/l38 0 2024-02-28T16:24:32.782 INFO:tasks.workunit.client.1.smithi153.stdout:9/160: write d1/f15 [4725806,6012] 0 2024-02-28T16:24:32.783 INFO:tasks.workunit.client.1.smithi153.stdout:1/186: creat d0/dd/f49 x:0 0 0 2024-02-28T16:24:32.785 INFO:tasks.workunit.client.1.smithi153.stdout:0/218: symlink d4/dc/l4d 0 2024-02-28T16:24:32.786 INFO:tasks.workunit.client.1.smithi153.stdout:1/187: chown d0/d3d/f43 545 1 2024-02-28T16:24:32.790 INFO:tasks.workunit.client.1.smithi153.stdout:6/206: creat d0/d15/d2e/f4e x:0 0 0 2024-02-28T16:24:32.795 INFO:tasks.workunit.client.1.smithi153.stdout:8/208: creat d0/d19/d1e/f40 x:0 0 0 2024-02-28T16:24:32.796 INFO:tasks.workunit.client.1.smithi153.stdout:6/207: read d0/d15/f2c [396846,115679] 0 2024-02-28T16:24:32.798 INFO:tasks.workunit.client.1.smithi153.stdout:6/208: dread - d0/d1d/f47 zero size 2024-02-28T16:24:32.804 INFO:tasks.workunit.client.1.smithi153.stdout:4/196: creat d4/d3c/f42 x:0 0 0 2024-02-28T16:24:32.807 INFO:tasks.workunit.client.1.smithi153.stdout:5/204: creat da/dd/f4c x:0 0 0 2024-02-28T16:24:32.809 INFO:tasks.workunit.client.1.smithi153.stdout:5/205: read da/d29/f30 [2672700,49861] 0 2024-02-28T16:24:32.811 INFO:tasks.workunit.client.1.smithi153.stdout:0/219: mknod d4/dc/c4e 0 2024-02-28T16:24:32.819 INFO:tasks.workunit.client.1.smithi153.stdout:9/161: rename d1/f4 to d1/d5/d11/d1f/d20/d36/f38 0 2024-02-28T16:24:32.819 INFO:tasks.workunit.client.1.smithi153.stdout:9/162: stat d1/d5 0 2024-02-28T16:24:32.820 INFO:tasks.workunit.client.1.smithi153.stdout:8/209: creat d0/d25/f41 x:0 0 0 2024-02-28T16:24:32.823 INFO:tasks.workunit.client.1.smithi153.stdout:9/163: write d1/d5/d11/d1f/d20/d36/f2d [1525990,94234] 0 2024-02-28T16:24:32.824 INFO:tasks.workunit.client.1.smithi153.stdout:7/194: mknod d1/d25/df/d26/c39 0 2024-02-28T16:24:32.834 INFO:tasks.workunit.client.1.smithi153.stdout:4/197: dread d4/f38 [0,4194304] 0 2024-02-28T16:24:32.838 INFO:tasks.workunit.client.1.smithi153.stdout:4/198: dread d4/f38 [0,4194304] 0 2024-02-28T16:24:32.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/210: dread d0/d12/d15/f29 [0,4194304] 0 2024-02-28T16:24:32.844 INFO:tasks.workunit.client.1.smithi153.stdout:4/199: fdatasync d4/de/d23/d2b/d31/f34 0 2024-02-28T16:24:32.855 INFO:tasks.workunit.client.1.smithi153.stdout:9/164: dwrite d1/d2/f32 [0,4194304] 0 2024-02-28T16:24:32.860 INFO:tasks.workunit.client.1.smithi153.stdout:4/200: creat d4/d3c/f43 x:0 0 0 2024-02-28T16:24:32.862 INFO:tasks.workunit.client.1.smithi153.stdout:6/209: getdents d0/d1d/d30 0 2024-02-28T16:24:32.866 INFO:tasks.workunit.client.1.smithi153.stdout:8/211: symlink d0/l42 0 2024-02-28T16:24:32.871 INFO:tasks.workunit.client.1.smithi153.stdout:7/195: dwrite d1/d25/dc/f13 [0,4194304] 0 2024-02-28T16:24:32.875 INFO:tasks.workunit.client.1.smithi153.stdout:4/201: truncate d4/f7 2705711 0 2024-02-28T16:24:32.881 INFO:tasks.workunit.client.1.smithi153.stdout:2/187: link d2/f10 d2/d23/d36/f3c 0 2024-02-28T16:24:32.883 INFO:tasks.workunit.client.1.smithi153.stdout:7/196: mkdir d1/d25/df/d26/d3a 0 2024-02-28T16:24:32.885 INFO:tasks.workunit.client.1.smithi153.stdout:2/188: chown d2/d19/d2a/f2f 236619 1 2024-02-28T16:24:32.889 INFO:tasks.workunit.client.1.smithi153.stdout:2/189: truncate d2/d19/f2c 426423 0 2024-02-28T16:24:32.889 INFO:tasks.workunit.client.1.smithi153.stdout:6/210: link d0/d17/f1f d0/d17/f4f 0 2024-02-28T16:24:32.891 INFO:tasks.workunit.client.1.smithi153.stdout:4/202: dwrite d4/de/f16 [0,4194304] 0 2024-02-28T16:24:32.899 INFO:tasks.workunit.client.1.smithi153.stdout:2/190: chown d2/d19/c27 310 1 2024-02-28T16:24:32.901 INFO:tasks.workunit.client.1.smithi153.stdout:6/211: symlink d0/d15/d48/l50 0 2024-02-28T16:24:32.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/218: dwrite d4/d8/d26/f44 [0,4194304] 0 2024-02-28T16:24:32.908 INFO:tasks.workunit.client.1.smithi153.stdout:3/219: chown d4/d8/d1e/f42 0 1 2024-02-28T16:24:32.911 INFO:tasks.workunit.client.1.smithi153.stdout:7/197: dwrite d1/d25/fe [0,4194304] 0 2024-02-28T16:24:32.916 INFO:tasks.workunit.client.1.smithi153.stdout:6/212: creat d0/d17/f51 x:0 0 0 2024-02-28T16:24:32.918 INFO:tasks.workunit.client.1.smithi153.stdout:3/220: stat d4/f17 0 2024-02-28T16:24:32.928 INFO:tasks.workunit.client.1.smithi153.stdout:2/191: dwrite d2/d19/f38 [0,4194304] 0 2024-02-28T16:24:32.934 INFO:tasks.workunit.client.1.smithi153.stdout:3/221: symlink d4/d13/l4c 0 2024-02-28T16:24:32.935 INFO:tasks.workunit.client.1.smithi153.stdout:2/192: write d2/d23/f24 [1017264,62161] 0 2024-02-28T16:24:32.935 INFO:tasks.workunit.client.1.smithi153.stdout:7/198: rmdir d1/d25/dc/d2b 0 2024-02-28T16:24:32.939 INFO:tasks.workunit.client.1.smithi153.stdout:6/213: dwrite d0/d1d/d23/f3d [0,4194304] 0 2024-02-28T16:24:32.942 INFO:tasks.workunit.client.1.smithi153.stdout:6/214: stat d0/d15/d2e/l32 0 2024-02-28T16:24:32.943 INFO:tasks.workunit.client.1.smithi153.stdout:7/199: unlink d1/d25/dc/f15 0 2024-02-28T16:24:32.955 INFO:tasks.workunit.client.1.smithi153.stdout:2/193: getdents d2 0 2024-02-28T16:24:32.962 INFO:tasks.workunit.client.1.smithi153.stdout:8/212: getdents d0/d19/d1e 0 2024-02-28T16:24:32.963 INFO:tasks.workunit.client.1.smithi153.stdout:6/215: dwrite d0/f19 [4194304,4194304] 0 2024-02-28T16:24:32.968 INFO:tasks.workunit.client.1.smithi153.stdout:6/216: creat d0/f52 x:0 0 0 2024-02-28T16:24:32.971 INFO:tasks.workunit.client.1.smithi153.stdout:8/213: link d0/d19/d2b/d2d/f35 d0/d19/f43 0 2024-02-28T16:24:32.972 INFO:tasks.workunit.client.1.smithi153.stdout:1/188: write d0/f16 [246257,83710] 0 2024-02-28T16:24:32.978 INFO:tasks.workunit.client.1.smithi153.stdout:1/189: mkdir d0/d3d/d4a 0 2024-02-28T16:24:32.979 INFO:tasks.workunit.client.1.smithi153.stdout:8/214: fsync d0/d25/f23 0 2024-02-28T16:24:32.985 INFO:tasks.workunit.client.1.smithi153.stdout:3/222: rename d4/f5 to d4/d8/f4d 0 2024-02-28T16:24:32.985 INFO:tasks.workunit.client.1.smithi153.stdout:1/190: rmdir d0/dd 39 2024-02-28T16:24:32.987 INFO:tasks.workunit.client.1.smithi153.stdout:0/220: truncate d4/fe 442820 0 2024-02-28T16:24:32.994 INFO:tasks.workunit.client.1.smithi153.stdout:0/221: mknod d4/d1a/c4f 0 2024-02-28T16:24:32.995 INFO:tasks.workunit.client.1.smithi153.stdout:9/165: truncate d1/d2/f32 3489006 0 2024-02-28T16:24:32.999 INFO:tasks.workunit.client.1.smithi153.stdout:0/222: chown d4/d27/l41 17443 1 2024-02-28T16:24:33.003 INFO:tasks.workunit.client.1.smithi153.stdout:6/217: fsync d0/d17/f4f 0 2024-02-28T16:24:33.004 INFO:tasks.workunit.client.1.smithi153.stdout:5/206: dwrite da/dd/d25/f32 [0,4194304] 0 2024-02-28T16:24:33.008 INFO:tasks.workunit.client.1.smithi153.stdout:9/166: read d1/d5/fb [144027,88083] 0 2024-02-28T16:24:33.017 INFO:tasks.workunit.client.1.smithi153.stdout:6/218: rename d0/d15/f49 to d0/d15/d2e/f53 0 2024-02-28T16:24:33.017 INFO:tasks.workunit.client.1.smithi153.stdout:0/223: dread d4/f2f [0,4194304] 0 2024-02-28T16:24:33.020 INFO:tasks.workunit.client.1.smithi153.stdout:3/223: dwrite d4/d8/fd [0,4194304] 0 2024-02-28T16:24:33.020 INFO:tasks.workunit.client.1.smithi153.stdout:0/224: dread - d4/d1a/f1d zero size 2024-02-28T16:24:33.024 INFO:tasks.workunit.client.1.smithi153.stdout:4/203: truncate d4/f6 1863492 0 2024-02-28T16:24:33.031 INFO:tasks.workunit.client.1.smithi153.stdout:3/224: creat d4/d2c/f4e x:0 0 0 2024-02-28T16:24:33.036 INFO:tasks.workunit.client.1.smithi153.stdout:9/167: creat d1/d2/f39 x:0 0 0 2024-02-28T16:24:33.041 INFO:tasks.workunit.client.1.smithi153.stdout:5/207: getdents da/dd 0 2024-02-28T16:24:33.045 INFO:tasks.workunit.client.1.smithi153.stdout:6/219: rename d0/d15/l24 to d0/d1d/l54 0 2024-02-28T16:24:33.052 INFO:tasks.workunit.client.1.smithi153.stdout:9/168: dread d1/d5/d11/d1f/d20/d36/f2d [0,4194304] 0 2024-02-28T16:24:33.053 INFO:tasks.workunit.client.1.smithi153.stdout:5/208: rename da/c2d to da/dd/c4d 0 2024-02-28T16:24:33.054 INFO:tasks.workunit.client.1.smithi153.stdout:6/220: mkdir d0/d1d/d30/d55 0 2024-02-28T16:24:33.055 INFO:tasks.workunit.client.1.smithi153.stdout:4/204: link d4/cf d4/de/d13/c44 0 2024-02-28T16:24:33.056 INFO:tasks.workunit.client.1.smithi153.stdout:6/221: truncate d0/d1d/f47 151287 0 2024-02-28T16:24:33.057 INFO:tasks.workunit.client.1.smithi153.stdout:0/225: getdents d4/d32 0 2024-02-28T16:24:33.058 INFO:tasks.workunit.client.1.smithi153.stdout:6/222: rename d0 to d0/d1d/d34/d56 22 2024-02-28T16:24:33.063 INFO:tasks.workunit.client.1.smithi153.stdout:0/226: rename d4/dc/l4d to d4/d32/l50 0 2024-02-28T16:24:33.064 INFO:tasks.workunit.client.1.smithi153.stdout:0/227: read d4/f2f [344826,27359] 0 2024-02-28T16:24:33.067 INFO:tasks.workunit.client.1.smithi153.stdout:6/223: rename d0/d17/f1f to d0/d1d/d23/f57 0 2024-02-28T16:24:33.076 INFO:tasks.workunit.client.1.smithi153.stdout:0/228: rename d4/l3d to d4/l51 0 2024-02-28T16:24:33.080 INFO:tasks.workunit.client.1.smithi153.stdout:7/200: dwrite d1/d25/f7 [0,4194304] 0 2024-02-28T16:24:33.082 INFO:tasks.workunit.client.1.smithi153.stdout:2/194: truncate d2/d25/f2d 3535953 0 2024-02-28T16:24:33.083 INFO:tasks.workunit.client.1.smithi153.stdout:7/201: write d1/d25/f16 [1008897,32591] 0 2024-02-28T16:24:33.083 INFO:tasks.workunit.client.1.smithi153.stdout:2/195: readlink d2/l13 0 2024-02-28T16:24:33.085 INFO:tasks.workunit.client.1.smithi153.stdout:2/196: readlink d2/l13 0 2024-02-28T16:24:33.086 INFO:tasks.workunit.client.1.smithi153.stdout:7/202: read - d1/d25/f33 zero size 2024-02-28T16:24:33.086 INFO:tasks.workunit.client.1.smithi153.stdout:4/205: dread d4/de/d23/f30 [0,4194304] 0 2024-02-28T16:24:33.087 INFO:tasks.workunit.client.1.smithi153.stdout:4/206: stat d4 0 2024-02-28T16:24:33.089 INFO:tasks.workunit.client.1.smithi153.stdout:2/197: creat d2/d25/f3d x:0 0 0 2024-02-28T16:24:33.098 INFO:tasks.workunit.client.1.smithi153.stdout:2/198: unlink d2/d19/l1d 0 2024-02-28T16:24:33.100 INFO:tasks.workunit.client.1.smithi153.stdout:7/203: rename d1/la to d1/d25/dc/l3b 0 2024-02-28T16:24:33.101 INFO:tasks.workunit.client.1.smithi153.stdout:1/191: getdents d0/d3d 0 2024-02-28T16:24:33.103 INFO:tasks.workunit.client.1.smithi153.stdout:7/204: write d1/f2c [769117,102736] 0 2024-02-28T16:24:33.106 INFO:tasks.workunit.client.1.smithi153.stdout:4/207: dwrite d4/f9 [0,4194304] 0 2024-02-28T16:24:33.107 INFO:tasks.workunit.client.1.smithi153.stdout:0/229: dread d4/f14 [0,4194304] 0 2024-02-28T16:24:33.108 INFO:tasks.workunit.client.1.smithi153.stdout:0/230: chown d4/d27 1599035 1 2024-02-28T16:24:33.108 INFO:tasks.workunit.client.1.smithi153.stdout:7/205: mknod d1/c3c 0 2024-02-28T16:24:33.110 INFO:tasks.workunit.client.1.smithi153.stdout:7/206: dread - d1/d25/f2a zero size 2024-02-28T16:24:33.112 INFO:tasks.workunit.client.1.smithi153.stdout:6/224: getdents d0/d15/d2e 0 2024-02-28T16:24:33.112 INFO:tasks.workunit.client.1.smithi153.stdout:7/207: chown d1/d25/c19 0 1 2024-02-28T16:24:33.117 INFO:tasks.workunit.client.1.smithi153.stdout:0/231: write d4/f14 [1367019,66853] 0 2024-02-28T16:24:33.119 INFO:tasks.workunit.client.1.smithi153.stdout:3/225: write d4/d13/f1d [1674650,122167] 0 2024-02-28T16:24:33.119 INFO:tasks.workunit.client.1.smithi153.stdout:0/232: chown d4/dc/f18 685766259 1 2024-02-28T16:24:33.122 INFO:tasks.workunit.client.1.smithi153.stdout:0/233: readlink d4/d27/l41 0 2024-02-28T16:24:33.124 INFO:tasks.workunit.client.1.smithi153.stdout:6/225: creat d0/d1d/d30/f58 x:0 0 0 2024-02-28T16:24:33.127 INFO:tasks.workunit.client.1.smithi153.stdout:4/208: creat d4/de/f45 x:0 0 0 2024-02-28T16:24:33.128 INFO:tasks.workunit.client.1.smithi153.stdout:4/209: fdatasync d4/de/f16 0 2024-02-28T16:24:33.129 INFO:tasks.workunit.client.1.smithi153.stdout:0/234: read - d4/f8 zero size 2024-02-28T16:24:33.134 INFO:tasks.workunit.client.1.smithi153.stdout:2/199: dread d2/f11 [0,4194304] 0 2024-02-28T16:24:33.141 INFO:tasks.workunit.client.1.smithi153.stdout:9/169: dwrite d1/d5/f19 [0,4194304] 0 2024-02-28T16:24:33.145 INFO:tasks.workunit.client.1.smithi153.stdout:9/170: rename d1/d5/d11 to d1/d5/d11/d1f/d3a 22 2024-02-28T16:24:33.145 INFO:tasks.workunit.client.1.smithi153.stdout:0/235: symlink d4/dc/l52 0 2024-02-28T16:24:33.148 INFO:tasks.workunit.client.1.smithi153.stdout:6/226: rmdir d0/d1d/d30/d55 0 2024-02-28T16:24:33.148 INFO:tasks.workunit.client.1.smithi153.stdout:2/200: mkdir d2/d19/d3e 0 2024-02-28T16:24:33.149 INFO:tasks.workunit.client.1.smithi153.stdout:5/209: write da/dd/d25/f2e [1405103,29322] 0 2024-02-28T16:24:33.151 INFO:tasks.workunit.client.1.smithi153.stdout:4/210: link d4/de/f21 d4/de/d40/f46 0 2024-02-28T16:24:33.151 INFO:tasks.workunit.client.1.smithi153.stdout:9/171: stat d1/d5/d27/f30 0 2024-02-28T16:24:33.151 INFO:tasks.workunit.client.1.smithi153.stdout:6/227: dread - d0/d1d/d30/f31 zero size 2024-02-28T16:24:33.151 INFO:tasks.workunit.client.1.smithi153.stdout:2/201: fsync d2/d25/f3d 0 2024-02-28T16:24:33.155 INFO:tasks.workunit.client.1.smithi153.stdout:9/172: truncate d1/d5/f19 5122082 0 2024-02-28T16:24:33.155 INFO:tasks.workunit.client.1.smithi153.stdout:2/202: truncate d2/ff 4240823 0 2024-02-28T16:24:33.155 INFO:tasks.workunit.client.1.smithi153.stdout:0/236: creat d4/f53 x:0 0 0 2024-02-28T16:24:33.156 INFO:tasks.workunit.client.1.smithi153.stdout:1/192: write d0/dd/f29 [556162,128565] 0 2024-02-28T16:24:33.157 INFO:tasks.workunit.client.1.smithi153.stdout:0/237: dread - d4/d32/f48 zero size 2024-02-28T16:24:33.159 INFO:tasks.workunit.client.1.smithi153.stdout:0/238: dread - d4/d1a/f1d zero size 2024-02-28T16:24:33.161 INFO:tasks.workunit.client.1.smithi153.stdout:3/226: truncate d4/d8/d1e/d2a/d35/f39 3407429 0 2024-02-28T16:24:33.162 INFO:tasks.workunit.client.1.smithi153.stdout:9/173: rename d1/f10 to d1/d5/d27/f3b 0 2024-02-28T16:24:33.163 INFO:tasks.workunit.client.1.smithi153.stdout:4/211: truncate d4/f10 669878 0 2024-02-28T16:24:33.172 INFO:tasks.workunit.client.1.smithi153.stdout:3/227: fsync d4/d8/f4d 0 2024-02-28T16:24:33.174 INFO:tasks.workunit.client.1.smithi153.stdout:9/174: chown d1/d5/l7 1 1 2024-02-28T16:24:33.177 INFO:tasks.workunit.client.1.smithi153.stdout:0/239: stat d4/d27/f4a 0 2024-02-28T16:24:33.178 INFO:tasks.workunit.client.1.smithi153.stdout:3/228: creat d4/d8/d26/f4f x:0 0 0 2024-02-28T16:24:33.182 INFO:tasks.workunit.client.1.smithi153.stdout:2/203: truncate d2/d25/f2d 1989717 0 2024-02-28T16:24:33.183 INFO:tasks.workunit.client.1.smithi153.stdout:4/212: mkdir d4/de/d47 0 2024-02-28T16:24:33.186 INFO:tasks.workunit.client.1.smithi153.stdout:0/240: creat d4/d32/f54 x:0 0 0 2024-02-28T16:24:33.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/193: dwrite d0/dd/f1c [0,4194304] 0 2024-02-28T16:24:33.191 INFO:tasks.workunit.client.1.smithi153.stdout:1/194: chown d0/c1a 0 1 2024-02-28T16:24:33.194 INFO:tasks.workunit.client.1.smithi153.stdout:2/204: write d2/f26 [2951646,42084] 0 2024-02-28T16:24:33.194 INFO:tasks.workunit.client.1.smithi153.stdout:4/213: readlink d4/de/l3d 0 2024-02-28T16:24:33.197 INFO:tasks.workunit.client.1.smithi153.stdout:3/229: symlink d4/l50 0 2024-02-28T16:24:33.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/195: creat d0/d3d/f4b x:0 0 0 2024-02-28T16:24:33.203 INFO:tasks.workunit.client.1.smithi153.stdout:1/196: truncate d0/f40 155006 0 2024-02-28T16:24:33.211 INFO:tasks.workunit.client.1.smithi153.stdout:3/230: link d4/d8/d26/f44 d4/d8/d1e/d2a/d35/f51 0 2024-02-28T16:24:33.213 INFO:tasks.workunit.client.1.smithi153.stdout:1/197: mknod d0/c4c 0 2024-02-28T16:24:33.214 INFO:tasks.workunit.client.1.smithi153.stdout:2/205: dwrite d2/d23/f29 [0,4194304] 0 2024-02-28T16:24:33.215 INFO:tasks.workunit.client.1.smithi153.stdout:3/231: dread - d4/d8/d26/d41/f4a zero size 2024-02-28T16:24:33.216 INFO:tasks.workunit.client.1.smithi153.stdout:1/198: symlink d0/dd/l4d 0 2024-02-28T16:24:33.217 INFO:tasks.workunit.client.1.smithi153.stdout:4/214: write d4/f6 [1242816,74861] 0 2024-02-28T16:24:33.222 INFO:tasks.workunit.client.1.smithi153.stdout:3/232: mknod d4/d8/d1e/d23/c52 0 2024-02-28T16:24:33.223 INFO:tasks.workunit.client.1.smithi153.stdout:1/199: chown d0/dd/c2c 328840152 1 2024-02-28T16:24:33.224 INFO:tasks.workunit.client.1.smithi153.stdout:2/206: truncate d2/f7 1837125 0 2024-02-28T16:24:33.227 INFO:tasks.workunit.client.1.smithi153.stdout:3/233: rmdir d4/d8/d26/d41 39 2024-02-28T16:24:33.231 INFO:tasks.workunit.client.1.smithi153.stdout:2/207: mknod d2/d19/c3f 0 2024-02-28T16:24:33.236 INFO:tasks.workunit.client.1.smithi153.stdout:2/208: unlink d2/d19/d31/l33 0 2024-02-28T16:24:33.247 INFO:tasks.workunit.client.1.smithi153.stdout:1/200: write d0/f8 [1358397,97402] 0 2024-02-28T16:24:33.249 INFO:tasks.workunit.client.1.smithi153.stdout:1/201: fdatasync d0/dd/f29 0 2024-02-28T16:24:33.250 INFO:tasks.workunit.client.1.smithi153.stdout:1/202: chown d0/dd/c2a 0 1 2024-02-28T16:24:33.251 INFO:tasks.workunit.client.1.smithi153.stdout:1/203: readlink d0/l2f 0 2024-02-28T16:24:33.255 INFO:tasks.workunit.client.1.smithi153.stdout:1/204: creat d0/d3d/f4e x:0 0 0 2024-02-28T16:24:33.256 INFO:tasks.workunit.client.1.smithi153.stdout:2/209: write d2/f10 [678180,76350] 0 2024-02-28T16:24:33.258 INFO:tasks.workunit.client.1.smithi153.stdout:1/205: creat d0/d3d/f4f x:0 0 0 2024-02-28T16:24:33.258 INFO:tasks.workunit.client.1.smithi153.stdout:2/210: write d2/f26 [4061133,85163] 0 2024-02-28T16:24:33.263 INFO:tasks.workunit.client.1.smithi153.stdout:1/206: rename d0/c45 to d0/dd/c50 0 2024-02-28T16:24:33.264 INFO:tasks.workunit.client.1.smithi153.stdout:4/215: dread d4/de/d13/d1b/f2a [0,4194304] 0 2024-02-28T16:24:33.271 INFO:tasks.workunit.client.1.smithi153.stdout:2/211: write d2/f11 [2582833,106956] 0 2024-02-28T16:24:33.271 INFO:tasks.workunit.client.1.smithi153.stdout:1/207: stat d0/dd/l2e 0 2024-02-28T16:24:33.274 INFO:tasks.workunit.client.1.smithi153.stdout:4/216: chown d4/de/d23/d2b/d31/c3f 91560969 1 2024-02-28T16:24:33.275 INFO:tasks.workunit.client.1.smithi153.stdout:3/234: dread d4/d8/d1e/d23/f24 [0,4194304] 0 2024-02-28T16:24:33.281 INFO:tasks.workunit.client.1.smithi153.stdout:4/217: write d4/de/d23/f30 [2790100,122969] 0 2024-02-28T16:24:33.281 INFO:tasks.workunit.client.1.smithi153.stdout:3/235: symlink d4/d8/d1e/d2a/l53 0 2024-02-28T16:24:33.286 INFO:tasks.workunit.client.1.smithi153.stdout:3/236: mkdir d4/d8/d1e/d2a/d35/d54 0 2024-02-28T16:24:33.290 INFO:tasks.workunit.client.1.smithi153.stdout:2/212: dwrite d2/d19/d2a/f30 [0,4194304] 0 2024-02-28T16:24:33.291 INFO:tasks.workunit.client.1.smithi153.stdout:1/208: dwrite d0/f23 [4194304,4194304] 0 2024-02-28T16:24:33.293 INFO:tasks.workunit.client.1.smithi153.stdout:1/209: fdatasync d0/dd/f34 0 2024-02-28T16:24:33.295 INFO:tasks.workunit.client.1.smithi153.stdout:8/215: sync 2024-02-28T16:24:33.296 INFO:tasks.workunit.client.1.smithi153.stdout:1/210: write d0/dd/f29 [955367,51155] 0 2024-02-28T16:24:33.298 INFO:tasks.workunit.client.1.smithi153.stdout:2/213: creat d2/d19/d31/f40 x:0 0 0 2024-02-28T16:24:33.300 INFO:tasks.workunit.client.1.smithi153.stdout:8/216: read d0/d19/f38 [1316009,16178] 0 2024-02-28T16:24:33.303 INFO:tasks.workunit.client.1.smithi153.stdout:1/211: truncate d0/d3d/f3e 616101 0 2024-02-28T16:24:33.306 INFO:tasks.workunit.client.1.smithi153.stdout:8/217: rename d0/lb to d0/d19/d2b/d2d/d3f/l44 0 2024-02-28T16:24:33.307 INFO:tasks.workunit.client.1.smithi153.stdout:3/237: dread d4/d8/d26/f44 [0,4194304] 0 2024-02-28T16:24:33.312 INFO:tasks.workunit.client.1.smithi153.stdout:8/218: mknod d0/c45 0 2024-02-28T16:24:33.313 INFO:tasks.workunit.client.1.smithi153.stdout:8/219: fsync d0/d19/d1e/f2e 0 2024-02-28T16:24:33.314 INFO:tasks.workunit.client.1.smithi153.stdout:3/238: mkdir d4/d8/d1e/d2a/d55 0 2024-02-28T16:24:33.315 INFO:tasks.workunit.client.1.smithi153.stdout:8/220: symlink d0/d34/l46 0 2024-02-28T16:24:33.319 INFO:tasks.workunit.client.1.smithi153.stdout:8/221: creat d0/d25/f47 x:0 0 0 2024-02-28T16:24:33.324 INFO:tasks.workunit.client.1.smithi153.stdout:8/222: rmdir d0/d19/d1c 39 2024-02-28T16:24:33.328 INFO:tasks.workunit.client.1.smithi153.stdout:2/214: truncate d2/d19/f38 3430047 0 2024-02-28T16:24:33.330 INFO:tasks.workunit.client.1.smithi153.stdout:1/212: truncate d0/f23 2171772 0 2024-02-28T16:24:33.331 INFO:tasks.workunit.client.1.smithi153.stdout:1/213: stat d0/dd/f32 0 2024-02-28T16:24:33.333 INFO:tasks.workunit.client.1.smithi153.stdout:3/239: getdents d4/d8/d1e/d2a/d35 0 2024-02-28T16:24:33.333 INFO:tasks.workunit.client.1.smithi153.stdout:1/214: chown d0/f25 712 1 2024-02-28T16:24:33.341 INFO:tasks.workunit.client.1.smithi153.stdout:2/215: write d2/d25/f2d [472607,21561] 0 2024-02-28T16:24:33.342 INFO:tasks.workunit.client.1.smithi153.stdout:8/223: dwrite d0/d19/d1e/f40 [0,4194304] 0 2024-02-28T16:24:33.346 INFO:tasks.workunit.client.1.smithi153.stdout:1/215: link d0/f41 d0/d3d/d4a/f51 0 2024-02-28T16:24:33.346 INFO:tasks.workunit.client.1.smithi153.stdout:1/216: write d0/dd/f49 [538277,20828] 0 2024-02-28T16:24:33.349 INFO:tasks.workunit.client.1.smithi153.stdout:2/216: symlink d2/d19/l41 0 2024-02-28T16:24:33.349 INFO:tasks.workunit.client.1.smithi153.stdout:3/240: truncate d4/f17 2901946 0 2024-02-28T16:24:33.352 INFO:tasks.workunit.client.1.smithi153.stdout:8/224: write d0/d19/d1c/f2c [435064,80336] 0 2024-02-28T16:24:33.354 INFO:tasks.workunit.client.1.smithi153.stdout:2/217: creat d2/d23/f42 x:0 0 0 2024-02-28T16:24:33.357 INFO:tasks.workunit.client.1.smithi153.stdout:3/241: rename d4/f22 to d4/d13/d28/d36/f56 0 2024-02-28T16:24:33.358 INFO:tasks.workunit.client.1.smithi153.stdout:2/218: fsync d2/f21 0 2024-02-28T16:24:33.368 INFO:tasks.workunit.client.1.smithi153.stdout:8/225: creat d0/d19/f48 x:0 0 0 2024-02-28T16:24:33.370 INFO:tasks.workunit.client.1.smithi153.stdout:8/226: write d0/d19/d1e/f2e [862074,67866] 0 2024-02-28T16:24:33.375 INFO:tasks.workunit.client.1.smithi153.stdout:8/227: mknod d0/d19/d2b/c49 0 2024-02-28T16:24:33.379 INFO:tasks.workunit.client.1.smithi153.stdout:2/219: dwrite d2/f20 [0,4194304] 0 2024-02-28T16:24:33.379 INFO:tasks.workunit.client.1.smithi153.stdout:8/228: mknod d0/d19/d1c/c4a 0 2024-02-28T16:24:33.383 INFO:tasks.workunit.client.1.smithi153.stdout:1/217: dwrite d0/f41 [0,4194304] 0 2024-02-28T16:24:33.383 INFO:tasks.workunit.client.1.smithi153.stdout:2/220: symlink d2/d23/l43 0 2024-02-28T16:24:33.385 INFO:tasks.workunit.client.1.smithi153.stdout:8/229: mknod d0/c4b 0 2024-02-28T16:24:33.389 INFO:tasks.workunit.client.1.smithi153.stdout:2/221: symlink d2/d23/l44 0 2024-02-28T16:24:33.391 INFO:tasks.workunit.client.1.smithi153.stdout:1/218: symlink d0/l52 0 2024-02-28T16:24:33.393 INFO:tasks.workunit.client.1.smithi153.stdout:2/222: creat d2/d19/d2a/f45 x:0 0 0 2024-02-28T16:24:33.394 INFO:tasks.workunit.client.1.smithi153.stdout:8/230: mknod d0/d12/c4c 0 2024-02-28T16:24:33.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/223: write d2/d19/d2a/f2f [6581479,87734] 0 2024-02-28T16:24:33.400 INFO:tasks.workunit.client.1.smithi153.stdout:2/224: chown d2/d19/d2a/f30 1 1 2024-02-28T16:24:33.402 INFO:tasks.workunit.client.1.smithi153.stdout:1/219: link d0/dd/c2a d0/dd/c53 0 2024-02-28T16:24:33.402 INFO:tasks.workunit.client.1.smithi153.stdout:3/242: dwrite d4/d8/d1e/d2a/d35/f39 [0,4194304] 0 2024-02-28T16:24:33.408 INFO:tasks.workunit.client.1.smithi153.stdout:2/225: rename d2/d19/c27 to d2/d19/d3e/c46 0 2024-02-28T16:24:33.410 INFO:tasks.workunit.client.1.smithi153.stdout:2/226: stat d2/d25/f3d 0 2024-02-28T16:24:33.414 INFO:tasks.workunit.client.1.smithi153.stdout:7/208: sync 2024-02-28T16:24:33.415 INFO:tasks.workunit.client.1.smithi153.stdout:1/220: dread d0/d3d/f3e [0,4194304] 0 2024-02-28T16:24:33.416 INFO:tasks.workunit.client.1.smithi153.stdout:8/231: dwrite d0/d25/f23 [4194304,4194304] 0 2024-02-28T16:24:33.417 INFO:tasks.workunit.client.1.smithi153.stdout:1/221: read - d0/dd/f32 zero size 2024-02-28T16:24:33.422 INFO:tasks.workunit.client.1.smithi153.stdout:1/222: symlink d0/d3d/l54 0 2024-02-28T16:24:33.425 INFO:tasks.workunit.client.1.smithi153.stdout:8/232: chown d0/d19/d2b/c49 27714 1 2024-02-28T16:24:33.428 INFO:tasks.workunit.client.1.smithi153.stdout:3/243: dwrite d4/d13/f21 [0,4194304] 0 2024-02-28T16:24:33.431 INFO:tasks.workunit.client.1.smithi153.stdout:1/223: symlink d0/l55 0 2024-02-28T16:24:33.435 INFO:tasks.workunit.client.1.smithi153.stdout:1/224: dread - d0/d3d/f4e zero size 2024-02-28T16:24:33.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/227: dread d2/d19/f38 [0,4194304] 0 2024-02-28T16:24:33.438 INFO:tasks.workunit.client.1.smithi153.stdout:1/225: fdatasync d0/d3d/f4f 0 2024-02-28T16:24:33.438 INFO:tasks.workunit.client.1.smithi153.stdout:8/233: rename d0/d19/d2b/d2d/d3f/l44 to d0/d12/d27/l4d 0 2024-02-28T16:24:33.441 INFO:tasks.workunit.client.1.smithi153.stdout:3/244: getdents d4/d8/d1e/d2a/d35 0 2024-02-28T16:24:33.443 INFO:tasks.workunit.client.1.smithi153.stdout:8/234: readlink d0/d12/d27/d30/l3c 0 2024-02-28T16:24:33.445 INFO:tasks.workunit.client.1.smithi153.stdout:8/235: readlink d0/l5 0 2024-02-28T16:24:33.454 INFO:tasks.workunit.client.1.smithi153.stdout:8/236: getdents d0/d12/d15 0 2024-02-28T16:24:33.456 INFO:tasks.workunit.client.1.smithi153.stdout:8/237: readlink d0/d12/d27/d30/l3c 0 2024-02-28T16:24:33.457 INFO:tasks.workunit.client.1.smithi153.stdout:1/226: dwrite d0/dd/f30 [0,4194304] 0 2024-02-28T16:24:33.461 INFO:tasks.workunit.client.1.smithi153.stdout:1/227: dread d0/f40 [0,4194304] 0 2024-02-28T16:24:33.464 INFO:tasks.workunit.client.1.smithi153.stdout:3/245: dwrite d4/f1f [0,4194304] 0 2024-02-28T16:24:33.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/228: write d0/d3d/f4b [172864,51052] 0 2024-02-28T16:24:33.469 INFO:tasks.workunit.client.1.smithi153.stdout:1/229: truncate d0/dd/f30 4739719 0 2024-02-28T16:24:33.470 INFO:tasks.workunit.client.1.smithi153.stdout:1/230: chown d0/d3d 222137 1 2024-02-28T16:24:33.478 INFO:tasks.workunit.client.1.smithi153.stdout:1/231: creat d0/d3d/d4a/f56 x:0 0 0 2024-02-28T16:24:33.479 INFO:tasks.workunit.client.1.smithi153.stdout:7/209: dread d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:33.479 INFO:tasks.workunit.client.1.smithi153.stdout:8/238: dwrite d0/d12/d27/d30/f3a [0,4194304] 0 2024-02-28T16:24:33.480 INFO:tasks.workunit.client.1.smithi153.stdout:1/232: dread - d0/d3d/f4f zero size 2024-02-28T16:24:33.484 INFO:tasks.workunit.client.1.smithi153.stdout:7/210: write d1/d25/f33 [824188,53843] 0 2024-02-28T16:24:33.486 INFO:tasks.workunit.client.1.smithi153.stdout:1/233: unlink d0/c4c 0 2024-02-28T16:24:33.486 INFO:tasks.workunit.client.1.smithi153.stdout:7/211: read - d1/d25/f2a zero size 2024-02-28T16:24:33.486 INFO:tasks.workunit.client.1.smithi153.stdout:1/234: stat d0/l55 0 2024-02-28T16:24:33.488 INFO:tasks.workunit.client.1.smithi153.stdout:7/212: mknod d1/c3d 0 2024-02-28T16:24:33.488 INFO:tasks.workunit.client.1.smithi153.stdout:1/235: symlink d0/dd/l57 0 2024-02-28T16:24:33.492 INFO:tasks.workunit.client.1.smithi153.stdout:3/246: fdatasync d4/f1f 0 2024-02-28T16:24:33.494 INFO:tasks.workunit.client.1.smithi153.stdout:7/213: rename d1/c31 to d1/c3e 0 2024-02-28T16:24:33.495 INFO:tasks.workunit.client.1.smithi153.stdout:1/236: creat d0/dd/f58 x:0 0 0 2024-02-28T16:24:33.497 INFO:tasks.workunit.client.1.smithi153.stdout:3/247: rename d4/f1b to d4/d2c/f57 0 2024-02-28T16:24:33.499 INFO:tasks.workunit.client.1.smithi153.stdout:1/237: mkdir d0/d3d/d4a/d59 0 2024-02-28T16:24:33.500 INFO:tasks.workunit.client.1.smithi153.stdout:1/238: stat d0/f25 0 2024-02-28T16:24:33.501 INFO:tasks.workunit.client.1.smithi153.stdout:3/248: creat d4/d8/d1e/f58 x:0 0 0 2024-02-28T16:24:33.501 INFO:tasks.workunit.client.1.smithi153.stdout:1/239: readlink d0/d3d/l42 0 2024-02-28T16:24:33.502 INFO:tasks.workunit.client.1.smithi153.stdout:3/249: readlink d4/l50 0 2024-02-28T16:24:33.504 INFO:tasks.workunit.client.1.smithi153.stdout:1/240: creat d0/d3d/d4a/d59/f5a x:0 0 0 2024-02-28T16:24:33.506 INFO:tasks.workunit.client.1.smithi153.stdout:3/250: mknod d4/d8/d1e/d2a/d35/d54/c59 0 2024-02-28T16:24:33.508 INFO:tasks.workunit.client.1.smithi153.stdout:3/251: write d4/d8/f1c [3990849,106725] 0 2024-02-28T16:24:33.511 INFO:tasks.workunit.client.1.smithi153.stdout:3/252: chown d4/d13/d28/d36 102102 1 2024-02-28T16:24:33.513 INFO:tasks.workunit.client.1.smithi153.stdout:7/214: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:24:33.515 INFO:tasks.workunit.client.1.smithi153.stdout:3/253: creat d4/d2c/f5a x:0 0 0 2024-02-28T16:24:33.517 INFO:tasks.workunit.client.1.smithi153.stdout:8/239: dread d0/ff [0,4194304] 0 2024-02-28T16:24:33.519 INFO:tasks.workunit.client.1.smithi153.stdout:7/215: mkdir d1/d25/df/d26/d3a/d3f 0 2024-02-28T16:24:33.520 INFO:tasks.workunit.client.1.smithi153.stdout:1/241: dread d0/f41 [0,4194304] 0 2024-02-28T16:24:33.526 INFO:tasks.workunit.client.1.smithi153.stdout:3/254: read d4/f17 [983820,121235] 0 2024-02-28T16:24:33.528 INFO:tasks.workunit.client.1.smithi153.stdout:8/240: rename d0/d25/f23 to d0/d12/d27/f4e 0 2024-02-28T16:24:33.532 INFO:tasks.workunit.client.1.smithi153.stdout:7/216: dread d1/d25/f7 [0,4194304] 0 2024-02-28T16:24:33.534 INFO:tasks.workunit.client.1.smithi153.stdout:1/242: rename d0/dd/f2b to d0/d3d/d4a/f5b 0 2024-02-28T16:24:33.535 INFO:tasks.workunit.client.1.smithi153.stdout:8/241: mknod d0/d19/d1c/c4f 0 2024-02-28T16:24:33.537 INFO:tasks.workunit.client.1.smithi153.stdout:7/217: symlink d1/d25/df/d26/l40 0 2024-02-28T16:24:33.538 INFO:tasks.workunit.client.1.smithi153.stdout:7/218: read d1/f2c [3647702,83555] 0 2024-02-28T16:24:33.542 INFO:tasks.workunit.client.1.smithi153.stdout:8/242: mkdir d0/d34/d50 0 2024-02-28T16:24:33.545 INFO:tasks.workunit.client.1.smithi153.stdout:3/255: rename d4/d8/d1e/c31 to d4/d13/d28/d36/c5b 0 2024-02-28T16:24:33.548 INFO:tasks.workunit.client.1.smithi153.stdout:8/243: write d0/ff [4538632,126596] 0 2024-02-28T16:24:33.549 INFO:tasks.workunit.client.1.smithi153.stdout:8/244: chown d0/f8 428552111 1 2024-02-28T16:24:33.550 INFO:tasks.workunit.client.1.smithi153.stdout:1/243: truncate d0/f41 1993097 0 2024-02-28T16:24:33.552 INFO:tasks.workunit.client.1.smithi153.stdout:1/244: chown d0/dd/c1b 59918 1 2024-02-28T16:24:33.552 INFO:tasks.workunit.client.1.smithi153.stdout:3/256: rmdir d4/d8/d1e/d2a 39 2024-02-28T16:24:33.556 INFO:tasks.workunit.client.1.smithi153.stdout:7/219: rename d1/c3e to d1/d25/df/d26/d3a/c41 0 2024-02-28T16:24:33.559 INFO:tasks.workunit.client.1.smithi153.stdout:1/245: symlink d0/d3d/l5c 0 2024-02-28T16:24:33.560 INFO:tasks.workunit.client.1.smithi153.stdout:1/246: chown d0/dd/c26 0 1 2024-02-28T16:24:33.562 INFO:tasks.workunit.client.1.smithi153.stdout:5/210: sync 2024-02-28T16:24:33.565 INFO:tasks.workunit.client.1.smithi153.stdout:5/211: truncate da/f35 1157601 0 2024-02-28T16:24:33.566 INFO:tasks.workunit.client.1.smithi153.stdout:7/220: rename d1/c3c to d1/c42 0 2024-02-28T16:24:33.567 INFO:tasks.workunit.client.1.smithi153.stdout:1/247: creat d0/dd/f5d x:0 0 0 2024-02-28T16:24:33.568 INFO:tasks.workunit.client.1.smithi153.stdout:7/221: write d1/d25/dc/f35 [1044715,43504] 0 2024-02-28T16:24:33.574 INFO:tasks.workunit.client.1.smithi153.stdout:8/245: rename d0/f17 to d0/f51 0 2024-02-28T16:24:33.575 INFO:tasks.workunit.client.1.smithi153.stdout:5/212: rename da to da/d4e 22 2024-02-28T16:24:33.576 INFO:tasks.workunit.client.1.smithi153.stdout:7/222: readlink d1/d25/dc/l21 0 2024-02-28T16:24:33.576 INFO:tasks.workunit.client.1.smithi153.stdout:8/246: dread - d0/d25/f47 zero size 2024-02-28T16:24:33.578 INFO:tasks.workunit.client.1.smithi153.stdout:7/223: write d1/d25/dc/f35 [1867863,98647] 0 2024-02-28T16:24:33.579 INFO:tasks.workunit.client.1.smithi153.stdout:1/248: dread d0/f8 [0,4194304] 0 2024-02-28T16:24:33.581 INFO:tasks.workunit.client.1.smithi153.stdout:8/247: symlink d0/d12/d15/l52 0 2024-02-28T16:24:33.581 INFO:tasks.workunit.client.1.smithi153.stdout:3/257: dread d4/d8/f1c [0,4194304] 0 2024-02-28T16:24:33.583 INFO:tasks.workunit.client.1.smithi153.stdout:8/248: readlink d0/d12/d27/d30/l3c 0 2024-02-28T16:24:33.583 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:33 smithi153 ceph-mon[35341]: pgmap v6: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:33.587 INFO:tasks.workunit.client.1.smithi153.stdout:3/258: link d4/d8/f10 d4/d13/d28/d36/f5c 0 2024-02-28T16:24:33.587 INFO:tasks.workunit.client.1.smithi153.stdout:3/259: stat d4/d13/f1d 0 2024-02-28T16:24:33.589 INFO:tasks.workunit.client.1.smithi153.stdout:8/249: link d0/d25/f41 d0/d19/d1e/f53 0 2024-02-28T16:24:33.593 INFO:tasks.workunit.client.1.smithi153.stdout:3/260: symlink d4/d8/d26/d41/l5d 0 2024-02-28T16:24:33.594 INFO:tasks.workunit.client.1.smithi153.stdout:8/250: creat d0/d19/d2b/f54 x:0 0 0 2024-02-28T16:24:33.594 INFO:tasks.workunit.client.1.smithi153.stdout:3/261: stat d4/d2c/c2e 0 2024-02-28T16:24:33.596 INFO:tasks.workunit.client.1.smithi153.stdout:1/249: dwrite d0/d3d/d4a/d59/f5a [0,4194304] 0 2024-02-28T16:24:33.598 INFO:tasks.workunit.client.1.smithi153.stdout:1/250: chown d0/d3d/d4a/d59/f5a 379096 1 2024-02-28T16:24:33.600 INFO:tasks.workunit.client.1.smithi153.stdout:3/262: readlink d4/d8/d1e/d2a/l30 0 2024-02-28T16:24:33.600 INFO:tasks.workunit.client.1.smithi153.stdout:1/251: stat d0/dd/f1c 0 2024-02-28T16:24:33.601 INFO:tasks.workunit.client.1.smithi153.stdout:7/224: truncate d1/f23 3510354 0 2024-02-28T16:24:33.603 INFO:tasks.workunit.client.1.smithi153.stdout:8/251: symlink d0/d12/d15/l55 0 2024-02-28T16:24:33.606 INFO:tasks.workunit.client.1.smithi153.stdout:8/252: chown d0/d19/f48 873820953 1 2024-02-28T16:24:33.606 INFO:tasks.workunit.client.1.smithi153.stdout:1/252: symlink d0/d3d/d4a/d59/l5e 0 2024-02-28T16:24:33.607 INFO:tasks.workunit.client.1.smithi153.stdout:7/225: mkdir d1/d25/d27/d43 0 2024-02-28T16:24:33.609 INFO:tasks.workunit.client.1.smithi153.stdout:6/228: sync 2024-02-28T16:24:33.609 INFO:tasks.workunit.client.1.smithi153.stdout:9/175: sync 2024-02-28T16:24:33.609 INFO:tasks.workunit.client.1.smithi153.stdout:2/228: sync 2024-02-28T16:24:33.610 INFO:tasks.workunit.client.1.smithi153.stdout:0/241: sync 2024-02-28T16:24:33.610 INFO:tasks.workunit.client.1.smithi153.stdout:4/218: sync 2024-02-28T16:24:33.611 INFO:tasks.workunit.client.1.smithi153.stdout:8/253: mknod d0/d34/d50/c56 0 2024-02-28T16:24:33.611 INFO:tasks.workunit.client.1.smithi153.stdout:2/229: fdatasync d2/f21 0 2024-02-28T16:24:33.619 INFO:tasks.workunit.client.1.smithi153.stdout:4/219: write d4/de/f45 [693522,67319] 0 2024-02-28T16:24:33.619 INFO:tasks.workunit.client.1.smithi153.stdout:9/176: fdatasync d1/d5/fb 0 2024-02-28T16:24:33.619 INFO:tasks.workunit.client.1.smithi153.stdout:6/229: creat d0/d1d/d23/f59 x:0 0 0 2024-02-28T16:24:33.620 INFO:tasks.workunit.client.1.smithi153.stdout:8/254: truncate d0/d25/f41 186359 0 2024-02-28T16:24:33.620 INFO:tasks.workunit.client.1.smithi153.stdout:9/177: write d1/d2/f39 [751833,38208] 0 2024-02-28T16:24:33.620 INFO:tasks.workunit.client.1.smithi153.stdout:2/230: rename d2/d23/f24 to d2/d19/d2a/f47 0 2024-02-28T16:24:33.625 INFO:tasks.workunit.client.1.smithi153.stdout:2/231: fsync d2/d23/f42 0 2024-02-28T16:24:33.629 INFO:tasks.workunit.client.1.smithi153.stdout:4/220: link d4/de/f16 d4/de/d23/f48 0 2024-02-28T16:24:33.630 INFO:tasks.workunit.client.1.smithi153.stdout:7/226: dread d1/d25/dc/f13 [0,4194304] 0 2024-02-28T16:24:33.632 INFO:tasks.workunit.client.1.smithi153.stdout:3/263: dread d4/f18 [0,4194304] 0 2024-02-28T16:24:33.636 INFO:tasks.workunit.client.1.smithi153.stdout:0/242: dwrite d4/f53 [0,4194304] 0 2024-02-28T16:24:33.639 INFO:tasks.workunit.client.1.smithi153.stdout:7/227: symlink d1/d25/d27/d43/l44 0 2024-02-28T16:24:33.645 INFO:tasks.workunit.client.1.smithi153.stdout:2/232: dread d2/f20 [0,4194304] 0 2024-02-28T16:24:33.646 INFO:tasks.workunit.client.1.smithi153.stdout:6/230: dwrite d0/d15/d2e/f37 [0,4194304] 0 2024-02-28T16:24:33.647 INFO:tasks.workunit.client.1.smithi153.stdout:2/233: stat d2/d23/f42 0 2024-02-28T16:24:33.649 INFO:tasks.workunit.client.1.smithi153.stdout:9/178: dwrite d1/d5/d11/d1f/d20/d36/f37 [0,4194304] 0 2024-02-28T16:24:33.650 INFO:tasks.workunit.client.1.smithi153.stdout:6/231: write d0/f45 [952739,118675] 0 2024-02-28T16:24:33.651 INFO:tasks.workunit.client.1.smithi153.stdout:7/228: symlink d1/d25/dc/l45 0 2024-02-28T16:24:33.654 INFO:tasks.workunit.client.1.smithi153.stdout:3/264: rename d4/d13/d28/d36/f5c to d4/d8/d1e/f5e 0 2024-02-28T16:24:33.658 INFO:tasks.workunit.client.1.smithi153.stdout:2/234: truncate d2/d19/d31/f40 687523 0 2024-02-28T16:24:33.658 INFO:tasks.workunit.client.1.smithi153.stdout:0/243: dread d4/f14 [0,4194304] 0 2024-02-28T16:24:33.660 INFO:tasks.workunit.client.1.smithi153.stdout:0/244: readlink d4/d27/l41 0 2024-02-28T16:24:33.662 INFO:tasks.workunit.client.1.smithi153.stdout:6/232: rename d0/f8 to d0/d15/d2e/f5a 0 2024-02-28T16:24:33.662 INFO:tasks.workunit.client.1.smithi153.stdout:9/179: mknod d1/d5/d27/c3c 0 2024-02-28T16:24:33.664 INFO:tasks.workunit.client.1.smithi153.stdout:6/233: chown d0/l12 1840161542 1 2024-02-28T16:24:33.677 INFO:tasks.workunit.client.1.smithi153.stdout:2/235: dwrite d2/d25/f3d [0,4194304] 0 2024-02-28T16:24:33.682 INFO:tasks.workunit.client.1.smithi153.stdout:3/265: rename d4/f20 to d4/d8/d1e/d2a/d35/f5f 0 2024-02-28T16:24:33.689 INFO:tasks.workunit.client.1.smithi153.stdout:2/236: unlink d2/d23/c2e 0 2024-02-28T16:24:33.691 INFO:tasks.workunit.client.1.smithi153.stdout:6/234: rename d0/d17/f51 to d0/d15/d2e/f5b 0 2024-02-28T16:24:33.693 INFO:tasks.workunit.client.1.smithi153.stdout:0/245: link d4/f34 d4/d27/f55 0 2024-02-28T16:24:33.694 INFO:tasks.workunit.client.1.smithi153.stdout:9/180: getdents d1/d5/d27 0 2024-02-28T16:24:33.695 INFO:tasks.workunit.client.1.smithi153.stdout:6/235: chown d0/d15/f3a 903319693 1 2024-02-28T16:24:33.696 INFO:tasks.workunit.client.1.smithi153.stdout:2/237: mkdir d2/d23/d48 0 2024-02-28T16:24:33.698 INFO:tasks.workunit.client.1.smithi153.stdout:0/246: write d4/d27/f44 [34421,85735] 0 2024-02-28T16:24:33.700 INFO:tasks.workunit.client.1.smithi153.stdout:2/238: write d2/f26 [4786924,20750] 0 2024-02-28T16:24:33.704 INFO:tasks.workunit.client.1.smithi153.stdout:7/229: dwrite d1/f23 [0,4194304] 0 2024-02-28T16:24:33.708 INFO:tasks.workunit.client.1.smithi153.stdout:0/247: symlink d4/d32/l56 0 2024-02-28T16:24:33.714 INFO:tasks.workunit.client.1.smithi153.stdout:7/230: mknod d1/d25/d27/d43/c46 0 2024-02-28T16:24:33.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/181: creat d1/d2/f3d x:0 0 0 2024-02-28T16:24:33.722 INFO:tasks.workunit.client.1.smithi153.stdout:0/248: symlink d4/d1a/l57 0 2024-02-28T16:24:33.726 INFO:tasks.workunit.client.1.smithi153.stdout:7/231: creat d1/d25/df/f47 x:0 0 0 2024-02-28T16:24:33.727 INFO:tasks.workunit.client.1.smithi153.stdout:2/239: dwrite d2/f10 [0,4194304] 0 2024-02-28T16:24:33.728 INFO:tasks.workunit.client.1.smithi153.stdout:9/182: unlink d1/f2e 0 2024-02-28T16:24:33.733 INFO:tasks.workunit.client.1.smithi153.stdout:6/236: dread d0/fb [0,4194304] 0 2024-02-28T16:24:33.736 INFO:tasks.workunit.client.1.smithi153.stdout:7/232: creat d1/d25/df/f48 x:0 0 0 2024-02-28T16:24:33.740 INFO:tasks.workunit.client.1.smithi153.stdout:3/266: dread d4/d13/d28/f2f [0,4194304] 0 2024-02-28T16:24:33.744 INFO:tasks.workunit.client.1.smithi153.stdout:9/183: write d1/d2/f25 [5149550,45074] 0 2024-02-28T16:24:33.746 INFO:tasks.workunit.client.1.smithi153.stdout:7/233: truncate d1/f2c 4704037 0 2024-02-28T16:24:33.747 INFO:tasks.workunit.client.1.smithi153.stdout:9/184: chown d1/d5/d11/d1f/d20/d36/f2d 22813286 1 2024-02-28T16:24:33.750 INFO:tasks.workunit.client.1.smithi153.stdout:3/267: mknod d4/d2c/c60 0 2024-02-28T16:24:33.756 INFO:tasks.workunit.client.1.smithi153.stdout:9/185: rmdir d1/d5/d11/d1f 39 2024-02-28T16:24:33.756 INFO:tasks.workunit.client.1.smithi153.stdout:0/249: getdents d4/d27 0 2024-02-28T16:24:33.760 INFO:tasks.workunit.client.1.smithi153.stdout:2/240: dwrite d2/d19/f38 [0,4194304] 0 2024-02-28T16:24:33.762 INFO:tasks.workunit.client.1.smithi153.stdout:2/241: fsync d2/f11 0 2024-02-28T16:24:33.767 INFO:tasks.workunit.client.1.smithi153.stdout:6/237: write d0/d15/d2e/f5a [2088754,51770] 0 2024-02-28T16:24:33.771 INFO:tasks.workunit.client.1.smithi153.stdout:7/234: dwrite d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:33.771 INFO:tasks.workunit.client.1.smithi153.stdout:2/242: mkdir d2/d25/d49 0 2024-02-28T16:24:33.772 INFO:tasks.workunit.client.1.smithi153.stdout:6/238: truncate d0/d15/d2e/f4e 94808 0 2024-02-28T16:24:33.778 INFO:tasks.workunit.client.1.smithi153.stdout:9/186: dwrite d1/f34 [0,4194304] 0 2024-02-28T16:24:33.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/250: link d4/dc/c49 d4/c58 0 2024-02-28T16:24:33.780 INFO:tasks.workunit.client.1.smithi153.stdout:6/239: mknod d0/d15/c5c 0 2024-02-28T16:24:33.787 INFO:tasks.workunit.client.1.smithi153.stdout:2/243: getdents d2/d25/d49 0 2024-02-28T16:24:33.789 INFO:tasks.workunit.client.1.smithi153.stdout:6/240: mkdir d0/d1d/d5d 0 2024-02-28T16:24:33.791 INFO:tasks.workunit.client.1.smithi153.stdout:6/241: dread - d0/d1d/d30/f36 zero size 2024-02-28T16:24:33.794 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:33 smithi023 ceph-mon[29137]: pgmap v6: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-02-28T16:24:33.794 INFO:tasks.workunit.client.1.smithi153.stdout:0/251: mknod d4/d1a/c59 0 2024-02-28T16:24:33.795 INFO:tasks.workunit.client.1.smithi153.stdout:6/242: write d0/f4c [833861,90942] 0 2024-02-28T16:24:33.795 INFO:tasks.workunit.client.1.smithi153.stdout:3/268: dwrite d4/d8/d1e/d2a/d35/f5f [0,4194304] 0 2024-02-28T16:24:33.798 INFO:tasks.workunit.client.1.smithi153.stdout:2/244: dread d2/d19/d31/f40 [0,4194304] 0 2024-02-28T16:24:33.800 INFO:tasks.workunit.client.1.smithi153.stdout:6/243: write d0/d15/f2c [4290766,45119] 0 2024-02-28T16:24:33.809 INFO:tasks.workunit.client.1.smithi153.stdout:9/187: truncate d1/d5/fb 3912231 0 2024-02-28T16:24:33.809 INFO:tasks.workunit.client.1.smithi153.stdout:7/235: write d1/f2c [820028,128458] 0 2024-02-28T16:24:33.811 INFO:tasks.workunit.client.1.smithi153.stdout:0/252: creat d4/d27/f5a x:0 0 0 2024-02-28T16:24:33.813 INFO:tasks.workunit.client.1.smithi153.stdout:3/269: dread d4/d8/d1e/d2a/d35/f51 [0,4194304] 0 2024-02-28T16:24:33.814 INFO:tasks.workunit.client.1.smithi153.stdout:2/245: mknod d2/d19/c4a 0 2024-02-28T16:24:33.821 INFO:tasks.workunit.client.1.smithi153.stdout:0/253: chown d4/c16 1729 1 2024-02-28T16:24:33.821 INFO:tasks.workunit.client.1.smithi153.stdout:2/246: mkdir d2/d4b 0 2024-02-28T16:24:33.822 INFO:tasks.workunit.client.1.smithi153.stdout:0/254: stat d4/d1a/l29 0 2024-02-28T16:24:33.823 INFO:tasks.workunit.client.1.smithi153.stdout:2/247: stat d2/d19/d3e 0 2024-02-28T16:24:33.825 INFO:tasks.workunit.client.1.smithi153.stdout:2/248: fsync d2/f7 0 2024-02-28T16:24:33.825 INFO:tasks.workunit.client.1.smithi153.stdout:9/188: creat d1/d5/d11/d1f/d20/f3e x:0 0 0 2024-02-28T16:24:33.828 INFO:tasks.workunit.client.1.smithi153.stdout:3/270: write d4/d8/f4d [4865424,16733] 0 2024-02-28T16:24:33.828 INFO:tasks.workunit.client.1.smithi153.stdout:9/189: stat d1/d5/d11/d1f/c23 0 2024-02-28T16:24:33.830 INFO:tasks.workunit.client.1.smithi153.stdout:3/271: fsync d4/f1f 0 2024-02-28T16:24:33.831 INFO:tasks.workunit.client.1.smithi153.stdout:7/236: rename d1/d25/dc/f13 to d1/d25/f49 0 2024-02-28T16:24:33.834 INFO:tasks.workunit.client.1.smithi153.stdout:6/244: dwrite d0/d15/d2e/f5b [0,4194304] 0 2024-02-28T16:24:33.834 INFO:tasks.workunit.client.1.smithi153.stdout:7/237: fsync d1/d25/f16 0 2024-02-28T16:24:33.837 INFO:tasks.workunit.client.1.smithi153.stdout:0/255: link d4/f45 d4/d32/f5b 0 2024-02-28T16:24:33.838 INFO:tasks.workunit.client.1.smithi153.stdout:6/245: write d0/d15/d2e/f5a [2088389,79717] 0 2024-02-28T16:24:33.839 INFO:tasks.workunit.client.1.smithi153.stdout:9/190: symlink d1/l3f 0 2024-02-28T16:24:33.839 INFO:tasks.workunit.client.1.smithi153.stdout:3/272: mknod d4/d8/d1e/c61 0 2024-02-28T16:24:33.839 INFO:tasks.workunit.client.1.smithi153.stdout:0/256: read - d4/d1a/f1d zero size 2024-02-28T16:24:33.843 INFO:tasks.workunit.client.1.smithi153.stdout:7/238: rename d1/d25/f2a to d1/d25/d27/d43/f4a 0 2024-02-28T16:24:33.844 INFO:tasks.workunit.client.1.smithi153.stdout:6/246: creat d0/d1d/d30/f5e x:0 0 0 2024-02-28T16:24:33.847 INFO:tasks.workunit.client.1.smithi153.stdout:3/273: write d4/d8/f10 [5221861,33565] 0 2024-02-28T16:24:33.847 INFO:tasks.workunit.client.1.smithi153.stdout:9/191: truncate d1/d2/f18 2074117 0 2024-02-28T16:24:33.847 INFO:tasks.workunit.client.1.smithi153.stdout:7/239: truncate d1/d25/f16 4434708 0 2024-02-28T16:24:33.850 INFO:tasks.workunit.client.1.smithi153.stdout:7/240: write d1/d25/f9 [2899223,46842] 0 2024-02-28T16:24:33.853 INFO:tasks.workunit.client.1.smithi153.stdout:3/274: rmdir d4/d2c 39 2024-02-28T16:24:33.853 INFO:tasks.workunit.client.1.smithi153.stdout:5/213: sync 2024-02-28T16:24:33.853 INFO:tasks.workunit.client.1.smithi153.stdout:6/247: chown d0/d15/l4a 154 1 2024-02-28T16:24:33.855 INFO:tasks.workunit.client.1.smithi153.stdout:5/214: dread - da/f27 zero size 2024-02-28T16:24:33.857 INFO:tasks.workunit.client.1.smithi153.stdout:5/215: write da/d29/f30 [572923,20279] 0 2024-02-28T16:24:33.859 INFO:tasks.workunit.client.1.smithi153.stdout:2/249: dread d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:33.859 INFO:tasks.workunit.client.1.smithi153.stdout:6/248: getdents d0/d15/d48 0 2024-02-28T16:24:33.861 INFO:tasks.workunit.client.1.smithi153.stdout:7/241: link d1/d25/df/d26/l40 d1/d25/df/d26/d3a/d3f/l4b 0 2024-02-28T16:24:33.862 INFO:tasks.workunit.client.1.smithi153.stdout:5/216: creat da/d29/d43/f4f x:0 0 0 2024-02-28T16:24:33.862 INFO:tasks.workunit.client.1.smithi153.stdout:6/249: dread - d0/d1d/d30/f5e zero size 2024-02-28T16:24:33.865 INFO:tasks.workunit.client.1.smithi153.stdout:6/250: fsync d0/f10 0 2024-02-28T16:24:33.865 INFO:tasks.workunit.client.1.smithi153.stdout:7/242: write d1/d25/f33 [887112,12531] 0 2024-02-28T16:24:33.872 INFO:tasks.workunit.client.1.smithi153.stdout:2/250: link d2/d25/l39 d2/d25/l4c 0 2024-02-28T16:24:33.874 INFO:tasks.workunit.client.1.smithi153.stdout:6/251: dread d0/f4c [0,4194304] 0 2024-02-28T16:24:33.874 INFO:tasks.workunit.client.1.smithi153.stdout:5/217: link da/dd/d25/f36 da/dd/d25/d41/f50 0 2024-02-28T16:24:33.876 INFO:tasks.workunit.client.1.smithi153.stdout:6/252: fsync d0/d17/f28 0 2024-02-28T16:24:33.881 INFO:tasks.workunit.client.1.smithi153.stdout:2/251: link d2/d19/c1b d2/d19/d2a/c4d 0 2024-02-28T16:24:33.882 INFO:tasks.workunit.client.1.smithi153.stdout:7/243: dread d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:33.883 INFO:tasks.workunit.client.1.smithi153.stdout:6/253: link d0/l2 d0/l5f 0 2024-02-28T16:24:33.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/192: dread d1/d5/fb [0,4194304] 0 2024-02-28T16:24:33.886 INFO:tasks.workunit.client.1.smithi153.stdout:7/244: creat d1/d25/d27/f4c x:0 0 0 2024-02-28T16:24:33.886 INFO:tasks.workunit.client.1.smithi153.stdout:9/193: dread - d1/d5/d11/d1f/d20/f3e zero size 2024-02-28T16:24:33.886 INFO:tasks.workunit.client.1.smithi153.stdout:2/252: creat d2/d19/d2a/d3b/f4e x:0 0 0 2024-02-28T16:24:33.888 INFO:tasks.workunit.client.1.smithi153.stdout:6/254: rename d0/d46 to d0/d1d/d23/d60 0 2024-02-28T16:24:33.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/194: mkdir d1/d5/d11/d1f/d40 0 2024-02-28T16:24:33.893 INFO:tasks.workunit.client.1.smithi153.stdout:6/255: unlink d0/f4c 0 2024-02-28T16:24:33.894 INFO:tasks.workunit.client.1.smithi153.stdout:5/218: truncate da/fc 745798 0 2024-02-28T16:24:33.895 INFO:tasks.workunit.client.1.smithi153.stdout:5/219: fdatasync da/dd/d25/d41/f49 0 2024-02-28T16:24:33.895 INFO:tasks.workunit.client.1.smithi153.stdout:9/195: rename d1/d2/f39 to d1/d5/d27/f41 0 2024-02-28T16:24:33.896 INFO:tasks.workunit.client.1.smithi153.stdout:6/256: truncate d0/d1d/d23/f57 2016629 0 2024-02-28T16:24:33.896 INFO:tasks.workunit.client.1.smithi153.stdout:7/245: fsync d1/d25/d27/f4c 0 2024-02-28T16:24:33.896 INFO:tasks.workunit.client.1.smithi153.stdout:9/196: chown d1 6 1 2024-02-28T16:24:33.897 INFO:tasks.workunit.client.1.smithi153.stdout:2/253: fsync d2/d19/d2a/d3b/f4e 0 2024-02-28T16:24:33.898 INFO:tasks.workunit.client.1.smithi153.stdout:7/246: dread - d1/d25/df/f47 zero size 2024-02-28T16:24:33.898 INFO:tasks.workunit.client.1.smithi153.stdout:6/257: write d0/d1d/d30/f36 [1031723,44248] 0 2024-02-28T16:24:33.898 INFO:tasks.workunit.client.1.smithi153.stdout:9/197: chown d1/d5/fb 76745 1 2024-02-28T16:24:33.902 INFO:tasks.workunit.client.1.smithi153.stdout:7/247: write d1/d25/d27/f4c [731333,108368] 0 2024-02-28T16:24:33.904 INFO:tasks.workunit.client.1.smithi153.stdout:7/248: write d1/d25/f33 [29172,32210] 0 2024-02-28T16:24:33.906 INFO:tasks.workunit.client.1.smithi153.stdout:2/254: getdents d2/d23/d48 0 2024-02-28T16:24:33.909 INFO:tasks.workunit.client.1.smithi153.stdout:6/258: symlink d0/d1d/d5d/l61 0 2024-02-28T16:24:33.910 INFO:tasks.workunit.client.1.smithi153.stdout:6/259: stat d0/d1d/d23/f26 0 2024-02-28T16:24:33.911 INFO:tasks.workunit.client.1.smithi153.stdout:6/260: chown d0/f45 1329 1 2024-02-28T16:24:33.912 INFO:tasks.workunit.client.1.smithi153.stdout:9/198: creat d1/d2a/f42 x:0 0 0 2024-02-28T16:24:33.916 INFO:tasks.workunit.client.1.smithi153.stdout:2/255: dread d2/f10 [0,4194304] 0 2024-02-28T16:24:33.918 INFO:tasks.workunit.client.1.smithi153.stdout:5/220: write da/dd/d25/d41/f50 [2280573,96581] 0 2024-02-28T16:24:33.921 INFO:tasks.workunit.client.1.smithi153.stdout:6/261: mknod d0/d1d/d34/c62 0 2024-02-28T16:24:33.923 INFO:tasks.workunit.client.1.smithi153.stdout:6/262: write d0/d1d/d23/f3d [3430508,30442] 0 2024-02-28T16:24:33.925 INFO:tasks.workunit.client.1.smithi153.stdout:9/199: mkdir d1/d5/d11/d1f/d43 0 2024-02-28T16:24:33.931 INFO:tasks.workunit.client.1.smithi153.stdout:7/249: write d1/d25/f16 [14431,73787] 0 2024-02-28T16:24:33.933 INFO:tasks.workunit.client.1.smithi153.stdout:6/263: mkdir d0/d15/d48/d63 0 2024-02-28T16:24:33.934 INFO:tasks.workunit.client.1.smithi153.stdout:7/250: write d1/d25/f9 [4878600,108436] 0 2024-02-28T16:24:33.937 INFO:tasks.workunit.client.1.smithi153.stdout:7/251: write d1/d25/df/f48 [489607,53130] 0 2024-02-28T16:24:33.939 INFO:tasks.workunit.client.1.smithi153.stdout:9/200: symlink d1/d5/d11/l44 0 2024-02-28T16:24:33.941 INFO:tasks.workunit.client.1.smithi153.stdout:7/252: creat d1/d25/d27/f4d x:0 0 0 2024-02-28T16:24:33.943 INFO:tasks.workunit.client.1.smithi153.stdout:7/253: read d1/f23 [1959206,117710] 0 2024-02-28T16:24:33.943 INFO:tasks.workunit.client.1.smithi153.stdout:9/201: read d1/d5/f19 [2134230,54485] 0 2024-02-28T16:24:33.943 INFO:tasks.workunit.client.1.smithi153.stdout:9/202: stat d1/f15 0 2024-02-28T16:24:33.947 INFO:tasks.workunit.client.1.smithi153.stdout:7/254: rmdir d1/d25/df/d26 39 2024-02-28T16:24:33.948 INFO:tasks.workunit.client.1.smithi153.stdout:9/203: write d1/d5/d11/d1f/d20/f31 [387002,15690] 0 2024-02-28T16:24:33.950 INFO:tasks.workunit.client.1.smithi153.stdout:7/255: dread - d1/d25/d27/d43/f4a zero size 2024-02-28T16:24:33.951 INFO:tasks.workunit.client.1.smithi153.stdout:9/204: mkdir d1/d5/d11/d1f/d20/d45 0 2024-02-28T16:24:33.952 INFO:tasks.workunit.client.1.smithi153.stdout:7/256: chown d1/d25/fe 62784054 1 2024-02-28T16:24:33.952 INFO:tasks.workunit.client.1.smithi153.stdout:2/256: dread d2/d19/d2a/f2f [0,4194304] 0 2024-02-28T16:24:33.954 INFO:tasks.workunit.client.1.smithi153.stdout:7/257: write d1/d25/dc/f35 [1741174,101455] 0 2024-02-28T16:24:33.959 INFO:tasks.workunit.client.1.smithi153.stdout:5/221: dread da/dd/d25/d41/f50 [0,4194304] 0 2024-02-28T16:24:33.960 INFO:tasks.workunit.client.1.smithi153.stdout:2/257: mkdir d2/d19/d4f 0 2024-02-28T16:24:33.962 INFO:tasks.workunit.client.1.smithi153.stdout:7/258: readlink d1/d25/dc/l3b 0 2024-02-28T16:24:33.965 INFO:tasks.workunit.client.1.smithi153.stdout:9/205: creat d1/d2/f46 x:0 0 0 2024-02-28T16:24:33.973 INFO:tasks.workunit.client.1.smithi153.stdout:5/222: creat da/f51 x:0 0 0 2024-02-28T16:24:33.976 INFO:tasks.workunit.client.1.smithi153.stdout:7/259: creat d1/d25/df/f4e x:0 0 0 2024-02-28T16:24:33.979 INFO:tasks.workunit.client.1.smithi153.stdout:5/223: mknod da/d29/c52 0 2024-02-28T16:24:33.980 INFO:tasks.workunit.client.1.smithi153.stdout:7/260: dread - d1/d25/df/f4e zero size 2024-02-28T16:24:33.981 INFO:tasks.workunit.client.1.smithi153.stdout:7/261: chown d1/d25/f33 28311852 1 2024-02-28T16:24:33.983 INFO:tasks.workunit.client.1.smithi153.stdout:7/262: write d1/d25/df/f48 [1139764,93850] 0 2024-02-28T16:24:33.984 INFO:tasks.workunit.client.1.smithi153.stdout:5/224: fsync da/dd/f31 0 2024-02-28T16:24:33.998 INFO:tasks.workunit.client.1.smithi153.stdout:7/263: dread d1/d25/f7 [0,4194304] 0 2024-02-28T16:24:34.008 INFO:tasks.workunit.client.1.smithi153.stdout:7/264: write d1/d25/d27/d43/f4a [259940,3653] 0 2024-02-28T16:24:34.008 INFO:tasks.workunit.client.1.smithi153.stdout:8/255: sync 2024-02-28T16:24:34.008 INFO:tasks.workunit.client.1.smithi153.stdout:1/253: sync 2024-02-28T16:24:34.008 INFO:tasks.workunit.client.1.smithi153.stdout:4/221: sync 2024-02-28T16:24:34.011 INFO:tasks.workunit.client.1.smithi153.stdout:5/225: dwrite da/dd/f3d [0,4194304] 0 2024-02-28T16:24:34.014 INFO:tasks.workunit.client.1.smithi153.stdout:4/222: chown d4/de/l2f 142852 1 2024-02-28T16:24:34.017 INFO:tasks.workunit.client.1.smithi153.stdout:5/226: mknod da/d29/d43/c53 0 2024-02-28T16:24:34.019 INFO:tasks.workunit.client.1.smithi153.stdout:4/223: rmdir d4/d3c 39 2024-02-28T16:24:34.020 INFO:tasks.workunit.client.1.smithi153.stdout:5/227: chown da/dd/f3d 2 1 2024-02-28T16:24:34.026 INFO:tasks.workunit.client.1.smithi153.stdout:7/265: mknod d1/d25/df/d26/d3a/c4f 0 2024-02-28T16:24:34.026 INFO:tasks.workunit.client.1.smithi153.stdout:9/206: dwrite d1/d5/fb [0,4194304] 0 2024-02-28T16:24:34.026 INFO:tasks.workunit.client.1.smithi153.stdout:5/228: write da/f42 [489711,17307] 0 2024-02-28T16:24:34.028 INFO:tasks.workunit.client.1.smithi153.stdout:7/266: dread - d1/d25/df/f4e zero size 2024-02-28T16:24:34.030 INFO:tasks.workunit.client.1.smithi153.stdout:9/207: unlink d1/l3f 0 2024-02-28T16:24:34.030 INFO:tasks.workunit.client.1.smithi153.stdout:4/224: creat d4/de/d40/f49 x:0 0 0 2024-02-28T16:24:34.031 INFO:tasks.workunit.client.1.smithi153.stdout:8/256: dread d0/d19/d1e/f40 [0,4194304] 0 2024-02-28T16:24:34.032 INFO:tasks.workunit.client.1.smithi153.stdout:5/229: rmdir da/dd/d25 39 2024-02-28T16:24:34.035 INFO:tasks.workunit.client.1.smithi153.stdout:7/267: mkdir d1/d25/dc/d50 0 2024-02-28T16:24:34.037 INFO:tasks.workunit.client.1.smithi153.stdout:7/268: dread - d1/d25/df/f47 zero size 2024-02-28T16:24:34.039 INFO:tasks.workunit.client.1.smithi153.stdout:4/225: creat d4/de/d23/f4a x:0 0 0 2024-02-28T16:24:34.041 INFO:tasks.workunit.client.1.smithi153.stdout:7/269: write d1/d25/df/f4e [823655,67812] 0 2024-02-28T16:24:34.041 INFO:tasks.workunit.client.1.smithi153.stdout:9/208: creat d1/d5/f47 x:0 0 0 2024-02-28T16:24:34.044 INFO:tasks.workunit.client.1.smithi153.stdout:4/226: rmdir d4/de/d13/d1b 39 2024-02-28T16:24:34.045 INFO:tasks.workunit.client.1.smithi153.stdout:5/230: read da/dd/d25/d41/f50 [1595259,12598] 0 2024-02-28T16:24:34.048 INFO:tasks.workunit.client.1.smithi153.stdout:9/209: creat d1/d5/d11/d1f/d40/f48 x:0 0 0 2024-02-28T16:24:34.048 INFO:tasks.workunit.client.1.smithi153.stdout:5/231: write da/dd/d25/d41/f49 [279667,83649] 0 2024-02-28T16:24:34.048 INFO:tasks.workunit.client.1.smithi153.stdout:4/227: mkdir d4/de/d23/d2b/d4b 0 2024-02-28T16:24:34.050 INFO:tasks.workunit.client.1.smithi153.stdout:5/232: fdatasync da/f3a 0 2024-02-28T16:24:34.051 INFO:tasks.workunit.client.1.smithi153.stdout:7/270: getdents d1/d25/df 0 2024-02-28T16:24:34.051 INFO:tasks.workunit.client.1.smithi153.stdout:9/210: write d1/d2/f46 [694987,121] 0 2024-02-28T16:24:34.052 INFO:tasks.workunit.client.1.smithi153.stdout:4/228: mknod d4/de/d23/d2b/c4c 0 2024-02-28T16:24:34.054 INFO:tasks.workunit.client.1.smithi153.stdout:7/271: fdatasync d1/d25/d27/d43/f4a 0 2024-02-28T16:24:34.056 INFO:tasks.workunit.client.1.smithi153.stdout:7/272: chown d1/d25/df/d26 0 1 2024-02-28T16:24:34.056 INFO:tasks.workunit.client.1.smithi153.stdout:4/229: mkdir d4/de/d40/d4d 0 2024-02-28T16:24:34.061 INFO:tasks.workunit.client.1.smithi153.stdout:4/230: chown d4/d3c/f43 187082 1 2024-02-28T16:24:34.062 INFO:tasks.workunit.client.1.smithi153.stdout:1/254: dread d0/dd/f21 [0,4194304] 0 2024-02-28T16:24:34.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/257: truncate d0/d12/d27/f4e 6088740 0 2024-02-28T16:24:34.072 INFO:tasks.workunit.client.1.smithi153.stdout:8/258: unlink d0/l5 0 2024-02-28T16:24:34.072 INFO:tasks.workunit.client.1.smithi153.stdout:4/231: mkdir d4/de/d13/d1b/d4e 0 2024-02-28T16:24:34.073 INFO:tasks.workunit.client.1.smithi153.stdout:0/257: sync 2024-02-28T16:24:34.075 INFO:tasks.workunit.client.1.smithi153.stdout:5/233: dwrite da/f39 [0,4194304] 0 2024-02-28T16:24:34.079 INFO:tasks.workunit.client.1.smithi153.stdout:1/255: link d0/dd/l57 d0/d3d/d4a/d59/l5f 0 2024-02-28T16:24:34.079 INFO:tasks.workunit.client.1.smithi153.stdout:4/232: symlink d4/de/d13/d1b/l4f 0 2024-02-28T16:24:34.081 INFO:tasks.workunit.client.1.smithi153.stdout:9/211: dwrite d1/d5/f47 [0,4194304] 0 2024-02-28T16:24:34.081 INFO:tasks.workunit.client.1.smithi153.stdout:0/258: mkdir d4/dc/d5c 0 2024-02-28T16:24:34.084 INFO:tasks.workunit.client.1.smithi153.stdout:5/234: rmdir da/d29/d43 39 2024-02-28T16:24:34.086 INFO:tasks.workunit.client.1.smithi153.stdout:9/212: creat d1/d5/d11/d1f/d20/f49 x:0 0 0 2024-02-28T16:24:34.087 INFO:tasks.workunit.client.1.smithi153.stdout:4/233: write d4/de/d13/f20 [4479870,110641] 0 2024-02-28T16:24:34.088 INFO:tasks.workunit.client.1.smithi153.stdout:0/259: write d4/dc/f3f [981955,84210] 0 2024-02-28T16:24:34.090 INFO:tasks.workunit.client.1.smithi153.stdout:5/235: mkdir da/dd/d54 0 2024-02-28T16:24:34.090 INFO:tasks.workunit.client.1.smithi153.stdout:7/273: dwrite d1/d25/d27/f4c [0,4194304] 0 2024-02-28T16:24:34.091 INFO:tasks.workunit.client.1.smithi153.stdout:9/213: fdatasync d1/d2a/f42 0 2024-02-28T16:24:34.102 INFO:tasks.workunit.client.1.smithi153.stdout:8/259: dread d0/d19/d2b/f33 [0,4194304] 0 2024-02-28T16:24:34.102 INFO:tasks.workunit.client.1.smithi153.stdout:1/256: dread d0/f41 [0,4194304] 0 2024-02-28T16:24:34.103 INFO:tasks.workunit.client.1.smithi153.stdout:0/260: truncate d4/d27/f42 1904856 0 2024-02-28T16:24:34.104 INFO:tasks.workunit.client.1.smithi153.stdout:4/234: mkdir d4/de/d13/d1b/d4e/d50 0 2024-02-28T16:24:34.106 INFO:tasks.workunit.client.1.smithi153.stdout:1/257: chown d0/dd/c20 10 1 2024-02-28T16:24:34.108 INFO:tasks.workunit.client.1.smithi153.stdout:9/214: creat d1/d5/d11/d1f/d20/d45/f4a x:0 0 0 2024-02-28T16:24:34.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/258: chown d0/dd/f21 2 1 2024-02-28T16:24:34.111 INFO:tasks.workunit.client.1.smithi153.stdout:5/236: rename da/dd/f1a to da/dd/d25/f55 0 2024-02-28T16:24:34.119 INFO:tasks.workunit.client.1.smithi153.stdout:8/260: dread d0/d19/d2b/d2d/f35 [0,4194304] 0 2024-02-28T16:24:34.121 INFO:tasks.workunit.client.1.smithi153.stdout:5/237: read da/dd/f3d [1783117,58801] 0 2024-02-28T16:24:34.121 INFO:tasks.workunit.client.1.smithi153.stdout:4/235: mkdir d4/de/d40/d4d/d51 0 2024-02-28T16:24:34.121 INFO:tasks.workunit.client.1.smithi153.stdout:7/274: dwrite d1/d25/dc/f35 [0,4194304] 0 2024-02-28T16:24:34.139 INFO:tasks.workunit.client.1.smithi153.stdout:7/275: unlink d1/lb 0 2024-02-28T16:24:34.140 INFO:tasks.workunit.client.1.smithi153.stdout:9/215: creat d1/d2/f4b x:0 0 0 2024-02-28T16:24:34.140 INFO:tasks.workunit.client.1.smithi153.stdout:1/259: creat d0/f60 x:0 0 0 2024-02-28T16:24:34.140 INFO:tasks.workunit.client.1.smithi153.stdout:4/236: mknod d4/de/d23/d2b/d31/c52 0 2024-02-28T16:24:34.142 INFO:tasks.workunit.client.1.smithi153.stdout:5/238: truncate da/dd/f4c 792932 0 2024-02-28T16:24:34.144 INFO:tasks.workunit.client.1.smithi153.stdout:7/276: write d1/d25/df/f4e [1539310,53284] 0 2024-02-28T16:24:34.145 INFO:tasks.workunit.client.1.smithi153.stdout:0/261: link d4/dc/c49 d4/dc/d5c/c5d 0 2024-02-28T16:24:34.146 INFO:tasks.workunit.client.1.smithi153.stdout:0/262: chown d4/d1a/l29 655531 1 2024-02-28T16:24:34.147 INFO:tasks.workunit.client.1.smithi153.stdout:4/237: truncate d4/f15 562326 0 2024-02-28T16:24:34.151 INFO:tasks.workunit.client.1.smithi153.stdout:1/260: creat d0/d3d/d4a/f61 x:0 0 0 2024-02-28T16:24:34.154 INFO:tasks.workunit.client.1.smithi153.stdout:7/277: mknod d1/d25/df/c51 0 2024-02-28T16:24:34.164 INFO:tasks.workunit.client.1.smithi153.stdout:3/275: sync 2024-02-28T16:24:34.164 INFO:tasks.workunit.client.1.smithi153.stdout:4/238: dwrite d4/d3c/f43 [0,4194304] 0 2024-02-28T16:24:34.165 INFO:tasks.workunit.client.1.smithi153.stdout:6/264: sync 2024-02-28T16:24:34.165 INFO:tasks.workunit.client.1.smithi153.stdout:2/258: sync 2024-02-28T16:24:34.168 INFO:tasks.workunit.client.1.smithi153.stdout:1/261: getdents d0/d3d 0 2024-02-28T16:24:34.175 INFO:tasks.workunit.client.1.smithi153.stdout:4/239: write d4/f32 [8500703,115686] 0 2024-02-28T16:24:34.175 INFO:tasks.workunit.client.1.smithi153.stdout:5/239: dread da/dd/fe [0,4194304] 0 2024-02-28T16:24:34.180 INFO:tasks.workunit.client.1.smithi153.stdout:2/259: creat d2/d4b/f50 x:0 0 0 2024-02-28T16:24:34.180 INFO:tasks.workunit.client.1.smithi153.stdout:4/240: truncate d4/de/d13/f18 984187 0 2024-02-28T16:24:34.182 INFO:tasks.workunit.client.1.smithi153.stdout:8/261: dwrite d0/d19/d1e/f53 [0,4194304] 0 2024-02-28T16:24:34.183 INFO:tasks.workunit.client.1.smithi153.stdout:6/265: rename d0/c41 to d0/d1d/d34/c64 0 2024-02-28T16:24:34.185 INFO:tasks.workunit.client.1.smithi153.stdout:9/216: dread d1/d2/f32 [0,4194304] 0 2024-02-28T16:24:34.189 INFO:tasks.workunit.client.1.smithi153.stdout:0/263: truncate d4/fa 505586 0 2024-02-28T16:24:34.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/262: mkdir d0/d62 0 2024-02-28T16:24:34.190 INFO:tasks.workunit.client.1.smithi153.stdout:3/276: getdents d4/d8/d1e/d2a/d55 0 2024-02-28T16:24:34.193 INFO:tasks.workunit.client.1.smithi153.stdout:2/260: creat d2/d23/d36/f51 x:0 0 0 2024-02-28T16:24:34.194 INFO:tasks.workunit.client.1.smithi153.stdout:6/266: mkdir d0/d15/d2e/d65 0 2024-02-28T16:24:34.194 INFO:tasks.workunit.client.1.smithi153.stdout:8/262: creat d0/d25/f57 x:0 0 0 2024-02-28T16:24:34.198 INFO:tasks.workunit.client.1.smithi153.stdout:2/261: fdatasync d2/f7 0 2024-02-28T16:24:34.198 INFO:tasks.workunit.client.1.smithi153.stdout:9/217: write d1/d5/d11/d1f/d20/d36/f2d [527909,84016] 0 2024-02-28T16:24:34.199 INFO:tasks.workunit.client.1.smithi153.stdout:5/240: creat da/d29/f56 x:0 0 0 2024-02-28T16:24:34.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/263: fdatasync d0/dd/f21 0 2024-02-28T16:24:34.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/278: mkdir d1/d25/df/d26/d3a/d52 0 2024-02-28T16:24:34.202 INFO:tasks.workunit.client.1.smithi153.stdout:9/218: readlink d1/d5/d11/d1f/d20/l2b 0 2024-02-28T16:24:34.203 INFO:tasks.workunit.client.1.smithi153.stdout:0/264: unlink d4/l51 0 2024-02-28T16:24:34.204 INFO:tasks.workunit.client.1.smithi153.stdout:7/279: write d1/f2c [165258,90966] 0 2024-02-28T16:24:34.206 INFO:tasks.workunit.client.1.smithi153.stdout:2/262: symlink d2/d19/d3e/l52 0 2024-02-28T16:24:34.208 INFO:tasks.workunit.client.1.smithi153.stdout:9/219: chown d1/d2/c21 4156 1 2024-02-28T16:24:34.211 INFO:tasks.workunit.client.1.smithi153.stdout:5/241: creat da/dd/d25/f57 x:0 0 0 2024-02-28T16:24:34.212 INFO:tasks.workunit.client.1.smithi153.stdout:0/265: creat d4/dc/f5e x:0 0 0 2024-02-28T16:24:34.213 INFO:tasks.workunit.client.1.smithi153.stdout:9/220: dread - d1/d5/d11/d1f/d40/f48 zero size 2024-02-28T16:24:34.213 INFO:tasks.workunit.client.1.smithi153.stdout:1/264: creat d0/d3d/d4a/d59/f63 x:0 0 0 2024-02-28T16:24:34.216 INFO:tasks.workunit.client.1.smithi153.stdout:4/241: write d4/de/d23/f48 [1132844,54642] 0 2024-02-28T16:24:34.216 INFO:tasks.workunit.client.1.smithi153.stdout:0/266: readlink d4/d1a/l29 0 2024-02-28T16:24:34.220 INFO:tasks.workunit.client.1.smithi153.stdout:0/267: readlink d4/d1a/l29 0 2024-02-28T16:24:34.221 INFO:tasks.workunit.client.1.smithi153.stdout:3/277: dread d4/d8/d1e/f5e [0,4194304] 0 2024-02-28T16:24:34.222 INFO:tasks.workunit.client.1.smithi153.stdout:2/263: creat d2/d19/d4f/f53 x:0 0 0 2024-02-28T16:24:34.224 INFO:tasks.workunit.client.1.smithi153.stdout:7/280: mknod d1/d25/df/d26/d3a/d52/c53 0 2024-02-28T16:24:34.225 INFO:tasks.workunit.client.1.smithi153.stdout:6/267: dwrite d0/f52 [0,4194304] 0 2024-02-28T16:24:34.228 INFO:tasks.workunit.client.1.smithi153.stdout:4/242: read d4/de/f11 [2558187,81441] 0 2024-02-28T16:24:34.229 INFO:tasks.workunit.client.1.smithi153.stdout:1/265: creat d0/d3d/f64 x:0 0 0 2024-02-28T16:24:34.230 INFO:tasks.workunit.client.1.smithi153.stdout:9/221: creat d1/d5/d11/d1f/f4c x:0 0 0 2024-02-28T16:24:34.231 INFO:tasks.workunit.client.1.smithi153.stdout:7/281: write d1/d25/dc/f35 [2042737,7583] 0 2024-02-28T16:24:34.233 INFO:tasks.workunit.client.1.smithi153.stdout:0/268: write d4/dc/f2c [940104,116977] 0 2024-02-28T16:24:34.233 INFO:tasks.workunit.client.1.smithi153.stdout:8/263: link d0/d19/d1e/f53 d0/d12/d27/d30/f58 0 2024-02-28T16:24:34.235 INFO:tasks.workunit.client.1.smithi153.stdout:1/266: write d0/d3d/d4a/d59/f5a [2748684,86618] 0 2024-02-28T16:24:34.236 INFO:tasks.workunit.client.1.smithi153.stdout:3/278: rmdir d4/d8/d1e/d23 39 2024-02-28T16:24:34.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/269: dread d4/d1a/f21 [0,4194304] 0 2024-02-28T16:24:34.243 INFO:tasks.workunit.client.1.smithi153.stdout:5/242: link da/d29/f56 da/dd/d25/f58 0 2024-02-28T16:24:34.248 INFO:tasks.workunit.client.1.smithi153.stdout:6/268: unlink d0/d1d/c2f 0 2024-02-28T16:24:34.249 INFO:tasks.workunit.client.1.smithi153.stdout:9/222: fdatasync d1/d5/f19 0 2024-02-28T16:24:34.252 INFO:tasks.workunit.client.1.smithi153.stdout:4/243: mkdir d4/d53 0 2024-02-28T16:24:34.253 INFO:tasks.workunit.client.1.smithi153.stdout:6/269: dread - d0/d1d/d23/f59 zero size 2024-02-28T16:24:34.258 INFO:tasks.workunit.client.1.smithi153.stdout:7/282: symlink d1/d25/dc/d50/l54 0 2024-02-28T16:24:34.260 INFO:tasks.workunit.client.1.smithi153.stdout:0/270: mknod d4/dc/d5c/c5f 0 2024-02-28T16:24:34.262 INFO:tasks.workunit.client.1.smithi153.stdout:6/270: chown d0/d15/d2e/f42 10087 1 2024-02-28T16:24:34.263 INFO:tasks.workunit.client.1.smithi153.stdout:4/244: creat d4/de/d40/f54 x:0 0 0 2024-02-28T16:24:34.266 INFO:tasks.workunit.client.1.smithi153.stdout:3/279: dread d4/d8/f10 [0,4194304] 0 2024-02-28T16:24:34.266 INFO:tasks.workunit.client.1.smithi153.stdout:1/267: dwrite d0/d3d/d4a/f56 [0,4194304] 0 2024-02-28T16:24:34.267 INFO:tasks.workunit.client.1.smithi153.stdout:8/264: getdents d0/d34 0 2024-02-28T16:24:34.273 INFO:tasks.workunit.client.1.smithi153.stdout:7/283: symlink d1/d25/d27/d43/l55 0 2024-02-28T16:24:34.273 INFO:tasks.workunit.client.1.smithi153.stdout:0/271: symlink d4/dc/l60 0 2024-02-28T16:24:34.274 INFO:tasks.workunit.client.1.smithi153.stdout:3/280: truncate d4/d8/d1e/f5e 5636139 0 2024-02-28T16:24:34.274 INFO:tasks.workunit.client.1.smithi153.stdout:5/243: dwrite f1 [0,4194304] 0 2024-02-28T16:24:34.279 INFO:tasks.workunit.client.1.smithi153.stdout:9/223: link d1/d2/f4b d1/d5/d11/d1f/d43/f4d 0 2024-02-28T16:24:34.279 INFO:tasks.workunit.client.1.smithi153.stdout:2/264: truncate d2/d23/f29 660449 0 2024-02-28T16:24:34.280 INFO:tasks.workunit.client.1.smithi153.stdout:8/265: mknod d0/d25/c59 0 2024-02-28T16:24:34.282 INFO:tasks.workunit.client.1.smithi153.stdout:8/266: write d0/d12/d15/f18 [2936945,92278] 0 2024-02-28T16:24:34.285 INFO:tasks.workunit.client.1.smithi153.stdout:6/271: truncate d0/d1d/d33/f3b 3430613 0 2024-02-28T16:24:34.293 INFO:tasks.workunit.client.1.smithi153.stdout:4/245: mknod d4/de/d13/d1b/d4e/d50/c55 0 2024-02-28T16:24:34.295 INFO:tasks.workunit.client.1.smithi153.stdout:6/272: write d0/f10 [4789246,127881] 0 2024-02-28T16:24:34.301 INFO:tasks.workunit.client.1.smithi153.stdout:7/284: truncate d1/d25/df/f4e 2063085 0 2024-02-28T16:24:34.302 INFO:tasks.workunit.client.1.smithi153.stdout:9/224: truncate d1/d5/f19 155107 0 2024-02-28T16:24:34.303 INFO:tasks.workunit.client.1.smithi153.stdout:6/273: fsync d0/d15/d2e/f5b 0 2024-02-28T16:24:34.304 INFO:tasks.workunit.client.1.smithi153.stdout:6/274: read d0/f52 [3910296,64363] 0 2024-02-28T16:24:34.305 INFO:tasks.workunit.client.1.smithi153.stdout:2/265: symlink d2/d25/d49/l54 0 2024-02-28T16:24:34.305 INFO:tasks.workunit.client.1.smithi153.stdout:1/268: link d0/c2 d0/d3d/d4a/d59/c65 0 2024-02-28T16:24:34.314 INFO:tasks.workunit.client.1.smithi153.stdout:9/225: write d1/d5/d27/f3b [2542991,110721] 0 2024-02-28T16:24:34.314 INFO:tasks.workunit.client.1.smithi153.stdout:2/266: truncate d2/d19/d2a/f2f 6728699 0 2024-02-28T16:24:34.316 INFO:tasks.workunit.client.1.smithi153.stdout:3/281: dwrite d4/d13/f3f [4194304,4194304] 0 2024-02-28T16:24:34.325 INFO:tasks.workunit.client.1.smithi153.stdout:2/267: write d2/ff [2073575,56705] 0 2024-02-28T16:24:34.325 INFO:tasks.workunit.client.1.smithi153.stdout:1/269: dread d0/f40 [0,4194304] 0 2024-02-28T16:24:34.327 INFO:tasks.workunit.client.1.smithi153.stdout:7/285: rename d1/d25/d27/d43/f4a to d1/d25/df/f56 0 2024-02-28T16:24:34.328 INFO:tasks.workunit.client.1.smithi153.stdout:5/244: dwrite da/f2c [0,4194304] 0 2024-02-28T16:24:34.332 INFO:tasks.workunit.client.1.smithi153.stdout:3/282: read d4/d13/f14 [834376,81476] 0 2024-02-28T16:24:34.337 INFO:tasks.workunit.client.1.smithi153.stdout:0/272: truncate d4/d1a/f39 2335064 0 2024-02-28T16:24:34.344 INFO:tasks.workunit.client.1.smithi153.stdout:8/267: dwrite d0/d25/f41 [0,4194304] 0 2024-02-28T16:24:34.350 INFO:tasks.workunit.client.1.smithi153.stdout:7/286: creat d1/d25/df/d26/f57 x:0 0 0 2024-02-28T16:24:34.352 INFO:tasks.workunit.client.1.smithi153.stdout:8/268: creat d0/d19/d2b/d2d/f5a x:0 0 0 2024-02-28T16:24:34.360 INFO:tasks.workunit.client.1.smithi153.stdout:1/270: mkdir d0/d62/d66 0 2024-02-28T16:24:34.360 INFO:tasks.workunit.client.1.smithi153.stdout:0/273: symlink d4/dc/d5c/l61 0 2024-02-28T16:24:34.361 INFO:tasks.workunit.client.1.smithi153.stdout:3/283: mknod d4/d13/c62 0 2024-02-28T16:24:34.364 INFO:tasks.workunit.client.1.smithi153.stdout:5/245: creat da/d29/f59 x:0 0 0 2024-02-28T16:24:34.369 INFO:tasks.workunit.client.1.smithi153.stdout:8/269: read d0/d12/d15/f29 [119153,20451] 0 2024-02-28T16:24:34.369 INFO:tasks.workunit.client.1.smithi153.stdout:9/226: dwrite d1/d2/f46 [0,4194304] 0 2024-02-28T16:24:34.375 INFO:tasks.workunit.client.1.smithi153.stdout:1/271: mkdir d0/dd/d67 0 2024-02-28T16:24:34.379 INFO:tasks.workunit.client.1.smithi153.stdout:7/287: fdatasync d1/d25/df/f47 0 2024-02-28T16:24:34.380 INFO:tasks.workunit.client.1.smithi153.stdout:5/246: stat da/d29/f4b 0 2024-02-28T16:24:34.384 INFO:tasks.workunit.client.1.smithi153.stdout:6/275: dwrite d0/d17/f4f [0,4194304] 0 2024-02-28T16:24:34.389 INFO:tasks.workunit.client.1.smithi153.stdout:5/247: read da/dd/fe [143430,8963] 0 2024-02-28T16:24:34.390 INFO:tasks.workunit.client.1.smithi153.stdout:1/272: rename d0/f60 to d0/d3d/f68 0 2024-02-28T16:24:34.391 INFO:tasks.workunit.client.1.smithi153.stdout:4/246: dwrite d4/de/f19 [0,4194304] 0 2024-02-28T16:24:34.391 INFO:tasks.workunit.client.1.smithi153.stdout:8/270: dread d0/d19/d2b/d2d/f35 [0,4194304] 0 2024-02-28T16:24:34.394 INFO:tasks.workunit.client.1.smithi153.stdout:1/273: chown d0/dd/c39 857 1 2024-02-28T16:24:34.394 INFO:tasks.workunit.client.1.smithi153.stdout:2/268: dwrite d2/d19/d2a/d3b/f4e [0,4194304] 0 2024-02-28T16:24:34.396 INFO:tasks.workunit.client.1.smithi153.stdout:6/276: mkdir d0/d66 0 2024-02-28T16:24:34.397 INFO:tasks.workunit.client.1.smithi153.stdout:8/271: write d0/f9 [2448304,42370] 0 2024-02-28T16:24:34.403 INFO:tasks.workunit.client.1.smithi153.stdout:7/288: rename d1/c3d to d1/d25/df/d26/d3a/d52/c58 0 2024-02-28T16:24:34.403 INFO:tasks.workunit.client.1.smithi153.stdout:9/227: creat d1/f4e x:0 0 0 2024-02-28T16:24:34.405 INFO:tasks.workunit.client.1.smithi153.stdout:6/277: fsync d0/f52 0 2024-02-28T16:24:34.406 INFO:tasks.workunit.client.1.smithi153.stdout:0/274: getdents d4/d32 0 2024-02-28T16:24:34.407 INFO:tasks.workunit.client.1.smithi153.stdout:6/278: read d0/f52 [3594995,86075] 0 2024-02-28T16:24:34.407 INFO:tasks.workunit.client.1.smithi153.stdout:9/228: fdatasync d1/d5/d11/d1f/d20/d45/f4a 0 2024-02-28T16:24:34.411 INFO:tasks.workunit.client.1.smithi153.stdout:6/279: write d0/d17/f28 [289050,121179] 0 2024-02-28T16:24:34.411 INFO:tasks.workunit.client.1.smithi153.stdout:3/284: dread d4/d8/d1e/d2a/d35/f39 [0,4194304] 0 2024-02-28T16:24:34.412 INFO:tasks.workunit.client.1.smithi153.stdout:0/275: truncate d4/d1a/f4b 69703 0 2024-02-28T16:24:34.414 INFO:tasks.workunit.client.1.smithi153.stdout:5/248: mkdir da/d29/d43/d5a 0 2024-02-28T16:24:34.414 INFO:tasks.workunit.client.1.smithi153.stdout:0/276: chown d4/d1a/f21 241117842 1 2024-02-28T16:24:34.421 INFO:tasks.workunit.client.1.smithi153.stdout:5/249: chown da/d29/f4b 0 1 2024-02-28T16:24:34.421 INFO:tasks.workunit.client.1.smithi153.stdout:3/285: write d4/d13/f1d [452431,113076] 0 2024-02-28T16:24:34.422 INFO:tasks.workunit.client.1.smithi153.stdout:1/274: creat d0/dd/f69 x:0 0 0 2024-02-28T16:24:34.422 INFO:tasks.workunit.client.1.smithi153.stdout:2/269: unlink d2/d19/d2a/f2f 0 2024-02-28T16:24:34.425 INFO:tasks.workunit.client.1.smithi153.stdout:7/289: creat d1/d25/d27/f59 x:0 0 0 2024-02-28T16:24:34.430 INFO:tasks.workunit.client.1.smithi153.stdout:4/247: creat d4/de/f56 x:0 0 0 2024-02-28T16:24:34.434 INFO:tasks.workunit.client.1.smithi153.stdout:2/270: mknod d2/d25/d49/c55 0 2024-02-28T16:24:34.437 INFO:tasks.workunit.client.1.smithi153.stdout:0/277: mknod d4/c62 0 2024-02-28T16:24:34.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/271: read d2/d25/f3d [303040,29156] 0 2024-02-28T16:24:34.441 INFO:tasks.workunit.client.1.smithi153.stdout:3/286: mkdir d4/d8/d1e/d63 0 2024-02-28T16:24:34.443 INFO:tasks.workunit.client.1.smithi153.stdout:8/272: dwrite d0/d12/f28 [0,4194304] 0 2024-02-28T16:24:34.445 INFO:tasks.workunit.client.1.smithi153.stdout:2/272: write d2/f10 [4203487,78476] 0 2024-02-28T16:24:34.446 INFO:tasks.workunit.client.1.smithi153.stdout:2/273: readlink d2/d19/l32 0 2024-02-28T16:24:34.448 INFO:tasks.workunit.client.1.smithi153.stdout:9/229: creat d1/d2/f4f x:0 0 0 2024-02-28T16:24:34.449 INFO:tasks.workunit.client.1.smithi153.stdout:7/290: mkdir d1/d25/df/d5a 0 2024-02-28T16:24:34.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/280: dwrite d0/d1d/d30/f36 [0,4194304] 0 2024-02-28T16:24:34.459 INFO:tasks.workunit.client.1.smithi153.stdout:5/250: creat da/d29/f5b x:0 0 0 2024-02-28T16:24:34.463 INFO:tasks.workunit.client.1.smithi153.stdout:2/274: mknod d2/d23/d36/c56 0 2024-02-28T16:24:34.464 INFO:tasks.workunit.client.1.smithi153.stdout:4/248: dwrite d4/d3c/f42 [0,4194304] 0 2024-02-28T16:24:34.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/275: dwrite d0/d3d/d4a/f56 [0,4194304] 0 2024-02-28T16:24:34.465 INFO:tasks.workunit.client.1.smithi153.stdout:7/291: creat d1/d25/dc/d50/f5b x:0 0 0 2024-02-28T16:24:34.468 INFO:tasks.workunit.client.1.smithi153.stdout:1/276: dread - d0/f48 zero size 2024-02-28T16:24:34.472 INFO:tasks.workunit.client.1.smithi153.stdout:5/251: readlink da/dd/l1d 0 2024-02-28T16:24:34.473 INFO:tasks.workunit.client.1.smithi153.stdout:3/287: mkdir d4/d8/d1e/d64 0 2024-02-28T16:24:34.474 INFO:tasks.workunit.client.1.smithi153.stdout:3/288: fsync d4/f1f 0 2024-02-28T16:24:34.476 INFO:tasks.workunit.client.1.smithi153.stdout:6/281: creat d0/d1d/d23/d60/f67 x:0 0 0 2024-02-28T16:24:34.484 INFO:tasks.workunit.client.1.smithi153.stdout:4/249: unlink d4/de/d40/f54 0 2024-02-28T16:24:34.486 INFO:tasks.workunit.client.1.smithi153.stdout:5/252: rename da/f39 to da/dd/d25/f5c 0 2024-02-28T16:24:34.489 INFO:tasks.workunit.client.1.smithi153.stdout:1/277: symlink d0/l6a 0 2024-02-28T16:24:34.491 INFO:tasks.workunit.client.1.smithi153.stdout:3/289: creat d4/d8/f65 x:0 0 0 2024-02-28T16:24:34.493 INFO:tasks.workunit.client.1.smithi153.stdout:6/282: mkdir d0/d15/d68 0 2024-02-28T16:24:34.494 INFO:tasks.workunit.client.1.smithi153.stdout:7/292: getdents d1/d25/df/d5a 0 2024-02-28T16:24:34.498 INFO:tasks.workunit.client.1.smithi153.stdout:3/290: fdatasync d4/d8/f65 0 2024-02-28T16:24:34.500 INFO:tasks.workunit.client.1.smithi153.stdout:1/278: write d0/dd/f1c [3112769,25104] 0 2024-02-28T16:24:34.503 INFO:tasks.workunit.client.1.smithi153.stdout:6/283: mknod d0/d66/c69 0 2024-02-28T16:24:34.507 INFO:tasks.workunit.client.1.smithi153.stdout:6/284: write d0/d15/f3a [159634,13633] 0 2024-02-28T16:24:34.508 INFO:tasks.workunit.client.1.smithi153.stdout:1/279: chown d0/d3d/d4a/d59/l5e 328726 1 2024-02-28T16:24:34.510 INFO:tasks.workunit.client.1.smithi153.stdout:0/278: dwrite d4/d27/f55 [4194304,4194304] 0 2024-02-28T16:24:34.510 INFO:tasks.workunit.client.1.smithi153.stdout:3/291: dread - d4/d8/d1e/f58 zero size 2024-02-28T16:24:34.512 INFO:tasks.workunit.client.1.smithi153.stdout:6/285: stat d0/d15/d68 0 2024-02-28T16:24:34.515 INFO:tasks.workunit.client.1.smithi153.stdout:2/275: dwrite d2/f7 [0,4194304] 0 2024-02-28T16:24:34.516 INFO:tasks.workunit.client.1.smithi153.stdout:1/280: write d0/f25 [1817922,115359] 0 2024-02-28T16:24:34.522 INFO:tasks.workunit.client.1.smithi153.stdout:4/250: dwrite d4/de/d23/d2b/d31/f34 [0,4194304] 0 2024-02-28T16:24:34.526 INFO:tasks.workunit.client.1.smithi153.stdout:3/292: write d4/f7 [969287,98266] 0 2024-02-28T16:24:34.526 INFO:tasks.workunit.client.1.smithi153.stdout:6/286: rename d0/d1d/d23/f3d to d0/d66/f6a 0 2024-02-28T16:24:34.531 INFO:tasks.workunit.client.1.smithi153.stdout:2/276: write d2/d19/d2a/f30 [5048207,24469] 0 2024-02-28T16:24:34.536 INFO:tasks.workunit.client.1.smithi153.stdout:3/293: write d4/d8/fd [3941135,36294] 0 2024-02-28T16:24:34.541 INFO:tasks.workunit.client.1.smithi153.stdout:3/294: write d4/d8/d1e/d2a/d35/f51 [3375796,14081] 0 2024-02-28T16:24:34.543 INFO:tasks.workunit.client.1.smithi153.stdout:7/293: dwrite d1/d25/d27/f4d [0,4194304] 0 2024-02-28T16:24:34.554 INFO:tasks.workunit.client.1.smithi153.stdout:3/295: dread d4/d8/d26/f3d [0,4194304] 0 2024-02-28T16:24:34.557 INFO:tasks.workunit.client.1.smithi153.stdout:4/251: link f1 d4/de/f57 0 2024-02-28T16:24:34.561 INFO:tasks.workunit.client.1.smithi153.stdout:2/277: symlink d2/d23/d36/l57 0 2024-02-28T16:24:34.561 INFO:tasks.workunit.client.1.smithi153.stdout:3/296: read d4/d13/d28/d36/f56 [269474,65591] 0 2024-02-28T16:24:34.564 INFO:tasks.workunit.client.1.smithi153.stdout:7/294: unlink d1/d25/df/f56 0 2024-02-28T16:24:34.564 INFO:tasks.workunit.client.1.smithi153.stdout:5/253: dread da/dd/d25/f32 [0,4194304] 0 2024-02-28T16:24:34.565 INFO:tasks.workunit.client.1.smithi153.stdout:0/279: getdents d4/dc/d5c 0 2024-02-28T16:24:34.571 INFO:tasks.workunit.client.1.smithi153.stdout:2/278: readlink d2/d25/l39 0 2024-02-28T16:24:34.574 INFO:tasks.workunit.client.1.smithi153.stdout:2/279: read d2/d25/f2d [886781,20207] 0 2024-02-28T16:24:34.574 INFO:tasks.workunit.client.1.smithi153.stdout:5/254: creat da/dd/d25/f5d x:0 0 0 2024-02-28T16:24:34.575 INFO:tasks.workunit.client.1.smithi153.stdout:6/287: write d0/d1d/d33/f3b [1822249,62183] 0 2024-02-28T16:24:34.580 INFO:tasks.workunit.client.1.smithi153.stdout:3/297: creat d4/f66 x:0 0 0 2024-02-28T16:24:34.582 INFO:tasks.workunit.client.1.smithi153.stdout:2/280: creat d2/d19/d31/f58 x:0 0 0 2024-02-28T16:24:34.583 INFO:tasks.workunit.client.1.smithi153.stdout:6/288: mkdir d0/d1d/d5d/d6b 0 2024-02-28T16:24:34.591 INFO:tasks.workunit.client.1.smithi153.stdout:7/295: dwrite d1/d25/dc/f35 [0,4194304] 0 2024-02-28T16:24:34.593 INFO:tasks.workunit.client.1.smithi153.stdout:5/255: creat da/d29/f5e x:0 0 0 2024-02-28T16:24:34.596 INFO:tasks.workunit.client.1.smithi153.stdout:3/298: creat d4/d13/f67 x:0 0 0 2024-02-28T16:24:34.599 INFO:tasks.workunit.client.1.smithi153.stdout:0/280: dwrite d4/dc/f5e [0,4194304] 0 2024-02-28T16:24:34.601 INFO:tasks.workunit.client.1.smithi153.stdout:5/256: rmdir da/dd/d25 39 2024-02-28T16:24:34.603 INFO:tasks.workunit.client.1.smithi153.stdout:3/299: write d4/d8/d26/d41/f4a [466626,91280] 0 2024-02-28T16:24:34.608 INFO:tasks.workunit.client.1.smithi153.stdout:5/257: write da/d29/f5e [26337,21638] 0 2024-02-28T16:24:34.608 INFO:tasks.workunit.client.1.smithi153.stdout:0/281: mknod d4/dc/d5c/c63 0 2024-02-28T16:24:34.615 INFO:tasks.workunit.client.1.smithi153.stdout:6/289: dwrite d0/d1d/d23/f57 [0,4194304] 0 2024-02-28T16:24:34.617 INFO:tasks.workunit.client.1.smithi153.stdout:5/258: write da/f19 [4837586,63359] 0 2024-02-28T16:24:34.632 INFO:tasks.workunit.client.1.smithi153.stdout:6/290: mkdir d0/d1d/d23/d6c 0 2024-02-28T16:24:34.638 INFO:tasks.workunit.client.1.smithi153.stdout:6/291: truncate d0/d17/f4f 4317945 0 2024-02-28T16:24:34.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/259: truncate da/dd/d25/f2e 1449591 0 2024-02-28T16:24:34.638 INFO:tasks.workunit.client.1.smithi153.stdout:7/296: truncate d1/d25/d27/f4c 1668556 0 2024-02-28T16:24:34.641 INFO:tasks.workunit.client.1.smithi153.stdout:6/292: read d0/f52 [2316886,39647] 0 2024-02-28T16:24:34.644 INFO:tasks.workunit.client.1.smithi153.stdout:7/297: creat d1/d25/d27/f5c x:0 0 0 2024-02-28T16:24:34.646 INFO:tasks.workunit.client.1.smithi153.stdout:3/300: truncate d4/d8/d1e/f5e 4102316 0 2024-02-28T16:24:34.647 INFO:tasks.workunit.client.1.smithi153.stdout:5/260: fdatasync da/dd/d25/f32 0 2024-02-28T16:24:34.648 INFO:tasks.workunit.client.1.smithi153.stdout:0/282: dwrite d4/dc/f33 [0,4194304] 0 2024-02-28T16:24:34.649 INFO:tasks.workunit.client.1.smithi153.stdout:3/301: read - d4/d8/d1e/f58 zero size 2024-02-28T16:24:34.650 INFO:tasks.workunit.client.1.smithi153.stdout:5/261: chown da/f19 311076 1 2024-02-28T16:24:34.651 INFO:tasks.workunit.client.1.smithi153.stdout:6/293: mknod d0/d1d/d5d/d6b/c6d 0 2024-02-28T16:24:34.652 INFO:tasks.workunit.client.1.smithi153.stdout:3/302: write d4/d8/d1e/f58 [476812,73883] 0 2024-02-28T16:24:34.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/283: write d4/dc/f2c [1056945,12693] 0 2024-02-28T16:24:34.654 INFO:tasks.workunit.client.1.smithi153.stdout:7/298: symlink d1/d25/df/d26/d3a/l5d 0 2024-02-28T16:24:34.655 INFO:tasks.workunit.client.1.smithi153.stdout:5/262: write da/d29/f5b [814371,53198] 0 2024-02-28T16:24:34.659 INFO:tasks.workunit.client.1.smithi153.stdout:6/294: creat d0/d1d/d30/f6e x:0 0 0 2024-02-28T16:24:34.661 INFO:tasks.workunit.client.1.smithi153.stdout:7/299: truncate d1/d25/d27/f5c 1036301 0 2024-02-28T16:24:34.662 INFO:tasks.workunit.client.1.smithi153.stdout:0/284: dread d4/d1a/f21 [0,4194304] 0 2024-02-28T16:24:34.662 INFO:tasks.workunit.client.1.smithi153.stdout:3/303: mknod d4/d8/d1e/c68 0 2024-02-28T16:24:34.662 INFO:tasks.workunit.client.1.smithi153.stdout:6/295: write d0/d17/f28 [1113746,128676] 0 2024-02-28T16:24:34.665 INFO:tasks.workunit.client.1.smithi153.stdout:6/296: dread - d0/d1d/d30/f58 zero size 2024-02-28T16:24:34.666 INFO:tasks.workunit.client.1.smithi153.stdout:0/285: write d4/f3e [57903,12284] 0 2024-02-28T16:24:34.667 INFO:tasks.workunit.client.1.smithi153.stdout:0/286: readlink d4/d32/l56 0 2024-02-28T16:24:34.669 INFO:tasks.workunit.client.1.smithi153.stdout:8/273: sync 2024-02-28T16:24:34.670 INFO:tasks.workunit.client.1.smithi153.stdout:6/297: creat d0/d15/d68/f6f x:0 0 0 2024-02-28T16:24:34.677 INFO:tasks.workunit.client.1.smithi153.stdout:8/274: read d0/d12/d27/d30/f3a [4185650,55362] 0 2024-02-28T16:24:34.678 INFO:tasks.workunit.client.1.smithi153.stdout:0/287: rename d4/c58 to d4/d32/c64 0 2024-02-28T16:24:34.685 INFO:tasks.workunit.client.1.smithi153.stdout:7/300: dwrite d1/d25/dc/f35 [0,4194304] 0 2024-02-28T16:24:34.686 INFO:tasks.workunit.client.1.smithi153.stdout:3/304: dwrite d4/d2c/f5a [0,4194304] 0 2024-02-28T16:24:34.688 INFO:tasks.workunit.client.1.smithi153.stdout:0/288: rmdir d4/d32 39 2024-02-28T16:24:34.688 INFO:tasks.workunit.client.1.smithi153.stdout:7/301: write d1/d25/df/d26/f57 [249022,53137] 0 2024-02-28T16:24:34.695 INFO:tasks.workunit.client.1.smithi153.stdout:0/289: write d4/d27/f5a [989131,23876] 0 2024-02-28T16:24:34.698 INFO:tasks.workunit.client.1.smithi153.stdout:3/305: symlink d4/d8/d1e/d2a/d35/l69 0 2024-02-28T16:24:34.700 INFO:tasks.workunit.client.1.smithi153.stdout:5/263: dread da/d29/f30 [0,4194304] 0 2024-02-28T16:24:34.702 INFO:tasks.workunit.client.1.smithi153.stdout:5/264: stat da/d29/d43/f4f 0 2024-02-28T16:24:34.708 INFO:tasks.workunit.client.1.smithi153.stdout:7/302: mkdir d1/d25/df/d26/d3a/d5e 0 2024-02-28T16:24:34.709 INFO:tasks.workunit.client.1.smithi153.stdout:0/290: dread d4/d27/f3a [0,4194304] 0 2024-02-28T16:24:34.711 INFO:tasks.workunit.client.1.smithi153.stdout:8/275: link d0/d12/d15/l52 d0/d34/d50/l5b 0 2024-02-28T16:24:34.713 INFO:tasks.workunit.client.1.smithi153.stdout:3/306: getdents d4/d8/d1e/d64 0 2024-02-28T16:24:34.714 INFO:tasks.workunit.client.1.smithi153.stdout:0/291: mkdir d4/d1a/d65 0 2024-02-28T16:24:34.717 INFO:tasks.workunit.client.1.smithi153.stdout:5/265: dread da/dd/fe [0,4194304] 0 2024-02-28T16:24:34.717 INFO:tasks.workunit.client.1.smithi153.stdout:6/298: dwrite d0/d15/f1a [0,4194304] 0 2024-02-28T16:24:34.723 INFO:tasks.workunit.client.1.smithi153.stdout:8/276: fsync d0/d19/f43 0 2024-02-28T16:24:34.723 INFO:tasks.workunit.client.1.smithi153.stdout:0/292: mknod d4/d1a/c66 0 2024-02-28T16:24:34.727 INFO:tasks.workunit.client.1.smithi153.stdout:6/299: rmdir d0/d15/d68 39 2024-02-28T16:24:34.730 INFO:tasks.workunit.client.1.smithi153.stdout:5/266: symlink da/dd/d25/d41/l5f 0 2024-02-28T16:24:34.734 INFO:tasks.workunit.client.1.smithi153.stdout:3/307: mkdir d4/d6a 0 2024-02-28T16:24:34.734 INFO:tasks.workunit.client.1.smithi153.stdout:7/303: write d1/d25/d27/f4c [2441883,73635] 0 2024-02-28T16:24:34.738 INFO:tasks.workunit.client.1.smithi153.stdout:0/293: readlink d4/d32/l50 0 2024-02-28T16:24:34.742 INFO:tasks.workunit.client.1.smithi153.stdout:6/300: readlink d0/d1d/d23/l2a 0 2024-02-28T16:24:34.746 INFO:tasks.workunit.client.1.smithi153.stdout:7/304: mknod d1/d25/d27/d43/c5f 0 2024-02-28T16:24:34.747 INFO:tasks.workunit.client.1.smithi153.stdout:8/277: symlink d0/d12/l5c 0 2024-02-28T16:24:34.748 INFO:tasks.workunit.client.1.smithi153.stdout:3/308: dwrite d4/d13/f1d [0,4194304] 0 2024-02-28T16:24:34.749 INFO:tasks.workunit.client.1.smithi153.stdout:7/305: write d1/d25/fe [5258700,7426] 0 2024-02-28T16:24:34.749 INFO:tasks.workunit.client.1.smithi153.stdout:8/278: fsync d0/f9 0 2024-02-28T16:24:34.750 INFO:tasks.workunit.client.1.smithi153.stdout:0/294: truncate d4/d1a/f31 6116886 0 2024-02-28T16:24:34.751 INFO:tasks.workunit.client.1.smithi153.stdout:6/301: unlink d0/d1d/d5d/l61 0 2024-02-28T16:24:34.756 INFO:tasks.workunit.client.1.smithi153.stdout:7/306: rmdir d1/d25/df/d26 39 2024-02-28T16:24:34.757 INFO:tasks.workunit.client.1.smithi153.stdout:7/307: fsync d1/d25/dc/f35 0 2024-02-28T16:24:34.758 INFO:tasks.workunit.client.1.smithi153.stdout:7/308: readlink d1/d25/dc/l1f 0 2024-02-28T16:24:34.760 INFO:tasks.workunit.client.1.smithi153.stdout:0/295: rmdir d4/d27 39 2024-02-28T16:24:34.762 INFO:tasks.workunit.client.1.smithi153.stdout:5/267: creat da/dd/f60 x:0 0 0 2024-02-28T16:24:34.763 INFO:tasks.workunit.client.1.smithi153.stdout:3/309: mkdir d4/d8/d1e/d2a/d55/d6b 0 2024-02-28T16:24:34.767 INFO:tasks.workunit.client.1.smithi153.stdout:6/302: creat d0/d15/d68/f70 x:0 0 0 2024-02-28T16:24:34.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/296: dread d4/dc/f3f [0,4194304] 0 2024-02-28T16:24:34.770 INFO:tasks.workunit.client.1.smithi153.stdout:5/268: creat da/dd/d25/d41/f61 x:0 0 0 2024-02-28T16:24:34.770 INFO:tasks.workunit.client.1.smithi153.stdout:8/279: rename d0/l42 to d0/d12/l5d 0 2024-02-28T16:24:34.772 INFO:tasks.workunit.client.1.smithi153.stdout:5/269: fsync da/f1e 0 2024-02-28T16:24:34.776 INFO:tasks.workunit.client.1.smithi153.stdout:6/303: mkdir d0/d1d/d30/d71 0 2024-02-28T16:24:34.777 INFO:tasks.workunit.client.1.smithi153.stdout:6/304: readlink d0/l7 0 2024-02-28T16:24:34.779 INFO:tasks.workunit.client.1.smithi153.stdout:6/305: read d0/d1d/d23/f57 [895463,69351] 0 2024-02-28T16:24:34.780 INFO:tasks.workunit.client.1.smithi153.stdout:0/297: write d4/d27/f5a [662917,62758] 0 2024-02-28T16:24:34.781 INFO:tasks.workunit.client.1.smithi153.stdout:8/280: creat d0/d19/d2b/d2d/f5e x:0 0 0 2024-02-28T16:24:34.783 INFO:tasks.workunit.client.1.smithi153.stdout:0/298: read d4/d27/f3a [288371,103572] 0 2024-02-28T16:24:34.784 INFO:tasks.workunit.client.1.smithi153.stdout:7/309: getdents d1/d25/df/d26/d3a/d5e 0 2024-02-28T16:24:34.788 INFO:tasks.workunit.client.1.smithi153.stdout:0/299: fdatasync d4/f12 0 2024-02-28T16:24:34.789 INFO:tasks.workunit.client.1.smithi153.stdout:3/310: dread d4/d8/d1e/d2a/d35/f47 [0,4194304] 0 2024-02-28T16:24:34.789 INFO:tasks.workunit.client.1.smithi153.stdout:8/281: rename d0/d25/f41 to d0/d12/d15/f5f 0 2024-02-28T16:24:34.790 INFO:tasks.workunit.client.1.smithi153.stdout:0/300: stat d4/d27/f55 0 2024-02-28T16:24:34.792 INFO:tasks.workunit.client.1.smithi153.stdout:5/270: creat da/d29/f62 x:0 0 0 2024-02-28T16:24:34.793 INFO:tasks.workunit.client.1.smithi153.stdout:6/306: dread d0/d1d/d23/f57 [0,4194304] 0 2024-02-28T16:24:34.793 INFO:tasks.workunit.client.1.smithi153.stdout:9/230: sync 2024-02-28T16:24:34.795 INFO:tasks.workunit.client.1.smithi153.stdout:9/231: read d1/d5/fb [3577284,85245] 0 2024-02-28T16:24:34.796 INFO:tasks.workunit.client.1.smithi153.stdout:8/282: creat d0/d34/f60 x:0 0 0 2024-02-28T16:24:34.796 INFO:tasks.workunit.client.1.smithi153.stdout:9/232: chown d1/d5/d11/d1f/d20/d36 2 1 2024-02-28T16:24:34.798 INFO:tasks.workunit.client.1.smithi153.stdout:7/310: mkdir d1/d25/df/d60 0 2024-02-28T16:24:34.799 INFO:tasks.workunit.client.1.smithi153.stdout:0/301: rename d4/dc/f2c to d4/d1a/f67 0 2024-02-28T16:24:34.801 INFO:tasks.workunit.client.1.smithi153.stdout:0/302: truncate d4/d1a/f37 783504 0 2024-02-28T16:24:34.805 INFO:tasks.workunit.client.1.smithi153.stdout:8/283: readlink d0/d12/d27/l4d 0 2024-02-28T16:24:34.806 INFO:tasks.workunit.client.1.smithi153.stdout:5/271: dwrite da/dd/d25/d41/f49 [0,4194304] 0 2024-02-28T16:24:34.867 INFO:tasks.workunit.client.1.smithi153.stdout:3/311: dread d4/d8/f10 [0,4194304] 0 2024-02-28T16:24:34.869 INFO:tasks.workunit.client.1.smithi153.stdout:6/307: write d0/d1d/d30/f36 [4610133,121844] 0 2024-02-28T16:24:34.872 INFO:tasks.workunit.client.1.smithi153.stdout:8/284: creat d0/d19/d2b/f61 x:0 0 0 2024-02-28T16:24:34.873 INFO:tasks.workunit.client.1.smithi153.stdout:5/272: chown da/dd/f47 15124 1 2024-02-28T16:24:34.877 INFO:tasks.workunit.client.1.smithi153.stdout:6/308: rmdir d0 39 2024-02-28T16:24:34.879 INFO:tasks.workunit.client.1.smithi153.stdout:3/312: creat d4/d8/f6c x:0 0 0 2024-02-28T16:24:34.883 INFO:tasks.workunit.client.1.smithi153.stdout:5/273: mkdir da/dd/d54/d63 0 2024-02-28T16:24:34.886 INFO:tasks.workunit.client.1.smithi153.stdout:3/313: truncate d4/d8/f65 633813 0 2024-02-28T16:24:34.891 INFO:tasks.workunit.client.1.smithi153.stdout:0/303: dwrite d4/fe [0,4194304] 0 2024-02-28T16:24:34.894 INFO:tasks.workunit.client.1.smithi153.stdout:7/311: dwrite d1/d25/df/f48 [0,4194304] 0 2024-02-28T16:24:34.907 INFO:tasks.workunit.client.1.smithi153.stdout:3/314: truncate d4/d8/d1e/f5e 2583557 0 2024-02-28T16:24:34.912 INFO:tasks.workunit.client.1.smithi153.stdout:8/285: dwrite d0/d12/d15/f5f [0,4194304] 0 2024-02-28T16:24:34.913 INFO:tasks.workunit.client.1.smithi153.stdout:1/281: sync 2024-02-28T16:24:34.913 INFO:tasks.workunit.client.1.smithi153.stdout:4/252: sync 2024-02-28T16:24:34.914 INFO:tasks.workunit.client.1.smithi153.stdout:2/281: sync 2024-02-28T16:24:34.917 INFO:tasks.workunit.client.1.smithi153.stdout:4/253: dread - d4/de/d23/f4a zero size 2024-02-28T16:24:34.918 INFO:tasks.workunit.client.1.smithi153.stdout:1/282: chown d0/dd/f32 54054 1 2024-02-28T16:24:34.918 INFO:tasks.workunit.client.1.smithi153.stdout:7/312: rename d1/d25/df/f48 to d1/d25/df/f61 0 2024-02-28T16:24:34.918 INFO:tasks.workunit.client.1.smithi153.stdout:2/282: readlink d2/l14 0 2024-02-28T16:24:34.926 INFO:tasks.workunit.client.1.smithi153.stdout:5/274: dwrite da/dd/f60 [0,4194304] 0 2024-02-28T16:24:34.928 INFO:tasks.workunit.client.1.smithi153.stdout:2/283: write d2/d19/d2a/f45 [961664,14050] 0 2024-02-28T16:24:34.929 INFO:tasks.workunit.client.1.smithi153.stdout:7/313: truncate d1/d25/dc/d50/f5b 153090 0 2024-02-28T16:24:34.933 INFO:tasks.workunit.client.1.smithi153.stdout:5/275: chown da/d29/f5e 1955 1 2024-02-28T16:24:34.934 INFO:tasks.workunit.client.1.smithi153.stdout:2/284: dread - d2/d4b/f50 zero size 2024-02-28T16:24:34.935 INFO:tasks.workunit.client.1.smithi153.stdout:0/304: dwrite d4/d32/f5b [0,4194304] 0 2024-02-28T16:24:34.937 INFO:tasks.workunit.client.1.smithi153.stdout:0/305: readlink d4/dc/l60 0 2024-02-28T16:24:34.939 INFO:tasks.workunit.client.1.smithi153.stdout:4/254: symlink d4/de/d47/l58 0 2024-02-28T16:24:34.943 INFO:tasks.workunit.client.1.smithi153.stdout:0/306: write d4/fe [921488,22057] 0 2024-02-28T16:24:34.943 INFO:tasks.workunit.client.1.smithi153.stdout:6/309: dread d0/d15/f2c [0,4194304] 0 2024-02-28T16:24:34.945 INFO:tasks.workunit.client.1.smithi153.stdout:7/314: chown d1/l2f 147 1 2024-02-28T16:24:34.953 INFO:tasks.workunit.client.1.smithi153.stdout:6/310: mkdir d0/d15/d48/d72 0 2024-02-28T16:24:34.959 INFO:tasks.workunit.client.1.smithi153.stdout:6/311: fsync d0/d1d/d23/d60/f67 0 2024-02-28T16:24:34.959 INFO:tasks.workunit.client.1.smithi153.stdout:7/315: rename d1/d25/d27/f4c to d1/d25/dc/f62 0 2024-02-28T16:24:34.963 INFO:tasks.workunit.client.1.smithi153.stdout:7/316: fsync d1/d25/f16 0 2024-02-28T16:24:34.967 INFO:tasks.workunit.client.1.smithi153.stdout:5/276: dwrite da/d29/d43/f4f [0,4194304] 0 2024-02-28T16:24:34.970 INFO:tasks.workunit.client.1.smithi153.stdout:0/307: rename d4/c22 to d4/dc/d5c/c68 0 2024-02-28T16:24:34.970 INFO:tasks.workunit.client.1.smithi153.stdout:7/317: chown d1/c42 157815 1 2024-02-28T16:24:34.971 INFO:tasks.workunit.client.1.smithi153.stdout:8/286: dread d0/d12/d15/f36 [0,4194304] 0 2024-02-28T16:24:34.975 INFO:tasks.workunit.client.1.smithi153.stdout:4/255: dwrite d4/de/f16 [0,4194304] 0 2024-02-28T16:24:34.975 INFO:tasks.workunit.client.1.smithi153.stdout:0/308: chown d4/d32/l46 5 1 2024-02-28T16:24:34.977 INFO:tasks.workunit.client.1.smithi153.stdout:5/277: truncate da/dd/d25/f58 897555 0 2024-02-28T16:24:34.978 INFO:tasks.workunit.client.1.smithi153.stdout:7/318: mkdir d1/d25/df/d26/d3a/d52/d63 0 2024-02-28T16:24:34.979 INFO:tasks.workunit.client.1.smithi153.stdout:1/283: truncate d0/dd/f29 732082 0 2024-02-28T16:24:34.988 INFO:tasks.workunit.client.1.smithi153.stdout:2/285: write d2/d25/f2d [2193261,129799] 0 2024-02-28T16:24:34.991 INFO:tasks.workunit.client.1.smithi153.stdout:1/284: creat d0/d3d/f6b x:0 0 0 2024-02-28T16:24:34.991 INFO:tasks.workunit.client.1.smithi153.stdout:6/312: dwrite d0/d15/f3a [0,4194304] 0 2024-02-28T16:24:34.995 INFO:tasks.workunit.client.1.smithi153.stdout:2/286: dread - d2/d19/d31/f58 zero size 2024-02-28T16:24:35.000 INFO:tasks.workunit.client.1.smithi153.stdout:5/278: mknod da/d29/d43/d5a/c64 0 2024-02-28T16:24:35.003 INFO:tasks.workunit.client.1.smithi153.stdout:0/309: dread d4/f3b [0,4194304] 0 2024-02-28T16:24:35.005 INFO:tasks.workunit.client.1.smithi153.stdout:1/285: rename d0/lc to d0/dd/d67/l6c 0 2024-02-28T16:24:35.007 INFO:tasks.workunit.client.1.smithi153.stdout:2/287: symlink d2/l59 0 2024-02-28T16:24:35.008 INFO:tasks.workunit.client.1.smithi153.stdout:1/286: stat d0/d3d/d4a/d59 0 2024-02-28T16:24:35.010 INFO:tasks.workunit.client.1.smithi153.stdout:2/288: truncate d2/d19/d4f/f53 865769 0 2024-02-28T16:24:35.012 INFO:tasks.workunit.client.1.smithi153.stdout:7/319: link d1/d25/df/d26/f57 d1/d25/dc/f64 0 2024-02-28T16:24:35.012 INFO:tasks.workunit.client.1.smithi153.stdout:2/289: readlink d2/d19/l41 0 2024-02-28T16:24:35.019 INFO:tasks.workunit.client.1.smithi153.stdout:6/313: getdents d0/d15/d2e/d65 0 2024-02-28T16:24:35.021 INFO:tasks.workunit.client.1.smithi153.stdout:6/314: read d0/d15/f3a [673301,106564] 0 2024-02-28T16:24:35.028 INFO:tasks.workunit.client.1.smithi153.stdout:0/310: dread - d4/f3c zero size 2024-02-28T16:24:35.029 INFO:tasks.workunit.client.1.smithi153.stdout:0/311: read - d4/f3c zero size 2024-02-28T16:24:35.036 INFO:tasks.workunit.client.1.smithi153.stdout:2/290: symlink d2/d19/d3e/l5a 0 2024-02-28T16:24:35.037 INFO:tasks.workunit.client.1.smithi153.stdout:9/233: sync 2024-02-28T16:24:35.037 INFO:tasks.workunit.client.1.smithi153.stdout:3/315: sync 2024-02-28T16:24:35.037 INFO:tasks.workunit.client.1.smithi153.stdout:7/320: creat d1/d25/dc/d50/f65 x:0 0 0 2024-02-28T16:24:35.042 INFO:tasks.workunit.client.1.smithi153.stdout:4/256: link d4/de/d13/c44 d4/de/d13/d1b/d4e/d50/c59 0 2024-02-28T16:24:35.044 INFO:tasks.workunit.client.1.smithi153.stdout:2/291: write d2/d19/d4f/f53 [328438,93760] 0 2024-02-28T16:24:35.044 INFO:tasks.workunit.client.1.smithi153.stdout:3/316: truncate d4/d8/d26/f4f 560611 0 2024-02-28T16:24:35.049 INFO:tasks.workunit.client.1.smithi153.stdout:0/312: write d4/d1a/f37 [247180,21630] 0 2024-02-28T16:24:35.050 INFO:tasks.workunit.client.1.smithi153.stdout:5/279: creat da/dd/f65 x:0 0 0 2024-02-28T16:24:35.053 INFO:tasks.workunit.client.1.smithi153.stdout:7/321: mkdir d1/d25/dc/d50/d66 0 2024-02-28T16:24:35.054 INFO:tasks.workunit.client.1.smithi153.stdout:8/287: write d0/f8 [2622711,84592] 0 2024-02-28T16:24:35.062 INFO:tasks.workunit.client.1.smithi153.stdout:5/280: symlink da/dd/d25/l66 0 2024-02-28T16:24:35.066 INFO:tasks.workunit.client.1.smithi153.stdout:2/292: dwrite d2/f21 [0,4194304] 0 2024-02-28T16:24:35.066 INFO:tasks.workunit.client.1.smithi153.stdout:1/287: rmdir d0/d3d 39 2024-02-28T16:24:35.067 INFO:tasks.workunit.client.1.smithi153.stdout:0/313: symlink d4/d32/l69 0 2024-02-28T16:24:35.074 INFO:tasks.workunit.client.1.smithi153.stdout:8/288: creat d0/d12/d15/f62 x:0 0 0 2024-02-28T16:24:35.080 INFO:tasks.workunit.client.1.smithi153.stdout:2/293: mknod d2/d23/d36/c5b 0 2024-02-28T16:24:35.084 INFO:tasks.workunit.client.1.smithi153.stdout:0/314: creat d4/dc/d5c/f6a x:0 0 0 2024-02-28T16:24:35.085 INFO:tasks.workunit.client.1.smithi153.stdout:9/234: creat d1/d5/d11/f50 x:0 0 0 2024-02-28T16:24:35.087 INFO:tasks.workunit.client.1.smithi153.stdout:7/322: link d1/d25/dc/d50/f5b d1/d25/df/d60/f67 0 2024-02-28T16:24:35.089 INFO:tasks.workunit.client.1.smithi153.stdout:5/281: symlink da/l67 0 2024-02-28T16:24:35.091 INFO:tasks.workunit.client.1.smithi153.stdout:8/289: mkdir d0/d12/d27/d30/d63 0 2024-02-28T16:24:35.092 INFO:tasks.workunit.client.1.smithi153.stdout:8/290: write d0/d34/f3d [2545576,6111] 0 2024-02-28T16:24:35.105 INFO:tasks.workunit.client.1.smithi153.stdout:9/235: mknod d1/d5/d27/c51 0 2024-02-28T16:24:35.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/288: rename d0/d3d/d4a/f5b to d0/d3d/f6d 0 2024-02-28T16:24:35.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/315: truncate d0/f20 2395016 0 2024-02-28T16:24:35.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/316: stat d0/d1d/d30/d71 0 2024-02-28T16:24:35.116 INFO:tasks.workunit.client.1.smithi153.stdout:5/282: rename da/dd/d25/d41/l5f to da/dd/d54/d63/l68 0 2024-02-28T16:24:35.116 INFO:tasks.workunit.client.1.smithi153.stdout:6/317: fdatasync d0/d15/f3e 0 2024-02-28T16:24:35.117 INFO:tasks.workunit.client.1.smithi153.stdout:2/294: rmdir d2/d23 39 2024-02-28T16:24:35.120 INFO:tasks.workunit.client.1.smithi153.stdout:2/295: truncate d2/d19/d2a/f30 5719521 0 2024-02-28T16:24:35.121 INFO:tasks.workunit.client.1.smithi153.stdout:5/283: rename da/dd/d25/d41/f50 to da/dd/d54/f69 0 2024-02-28T16:24:35.121 INFO:tasks.workunit.client.1.smithi153.stdout:2/296: stat d2/d25 0 2024-02-28T16:24:35.122 INFO:tasks.workunit.client.1.smithi153.stdout:6/318: creat d0/d1d/d33/f73 x:0 0 0 2024-02-28T16:24:35.124 INFO:tasks.workunit.client.1.smithi153.stdout:3/317: dwrite d4/d2c/f57 [0,4194304] 0 2024-02-28T16:24:35.124 INFO:tasks.workunit.client.1.smithi153.stdout:6/319: chown d0/d17/l39 396845760 1 2024-02-28T16:24:35.128 INFO:tasks.workunit.client.1.smithi153.stdout:1/289: getdents d0/dd 0 2024-02-28T16:24:35.130 INFO:tasks.workunit.client.1.smithi153.stdout:2/297: rmdir d2/d19/d3e 39 2024-02-28T16:24:35.133 INFO:tasks.workunit.client.1.smithi153.stdout:9/236: dread d1/f34 [0,4194304] 0 2024-02-28T16:24:35.137 INFO:tasks.workunit.client.1.smithi153.stdout:3/318: creat d4/d8/d1e/d2a/d35/d54/f6d x:0 0 0 2024-02-28T16:24:35.145 INFO:tasks.workunit.client.1.smithi153.stdout:3/319: write d4/f66 [980657,52484] 0 2024-02-28T16:24:35.147 INFO:tasks.workunit.client.1.smithi153.stdout:5/284: rmdir da/dd/d25/d41 39 2024-02-28T16:24:35.148 INFO:tasks.workunit.client.1.smithi153.stdout:6/320: link d0/d1d/d30/f58 d0/d1d/d23/d60/f74 0 2024-02-28T16:24:35.148 INFO:tasks.workunit.client.1.smithi153.stdout:3/320: chown d4/d8/d26/d41 27290905 1 2024-02-28T16:24:35.156 INFO:tasks.workunit.client.1.smithi153.stdout:3/321: write d4/d8/d26/d41/f3e [148425,66619] 0 2024-02-28T16:24:35.159 INFO:tasks.workunit.client.1.smithi153.stdout:0/315: dwrite d4/d1a/f21 [0,4194304] 0 2024-02-28T16:24:35.162 INFO:tasks.workunit.client.1.smithi153.stdout:3/322: dread - d4/d13/f67 zero size 2024-02-28T16:24:35.162 INFO:tasks.workunit.client.1.smithi153.stdout:8/291: dwrite d0/d12/d15/f29 [0,4194304] 0 2024-02-28T16:24:35.162 INFO:tasks.workunit.client.1.smithi153.stdout:9/237: dwrite d1/d5/d11/d1f/d20/d36/f37 [0,4194304] 0 2024-02-28T16:24:35.167 INFO:tasks.workunit.client.1.smithi153.stdout:6/321: unlink d0/d15/d2e/f5a 0 2024-02-28T16:24:35.168 INFO:tasks.workunit.client.1.smithi153.stdout:1/290: getdents d0/d3d 0 2024-02-28T16:24:35.170 INFO:tasks.workunit.client.1.smithi153.stdout:0/316: unlink d4/d1a/c1c 0 2024-02-28T16:24:35.172 INFO:tasks.workunit.client.1.smithi153.stdout:1/291: fdatasync d0/dd/f49 0 2024-02-28T16:24:35.173 INFO:tasks.workunit.client.1.smithi153.stdout:2/298: dread d2/d23/d36/f3c [0,4194304] 0 2024-02-28T16:24:35.173 INFO:tasks.workunit.client.1.smithi153.stdout:3/323: symlink d4/d8/d1e/d2a/d35/l6e 0 2024-02-28T16:24:35.173 INFO:tasks.workunit.client.1.smithi153.stdout:9/238: rmdir d1/d2 39 2024-02-28T16:24:35.175 INFO:tasks.workunit.client.1.smithi153.stdout:9/239: chown d1/d5/d11/d29 107158 1 2024-02-28T16:24:35.177 INFO:tasks.workunit.client.1.smithi153.stdout:6/322: rmdir d0/d15/d68 39 2024-02-28T16:24:35.178 INFO:tasks.workunit.client.1.smithi153.stdout:5/285: dread da/dd/f3d [0,4194304] 0 2024-02-28T16:24:35.180 INFO:tasks.workunit.client.1.smithi153.stdout:2/299: write d2/d19/d2a/f45 [1113664,8958] 0 2024-02-28T16:24:35.181 INFO:tasks.workunit.client.1.smithi153.stdout:8/292: creat d0/f64 x:0 0 0 2024-02-28T16:24:35.183 INFO:tasks.workunit.client.1.smithi153.stdout:3/324: mkdir d4/d8/d1e/d63/d6f 0 2024-02-28T16:24:35.184 INFO:tasks.workunit.client.1.smithi153.stdout:2/300: fdatasync d2/d19/d2a/d3b/f4e 0 2024-02-28T16:24:35.185 INFO:tasks.workunit.client.1.smithi153.stdout:9/240: rmdir d1/d5/d11/d1f/d40 39 2024-02-28T16:24:35.188 INFO:tasks.workunit.client.1.smithi153.stdout:3/325: truncate d4/d13/f67 120646 0 2024-02-28T16:24:35.193 INFO:tasks.workunit.client.1.smithi153.stdout:1/292: write d0/d3d/f6d [2661034,7528] 0 2024-02-28T16:24:35.198 INFO:tasks.workunit.client.1.smithi153.stdout:8/293: dread d0/d12/d27/d30/f58 [0,4194304] 0 2024-02-28T16:24:35.199 INFO:tasks.workunit.client.1.smithi153.stdout:5/286: dwrite f1 [0,4194304] 0 2024-02-28T16:24:35.200 INFO:tasks.workunit.client.1.smithi153.stdout:9/241: write d1/d5/d11/d1f/d40/f48 [109273,101426] 0 2024-02-28T16:24:35.201 INFO:tasks.workunit.client.1.smithi153.stdout:2/301: dread d2/f21 [0,4194304] 0 2024-02-28T16:24:35.203 INFO:tasks.workunit.client.1.smithi153.stdout:0/317: creat d4/f6b x:0 0 0 2024-02-28T16:24:35.206 INFO:tasks.workunit.client.1.smithi153.stdout:8/294: dread d0/d19/d2b/f33 [0,4194304] 0 2024-02-28T16:24:35.208 INFO:tasks.workunit.client.1.smithi153.stdout:6/323: rename d0/d1d/d23/f57 to d0/d17/f75 0 2024-02-28T16:24:35.210 INFO:tasks.workunit.client.1.smithi153.stdout:8/295: truncate d0/d25/f57 954552 0 2024-02-28T16:24:35.211 INFO:tasks.workunit.client.1.smithi153.stdout:8/296: fdatasync d0/f9 0 2024-02-28T16:24:35.212 INFO:tasks.workunit.client.1.smithi153.stdout:1/293: dwrite d0/dd/f1c [0,4194304] 0 2024-02-28T16:24:35.212 INFO:tasks.workunit.client.1.smithi153.stdout:9/242: unlink d1/l12 0 2024-02-28T16:24:35.214 INFO:tasks.workunit.client.1.smithi153.stdout:3/326: mkdir d4/d8/d26/d70 0 2024-02-28T16:24:35.215 INFO:tasks.workunit.client.1.smithi153.stdout:8/297: chown d0/f9 13 1 2024-02-28T16:24:35.217 INFO:tasks.workunit.client.1.smithi153.stdout:0/318: creat d4/dc/f6c x:0 0 0 2024-02-28T16:24:35.217 INFO:tasks.workunit.client.1.smithi153.stdout:5/287: dread da/d29/f30 [0,4194304] 0 2024-02-28T16:24:35.218 INFO:tasks.workunit.client.1.smithi153.stdout:8/298: chown d0/d12/c32 31118220 1 2024-02-28T16:24:35.218 INFO:tasks.workunit.client.1.smithi153.stdout:2/302: mknod d2/d19/d3e/c5c 0 2024-02-28T16:24:35.223 INFO:tasks.workunit.client.1.smithi153.stdout:6/324: creat d0/d15/d48/d72/f76 x:0 0 0 2024-02-28T16:24:35.224 INFO:tasks.workunit.client.1.smithi153.stdout:3/327: mkdir d4/d8/d26/d41/d71 0 2024-02-28T16:24:35.229 INFO:tasks.workunit.client.1.smithi153.stdout:0/319: unlink d4/f34 0 2024-02-28T16:24:35.230 INFO:tasks.workunit.client.1.smithi153.stdout:5/288: stat da/dd/d25/d41/f49 0 2024-02-28T16:24:35.232 INFO:tasks.workunit.client.1.smithi153.stdout:8/299: creat d0/d12/d27/d30/f65 x:0 0 0 2024-02-28T16:24:35.234 INFO:tasks.workunit.client.1.smithi153.stdout:9/243: mkdir d1/d5/d11/d1f/d52 0 2024-02-28T16:24:35.234 INFO:tasks.workunit.client.1.smithi153.stdout:3/328: mknod d4/d8/d1e/d2a/d35/c72 0 2024-02-28T16:24:35.243 INFO:tasks.workunit.client.1.smithi153.stdout:1/294: rename d0/l3a to d0/l6e 0 2024-02-28T16:24:35.243 INFO:tasks.workunit.client.1.smithi153.stdout:5/289: dwrite f1 [4194304,4194304] 0 2024-02-28T16:24:35.247 INFO:tasks.workunit.client.1.smithi153.stdout:2/303: mkdir d2/d19/d5d 0 2024-02-28T16:24:35.251 INFO:tasks.workunit.client.1.smithi153.stdout:2/304: write d2/d23/d36/f51 [168178,768] 0 2024-02-28T16:24:35.251 INFO:tasks.workunit.client.1.smithi153.stdout:3/329: mknod d4/d13/d28/c73 0 2024-02-28T16:24:35.252 INFO:tasks.workunit.client.1.smithi153.stdout:2/305: readlink d2/d25/d49/l54 0 2024-02-28T16:24:35.253 INFO:tasks.workunit.client.1.smithi153.stdout:9/244: creat d1/d5/d11/d1f/d20/d45/f53 x:0 0 0 2024-02-28T16:24:35.257 INFO:tasks.workunit.client.1.smithi153.stdout:0/320: truncate d4/d1a/f31 5094885 0 2024-02-28T16:24:35.258 INFO:tasks.workunit.client.1.smithi153.stdout:1/295: mknod d0/dd/c6f 0 2024-02-28T16:24:35.258 INFO:tasks.workunit.client.1.smithi153.stdout:0/321: readlink d4/d32/l69 0 2024-02-28T16:24:35.260 INFO:tasks.workunit.client.1.smithi153.stdout:5/290: write da/dd/d54/f69 [2089430,48673] 0 2024-02-28T16:24:35.262 INFO:tasks.workunit.client.1.smithi153.stdout:5/291: chown da/f1b 1073340 1 2024-02-28T16:24:35.266 INFO:tasks.workunit.client.1.smithi153.stdout:9/245: fdatasync d1/d2/f3d 0 2024-02-28T16:24:35.267 INFO:tasks.workunit.client.1.smithi153.stdout:3/330: dwrite d4/d8/d26/f4f [0,4194304] 0 2024-02-28T16:24:35.269 INFO:tasks.workunit.client.1.smithi153.stdout:3/331: chown d4/le 5 1 2024-02-28T16:24:35.270 INFO:tasks.workunit.client.1.smithi153.stdout:3/332: dread - d4/d13/f27 zero size 2024-02-28T16:24:35.273 INFO:tasks.workunit.client.1.smithi153.stdout:0/322: rmdir d4/d32 39 2024-02-28T16:24:35.280 INFO:tasks.workunit.client.1.smithi153.stdout:8/300: creat d0/f66 x:0 0 0 2024-02-28T16:24:35.282 INFO:tasks.workunit.client.1.smithi153.stdout:2/306: dwrite d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:35.285 INFO:tasks.workunit.client.1.smithi153.stdout:2/307: write d2/d19/f38 [4622498,5573] 0 2024-02-28T16:24:35.290 INFO:tasks.workunit.client.1.smithi153.stdout:0/323: symlink d4/d1a/l6d 0 2024-02-28T16:24:35.292 INFO:tasks.workunit.client.1.smithi153.stdout:3/333: dwrite d4/d8/d26/d41/f3e [0,4194304] 0 2024-02-28T16:24:35.297 INFO:tasks.workunit.client.1.smithi153.stdout:5/292: mknod da/c6a 0 2024-02-28T16:24:35.299 INFO:tasks.workunit.client.1.smithi153.stdout:5/293: truncate da/f51 285144 0 2024-02-28T16:24:35.300 INFO:tasks.workunit.client.1.smithi153.stdout:4/257: sync 2024-02-28T16:24:35.302 INFO:tasks.workunit.client.1.smithi153.stdout:2/308: read d2/d25/f3d [2273508,102272] 0 2024-02-28T16:24:35.303 INFO:tasks.workunit.client.1.smithi153.stdout:4/258: read d4/f15 [112314,5673] 0 2024-02-28T16:24:35.304 INFO:tasks.workunit.client.1.smithi153.stdout:4/259: chown d4 32 1 2024-02-28T16:24:35.305 INFO:tasks.workunit.client.1.smithi153.stdout:1/296: creat d0/f70 x:0 0 0 2024-02-28T16:24:35.305 INFO:tasks.workunit.client.1.smithi153.stdout:4/260: chown d4/de 14 1 2024-02-28T16:24:35.313 INFO:tasks.workunit.client.1.smithi153.stdout:2/309: mkdir d2/d19/d2a/d3b/d5e 0 2024-02-28T16:24:35.315 INFO:tasks.workunit.client.1.smithi153.stdout:0/324: chown d4/d27/f5a 0 1 2024-02-28T16:24:35.315 INFO:tasks.workunit.client.1.smithi153.stdout:1/297: fdatasync d0/d3d/f3e 0 2024-02-28T16:24:35.317 INFO:tasks.workunit.client.1.smithi153.stdout:1/298: write d0/d3d/f3e [1484874,46874] 0 2024-02-28T16:24:35.319 INFO:tasks.workunit.client.1.smithi153.stdout:9/246: truncate d1/d2/f46 3372447 0 2024-02-28T16:24:35.321 INFO:tasks.workunit.client.1.smithi153.stdout:8/301: rename d0/d12/d27 to d0/d12/d67 0 2024-02-28T16:24:35.324 INFO:tasks.workunit.client.1.smithi153.stdout:5/294: fsync da/fc 0 2024-02-28T16:24:35.329 INFO:tasks.workunit.client.1.smithi153.stdout:3/334: link d4/cc d4/d8/d1e/d64/c74 0 2024-02-28T16:24:35.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/299: rename d0/d3d/f68 to d0/d3d/f71 0 2024-02-28T16:24:35.333 INFO:tasks.workunit.client.1.smithi153.stdout:0/325: dwrite d4/f53 [4194304,4194304] 0 2024-02-28T16:24:35.334 INFO:tasks.workunit.client.1.smithi153.stdout:8/302: unlink d0/d12/d15/f18 0 2024-02-28T16:24:35.336 INFO:tasks.workunit.client.1.smithi153.stdout:9/247: dwrite d1/d2a/f42 [0,4194304] 0 2024-02-28T16:24:35.337 INFO:tasks.workunit.client.1.smithi153.stdout:2/310: symlink d2/d23/d48/l5f 0 2024-02-28T16:24:35.343 INFO:tasks.workunit.client.1.smithi153.stdout:7/323: sync 2024-02-28T16:24:35.345 INFO:tasks.workunit.client.1.smithi153.stdout:7/324: stat d1/c29 0 2024-02-28T16:24:35.350 INFO:tasks.workunit.client.1.smithi153.stdout:0/326: creat d4/d1a/f6e x:0 0 0 2024-02-28T16:24:35.352 INFO:tasks.workunit.client.1.smithi153.stdout:4/261: getdents d4/de 0 2024-02-28T16:24:35.353 INFO:tasks.workunit.client.1.smithi153.stdout:4/262: readlink d4/de/l1a 0 2024-02-28T16:24:35.357 INFO:tasks.workunit.client.1.smithi153.stdout:5/295: write da/dd/d25/d41/f49 [4767832,100300] 0 2024-02-28T16:24:35.357 INFO:tasks.workunit.client.1.smithi153.stdout:7/325: creat d1/d25/df/d26/d3a/d5e/f68 x:0 0 0 2024-02-28T16:24:35.358 INFO:tasks.workunit.client.1.smithi153.stdout:2/311: dwrite d2/d23/d36/f51 [0,4194304] 0 2024-02-28T16:24:35.361 INFO:tasks.workunit.client.1.smithi153.stdout:9/248: mkdir d1/d5/d11/d54 0 2024-02-28T16:24:35.362 INFO:tasks.workunit.client.1.smithi153.stdout:0/327: symlink d4/d1a/d65/l6f 0 2024-02-28T16:24:35.366 INFO:tasks.workunit.client.1.smithi153.stdout:1/300: truncate d0/f23 534187 0 2024-02-28T16:24:35.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/296: chown da/dd/ff 7970 1 2024-02-28T16:24:35.367 INFO:tasks.workunit.client.1.smithi153.stdout:3/335: dwrite d4/d8/f1c [0,4194304] 0 2024-02-28T16:24:35.369 INFO:tasks.workunit.client.1.smithi153.stdout:2/312: symlink d2/d19/d3e/l60 0 2024-02-28T16:24:35.378 INFO:tasks.workunit.client.1.smithi153.stdout:0/328: read d4/d32/f36 [5560780,78945] 0 2024-02-28T16:24:35.380 INFO:tasks.workunit.client.1.smithi153.stdout:1/301: creat d0/d3d/f72 x:0 0 0 2024-02-28T16:24:35.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/303: dread d0/ff [0,4194304] 0 2024-02-28T16:24:35.382 INFO:tasks.workunit.client.1.smithi153.stdout:1/302: chown d0/dd/d67 2587241 1 2024-02-28T16:24:35.388 INFO:tasks.workunit.client.1.smithi153.stdout:4/263: getdents d4 0 2024-02-28T16:24:35.389 INFO:tasks.workunit.client.1.smithi153.stdout:5/297: dwrite da/dd/d25/d41/f46 [0,4194304] 0 2024-02-28T16:24:35.389 INFO:tasks.workunit.client.1.smithi153.stdout:2/313: fdatasync d2/f1c 0 2024-02-28T16:24:35.392 INFO:tasks.workunit.client.1.smithi153.stdout:7/326: mknod d1/d25/df/d26/d3a/d52/d63/c69 0 2024-02-28T16:24:35.395 INFO:tasks.workunit.client.1.smithi153.stdout:3/336: rename d4/d13/d28/d36/c3b to d4/d8/d1e/d63/c75 0 2024-02-28T16:24:35.397 INFO:tasks.workunit.client.1.smithi153.stdout:5/298: dread - da/f44 zero size 2024-02-28T16:24:35.398 INFO:tasks.workunit.client.1.smithi153.stdout:5/299: readlink da/dd/l1d 0 2024-02-28T16:24:35.401 INFO:tasks.workunit.client.1.smithi153.stdout:1/303: rmdir d0/dd/d67 39 2024-02-28T16:24:35.403 INFO:tasks.workunit.client.1.smithi153.stdout:8/304: creat d0/d34/f68 x:0 0 0 2024-02-28T16:24:35.409 INFO:tasks.workunit.client.1.smithi153.stdout:1/304: chown d0/d3d/d4a/d59/l5f 1832 1 2024-02-28T16:24:35.410 INFO:tasks.workunit.client.1.smithi153.stdout:2/314: mkdir d2/d19/d2a/d3b/d5e/d61 0 2024-02-28T16:24:35.414 INFO:tasks.workunit.client.1.smithi153.stdout:5/300: mknod da/c6b 0 2024-02-28T16:24:35.418 INFO:tasks.workunit.client.1.smithi153.stdout:0/329: rename d4/dc/d5c/c63 to d4/d27/c70 0 2024-02-28T16:24:35.418 INFO:tasks.workunit.client.1.smithi153.stdout:5/301: rmdir da/d29/d43/d5a 39 2024-02-28T16:24:35.424 INFO:tasks.workunit.client.1.smithi153.stdout:7/327: rename d1/d25/df/c51 to d1/d25/d27/d43/c6a 0 2024-02-28T16:24:35.424 INFO:tasks.workunit.client.1.smithi153.stdout:0/330: symlink d4/d27/l71 0 2024-02-28T16:24:35.426 INFO:tasks.workunit.client.1.smithi153.stdout:0/331: readlink d4/d1a/l6d 0 2024-02-28T16:24:35.427 INFO:tasks.workunit.client.1.smithi153.stdout:9/249: rename d1/d5/d11/d1f/f4c to d1/d5/d11/d1f/d20/d45/f55 0 2024-02-28T16:24:35.428 INFO:tasks.workunit.client.1.smithi153.stdout:3/337: dread d4/d8/d1e/f42 [0,4194304] 0 2024-02-28T16:24:35.428 INFO:tasks.workunit.client.1.smithi153.stdout:6/325: sync 2024-02-28T16:24:35.429 INFO:tasks.workunit.client.1.smithi153.stdout:2/315: dwrite d2/f26 [0,4194304] 0 2024-02-28T16:24:35.430 INFO:tasks.workunit.client.1.smithi153.stdout:0/332: creat d4/d1a/d65/f72 x:0 0 0 2024-02-28T16:24:35.432 INFO:tasks.workunit.client.1.smithi153.stdout:7/328: write d1/d25/df/f4e [1272268,18491] 0 2024-02-28T16:24:35.433 INFO:tasks.workunit.client.1.smithi153.stdout:1/305: dwrite d0/f25 [0,4194304] 0 2024-02-28T16:24:35.434 INFO:tasks.workunit.client.1.smithi153.stdout:9/250: truncate d1/f4e 342263 0 2024-02-28T16:24:35.434 INFO:tasks.workunit.client.1.smithi153.stdout:6/326: creat d0/d1d/d34/f77 x:0 0 0 2024-02-28T16:24:35.437 INFO:tasks.workunit.client.1.smithi153.stdout:5/302: dread f1 [0,4194304] 0 2024-02-28T16:24:35.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/333: fdatasync d4/d27/f3a 0 2024-02-28T16:24:35.443 INFO:tasks.workunit.client.1.smithi153.stdout:3/338: getdents d4/d8/d26/d70 0 2024-02-28T16:24:35.447 INFO:tasks.workunit.client.1.smithi153.stdout:6/327: symlink d0/d1d/d5d/l78 0 2024-02-28T16:24:35.448 INFO:tasks.workunit.client.1.smithi153.stdout:1/306: mknod d0/dd/c73 0 2024-02-28T16:24:35.448 INFO:tasks.workunit.client.1.smithi153.stdout:2/316: dread d2/f7 [0,4194304] 0 2024-02-28T16:24:35.451 INFO:tasks.workunit.client.1.smithi153.stdout:9/251: symlink d1/d5/l56 0 2024-02-28T16:24:35.453 INFO:tasks.workunit.client.1.smithi153.stdout:7/329: mknod d1/d25/df/d26/d3a/d3f/c6b 0 2024-02-28T16:24:35.453 INFO:tasks.workunit.client.1.smithi153.stdout:3/339: mknod d4/d8/c76 0 2024-02-28T16:24:35.456 INFO:tasks.workunit.client.1.smithi153.stdout:2/317: symlink d2/d25/d49/l62 0 2024-02-28T16:24:35.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/303: creat da/f6c x:0 0 0 2024-02-28T16:24:35.462 INFO:tasks.workunit.client.1.smithi153.stdout:0/334: creat d4/d27/f73 x:0 0 0 2024-02-28T16:24:35.464 INFO:tasks.workunit.client.1.smithi153.stdout:5/304: fdatasync da/dd/d54/f69 0 2024-02-28T16:24:35.464 INFO:tasks.workunit.client.1.smithi153.stdout:1/307: link d0/fe d0/f74 0 2024-02-28T16:24:35.465 INFO:tasks.workunit.client.1.smithi153.stdout:0/335: stat d4/dc/c15 0 2024-02-28T16:24:35.465 INFO:tasks.workunit.client.1.smithi153.stdout:2/318: mkdir d2/d63 0 2024-02-28T16:24:35.468 INFO:tasks.workunit.client.1.smithi153.stdout:5/305: read - da/dd/d25/f55 zero size 2024-02-28T16:24:35.469 INFO:tasks.workunit.client.1.smithi153.stdout:9/252: link d1/d5/d11/c13 d1/d5/d11/d29/c57 0 2024-02-28T16:24:35.470 INFO:tasks.workunit.client.1.smithi153.stdout:6/328: dwrite d0/d15/d2e/f37 [0,4194304] 0 2024-02-28T16:24:35.471 INFO:tasks.workunit.client.1.smithi153.stdout:1/308: mknod d0/d62/d66/c75 0 2024-02-28T16:24:35.476 INFO:tasks.workunit.client.1.smithi153.stdout:0/336: rename d4/d1a/l57 to d4/d1a/d65/l74 0 2024-02-28T16:24:35.476 INFO:tasks.workunit.client.1.smithi153.stdout:9/253: mkdir d1/d58 0 2024-02-28T16:24:35.477 INFO:tasks.workunit.client.1.smithi153.stdout:7/330: dwrite d1/d25/f9 [0,4194304] 0 2024-02-28T16:24:35.480 INFO:tasks.workunit.client.1.smithi153.stdout:3/340: dwrite d4/f1f [0,4194304] 0 2024-02-28T16:24:35.481 INFO:tasks.workunit.client.1.smithi153.stdout:0/337: chown d4/dc/f18 24184574 1 2024-02-28T16:24:35.481 INFO:tasks.workunit.client.1.smithi153.stdout:2/319: rename d2/d23/d36/l57 to d2/d23/d36/l64 0 2024-02-28T16:24:35.483 INFO:tasks.workunit.client.1.smithi153.stdout:0/338: dread - d4/f3c zero size 2024-02-28T16:24:35.488 INFO:tasks.workunit.client.1.smithi153.stdout:2/320: write d2/d4b/f50 [554373,6812] 0 2024-02-28T16:24:35.492 INFO:tasks.workunit.client.1.smithi153.stdout:1/309: link d0/d3d/f6b d0/dd/f76 0 2024-02-28T16:24:35.493 INFO:tasks.workunit.client.1.smithi153.stdout:7/331: creat d1/f6c x:0 0 0 2024-02-28T16:24:35.497 INFO:tasks.workunit.client.1.smithi153.stdout:2/321: creat d2/d19/d3e/f65 x:0 0 0 2024-02-28T16:24:35.499 INFO:tasks.workunit.client.1.smithi153.stdout:5/306: dwrite da/dd/d25/f55 [0,4194304] 0 2024-02-28T16:24:35.499 INFO:tasks.workunit.client.1.smithi153.stdout:7/332: mknod d1/d25/d27/c6d 0 2024-02-28T16:24:35.503 INFO:tasks.workunit.client.1.smithi153.stdout:9/254: rename d1/d5/d11/f50 to d1/d5/f59 0 2024-02-28T16:24:35.507 INFO:tasks.workunit.client.1.smithi153.stdout:7/333: unlink d1/d25/d27/f59 0 2024-02-28T16:24:35.512 INFO:tasks.workunit.client.1.smithi153.stdout:0/339: dwrite d4/d1a/f37 [0,4194304] 0 2024-02-28T16:24:35.514 INFO:tasks.workunit.client.1.smithi153.stdout:5/307: dread da/f35 [0,4194304] 0 2024-02-28T16:24:35.517 INFO:tasks.workunit.client.1.smithi153.stdout:5/308: readlink da/d29/l3f 0 2024-02-28T16:24:35.519 INFO:tasks.workunit.client.1.smithi153.stdout:5/309: fsync da/dd/d25/f5d 0 2024-02-28T16:24:35.520 INFO:tasks.workunit.client.1.smithi153.stdout:1/310: dwrite d0/d3d/d4a/d59/f63 [0,4194304] 0 2024-02-28T16:24:35.526 INFO:tasks.workunit.client.1.smithi153.stdout:2/322: dread d2/d4b/f50 [0,4194304] 0 2024-02-28T16:24:35.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/340: rename d4/d1a/f6e to d4/f75 0 2024-02-28T16:24:35.532 INFO:tasks.workunit.client.1.smithi153.stdout:7/334: dwrite d1/d25/fe [0,4194304] 0 2024-02-28T16:24:35.536 INFO:tasks.workunit.client.1.smithi153.stdout:5/310: dread da/dd/d25/f2e [0,4194304] 0 2024-02-28T16:24:35.536 INFO:tasks.workunit.client.1.smithi153.stdout:1/311: mknod d0/d3d/d4a/c77 0 2024-02-28T16:24:35.536 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:35 smithi153 ceph-mon[35341]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 12 MiB/s rd, 111 MiB/s wr, 203 op/s 2024-02-28T16:24:35.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:35 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:35.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:35 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:35.537 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:35 smithi023 ceph-mon[29137]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 12 MiB/s rd, 111 MiB/s wr, 203 op/s 2024-02-28T16:24:35.537 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:35 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:35.537 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:35 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:35.538 INFO:tasks.workunit.client.1.smithi153.stdout:1/312: dread - d0/d3d/d4a/f61 zero size 2024-02-28T16:24:35.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/323: symlink d2/d19/d2a/d3b/d5e/l66 0 2024-02-28T16:24:35.545 INFO:tasks.workunit.client.1.smithi153.stdout:2/324: dread d2/f6 [4194304,4194304] 0 2024-02-28T16:24:35.549 INFO:tasks.workunit.client.1.smithi153.stdout:0/341: symlink d4/d1a/d65/l76 0 2024-02-28T16:24:35.553 INFO:tasks.workunit.client.1.smithi153.stdout:7/335: creat d1/d25/df/d26/d3a/d52/f6e x:0 0 0 2024-02-28T16:24:35.556 INFO:tasks.workunit.client.1.smithi153.stdout:5/311: fdatasync da/d29/f30 0 2024-02-28T16:24:35.558 INFO:tasks.workunit.client.1.smithi153.stdout:5/312: write da/d29/f30 [545906,22274] 0 2024-02-28T16:24:35.559 INFO:tasks.workunit.client.1.smithi153.stdout:2/325: dread d2/d23/d36/f51 [0,4194304] 0 2024-02-28T16:24:35.561 INFO:tasks.workunit.client.1.smithi153.stdout:1/313: dread d0/f74 [4194304,4194304] 0 2024-02-28T16:24:35.562 INFO:tasks.workunit.client.1.smithi153.stdout:1/314: chown d0/f74 12 1 2024-02-28T16:24:35.579 INFO:tasks.workunit.client.1.smithi153.stdout:2/326: fdatasync d2/f6 0 2024-02-28T16:24:35.588 INFO:tasks.workunit.client.1.smithi153.stdout:2/327: dread d2/f26 [0,4194304] 0 2024-02-28T16:24:35.590 INFO:tasks.workunit.client.1.smithi153.stdout:2/328: fsync d2/d19/d2a/f30 0 2024-02-28T16:24:35.598 INFO:tasks.workunit.client.1.smithi153.stdout:0/342: link d4/c62 d4/d32/c77 0 2024-02-28T16:24:35.602 INFO:tasks.workunit.client.1.smithi153.stdout:4/264: sync 2024-02-28T16:24:35.608 INFO:tasks.workunit.client.1.smithi153.stdout:5/313: rename da/l3c to da/d29/d43/d5a/l6d 0 2024-02-28T16:24:35.610 INFO:tasks.workunit.client.1.smithi153.stdout:5/314: dread - da/d29/f3e zero size 2024-02-28T16:24:35.613 INFO:tasks.workunit.client.1.smithi153.stdout:1/315: rename d0/f70 to d0/f78 0 2024-02-28T16:24:35.615 INFO:tasks.workunit.client.1.smithi153.stdout:1/316: write d0/d3d/f4e [76774,108220] 0 2024-02-28T16:24:35.615 INFO:tasks.workunit.client.1.smithi153.stdout:0/343: readlink d4/d27/l41 0 2024-02-28T16:24:35.615 INFO:tasks.workunit.client.1.smithi153.stdout:7/336: link d1/d25/df/c34 d1/d25/dc/d50/c6f 0 2024-02-28T16:24:35.616 INFO:tasks.workunit.client.1.smithi153.stdout:4/265: creat d4/de/d40/f5a x:0 0 0 2024-02-28T16:24:35.618 INFO:tasks.workunit.client.1.smithi153.stdout:9/255: symlink d1/d5/d11/d1f/l5a 0 2024-02-28T16:24:35.620 INFO:tasks.workunit.client.1.smithi153.stdout:1/317: symlink d0/d62/l79 0 2024-02-28T16:24:35.621 INFO:tasks.workunit.client.1.smithi153.stdout:4/266: mknod d4/d3c/c5b 0 2024-02-28T16:24:35.621 INFO:tasks.workunit.client.1.smithi153.stdout:7/337: truncate d1/d25/df/d26/d3a/d52/f6e 854038 0 2024-02-28T16:24:35.622 INFO:tasks.workunit.client.1.smithi153.stdout:2/329: creat d2/f67 x:0 0 0 2024-02-28T16:24:35.623 INFO:tasks.workunit.client.1.smithi153.stdout:9/256: mknod d1/d5/d11/d1f/d43/c5b 0 2024-02-28T16:24:35.625 INFO:tasks.workunit.client.1.smithi153.stdout:7/338: mkdir d1/d70 0 2024-02-28T16:24:35.627 INFO:tasks.workunit.client.1.smithi153.stdout:4/267: symlink d4/de/d23/d2b/d4b/l5c 0 2024-02-28T16:24:35.632 INFO:tasks.workunit.client.1.smithi153.stdout:4/268: creat d4/de/d40/d4d/f5d x:0 0 0 2024-02-28T16:24:35.633 INFO:tasks.workunit.client.1.smithi153.stdout:7/339: truncate d1/d25/dc/d50/f5b 323386 0 2024-02-28T16:24:35.635 INFO:tasks.workunit.client.1.smithi153.stdout:2/330: dread d2/d19/d2a/f47 [0,4194304] 0 2024-02-28T16:24:35.638 INFO:tasks.workunit.client.1.smithi153.stdout:4/269: fdatasync d4/f15 0 2024-02-28T16:24:35.639 INFO:tasks.workunit.client.1.smithi153.stdout:5/315: dwrite da/dd/fe [0,4194304] 0 2024-02-28T16:24:35.640 INFO:tasks.workunit.client.1.smithi153.stdout:2/331: chown d2/d25/l4c 64366872 1 2024-02-28T16:24:35.642 INFO:tasks.workunit.client.1.smithi153.stdout:7/340: symlink d1/d25/df/d5a/l71 0 2024-02-28T16:24:35.643 INFO:tasks.workunit.client.1.smithi153.stdout:0/344: dwrite d4/f75 [0,4194304] 0 2024-02-28T16:24:35.643 INFO:tasks.workunit.client.1.smithi153.stdout:4/270: chown d4/de/d13/f18 22 1 2024-02-28T16:24:35.649 INFO:tasks.workunit.client.1.smithi153.stdout:5/316: mknod da/dd/d25/d41/c6e 0 2024-02-28T16:24:35.650 INFO:tasks.workunit.client.1.smithi153.stdout:4/271: mkdir d4/de/d47/d5e 0 2024-02-28T16:24:35.653 INFO:tasks.workunit.client.1.smithi153.stdout:7/341: mkdir d1/d25/df/d26/d3a/d5e/d72 0 2024-02-28T16:24:35.655 INFO:tasks.workunit.client.1.smithi153.stdout:9/257: dread d1/d5/d11/d1f/d20/d36/f38 [4194304,4194304] 0 2024-02-28T16:24:35.656 INFO:tasks.workunit.client.1.smithi153.stdout:2/332: dread d2/f7 [0,4194304] 0 2024-02-28T16:24:35.660 INFO:tasks.workunit.client.1.smithi153.stdout:4/272: creat d4/de/d13/d1b/f5f x:0 0 0 2024-02-28T16:24:35.666 INFO:tasks.workunit.client.1.smithi153.stdout:0/345: link d4/dc/f18 d4/f78 0 2024-02-28T16:24:35.666 INFO:tasks.workunit.client.1.smithi153.stdout:9/258: creat d1/d2a/f5c x:0 0 0 2024-02-28T16:24:35.666 INFO:tasks.workunit.client.1.smithi153.stdout:0/346: chown d4/dc/d5c 605672 1 2024-02-28T16:24:35.668 INFO:tasks.workunit.client.1.smithi153.stdout:9/259: write d1/d2a/f42 [3822306,68944] 0 2024-02-28T16:24:35.669 INFO:tasks.workunit.client.1.smithi153.stdout:7/342: mknod d1/d70/c73 0 2024-02-28T16:24:35.669 INFO:tasks.workunit.client.1.smithi153.stdout:2/333: write d2/f20 [3031150,61377] 0 2024-02-28T16:24:35.670 INFO:tasks.workunit.client.1.smithi153.stdout:9/260: readlink d1/d2/l22 0 2024-02-28T16:24:35.674 INFO:tasks.workunit.client.1.smithi153.stdout:0/347: chown d4/d27/c28 94 1 2024-02-28T16:24:35.677 INFO:tasks.workunit.client.1.smithi153.stdout:7/343: rmdir d1/d25/df/d5a 39 2024-02-28T16:24:35.680 INFO:tasks.workunit.client.1.smithi153.stdout:9/261: mkdir d1/d5/d11/d1f/d20/d5d 0 2024-02-28T16:24:35.681 INFO:tasks.workunit.client.1.smithi153.stdout:4/273: dwrite d4/de/d23/f37 [4194304,4194304] 0 2024-02-28T16:24:35.681 INFO:tasks.workunit.client.1.smithi153.stdout:7/344: write d1/d25/df/d26/d3a/d5e/f68 [121323,62546] 0 2024-02-28T16:24:35.682 INFO:tasks.workunit.client.1.smithi153.stdout:9/262: dread - d1/d5/d11/d1f/d20/f49 zero size 2024-02-28T16:24:35.686 INFO:tasks.workunit.client.1.smithi153.stdout:0/348: rename d4/c38 to d4/d1a/d65/c79 0 2024-02-28T16:24:35.690 INFO:tasks.workunit.client.1.smithi153.stdout:7/345: creat d1/d25/df/d26/d3a/d3f/f74 x:0 0 0 2024-02-28T16:24:35.692 INFO:tasks.workunit.client.1.smithi153.stdout:9/263: mknod d1/d5/d11/d1f/d43/c5e 0 2024-02-28T16:24:35.697 INFO:tasks.workunit.client.1.smithi153.stdout:2/334: truncate d2/f21 2410782 0 2024-02-28T16:24:35.698 INFO:tasks.workunit.client.1.smithi153.stdout:7/346: mkdir d1/d25/df/d26/d3a/d52/d63/d75 0 2024-02-28T16:24:35.699 INFO:tasks.workunit.client.1.smithi153.stdout:5/317: dwrite da/dd/d25/f58 [0,4194304] 0 2024-02-28T16:24:35.701 INFO:tasks.workunit.client.1.smithi153.stdout:9/264: rename d1/d5/d27/f3b to d1/d5/d11/d1f/d20/d5d/f5f 0 2024-02-28T16:24:35.702 INFO:tasks.workunit.client.1.smithi153.stdout:7/347: read d1/d25/df/d26/d3a/d52/f6e [659014,6524] 0 2024-02-28T16:24:35.702 INFO:tasks.workunit.client.1.smithi153.stdout:2/335: creat d2/d19/d2a/d3b/f68 x:0 0 0 2024-02-28T16:24:35.703 INFO:tasks.workunit.client.1.smithi153.stdout:4/274: getdents d4/de/d13/d1b/d4e/d50 0 2024-02-28T16:24:35.703 INFO:tasks.workunit.client.1.smithi153.stdout:7/348: readlink d1/d25/d27/l28 0 2024-02-28T16:24:35.710 INFO:tasks.workunit.client.1.smithi153.stdout:9/265: chown d1/d2/l2f 8 1 2024-02-28T16:24:35.711 INFO:tasks.workunit.client.1.smithi153.stdout:2/336: symlink d2/d19/d4f/l69 0 2024-02-28T16:24:35.711 INFO:tasks.workunit.client.1.smithi153.stdout:9/266: read d1/f34 [679296,48933] 0 2024-02-28T16:24:35.717 INFO:tasks.workunit.client.1.smithi153.stdout:7/349: chown d1/d25/c14 1 1 2024-02-28T16:24:35.722 INFO:tasks.workunit.client.1.smithi153.stdout:5/318: symlink da/d29/l6f 0 2024-02-28T16:24:35.722 INFO:tasks.workunit.client.1.smithi153.stdout:0/349: truncate d4/f53 598688 0 2024-02-28T16:24:35.727 INFO:tasks.workunit.client.1.smithi153.stdout:5/319: dread da/f42 [0,4194304] 0 2024-02-28T16:24:35.728 INFO:tasks.workunit.client.1.smithi153.stdout:7/350: mkdir d1/d25/df/d26/d76 0 2024-02-28T16:24:35.733 INFO:tasks.workunit.client.1.smithi153.stdout:9/267: rename d1/d2/c35 to d1/d5/d11/d1f/d20/d45/c60 0 2024-02-28T16:24:35.736 INFO:tasks.workunit.client.1.smithi153.stdout:9/268: read d1/d5/f47 [2412998,31601] 0 2024-02-28T16:24:35.736 INFO:tasks.workunit.client.1.smithi153.stdout:6/329: sync 2024-02-28T16:24:35.736 INFO:tasks.workunit.client.1.smithi153.stdout:8/305: sync 2024-02-28T16:24:35.736 INFO:tasks.workunit.client.1.smithi153.stdout:3/341: sync 2024-02-28T16:24:35.739 INFO:tasks.workunit.client.1.smithi153.stdout:2/337: write d2/f1c [652183,96788] 0 2024-02-28T16:24:35.740 INFO:tasks.workunit.client.1.smithi153.stdout:5/320: mknod da/dd/c70 0 2024-02-28T16:24:35.741 INFO:tasks.workunit.client.1.smithi153.stdout:4/275: dread d4/de/f57 [0,4194304] 0 2024-02-28T16:24:35.745 INFO:tasks.workunit.client.1.smithi153.stdout:7/351: mknod d1/d25/c77 0 2024-02-28T16:24:35.750 INFO:tasks.workunit.client.1.smithi153.stdout:2/338: creat d2/d19/d31/f6a x:0 0 0 2024-02-28T16:24:35.753 INFO:tasks.workunit.client.1.smithi153.stdout:4/276: creat d4/de/f60 x:0 0 0 2024-02-28T16:24:35.754 INFO:tasks.workunit.client.1.smithi153.stdout:4/277: chown d4/de/d40/f5a 117647802 1 2024-02-28T16:24:35.756 INFO:tasks.workunit.client.1.smithi153.stdout:4/278: write d4/de/d40/f49 [384159,624] 0 2024-02-28T16:24:35.757 INFO:tasks.workunit.client.1.smithi153.stdout:0/350: getdents d4/dc/d5c 0 2024-02-28T16:24:35.760 INFO:tasks.workunit.client.1.smithi153.stdout:9/269: dwrite d1/d5/d27/f41 [0,4194304] 0 2024-02-28T16:24:35.769 INFO:tasks.workunit.client.1.smithi153.stdout:7/352: creat d1/d25/df/d5a/f78 x:0 0 0 2024-02-28T16:24:35.770 INFO:tasks.workunit.client.1.smithi153.stdout:0/351: dread d4/d27/f3a [0,4194304] 0 2024-02-28T16:24:35.770 INFO:tasks.workunit.client.1.smithi153.stdout:3/342: link d4/f1f d4/f77 0 2024-02-28T16:24:35.773 INFO:tasks.workunit.client.1.smithi153.stdout:5/321: rename da/f1b to da/dd/d25/f71 0 2024-02-28T16:24:35.776 INFO:tasks.workunit.client.1.smithi153.stdout:6/330: truncate d0/d15/f1a 626863 0 2024-02-28T16:24:35.778 INFO:tasks.workunit.client.1.smithi153.stdout:8/306: truncate d0/d19/d1e/f40 1968037 0 2024-02-28T16:24:35.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/352: creat d4/d1a/d65/f7a x:0 0 0 2024-02-28T16:24:35.782 INFO:tasks.workunit.client.1.smithi153.stdout:3/343: unlink d4/d8/d1e/l2d 0 2024-02-28T16:24:35.783 INFO:tasks.workunit.client.1.smithi153.stdout:7/353: dwrite d1/d25/df/f47 [0,4194304] 0 2024-02-28T16:24:35.784 INFO:tasks.workunit.client.1.smithi153.stdout:9/270: rename d1/d2 to d1/d5/d27/d61 0 2024-02-28T16:24:35.786 INFO:tasks.workunit.client.1.smithi153.stdout:9/271: dread - d1/d5/d11/d1f/d20/d45/f53 zero size 2024-02-28T16:24:35.786 INFO:tasks.workunit.client.1.smithi153.stdout:5/322: mknod da/dd/d25/d41/c72 0 2024-02-28T16:24:35.787 INFO:tasks.workunit.client.1.smithi153.stdout:2/339: truncate d2/d19/d2a/d3b/f4e 3485996 0 2024-02-28T16:24:35.787 INFO:tasks.workunit.client.1.smithi153.stdout:5/323: dread - da/f6c zero size 2024-02-28T16:24:35.789 INFO:tasks.workunit.client.1.smithi153.stdout:6/331: symlink d0/d15/d48/l79 0 2024-02-28T16:24:35.790 INFO:tasks.workunit.client.1.smithi153.stdout:0/353: mknod d4/dc/d5c/c7b 0 2024-02-28T16:24:35.791 INFO:tasks.workunit.client.1.smithi153.stdout:0/354: fdatasync d4/f45 0 2024-02-28T16:24:35.797 INFO:tasks.workunit.client.1.smithi153.stdout:7/354: mknod d1/d25/df/d26/d3a/c79 0 2024-02-28T16:24:35.798 INFO:tasks.workunit.client.1.smithi153.stdout:3/344: dread d4/d8/f10 [0,4194304] 0 2024-02-28T16:24:35.800 INFO:tasks.workunit.client.1.smithi153.stdout:7/355: truncate d1/f6c 926937 0 2024-02-28T16:24:35.806 INFO:tasks.workunit.client.1.smithi153.stdout:6/332: creat d0/d1d/d33/f7a x:0 0 0 2024-02-28T16:24:35.807 INFO:tasks.workunit.client.1.smithi153.stdout:2/340: dwrite d2/f11 [4194304,4194304] 0 2024-02-28T16:24:35.815 INFO:tasks.workunit.client.1.smithi153.stdout:3/345: mknod d4/d8/d1e/d63/c78 0 2024-02-28T16:24:35.816 INFO:tasks.workunit.client.1.smithi153.stdout:3/346: chown d4/d2c 15748 1 2024-02-28T16:24:35.816 INFO:tasks.workunit.client.1.smithi153.stdout:9/272: dwrite d1/d5/d11/d1f/d20/d45/f55 [0,4194304] 0 2024-02-28T16:24:35.825 INFO:tasks.workunit.client.1.smithi153.stdout:5/324: creat da/f73 x:0 0 0 2024-02-28T16:24:35.828 INFO:tasks.workunit.client.1.smithi153.stdout:7/356: unlink d1/d25/c30 0 2024-02-28T16:24:35.831 INFO:tasks.workunit.client.1.smithi153.stdout:8/307: read d0/d19/d1e/f40 [430540,36752] 0 2024-02-28T16:24:35.835 INFO:tasks.workunit.client.1.smithi153.stdout:0/355: write d4/f13 [5212565,30482] 0 2024-02-28T16:24:35.835 INFO:tasks.workunit.client.1.smithi153.stdout:9/273: dwrite d1/d5/d11/d1f/d20/f3e [0,4194304] 0 2024-02-28T16:24:35.836 INFO:tasks.workunit.client.1.smithi153.stdout:2/341: dread d2/f26 [0,4194304] 0 2024-02-28T16:24:35.838 INFO:tasks.workunit.client.1.smithi153.stdout:0/356: write d4/f6b [125589,1225] 0 2024-02-28T16:24:35.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/308: mknod d0/d34/d50/c69 0 2024-02-28T16:24:35.845 INFO:tasks.workunit.client.1.smithi153.stdout:5/325: rename da/dd/d25/l66 to da/dd/d25/l74 0 2024-02-28T16:24:35.851 INFO:tasks.workunit.client.1.smithi153.stdout:2/342: creat d2/d19/d2a/f6b x:0 0 0 2024-02-28T16:24:35.852 INFO:tasks.workunit.client.1.smithi153.stdout:2/343: fdatasync d2/d23/f42 0 2024-02-28T16:24:35.853 INFO:tasks.workunit.client.1.smithi153.stdout:8/309: rmdir d0/d25 39 2024-02-28T16:24:35.854 INFO:tasks.workunit.client.1.smithi153.stdout:8/310: stat d0/d19/d1c 0 2024-02-28T16:24:35.854 INFO:tasks.workunit.client.1.smithi153.stdout:3/347: dread d4/d8/d1e/d2a/d35/f39 [0,4194304] 0 2024-02-28T16:24:35.854 INFO:tasks.workunit.client.1.smithi153.stdout:2/344: write d2/f67 [7865,118953] 0 2024-02-28T16:24:35.855 INFO:tasks.workunit.client.1.smithi153.stdout:7/357: link d1/d25/dc/c22 d1/d25/dc/d50/d66/c7a 0 2024-02-28T16:24:35.855 INFO:tasks.workunit.client.1.smithi153.stdout:5/326: symlink da/d29/d43/d5a/l75 0 2024-02-28T16:24:35.857 INFO:tasks.workunit.client.1.smithi153.stdout:9/274: mkdir d1/d5/d11/d1f/d62 0 2024-02-28T16:24:35.862 INFO:tasks.workunit.client.1.smithi153.stdout:3/348: rmdir d4 39 2024-02-28T16:24:35.864 INFO:tasks.workunit.client.1.smithi153.stdout:8/311: symlink d0/d19/d1e/l6a 0 2024-02-28T16:24:35.865 INFO:tasks.workunit.client.1.smithi153.stdout:8/312: write d0/f8 [3021977,64404] 0 2024-02-28T16:24:35.867 INFO:tasks.workunit.client.1.smithi153.stdout:2/345: write d2/d4b/f50 [1304813,21737] 0 2024-02-28T16:24:35.868 INFO:tasks.workunit.client.1.smithi153.stdout:2/346: chown d2/c15 1383321 1 2024-02-28T16:24:35.869 INFO:tasks.workunit.client.1.smithi153.stdout:0/357: creat d4/d27/f7c x:0 0 0 2024-02-28T16:24:35.870 INFO:tasks.workunit.client.1.smithi153.stdout:7/358: creat d1/d25/df/d26/d3a/d52/d63/f7b x:0 0 0 2024-02-28T16:24:35.872 INFO:tasks.workunit.client.1.smithi153.stdout:3/349: chown d4/d8/d1e/d2a/d35/f5f 1511810 1 2024-02-28T16:24:35.873 INFO:tasks.workunit.client.1.smithi153.stdout:1/318: sync 2024-02-28T16:24:35.873 INFO:tasks.workunit.client.1.smithi153.stdout:2/347: dread d2/d19/d2a/f47 [0,4194304] 0 2024-02-28T16:24:35.878 INFO:tasks.workunit.client.1.smithi153.stdout:7/359: unlink d1/l24 0 2024-02-28T16:24:35.878 INFO:tasks.workunit.client.1.smithi153.stdout:0/358: rmdir d4/d27 39 2024-02-28T16:24:35.879 INFO:tasks.workunit.client.1.smithi153.stdout:0/359: chown d4/d1a/l6d 104347 1 2024-02-28T16:24:35.880 INFO:tasks.workunit.client.1.smithi153.stdout:5/327: write da/dd/f15 [648360,92321] 0 2024-02-28T16:24:35.881 INFO:tasks.workunit.client.1.smithi153.stdout:5/328: chown da 272120692 1 2024-02-28T16:24:35.882 INFO:tasks.workunit.client.1.smithi153.stdout:9/275: creat d1/d5/d27/d61/f63 x:0 0 0 2024-02-28T16:24:35.883 INFO:tasks.workunit.client.1.smithi153.stdout:8/313: link d0/d19/d1e/f2e d0/d25/f6b 0 2024-02-28T16:24:35.885 INFO:tasks.workunit.client.1.smithi153.stdout:5/329: rmdir da/d29 39 2024-02-28T16:24:35.886 INFO:tasks.workunit.client.1.smithi153.stdout:0/360: mknod d4/dc/c7d 0 2024-02-28T16:24:35.888 INFO:tasks.workunit.client.1.smithi153.stdout:2/348: dread d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:35.892 INFO:tasks.workunit.client.1.smithi153.stdout:5/330: symlink da/dd/l76 0 2024-02-28T16:24:35.894 INFO:tasks.workunit.client.1.smithi153.stdout:3/350: dwrite d4/d13/f27 [0,4194304] 0 2024-02-28T16:24:35.896 INFO:tasks.workunit.client.1.smithi153.stdout:9/276: dread d1/d5/d27/d61/f25 [4194304,4194304] 0 2024-02-28T16:24:35.897 INFO:tasks.workunit.client.1.smithi153.stdout:0/361: write d4/d27/f4a [645323,110000] 0 2024-02-28T16:24:35.898 INFO:tasks.workunit.client.1.smithi153.stdout:2/349: rmdir d2/d25/d49 39 2024-02-28T16:24:35.900 INFO:tasks.workunit.client.1.smithi153.stdout:1/319: dwrite d0/d3d/f4f [0,4194304] 0 2024-02-28T16:24:35.904 INFO:tasks.workunit.client.1.smithi153.stdout:0/362: creat d4/d1a/f7e x:0 0 0 2024-02-28T16:24:35.904 INFO:tasks.workunit.client.1.smithi153.stdout:9/277: mkdir d1/d5/d11/d64 0 2024-02-28T16:24:35.907 INFO:tasks.workunit.client.1.smithi153.stdout:2/350: readlink d2/d23/d36/l64 0 2024-02-28T16:24:35.908 INFO:tasks.workunit.client.1.smithi153.stdout:7/360: dwrite d1/d25/df/d26/d3a/d3f/f74 [0,4194304] 0 2024-02-28T16:24:35.909 INFO:tasks.workunit.client.1.smithi153.stdout:0/363: chown d4/d27/c28 582854812 1 2024-02-28T16:24:35.913 INFO:tasks.workunit.client.1.smithi153.stdout:9/278: write d1/d2a/f42 [4434311,85246] 0 2024-02-28T16:24:35.915 INFO:tasks.workunit.client.1.smithi153.stdout:0/364: mkdir d4/d32/d7f 0 2024-02-28T16:24:35.917 INFO:tasks.workunit.client.1.smithi153.stdout:2/351: creat d2/d19/d2a/d3b/d5e/f6c x:0 0 0 2024-02-28T16:24:35.917 INFO:tasks.workunit.client.1.smithi153.stdout:7/361: write d1/d25/d27/f4d [1008984,40307] 0 2024-02-28T16:24:35.918 INFO:tasks.workunit.client.1.smithi153.stdout:0/365: fsync d4/d27/f73 0 2024-02-28T16:24:35.922 INFO:tasks.workunit.client.1.smithi153.stdout:0/366: readlink d4/d1a/l6d 0 2024-02-28T16:24:35.923 INFO:tasks.workunit.client.1.smithi153.stdout:1/320: rename d0/dd/l57 to d0/dd/d67/l7a 0 2024-02-28T16:24:35.928 INFO:tasks.workunit.client.1.smithi153.stdout:5/331: dwrite da/f51 [0,4194304] 0 2024-02-28T16:24:35.932 INFO:tasks.workunit.client.1.smithi153.stdout:6/333: sync 2024-02-28T16:24:35.932 INFO:tasks.workunit.client.1.smithi153.stdout:4/279: sync 2024-02-28T16:24:35.934 INFO:tasks.workunit.client.1.smithi153.stdout:0/367: mknod d4/d32/c80 0 2024-02-28T16:24:35.935 INFO:tasks.workunit.client.1.smithi153.stdout:9/279: dread d1/d5/d27/f41 [0,4194304] 0 2024-02-28T16:24:35.938 INFO:tasks.workunit.client.1.smithi153.stdout:0/368: write d4/dc/f19 [5166478,66850] 0 2024-02-28T16:24:35.938 INFO:tasks.workunit.client.1.smithi153.stdout:3/351: dread d4/d8/fd [0,4194304] 0 2024-02-28T16:24:35.941 INFO:tasks.workunit.client.1.smithi153.stdout:1/321: creat d0/d3d/d4a/f7b x:0 0 0 2024-02-28T16:24:35.945 INFO:tasks.workunit.client.1.smithi153.stdout:5/332: write da/d29/d43/f48 [927271,3800] 0 2024-02-28T16:24:35.945 INFO:tasks.workunit.client.1.smithi153.stdout:6/334: dread d0/f45 [0,4194304] 0 2024-02-28T16:24:35.945 INFO:tasks.workunit.client.1.smithi153.stdout:4/280: truncate d4/f15 132728 0 2024-02-28T16:24:35.947 INFO:tasks.workunit.client.1.smithi153.stdout:9/280: fsync d1/d5/d11/d1f/d20/d45/f53 0 2024-02-28T16:24:35.952 INFO:tasks.workunit.client.1.smithi153.stdout:2/352: rename d2/f11 to d2/d25/f6d 0 2024-02-28T16:24:35.953 INFO:tasks.workunit.client.1.smithi153.stdout:1/322: mkdir d0/d62/d66/d7c 0 2024-02-28T16:24:35.954 INFO:tasks.workunit.client.1.smithi153.stdout:8/314: sync 2024-02-28T16:24:35.956 INFO:tasks.workunit.client.1.smithi153.stdout:6/335: write d0/d15/d2e/f53 [150571,94277] 0 2024-02-28T16:24:35.960 INFO:tasks.workunit.client.1.smithi153.stdout:5/333: mkdir da/d29/d43/d5a/d77 0 2024-02-28T16:24:35.960 INFO:tasks.workunit.client.1.smithi153.stdout:9/281: creat d1/d2a/f65 x:0 0 0 2024-02-28T16:24:35.962 INFO:tasks.workunit.client.1.smithi153.stdout:7/362: getdents d1/d25/dc/d50/d66 0 2024-02-28T16:24:35.965 INFO:tasks.workunit.client.1.smithi153.stdout:4/281: creat d4/d53/f61 x:0 0 0 2024-02-28T16:24:35.966 INFO:tasks.workunit.client.1.smithi153.stdout:1/323: creat d0/d3d/f7d x:0 0 0 2024-02-28T16:24:35.968 INFO:tasks.workunit.client.1.smithi153.stdout:8/315: unlink d0/d19/d2b/f33 0 2024-02-28T16:24:35.970 INFO:tasks.workunit.client.1.smithi153.stdout:8/316: write d0/d19/d2b/f54 [450765,108012] 0 2024-02-28T16:24:35.970 INFO:tasks.workunit.client.1.smithi153.stdout:0/369: link d4/d1a/c66 d4/d1a/c81 0 2024-02-28T16:24:35.972 INFO:tasks.workunit.client.1.smithi153.stdout:3/352: rmdir d4/d8/d1e/d2a/d55/d6b 0 2024-02-28T16:24:35.976 INFO:tasks.workunit.client.1.smithi153.stdout:7/363: mkdir d1/d25/d27/d7c 0 2024-02-28T16:24:35.977 INFO:tasks.workunit.client.1.smithi153.stdout:5/334: dread da/dd/d25/f55 [0,4194304] 0 2024-02-28T16:24:35.980 INFO:tasks.workunit.client.1.smithi153.stdout:5/335: chown da/f2c 28 1 2024-02-28T16:24:35.981 INFO:tasks.workunit.client.1.smithi153.stdout:6/336: chown d0/d1d/d23/f59 191 1 2024-02-28T16:24:35.982 INFO:tasks.workunit.client.1.smithi153.stdout:4/282: mkdir d4/de/d47/d5e/d62 0 2024-02-28T16:24:35.986 INFO:tasks.workunit.client.1.smithi153.stdout:2/353: dread d2/d25/f6d [0,4194304] 0 2024-02-28T16:24:35.991 INFO:tasks.workunit.client.1.smithi153.stdout:2/354: chown d2/d19 51 1 2024-02-28T16:24:35.994 INFO:tasks.workunit.client.1.smithi153.stdout:7/364: unlink d1/d25/dc/d50/c6f 0 2024-02-28T16:24:35.996 INFO:tasks.workunit.client.1.smithi153.stdout:9/282: dwrite d1/d5/d27/f41 [0,4194304] 0 2024-02-28T16:24:35.998 INFO:tasks.workunit.client.1.smithi153.stdout:6/337: creat d0/d15/d68/f7b x:0 0 0 2024-02-28T16:24:35.999 INFO:tasks.workunit.client.1.smithi153.stdout:9/283: readlink d1/le 0 2024-02-28T16:24:35.999 INFO:tasks.workunit.client.1.smithi153.stdout:5/336: creat da/dd/d25/f78 x:0 0 0 2024-02-28T16:24:36.000 INFO:tasks.workunit.client.1.smithi153.stdout:8/317: dwrite d0/d19/d1e/f53 [0,4194304] 0 2024-02-28T16:24:36.004 INFO:tasks.workunit.client.1.smithi153.stdout:7/365: mknod d1/d25/dc/c7d 0 2024-02-28T16:24:36.004 INFO:tasks.workunit.client.1.smithi153.stdout:6/338: rename d0/l12 to d0/l7c 0 2024-02-28T16:24:36.007 INFO:tasks.workunit.client.1.smithi153.stdout:8/318: symlink d0/d19/d2b/d2d/d3f/l6c 0 2024-02-28T16:24:36.009 INFO:tasks.workunit.client.1.smithi153.stdout:7/366: chown d1/d25/d27/d43/c5f 488 1 2024-02-28T16:24:36.009 INFO:tasks.workunit.client.1.smithi153.stdout:6/339: chown d0/d15/d68/f70 20414 1 2024-02-28T16:24:36.011 INFO:tasks.workunit.client.1.smithi153.stdout:9/284: rmdir d1/d5/d11/d29 39 2024-02-28T16:24:36.019 INFO:tasks.workunit.client.1.smithi153.stdout:0/370: dread d4/dc/f5e [0,4194304] 0 2024-02-28T16:24:36.020 INFO:tasks.workunit.client.1.smithi153.stdout:5/337: getdents da/dd/d54 0 2024-02-28T16:24:36.024 INFO:tasks.workunit.client.1.smithi153.stdout:5/338: read - da/dd/d25/f78 zero size 2024-02-28T16:24:36.029 INFO:tasks.workunit.client.1.smithi153.stdout:8/319: link d0/f6 d0/d12/d15/f6d 0 2024-02-28T16:24:36.035 INFO:tasks.workunit.client.1.smithi153.stdout:6/340: creat d0/d15/f7d x:0 0 0 2024-02-28T16:24:36.037 INFO:tasks.workunit.client.1.smithi153.stdout:5/339: mknod da/dd/d54/d63/c79 0 2024-02-28T16:24:36.037 INFO:tasks.workunit.client.1.smithi153.stdout:6/341: dread - d0/d15/d68/f70 zero size 2024-02-28T16:24:36.039 INFO:tasks.workunit.client.1.smithi153.stdout:9/285: mknod d1/d5/d11/d1f/d52/c66 0 2024-02-28T16:24:36.040 INFO:tasks.workunit.client.1.smithi153.stdout:1/324: write d0/d3d/d4a/f51 [77881,127856] 0 2024-02-28T16:24:36.041 INFO:tasks.workunit.client.1.smithi153.stdout:8/320: write d0/d12/d15/f36 [1748017,89503] 0 2024-02-28T16:24:36.043 INFO:tasks.workunit.client.1.smithi153.stdout:6/342: mkdir d0/d17/d7e 0 2024-02-28T16:24:36.044 INFO:tasks.workunit.client.1.smithi153.stdout:9/286: write d1/f15 [4995326,119859] 0 2024-02-28T16:24:36.052 INFO:tasks.workunit.client.1.smithi153.stdout:3/353: truncate d4/d8/d1e/d2a/d35/f39 1612490 0 2024-02-28T16:24:36.052 INFO:tasks.workunit.client.1.smithi153.stdout:4/283: chown d4/f15 19477164 1 2024-02-28T16:24:36.057 INFO:tasks.workunit.client.1.smithi153.stdout:8/321: rename d0/d12/d67/l4d to d0/d12/d15/l6e 0 2024-02-28T16:24:36.062 INFO:tasks.workunit.client.1.smithi153.stdout:4/284: creat d4/de/d23/d2b/f63 x:0 0 0 2024-02-28T16:24:36.063 INFO:tasks.workunit.client.1.smithi153.stdout:1/325: link d0/dd/c39 d0/d62/d66/d7c/c7e 0 2024-02-28T16:24:36.068 INFO:tasks.workunit.client.1.smithi153.stdout:3/354: creat d4/d8/d26/d41/f79 x:0 0 0 2024-02-28T16:24:36.070 INFO:tasks.workunit.client.1.smithi153.stdout:8/322: creat d0/d19/d2b/f6f x:0 0 0 2024-02-28T16:24:36.073 INFO:tasks.workunit.client.1.smithi153.stdout:1/326: symlink d0/d3d/d4a/l7f 0 2024-02-28T16:24:36.076 INFO:tasks.workunit.client.1.smithi153.stdout:4/285: creat d4/de/d23/d2b/d31/f64 x:0 0 0 2024-02-28T16:24:36.077 INFO:tasks.workunit.client.1.smithi153.stdout:7/367: write d1/d25/df/d26/f57 [750854,6601] 0 2024-02-28T16:24:36.081 INFO:tasks.workunit.client.1.smithi153.stdout:7/368: chown d1/d25/c14 1390 1 2024-02-28T16:24:36.084 INFO:tasks.workunit.client.1.smithi153.stdout:8/323: creat d0/d19/d2b/d2d/f70 x:0 0 0 2024-02-28T16:24:36.086 INFO:tasks.workunit.client.1.smithi153.stdout:3/355: creat d4/d8/d26/d70/f7a x:0 0 0 2024-02-28T16:24:36.086 INFO:tasks.workunit.client.1.smithi153.stdout:6/343: dwrite d0/d66/f6a [0,4194304] 0 2024-02-28T16:24:36.088 INFO:tasks.workunit.client.1.smithi153.stdout:5/340: getdents da/dd/d54/d63 0 2024-02-28T16:24:36.089 INFO:tasks.workunit.client.1.smithi153.stdout:5/341: fsync da/fb 0 2024-02-28T16:24:36.089 INFO:tasks.workunit.client.1.smithi153.stdout:2/355: dwrite d2/d23/f29 [0,4194304] 0 2024-02-28T16:24:36.089 INFO:tasks.workunit.client.1.smithi153.stdout:4/286: mknod d4/de/d23/c65 0 2024-02-28T16:24:36.093 INFO:tasks.workunit.client.1.smithi153.stdout:0/371: write d4/d27/f42 [1414428,47078] 0 2024-02-28T16:24:36.093 INFO:tasks.workunit.client.1.smithi153.stdout:1/327: truncate d0/f40 531777 0 2024-02-28T16:24:36.094 INFO:tasks.workunit.client.1.smithi153.stdout:7/369: mkdir d1/d25/dc/d7e 0 2024-02-28T16:24:36.097 INFO:tasks.workunit.client.1.smithi153.stdout:8/324: symlink d0/d12/d67/d30/l71 0 2024-02-28T16:24:36.098 INFO:tasks.workunit.client.1.smithi153.stdout:4/287: dread d4/f38 [0,4194304] 0 2024-02-28T16:24:36.101 INFO:tasks.workunit.client.1.smithi153.stdout:5/342: symlink da/dd/d54/l7a 0 2024-02-28T16:24:36.105 INFO:tasks.workunit.client.1.smithi153.stdout:4/288: chown d4/de/d23/d2b/d31/c3f 43546 1 2024-02-28T16:24:36.107 INFO:tasks.workunit.client.1.smithi153.stdout:5/343: stat da/dd/d25/d41/c6e 0 2024-02-28T16:24:36.108 INFO:tasks.workunit.client.1.smithi153.stdout:0/372: creat d4/d32/f82 x:0 0 0 2024-02-28T16:24:36.110 INFO:tasks.workunit.client.1.smithi153.stdout:5/344: dread - da/f1e zero size 2024-02-28T16:24:36.116 INFO:tasks.workunit.client.1.smithi153.stdout:8/325: link d0/d12/d15/f36 d0/d19/d2b/f72 0 2024-02-28T16:24:36.117 INFO:tasks.workunit.client.1.smithi153.stdout:3/356: link d4/d2c/f5a d4/d8/d1e/f7b 0 2024-02-28T16:24:36.118 INFO:tasks.workunit.client.1.smithi153.stdout:9/287: dwrite d1/d5/d11/d1f/d43/f4d [0,4194304] 0 2024-02-28T16:24:36.119 INFO:tasks.workunit.client.1.smithi153.stdout:5/345: read da/dd/d25/f36 [3023575,72713] 0 2024-02-28T16:24:36.127 INFO:tasks.workunit.client.1.smithi153.stdout:8/326: chown d0/d34/f68 7233531 1 2024-02-28T16:24:36.136 INFO:tasks.workunit.client.1.smithi153.stdout:0/373: write d4/d1a/f67 [488130,85582] 0 2024-02-28T16:24:36.136 INFO:tasks.workunit.client.1.smithi153.stdout:2/356: dwrite d2/d19/d31/f6a [0,4194304] 0 2024-02-28T16:24:36.138 INFO:tasks.workunit.client.1.smithi153.stdout:7/370: write d1/d25/df/d60/f67 [1223485,33426] 0 2024-02-28T16:24:36.139 INFO:tasks.workunit.client.1.smithi153.stdout:9/288: fdatasync d1/d5/d27/f30 0 2024-02-28T16:24:36.144 INFO:tasks.workunit.client.1.smithi153.stdout:6/344: dwrite d0/d1d/d23/d60/f67 [0,4194304] 0 2024-02-28T16:24:36.144 INFO:tasks.workunit.client.1.smithi153.stdout:8/327: symlink d0/d12/d15/l73 0 2024-02-28T16:24:36.149 INFO:tasks.workunit.client.1.smithi153.stdout:4/289: truncate d4/de/f57 2289721 0 2024-02-28T16:24:36.155 INFO:tasks.workunit.client.1.smithi153.stdout:4/290: stat d4/de/d23/d2b/d31/f34 0 2024-02-28T16:24:36.158 INFO:tasks.workunit.client.1.smithi153.stdout:4/291: stat d4/de/d13/f20 0 2024-02-28T16:24:36.160 INFO:tasks.workunit.client.1.smithi153.stdout:0/374: mknod d4/d32/d7f/c83 0 2024-02-28T16:24:36.163 INFO:tasks.workunit.client.1.smithi153.stdout:5/346: link da/dd/d25/f58 da/dd/f7b 0 2024-02-28T16:24:36.169 INFO:tasks.workunit.client.1.smithi153.stdout:8/328: mkdir d0/d12/d67/d30/d63/d74 0 2024-02-28T16:24:36.173 INFO:tasks.workunit.client.1.smithi153.stdout:0/375: chown d4/dc/c15 0 1 2024-02-28T16:24:36.175 INFO:tasks.workunit.client.1.smithi153.stdout:6/345: creat d0/d1d/d30/d71/f7f x:0 0 0 2024-02-28T16:24:36.177 INFO:tasks.workunit.client.1.smithi153.stdout:9/289: link d1/d5/fb d1/d5/d11/d64/f67 0 2024-02-28T16:24:36.183 INFO:tasks.workunit.client.1.smithi153.stdout:4/292: rename d4/de/l3d to d4/de/d47/d5e/d62/l66 0 2024-02-28T16:24:36.184 INFO:tasks.workunit.client.1.smithi153.stdout:1/328: dwrite d0/f40 [0,4194304] 0 2024-02-28T16:24:36.184 INFO:tasks.workunit.client.1.smithi153.stdout:5/347: mkdir da/dd/d25/d41/d7c 0 2024-02-28T16:24:36.184 INFO:tasks.workunit.client.1.smithi153.stdout:2/357: dwrite d2/d23/f29 [0,4194304] 0 2024-02-28T16:24:36.184 INFO:tasks.workunit.client.1.smithi153.stdout:8/329: write d0/f64 [273197,130034] 0 2024-02-28T16:24:36.192 INFO:tasks.workunit.client.1.smithi153.stdout:5/348: dread - da/dd/f65 zero size 2024-02-28T16:24:36.192 INFO:tasks.workunit.client.1.smithi153.stdout:1/329: dread - d0/d3d/f7d zero size 2024-02-28T16:24:36.194 INFO:tasks.workunit.client.1.smithi153.stdout:6/346: truncate d0/d15/d2e/f4e 533456 0 2024-02-28T16:24:36.194 INFO:tasks.workunit.client.1.smithi153.stdout:7/371: dwrite d1/d25/df/d26/f57 [0,4194304] 0 2024-02-28T16:24:36.197 INFO:tasks.workunit.client.1.smithi153.stdout:9/290: creat d1/d5/d11/d1f/d20/f68 x:0 0 0 2024-02-28T16:24:36.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/358: write d2/d19/d2a/d3b/d5e/f6c [404290,29399] 0 2024-02-28T16:24:36.204 INFO:tasks.workunit.client.1.smithi153.stdout:8/330: write d0/d19/d2b/d2d/f35 [950598,29615] 0 2024-02-28T16:24:36.206 INFO:tasks.workunit.client.1.smithi153.stdout:3/357: dread d4/d13/f3f [4194304,4194304] 0 2024-02-28T16:24:36.210 INFO:tasks.workunit.client.1.smithi153.stdout:9/291: mkdir d1/d69 0 2024-02-28T16:24:36.210 INFO:tasks.workunit.client.1.smithi153.stdout:3/358: readlink d4/l50 0 2024-02-28T16:24:36.211 INFO:tasks.workunit.client.1.smithi153.stdout:6/347: rename d0/d15/d68/f70 to d0/d1d/d23/d6c/f80 0 2024-02-28T16:24:36.215 INFO:tasks.workunit.client.1.smithi153.stdout:7/372: mkdir d1/d25/df/d26/d3a/d52/d7f 0 2024-02-28T16:24:36.215 INFO:tasks.workunit.client.1.smithi153.stdout:2/359: read d2/d23/d36/f3c [1655835,3402] 0 2024-02-28T16:24:36.218 INFO:tasks.workunit.client.1.smithi153.stdout:5/349: truncate da/dd/d25/d41/f61 558167 0 2024-02-28T16:24:36.219 INFO:tasks.workunit.client.1.smithi153.stdout:3/359: mknod d4/d2c/c7c 0 2024-02-28T16:24:36.219 INFO:tasks.workunit.client.1.smithi153.stdout:8/331: creat d0/d34/d50/f75 x:0 0 0 2024-02-28T16:24:36.220 INFO:tasks.workunit.client.1.smithi153.stdout:6/348: creat d0/f81 x:0 0 0 2024-02-28T16:24:36.221 INFO:tasks.workunit.client.1.smithi153.stdout:0/376: dwrite d4/d27/f42 [0,4194304] 0 2024-02-28T16:24:36.224 INFO:tasks.workunit.client.1.smithi153.stdout:6/349: stat d0/d1d/d23/d60 0 2024-02-28T16:24:36.224 INFO:tasks.workunit.client.1.smithi153.stdout:3/360: fsync d4/d8/f65 0 2024-02-28T16:24:36.226 INFO:tasks.workunit.client.1.smithi153.stdout:9/292: mkdir d1/d5/d27/d61/d6a 0 2024-02-28T16:24:36.227 INFO:tasks.workunit.client.1.smithi153.stdout:6/350: chown d0/d15/f3a 140024 1 2024-02-28T16:24:36.228 INFO:tasks.workunit.client.1.smithi153.stdout:8/332: truncate d0/f64 1016173 0 2024-02-28T16:24:36.232 INFO:tasks.workunit.client.1.smithi153.stdout:7/373: mkdir d1/d25/df/d26/d3a/d52/d7f/d80 0 2024-02-28T16:24:36.241 INFO:tasks.workunit.client.1.smithi153.stdout:6/351: creat d0/d66/f82 x:0 0 0 2024-02-28T16:24:36.242 INFO:tasks.workunit.client.1.smithi153.stdout:1/330: dwrite d0/f16 [0,4194304] 0 2024-02-28T16:24:36.249 INFO:tasks.workunit.client.1.smithi153.stdout:2/360: rename d2/d25/f2d to d2/d19/f6e 0 2024-02-28T16:24:36.255 INFO:tasks.workunit.client.1.smithi153.stdout:5/350: dwrite f9 [0,4194304] 0 2024-02-28T16:24:36.258 INFO:tasks.workunit.client.1.smithi153.stdout:0/377: truncate d4/d1a/f21 169789 0 2024-02-28T16:24:36.258 INFO:tasks.workunit.client.1.smithi153.stdout:9/293: dwrite d1/d5/d27/d61/f3d [0,4194304] 0 2024-02-28T16:24:36.264 INFO:tasks.workunit.client.1.smithi153.stdout:7/374: dwrite d1/d25/df/f4e [0,4194304] 0 2024-02-28T16:24:36.265 INFO:tasks.workunit.client.1.smithi153.stdout:9/294: fdatasync d1/d5/d11/d1f/d20/f31 0 2024-02-28T16:24:36.265 INFO:tasks.workunit.client.1.smithi153.stdout:0/378: write d4/dc/f6c [534107,73615] 0 2024-02-28T16:24:36.267 INFO:tasks.workunit.client.1.smithi153.stdout:3/361: getdents d4/d2c 0 2024-02-28T16:24:36.268 INFO:tasks.workunit.client.1.smithi153.stdout:0/379: dread - d4/d27/f7c zero size 2024-02-28T16:24:36.271 INFO:tasks.workunit.client.1.smithi153.stdout:9/295: write d1/d5/d27/d61/f3d [2605920,106321] 0 2024-02-28T16:24:36.277 INFO:tasks.workunit.client.1.smithi153.stdout:6/352: rename d0/d1d/d34/c62 to d0/d15/d48/d72/c83 0 2024-02-28T16:24:36.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/361: rmdir d2/d19/d2a/d3b 39 2024-02-28T16:24:36.277 INFO:tasks.workunit.client.1.smithi153.stdout:5/351: mknod da/dd/d54/c7d 0 2024-02-28T16:24:36.283 INFO:tasks.workunit.client.1.smithi153.stdout:8/333: creat d0/d19/f76 x:0 0 0 2024-02-28T16:24:36.288 INFO:tasks.workunit.client.1.smithi153.stdout:7/375: dread d1/d25/f9 [0,4194304] 0 2024-02-28T16:24:36.298 INFO:tasks.workunit.client.1.smithi153.stdout:4/293: sync 2024-02-28T16:24:36.298 INFO:tasks.workunit.client.1.smithi153.stdout:0/380: creat d4/d1a/d65/f84 x:0 0 0 2024-02-28T16:24:36.300 INFO:tasks.workunit.client.1.smithi153.stdout:4/294: chown d4/de/d23/f4a 1665501 1 2024-02-28T16:24:36.300 INFO:tasks.workunit.client.1.smithi153.stdout:6/353: creat d0/d1d/d30/d71/f84 x:0 0 0 2024-02-28T16:24:36.301 INFO:tasks.workunit.client.1.smithi153.stdout:4/295: chown d4/d3c/c5b 61563074 1 2024-02-28T16:24:36.304 INFO:tasks.workunit.client.1.smithi153.stdout:4/296: fsync d4/de/d13/d1b/f5f 0 2024-02-28T16:24:36.304 INFO:tasks.workunit.client.1.smithi153.stdout:8/334: creat d0/d12/d15/f77 x:0 0 0 2024-02-28T16:24:36.307 INFO:tasks.workunit.client.1.smithi153.stdout:7/376: mkdir d1/d25/df/d26/d3a/d81 0 2024-02-28T16:24:36.311 INFO:tasks.workunit.client.1.smithi153.stdout:6/354: mkdir d0/d66/d85 0 2024-02-28T16:24:36.311 INFO:tasks.workunit.client.1.smithi153.stdout:1/331: dread d0/dd/f30 [0,4194304] 0 2024-02-28T16:24:36.313 INFO:tasks.workunit.client.1.smithi153.stdout:2/362: symlink d2/d19/d2a/d3b/d5e/l6f 0 2024-02-28T16:24:36.313 INFO:tasks.workunit.client.1.smithi153.stdout:5/352: creat da/dd/d25/d41/d7c/f7e x:0 0 0 2024-02-28T16:24:36.315 INFO:tasks.workunit.client.1.smithi153.stdout:2/363: fsync d2/d19/f38 0 2024-02-28T16:24:36.315 INFO:tasks.workunit.client.1.smithi153.stdout:4/297: creat d4/de/d47/f67 x:0 0 0 2024-02-28T16:24:36.315 INFO:tasks.workunit.client.1.smithi153.stdout:6/355: truncate d0/d1d/d23/d60/f74 607925 0 2024-02-28T16:24:36.316 INFO:tasks.workunit.client.1.smithi153.stdout:8/335: mknod d0/d34/d50/c78 0 2024-02-28T16:24:36.324 INFO:tasks.workunit.client.1.smithi153.stdout:7/377: dwrite d1/d25/df/d60/f67 [0,4194304] 0 2024-02-28T16:24:36.333 INFO:tasks.workunit.client.1.smithi153.stdout:3/362: getdents d4/d13/d28 0 2024-02-28T16:24:36.334 INFO:tasks.workunit.client.1.smithi153.stdout:5/353: dwrite da/d29/d43/f48 [0,4194304] 0 2024-02-28T16:24:36.340 INFO:tasks.workunit.client.1.smithi153.stdout:4/298: read d4/de/f57 [260425,68783] 0 2024-02-28T16:24:36.340 INFO:tasks.workunit.client.1.smithi153.stdout:9/296: dwrite d1/d5/fb [0,4194304] 0 2024-02-28T16:24:36.341 INFO:tasks.workunit.client.1.smithi153.stdout:0/381: rename d4/dc/d5c/f6a to d4/d27/f85 0 2024-02-28T16:24:36.343 INFO:tasks.workunit.client.1.smithi153.stdout:8/336: dwrite d0/d19/d1e/f53 [0,4194304] 0 2024-02-28T16:24:36.343 INFO:tasks.workunit.client.1.smithi153.stdout:7/378: creat d1/f82 x:0 0 0 2024-02-28T16:24:36.346 INFO:tasks.workunit.client.1.smithi153.stdout:8/337: fdatasync d0/d34/f68 0 2024-02-28T16:24:36.348 INFO:tasks.workunit.client.1.smithi153.stdout:0/382: stat d4/d32/l46 0 2024-02-28T16:24:36.350 INFO:tasks.workunit.client.1.smithi153.stdout:6/356: link d0/d1d/d23/d60/f67 d0/d15/f86 0 2024-02-28T16:24:36.358 INFO:tasks.workunit.client.1.smithi153.stdout:5/354: getdents da 0 2024-02-28T16:24:36.361 INFO:tasks.workunit.client.1.smithi153.stdout:4/299: mknod d4/de/d47/d5e/d62/c68 0 2024-02-28T16:24:36.362 INFO:tasks.workunit.client.1.smithi153.stdout:1/332: dwrite d0/fe [0,4194304] 0 2024-02-28T16:24:36.373 INFO:tasks.workunit.client.1.smithi153.stdout:3/363: truncate d4/d8/d1e/d2a/d35/f39 1288310 0 2024-02-28T16:24:36.377 INFO:tasks.workunit.client.1.smithi153.stdout:7/379: truncate d1/d25/df/d26/d3a/d52/d63/f7b 33617 0 2024-02-28T16:24:36.377 INFO:tasks.workunit.client.1.smithi153.stdout:1/333: write d0/dd/f2d [821702,58517] 0 2024-02-28T16:24:36.381 INFO:tasks.workunit.client.1.smithi153.stdout:5/355: symlink da/d29/d43/d5a/d77/l7f 0 2024-02-28T16:24:36.382 INFO:tasks.workunit.client.1.smithi153.stdout:2/364: dwrite d2/d19/d2a/d3b/f4e [0,4194304] 0 2024-02-28T16:24:36.382 INFO:tasks.workunit.client.1.smithi153.stdout:0/383: link d4/f53 d4/d32/d7f/f86 0 2024-02-28T16:24:36.387 INFO:tasks.workunit.client.1.smithi153.stdout:1/334: mkdir d0/dd/d67/d80 0 2024-02-28T16:24:36.389 INFO:tasks.workunit.client.1.smithi153.stdout:9/297: dread d1/d5/d27/d61/f18 [0,4194304] 0 2024-02-28T16:24:36.390 INFO:tasks.workunit.client.1.smithi153.stdout:2/365: dread - d2/d19/d2a/d3b/f68 zero size 2024-02-28T16:24:36.390 INFO:tasks.workunit.client.1.smithi153.stdout:8/338: dwrite d0/d19/d2b/d2d/f5e [0,4194304] 0 2024-02-28T16:24:36.392 INFO:tasks.workunit.client.1.smithi153.stdout:0/384: mknod d4/d32/c87 0 2024-02-28T16:24:36.394 INFO:tasks.workunit.client.1.smithi153.stdout:5/356: unlink da/dd/d25/d41/f61 0 2024-02-28T16:24:36.395 INFO:tasks.workunit.client.1.smithi153.stdout:6/357: dwrite d0/d15/f86 [0,4194304] 0 2024-02-28T16:24:36.399 INFO:tasks.workunit.client.1.smithi153.stdout:8/339: fdatasync d0/d12/d15/f62 0 2024-02-28T16:24:36.399 INFO:tasks.workunit.client.1.smithi153.stdout:4/300: dwrite d4/de/d23/f30 [0,4194304] 0 2024-02-28T16:24:36.400 INFO:tasks.workunit.client.1.smithi153.stdout:3/364: rename d4/d8/d26 to d4/d7d 0 2024-02-28T16:24:36.403 INFO:tasks.workunit.client.1.smithi153.stdout:8/340: write d0/d25/f57 [1264454,98419] 0 2024-02-28T16:24:36.406 INFO:tasks.workunit.client.1.smithi153.stdout:8/341: dread - d0/d19/d2b/f61 zero size 2024-02-28T16:24:36.406 INFO:tasks.workunit.client.1.smithi153.stdout:0/385: write d4/f14 [513027,59609] 0 2024-02-28T16:24:36.411 INFO:tasks.workunit.client.1.smithi153.stdout:9/298: unlink d1/d5/d11/d1f/c23 0 2024-02-28T16:24:36.412 INFO:tasks.workunit.client.1.smithi153.stdout:1/335: dread d0/dd/f30 [0,4194304] 0 2024-02-28T16:24:36.412 INFO:tasks.workunit.client.1.smithi153.stdout:5/357: write da/dd/d25/f71 [783094,10302] 0 2024-02-28T16:24:36.412 INFO:tasks.workunit.client.1.smithi153.stdout:1/336: fdatasync d0/d3d/f6d 0 2024-02-28T16:24:36.414 INFO:tasks.workunit.client.1.smithi153.stdout:7/380: getdents d1 0 2024-02-28T16:24:36.416 INFO:tasks.workunit.client.1.smithi153.stdout:6/358: rename d0/d15/f2c to d0/d1d/d30/d71/f87 0 2024-02-28T16:24:36.419 INFO:tasks.workunit.client.1.smithi153.stdout:9/299: write d1/d5/d11/d1f/d20/f3e [634033,86675] 0 2024-02-28T16:24:36.421 INFO:tasks.workunit.client.1.smithi153.stdout:4/301: rmdir d4/de/d13 39 2024-02-28T16:24:36.427 INFO:tasks.workunit.client.1.smithi153.stdout:3/365: dread d4/d8/d1e/f5e [0,4194304] 0 2024-02-28T16:24:36.433 INFO:tasks.workunit.client.1.smithi153.stdout:6/359: unlink d0/lf 0 2024-02-28T16:24:36.436 INFO:tasks.workunit.client.1.smithi153.stdout:4/302: truncate f1 3019900 0 2024-02-28T16:24:36.436 INFO:tasks.workunit.client.1.smithi153.stdout:3/366: creat d4/d2c/f7e x:0 0 0 2024-02-28T16:24:36.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/386: rename d4/d1a/c66 to d4/dc/d5c/c88 0 2024-02-28T16:24:36.442 INFO:tasks.workunit.client.1.smithi153.stdout:9/300: symlink d1/d5/d11/d1f/d20/d5d/l6b 0 2024-02-28T16:24:36.443 INFO:tasks.workunit.client.1.smithi153.stdout:2/366: write d2/d23/d36/f51 [3319053,37903] 0 2024-02-28T16:24:36.445 INFO:tasks.workunit.client.1.smithi153.stdout:2/367: chown d2/d19/d3e/l60 486981456 1 2024-02-28T16:24:36.448 INFO:tasks.workunit.client.1.smithi153.stdout:5/358: rename da/dd/d54/d63/l68 to da/l80 0 2024-02-28T16:24:36.450 INFO:tasks.workunit.client.1.smithi153.stdout:1/337: getdents d0/d62/d66 0 2024-02-28T16:24:36.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/360: symlink d0/d1d/l88 0 2024-02-28T16:24:36.453 INFO:tasks.workunit.client.1.smithi153.stdout:9/301: readlink d1/d5/d11/l28 0 2024-02-28T16:24:36.455 INFO:tasks.workunit.client.1.smithi153.stdout:4/303: creat d4/de/d13/d1b/f69 x:0 0 0 2024-02-28T16:24:36.456 INFO:tasks.workunit.client.1.smithi153.stdout:9/302: fsync d1/d5/d27/d61/f63 0 2024-02-28T16:24:36.456 INFO:tasks.workunit.client.1.smithi153.stdout:8/342: dwrite d0/d12/d15/f36 [4194304,4194304] 0 2024-02-28T16:24:36.458 INFO:tasks.workunit.client.1.smithi153.stdout:0/387: mkdir d4/d89 0 2024-02-28T16:24:36.458 INFO:tasks.workunit.client.1.smithi153.stdout:8/343: dread - d0/d34/f60 zero size 2024-02-28T16:24:36.463 INFO:tasks.workunit.client.1.smithi153.stdout:7/381: rename d1/d25/df/d26/d3a/d52/d63/f7b to d1/d25/df/d26/d3a/f83 0 2024-02-28T16:24:36.468 INFO:tasks.workunit.client.1.smithi153.stdout:1/338: symlink d0/d62/l81 0 2024-02-28T16:24:36.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/361: write d0/d1d/d30/d71/f87 [1498736,43919] 0 2024-02-28T16:24:36.471 INFO:tasks.workunit.client.1.smithi153.stdout:6/362: chown d0/d1d/d33/f73 1 1 2024-02-28T16:24:36.472 INFO:tasks.workunit.client.1.smithi153.stdout:4/304: mknod d4/c6a 0 2024-02-28T16:24:36.473 INFO:tasks.workunit.client.1.smithi153.stdout:4/305: readlink d4/de/d13/d1b/l4f 0 2024-02-28T16:24:36.474 INFO:tasks.workunit.client.1.smithi153.stdout:6/363: write d0/d1d/d33/f73 [356055,68568] 0 2024-02-28T16:24:36.477 INFO:tasks.workunit.client.1.smithi153.stdout:7/382: dread d1/d25/df/d60/f67 [0,4194304] 0 2024-02-28T16:24:36.478 INFO:tasks.workunit.client.1.smithi153.stdout:7/383: fsync d1/d25/df/d5a/f78 0 2024-02-28T16:24:36.479 INFO:tasks.workunit.client.1.smithi153.stdout:9/303: creat d1/d5/d11/d1f/d52/f6c x:0 0 0 2024-02-28T16:24:36.479 INFO:tasks.workunit.client.1.smithi153.stdout:8/344: stat d0/ce 0 2024-02-28T16:24:36.480 INFO:tasks.workunit.client.1.smithi153.stdout:9/304: stat d1/ff 0 2024-02-28T16:24:36.480 INFO:tasks.workunit.client.1.smithi153.stdout:9/305: stat d1/d69 0 2024-02-28T16:24:36.482 INFO:tasks.workunit.client.1.smithi153.stdout:0/388: mkdir d4/d32/d7f/d8a 0 2024-02-28T16:24:36.482 INFO:tasks.workunit.client.1.smithi153.stdout:9/306: dread - d1/d5/f59 zero size 2024-02-28T16:24:36.483 INFO:tasks.workunit.client.1.smithi153.stdout:2/368: symlink d2/d63/l70 0 2024-02-28T16:24:36.486 INFO:tasks.workunit.client.1.smithi153.stdout:3/367: rename d4/d13/l4c to d4/d49/l7f 0 2024-02-28T16:24:36.488 INFO:tasks.workunit.client.1.smithi153.stdout:3/368: chown d4/d8/d1e/d64 244 1 2024-02-28T16:24:36.491 INFO:tasks.workunit.client.1.smithi153.stdout:1/339: readlink d0/dd/d67/l7a 0 2024-02-28T16:24:36.492 INFO:tasks.workunit.client.1.smithi153.stdout:4/306: rmdir d4 39 2024-02-28T16:24:36.494 INFO:tasks.workunit.client.1.smithi153.stdout:5/359: chown da/f42 6716 1 2024-02-28T16:24:36.496 INFO:tasks.workunit.client.1.smithi153.stdout:8/345: readlink d0/d34/d50/l5b 0 2024-02-28T16:24:36.498 INFO:tasks.workunit.client.1.smithi153.stdout:8/346: read d0/d19/d2b/d2d/f5e [25543,29257] 0 2024-02-28T16:24:36.500 INFO:tasks.workunit.client.1.smithi153.stdout:2/369: unlink d2/d19/d4f/l69 0 2024-02-28T16:24:36.500 INFO:tasks.workunit.client.1.smithi153.stdout:3/369: dwrite d4/d7d/f44 [4194304,4194304] 0 2024-02-28T16:24:36.503 INFO:tasks.workunit.client.1.smithi153.stdout:1/340: readlink d0/l6e 0 2024-02-28T16:24:36.504 INFO:tasks.workunit.client.1.smithi153.stdout:1/341: dread - d0/dd/f58 zero size 2024-02-28T16:24:36.509 INFO:tasks.workunit.client.1.smithi153.stdout:0/389: mknod d4/d89/c8b 0 2024-02-28T16:24:36.510 INFO:tasks.workunit.client.1.smithi153.stdout:8/347: mkdir d0/d25/d79 0 2024-02-28T16:24:36.511 INFO:tasks.workunit.client.1.smithi153.stdout:0/390: dread - d4/d32/f48 zero size 2024-02-28T16:24:36.512 INFO:tasks.workunit.client.1.smithi153.stdout:2/370: creat d2/d19/d2a/d3b/f71 x:0 0 0 2024-02-28T16:24:36.513 INFO:tasks.workunit.client.1.smithi153.stdout:2/371: fsync d2/d19/d2a/f6b 0 2024-02-28T16:24:36.525 INFO:tasks.workunit.client.1.smithi153.stdout:7/384: truncate d1/d25/f49 663515 0 2024-02-28T16:24:36.526 INFO:tasks.workunit.client.1.smithi153.stdout:7/385: readlink d1/l2f 0 2024-02-28T16:24:36.530 INFO:tasks.workunit.client.1.smithi153.stdout:6/364: getdents d0/d15/d68 0 2024-02-28T16:24:36.532 INFO:tasks.workunit.client.1.smithi153.stdout:3/370: write d4/d8/d1e/f7b [1148991,17810] 0 2024-02-28T16:24:36.532 INFO:tasks.workunit.client.1.smithi153.stdout:6/365: chown d0/d15/c22 218096607 1 2024-02-28T16:24:36.533 INFO:tasks.workunit.client.1.smithi153.stdout:9/307: truncate d1/d5/d27/d61/f18 1196806 0 2024-02-28T16:24:36.535 INFO:tasks.workunit.client.1.smithi153.stdout:1/342: creat d0/d62/d66/d7c/f82 x:0 0 0 2024-02-28T16:24:36.535 INFO:tasks.workunit.client.1.smithi153.stdout:8/348: write d0/d19/d1e/f2e [1106089,36655] 0 2024-02-28T16:24:36.536 INFO:tasks.workunit.client.1.smithi153.stdout:6/366: write d0/d1d/d33/f7a [695418,55224] 0 2024-02-28T16:24:36.539 INFO:tasks.workunit.client.1.smithi153.stdout:6/367: write d0/d15/f3e [5208064,112806] 0 2024-02-28T16:24:36.541 INFO:tasks.workunit.client.1.smithi153.stdout:2/372: write d2/f7 [1367388,61419] 0 2024-02-28T16:24:36.542 INFO:tasks.workunit.client.1.smithi153.stdout:5/360: rename da/f35 to da/dd/d25/d41/d7c/f81 0 2024-02-28T16:24:36.542 INFO:tasks.workunit.client.1.smithi153.stdout:0/391: symlink d4/l8c 0 2024-02-28T16:24:36.545 INFO:tasks.workunit.client.1.smithi153.stdout:0/392: write d4/d1a/f1f [247004,87601] 0 2024-02-28T16:24:36.545 INFO:tasks.workunit.client.1.smithi153.stdout:7/386: creat d1/d25/df/d26/f84 x:0 0 0 2024-02-28T16:24:36.547 INFO:tasks.workunit.client.1.smithi153.stdout:7/387: dread - d1/f82 zero size 2024-02-28T16:24:36.549 INFO:tasks.workunit.client.1.smithi153.stdout:3/371: creat d4/d8/d1e/d63/f80 x:0 0 0 2024-02-28T16:24:36.549 INFO:tasks.workunit.client.1.smithi153.stdout:4/307: write d4/de/f57 [1510096,120242] 0 2024-02-28T16:24:36.552 INFO:tasks.workunit.client.1.smithi153.stdout:4/308: readlink d4/de/d23/d2b/d31/l41 0 2024-02-28T16:24:36.553 INFO:tasks.workunit.client.1.smithi153.stdout:8/349: fsync d0/d19/d1e/f40 0 2024-02-28T16:24:36.555 INFO:tasks.workunit.client.1.smithi153.stdout:4/309: chown d4/de/d23/d2b/d31/c52 83953178 1 2024-02-28T16:24:36.555 INFO:tasks.workunit.client.1.smithi153.stdout:6/368: rmdir d0/d66 39 2024-02-28T16:24:36.557 INFO:tasks.workunit.client.1.smithi153.stdout:1/343: dwrite d0/f16 [0,4194304] 0 2024-02-28T16:24:36.564 INFO:tasks.workunit.client.1.smithi153.stdout:9/308: symlink d1/d5/d11/d1f/l6d 0 2024-02-28T16:24:36.568 INFO:tasks.workunit.client.1.smithi153.stdout:8/350: creat d0/d12/d67/d30/f7a x:0 0 0 2024-02-28T16:24:36.571 INFO:tasks.workunit.client.1.smithi153.stdout:6/369: dwrite d0/d1d/f47 [0,4194304] 0 2024-02-28T16:24:36.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/361: write da/d29/f5e [899381,9234] 0 2024-02-28T16:24:36.576 INFO:tasks.workunit.client.1.smithi153.stdout:2/373: mknod d2/d19/d2a/c72 0 2024-02-28T16:24:36.576 INFO:tasks.workunit.client.1.smithi153.stdout:6/370: write d0/d15/d68/f6f [270069,37923] 0 2024-02-28T16:24:36.578 INFO:tasks.workunit.client.1.smithi153.stdout:4/310: mknod d4/de/c6b 0 2024-02-28T16:24:36.578 INFO:tasks.workunit.client.1.smithi153.stdout:9/309: creat d1/d5/d11/d29/f6e x:0 0 0 2024-02-28T16:24:36.584 INFO:tasks.workunit.client.1.smithi153.stdout:3/372: creat d4/f81 x:0 0 0 2024-02-28T16:24:36.590 INFO:tasks.workunit.client.1.smithi153.stdout:0/393: getdents d4/dc 0 2024-02-28T16:24:36.590 INFO:tasks.workunit.client.1.smithi153.stdout:3/373: truncate d4/d2c/f7e 588083 0 2024-02-28T16:24:36.594 INFO:tasks.workunit.client.1.smithi153.stdout:7/388: truncate d1/d25/dc/d50/f5b 2922221 0 2024-02-28T16:24:36.594 INFO:tasks.workunit.client.1.smithi153.stdout:8/351: dwrite d0/d12/d15/f62 [0,4194304] 0 2024-02-28T16:24:36.594 INFO:tasks.workunit.client.1.smithi153.stdout:2/374: truncate d2/f21 1968704 0 2024-02-28T16:24:36.598 INFO:tasks.workunit.client.1.smithi153.stdout:2/375: write d2/f20 [4199362,80159] 0 2024-02-28T16:24:36.601 INFO:tasks.workunit.client.1.smithi153.stdout:5/362: dwrite da/dd/f60 [0,4194304] 0 2024-02-28T16:24:36.605 INFO:tasks.workunit.client.1.smithi153.stdout:0/394: mknod d4/dc/c8d 0 2024-02-28T16:24:36.609 INFO:tasks.workunit.client.1.smithi153.stdout:9/310: rename d1/d5/cc to d1/d5/d11/d29/c6f 0 2024-02-28T16:24:36.612 INFO:tasks.workunit.client.1.smithi153.stdout:8/352: creat d0/d34/f7b x:0 0 0 2024-02-28T16:24:36.612 INFO:tasks.workunit.client.1.smithi153.stdout:7/389: unlink d1/d25/dc/f62 0 2024-02-28T16:24:36.615 INFO:tasks.workunit.client.1.smithi153.stdout:9/311: fdatasync d1/d5/d11/d1f/d20/d36/f2d 0 2024-02-28T16:24:36.616 INFO:tasks.workunit.client.1.smithi153.stdout:4/311: creat d4/de/f6c x:0 0 0 2024-02-28T16:24:36.617 INFO:tasks.workunit.client.1.smithi153.stdout:8/353: write d0/d19/d1e/f53 [18491,49623] 0 2024-02-28T16:24:36.617 INFO:tasks.workunit.client.1.smithi153.stdout:7/390: rename d1 to d1/d25/df/d5a/d85 22 2024-02-28T16:24:36.618 INFO:tasks.workunit.client.1.smithi153.stdout:6/371: rename d0/d1d/c2d to d0/d1d/c89 0 2024-02-28T16:24:36.619 INFO:tasks.workunit.client.1.smithi153.stdout:0/395: mkdir d4/d1a/d8e 0 2024-02-28T16:24:36.625 INFO:tasks.workunit.client.1.smithi153.stdout:2/376: dwrite d2/d19/d3e/f65 [0,4194304] 0 2024-02-28T16:24:36.625 INFO:tasks.workunit.client.1.smithi153.stdout:5/363: mkdir da/dd/d25/d82 0 2024-02-28T16:24:36.626 INFO:tasks.workunit.client.1.smithi153.stdout:1/344: dread d0/dd/f1c [0,4194304] 0 2024-02-28T16:24:36.633 INFO:tasks.workunit.client.1.smithi153.stdout:9/312: rmdir d1/d5/d11/d1f/d43 39 2024-02-28T16:24:36.635 INFO:tasks.workunit.client.1.smithi153.stdout:7/391: creat d1/d25/dc/d50/d66/f86 x:0 0 0 2024-02-28T16:24:36.635 INFO:tasks.workunit.client.1.smithi153.stdout:2/377: mknod d2/d19/d31/c73 0 2024-02-28T16:24:36.637 INFO:tasks.workunit.client.1.smithi153.stdout:8/354: mknod d0/d19/d2b/c7c 0 2024-02-28T16:24:36.638 INFO:tasks.workunit.client.1.smithi153.stdout:1/345: creat d0/dd/d67/f83 x:0 0 0 2024-02-28T16:24:36.642 INFO:tasks.workunit.client.1.smithi153.stdout:9/313: fsync d1/d5/d27/f30 0 2024-02-28T16:24:36.649 INFO:tasks.workunit.client.1.smithi153.stdout:9/314: chown d1/f15 223 1 2024-02-28T16:24:36.650 INFO:tasks.workunit.client.1.smithi153.stdout:1/346: rmdir d0/d62 39 2024-02-28T16:24:36.652 INFO:tasks.workunit.client.1.smithi153.stdout:8/355: symlink d0/d34/l7d 0 2024-02-28T16:24:36.654 INFO:tasks.workunit.client.1.smithi153.stdout:2/378: mknod d2/d19/d2a/c74 0 2024-02-28T16:24:36.655 INFO:tasks.workunit.client.1.smithi153.stdout:0/396: dread d4/d1a/f24 [0,4194304] 0 2024-02-28T16:24:36.656 INFO:tasks.workunit.client.1.smithi153.stdout:9/315: truncate d1/f4e 955998 0 2024-02-28T16:24:36.656 INFO:tasks.workunit.client.1.smithi153.stdout:4/312: dwrite d4/de/f60 [0,4194304] 0 2024-02-28T16:24:36.657 INFO:tasks.workunit.client.1.smithi153.stdout:3/374: dwrite d4/d7d/f3d [0,4194304] 0 2024-02-28T16:24:36.659 INFO:tasks.workunit.client.1.smithi153.stdout:8/356: write d0/f8 [309882,45470] 0 2024-02-28T16:24:36.668 INFO:tasks.workunit.client.1.smithi153.stdout:1/347: mkdir d0/dd/d84 0 2024-02-28T16:24:36.668 INFO:tasks.workunit.client.1.smithi153.stdout:5/364: dwrite da/d29/d43/f4f [4194304,4194304] 0 2024-02-28T16:24:36.669 INFO:tasks.workunit.client.1.smithi153.stdout:4/313: unlink d4/de/f21 0 2024-02-28T16:24:36.670 INFO:tasks.workunit.client.1.smithi153.stdout:2/379: truncate d2/d19/d2a/d3b/f68 577979 0 2024-02-28T16:24:36.672 INFO:tasks.workunit.client.1.smithi153.stdout:8/357: creat d0/d25/f7e x:0 0 0 2024-02-28T16:24:36.675 INFO:tasks.workunit.client.1.smithi153.stdout:2/380: creat d2/d23/d48/f75 x:0 0 0 2024-02-28T16:24:36.677 INFO:tasks.workunit.client.1.smithi153.stdout:4/314: symlink d4/de/d13/l6d 0 2024-02-28T16:24:36.681 INFO:tasks.workunit.client.1.smithi153.stdout:5/365: creat da/d29/d43/d5a/d77/f83 x:0 0 0 2024-02-28T16:24:36.684 INFO:tasks.workunit.client.1.smithi153.stdout:0/397: dread d4/f78 [0,4194304] 0 2024-02-28T16:24:36.686 INFO:tasks.workunit.client.1.smithi153.stdout:0/398: readlink d4/dc/l11 0 2024-02-28T16:24:36.687 INFO:tasks.workunit.client.1.smithi153.stdout:5/366: chown da/f38 8 1 2024-02-28T16:24:36.691 INFO:tasks.workunit.client.1.smithi153.stdout:0/399: creat d4/dc/f8f x:0 0 0 2024-02-28T16:24:36.693 INFO:tasks.workunit.client.1.smithi153.stdout:0/400: dread - d4/d1a/f7e zero size 2024-02-28T16:24:36.694 INFO:tasks.workunit.client.1.smithi153.stdout:7/392: dread d1/d25/df/d60/f67 [0,4194304] 0 2024-02-28T16:24:36.697 INFO:tasks.workunit.client.1.smithi153.stdout:2/381: link d2/d19/d31/f40 d2/d19/d2a/f76 0 2024-02-28T16:24:36.697 INFO:tasks.workunit.client.1.smithi153.stdout:4/315: dwrite d4/d3c/f42 [4194304,4194304] 0 2024-02-28T16:24:36.699 INFO:tasks.workunit.client.1.smithi153.stdout:2/382: dread - d2/d19/d2a/f6b zero size 2024-02-28T16:24:36.700 INFO:tasks.workunit.client.1.smithi153.stdout:1/348: dread d0/f23 [0,4194304] 0 2024-02-28T16:24:36.702 INFO:tasks.workunit.client.1.smithi153.stdout:7/393: mkdir d1/d70/d87 0 2024-02-28T16:24:36.703 INFO:tasks.workunit.client.1.smithi153.stdout:8/358: truncate d0/d34/f3d 2322146 0 2024-02-28T16:24:36.709 INFO:tasks.workunit.client.1.smithi153.stdout:0/401: rename d4/dc to d4/d1a/d8e/d90 0 2024-02-28T16:24:36.711 INFO:tasks.workunit.client.1.smithi153.stdout:4/316: symlink d4/de/d23/d2b/d31/l6e 0 2024-02-28T16:24:36.715 INFO:tasks.workunit.client.1.smithi153.stdout:2/383: creat d2/d23/d36/f77 x:0 0 0 2024-02-28T16:24:36.717 INFO:tasks.workunit.client.1.smithi153.stdout:9/316: dread d1/d5/d11/d1f/d20/d36/f2d [0,4194304] 0 2024-02-28T16:24:36.719 INFO:tasks.workunit.client.1.smithi153.stdout:9/317: chown d1/d5/d27/f41 4635 1 2024-02-28T16:24:36.721 INFO:tasks.workunit.client.1.smithi153.stdout:7/394: dwrite d1/d25/dc/f35 [0,4194304] 0 2024-02-28T16:24:36.723 INFO:tasks.workunit.client.1.smithi153.stdout:4/317: symlink d4/de/d23/d2b/l6f 0 2024-02-28T16:24:36.723 INFO:tasks.workunit.client.1.smithi153.stdout:8/359: dwrite d0/d12/d15/f5f [0,4194304] 0 2024-02-28T16:24:36.728 INFO:tasks.workunit.client.1.smithi153.stdout:2/384: rmdir d2/d19/d31 39 2024-02-28T16:24:36.731 INFO:tasks.workunit.client.1.smithi153.stdout:2/385: write d2/d23/d36/f51 [1832241,101173] 0 2024-02-28T16:24:36.732 INFO:tasks.workunit.client.1.smithi153.stdout:4/318: creat d4/de/d23/f70 x:0 0 0 2024-02-28T16:24:36.734 INFO:tasks.workunit.client.1.smithi153.stdout:1/349: rename d0/d3d/f6b to d0/f85 0 2024-02-28T16:24:36.738 INFO:tasks.workunit.client.1.smithi153.stdout:1/350: truncate d0/d3d/d4a/f56 4859190 0 2024-02-28T16:24:36.739 INFO:tasks.workunit.client.1.smithi153.stdout:9/318: symlink d1/d5/d11/d1f/d62/l70 0 2024-02-28T16:24:36.739 INFO:tasks.workunit.client.1.smithi153.stdout:8/360: symlink d0/d12/d67/d30/d63/d74/l7f 0 2024-02-28T16:24:36.740 INFO:tasks.workunit.client.1.smithi153.stdout:5/367: read da/dd/d25/f58 [2145246,68625] 0 2024-02-28T16:24:36.741 INFO:tasks.workunit.client.1.smithi153.stdout:4/319: symlink d4/de/d13/d1b/d4e/d50/l71 0 2024-02-28T16:24:36.741 INFO:tasks.workunit.client.1.smithi153.stdout:1/351: stat d0/dd/c20 0 2024-02-28T16:24:36.741 INFO:tasks.workunit.client.1.smithi153.stdout:1/352: readlink d0/d3d/l5c 0 2024-02-28T16:24:36.743 INFO:tasks.workunit.client.1.smithi153.stdout:4/320: chown d4/de/c6b 54321675 1 2024-02-28T16:24:36.743 INFO:tasks.workunit.client.1.smithi153.stdout:2/386: rename d2/d19/f6e to d2/d63/f78 0 2024-02-28T16:24:36.743 INFO:tasks.workunit.client.1.smithi153.stdout:9/319: read d1/d5/d27/d61/f4b [2537629,38793] 0 2024-02-28T16:24:36.748 INFO:tasks.workunit.client.1.smithi153.stdout:8/361: read - d0/d19/d2b/d2d/f5a zero size 2024-02-28T16:24:36.748 INFO:tasks.workunit.client.1.smithi153.stdout:9/320: stat d1/d5/d11/d1f/d20/d45 0 2024-02-28T16:24:36.748 INFO:tasks.workunit.client.1.smithi153.stdout:0/402: write d4/d1a/f39 [1686021,128962] 0 2024-02-28T16:24:36.748 INFO:tasks.workunit.client.1.smithi153.stdout:5/368: creat da/dd/d25/d41/d7c/f84 x:0 0 0 2024-02-28T16:24:36.750 INFO:tasks.workunit.client.1.smithi153.stdout:5/369: chown f9 3351 1 2024-02-28T16:24:36.751 INFO:tasks.workunit.client.1.smithi153.stdout:2/387: creat d2/d19/d4f/f79 x:0 0 0 2024-02-28T16:24:36.754 INFO:tasks.workunit.client.1.smithi153.stdout:8/362: write d0/ff [2162757,75183] 0 2024-02-28T16:24:36.755 INFO:tasks.workunit.client.1.smithi153.stdout:8/363: readlink d0/d12/d67/d30/d63/d74/l7f 0 2024-02-28T16:24:36.756 INFO:tasks.workunit.client.1.smithi153.stdout:8/364: dread - d0/d25/f47 zero size 2024-02-28T16:24:36.757 INFO:tasks.workunit.client.1.smithi153.stdout:4/321: rename d4/de/d23/d2b/d4b/l5c to d4/de/d13/d1b/d4e/d50/l72 0 2024-02-28T16:24:36.760 INFO:tasks.workunit.client.1.smithi153.stdout:1/353: mknod d0/d62/d66/d7c/c86 0 2024-02-28T16:24:36.764 INFO:tasks.workunit.client.1.smithi153.stdout:8/365: creat d0/d34/f80 x:0 0 0 2024-02-28T16:24:36.767 INFO:tasks.workunit.client.1.smithi153.stdout:2/388: rename d2/f26 to d2/d19/d5d/f7a 0 2024-02-28T16:24:36.769 INFO:tasks.workunit.client.1.smithi153.stdout:2/389: write d2/f10 [2481549,107240] 0 2024-02-28T16:24:36.772 INFO:tasks.workunit.client.1.smithi153.stdout:1/354: chown d0/c2 3 1 2024-02-28T16:24:36.773 INFO:tasks.workunit.client.1.smithi153.stdout:5/370: symlink da/d29/d43/l85 0 2024-02-28T16:24:36.774 INFO:tasks.workunit.client.1.smithi153.stdout:5/371: fsync da/dd/d25/f32 0 2024-02-28T16:24:36.776 INFO:tasks.workunit.client.1.smithi153.stdout:5/372: stat da/dd/d25/d41/d7c/f7e 0 2024-02-28T16:24:36.778 INFO:tasks.workunit.client.1.smithi153.stdout:9/321: creat d1/d5/d11/f71 x:0 0 0 2024-02-28T16:24:36.780 INFO:tasks.workunit.client.1.smithi153.stdout:4/322: rename d4/cd to d4/de/d13/d1b/d4e/c73 0 2024-02-28T16:24:36.783 INFO:tasks.workunit.client.1.smithi153.stdout:4/323: dread - d4/de/d23/d2b/d31/f33 zero size 2024-02-28T16:24:36.784 INFO:tasks.workunit.client.1.smithi153.stdout:0/403: dwrite d4/d1a/f21 [0,4194304] 0 2024-02-28T16:24:36.784 INFO:tasks.workunit.client.1.smithi153.stdout:0/404: chown d4/d89 3037539 1 2024-02-28T16:24:36.786 INFO:tasks.workunit.client.1.smithi153.stdout:2/390: rmdir d2 39 2024-02-28T16:24:36.788 INFO:tasks.workunit.client.1.smithi153.stdout:1/355: rmdir d0/dd/d67 39 2024-02-28T16:24:36.789 INFO:tasks.workunit.client.1.smithi153.stdout:1/356: dread - d0/d3d/f7d zero size 2024-02-28T16:24:36.790 INFO:tasks.workunit.client.1.smithi153.stdout:1/357: chown d0/d3d/f43 1937418 1 2024-02-28T16:24:36.791 INFO:tasks.workunit.client.1.smithi153.stdout:0/405: read d4/d1a/d8e/d90/f6c [438217,23697] 0 2024-02-28T16:24:36.793 INFO:tasks.workunit.client.1.smithi153.stdout:1/358: read d0/dd/f37 [1783260,21555] 0 2024-02-28T16:24:36.795 INFO:tasks.workunit.client.1.smithi153.stdout:4/324: symlink d4/de/d47/d5e/d62/l74 0 2024-02-28T16:24:36.800 INFO:tasks.workunit.client.1.smithi153.stdout:8/366: creat d0/d12/f81 x:0 0 0 2024-02-28T16:24:36.802 INFO:tasks.workunit.client.1.smithi153.stdout:0/406: dread d4/d1a/f21 [0,4194304] 0 2024-02-28T16:24:36.805 INFO:tasks.workunit.client.1.smithi153.stdout:2/391: symlink d2/d19/d4f/l7b 0 2024-02-28T16:24:36.808 INFO:tasks.workunit.client.1.smithi153.stdout:8/367: rmdir d0/d19/d2b 39 2024-02-28T16:24:36.810 INFO:tasks.workunit.client.1.smithi153.stdout:8/368: dread - d0/d12/d67/d30/f65 zero size 2024-02-28T16:24:36.811 INFO:tasks.workunit.client.1.smithi153.stdout:8/369: stat d0/d19/d1e/l3b 0 2024-02-28T16:24:36.812 INFO:tasks.workunit.client.1.smithi153.stdout:5/373: rename da/dd/d25/f78 to da/f86 0 2024-02-28T16:24:36.813 INFO:tasks.workunit.client.1.smithi153.stdout:0/407: rmdir d4/d89 39 2024-02-28T16:24:36.814 INFO:tasks.workunit.client.1.smithi153.stdout:2/392: mknod d2/d19/d2a/d3b/c7c 0 2024-02-28T16:24:36.815 INFO:tasks.workunit.client.1.smithi153.stdout:9/322: getdents d1/d5/d11/d1f/d20/d36 0 2024-02-28T16:24:36.815 INFO:tasks.workunit.client.1.smithi153.stdout:0/408: fdatasync d4/d1a/d65/f7a 0 2024-02-28T16:24:36.816 INFO:tasks.workunit.client.1.smithi153.stdout:1/359: dwrite d0/d3d/f71 [0,4194304] 0 2024-02-28T16:24:36.817 INFO:tasks.workunit.client.1.smithi153.stdout:1/360: stat d0/l6e 0 2024-02-28T16:24:36.819 INFO:tasks.workunit.client.1.smithi153.stdout:0/409: creat d4/d32/f91 x:0 0 0 2024-02-28T16:24:36.821 INFO:tasks.workunit.client.1.smithi153.stdout:0/410: chown d4/d27/f42 0 1 2024-02-28T16:24:36.824 INFO:tasks.workunit.client.1.smithi153.stdout:9/323: mknod d1/d5/d11/c72 0 2024-02-28T16:24:36.828 INFO:tasks.workunit.client.1.smithi153.stdout:2/393: creat d2/f7d x:0 0 0 2024-02-28T16:24:36.829 INFO:tasks.workunit.client.1.smithi153.stdout:1/361: link d0/dd/f2d d0/d3d/f87 0 2024-02-28T16:24:36.830 INFO:tasks.workunit.client.1.smithi153.stdout:9/324: mknod d1/d2a/c73 0 2024-02-28T16:24:36.830 INFO:tasks.workunit.client.1.smithi153.stdout:5/374: dwrite da/dd/f47 [4194304,4194304] 0 2024-02-28T16:24:36.831 INFO:tasks.workunit.client.1.smithi153.stdout:2/394: read d2/f1c [716553,80359] 0 2024-02-28T16:24:36.833 INFO:tasks.workunit.client.1.smithi153.stdout:8/370: link d0/d34/d50/c78 d0/d12/d67/c82 0 2024-02-28T16:24:36.835 INFO:tasks.workunit.client.1.smithi153.stdout:5/375: chown da/f19 886 1 2024-02-28T16:24:36.835 INFO:tasks.workunit.client.1.smithi153.stdout:9/325: chown d1/d5/c1e 268 1 2024-02-28T16:24:36.837 INFO:tasks.workunit.client.1.smithi153.stdout:0/411: link d4/d1a/d8e/d90/f5e d4/d89/f92 0 2024-02-28T16:24:36.838 INFO:tasks.workunit.client.1.smithi153.stdout:5/376: write da/d29/d43/f48 [809277,71927] 0 2024-02-28T16:24:36.840 INFO:tasks.workunit.client.1.smithi153.stdout:8/371: unlink d0/d34/d50/f75 0 2024-02-28T16:24:36.840 INFO:tasks.workunit.client.1.smithi153.stdout:0/412: chown d4/d1a/d65/f84 15342 1 2024-02-28T16:24:36.842 INFO:tasks.workunit.client.1.smithi153.stdout:0/413: chown d4/d1a/d8e/d90/f2e 402 1 2024-02-28T16:24:36.844 INFO:tasks.workunit.client.1.smithi153.stdout:9/326: unlink d1/d5/d27/d61/f4b 0 2024-02-28T16:24:36.845 INFO:tasks.workunit.client.1.smithi153.stdout:0/414: chown d4/d1a/d8e/d90/f19 5116349 1 2024-02-28T16:24:36.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/377: chown da/l67 53673948 1 2024-02-28T16:24:36.847 INFO:tasks.workunit.client.1.smithi153.stdout:8/372: dread d0/f64 [0,4194304] 0 2024-02-28T16:24:36.847 INFO:tasks.workunit.client.1.smithi153.stdout:0/415: symlink d4/d32/d7f/l93 0 2024-02-28T16:24:36.849 INFO:tasks.workunit.client.1.smithi153.stdout:5/378: fdatasync da/dd/d25/f5d 0 2024-02-28T16:24:36.849 INFO:tasks.workunit.client.1.smithi153.stdout:8/373: chown d0/d34/d50/c69 205077406 1 2024-02-28T16:24:36.851 INFO:tasks.workunit.client.1.smithi153.stdout:5/379: stat da/dd/d54/l7a 0 2024-02-28T16:24:36.858 INFO:tasks.workunit.client.1.smithi153.stdout:8/374: getdents d0/d25 0 2024-02-28T16:24:36.859 INFO:tasks.workunit.client.1.smithi153.stdout:8/375: chown d0/c26 0 1 2024-02-28T16:24:36.861 INFO:tasks.workunit.client.1.smithi153.stdout:5/380: getdents da/dd/d54 0 2024-02-28T16:24:36.863 INFO:tasks.workunit.client.1.smithi153.stdout:5/381: dread - da/dd/d25/f5d zero size 2024-02-28T16:24:36.865 INFO:tasks.workunit.client.1.smithi153.stdout:0/416: dwrite d4/d27/f42 [4194304,4194304] 0 2024-02-28T16:24:36.866 INFO:tasks.workunit.client.1.smithi153.stdout:5/382: dread - da/d29/f3e zero size 2024-02-28T16:24:36.867 INFO:tasks.workunit.client.1.smithi153.stdout:8/376: mknod d0/c83 0 2024-02-28T16:24:36.867 INFO:tasks.workunit.client.1.smithi153.stdout:9/327: dread d1/d5/d11/d1f/d20/d36/f38 [4194304,4194304] 0 2024-02-28T16:24:36.871 INFO:tasks.workunit.client.1.smithi153.stdout:5/383: mknod da/dd/d54/c87 0 2024-02-28T16:24:36.871 INFO:tasks.workunit.client.1.smithi153.stdout:0/417: write d4/d27/f44 [265838,26897] 0 2024-02-28T16:24:36.873 INFO:tasks.workunit.client.1.smithi153.stdout:9/328: mkdir d1/d74 0 2024-02-28T16:24:36.875 INFO:tasks.workunit.client.1.smithi153.stdout:5/384: symlink da/dd/d54/l88 0 2024-02-28T16:24:36.883 INFO:tasks.workunit.client.1.smithi153.stdout:6/372: sync 2024-02-28T16:24:36.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/329: getdents d1/d5/d27/d61/d6a 0 2024-02-28T16:24:36.887 INFO:tasks.workunit.client.1.smithi153.stdout:0/418: dread d4/d1a/f21 [0,4194304] 0 2024-02-28T16:24:36.888 INFO:tasks.workunit.client.1.smithi153.stdout:9/330: fsync d1/d5/d11/d1f/d20/f49 0 2024-02-28T16:24:36.888 INFO:tasks.workunit.client.1.smithi153.stdout:8/377: dread d0/f9 [0,4194304] 0 2024-02-28T16:24:36.889 INFO:tasks.workunit.client.1.smithi153.stdout:0/419: fdatasync d4/d1a/d65/f84 0 2024-02-28T16:24:36.890 INFO:tasks.workunit.client.1.smithi153.stdout:9/331: stat d1/d5/d11/d1f 0 2024-02-28T16:24:36.891 INFO:tasks.workunit.client.1.smithi153.stdout:9/332: stat d1/d5/d11/d1f/d20/d45/f55 0 2024-02-28T16:24:36.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/333: stat d1/d69 0 2024-02-28T16:24:36.895 INFO:tasks.workunit.client.1.smithi153.stdout:6/373: truncate d0/d1d/d30/f36 1526748 0 2024-02-28T16:24:36.895 INFO:tasks.workunit.client.1.smithi153.stdout:0/420: mkdir d4/d1a/d8e/d94 0 2024-02-28T16:24:36.895 INFO:tasks.workunit.client.1.smithi153.stdout:8/378: write d0/d19/d2b/d2d/f5a [149031,57841] 0 2024-02-28T16:24:36.900 INFO:tasks.workunit.client.1.smithi153.stdout:6/374: symlink d0/d15/d48/l8a 0 2024-02-28T16:24:36.902 INFO:tasks.workunit.client.1.smithi153.stdout:5/385: dwrite da/f27 [0,4194304] 0 2024-02-28T16:24:36.904 INFO:tasks.workunit.client.1.smithi153.stdout:0/421: symlink d4/d27/l95 0 2024-02-28T16:24:36.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/375: creat d0/d1d/d23/d60/f8b x:0 0 0 2024-02-28T16:24:36.911 INFO:tasks.workunit.client.1.smithi153.stdout:5/386: fsync da/f2c 0 2024-02-28T16:24:36.911 INFO:tasks.workunit.client.1.smithi153.stdout:8/379: truncate d0/f51 124384 0 2024-02-28T16:24:36.911 INFO:tasks.workunit.client.1.smithi153.stdout:6/376: write d0/d15/d68/f7b [137824,88189] 0 2024-02-28T16:24:36.914 INFO:tasks.workunit.client.1.smithi153.stdout:0/422: creat d4/d32/f96 x:0 0 0 2024-02-28T16:24:36.915 INFO:tasks.workunit.client.1.smithi153.stdout:9/334: dwrite d1/d5/d11/d1f/d20/d5d/f5f [0,4194304] 0 2024-02-28T16:24:36.915 INFO:tasks.workunit.client.1.smithi153.stdout:8/380: write d0/f11 [4960351,57286] 0 2024-02-28T16:24:36.917 INFO:tasks.workunit.client.1.smithi153.stdout:6/377: mkdir d0/d15/d48/d63/d8c 0 2024-02-28T16:24:36.920 INFO:tasks.workunit.client.1.smithi153.stdout:9/335: fdatasync d1/d5/d11/d1f/d52/f6c 0 2024-02-28T16:24:36.922 INFO:tasks.workunit.client.1.smithi153.stdout:0/423: unlink d4/d1a/d65/l74 0 2024-02-28T16:24:36.922 INFO:tasks.workunit.client.1.smithi153.stdout:6/378: truncate d0/d17/f28 2108521 0 2024-02-28T16:24:36.924 INFO:tasks.workunit.client.1.smithi153.stdout:8/381: fdatasync d0/d12/d15/f6d 0 2024-02-28T16:24:36.928 INFO:tasks.workunit.client.1.smithi153.stdout:6/379: dread - d0/d1d/d23/f59 zero size 2024-02-28T16:24:36.939 INFO:tasks.workunit.client.1.smithi153.stdout:9/336: dread d1/d5/fb [0,4194304] 0 2024-02-28T16:24:36.943 INFO:tasks.workunit.client.1.smithi153.stdout:6/380: rename d0/d15/d2e/d65 to d0/d1d/d33/d8d 0 2024-02-28T16:24:36.944 INFO:tasks.workunit.client.1.smithi153.stdout:0/424: rename d4/f2f to d4/f97 0 2024-02-28T16:24:36.945 INFO:tasks.workunit.client.1.smithi153.stdout:6/381: chown d0/d15/d2e/f42 629476 1 2024-02-28T16:24:36.946 INFO:tasks.workunit.client.1.smithi153.stdout:6/382: fsync d0/d1d/d30/f31 0 2024-02-28T16:24:36.947 INFO:tasks.workunit.client.1.smithi153.stdout:5/387: truncate da/d29/f5b 116485 0 2024-02-28T16:24:36.952 INFO:tasks.workunit.client.1.smithi153.stdout:0/425: fdatasync d4/f78 0 2024-02-28T16:24:36.952 INFO:tasks.workunit.client.1.smithi153.stdout:0/426: fdatasync d4/d32/f82 0 2024-02-28T16:24:36.955 INFO:tasks.workunit.client.1.smithi153.stdout:5/388: rename da/d29/d43/d5a/c64 to da/d29/d43/d5a/c89 0 2024-02-28T16:24:36.959 INFO:tasks.workunit.client.1.smithi153.stdout:9/337: creat d1/d5/d11/f75 x:0 0 0 2024-02-28T16:24:36.963 INFO:tasks.workunit.client.1.smithi153.stdout:5/389: fsync da/f51 0 2024-02-28T16:24:36.964 INFO:tasks.workunit.client.1.smithi153.stdout:8/382: dwrite d0/f51 [0,4194304] 0 2024-02-28T16:24:36.967 INFO:tasks.workunit.client.1.smithi153.stdout:8/383: fdatasync d0/d12/d15/f5f 0 2024-02-28T16:24:36.972 INFO:tasks.workunit.client.1.smithi153.stdout:6/383: rename d0/f45 to d0/d1d/d23/f8e 0 2024-02-28T16:24:36.977 INFO:tasks.workunit.client.1.smithi153.stdout:5/390: unlink da/dd/f7b 0 2024-02-28T16:24:36.980 INFO:tasks.workunit.client.1.smithi153.stdout:8/384: rmdir d0/d19/d2b 39 2024-02-28T16:24:36.984 INFO:tasks.workunit.client.1.smithi153.stdout:7/395: sync 2024-02-28T16:24:36.985 INFO:tasks.workunit.client.1.smithi153.stdout:2/395: sync 2024-02-28T16:24:36.985 INFO:tasks.workunit.client.1.smithi153.stdout:3/375: sync 2024-02-28T16:24:36.985 INFO:tasks.workunit.client.1.smithi153.stdout:4/325: sync 2024-02-28T16:24:36.985 INFO:tasks.workunit.client.1.smithi153.stdout:1/362: sync 2024-02-28T16:24:36.985 INFO:tasks.workunit.client.1.smithi153.stdout:6/384: creat d0/d15/d48/d72/f8f x:0 0 0 2024-02-28T16:24:36.987 INFO:tasks.workunit.client.1.smithi153.stdout:2/396: stat d2/d25/f6d 0 2024-02-28T16:24:36.988 INFO:tasks.workunit.client.1.smithi153.stdout:6/385: chown d0/d15/d2e/f42 129611 1 2024-02-28T16:24:36.989 INFO:tasks.workunit.client.1.smithi153.stdout:0/427: getdents d4/d1a/d8e/d90 0 2024-02-28T16:24:36.991 INFO:tasks.workunit.client.1.smithi153.stdout:1/363: fdatasync d0/d3d/d4a/d59/f5a 0 2024-02-28T16:24:36.992 INFO:tasks.workunit.client.1.smithi153.stdout:9/338: rmdir d1 39 2024-02-28T16:24:36.992 INFO:tasks.workunit.client.1.smithi153.stdout:2/397: dread - d2/d23/d36/f77 zero size 2024-02-28T16:24:36.993 INFO:tasks.workunit.client.1.smithi153.stdout:1/364: stat d0/d3d/f3e 0 2024-02-28T16:24:36.993 INFO:tasks.workunit.client.1.smithi153.stdout:8/385: chown d0/d12/c13 11 1 2024-02-28T16:24:36.995 INFO:tasks.workunit.client.1.smithi153.stdout:2/398: chown d2/d25/f6d 33948 1 2024-02-28T16:24:36.996 INFO:tasks.workunit.client.1.smithi153.stdout:5/391: mkdir da/dd/d25/d8a 0 2024-02-28T16:24:37.000 INFO:tasks.workunit.client.1.smithi153.stdout:4/326: rmdir d4/de/d13/d1b/d4e 39 2024-02-28T16:24:37.004 INFO:tasks.workunit.client.1.smithi153.stdout:7/396: rmdir d1/d25/df/d26 39 2024-02-28T16:24:37.006 INFO:tasks.workunit.client.1.smithi153.stdout:3/376: creat d4/d8/d1e/d2a/d35/d54/f82 x:0 0 0 2024-02-28T16:24:37.007 INFO:tasks.workunit.client.1.smithi153.stdout:0/428: symlink d4/d89/l98 0 2024-02-28T16:24:37.010 INFO:tasks.workunit.client.1.smithi153.stdout:6/386: mknod d0/d1d/d5d/c90 0 2024-02-28T16:24:37.011 INFO:tasks.workunit.client.1.smithi153.stdout:9/339: chown d1/d5/d11/d1f/d20/d36 104845596 1 2024-02-28T16:24:37.012 INFO:tasks.workunit.client.1.smithi153.stdout:1/365: rename d0/dd/f34 to d0/d3d/f88 0 2024-02-28T16:24:37.014 INFO:tasks.workunit.client.1.smithi153.stdout:1/366: chown d0/l7 170025 1 2024-02-28T16:24:37.015 INFO:tasks.workunit.client.1.smithi153.stdout:8/386: mkdir d0/d25/d84 0 2024-02-28T16:24:37.016 INFO:tasks.workunit.client.1.smithi153.stdout:9/340: write d1/d5/d11/f71 [932770,106213] 0 2024-02-28T16:24:37.017 INFO:tasks.workunit.client.1.smithi153.stdout:1/367: dread - d0/d3d/d4a/f7b zero size 2024-02-28T16:24:37.018 INFO:tasks.workunit.client.1.smithi153.stdout:8/387: chown d0/d12/d67/d30 442785235 1 2024-02-28T16:24:37.019 INFO:tasks.workunit.client.1.smithi153.stdout:6/387: mkdir d0/d1d/d30/d71/d91 0 2024-02-28T16:24:37.021 INFO:tasks.workunit.client.1.smithi153.stdout:9/341: truncate d1/f34 5012918 0 2024-02-28T16:24:37.021 INFO:tasks.workunit.client.1.smithi153.stdout:1/368: chown d0/d62/d66/d7c/c86 41486262 1 2024-02-28T16:24:37.022 INFO:tasks.workunit.client.1.smithi153.stdout:6/388: chown d0/d1d/d5d 204647267 1 2024-02-28T16:24:37.024 INFO:tasks.workunit.client.1.smithi153.stdout:2/399: unlink d2/d19/c1a 0 2024-02-28T16:24:37.026 INFO:tasks.workunit.client.1.smithi153.stdout:3/377: dread d4/d8/fd [0,4194304] 0 2024-02-28T16:24:37.028 INFO:tasks.workunit.client.1.smithi153.stdout:0/429: dread d4/d1a/f21 [0,4194304] 0 2024-02-28T16:24:37.028 INFO:tasks.workunit.client.1.smithi153.stdout:5/392: write da/dd/d25/f58 [1109995,128438] 0 2024-02-28T16:24:37.029 INFO:tasks.workunit.client.1.smithi153.stdout:8/388: dread d0/d19/f43 [0,4194304] 0 2024-02-28T16:24:37.031 INFO:tasks.workunit.client.1.smithi153.stdout:5/393: write da/dd/f15 [391576,123402] 0 2024-02-28T16:24:37.037 INFO:tasks.workunit.client.1.smithi153.stdout:7/397: rename d1/d70/d87 to d1/d25/d88 0 2024-02-28T16:24:37.043 INFO:tasks.workunit.client.1.smithi153.stdout:4/327: getdents d4/de/d40/d4d/d51 0 2024-02-28T16:24:37.047 INFO:tasks.workunit.client.1.smithi153.stdout:5/394: rename da/d29/f3e to da/d29/d43/d5a/d77/f8b 0 2024-02-28T16:24:37.049 INFO:tasks.workunit.client.1.smithi153.stdout:0/430: mkdir d4/d99 0 2024-02-28T16:24:37.050 INFO:tasks.workunit.client.1.smithi153.stdout:0/431: readlink d4/d32/l46 0 2024-02-28T16:24:37.055 INFO:tasks.workunit.client.1.smithi153.stdout:6/389: dwrite d0/d66/f6a [4194304,4194304] 0 2024-02-28T16:24:37.061 INFO:tasks.workunit.client.1.smithi153.stdout:6/390: chown d0/d15/d48/l8a 1653399543 1 2024-02-28T16:24:37.062 INFO:tasks.workunit.client.1.smithi153.stdout:8/389: write d0/d19/d2b/d2d/f35 [1261364,111015] 0 2024-02-28T16:24:37.063 INFO:tasks.workunit.client.1.smithi153.stdout:2/400: dwrite d2/d19/d2a/f47 [0,4194304] 0 2024-02-28T16:24:37.072 INFO:tasks.workunit.client.1.smithi153.stdout:4/328: rename d4/cf to d4/de/d47/d5e/c75 0 2024-02-28T16:24:37.085 INFO:tasks.workunit.client.1.smithi153.stdout:6/391: creat d0/d15/d48/d63/f92 x:0 0 0 2024-02-28T16:24:37.091 INFO:tasks.workunit.client.1.smithi153.stdout:4/329: rename d4/f2d to d4/d53/f76 0 2024-02-28T16:24:37.100 INFO:tasks.workunit.client.1.smithi153.stdout:5/395: link da/c33 da/dd/d25/d41/c8c 0 2024-02-28T16:24:37.100 INFO:tasks.workunit.client.1.smithi153.stdout:7/398: dwrite d1/d25/f7 [0,4194304] 0 2024-02-28T16:24:37.100 INFO:tasks.workunit.client.1.smithi153.stdout:8/390: dwrite d0/d12/d15/f5f [0,4194304] 0 2024-02-28T16:24:37.102 INFO:tasks.workunit.client.1.smithi153.stdout:4/330: unlink d4/de/d23/d2b/d31/l6e 0 2024-02-28T16:24:37.104 INFO:tasks.workunit.client.1.smithi153.stdout:2/401: getdents d2/d23/d36 0 2024-02-28T16:24:37.108 INFO:tasks.workunit.client.1.smithi153.stdout:8/391: write d0/d19/f76 [422359,49424] 0 2024-02-28T16:24:37.110 INFO:tasks.workunit.client.1.smithi153.stdout:5/396: unlink da/l21 0 2024-02-28T16:24:37.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/399: creat d1/d25/df/d60/f89 x:0 0 0 2024-02-28T16:24:37.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/400: dread - d1/d25/dc/d50/f65 zero size 2024-02-28T16:24:37.118 INFO:tasks.workunit.client.1.smithi153.stdout:8/392: truncate d0/d19/d2b/d2d/f70 758202 0 2024-02-28T16:24:37.118 INFO:tasks.workunit.client.1.smithi153.stdout:4/331: mknod d4/de/d23/d2b/d4b/c77 0 2024-02-28T16:24:37.133 INFO:tasks.workunit.client.1.smithi153.stdout:6/392: write d0/d1d/d23/d60/f74 [610985,17823] 0 2024-02-28T16:24:37.136 INFO:tasks.workunit.client.1.smithi153.stdout:2/402: getdents d2/d19/d3e 0 2024-02-28T16:24:37.137 INFO:tasks.workunit.client.1.smithi153.stdout:7/401: mkdir d1/d25/df/d8a 0 2024-02-28T16:24:37.138 INFO:tasks.workunit.client.1.smithi153.stdout:4/332: getdents d4/de/d40/d4d/d51 0 2024-02-28T16:24:37.140 INFO:tasks.workunit.client.1.smithi153.stdout:9/342: sync 2024-02-28T16:24:37.140 INFO:tasks.workunit.client.1.smithi153.stdout:6/393: symlink d0/d1d/d33/d8d/l93 0 2024-02-28T16:24:37.141 INFO:tasks.workunit.client.1.smithi153.stdout:9/343: stat d1/d5/d27 0 2024-02-28T16:24:37.145 INFO:tasks.workunit.client.1.smithi153.stdout:7/402: creat d1/f8b x:0 0 0 2024-02-28T16:24:37.156 INFO:tasks.workunit.client.1.smithi153.stdout:8/393: write d0/d34/f3d [1734856,22687] 0 2024-02-28T16:24:37.158 INFO:tasks.workunit.client.1.smithi153.stdout:7/403: write d1/d25/df/d26/d3a/d3f/f74 [1548251,89091] 0 2024-02-28T16:24:37.161 INFO:tasks.workunit.client.1.smithi153.stdout:5/397: dread da/d29/f56 [0,4194304] 0 2024-02-28T16:24:37.164 INFO:tasks.workunit.client.1.smithi153.stdout:2/403: rmdir d2/d19/d2a/d3b/d5e 39 2024-02-28T16:24:37.165 INFO:tasks.workunit.client.1.smithi153.stdout:4/333: dwrite d4/de/f60 [0,4194304] 0 2024-02-28T16:24:37.166 INFO:tasks.workunit.client.1.smithi153.stdout:2/404: write d2/f20 [4701189,112074] 0 2024-02-28T16:24:37.168 INFO:tasks.workunit.client.1.smithi153.stdout:7/404: creat d1/d25/df/d26/f8c x:0 0 0 2024-02-28T16:24:37.169 INFO:tasks.workunit.client.1.smithi153.stdout:2/405: stat d2/d23/f29 0 2024-02-28T16:24:37.170 INFO:tasks.workunit.client.1.smithi153.stdout:9/344: mkdir d1/d5/d11/d1f/d43/d76 0 2024-02-28T16:24:37.174 INFO:tasks.workunit.client.1.smithi153.stdout:4/334: rename d4/de/d23/c2e to d4/c78 0 2024-02-28T16:24:37.175 INFO:tasks.workunit.client.1.smithi153.stdout:9/345: dread - d1/d5/d11/d1f/d20/d45/f53 zero size 2024-02-28T16:24:37.178 INFO:tasks.workunit.client.1.smithi153.stdout:7/405: creat d1/f8d x:0 0 0 2024-02-28T16:24:37.179 INFO:tasks.workunit.client.1.smithi153.stdout:9/346: write d1/d5/d11/d1f/d20/f68 [224469,30828] 0 2024-02-28T16:24:37.182 INFO:tasks.workunit.client.1.smithi153.stdout:5/398: creat da/dd/d25/d8a/f8d x:0 0 0 2024-02-28T16:24:37.183 INFO:tasks.workunit.client.1.smithi153.stdout:9/347: dread - d1/d5/d11/d1f/d52/f6c zero size 2024-02-28T16:24:37.187 INFO:tasks.workunit.client.1.smithi153.stdout:2/406: dread d2/d19/d3e/f65 [0,4194304] 0 2024-02-28T16:24:37.191 INFO:tasks.workunit.client.1.smithi153.stdout:5/399: write da/d29/d43/d5a/d77/f8b [703699,52508] 0 2024-02-28T16:24:37.191 INFO:tasks.workunit.client.1.smithi153.stdout:4/335: write d4/de/d23/f30 [3751144,90900] 0 2024-02-28T16:24:37.192 INFO:tasks.workunit.client.1.smithi153.stdout:2/407: mknod d2/d63/c7e 0 2024-02-28T16:24:37.196 INFO:tasks.workunit.client.1.smithi153.stdout:2/408: write d2/f6 [773421,19522] 0 2024-02-28T16:24:37.199 INFO:tasks.workunit.client.1.smithi153.stdout:5/400: chown da/c2a 7803 1 2024-02-28T16:24:37.202 INFO:tasks.workunit.client.1.smithi153.stdout:5/401: chown da/dd/d25/d41/c6e 1683 1 2024-02-28T16:24:37.203 INFO:tasks.workunit.client.1.smithi153.stdout:4/336: truncate d4/de/d13/f35 303645 0 2024-02-28T16:24:37.203 INFO:tasks.workunit.client.1.smithi153.stdout:7/406: dwrite d1/d25/fe [0,4194304] 0 2024-02-28T16:24:37.207 INFO:tasks.workunit.client.1.smithi153.stdout:9/348: link d1/d5/d27/d61/l2f d1/d5/d27/d61/l77 0 2024-02-28T16:24:37.207 INFO:tasks.workunit.client.1.smithi153.stdout:8/394: dwrite d0/d19/f38 [0,4194304] 0 2024-02-28T16:24:37.209 INFO:tasks.workunit.client.1.smithi153.stdout:8/395: readlink d0/d19/d2b/l2f 0 2024-02-28T16:24:37.214 INFO:tasks.workunit.client.1.smithi153.stdout:4/337: symlink d4/d53/l79 0 2024-02-28T16:24:37.214 INFO:tasks.workunit.client.1.smithi153.stdout:5/402: mknod da/dd/d25/d41/c8e 0 2024-02-28T16:24:37.218 INFO:tasks.workunit.client.1.smithi153.stdout:8/396: mkdir d0/d19/d1c/d85 0 2024-02-28T16:24:37.219 INFO:tasks.workunit.client.1.smithi153.stdout:9/349: mkdir d1/d5/d27/d61/d78 0 2024-02-28T16:24:37.221 INFO:tasks.workunit.client.1.smithi153.stdout:7/407: truncate d1/d25/f49 485453 0 2024-02-28T16:24:37.226 INFO:tasks.workunit.client.1.smithi153.stdout:7/408: dread - d1/d25/dc/d50/f65 zero size 2024-02-28T16:24:37.227 INFO:tasks.workunit.client.1.smithi153.stdout:2/409: dwrite d2/d19/d2a/f45 [0,4194304] 0 2024-02-28T16:24:37.234 INFO:tasks.workunit.client.1.smithi153.stdout:2/410: write d2/f10 [3419454,72895] 0 2024-02-28T16:24:37.234 INFO:tasks.workunit.client.1.smithi153.stdout:8/397: symlink d0/d19/d2b/d2d/d3f/l86 0 2024-02-28T16:24:37.236 INFO:tasks.workunit.client.1.smithi153.stdout:9/350: rename d1/d5/d27/d61/d6a to d1/d5/d11/d29/d79 0 2024-02-28T16:24:37.237 INFO:tasks.workunit.client.1.smithi153.stdout:2/411: stat d2/d19/d4f/f79 0 2024-02-28T16:24:37.239 INFO:tasks.workunit.client.1.smithi153.stdout:4/338: getdents d4/de/d40/d4d 0 2024-02-28T16:24:37.240 INFO:tasks.workunit.client.1.smithi153.stdout:5/403: dread da/d29/d43/f4f [4194304,4194304] 0 2024-02-28T16:24:37.242 INFO:tasks.workunit.client.1.smithi153.stdout:5/404: write da/d29/d43/f48 [3707581,21414] 0 2024-02-28T16:24:37.246 INFO:tasks.workunit.client.1.smithi153.stdout:2/412: creat d2/d23/d36/f7f x:0 0 0 2024-02-28T16:24:37.247 INFO:tasks.workunit.client.1.smithi153.stdout:2/413: fdatasync d2/f7 0 2024-02-28T16:24:37.249 INFO:tasks.workunit.client.1.smithi153.stdout:7/409: link d1/d25/dc/c7d d1/d25/d27/c8e 0 2024-02-28T16:24:37.251 INFO:tasks.workunit.client.1.smithi153.stdout:2/414: write d2/d23/d48/f75 [68873,107049] 0 2024-02-28T16:24:37.255 INFO:tasks.workunit.client.1.smithi153.stdout:5/405: mkdir da/dd/d25/d82/d8f 0 2024-02-28T16:24:37.256 INFO:tasks.workunit.client.1.smithi153.stdout:7/410: read d1/d25/df/d60/f67 [2635333,48135] 0 2024-02-28T16:24:37.261 INFO:tasks.workunit.client.1.smithi153.stdout:4/339: write d4/f7 [1494231,97702] 0 2024-02-28T16:24:37.262 INFO:tasks.workunit.client.1.smithi153.stdout:9/351: getdents d1/d5 0 2024-02-28T16:24:37.263 INFO:tasks.workunit.client.1.smithi153.stdout:4/340: read - d4/de/d47/f67 zero size 2024-02-28T16:24:37.266 INFO:tasks.workunit.client.1.smithi153.stdout:9/352: chown d1/d5/d11/d1f/d20/d36/c33 1694198588 1 2024-02-28T16:24:37.266 INFO:tasks.workunit.client.1.smithi153.stdout:2/415: mkdir d2/d25/d49/d80 0 2024-02-28T16:24:37.269 INFO:tasks.workunit.client.1.smithi153.stdout:7/411: creat d1/d25/df/f8f x:0 0 0 2024-02-28T16:24:37.270 INFO:tasks.workunit.client.1.smithi153.stdout:9/353: creat d1/d5/f7a x:0 0 0 2024-02-28T16:24:37.271 INFO:tasks.workunit.client.1.smithi153.stdout:4/341: symlink d4/de/d13/d1b/d4e/d50/l7a 0 2024-02-28T16:24:37.272 INFO:tasks.workunit.client.1.smithi153.stdout:7/412: write d1/d25/df/d60/f89 [131479,87141] 0 2024-02-28T16:24:37.274 INFO:tasks.workunit.client.1.smithi153.stdout:2/416: rename d2/c15 to d2/d19/d4f/c81 0 2024-02-28T16:24:37.279 INFO:tasks.workunit.client.1.smithi153.stdout:1/369: sync 2024-02-28T16:24:37.279 INFO:tasks.workunit.client.1.smithi153.stdout:7/413: dread - d1/d25/df/d26/f84 zero size 2024-02-28T16:24:37.279 INFO:tasks.workunit.client.1.smithi153.stdout:5/406: dwrite da/dd/f15 [0,4194304] 0 2024-02-28T16:24:37.279 INFO:tasks.workunit.client.1.smithi153.stdout:4/342: symlink d4/de/d13/d1b/d4e/l7b 0 2024-02-28T16:24:37.280 INFO:tasks.workunit.client.1.smithi153.stdout:4/343: stat d4/de/d13/c36 0 2024-02-28T16:24:37.280 INFO:tasks.workunit.client.1.smithi153.stdout:1/370: dread - d0/dd/d67/f83 zero size 2024-02-28T16:24:37.285 INFO:tasks.workunit.client.1.smithi153.stdout:2/417: mknod d2/d19/d2a/d3b/c82 0 2024-02-28T16:24:37.285 INFO:tasks.workunit.client.1.smithi153.stdout:7/414: mknod d1/d25/d27/d43/c90 0 2024-02-28T16:24:37.286 INFO:tasks.workunit.client.1.smithi153.stdout:2/418: chown d2/la 142 1 2024-02-28T16:24:37.289 INFO:tasks.workunit.client.1.smithi153.stdout:1/371: write d0/d3d/d4a/f51 [2343826,102106] 0 2024-02-28T16:24:37.291 INFO:tasks.workunit.client.1.smithi153.stdout:1/372: chown d0/l52 27 1 2024-02-28T16:24:37.296 INFO:tasks.workunit.client.1.smithi153.stdout:5/407: dwrite da/d29/f56 [0,4194304] 0 2024-02-28T16:24:37.298 INFO:tasks.workunit.client.1.smithi153.stdout:7/415: rename d1/d25/df/d26/d3a/d52/d7f to d1/d25/dc/d7e/d91 0 2024-02-28T16:24:37.300 INFO:tasks.workunit.client.1.smithi153.stdout:7/416: chown d1/d25/d88 664 1 2024-02-28T16:24:37.302 INFO:tasks.workunit.client.1.smithi153.stdout:1/373: dread d0/d3d/f3e [0,4194304] 0 2024-02-28T16:24:37.305 INFO:tasks.workunit.client.1.smithi153.stdout:9/354: unlink d1/d5/d27/d61/c26 0 2024-02-28T16:24:37.307 INFO:tasks.workunit.client.1.smithi153.stdout:7/417: chown d1/d25/df/d26/d3a/d52/d63 961858 1 2024-02-28T16:24:37.309 INFO:tasks.workunit.client.1.smithi153.stdout:5/408: creat da/dd/d25/d8a/f90 x:0 0 0 2024-02-28T16:24:37.309 INFO:tasks.workunit.client.1.smithi153.stdout:2/419: dwrite d2/d23/d36/f3c [0,4194304] 0 2024-02-28T16:24:37.312 INFO:tasks.workunit.client.1.smithi153.stdout:2/420: write d2/d23/f42 [8811,35968] 0 2024-02-28T16:24:37.313 INFO:tasks.workunit.client.1.smithi153.stdout:4/344: truncate d4/de/f57 933080 0 2024-02-28T16:24:37.318 INFO:tasks.workunit.client.1.smithi153.stdout:1/374: write d0/dd/f30 [5228832,102790] 0 2024-02-28T16:24:37.322 INFO:tasks.workunit.client.1.smithi153.stdout:9/355: unlink d1/d5/d11/c72 0 2024-02-28T16:24:37.325 INFO:tasks.workunit.client.1.smithi153.stdout:2/421: write d2/d63/f78 [2222109,47114] 0 2024-02-28T16:24:37.325 INFO:tasks.workunit.client.1.smithi153.stdout:7/418: write d1/d25/dc/d50/f5b [1430250,52214] 0 2024-02-28T16:24:37.327 INFO:tasks.workunit.client.1.smithi153.stdout:9/356: read d1/f4e [721853,4758] 0 2024-02-28T16:24:37.327 INFO:tasks.workunit.client.1.smithi153.stdout:7/419: read - d1/f8d zero size 2024-02-28T16:24:37.328 INFO:tasks.workunit.client.1.smithi153.stdout:2/422: write d2/d23/d48/f75 [323253,81751] 0 2024-02-28T16:24:37.329 INFO:tasks.workunit.client.1.smithi153.stdout:5/409: unlink da/d29/d43/d5a/c89 0 2024-02-28T16:24:37.330 INFO:tasks.workunit.client.1.smithi153.stdout:2/423: chown d2/d19/d3e/l5a 966 1 2024-02-28T16:24:37.331 INFO:tasks.workunit.client.1.smithi153.stdout:4/345: write f0 [754953,12751] 0 2024-02-28T16:24:37.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/375: mkdir d0/dd/d67/d89 0 2024-02-28T16:24:37.334 INFO:tasks.workunit.client.1.smithi153.stdout:2/424: read d2/d23/d36/f51 [1284875,51039] 0 2024-02-28T16:24:37.338 INFO:tasks.workunit.client.1.smithi153.stdout:2/425: chown d2/c8 848442 1 2024-02-28T16:24:37.339 INFO:tasks.workunit.client.1.smithi153.stdout:5/410: dread - da/f3a zero size 2024-02-28T16:24:37.340 INFO:tasks.workunit.client.1.smithi153.stdout:4/346: mkdir d4/d53/d7c 0 2024-02-28T16:24:37.341 INFO:tasks.workunit.client.1.smithi153.stdout:2/426: chown d2/d19/l32 640620 1 2024-02-28T16:24:37.342 INFO:tasks.workunit.client.1.smithi153.stdout:5/411: chown da/d29/f56 1868687434 1 2024-02-28T16:24:37.343 INFO:tasks.workunit.client.1.smithi153.stdout:2/427: chown d2/d23/d36/c3a 62716128 1 2024-02-28T16:24:37.345 INFO:tasks.workunit.client.1.smithi153.stdout:2/428: chown d2/d19/d2a/d3b/f71 9 1 2024-02-28T16:24:37.347 INFO:tasks.workunit.client.1.smithi153.stdout:9/357: rename d1/d5/d11/d1f/d20/d45/c60 to d1/d5/d11/d64/c7b 0 2024-02-28T16:24:37.348 INFO:tasks.workunit.client.1.smithi153.stdout:1/376: symlink d0/dd/l8a 0 2024-02-28T16:24:37.351 INFO:tasks.workunit.client.1.smithi153.stdout:5/412: creat da/dd/d25/d82/d8f/f91 x:0 0 0 2024-02-28T16:24:37.353 INFO:tasks.workunit.client.1.smithi153.stdout:7/420: dread d1/d25/f9 [0,4194304] 0 2024-02-28T16:24:37.354 INFO:tasks.workunit.client.1.smithi153.stdout:2/429: creat d2/d25/d49/d80/f83 x:0 0 0 2024-02-28T16:24:37.360 INFO:tasks.workunit.client.1.smithi153.stdout:2/430: write d2/f6 [2403683,87105] 0 2024-02-28T16:24:37.360 INFO:tasks.workunit.client.1.smithi153.stdout:7/421: creat d1/d25/df/d26/f92 x:0 0 0 2024-02-28T16:24:37.362 INFO:tasks.workunit.client.1.smithi153.stdout:4/347: dwrite d4/de/f45 [0,4194304] 0 2024-02-28T16:24:37.363 INFO:tasks.workunit.client.1.smithi153.stdout:5/413: link da/dd/ff da/d29/f92 0 2024-02-28T16:24:37.368 INFO:tasks.workunit.client.1.smithi153.stdout:1/377: dwrite d0/d3d/d4a/d59/f63 [0,4194304] 0 2024-02-28T16:24:37.368 INFO:tasks.workunit.client.1.smithi153.stdout:7/422: mknod d1/d25/dc/c93 0 2024-02-28T16:24:37.368 INFO:tasks.workunit.client.1.smithi153.stdout:3/378: sync 2024-02-28T16:24:37.368 INFO:tasks.workunit.client.1.smithi153.stdout:0/432: sync 2024-02-28T16:24:37.372 INFO:tasks.workunit.client.1.smithi153.stdout:7/423: truncate d1/d25/dc/d50/f65 438985 0 2024-02-28T16:24:37.383 INFO:tasks.workunit.client.1.smithi153.stdout:3/379: dwrite d4/d13/f21 [0,4194304] 0 2024-02-28T16:24:37.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/358: write d1/d5/f19 [1093385,92574] 0 2024-02-28T16:24:37.386 INFO:tasks.workunit.client.1.smithi153.stdout:3/380: write d4/d7d/f4f [3139902,38187] 0 2024-02-28T16:24:37.392 INFO:tasks.workunit.client.1.smithi153.stdout:3/381: chown d4/f77 15423708 1 2024-02-28T16:24:37.392 INFO:tasks.workunit.client.1.smithi153.stdout:7/424: symlink d1/d25/d27/d43/l94 0 2024-02-28T16:24:37.393 INFO:tasks.workunit.client.1.smithi153.stdout:2/431: getdents d2/d23 0 2024-02-28T16:24:37.399 INFO:tasks.workunit.client.1.smithi153.stdout:5/414: creat da/dd/f93 x:0 0 0 2024-02-28T16:24:37.399 INFO:tasks.workunit.client.1.smithi153.stdout:9/359: dread d1/d5/d11/f71 [0,4194304] 0 2024-02-28T16:24:37.403 INFO:tasks.workunit.client.1.smithi153.stdout:2/432: creat d2/d19/d5d/f84 x:0 0 0 2024-02-28T16:24:37.406 INFO:tasks.workunit.client.1.smithi153.stdout:0/433: rename d4/d1a/d8e/d90/d5c to d4/d27/d9a 0 2024-02-28T16:24:37.410 INFO:tasks.workunit.client.1.smithi153.stdout:4/348: getdents d4/de/d13/d1b/d4e 0 2024-02-28T16:24:37.410 INFO:tasks.workunit.client.1.smithi153.stdout:7/425: mkdir d1/d25/df/d26/d3a/d95 0 2024-02-28T16:24:37.416 INFO:tasks.workunit.client.1.smithi153.stdout:3/382: fdatasync d4/d8/d1e/d2a/d35/f39 0 2024-02-28T16:24:37.417 INFO:tasks.workunit.client.1.smithi153.stdout:2/433: rmdir d2/d25/d49 39 2024-02-28T16:24:37.418 INFO:tasks.workunit.client.1.smithi153.stdout:3/383: chown d4/d8/d1e/c68 0 1 2024-02-28T16:24:37.420 INFO:tasks.workunit.client.1.smithi153.stdout:7/426: rename d1/d25/d27/d43/c90 to d1/d25/dc/d7e/d91/c96 0 2024-02-28T16:24:37.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/360: mkdir d1/d74/d7c 0 2024-02-28T16:24:37.424 INFO:tasks.workunit.client.1.smithi153.stdout:0/434: mkdir d4/d9b 0 2024-02-28T16:24:37.428 INFO:tasks.workunit.client.1.smithi153.stdout:3/384: truncate d4/d13/d28/f2f 788568 0 2024-02-28T16:24:37.432 INFO:tasks.workunit.client.1.smithi153.stdout:3/385: dread - d4/d8/d1e/d2a/d35/d54/f82 zero size 2024-02-28T16:24:37.433 INFO:tasks.workunit.client.1.smithi153.stdout:4/349: rename d4/de/d47/l58 to d4/de/d13/d1b/l7d 0 2024-02-28T16:24:37.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/434: dwrite d2/d23/d36/f77 [0,4194304] 0 2024-02-28T16:24:37.437 INFO:tasks.workunit.client.1.smithi153.stdout:3/386: rmdir d4/d13/d28/d36 39 2024-02-28T16:24:37.440 INFO:tasks.workunit.client.1.smithi153.stdout:9/361: dwrite d1/d5/d27/f30 [0,4194304] 0 2024-02-28T16:24:37.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/435: rename d4/d32/l40 to d4/d1a/d8e/l9c 0 2024-02-28T16:24:37.445 INFO:tasks.workunit.client.1.smithi153.stdout:4/350: dread - d4/f29 zero size 2024-02-28T16:24:37.448 INFO:tasks.workunit.client.1.smithi153.stdout:4/351: write d4/de/f16 [1028029,122826] 0 2024-02-28T16:24:37.455 INFO:tasks.workunit.client.1.smithi153.stdout:2/435: rmdir d2/d25/d49/d80 39 2024-02-28T16:24:37.461 INFO:tasks.workunit.client.1.smithi153.stdout:0/436: dwrite d4/f12 [0,4194304] 0 2024-02-28T16:24:37.462 INFO:tasks.workunit.client.1.smithi153.stdout:2/436: creat d2/d19/d4f/f85 x:0 0 0 2024-02-28T16:24:37.463 INFO:tasks.workunit.client.1.smithi153.stdout:3/387: rmdir d4/d8/d1e/d63/d6f 0 2024-02-28T16:24:37.468 INFO:tasks.workunit.client.1.smithi153.stdout:6/394: sync 2024-02-28T16:24:37.468 INFO:tasks.workunit.client.1.smithi153.stdout:8/398: sync 2024-02-28T16:24:37.468 INFO:tasks.workunit.client.1.smithi153.stdout:0/437: chown d4/f97 2667062 1 2024-02-28T16:24:37.470 INFO:tasks.workunit.client.1.smithi153.stdout:9/362: getdents d1/d5/d11/d1f/d62 0 2024-02-28T16:24:37.470 INFO:tasks.workunit.client.1.smithi153.stdout:8/399: readlink d0/d19/l31 0 2024-02-28T16:24:37.471 INFO:tasks.workunit.client.1.smithi153.stdout:3/388: creat d4/d8/d1e/d2a/f83 x:0 0 0 2024-02-28T16:24:37.477 INFO:tasks.workunit.client.1.smithi153.stdout:9/363: write d1/d2a/f65 [265191,48795] 0 2024-02-28T16:24:37.479 INFO:tasks.workunit.client.1.smithi153.stdout:3/389: symlink d4/d8/d1e/d2a/d35/d54/l84 0 2024-02-28T16:24:37.481 INFO:tasks.workunit.client.1.smithi153.stdout:6/395: getdents d0/d1d 0 2024-02-28T16:24:37.482 INFO:tasks.workunit.client.1.smithi153.stdout:2/437: dread d2/d19/d31/f40 [0,4194304] 0 2024-02-28T16:24:37.489 INFO:tasks.workunit.client.1.smithi153.stdout:9/364: mknod d1/d5/d11/d1f/d20/d5d/c7d 0 2024-02-28T16:24:37.492 INFO:tasks.workunit.client.1.smithi153.stdout:2/438: dread d2/f20 [4194304,4194304] 0 2024-02-28T16:24:37.492 INFO:tasks.workunit.client.1.smithi153.stdout:0/438: dwrite d4/d27/f7c [0,4194304] 0 2024-02-28T16:24:37.494 INFO:tasks.workunit.client.1.smithi153.stdout:3/390: mknod d4/d13/d28/d36/c85 0 2024-02-28T16:24:37.498 INFO:tasks.workunit.client.1.smithi153.stdout:8/400: truncate d0/d25/f57 921197 0 2024-02-28T16:24:37.498 INFO:tasks.workunit.client.1.smithi153.stdout:0/439: write d4/d1a/f4b [191728,90660] 0 2024-02-28T16:24:37.504 INFO:tasks.workunit.client.1.smithi153.stdout:3/391: rename d4/d8/f6c to d4/d2c/f86 0 2024-02-28T16:24:37.510 INFO:tasks.workunit.client.1.smithi153.stdout:8/401: rmdir d0/d12/d67/d30/d63 39 2024-02-28T16:24:37.513 INFO:tasks.workunit.client.1.smithi153.stdout:8/402: read d0/f9 [188617,103626] 0 2024-02-28T16:24:37.518 INFO:tasks.workunit.client.1.smithi153.stdout:2/439: rename d2/d19/d4f to d2/d86 0 2024-02-28T16:24:37.522 INFO:tasks.workunit.client.1.smithi153.stdout:8/403: symlink d0/d25/l87 0 2024-02-28T16:24:37.529 INFO:tasks.workunit.client.1.smithi153.stdout:9/365: dwrite d1/d5/d11/d29/f6e [0,4194304] 0 2024-02-28T16:24:37.539 INFO:tasks.workunit.client.1.smithi153.stdout:2/440: rmdir d2/d19/d2a/d3b/d5e/d61 0 2024-02-28T16:24:37.539 INFO:tasks.workunit.client.1.smithi153.stdout:3/392: dwrite d4/d7d/f3d [4194304,4194304] 0 2024-02-28T16:24:37.543 INFO:tasks.workunit.client.1.smithi153.stdout:4/352: sync 2024-02-28T16:24:37.544 INFO:tasks.workunit.client.1.smithi153.stdout:5/415: sync 2024-02-28T16:24:37.544 INFO:tasks.workunit.client.1.smithi153.stdout:1/378: sync 2024-02-28T16:24:37.544 INFO:tasks.workunit.client.1.smithi153.stdout:7/427: sync 2024-02-28T16:24:37.546 INFO:tasks.workunit.client.1.smithi153.stdout:6/396: dread d0/d15/f3a [0,4194304] 0 2024-02-28T16:24:37.551 INFO:tasks.workunit.client.1.smithi153.stdout:9/366: truncate d1/d5/f47 1396069 0 2024-02-28T16:24:37.552 INFO:tasks.workunit.client.1.smithi153.stdout:4/353: write d4/f7 [3466586,60829] 0 2024-02-28T16:24:37.552 INFO:tasks.workunit.client.1.smithi153.stdout:2/441: fdatasync d2/d25/f34 0 2024-02-28T16:24:37.553 INFO:tasks.workunit.client.1.smithi153.stdout:9/367: write d1/d5/f7a [260263,50316] 0 2024-02-28T16:24:37.558 INFO:tasks.workunit.client.1.smithi153.stdout:0/440: dread d4/f75 [0,4194304] 0 2024-02-28T16:24:37.558 INFO:tasks.workunit.client.1.smithi153.stdout:8/404: dread d0/d19/d2b/d2d/f5e [0,4194304] 0 2024-02-28T16:24:37.559 INFO:tasks.workunit.client.1.smithi153.stdout:2/442: chown d2/d19/c28 303858 1 2024-02-28T16:24:37.564 INFO:tasks.workunit.client.1.smithi153.stdout:5/416: symlink da/l94 0 2024-02-28T16:24:37.565 INFO:tasks.workunit.client.1.smithi153.stdout:1/379: mknod d0/dd/d67/d89/c8b 0 2024-02-28T16:24:37.568 INFO:tasks.workunit.client.1.smithi153.stdout:5/417: mknod da/dd/d25/d82/d8f/c95 0 2024-02-28T16:24:37.574 INFO:tasks.workunit.client.1.smithi153.stdout:1/380: chown d0/c35 163317705 1 2024-02-28T16:24:37.576 INFO:tasks.workunit.client.1.smithi153.stdout:0/441: truncate d4/d1a/d8e/d90/f5e 1404207 0 2024-02-28T16:24:37.577 INFO:tasks.workunit.client.1.smithi153.stdout:9/368: write d1/d5/f59 [821802,90180] 0 2024-02-28T16:24:37.578 INFO:tasks.workunit.client.1.smithi153.stdout:5/418: creat da/dd/d54/f96 x:0 0 0 2024-02-28T16:24:37.586 INFO:tasks.workunit.client.1.smithi153.stdout:1/381: creat d0/d3d/d4a/d59/f8c x:0 0 0 2024-02-28T16:24:37.591 INFO:tasks.workunit.client.1.smithi153.stdout:0/442: unlink d4/f75 0 2024-02-28T16:24:37.591 INFO:tasks.workunit.client.1.smithi153.stdout:3/393: dwrite d4/f18 [4194304,4194304] 0 2024-02-28T16:24:37.591 INFO:tasks.workunit.client.1.smithi153.stdout:8/405: dwrite d0/d25/f47 [0,4194304] 0 2024-02-28T16:24:37.595 INFO:tasks.workunit.client.1.smithi153.stdout:9/369: chown d1/d5/d27/d61/l77 1066342162 1 2024-02-28T16:24:37.613 INFO:tasks.workunit.client.1.smithi153.stdout:1/382: rename d0/d3d/c3f to d0/dd/c8d 0 2024-02-28T16:24:37.619 INFO:tasks.workunit.client.1.smithi153.stdout:5/419: dwrite da/dd/f13 [0,4194304] 0 2024-02-28T16:24:37.622 INFO:tasks.workunit.client.1.smithi153.stdout:5/420: chown da/d29/f4b 36769 1 2024-02-28T16:24:37.622 INFO:tasks.workunit.client.1.smithi153.stdout:9/370: dread d1/d5/fb [0,4194304] 0 2024-02-28T16:24:37.624 INFO:tasks.workunit.client.1.smithi153.stdout:5/421: chown da/dd/d25/d41/f46 6789692 1 2024-02-28T16:24:37.624 INFO:tasks.workunit.client.1.smithi153.stdout:8/406: rename d0/d19/d1c to d0/d12/d67/d88 0 2024-02-28T16:24:37.627 INFO:tasks.workunit.client.1.smithi153.stdout:0/443: link d4/d89/f92 d4/d32/d7f/d8a/f9d 0 2024-02-28T16:24:37.627 INFO:tasks.workunit.client.1.smithi153.stdout:5/422: write da/dd/d54/f96 [327441,77132] 0 2024-02-28T16:24:37.632 INFO:tasks.workunit.client.1.smithi153.stdout:9/371: unlink d1/l1d 0 2024-02-28T16:24:37.633 INFO:tasks.workunit.client.1.smithi153.stdout:2/443: dread d2/f6 [0,4194304] 0 2024-02-28T16:24:37.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/394: dread d4/d7d/f4f [0,4194304] 0 2024-02-28T16:24:37.644 INFO:tasks.workunit.client.1.smithi153.stdout:7/428: sync 2024-02-28T16:24:37.650 INFO:tasks.workunit.client.1.smithi153.stdout:0/444: dwrite d4/f14 [0,4194304] 0 2024-02-28T16:24:37.684 INFO:tasks.workunit.client.1.smithi153.stdout:4/354: sync 2024-02-28T16:24:37.685 INFO:tasks.workunit.client.1.smithi153.stdout:6/397: sync 2024-02-28T16:24:37.686 INFO:tasks.workunit.client.1.smithi153.stdout:6/398: fdatasync d0/d15/d2e/f53 0 2024-02-28T16:24:37.688 INFO:tasks.workunit.client.1.smithi153.stdout:6/399: write d0/d1d/d30/d71/f87 [5303678,123969] 0 2024-02-28T16:24:37.704 INFO:tasks.workunit.client.1.smithi153.stdout:1/383: write d0/dd/f2d [335077,29849] 0 2024-02-28T16:24:37.715 INFO:tasks.workunit.client.1.smithi153.stdout:7/429: dread d1/d25/df/d26/d3a/d52/f6e [0,4194304] 0 2024-02-28T16:24:37.721 INFO:tasks.workunit.client.1.smithi153.stdout:3/395: dwrite d4/d7d/f4f [0,4194304] 0 2024-02-28T16:24:37.729 INFO:tasks.workunit.client.1.smithi153.stdout:4/355: mknod d4/de/d47/d5e/d62/c7e 0 2024-02-28T16:24:37.746 INFO:tasks.workunit.client.1.smithi153.stdout:1/384: mkdir d0/d62/d66/d8e 0 2024-02-28T16:24:37.747 INFO:tasks.workunit.client.1.smithi153.stdout:1/385: fdatasync d0/d3d/d4a/f56 0 2024-02-28T16:24:37.748 INFO:tasks.workunit.client.1.smithi153.stdout:2/444: mkdir d2/d19/d2a/d3b/d87 0 2024-02-28T16:24:37.760 INFO:tasks.workunit.client.1.smithi153.stdout:0/445: mkdir d4/d1a/d8e/d94/d9e 0 2024-02-28T16:24:37.772 INFO:tasks.workunit.client.1.smithi153.stdout:4/356: dread f1 [0,4194304] 0 2024-02-28T16:24:37.773 INFO:tasks.workunit.client.1.smithi153.stdout:3/396: dread d4/d8/d1e/f7b [0,4194304] 0 2024-02-28T16:24:37.773 INFO:tasks.workunit.client.1.smithi153.stdout:4/357: dread - d4/de/f6c zero size 2024-02-28T16:24:37.774 INFO:tasks.workunit.client.1.smithi153.stdout:7/430: mkdir d1/d25/df/d26/d3a/d95/d97 0 2024-02-28T16:24:37.776 INFO:tasks.workunit.client.1.smithi153.stdout:0/446: chown d4/d32/d7f/d8a/f9d 3611265 1 2024-02-28T16:24:37.786 INFO:tasks.workunit.client.1.smithi153.stdout:1/386: dread d0/f16 [0,4194304] 0 2024-02-28T16:24:37.791 INFO:tasks.workunit.client.1.smithi153.stdout:7/431: dwrite d1/d25/dc/d50/f5b [0,4194304] 0 2024-02-28T16:24:37.798 INFO:tasks.workunit.client.1.smithi153.stdout:0/447: dwrite d4/fe [0,4194304] 0 2024-02-28T16:24:37.804 INFO:tasks.workunit.client.1.smithi153.stdout:2/445: mkdir d2/d23/d88 0 2024-02-28T16:24:37.805 INFO:tasks.workunit.client.1.smithi153.stdout:1/387: getdents d0/dd/d67/d89 0 2024-02-28T16:24:37.807 INFO:tasks.workunit.client.1.smithi153.stdout:1/388: dread - d0/d3d/f72 zero size 2024-02-28T16:24:37.818 INFO:tasks.workunit.client.1.smithi153.stdout:3/397: dread d4/d8/f4d [4194304,4194304] 0 2024-02-28T16:24:37.819 INFO:tasks.workunit.client.1.smithi153.stdout:1/389: creat d0/d62/f8f x:0 0 0 2024-02-28T16:24:37.819 INFO:tasks.workunit.client.1.smithi153.stdout:1/390: readlink d0/l6a 0 2024-02-28T16:24:37.821 INFO:tasks.workunit.client.1.smithi153.stdout:1/391: dread - d0/dd/f5d zero size 2024-02-28T16:24:37.823 INFO:tasks.workunit.client.1.smithi153.stdout:7/432: link d1/d25/f9 d1/d25/df/d26/d3a/f98 0 2024-02-28T16:24:37.825 INFO:tasks.workunit.client.1.smithi153.stdout:2/446: dread d2/d19/f2c [0,4194304] 0 2024-02-28T16:24:37.832 INFO:tasks.workunit.client.1.smithi153.stdout:1/392: creat d0/d3d/f90 x:0 0 0 2024-02-28T16:24:37.835 INFO:tasks.workunit.client.1.smithi153.stdout:2/447: symlink d2/d19/d31/l89 0 2024-02-28T16:24:37.838 INFO:tasks.workunit.client.1.smithi153.stdout:2/448: write d2/d19/d2a/d3b/f68 [1197004,11101] 0 2024-02-28T16:24:37.838 INFO:tasks.workunit.client.1.smithi153.stdout:7/433: dwrite d1/d25/f33 [0,4194304] 0 2024-02-28T16:24:37.846 INFO:tasks.workunit.client.1.smithi153.stdout:0/448: creat d4/d27/f9f x:0 0 0 2024-02-28T16:24:37.863 INFO:tasks.workunit.client.1.smithi153.stdout:3/398: dread d4/d7d/d41/f3e [0,4194304] 0 2024-02-28T16:24:37.865 INFO:tasks.workunit.client.1.smithi153.stdout:7/434: dwrite d1/f8d [0,4194304] 0 2024-02-28T16:24:37.866 INFO:tasks.workunit.client.1.smithi153.stdout:0/449: dwrite d4/d1a/f24 [4194304,4194304] 0 2024-02-28T16:24:37.869 INFO:tasks.workunit.client.1.smithi153.stdout:0/450: dread - d4/d1a/f7e zero size 2024-02-28T16:24:37.873 INFO:tasks.workunit.client.1.smithi153.stdout:1/393: dwrite d0/d3d/f3e [0,4194304] 0 2024-02-28T16:24:37.879 INFO:tasks.workunit.client.1.smithi153.stdout:5/423: write da/fc [992040,35422] 0 2024-02-28T16:24:37.886 INFO:tasks.workunit.client.1.smithi153.stdout:7/435: creat d1/d25/df/d26/d3a/d52/d63/d75/f99 x:0 0 0 2024-02-28T16:24:37.887 INFO:tasks.workunit.client.1.smithi153.stdout:0/451: creat d4/d32/d7f/d8a/fa0 x:0 0 0 2024-02-28T16:24:37.888 INFO:tasks.workunit.client.1.smithi153.stdout:5/424: write da/dd/d25/d41/f49 [85470,48147] 0 2024-02-28T16:24:37.888 INFO:tasks.workunit.client.1.smithi153.stdout:1/394: getdents d0/dd/d67/d89 0 2024-02-28T16:24:37.890 INFO:tasks.workunit.client.1.smithi153.stdout:0/452: chown d4/d27/f73 3520 1 2024-02-28T16:24:37.894 INFO:tasks.workunit.client.1.smithi153.stdout:9/372: truncate d1/d5/d27/d61/f3d 124605 0 2024-02-28T16:24:37.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:37 smithi153 ceph-mon[35341]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 9.1 MiB/s rd, 86 MiB/s wr, 158 op/s 2024-02-28T16:24:37.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:37 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:37.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:37 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:37.899 INFO:tasks.workunit.client.1.smithi153.stdout:5/425: symlink da/dd/d54/l97 0 2024-02-28T16:24:37.900 INFO:tasks.workunit.client.1.smithi153.stdout:1/395: creat d0/dd/d67/f91 x:0 0 0 2024-02-28T16:24:37.900 INFO:tasks.workunit.client.1.smithi153.stdout:2/449: dread d2/d23/d36/f51 [0,4194304] 0 2024-02-28T16:24:37.900 INFO:tasks.workunit.client.1.smithi153.stdout:6/400: truncate d0/d1d/d23/d60/f74 586739 0 2024-02-28T16:24:37.901 INFO:tasks.workunit.client.1.smithi153.stdout:0/453: rename d4/d1a/d65 to d4/d27/d9a/da1 0 2024-02-28T16:24:37.902 INFO:tasks.workunit.client.1.smithi153.stdout:7/436: creat d1/d25/df/d26/d76/f9a x:0 0 0 2024-02-28T16:24:37.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/358: symlink d4/l7f 0 2024-02-28T16:24:37.905 INFO:tasks.workunit.client.1.smithi153.stdout:3/399: mkdir d4/d8/d1e/d87 0 2024-02-28T16:24:37.905 INFO:tasks.workunit.client.1.smithi153.stdout:2/450: write d2/d19/f38 [958916,59648] 0 2024-02-28T16:24:37.905 INFO:tasks.workunit.client.1.smithi153.stdout:0/454: stat d4/d27/d9a/c7b 0 2024-02-28T16:24:37.906 INFO:tasks.workunit.client.1.smithi153.stdout:5/426: creat da/dd/d25/d82/d8f/f98 x:0 0 0 2024-02-28T16:24:37.907 INFO:tasks.workunit.client.1.smithi153.stdout:7/437: write d1/d25/dc/f35 [4131564,97366] 0 2024-02-28T16:24:37.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/359: fsync d4/de/d13/f20 0 2024-02-28T16:24:37.910 INFO:tasks.workunit.client.1.smithi153.stdout:1/396: creat d0/dd/d67/d89/f92 x:0 0 0 2024-02-28T16:24:37.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/401: mknod d0/d15/d2e/c94 0 2024-02-28T16:24:37.913 INFO:tasks.workunit.client.1.smithi153.stdout:3/400: write d4/d8/f1c [1289136,68933] 0 2024-02-28T16:24:37.917 INFO:tasks.workunit.client.1.smithi153.stdout:7/438: creat d1/d25/d27/f9b x:0 0 0 2024-02-28T16:24:37.917 INFO:tasks.workunit.client.1.smithi153.stdout:3/401: fsync d4/d8/f10 0 2024-02-28T16:24:37.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:37 smithi023 ceph-mon[29137]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 9.1 MiB/s rd, 86 MiB/s wr, 158 op/s 2024-02-28T16:24:37.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:37 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:37.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:37 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:37.925 INFO:tasks.workunit.client.1.smithi153.stdout:4/360: mkdir d4/de/d23/d2b/d4b/d80 0 2024-02-28T16:24:37.926 INFO:tasks.workunit.client.1.smithi153.stdout:6/402: fsync d0/d1d/d23/f26 0 2024-02-28T16:24:37.927 INFO:tasks.workunit.client.1.smithi153.stdout:3/402: unlink d4/d13/d28/d36/c85 0 2024-02-28T16:24:37.930 INFO:tasks.workunit.client.1.smithi153.stdout:9/373: dwrite d1/d5/d27/d61/f32 [0,4194304] 0 2024-02-28T16:24:37.930 INFO:tasks.workunit.client.1.smithi153.stdout:1/397: mknod d0/dd/d67/d80/c93 0 2024-02-28T16:24:37.930 INFO:tasks.workunit.client.1.smithi153.stdout:7/439: mkdir d1/d25/df/d26/d3a/d5e/d72/d9c 0 2024-02-28T16:24:37.933 INFO:tasks.workunit.client.1.smithi153.stdout:0/455: getdents d4/d27 0 2024-02-28T16:24:37.935 INFO:tasks.workunit.client.1.smithi153.stdout:7/440: fdatasync d1/d25/df/d26/f92 0 2024-02-28T16:24:37.937 INFO:tasks.workunit.client.1.smithi153.stdout:7/441: chown d1/d25/dc 9 1 2024-02-28T16:24:37.938 INFO:tasks.workunit.client.1.smithi153.stdout:6/403: mknod d0/d1d/c95 0 2024-02-28T16:24:37.938 INFO:tasks.workunit.client.1.smithi153.stdout:8/407: mkdir d0/d19/d89 0 2024-02-28T16:24:37.940 INFO:tasks.workunit.client.1.smithi153.stdout:8/408: chown d0/d19/d2b/f6f 9 1 2024-02-28T16:24:37.946 INFO:tasks.workunit.client.1.smithi153.stdout:5/427: dread da/dd/fe [0,4194304] 0 2024-02-28T16:24:37.948 INFO:tasks.workunit.client.1.smithi153.stdout:3/403: symlink d4/d8/d1e/d2a/l88 0 2024-02-28T16:24:37.952 INFO:tasks.workunit.client.1.smithi153.stdout:8/409: dread d0/d19/d2b/f54 [0,4194304] 0 2024-02-28T16:24:37.953 INFO:tasks.workunit.client.1.smithi153.stdout:0/456: chown d4/d27/d9a/c88 218595 1 2024-02-28T16:24:37.955 INFO:tasks.workunit.client.1.smithi153.stdout:1/398: dwrite d0/dd/d67/f91 [0,4194304] 0 2024-02-28T16:24:37.956 INFO:tasks.workunit.client.1.smithi153.stdout:7/442: mknod d1/d25/d27/c9d 0 2024-02-28T16:24:37.957 INFO:tasks.workunit.client.1.smithi153.stdout:1/399: dread - d0/dd/d67/d89/f92 zero size 2024-02-28T16:24:37.960 INFO:tasks.workunit.client.1.smithi153.stdout:4/361: unlink d4/de/d40/f46 0 2024-02-28T16:24:37.960 INFO:tasks.workunit.client.1.smithi153.stdout:1/400: write d0/dd/f58 [754641,47740] 0 2024-02-28T16:24:37.962 INFO:tasks.workunit.client.1.smithi153.stdout:1/401: dread - d0/d3d/f72 zero size 2024-02-28T16:24:37.963 INFO:tasks.workunit.client.1.smithi153.stdout:4/362: read - d4/de/d47/f67 zero size 2024-02-28T16:24:37.965 INFO:tasks.workunit.client.1.smithi153.stdout:9/374: mkdir d1/d7e 0 2024-02-28T16:24:37.972 INFO:tasks.workunit.client.1.smithi153.stdout:3/404: creat d4/d8/d1e/d2a/f89 x:0 0 0 2024-02-28T16:24:37.976 INFO:tasks.workunit.client.1.smithi153.stdout:8/410: unlink d0/d12/d15/l73 0 2024-02-28T16:24:37.981 INFO:tasks.workunit.client.1.smithi153.stdout:0/457: symlink d4/d1a/la2 0 2024-02-28T16:24:37.988 INFO:tasks.workunit.client.1.smithi153.stdout:1/402: rename d0/dd/c26 to d0/d3d/c94 0 2024-02-28T16:24:37.988 INFO:tasks.workunit.client.1.smithi153.stdout:4/363: read d4/de/d13/f35 [94541,92327] 0 2024-02-28T16:24:37.992 INFO:tasks.workunit.client.1.smithi153.stdout:5/428: dread da/f27 [0,4194304] 0 2024-02-28T16:24:37.996 INFO:tasks.workunit.client.1.smithi153.stdout:0/458: rmdir d4/d89 39 2024-02-28T16:24:37.997 INFO:tasks.workunit.client.1.smithi153.stdout:1/403: fsync d0/f78 0 2024-02-28T16:24:37.997 INFO:tasks.workunit.client.1.smithi153.stdout:4/364: dread d4/f5 [0,4194304] 0 2024-02-28T16:24:38.001 INFO:tasks.workunit.client.1.smithi153.stdout:8/411: rename d0/f11 to d0/d19/d2b/d2d/f8a 0 2024-02-28T16:24:38.008 INFO:tasks.workunit.client.1.smithi153.stdout:3/405: dread d4/f1f [0,4194304] 0 2024-02-28T16:24:38.008 INFO:tasks.workunit.client.1.smithi153.stdout:4/365: unlink d4/de/d23/f37 0 2024-02-28T16:24:38.009 INFO:tasks.workunit.client.1.smithi153.stdout:0/459: dread d4/fe [0,4194304] 0 2024-02-28T16:24:38.011 INFO:tasks.workunit.client.1.smithi153.stdout:2/451: dwrite d2/d23/d36/f51 [0,4194304] 0 2024-02-28T16:24:38.012 INFO:tasks.workunit.client.1.smithi153.stdout:5/429: rename da/d29/c52 to da/dd/d25/d8a/c99 0 2024-02-28T16:24:38.025 INFO:tasks.workunit.client.1.smithi153.stdout:0/460: symlink d4/d32/d7f/d8a/la3 0 2024-02-28T16:24:38.028 INFO:tasks.workunit.client.1.smithi153.stdout:5/430: chown da/f6c 3049 1 2024-02-28T16:24:38.029 INFO:tasks.workunit.client.1.smithi153.stdout:9/375: link d1/d5/d11/c13 d1/d58/c7f 0 2024-02-28T16:24:38.034 INFO:tasks.workunit.client.1.smithi153.stdout:1/404: link d0/d3d/d4a/c77 d0/d62/c95 0 2024-02-28T16:24:38.039 INFO:tasks.workunit.client.1.smithi153.stdout:4/366: creat d4/de/d23/d2b/d4b/d80/f81 x:0 0 0 2024-02-28T16:24:38.042 INFO:tasks.workunit.client.1.smithi153.stdout:0/461: creat d4/d27/d9a/fa4 x:0 0 0 2024-02-28T16:24:38.047 INFO:tasks.workunit.client.1.smithi153.stdout:3/406: rename d4/d8/d1e/d64/c74 to d4/d8/d1e/d87/c8a 0 2024-02-28T16:24:38.049 INFO:tasks.workunit.client.1.smithi153.stdout:8/412: rmdir d0/d25/d84 0 2024-02-28T16:24:38.051 INFO:tasks.workunit.client.1.smithi153.stdout:5/431: write f1 [1820500,66501] 0 2024-02-28T16:24:38.053 INFO:tasks.workunit.client.1.smithi153.stdout:6/404: readlink d0/d1d/d23/l2a 0 2024-02-28T16:24:38.110 INFO:tasks.workunit.client.1.smithi153.stdout:7/443: sync 2024-02-28T16:24:38.112 INFO:tasks.workunit.client.1.smithi153.stdout:0/462: unlink d4/d27/d9a/da1/l76 0 2024-02-28T16:24:38.114 INFO:tasks.workunit.client.1.smithi153.stdout:1/405: dwrite d0/d3d/f43 [0,4194304] 0 2024-02-28T16:24:38.115 INFO:tasks.workunit.client.1.smithi153.stdout:0/463: chown d4/d1a/d8e/d94/d9e 163 1 2024-02-28T16:24:38.116 INFO:tasks.workunit.client.1.smithi153.stdout:6/405: mkdir d0/d1d/d23/d60/d96 0 2024-02-28T16:24:38.116 INFO:tasks.workunit.client.1.smithi153.stdout:3/407: write d4/f17 [2674123,377] 0 2024-02-28T16:24:38.117 INFO:tasks.workunit.client.1.smithi153.stdout:8/413: symlink d0/d12/l8b 0 2024-02-28T16:24:38.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/444: dread d1/d25/df/d26/d3a/f83 [0,4194304] 0 2024-02-28T16:24:38.118 INFO:tasks.workunit.client.1.smithi153.stdout:1/406: readlink d0/l31 0 2024-02-28T16:24:38.121 INFO:tasks.workunit.client.1.smithi153.stdout:6/406: creat d0/d15/d48/d72/f97 x:0 0 0 2024-02-28T16:24:38.124 INFO:tasks.workunit.client.1.smithi153.stdout:8/414: creat d0/d19/d2b/d2d/f8c x:0 0 0 2024-02-28T16:24:38.125 INFO:tasks.workunit.client.1.smithi153.stdout:1/407: creat d0/dd/d67/d80/f96 x:0 0 0 2024-02-28T16:24:38.125 INFO:tasks.workunit.client.1.smithi153.stdout:6/407: fdatasync d0/d1d/d23/f8e 0 2024-02-28T16:24:38.128 INFO:tasks.workunit.client.1.smithi153.stdout:7/445: chown d1/d25/dc/l21 113 1 2024-02-28T16:24:38.130 INFO:tasks.workunit.client.1.smithi153.stdout:3/408: symlink d4/d7d/d41/d71/l8b 0 2024-02-28T16:24:38.131 INFO:tasks.workunit.client.1.smithi153.stdout:6/408: rename d0/fb to d0/d66/f98 0 2024-02-28T16:24:38.139 INFO:tasks.workunit.client.1.smithi153.stdout:4/367: dwrite f1 [0,4194304] 0 2024-02-28T16:24:38.139 INFO:tasks.workunit.client.1.smithi153.stdout:1/408: creat d0/d62/d66/d8e/f97 x:0 0 0 2024-02-28T16:24:38.143 INFO:tasks.workunit.client.1.smithi153.stdout:1/409: fdatasync d0/dd/d67/f83 0 2024-02-28T16:24:38.143 INFO:tasks.workunit.client.1.smithi153.stdout:0/464: dwrite d4/d27/f44 [0,4194304] 0 2024-02-28T16:24:38.146 INFO:tasks.workunit.client.1.smithi153.stdout:8/415: creat d0/d12/f8d x:0 0 0 2024-02-28T16:24:38.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/410: write d0/d3d/d4a/d59/f5a [4651928,55073] 0 2024-02-28T16:24:38.159 INFO:tasks.workunit.client.1.smithi153.stdout:4/368: creat d4/de/d40/d4d/f82 x:0 0 0 2024-02-28T16:24:38.161 INFO:tasks.workunit.client.1.smithi153.stdout:5/432: dread da/dd/d25/d41/f49 [0,4194304] 0 2024-02-28T16:24:38.162 INFO:tasks.workunit.client.1.smithi153.stdout:8/416: mkdir d0/d12/d67/d88/d8e 0 2024-02-28T16:24:38.165 INFO:tasks.workunit.client.1.smithi153.stdout:1/411: mknod d0/d3d/d4a/c98 0 2024-02-28T16:24:38.167 INFO:tasks.workunit.client.1.smithi153.stdout:1/412: write d0/d62/f8f [996893,78378] 0 2024-02-28T16:24:38.168 INFO:tasks.workunit.client.1.smithi153.stdout:1/413: chown d0/d3d/d4a 3 1 2024-02-28T16:24:38.177 INFO:tasks.workunit.client.1.smithi153.stdout:2/452: sync 2024-02-28T16:24:38.179 INFO:tasks.workunit.client.1.smithi153.stdout:2/453: truncate d2/f67 315667 0 2024-02-28T16:24:38.185 INFO:tasks.workunit.client.1.smithi153.stdout:0/465: write d4/d1a/d8e/d90/f6c [1308353,113137] 0 2024-02-28T16:24:38.185 INFO:tasks.workunit.client.1.smithi153.stdout:0/466: readlink d4/d1a/d8e/d90/l11 0 2024-02-28T16:24:38.185 INFO:tasks.workunit.client.1.smithi153.stdout:3/409: rename d4/d13/f21 to d4/d7d/f8c 0 2024-02-28T16:24:38.185 INFO:tasks.workunit.client.1.smithi153.stdout:3/410: dread - d4/d8/d1e/d2a/d35/d54/f82 zero size 2024-02-28T16:24:38.186 INFO:tasks.workunit.client.1.smithi153.stdout:7/446: rmdir d1/d25/dc/d7e/d91/d80 0 2024-02-28T16:24:38.189 INFO:tasks.workunit.client.1.smithi153.stdout:8/417: creat d0/d34/f8f x:0 0 0 2024-02-28T16:24:38.190 INFO:tasks.workunit.client.1.smithi153.stdout:8/418: stat d0/d19/d2b/f6f 0 2024-02-28T16:24:38.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/414: creat d0/dd/d67/d80/f99 x:0 0 0 2024-02-28T16:24:38.195 INFO:tasks.workunit.client.1.smithi153.stdout:7/447: rmdir d1/d25/df/d26/d3a/d95 39 2024-02-28T16:24:38.198 INFO:tasks.workunit.client.1.smithi153.stdout:3/411: dread d4/d7d/f3d [4194304,4194304] 0 2024-02-28T16:24:38.199 INFO:tasks.workunit.client.1.smithi153.stdout:6/409: getdents d0/d1d/d30 0 2024-02-28T16:24:38.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/415: mkdir d0/d3d/d4a/d59/d9a 0 2024-02-28T16:24:38.203 INFO:tasks.workunit.client.1.smithi153.stdout:1/416: stat d0/f14 0 2024-02-28T16:24:38.203 INFO:tasks.workunit.client.1.smithi153.stdout:5/433: creat da/d29/d43/f9a x:0 0 0 2024-02-28T16:24:38.203 INFO:tasks.workunit.client.1.smithi153.stdout:2/454: link d2/d86/l7b d2/d23/d36/l8a 0 2024-02-28T16:24:38.205 INFO:tasks.workunit.client.1.smithi153.stdout:7/448: mknod d1/d25/df/d26/d3a/d95/c9e 0 2024-02-28T16:24:38.208 INFO:tasks.workunit.client.1.smithi153.stdout:3/412: unlink d4/d13/d28/f2f 0 2024-02-28T16:24:38.208 INFO:tasks.workunit.client.1.smithi153.stdout:6/410: read d0/d1d/d33/f7a [24175,87362] 0 2024-02-28T16:24:38.209 INFO:tasks.workunit.client.1.smithi153.stdout:1/417: rmdir d0/d62/d66 39 2024-02-28T16:24:38.212 INFO:tasks.workunit.client.1.smithi153.stdout:4/369: dwrite d4/f38 [0,4194304] 0 2024-02-28T16:24:38.214 INFO:tasks.workunit.client.1.smithi153.stdout:7/449: symlink d1/d25/dc/d7e/l9f 0 2024-02-28T16:24:38.216 INFO:tasks.workunit.client.1.smithi153.stdout:8/419: dwrite d0/d12/d67/d30/f65 [0,4194304] 0 2024-02-28T16:24:38.217 INFO:tasks.workunit.client.1.smithi153.stdout:6/411: mkdir d0/d15/d2e/d99 0 2024-02-28T16:24:38.225 INFO:tasks.workunit.client.1.smithi153.stdout:3/413: symlink d4/d6a/l8d 0 2024-02-28T16:24:38.229 INFO:tasks.workunit.client.1.smithi153.stdout:7/450: mknod d1/d25/df/d26/d3a/d95/ca0 0 2024-02-28T16:24:38.232 INFO:tasks.workunit.client.1.smithi153.stdout:3/414: stat d4/d13/d28/d36/f56 0 2024-02-28T16:24:38.236 INFO:tasks.workunit.client.1.smithi153.stdout:7/451: symlink d1/d25/d88/la1 0 2024-02-28T16:24:38.240 INFO:tasks.workunit.client.1.smithi153.stdout:2/455: getdents d2/d23/d36 0 2024-02-28T16:24:38.240 INFO:tasks.workunit.client.1.smithi153.stdout:1/418: dwrite d0/dd/f1c [4194304,4194304] 0 2024-02-28T16:24:38.241 INFO:tasks.workunit.client.1.smithi153.stdout:6/412: rename d0/d1d/d23/f59 to d0/d15/f9a 0 2024-02-28T16:24:38.244 INFO:tasks.workunit.client.1.smithi153.stdout:3/415: mknod d4/c8e 0 2024-02-28T16:24:38.245 INFO:tasks.workunit.client.1.smithi153.stdout:5/434: dread da/dd/f3d [0,4194304] 0 2024-02-28T16:24:38.248 INFO:tasks.workunit.client.1.smithi153.stdout:7/452: symlink d1/d25/df/d60/la2 0 2024-02-28T16:24:38.249 INFO:tasks.workunit.client.1.smithi153.stdout:6/413: chown d0/d1d/l3f 4162320 1 2024-02-28T16:24:38.250 INFO:tasks.workunit.client.1.smithi153.stdout:1/419: symlink d0/d3d/l9b 0 2024-02-28T16:24:38.251 INFO:tasks.workunit.client.1.smithi153.stdout:2/456: mkdir d2/d19/d8b 0 2024-02-28T16:24:38.256 INFO:tasks.workunit.client.1.smithi153.stdout:1/420: fdatasync d0/dd/f21 0 2024-02-28T16:24:38.256 INFO:tasks.workunit.client.1.smithi153.stdout:7/453: chown d1/d25/df/c34 38749897 1 2024-02-28T16:24:38.258 INFO:tasks.workunit.client.1.smithi153.stdout:3/416: mkdir d4/d13/d8f 0 2024-02-28T16:24:38.261 INFO:tasks.workunit.client.1.smithi153.stdout:7/454: symlink d1/d25/dc/d7e/la3 0 2024-02-28T16:24:38.265 INFO:tasks.workunit.client.1.smithi153.stdout:3/417: rename d4/d7d/f4f to d4/d13/d28/d36/f90 0 2024-02-28T16:24:38.267 INFO:tasks.workunit.client.1.smithi153.stdout:6/414: getdents d0/d15/d48/d72 0 2024-02-28T16:24:38.269 INFO:tasks.workunit.client.1.smithi153.stdout:7/455: stat d1/d25/dc/d50/d66/c7a 0 2024-02-28T16:24:38.270 INFO:tasks.workunit.client.1.smithi153.stdout:9/376: sync 2024-02-28T16:24:38.273 INFO:tasks.workunit.client.1.smithi153.stdout:3/418: mkdir d4/d8/d1e/d2a/d91 0 2024-02-28T16:24:38.275 INFO:tasks.workunit.client.1.smithi153.stdout:8/420: truncate d0/d12/d15/f62 57628 0 2024-02-28T16:24:38.275 INFO:tasks.workunit.client.1.smithi153.stdout:5/435: dwrite da/dd/d25/f55 [4194304,4194304] 0 2024-02-28T16:24:38.275 INFO:tasks.workunit.client.1.smithi153.stdout:2/457: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:24:38.279 INFO:tasks.workunit.client.1.smithi153.stdout:6/415: write d0/d15/f9a [875202,50224] 0 2024-02-28T16:24:38.280 INFO:tasks.workunit.client.1.smithi153.stdout:3/419: dread - d4/d8/d1e/d2a/f83 zero size 2024-02-28T16:24:38.280 INFO:tasks.workunit.client.1.smithi153.stdout:1/421: link d0/c47 d0/dd/d84/c9c 0 2024-02-28T16:24:38.289 INFO:tasks.workunit.client.1.smithi153.stdout:1/422: unlink d0/l2f 0 2024-02-28T16:24:38.293 INFO:tasks.workunit.client.1.smithi153.stdout:0/467: sync 2024-02-28T16:24:38.298 INFO:tasks.workunit.client.1.smithi153.stdout:4/370: dread d4/de/f11 [0,4194304] 0 2024-02-28T16:24:38.299 INFO:tasks.workunit.client.1.smithi153.stdout:5/436: write da/f86 [516391,5108] 0 2024-02-28T16:24:38.305 INFO:tasks.workunit.client.1.smithi153.stdout:8/421: link d0/d19/d2b/d2d/f70 d0/d19/d89/f90 0 2024-02-28T16:24:38.307 INFO:tasks.workunit.client.1.smithi153.stdout:7/456: dwrite d1/d25/df/d60/f67 [0,4194304] 0 2024-02-28T16:24:38.307 INFO:tasks.workunit.client.1.smithi153.stdout:2/458: rename d2/d19/d2a/c72 to d2/d23/c8c 0 2024-02-28T16:24:38.308 INFO:tasks.workunit.client.1.smithi153.stdout:8/422: dread - d0/d12/d15/f77 zero size 2024-02-28T16:24:38.309 INFO:tasks.workunit.client.1.smithi153.stdout:6/416: rename d0/d17 to d0/d17/d7e/d9b 22 2024-02-28T16:24:38.315 INFO:tasks.workunit.client.1.smithi153.stdout:5/437: creat da/dd/d25/d41/f9b x:0 0 0 2024-02-28T16:24:38.315 INFO:tasks.workunit.client.1.smithi153.stdout:6/417: chown d0/d15/c5c 38172 1 2024-02-28T16:24:38.316 INFO:tasks.workunit.client.1.smithi153.stdout:4/371: mkdir d4/de/d23/d83 0 2024-02-28T16:24:38.319 INFO:tasks.workunit.client.1.smithi153.stdout:7/457: dread d1/d25/dc/d50/f65 [0,4194304] 0 2024-02-28T16:24:38.319 INFO:tasks.workunit.client.1.smithi153.stdout:0/468: mkdir d4/d99/da5 0 2024-02-28T16:24:38.321 INFO:tasks.workunit.client.1.smithi153.stdout:2/459: rename d2/d19/f38 to d2/d23/d48/f8d 0 2024-02-28T16:24:38.324 INFO:tasks.workunit.client.1.smithi153.stdout:0/469: read d4/f13 [4872655,24958] 0 2024-02-28T16:24:38.328 INFO:tasks.workunit.client.1.smithi153.stdout:6/418: rename d0/d15 to d0/d1d/d33/d9c 0 2024-02-28T16:24:38.337 INFO:tasks.workunit.client.1.smithi153.stdout:1/423: dwrite d0/f23 [0,4194304] 0 2024-02-28T16:24:38.337 INFO:tasks.workunit.client.1.smithi153.stdout:6/419: write d0/d1d/d33/d9c/d48/d63/f92 [267539,83089] 0 2024-02-28T16:24:38.337 INFO:tasks.workunit.client.1.smithi153.stdout:1/424: write d0/dd/f32 [161517,18568] 0 2024-02-28T16:24:38.337 INFO:tasks.workunit.client.1.smithi153.stdout:2/460: symlink d2/d63/l8e 0 2024-02-28T16:24:38.338 INFO:tasks.workunit.client.1.smithi153.stdout:2/461: chown d2/d19/d3e 2011638 1 2024-02-28T16:24:38.343 INFO:tasks.workunit.client.1.smithi153.stdout:5/438: creat da/f9c x:0 0 0 2024-02-28T16:24:38.345 INFO:tasks.workunit.client.1.smithi153.stdout:4/372: creat d4/de/d13/f84 x:0 0 0 2024-02-28T16:24:38.346 INFO:tasks.workunit.client.1.smithi153.stdout:0/470: chown d4/d27/d9a/da1/c79 27 1 2024-02-28T16:24:38.347 INFO:tasks.workunit.client.1.smithi153.stdout:9/377: dread d1/d5/d11/d1f/d20/d36/f2d [0,4194304] 0 2024-02-28T16:24:38.350 INFO:tasks.workunit.client.1.smithi153.stdout:1/425: symlink d0/d3d/d4a/l9d 0 2024-02-28T16:24:38.354 INFO:tasks.workunit.client.1.smithi153.stdout:3/420: sync 2024-02-28T16:24:38.356 INFO:tasks.workunit.client.1.smithi153.stdout:2/462: mknod d2/d25/d49/c8f 0 2024-02-28T16:24:38.356 INFO:tasks.workunit.client.1.smithi153.stdout:4/373: readlink d4/de/l2f 0 2024-02-28T16:24:38.357 INFO:tasks.workunit.client.1.smithi153.stdout:9/378: dread d1/d5/d11/d1f/d20/f31 [0,4194304] 0 2024-02-28T16:24:38.358 INFO:tasks.workunit.client.1.smithi153.stdout:0/471: fdatasync d4/d27/f3a 0 2024-02-28T16:24:38.359 INFO:tasks.workunit.client.1.smithi153.stdout:2/463: chown d2/d25/d49/l54 0 1 2024-02-28T16:24:38.359 INFO:tasks.workunit.client.1.smithi153.stdout:3/421: write d4/d7d/d70/f7a [850827,44458] 0 2024-02-28T16:24:38.360 INFO:tasks.workunit.client.1.smithi153.stdout:8/423: dread d0/ff [0,4194304] 0 2024-02-28T16:24:38.361 INFO:tasks.workunit.client.1.smithi153.stdout:6/420: mkdir d0/d1d/d33/d9c/d48/d63/d8c/d9d 0 2024-02-28T16:24:38.362 INFO:tasks.workunit.client.1.smithi153.stdout:1/426: creat d0/dd/d67/d89/f9e x:0 0 0 2024-02-28T16:24:38.364 INFO:tasks.workunit.client.1.smithi153.stdout:7/458: getdents d1/d25/df/d26/d3a/d95 0 2024-02-28T16:24:38.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/439: link da/dd/d25/f5d da/d29/d43/f9d 0 2024-02-28T16:24:38.367 INFO:tasks.workunit.client.1.smithi153.stdout:4/374: write d4/de/d40/f49 [881766,101187] 0 2024-02-28T16:24:38.371 INFO:tasks.workunit.client.1.smithi153.stdout:3/422: unlink d4/d8/c34 0 2024-02-28T16:24:38.378 INFO:tasks.workunit.client.1.smithi153.stdout:7/459: mkdir d1/d25/df/d60/da4 0 2024-02-28T16:24:38.382 INFO:tasks.workunit.client.1.smithi153.stdout:5/440: mknod da/dd/d25/d41/d7c/c9e 0 2024-02-28T16:24:38.382 INFO:tasks.workunit.client.1.smithi153.stdout:7/460: write d1/d25/dc/f35 [3094098,39927] 0 2024-02-28T16:24:38.383 INFO:tasks.workunit.client.1.smithi153.stdout:9/379: write d1/d5/d27/d61/f3d [1031870,18659] 0 2024-02-28T16:24:38.386 INFO:tasks.workunit.client.1.smithi153.stdout:2/464: getdents d2/d23/d88 0 2024-02-28T16:24:38.386 INFO:tasks.workunit.client.1.smithi153.stdout:3/423: rename d4/d8/d1e/d2a/d35/d54/f6d to d4/d8/d1e/d2a/d55/f92 0 2024-02-28T16:24:38.387 INFO:tasks.workunit.client.1.smithi153.stdout:4/375: dwrite d4/de/d23/d2b/d31/f64 [0,4194304] 0 2024-02-28T16:24:38.392 INFO:tasks.workunit.client.1.smithi153.stdout:5/441: truncate da/d29/f62 530166 0 2024-02-28T16:24:38.392 INFO:tasks.workunit.client.1.smithi153.stdout:2/465: fsync d2/d19/d31/f6a 0 2024-02-28T16:24:38.393 INFO:tasks.workunit.client.1.smithi153.stdout:8/424: getdents d0/d34 0 2024-02-28T16:24:38.400 INFO:tasks.workunit.client.1.smithi153.stdout:0/472: dwrite d4/d1a/d8e/d90/f5e [0,4194304] 0 2024-02-28T16:24:38.402 INFO:tasks.workunit.client.1.smithi153.stdout:3/424: creat d4/d8/d1e/d63/f93 x:0 0 0 2024-02-28T16:24:38.402 INFO:tasks.workunit.client.1.smithi153.stdout:4/376: readlink d4/de/d13/d1b/d4e/d50/l71 0 2024-02-28T16:24:38.402 INFO:tasks.workunit.client.1.smithi153.stdout:5/442: fdatasync da/dd/d25/d41/d7c/f84 0 2024-02-28T16:24:38.411 INFO:tasks.workunit.client.1.smithi153.stdout:6/421: dwrite d0/f20 [0,4194304] 0 2024-02-28T16:24:38.414 INFO:tasks.workunit.client.1.smithi153.stdout:0/473: truncate d4/f78 960230 0 2024-02-28T16:24:38.418 INFO:tasks.workunit.client.1.smithi153.stdout:3/425: mknod d4/d8/d1e/d23/c94 0 2024-02-28T16:24:38.421 INFO:tasks.workunit.client.1.smithi153.stdout:5/443: mkdir da/d29/d43/d5a/d9f 0 2024-02-28T16:24:38.431 INFO:tasks.workunit.client.1.smithi153.stdout:3/426: chown d4/d8/d1e/f42 16128445 1 2024-02-28T16:24:38.432 INFO:tasks.workunit.client.1.smithi153.stdout:2/466: dwrite d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:38.432 INFO:tasks.workunit.client.1.smithi153.stdout:0/474: dread d4/f97 [0,4194304] 0 2024-02-28T16:24:38.435 INFO:tasks.workunit.client.1.smithi153.stdout:3/427: write d4/d13/f14 [2336030,27710] 0 2024-02-28T16:24:38.436 INFO:tasks.workunit.client.1.smithi153.stdout:8/425: dwrite d0/d12/d67/d30/f58 [0,4194304] 0 2024-02-28T16:24:38.437 INFO:tasks.workunit.client.1.smithi153.stdout:6/422: fdatasync d0/d1d/d23/d60/f74 0 2024-02-28T16:24:38.442 INFO:tasks.workunit.client.1.smithi153.stdout:5/444: creat da/dd/d25/d82/fa0 x:0 0 0 2024-02-28T16:24:38.443 INFO:tasks.workunit.client.1.smithi153.stdout:7/461: dread d1/f23 [0,4194304] 0 2024-02-28T16:24:38.444 INFO:tasks.workunit.client.1.smithi153.stdout:4/377: truncate d4/f7 2416802 0 2024-02-28T16:24:38.448 INFO:tasks.workunit.client.1.smithi153.stdout:9/380: dread d1/d5/d11/d1f/d20/d45/f55 [0,4194304] 0 2024-02-28T16:24:38.450 INFO:tasks.workunit.client.1.smithi153.stdout:4/378: chown d4/d3c/f43 388 1 2024-02-28T16:24:38.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/423: symlink d0/d1d/d23/d6c/l9e 0 2024-02-28T16:24:38.455 INFO:tasks.workunit.client.1.smithi153.stdout:8/426: creat d0/d19/d89/f91 x:0 0 0 2024-02-28T16:24:38.455 INFO:tasks.workunit.client.1.smithi153.stdout:9/381: fdatasync d1/d5/d11/d1f/d20/d45/f4a 0 2024-02-28T16:24:38.455 INFO:tasks.workunit.client.1.smithi153.stdout:5/445: dread da/d29/f5b [0,4194304] 0 2024-02-28T16:24:38.457 INFO:tasks.workunit.client.1.smithi153.stdout:2/467: dread d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:38.457 INFO:tasks.workunit.client.1.smithi153.stdout:3/428: unlink d4/c45 0 2024-02-28T16:24:38.463 INFO:tasks.workunit.client.1.smithi153.stdout:5/446: chown da/d29/d43/c53 30335 1 2024-02-28T16:24:38.464 INFO:tasks.workunit.client.1.smithi153.stdout:9/382: mkdir d1/d74/d80 0 2024-02-28T16:24:38.465 INFO:tasks.workunit.client.1.smithi153.stdout:8/427: fdatasync d0/d12/d15/f62 0 2024-02-28T16:24:38.466 INFO:tasks.workunit.client.1.smithi153.stdout:3/429: fsync d4/d8/d1e/f42 0 2024-02-28T16:24:38.467 INFO:tasks.workunit.client.1.smithi153.stdout:7/462: creat d1/d25/fa5 x:0 0 0 2024-02-28T16:24:38.468 INFO:tasks.workunit.client.1.smithi153.stdout:6/424: creat d0/d1d/d33/d9c/d48/d63/f9f x:0 0 0 2024-02-28T16:24:38.472 INFO:tasks.workunit.client.1.smithi153.stdout:4/379: read d4/de/d13/f20 [3503174,82429] 0 2024-02-28T16:24:38.473 INFO:tasks.workunit.client.1.smithi153.stdout:7/463: symlink d1/la6 0 2024-02-28T16:24:38.478 INFO:tasks.workunit.client.1.smithi153.stdout:0/475: dwrite d4/d1a/d8e/d90/f33 [0,4194304] 0 2024-02-28T16:24:38.484 INFO:tasks.workunit.client.1.smithi153.stdout:3/430: mknod d4/d13/d28/d36/c95 0 2024-02-28T16:24:38.485 INFO:tasks.workunit.client.1.smithi153.stdout:8/428: rename d0/d12/d15/l6e to d0/d19/d1e/l92 0 2024-02-28T16:24:38.486 INFO:tasks.workunit.client.1.smithi153.stdout:7/464: dread - d1/d25/df/d26/d76/f9a zero size 2024-02-28T16:24:38.487 INFO:tasks.workunit.client.1.smithi153.stdout:0/476: creat d4/d1a/d8e/d90/fa6 x:0 0 0 2024-02-28T16:24:38.491 INFO:tasks.workunit.client.1.smithi153.stdout:4/380: rename d4/de/d23/d2b/d31/c3f to d4/de/d23/d2b/d4b/c85 0 2024-02-28T16:24:38.498 INFO:tasks.workunit.client.1.smithi153.stdout:2/468: dwrite d2/f67 [0,4194304] 0 2024-02-28T16:24:38.500 INFO:tasks.workunit.client.1.smithi153.stdout:3/431: fsync d4/f18 0 2024-02-28T16:24:38.501 INFO:tasks.workunit.client.1.smithi153.stdout:7/465: truncate d1/d25/df/d5a/f78 165355 0 2024-02-28T16:24:38.504 INFO:tasks.workunit.client.1.smithi153.stdout:5/447: dwrite da/f19 [0,4194304] 0 2024-02-28T16:24:38.507 INFO:tasks.workunit.client.1.smithi153.stdout:0/477: link d4/f3c d4/d9b/fa7 0 2024-02-28T16:24:38.507 INFO:tasks.workunit.client.1.smithi153.stdout:6/425: dwrite d0/d1d/d33/d9c/d2e/f5b [0,4194304] 0 2024-02-28T16:24:38.512 INFO:tasks.workunit.client.1.smithi153.stdout:6/426: write d0/f20 [3204926,208] 0 2024-02-28T16:24:38.514 INFO:tasks.workunit.client.1.smithi153.stdout:5/448: fdatasync da/f16 0 2024-02-28T16:24:38.517 INFO:tasks.workunit.client.1.smithi153.stdout:7/466: rename d1/d25/df/d26/d3a/d5e/f68 to d1/d25/df/d26/d3a/d52/fa7 0 2024-02-28T16:24:38.519 INFO:tasks.workunit.client.1.smithi153.stdout:2/469: creat d2/d19/d8b/f90 x:0 0 0 2024-02-28T16:24:38.522 INFO:tasks.workunit.client.1.smithi153.stdout:0/478: symlink d4/d32/d7f/d8a/la8 0 2024-02-28T16:24:38.522 INFO:tasks.workunit.client.1.smithi153.stdout:7/467: fdatasync d1/f2c 0 2024-02-28T16:24:38.525 INFO:tasks.workunit.client.1.smithi153.stdout:0/479: write d4/d1a/f39 [1177625,37556] 0 2024-02-28T16:24:38.527 INFO:tasks.workunit.client.1.smithi153.stdout:5/449: creat da/dd/d54/fa1 x:0 0 0 2024-02-28T16:24:38.527 INFO:tasks.workunit.client.1.smithi153.stdout:7/468: read - d1/d25/fa5 zero size 2024-02-28T16:24:38.530 INFO:tasks.workunit.client.1.smithi153.stdout:7/469: dread - d1/d25/df/f8f zero size 2024-02-28T16:24:38.536 INFO:tasks.workunit.client.1.smithi153.stdout:5/450: write da/fb [304100,96120] 0 2024-02-28T16:24:38.537 INFO:tasks.workunit.client.1.smithi153.stdout:2/470: symlink d2/d19/d2a/l91 0 2024-02-28T16:24:38.542 INFO:tasks.workunit.client.1.smithi153.stdout:6/427: dread d0/d1d/d33/d9c/d68/f6f [0,4194304] 0 2024-02-28T16:24:38.545 INFO:tasks.workunit.client.1.smithi153.stdout:2/471: write d2/d19/d2a/f45 [1292118,1585] 0 2024-02-28T16:24:38.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/427: sync 2024-02-28T16:24:38.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/470: mknod d1/d25/df/d26/d3a/d5e/ca8 0 2024-02-28T16:24:38.550 INFO:tasks.workunit.client.1.smithi153.stdout:6/428: mknod d0/d1d/d23/d6c/ca0 0 2024-02-28T16:24:38.551 INFO:tasks.workunit.client.1.smithi153.stdout:4/381: dwrite d4/de/d23/f3a [0,4194304] 0 2024-02-28T16:24:38.552 INFO:tasks.workunit.client.1.smithi153.stdout:7/471: chown d1/d25/df/d26/d3a/d52/f6e 4130 1 2024-02-28T16:24:38.555 INFO:tasks.workunit.client.1.smithi153.stdout:1/428: truncate d0/dd/f76 223228 0 2024-02-28T16:24:38.555 INFO:tasks.workunit.client.1.smithi153.stdout:4/382: read - d4/de/d40/d4d/f82 zero size 2024-02-28T16:24:38.556 INFO:tasks.workunit.client.1.smithi153.stdout:7/472: readlink d1/d25/dc/l45 0 2024-02-28T16:24:38.560 INFO:tasks.workunit.client.1.smithi153.stdout:4/383: readlink d4/de/d13/l6d 0 2024-02-28T16:24:38.564 INFO:tasks.workunit.client.1.smithi153.stdout:6/429: chown d0/d1d/l54 1674 1 2024-02-28T16:24:38.565 INFO:tasks.workunit.client.1.smithi153.stdout:1/429: unlink d0/dd/d67/d80/f96 0 2024-02-28T16:24:38.568 INFO:tasks.workunit.client.1.smithi153.stdout:4/384: read d4/de/d23/d2b/d31/f34 [1822793,58445] 0 2024-02-28T16:24:38.568 INFO:tasks.workunit.client.1.smithi153.stdout:2/472: creat d2/d19/d2a/d3b/f92 x:0 0 0 2024-02-28T16:24:38.568 INFO:tasks.workunit.client.1.smithi153.stdout:5/451: dwrite da/f9c [0,4194304] 0 2024-02-28T16:24:38.569 INFO:tasks.workunit.client.1.smithi153.stdout:3/432: dread d4/d13/f1d [0,4194304] 0 2024-02-28T16:24:38.571 INFO:tasks.workunit.client.1.smithi153.stdout:7/473: mkdir d1/d25/dc/d50/d66/da9 0 2024-02-28T16:24:38.572 INFO:tasks.workunit.client.1.smithi153.stdout:6/430: write d0/f10 [5375895,47750] 0 2024-02-28T16:24:38.580 INFO:tasks.workunit.client.1.smithi153.stdout:9/383: sync 2024-02-28T16:24:38.580 INFO:tasks.workunit.client.1.smithi153.stdout:4/385: write d4/de/d13/d1b/f5f [374535,72778] 0 2024-02-28T16:24:38.581 INFO:tasks.workunit.client.1.smithi153.stdout:4/386: fdatasync d4/de/f19 0 2024-02-28T16:24:38.585 INFO:tasks.workunit.client.1.smithi153.stdout:3/433: mkdir d4/d8/d1e/d2a/d35/d96 0 2024-02-28T16:24:38.586 INFO:tasks.workunit.client.1.smithi153.stdout:1/430: read d0/d3d/f87 [837356,126745] 0 2024-02-28T16:24:38.589 INFO:tasks.workunit.client.1.smithi153.stdout:1/431: chown d0/l6e 3255 1 2024-02-28T16:24:38.592 INFO:tasks.workunit.client.1.smithi153.stdout:0/480: dread d4/d1a/f37 [0,4194304] 0 2024-02-28T16:24:38.595 INFO:tasks.workunit.client.1.smithi153.stdout:1/432: creat d0/d3d/d4a/d59/f9f x:0 0 0 2024-02-28T16:24:38.597 INFO:tasks.workunit.client.1.smithi153.stdout:8/429: dread d0/d19/f38 [0,4194304] 0 2024-02-28T16:24:38.597 INFO:tasks.workunit.client.1.smithi153.stdout:0/481: chown d4/d1a/c4f 62 1 2024-02-28T16:24:38.598 INFO:tasks.workunit.client.1.smithi153.stdout:5/452: rename da/d29/d43/f9d to da/d29/d43/fa2 0 2024-02-28T16:24:38.600 INFO:tasks.workunit.client.1.smithi153.stdout:6/431: getdents d0/d66 0 2024-02-28T16:24:38.601 INFO:tasks.workunit.client.1.smithi153.stdout:2/473: truncate d2/d19/d2a/f30 3717532 0 2024-02-28T16:24:38.607 INFO:tasks.workunit.client.1.smithi153.stdout:5/453: mknod da/dd/d25/d82/ca3 0 2024-02-28T16:24:38.609 INFO:tasks.workunit.client.1.smithi153.stdout:9/384: dwrite d1/d5/d11/d1f/d20/d45/f4a [0,4194304] 0 2024-02-28T16:24:38.610 INFO:tasks.workunit.client.1.smithi153.stdout:1/433: creat d0/d62/d66/d8e/fa0 x:0 0 0 2024-02-28T16:24:38.612 INFO:tasks.workunit.client.1.smithi153.stdout:5/454: stat da/d29/f5b 0 2024-02-28T16:24:38.612 INFO:tasks.workunit.client.1.smithi153.stdout:8/430: dread d0/d19/d2b/f54 [0,4194304] 0 2024-02-28T16:24:38.617 INFO:tasks.workunit.client.1.smithi153.stdout:5/455: unlink da/d29/l3f 0 2024-02-28T16:24:38.620 INFO:tasks.workunit.client.1.smithi153.stdout:8/431: write d0/d12/d67/d30/f65 [2045788,68883] 0 2024-02-28T16:24:38.625 INFO:tasks.workunit.client.1.smithi153.stdout:5/456: chown da/dd/d25/d82 963346 1 2024-02-28T16:24:38.627 INFO:tasks.workunit.client.1.smithi153.stdout:3/434: dwrite d4/d8/d1e/d63/f80 [0,4194304] 0 2024-02-28T16:24:38.632 INFO:tasks.workunit.client.1.smithi153.stdout:4/387: write d4/f10 [1549018,99116] 0 2024-02-28T16:24:38.634 INFO:tasks.workunit.client.1.smithi153.stdout:2/474: rename d2/d25/d49/d80 to d2/d19/d2a/d93 0 2024-02-28T16:24:38.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/388: fsync d4/de/d23/f3a 0 2024-02-28T16:24:38.639 INFO:tasks.workunit.client.1.smithi153.stdout:5/457: chown da/dd/d54/c7d 107756 1 2024-02-28T16:24:38.639 INFO:tasks.workunit.client.1.smithi153.stdout:3/435: symlink d4/d13/d28/d36/l97 0 2024-02-28T16:24:38.647 INFO:tasks.workunit.client.1.smithi153.stdout:6/432: rename d0/d1d/d33/d9c/d48/d63/d8c/d9d to d0/d1d/d33/d9c/d68/da1 0 2024-02-28T16:24:38.648 INFO:tasks.workunit.client.1.smithi153.stdout:0/482: dread d4/d1a/f39 [0,4194304] 0 2024-02-28T16:24:38.654 INFO:tasks.workunit.client.1.smithi153.stdout:1/434: dread d0/d3d/f87 [0,4194304] 0 2024-02-28T16:24:38.659 INFO:tasks.workunit.client.1.smithi153.stdout:6/433: rmdir d0/d1d 39 2024-02-28T16:24:38.665 INFO:tasks.workunit.client.1.smithi153.stdout:3/436: creat d4/d8/d1e/d63/f98 x:0 0 0 2024-02-28T16:24:38.670 INFO:tasks.workunit.client.1.smithi153.stdout:8/432: dwrite d0/d19/d2b/f6f [0,4194304] 0 2024-02-28T16:24:38.673 INFO:tasks.workunit.client.1.smithi153.stdout:9/385: dwrite d1/d2a/f65 [0,4194304] 0 2024-02-28T16:24:38.675 INFO:tasks.workunit.client.1.smithi153.stdout:2/475: dwrite d2/d23/f42 [0,4194304] 0 2024-02-28T16:24:38.680 INFO:tasks.workunit.client.1.smithi153.stdout:4/389: write d4/f7 [520596,111122] 0 2024-02-28T16:24:38.685 INFO:tasks.workunit.client.1.smithi153.stdout:8/433: symlink d0/d19/d2b/l93 0 2024-02-28T16:24:38.691 INFO:tasks.workunit.client.1.smithi153.stdout:3/437: mkdir d4/d13/d28/d99 0 2024-02-28T16:24:38.691 INFO:tasks.workunit.client.1.smithi153.stdout:7/474: dread d1/d25/df/f4e [0,4194304] 0 2024-02-28T16:24:38.692 INFO:tasks.workunit.client.1.smithi153.stdout:6/434: chown d0/d1d/d30/f6e 5618048 1 2024-02-28T16:24:38.692 INFO:tasks.workunit.client.1.smithi153.stdout:8/434: chown d0/d25/f6b 58057963 1 2024-02-28T16:24:38.692 INFO:tasks.workunit.client.1.smithi153.stdout:5/458: getdents da/d29/d43/d5a/d77 0 2024-02-28T16:24:38.696 INFO:tasks.workunit.client.1.smithi153.stdout:3/438: write d4/f18 [7173917,43752] 0 2024-02-28T16:24:38.702 INFO:tasks.workunit.client.1.smithi153.stdout:8/435: mknod d0/d12/c94 0 2024-02-28T16:24:38.704 INFO:tasks.workunit.client.1.smithi153.stdout:0/483: truncate d4/f14 2126681 0 2024-02-28T16:24:38.707 INFO:tasks.workunit.client.1.smithi153.stdout:7/475: creat d1/d25/dc/faa x:0 0 0 2024-02-28T16:24:38.707 INFO:tasks.workunit.client.1.smithi153.stdout:3/439: write d4/d13/d28/d36/f56 [765321,10622] 0 2024-02-28T16:24:38.713 INFO:tasks.workunit.client.1.smithi153.stdout:2/476: rename d2/d25/d49/l62 to d2/d19/l94 0 2024-02-28T16:24:38.714 INFO:tasks.workunit.client.1.smithi153.stdout:5/459: chown da/dd/d25/d82/d8f/c95 20074671 1 2024-02-28T16:24:38.715 INFO:tasks.workunit.client.1.smithi153.stdout:3/440: chown d4/d2c/f57 995 1 2024-02-28T16:24:38.716 INFO:tasks.workunit.client.1.smithi153.stdout:1/435: truncate d0/dd/f1c 5757621 0 2024-02-28T16:24:38.716 INFO:tasks.workunit.client.1.smithi153.stdout:4/390: dwrite d4/d3c/f43 [4194304,4194304] 0 2024-02-28T16:24:38.718 INFO:tasks.workunit.client.1.smithi153.stdout:8/436: mknod d0/d12/d67/c95 0 2024-02-28T16:24:38.720 INFO:tasks.workunit.client.1.smithi153.stdout:5/460: chown da/f38 2716561 1 2024-02-28T16:24:38.721 INFO:tasks.workunit.client.1.smithi153.stdout:4/391: fdatasync d4/f6 0 2024-02-28T16:24:38.721 INFO:tasks.workunit.client.1.smithi153.stdout:2/477: write d2/d4b/f50 [2257730,13676] 0 2024-02-28T16:24:38.723 INFO:tasks.workunit.client.1.smithi153.stdout:7/476: rename d1/d25/dc/d50/l54 to d1/d25/df/d26/d3a/d5e/d72/lab 0 2024-02-28T16:24:38.723 INFO:tasks.workunit.client.1.smithi153.stdout:9/386: dwrite d1/d5/d27/d61/f32 [0,4194304] 0 2024-02-28T16:24:38.726 INFO:tasks.workunit.client.1.smithi153.stdout:3/441: creat d4/d49/f9a x:0 0 0 2024-02-28T16:24:38.729 INFO:tasks.workunit.client.1.smithi153.stdout:2/478: read - d2/d86/f85 zero size 2024-02-28T16:24:38.729 INFO:tasks.workunit.client.1.smithi153.stdout:1/436: unlink d0/d62/d66/c75 0 2024-02-28T16:24:38.731 INFO:tasks.workunit.client.1.smithi153.stdout:8/437: unlink d0/d12/l5c 0 2024-02-28T16:24:38.732 INFO:tasks.workunit.client.1.smithi153.stdout:4/392: mknod d4/de/d23/d2b/c86 0 2024-02-28T16:24:38.734 INFO:tasks.workunit.client.1.smithi153.stdout:7/477: chown d1/d25/df/d26/d3a/d52/c58 685405261 1 2024-02-28T16:24:38.741 INFO:tasks.workunit.client.1.smithi153.stdout:4/393: chown d4/f10 188959690 1 2024-02-28T16:24:38.741 INFO:tasks.workunit.client.1.smithi153.stdout:7/478: readlink d1/d25/dc/l1a 0 2024-02-28T16:24:38.741 INFO:tasks.workunit.client.1.smithi153.stdout:1/437: creat d0/d3d/fa1 x:0 0 0 2024-02-28T16:24:38.742 INFO:tasks.workunit.client.1.smithi153.stdout:7/479: readlink d1/d25/df/d60/la2 0 2024-02-28T16:24:38.743 INFO:tasks.workunit.client.1.smithi153.stdout:2/479: rmdir d2/d25 39 2024-02-28T16:24:38.744 INFO:tasks.workunit.client.1.smithi153.stdout:8/438: mkdir d0/d12/d67/d88/d96 0 2024-02-28T16:24:38.747 INFO:tasks.workunit.client.1.smithi153.stdout:8/439: fsync d0/d19/d2b/d2d/f5a 0 2024-02-28T16:24:38.750 INFO:tasks.workunit.client.1.smithi153.stdout:1/438: unlink d0/d3d/f90 0 2024-02-28T16:24:38.752 INFO:tasks.workunit.client.1.smithi153.stdout:5/461: link da/dd/d25/d41/d7c/f84 da/dd/d25/d41/fa4 0 2024-02-28T16:24:38.754 INFO:tasks.workunit.client.1.smithi153.stdout:4/394: creat d4/de/d23/d2b/d4b/f87 x:0 0 0 2024-02-28T16:24:38.755 INFO:tasks.workunit.client.1.smithi153.stdout:7/480: mknod d1/d25/df/d26/d3a/d52/d63/d75/cac 0 2024-02-28T16:24:38.759 INFO:tasks.workunit.client.1.smithi153.stdout:5/462: unlink da/d29/f62 0 2024-02-28T16:24:38.759 INFO:tasks.workunit.client.1.smithi153.stdout:1/439: creat d0/dd/d67/fa2 x:0 0 0 2024-02-28T16:24:38.760 INFO:tasks.workunit.client.1.smithi153.stdout:3/442: dread d4/d8/d1e/d2a/d35/f39 [0,4194304] 0 2024-02-28T16:24:38.763 INFO:tasks.workunit.client.1.smithi153.stdout:4/395: chown d4/de/d23/f30 154646491 1 2024-02-28T16:24:38.764 INFO:tasks.workunit.client.1.smithi153.stdout:6/435: dread d0/f10 [0,4194304] 0 2024-02-28T16:24:38.766 INFO:tasks.workunit.client.1.smithi153.stdout:3/443: chown d4/d7d/d41/f3e 20064165 1 2024-02-28T16:24:38.772 INFO:tasks.workunit.client.1.smithi153.stdout:5/463: fdatasync da/f42 0 2024-02-28T16:24:38.772 INFO:tasks.workunit.client.1.smithi153.stdout:9/387: dwrite d1/d5/d11/d1f/d20/d45/f55 [0,4194304] 0 2024-02-28T16:24:38.772 INFO:tasks.workunit.client.1.smithi153.stdout:4/396: fdatasync d4/de/d23/f70 0 2024-02-28T16:24:38.775 INFO:tasks.workunit.client.1.smithi153.stdout:8/440: dwrite d0/d12/f8d [0,4194304] 0 2024-02-28T16:24:38.776 INFO:tasks.workunit.client.1.smithi153.stdout:1/440: rename d0/d62/d66/d7c/c86 to d0/d3d/d4a/d59/ca3 0 2024-02-28T16:24:38.779 INFO:tasks.workunit.client.1.smithi153.stdout:3/444: symlink d4/d2c/l9b 0 2024-02-28T16:24:38.783 INFO:tasks.workunit.client.1.smithi153.stdout:6/436: write d0/d1d/d33/d9c/d48/d72/f97 [734097,50159] 0 2024-02-28T16:24:38.784 INFO:tasks.workunit.client.1.smithi153.stdout:6/437: chown d0/d1d/d30 342362 1 2024-02-28T16:24:38.785 INFO:tasks.workunit.client.1.smithi153.stdout:8/441: write d0/d19/f43 [723588,82866] 0 2024-02-28T16:24:38.792 INFO:tasks.workunit.client.1.smithi153.stdout:3/445: creat d4/d7d/d41/f9c x:0 0 0 2024-02-28T16:24:38.796 INFO:tasks.workunit.client.1.smithi153.stdout:9/388: read d1/d5/f47 [734181,105105] 0 2024-02-28T16:24:38.800 INFO:tasks.workunit.client.1.smithi153.stdout:7/481: link d1/d25/dc/c93 d1/d25/df/d26/d3a/d5e/d72/d9c/cad 0 2024-02-28T16:24:38.803 INFO:tasks.workunit.client.1.smithi153.stdout:6/438: mkdir d0/d1d/d33/d9c/d68/da2 0 2024-02-28T16:24:38.804 INFO:tasks.workunit.client.1.smithi153.stdout:4/397: symlink d4/de/d23/d83/l88 0 2024-02-28T16:24:38.806 INFO:tasks.workunit.client.1.smithi153.stdout:1/441: creat d0/dd/d84/fa4 x:0 0 0 2024-02-28T16:24:38.807 INFO:tasks.workunit.client.1.smithi153.stdout:8/442: rename d0/d34/d50/c56 to d0/d34/c97 0 2024-02-28T16:24:38.809 INFO:tasks.workunit.client.1.smithi153.stdout:1/442: dread - d0/dd/d67/d89/f92 zero size 2024-02-28T16:24:38.809 INFO:tasks.workunit.client.1.smithi153.stdout:3/446: fdatasync d4/d8/d1e/d2a/d55/f92 0 2024-02-28T16:24:38.810 INFO:tasks.workunit.client.1.smithi153.stdout:9/389: mknod d1/d5/d11/d1f/d20/d36/c81 0 2024-02-28T16:24:38.813 INFO:tasks.workunit.client.1.smithi153.stdout:7/482: mkdir d1/d25/df/d5a/dae 0 2024-02-28T16:24:38.814 INFO:tasks.workunit.client.1.smithi153.stdout:9/390: stat d1/d5/d11/d1f/d20/f68 0 2024-02-28T16:24:38.816 INFO:tasks.workunit.client.1.smithi153.stdout:6/439: rename d0/d1d/d33/d9c/d2e/c94 to d0/d1d/d33/d8d/ca3 0 2024-02-28T16:24:38.818 INFO:tasks.workunit.client.1.smithi153.stdout:6/440: chown d0/d66/d85 116511 1 2024-02-28T16:24:38.819 INFO:tasks.workunit.client.1.smithi153.stdout:0/484: sync 2024-02-28T16:24:38.821 INFO:tasks.workunit.client.1.smithi153.stdout:1/443: creat d0/d62/d66/d8e/fa5 x:0 0 0 2024-02-28T16:24:38.822 INFO:tasks.workunit.client.1.smithi153.stdout:3/447: mknod d4/d7d/d41/d71/c9d 0 2024-02-28T16:24:38.822 INFO:tasks.workunit.client.1.smithi153.stdout:4/398: dread f1 [0,4194304] 0 2024-02-28T16:24:38.827 INFO:tasks.workunit.client.1.smithi153.stdout:0/485: write d4/d27/f9f [441014,17040] 0 2024-02-28T16:24:38.828 INFO:tasks.workunit.client.1.smithi153.stdout:6/441: read d0/d17/f75 [3652839,8701] 0 2024-02-28T16:24:38.828 INFO:tasks.workunit.client.1.smithi153.stdout:3/448: read d4/d13/f14 [275928,87698] 0 2024-02-28T16:24:38.832 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:38 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:38.832 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:38 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:38.832 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:38 smithi023 ceph-mon[29137]: pgmap v9: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 25 MiB/s rd, 142 MiB/s wr, 284 op/s 2024-02-28T16:24:38.832 INFO:tasks.workunit.client.1.smithi153.stdout:9/391: rename d1/d5/d11/d1f/d20/d45/f55 to d1/d5/d11/d1f/d43/d76/f82 0 2024-02-28T16:24:38.836 INFO:tasks.workunit.client.1.smithi153.stdout:5/464: dwrite da/dd/d25/d41/d7c/f84 [0,4194304] 0 2024-02-28T16:24:38.836 INFO:tasks.workunit.client.1.smithi153.stdout:1/444: rename d0/d3d/f4b to d0/d3d/fa6 0 2024-02-28T16:24:38.838 INFO:tasks.workunit.client.1.smithi153.stdout:8/443: dwrite d0/d19/d2b/d2d/f35 [0,4194304] 0 2024-02-28T16:24:38.839 INFO:tasks.workunit.client.1.smithi153.stdout:9/392: write d1/d5/d11/d1f/d20/d45/f4a [188066,72058] 0 2024-02-28T16:24:38.840 INFO:tasks.workunit.client.1.smithi153.stdout:7/483: dwrite d1/d25/df/d26/f57 [0,4194304] 0 2024-02-28T16:24:38.851 INFO:tasks.workunit.client.1.smithi153.stdout:5/465: fdatasync da/f73 0 2024-02-28T16:24:38.852 INFO:tasks.workunit.client.1.smithi153.stdout:4/399: creat d4/de/d40/d4d/d51/f89 x:0 0 0 2024-02-28T16:24:38.854 INFO:tasks.workunit.client.1.smithi153.stdout:0/486: symlink d4/d99/da5/la9 0 2024-02-28T16:24:38.856 INFO:tasks.workunit.client.1.smithi153.stdout:8/444: mknod d0/d19/c98 0 2024-02-28T16:24:38.857 INFO:tasks.workunit.client.1.smithi153.stdout:7/484: truncate d1/d25/df/d26/d3a/d52/fa7 993347 0 2024-02-28T16:24:38.861 INFO:tasks.workunit.client.1.smithi153.stdout:4/400: read - d4/de/d23/d2b/d4b/f87 zero size 2024-02-28T16:24:38.861 INFO:tasks.workunit.client.1.smithi153.stdout:6/442: dwrite d0/d1d/d30/f31 [0,4194304] 0 2024-02-28T16:24:38.868 INFO:tasks.workunit.client.1.smithi153.stdout:9/393: write d1/ff [700025,24481] 0 2024-02-28T16:24:38.869 INFO:tasks.workunit.client.1.smithi153.stdout:8/445: unlink d0/d19/d1e/l92 0 2024-02-28T16:24:38.873 INFO:tasks.workunit.client.1.smithi153.stdout:8/446: rmdir d0/d19/d2b 39 2024-02-28T16:24:38.875 INFO:tasks.workunit.client.1.smithi153.stdout:9/394: mknod d1/d5/d11/d1f/d20/d5d/c83 0 2024-02-28T16:24:38.879 INFO:tasks.workunit.client.1.smithi153.stdout:6/443: getdents d0/d17 0 2024-02-28T16:24:38.879 INFO:tasks.workunit.client.1.smithi153.stdout:4/401: link d4/de/l2f d4/de/d40/d4d/d51/l8a 0 2024-02-28T16:24:38.884 INFO:tasks.workunit.client.1.smithi153.stdout:8/447: chown d0/d12/d67/d30/d63/d74/l7f 14146786 1 2024-02-28T16:24:38.889 INFO:tasks.workunit.client.1.smithi153.stdout:7/485: dwrite d1/d25/df/d26/f57 [0,4194304] 0 2024-02-28T16:24:38.892 INFO:tasks.workunit.client.1.smithi153.stdout:4/402: mknod d4/de/d13/d1b/d4e/c8b 0 2024-02-28T16:24:38.894 INFO:tasks.workunit.client.1.smithi153.stdout:0/487: dwrite d4/d1a/d8e/d90/f3f [0,4194304] 0 2024-02-28T16:24:38.894 INFO:tasks.workunit.client.1.smithi153.stdout:9/395: read d1/d5/d11/d1f/d20/f68 [209923,29908] 0 2024-02-28T16:24:38.895 INFO:tasks.workunit.client.1.smithi153.stdout:6/444: write d0/d1d/d33/d9c/d68/f7b [490516,54991] 0 2024-02-28T16:24:38.895 INFO:tasks.workunit.client.1.smithi153.stdout:8/448: rename d0/d19/d2b/d2d/d3f/l86 to d0/d34/l99 0 2024-02-28T16:24:38.896 INFO:tasks.workunit.client.1.smithi153.stdout:4/403: readlink d4/de/d23/d2b/l6f 0 2024-02-28T16:24:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:38 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:38 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:38.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:38 smithi153 ceph-mon[35341]: pgmap v9: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 25 MiB/s rd, 142 MiB/s wr, 284 op/s 2024-02-28T16:24:38.898 INFO:tasks.workunit.client.1.smithi153.stdout:6/445: chown d0/d17/f75 678178659 1 2024-02-28T16:24:38.901 INFO:tasks.workunit.client.1.smithi153.stdout:7/486: truncate d1/d25/df/d26/d76/f9a 1010280 0 2024-02-28T16:24:38.903 INFO:tasks.workunit.client.1.smithi153.stdout:0/488: chown d4/d1a/f31 19 1 2024-02-28T16:24:38.904 INFO:tasks.workunit.client.1.smithi153.stdout:7/487: chown d1/c29 657847313 1 2024-02-28T16:24:38.904 INFO:tasks.workunit.client.1.smithi153.stdout:2/480: sync 2024-02-28T16:24:38.907 INFO:tasks.workunit.client.1.smithi153.stdout:2/481: fdatasync d2/d19/d2a/d3b/f71 0 2024-02-28T16:24:38.907 INFO:tasks.workunit.client.1.smithi153.stdout:8/449: rename d0/d12/d15/f62 to d0/d12/d67/d30/d63/f9a 0 2024-02-28T16:24:38.908 INFO:tasks.workunit.client.1.smithi153.stdout:7/488: write d1/d25/df/d26/f84 [395828,56908] 0 2024-02-28T16:24:38.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/404: dread d4/de/f11 [0,4194304] 0 2024-02-28T16:24:38.911 INFO:tasks.workunit.client.1.smithi153.stdout:7/489: fdatasync d1/d25/df/d26/f8c 0 2024-02-28T16:24:38.914 INFO:tasks.workunit.client.1.smithi153.stdout:6/446: rename d0/d1d/d23 to d0/d1d/d5d/d6b/da4 0 2024-02-28T16:24:38.916 INFO:tasks.workunit.client.1.smithi153.stdout:4/405: chown d4/de/d13/c44 2985 1 2024-02-28T16:24:38.916 INFO:tasks.workunit.client.1.smithi153.stdout:2/482: mkdir d2/d23/d88/d95 0 2024-02-28T16:24:38.917 INFO:tasks.workunit.client.1.smithi153.stdout:4/406: dread - d4/de/d13/f84 zero size 2024-02-28T16:24:38.918 INFO:tasks.workunit.client.1.smithi153.stdout:0/489: getdents d4/d1a/d8e 0 2024-02-28T16:24:38.920 INFO:tasks.workunit.client.1.smithi153.stdout:4/407: truncate d4/f6 2127207 0 2024-02-28T16:24:38.920 INFO:tasks.workunit.client.1.smithi153.stdout:2/483: symlink d2/d19/d31/l96 0 2024-02-28T16:24:38.923 INFO:tasks.workunit.client.1.smithi153.stdout:0/490: creat d4/d32/d7f/faa x:0 0 0 2024-02-28T16:24:38.923 INFO:tasks.workunit.client.1.smithi153.stdout:6/447: chown d0/d1d/d34/c64 978 1 2024-02-28T16:24:38.925 INFO:tasks.workunit.client.1.smithi153.stdout:4/408: creat d4/de/d47/f8c x:0 0 0 2024-02-28T16:24:38.927 INFO:tasks.workunit.client.1.smithi153.stdout:6/448: symlink d0/d17/la5 0 2024-02-28T16:24:38.929 INFO:tasks.workunit.client.1.smithi153.stdout:0/491: fsync d4/d1a/f31 0 2024-02-28T16:24:38.930 INFO:tasks.workunit.client.1.smithi153.stdout:5/466: dread da/f51 [0,4194304] 0 2024-02-28T16:24:38.936 INFO:tasks.workunit.client.1.smithi153.stdout:2/484: link d2/d23/f29 d2/d25/d49/f97 0 2024-02-28T16:24:38.940 INFO:tasks.workunit.client.1.smithi153.stdout:5/467: rename da/d29/f30 to da/dd/d54/d63/fa5 0 2024-02-28T16:24:38.944 INFO:tasks.workunit.client.1.smithi153.stdout:5/468: fsync da/f2c 0 2024-02-28T16:24:38.947 INFO:tasks.workunit.client.1.smithi153.stdout:5/469: dread - da/dd/d25/d8a/f8d zero size 2024-02-28T16:24:38.948 INFO:tasks.workunit.client.1.smithi153.stdout:6/449: dwrite d0/d1d/d30/f31 [4194304,4194304] 0 2024-02-28T16:24:38.950 INFO:tasks.workunit.client.1.smithi153.stdout:0/492: dwrite d4/d32/f48 [0,4194304] 0 2024-02-28T16:24:38.953 INFO:tasks.workunit.client.1.smithi153.stdout:2/485: symlink d2/d23/l98 0 2024-02-28T16:24:38.953 INFO:tasks.workunit.client.1.smithi153.stdout:0/493: read - d4/d27/d9a/fa4 zero size 2024-02-28T16:24:38.953 INFO:tasks.workunit.client.1.smithi153.stdout:9/396: dread d1/d5/d11/d1f/d20/d36/f38 [0,4194304] 0 2024-02-28T16:24:38.954 INFO:tasks.workunit.client.1.smithi153.stdout:7/490: truncate d1/d25/df/f61 1494568 0 2024-02-28T16:24:38.956 INFO:tasks.workunit.client.1.smithi153.stdout:9/397: dread - d1/d5/d11/d1f/d52/f6c zero size 2024-02-28T16:24:38.972 INFO:tasks.workunit.client.1.smithi153.stdout:6/450: symlink d0/d17/la6 0 2024-02-28T16:24:38.973 INFO:tasks.workunit.client.1.smithi153.stdout:6/451: chown d0/d66/c69 19805 1 2024-02-28T16:24:38.979 INFO:tasks.workunit.client.1.smithi153.stdout:0/494: rename d4/d1a to d4/d32/d7f/d8a/dab 0 2024-02-28T16:24:38.980 INFO:tasks.workunit.client.1.smithi153.stdout:4/409: getdents d4/de/d47/d5e 0 2024-02-28T16:24:38.983 INFO:tasks.workunit.client.1.smithi153.stdout:9/398: chown d1/d5/d11/c16 12721842 1 2024-02-28T16:24:38.989 INFO:tasks.workunit.client.1.smithi153.stdout:6/452: truncate d0/d17/f75 4912043 0 2024-02-28T16:24:38.991 INFO:tasks.workunit.client.1.smithi153.stdout:0/495: chown d4/f53 0 1 2024-02-28T16:24:38.991 INFO:tasks.workunit.client.1.smithi153.stdout:6/453: write d0/d1d/d33/f73 [926833,100750] 0 2024-02-28T16:24:38.993 INFO:tasks.workunit.client.1.smithi153.stdout:4/410: unlink d4/de/f11 0 2024-02-28T16:24:38.994 INFO:tasks.workunit.client.1.smithi153.stdout:9/399: creat d1/d5/d11/d64/f84 x:0 0 0 2024-02-28T16:24:39.000 INFO:tasks.workunit.client.1.smithi153.stdout:2/486: dread d2/ff [0,4194304] 0 2024-02-28T16:24:39.003 INFO:tasks.workunit.client.1.smithi153.stdout:6/454: dread d0/d1d/d33/f7a [0,4194304] 0 2024-02-28T16:24:39.006 INFO:tasks.workunit.client.1.smithi153.stdout:0/496: getdents d4/d32/d7f/d8a/dab/d8e/d94/d9e 0 2024-02-28T16:24:39.011 INFO:tasks.workunit.client.1.smithi153.stdout:6/455: fdatasync d0/d1d/d33/d9c/d68/f6f 0 2024-02-28T16:24:39.012 INFO:tasks.workunit.client.1.smithi153.stdout:4/411: dwrite d4/de/d23/d2b/d31/f64 [0,4194304] 0 2024-02-28T16:24:39.017 INFO:tasks.workunit.client.1.smithi153.stdout:0/497: mknod d4/d99/cac 0 2024-02-28T16:24:39.017 INFO:tasks.workunit.client.1.smithi153.stdout:6/456: write d0/d1d/d33/d9c/d2e/f37 [1158439,105478] 0 2024-02-28T16:24:39.017 INFO:tasks.workunit.client.1.smithi153.stdout:9/400: rmdir d1/d5/d27/d61/d78 0 2024-02-28T16:24:39.019 INFO:tasks.workunit.client.1.smithi153.stdout:5/470: dwrite da/dd/d25/d41/d7c/f81 [0,4194304] 0 2024-02-28T16:24:39.023 INFO:tasks.workunit.client.1.smithi153.stdout:9/401: chown d1/d5/d11/d64/f67 1 1 2024-02-28T16:24:39.025 INFO:tasks.workunit.client.1.smithi153.stdout:4/412: mkdir d4/d8d 0 2024-02-28T16:24:39.032 INFO:tasks.workunit.client.1.smithi153.stdout:6/457: dread d0/d1d/d33/d9c/d68/f7b [0,4194304] 0 2024-02-28T16:24:39.035 INFO:tasks.workunit.client.1.smithi153.stdout:6/458: write d0/d1d/d33/d9c/f86 [4328372,54174] 0 2024-02-28T16:24:39.041 INFO:tasks.workunit.client.1.smithi153.stdout:2/487: write d2/d19/d2a/f76 [918546,70177] 0 2024-02-28T16:24:39.042 INFO:tasks.workunit.client.1.smithi153.stdout:9/402: stat d1/d5/c1e 0 2024-02-28T16:24:39.044 INFO:tasks.workunit.client.1.smithi153.stdout:9/403: write d1/ff [524960,25434] 0 2024-02-28T16:24:39.045 INFO:tasks.workunit.client.1.smithi153.stdout:5/471: rename da/dd/l1d to da/d29/d43/d5a/d9f/la6 0 2024-02-28T16:24:39.055 INFO:tasks.workunit.client.1.smithi153.stdout:5/472: dread da/dd/f3d [0,4194304] 0 2024-02-28T16:24:39.056 INFO:tasks.workunit.client.1.smithi153.stdout:5/473: stat da/d29/d43/d5a/d9f 0 2024-02-28T16:24:39.096 INFO:tasks.workunit.client.1.smithi153.stdout:3/449: sync 2024-02-28T16:24:39.096 INFO:tasks.workunit.client.1.smithi153.stdout:1/445: sync 2024-02-28T16:24:39.096 INFO:tasks.workunit.client.1.smithi153.stdout:0/498: dread d4/d27/f7c [0,4194304] 0 2024-02-28T16:24:39.098 INFO:tasks.workunit.client.1.smithi153.stdout:9/404: mkdir d1/d5/d11/d64/d85 0 2024-02-28T16:24:39.100 INFO:tasks.workunit.client.1.smithi153.stdout:5/474: write da/f51 [5176336,59524] 0 2024-02-28T16:24:39.100 INFO:tasks.workunit.client.1.smithi153.stdout:2/488: mkdir d2/d19/d2a/d99 0 2024-02-28T16:24:39.100 INFO:tasks.workunit.client.1.smithi153.stdout:0/499: stat d4/d32/d7f/l93 0 2024-02-28T16:24:39.106 INFO:tasks.workunit.client.1.smithi153.stdout:5/475: write da/dd/d25/d41/d7c/f84 [1527239,111422] 0 2024-02-28T16:24:39.106 INFO:tasks.workunit.client.1.smithi153.stdout:3/450: creat d4/d2c/f9e x:0 0 0 2024-02-28T16:24:39.107 INFO:tasks.workunit.client.1.smithi153.stdout:9/405: creat d1/d5/d11/d64/f86 x:0 0 0 2024-02-28T16:24:39.111 INFO:tasks.workunit.client.1.smithi153.stdout:0/500: chown d4/d89/l98 198048058 1 2024-02-28T16:24:39.111 INFO:tasks.workunit.client.1.smithi153.stdout:2/489: creat d2/d23/d88/f9a x:0 0 0 2024-02-28T16:24:39.113 INFO:tasks.workunit.client.1.smithi153.stdout:0/501: dread - d4/d32/f96 zero size 2024-02-28T16:24:39.117 INFO:tasks.workunit.client.1.smithi153.stdout:3/451: write d4/d13/d28/d36/f56 [1251854,7075] 0 2024-02-28T16:24:39.117 INFO:tasks.workunit.client.1.smithi153.stdout:9/406: creat d1/d5/d11/d64/f87 x:0 0 0 2024-02-28T16:24:39.121 INFO:tasks.workunit.client.1.smithi153.stdout:6/459: write d0/d1d/d30/f36 [1616748,50105] 0 2024-02-28T16:24:39.126 INFO:tasks.workunit.client.1.smithi153.stdout:4/413: chown d4/de/f19 5 1 2024-02-28T16:24:39.138 INFO:tasks.workunit.client.1.smithi153.stdout:8/450: sync 2024-02-28T16:24:39.142 INFO:tasks.workunit.client.1.smithi153.stdout:5/476: dwrite da/dd/d25/f58 [0,4194304] 0 2024-02-28T16:24:39.149 INFO:tasks.workunit.client.1.smithi153.stdout:6/460: link d0/f10 d0/d1d/d33/d9c/d68/da2/fa7 0 2024-02-28T16:24:39.149 INFO:tasks.workunit.client.1.smithi153.stdout:1/446: dwrite d0/dd/f32 [0,4194304] 0 2024-02-28T16:24:39.154 INFO:tasks.workunit.client.1.smithi153.stdout:0/502: rmdir d4/d32/d7f/d8a/dab/d8e/d94/d9e 0 2024-02-28T16:24:39.158 INFO:tasks.workunit.client.1.smithi153.stdout:8/451: mknod d0/d34/d50/c9b 0 2024-02-28T16:24:39.167 INFO:tasks.workunit.client.1.smithi153.stdout:2/490: dwrite d2/d23/d48/f75 [0,4194304] 0 2024-02-28T16:24:39.169 INFO:tasks.workunit.client.1.smithi153.stdout:6/461: creat d0/d1d/d33/d8d/fa8 x:0 0 0 2024-02-28T16:24:39.170 INFO:tasks.workunit.client.1.smithi153.stdout:9/407: write d1/d5/f47 [591640,33024] 0 2024-02-28T16:24:39.170 INFO:tasks.workunit.client.1.smithi153.stdout:3/452: dread d4/d8/d1e/d63/f80 [0,4194304] 0 2024-02-28T16:24:39.173 INFO:tasks.workunit.client.1.smithi153.stdout:7/491: sync 2024-02-28T16:24:39.176 INFO:tasks.workunit.client.1.smithi153.stdout:7/492: write d1/d25/fa5 [130654,106725] 0 2024-02-28T16:24:39.179 INFO:tasks.workunit.client.1.smithi153.stdout:7/493: fdatasync d1/f8b 0 2024-02-28T16:24:39.181 INFO:tasks.workunit.client.1.smithi153.stdout:0/503: creat d4/d32/fad x:0 0 0 2024-02-28T16:24:39.183 INFO:tasks.workunit.client.1.smithi153.stdout:2/491: fdatasync d2/d19/f2c 0 2024-02-28T16:24:39.184 INFO:tasks.workunit.client.1.smithi153.stdout:0/504: dread - d4/d32/f96 zero size 2024-02-28T16:24:39.190 INFO:tasks.workunit.client.1.smithi153.stdout:3/453: dread d4/d7d/d70/f7a [0,4194304] 0 2024-02-28T16:24:39.190 INFO:tasks.workunit.client.1.smithi153.stdout:4/414: truncate f1 1469367 0 2024-02-28T16:24:39.190 INFO:tasks.workunit.client.1.smithi153.stdout:2/492: truncate d2/f6 4701682 0 2024-02-28T16:24:39.196 INFO:tasks.workunit.client.1.smithi153.stdout:5/477: getdents da/d29 0 2024-02-28T16:24:39.201 INFO:tasks.workunit.client.1.smithi153.stdout:6/462: rename d0/d66/c69 to d0/d1d/d33/d9c/ca9 0 2024-02-28T16:24:39.204 INFO:tasks.workunit.client.1.smithi153.stdout:1/447: dwrite d0/d62/d66/d8e/fa5 [0,4194304] 0 2024-02-28T16:24:39.206 INFO:tasks.workunit.client.1.smithi153.stdout:4/415: unlink d4/de/d13/d1b/f2a 0 2024-02-28T16:24:39.208 INFO:tasks.workunit.client.1.smithi153.stdout:3/454: read - d4/d2c/f4e zero size 2024-02-28T16:24:39.209 INFO:tasks.workunit.client.1.smithi153.stdout:5/478: read - da/d29/d43/d5a/d77/f83 zero size 2024-02-28T16:24:39.217 INFO:tasks.workunit.client.1.smithi153.stdout:0/505: truncate d4/d32/d7f/d8a/dab/f31 3044581 0 2024-02-28T16:24:39.223 INFO:tasks.workunit.client.1.smithi153.stdout:7/494: dwrite d1/d25/dc/d50/d66/f86 [0,4194304] 0 2024-02-28T16:24:39.223 INFO:tasks.workunit.client.1.smithi153.stdout:8/452: dread d0/f9 [0,4194304] 0 2024-02-28T16:24:39.223 INFO:tasks.workunit.client.1.smithi153.stdout:9/408: dwrite d1/d5/d11/d1f/d20/f68 [0,4194304] 0 2024-02-28T16:24:39.226 INFO:tasks.workunit.client.1.smithi153.stdout:1/448: creat d0/dd/d67/d80/fa7 x:0 0 0 2024-02-28T16:24:39.227 INFO:tasks.workunit.client.1.smithi153.stdout:2/493: dwrite d2/d86/f85 [0,4194304] 0 2024-02-28T16:24:39.232 INFO:tasks.workunit.client.1.smithi153.stdout:3/455: unlink d4/d6a/l8d 0 2024-02-28T16:24:39.232 INFO:tasks.workunit.client.1.smithi153.stdout:5/479: dread da/fc [0,4194304] 0 2024-02-28T16:24:39.233 INFO:tasks.workunit.client.1.smithi153.stdout:0/506: mknod d4/d99/cae 0 2024-02-28T16:24:39.233 INFO:tasks.workunit.client.1.smithi153.stdout:1/449: fdatasync d0/d62/f8f 0 2024-02-28T16:24:39.236 INFO:tasks.workunit.client.1.smithi153.stdout:5/480: dread - da/d29/f59 zero size 2024-02-28T16:24:39.236 INFO:tasks.workunit.client.1.smithi153.stdout:0/507: stat d4/d27/f47 0 2024-02-28T16:24:39.238 INFO:tasks.workunit.client.1.smithi153.stdout:2/494: write d2/d19/d8b/f90 [253337,53179] 0 2024-02-28T16:24:39.238 INFO:tasks.workunit.client.1.smithi153.stdout:1/450: chown d0/d62/d66/d8e/fa5 897438 1 2024-02-28T16:24:39.245 INFO:tasks.workunit.client.1.smithi153.stdout:0/508: write d4/d27/d9a/da1/f7a [1004715,99367] 0 2024-02-28T16:24:39.247 INFO:tasks.workunit.client.1.smithi153.stdout:7/495: read d1/d25/fe [5036848,16796] 0 2024-02-28T16:24:39.251 INFO:tasks.workunit.client.1.smithi153.stdout:8/453: dwrite d0/d19/f43 [0,4194304] 0 2024-02-28T16:24:39.254 INFO:tasks.workunit.client.1.smithi153.stdout:7/496: write d1/d25/df/d26/f84 [12132,2070] 0 2024-02-28T16:24:39.254 INFO:tasks.workunit.client.1.smithi153.stdout:4/416: rename d4/de/d23/d2b/l6f to d4/d53/d7c/l8e 0 2024-02-28T16:24:39.257 INFO:tasks.workunit.client.1.smithi153.stdout:4/417: stat d4/de/d13/d1b 0 2024-02-28T16:24:39.260 INFO:tasks.workunit.client.1.smithi153.stdout:3/456: rmdir d4/d8/d1e/d2a/d55 39 2024-02-28T16:24:39.263 INFO:tasks.workunit.client.1.smithi153.stdout:1/451: rmdir d0/d62/d66 39 2024-02-28T16:24:39.265 INFO:tasks.workunit.client.1.smithi153.stdout:4/418: dread - d4/de/d47/f8c zero size 2024-02-28T16:24:39.265 INFO:tasks.workunit.client.1.smithi153.stdout:7/497: readlink d1/d25/dc/d7e/la3 0 2024-02-28T16:24:39.265 INFO:tasks.workunit.client.1.smithi153.stdout:2/495: dread d2/d23/d48/f75 [0,4194304] 0 2024-02-28T16:24:39.266 INFO:tasks.workunit.client.1.smithi153.stdout:0/509: readlink d4/l5 0 2024-02-28T16:24:39.268 INFO:tasks.workunit.client.1.smithi153.stdout:3/457: readlink d4/d8/d1e/d23/l25 0 2024-02-28T16:24:39.276 INFO:tasks.workunit.client.1.smithi153.stdout:2/496: mkdir d2/d19/d2a/d93/d9b 0 2024-02-28T16:24:39.278 INFO:tasks.workunit.client.1.smithi153.stdout:3/458: rmdir d4/d8/d1e/d63 39 2024-02-28T16:24:39.281 INFO:tasks.workunit.client.1.smithi153.stdout:0/510: creat d4/d32/d7f/d8a/dab/d8e/d90/faf x:0 0 0 2024-02-28T16:24:39.285 INFO:tasks.workunit.client.1.smithi153.stdout:9/409: link d1/d5/d11/d1f/d43/c5b d1/d2a/c88 0 2024-02-28T16:24:39.285 INFO:tasks.workunit.client.1.smithi153.stdout:2/497: readlink d2/d23/d36/l8a 0 2024-02-28T16:24:39.290 INFO:tasks.workunit.client.1.smithi153.stdout:0/511: fsync d4/d9b/fa7 0 2024-02-28T16:24:39.293 INFO:tasks.workunit.client.1.smithi153.stdout:9/410: mknod d1/d74/c89 0 2024-02-28T16:24:39.295 INFO:tasks.workunit.client.1.smithi153.stdout:7/498: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:24:39.295 INFO:tasks.workunit.client.1.smithi153.stdout:1/452: link d0/f8 d0/dd/d67/d89/fa8 0 2024-02-28T16:24:39.300 INFO:tasks.workunit.client.1.smithi153.stdout:8/454: dwrite d0/d12/d67/d30/f65 [0,4194304] 0 2024-02-28T16:24:39.302 INFO:tasks.workunit.client.1.smithi153.stdout:0/512: write d4/d27/d9a/fa4 [357066,58626] 0 2024-02-28T16:24:39.303 INFO:tasks.workunit.client.1.smithi153.stdout:1/453: chown d0/c1a 103 1 2024-02-28T16:24:39.303 INFO:tasks.workunit.client.1.smithi153.stdout:9/411: read d1/d5/d27/d61/f25 [3369478,96460] 0 2024-02-28T16:24:39.304 INFO:tasks.workunit.client.1.smithi153.stdout:6/463: sync 2024-02-28T16:24:39.315 INFO:tasks.workunit.client.1.smithi153.stdout:8/455: chown d0/d12/d67/d30/l3c 365078 1 2024-02-28T16:24:39.315 INFO:tasks.workunit.client.1.smithi153.stdout:9/412: readlink d1/le 0 2024-02-28T16:24:39.323 INFO:tasks.workunit.client.1.smithi153.stdout:2/498: dwrite d2/d19/d2a/f76 [0,4194304] 0 2024-02-28T16:24:39.325 INFO:tasks.workunit.client.1.smithi153.stdout:0/513: truncate d4/d32/f82 425962 0 2024-02-28T16:24:39.328 INFO:tasks.workunit.client.1.smithi153.stdout:7/499: link d1/d25/df/d26/d3a/d95/ca0 d1/d25/caf 0 2024-02-28T16:24:39.331 INFO:tasks.workunit.client.1.smithi153.stdout:4/419: sync 2024-02-28T16:24:39.333 INFO:tasks.workunit.client.1.smithi153.stdout:8/456: creat d0/d12/d67/d88/d8e/f9c x:0 0 0 2024-02-28T16:24:39.334 INFO:tasks.workunit.client.1.smithi153.stdout:3/459: dwrite d4/d8/d1e/d2a/f83 [0,4194304] 0 2024-02-28T16:24:39.334 INFO:tasks.workunit.client.1.smithi153.stdout:0/514: dread - d4/d27/d9a/da1/f84 zero size 2024-02-28T16:24:39.334 INFO:tasks.workunit.client.1.smithi153.stdout:9/413: rename d1/d5/d11/l44 to d1/d74/l8a 0 2024-02-28T16:24:39.336 INFO:tasks.workunit.client.1.smithi153.stdout:5/481: dread da/d29/d43/f4f [0,4194304] 0 2024-02-28T16:24:39.343 INFO:tasks.workunit.client.1.smithi153.stdout:4/420: write d4/de/d47/f67 [518768,128432] 0 2024-02-28T16:24:39.343 INFO:tasks.workunit.client.1.smithi153.stdout:6/464: dread d0/d1d/d33/d9c/d48/d63/f92 [0,4194304] 0 2024-02-28T16:24:39.348 INFO:tasks.workunit.client.1.smithi153.stdout:8/457: write d0/d12/d67/d30/f7a [198390,11685] 0 2024-02-28T16:24:39.348 INFO:tasks.workunit.client.1.smithi153.stdout:3/460: mkdir d4/d13/d28/d36/d9f 0 2024-02-28T16:24:39.348 INFO:tasks.workunit.client.1.smithi153.stdout:0/515: chown d4/d32/d7f/f86 75 1 2024-02-28T16:24:39.350 INFO:tasks.workunit.client.1.smithi153.stdout:7/500: mknod d1/d25/df/d26/d3a/d52/d63/d75/cb0 0 2024-02-28T16:24:39.351 INFO:tasks.workunit.client.1.smithi153.stdout:9/414: unlink d1/d5/d11/d1f/d20/d5d/l6b 0 2024-02-28T16:24:39.352 INFO:tasks.workunit.client.1.smithi153.stdout:8/458: readlink d0/d34/l46 0 2024-02-28T16:24:39.353 INFO:tasks.workunit.client.1.smithi153.stdout:5/482: mknod da/dd/d25/d8a/ca7 0 2024-02-28T16:24:39.356 INFO:tasks.workunit.client.1.smithi153.stdout:6/465: unlink d0/d1d/d5d/d6b/da4/f8e 0 2024-02-28T16:24:39.359 INFO:tasks.workunit.client.1.smithi153.stdout:7/501: write d1/f8d [237015,23007] 0 2024-02-28T16:24:39.361 INFO:tasks.workunit.client.1.smithi153.stdout:3/461: mkdir d4/d8/d1e/d23/da0 0 2024-02-28T16:24:39.367 INFO:tasks.workunit.client.1.smithi153.stdout:1/454: dwrite d0/dd/f76 [0,4194304] 0 2024-02-28T16:24:39.371 INFO:tasks.workunit.client.1.smithi153.stdout:0/516: dread d4/fa [0,4194304] 0 2024-02-28T16:24:39.375 INFO:tasks.workunit.client.1.smithi153.stdout:3/462: mknod d4/d8/d1e/d64/ca1 0 2024-02-28T16:24:39.376 INFO:tasks.workunit.client.1.smithi153.stdout:6/466: creat d0/d1d/d33/d9c/d48/d63/d8c/faa x:0 0 0 2024-02-28T16:24:39.378 INFO:tasks.workunit.client.1.smithi153.stdout:1/455: dread - d0/dd/d67/d89/f9e zero size 2024-02-28T16:24:39.380 INFO:tasks.workunit.client.1.smithi153.stdout:5/483: getdents da/dd/d25/d41 0 2024-02-28T16:24:39.384 INFO:tasks.workunit.client.1.smithi153.stdout:0/517: mkdir d4/d27/d9a/da1/db0 0 2024-02-28T16:24:39.388 INFO:tasks.workunit.client.1.smithi153.stdout:1/456: fdatasync d0/dd/d67/d89/f9e 0 2024-02-28T16:24:39.388 INFO:tasks.workunit.client.1.smithi153.stdout:9/415: dwrite d1/d5/d27/d61/f63 [0,4194304] 0 2024-02-28T16:24:39.389 INFO:tasks.workunit.client.1.smithi153.stdout:3/463: creat d4/d13/d28/d99/fa2 x:0 0 0 2024-02-28T16:24:39.390 INFO:tasks.workunit.client.1.smithi153.stdout:5/484: mknod da/dd/d25/d8a/ca8 0 2024-02-28T16:24:39.390 INFO:tasks.workunit.client.1.smithi153.stdout:6/467: mkdir d0/d1d/d33/d9c/d2e/d99/dab 0 2024-02-28T16:24:39.392 INFO:tasks.workunit.client.1.smithi153.stdout:6/468: chown d0 31 1 2024-02-28T16:24:39.395 INFO:tasks.workunit.client.1.smithi153.stdout:1/457: chown d0/d3d/d4a/l9d 16 1 2024-02-28T16:24:39.399 INFO:tasks.workunit.client.1.smithi153.stdout:0/518: creat d4/d99/da5/fb1 x:0 0 0 2024-02-28T16:24:39.400 INFO:tasks.workunit.client.1.smithi153.stdout:6/469: fdatasync d0/d1d/d33/f73 0 2024-02-28T16:24:39.403 INFO:tasks.workunit.client.1.smithi153.stdout:8/459: dread d0/d19/d1e/f53 [0,4194304] 0 2024-02-28T16:24:39.403 INFO:tasks.workunit.client.1.smithi153.stdout:7/502: dwrite d1/d25/df/f4e [0,4194304] 0 2024-02-28T16:24:39.411 INFO:tasks.workunit.client.1.smithi153.stdout:1/458: symlink d0/la9 0 2024-02-28T16:24:39.415 INFO:tasks.workunit.client.1.smithi153.stdout:4/421: sync 2024-02-28T16:24:39.417 INFO:tasks.workunit.client.1.smithi153.stdout:8/460: chown d0/ff 282922 1 2024-02-28T16:24:39.419 INFO:tasks.workunit.client.1.smithi153.stdout:6/470: read d0/f52 [479468,32195] 0 2024-02-28T16:24:39.421 INFO:tasks.workunit.client.1.smithi153.stdout:4/422: stat d4/de/c39 0 2024-02-28T16:24:39.421 INFO:tasks.workunit.client.1.smithi153.stdout:2/499: dread d2/d23/d48/f8d [0,4194304] 0 2024-02-28T16:24:39.423 INFO:tasks.workunit.client.1.smithi153.stdout:0/519: mknod d4/d32/d7f/d8a/dab/d8e/d90/cb2 0 2024-02-28T16:24:39.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/471: dread - d0/d1d/d5d/d6b/da4/d60/f8b zero size 2024-02-28T16:24:39.427 INFO:tasks.workunit.client.1.smithi153.stdout:3/464: dwrite d4/d7d/d70/f7a [0,4194304] 0 2024-02-28T16:24:39.428 INFO:tasks.workunit.client.1.smithi153.stdout:9/416: dread d1/d5/f59 [0,4194304] 0 2024-02-28T16:24:39.428 INFO:tasks.workunit.client.1.smithi153.stdout:1/459: truncate d0/d3d/d4a/f61 741081 0 2024-02-28T16:24:39.429 INFO:tasks.workunit.client.1.smithi153.stdout:8/461: rename d0/d34/d50 to d0/d12/d67/d88/d8e/d9d 0 2024-02-28T16:24:39.437 INFO:tasks.workunit.client.1.smithi153.stdout:5/485: truncate da/dd/d25/f58 378617 0 2024-02-28T16:24:39.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/500: unlink d2/d19/d2a/d3b/c7c 0 2024-02-28T16:24:39.439 INFO:tasks.workunit.client.1.smithi153.stdout:1/460: mkdir d0/dd/d67/d89/daa 0 2024-02-28T16:24:39.442 INFO:tasks.workunit.client.1.smithi153.stdout:5/486: chown da/dd/d25/f71 6798 1 2024-02-28T16:24:39.442 INFO:tasks.workunit.client.1.smithi153.stdout:2/501: chown d2/l59 250 1 2024-02-28T16:24:39.443 INFO:tasks.workunit.client.1.smithi153.stdout:9/417: creat d1/d5/d11/d1f/d40/f8b x:0 0 0 2024-02-28T16:24:39.445 INFO:tasks.workunit.client.1.smithi153.stdout:1/461: symlink d0/dd/d67/d89/lab 0 2024-02-28T16:24:39.446 INFO:tasks.workunit.client.1.smithi153.stdout:8/462: write d0/d12/d67/d30/f58 [3357285,57387] 0 2024-02-28T16:24:39.449 INFO:tasks.workunit.client.1.smithi153.stdout:5/487: write da/d29/f59 [895382,63960] 0 2024-02-28T16:24:39.450 INFO:tasks.workunit.client.1.smithi153.stdout:6/472: dread d0/d1d/d33/d9c/f9a [0,4194304] 0 2024-02-28T16:24:39.450 INFO:tasks.workunit.client.1.smithi153.stdout:3/465: mkdir d4/d8/d1e/d2a/d55/da3 0 2024-02-28T16:24:39.456 INFO:tasks.workunit.client.1.smithi153.stdout:8/463: write d0/d19/d2b/f6f [5238817,118265] 0 2024-02-28T16:24:39.457 INFO:tasks.workunit.client.1.smithi153.stdout:2/502: truncate d2/d19/d5d/f84 837371 0 2024-02-28T16:24:39.457 INFO:tasks.workunit.client.1.smithi153.stdout:7/503: dwrite d1/d25/df/d26/d3a/d52/f6e [0,4194304] 0 2024-02-28T16:24:39.457 INFO:tasks.workunit.client.1.smithi153.stdout:1/462: rmdir d0/dd/d84 39 2024-02-28T16:24:39.461 INFO:tasks.workunit.client.1.smithi153.stdout:9/418: mkdir d1/d5/d11/d64/d85/d8c 0 2024-02-28T16:24:39.469 INFO:tasks.workunit.client.1.smithi153.stdout:5/488: rename da/f9c to da/dd/d25/d82/d8f/fa9 0 2024-02-28T16:24:39.471 INFO:tasks.workunit.client.1.smithi153.stdout:8/464: creat d0/d34/f9e x:0 0 0 2024-02-28T16:24:39.474 INFO:tasks.workunit.client.1.smithi153.stdout:1/463: symlink d0/d3d/d4a/d59/d9a/lac 0 2024-02-28T16:24:39.474 INFO:tasks.workunit.client.1.smithi153.stdout:8/465: stat d0/d25/d79 0 2024-02-28T16:24:39.476 INFO:tasks.workunit.client.1.smithi153.stdout:8/466: readlink d0/l10 0 2024-02-28T16:24:39.477 INFO:tasks.workunit.client.1.smithi153.stdout:6/473: rename d0/d1d/d33/d9c/f9a to d0/d66/d85/fac 0 2024-02-28T16:24:39.479 INFO:tasks.workunit.client.1.smithi153.stdout:1/464: mkdir d0/dd/d67/d89/dad 0 2024-02-28T16:24:39.481 INFO:tasks.workunit.client.1.smithi153.stdout:0/520: dread d4/f14 [0,4194304] 0 2024-02-28T16:24:39.482 INFO:tasks.workunit.client.1.smithi153.stdout:7/504: creat d1/d25/df/fb1 x:0 0 0 2024-02-28T16:24:39.482 INFO:tasks.workunit.client.1.smithi153.stdout:5/489: rename da/d29/d43/d5a/d9f to da/dd/d25/d82/d8f/daa 0 2024-02-28T16:24:39.483 INFO:tasks.workunit.client.1.smithi153.stdout:8/467: mkdir d0/d19/d2b/d2d/d3f/d9f 0 2024-02-28T16:24:39.485 INFO:tasks.workunit.client.1.smithi153.stdout:2/503: write d2/d25/f3d [267989,109038] 0 2024-02-28T16:24:39.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/466: dwrite d4/d8/d1e/d2a/d35/d54/f82 [0,4194304] 0 2024-02-28T16:24:39.490 INFO:tasks.workunit.client.1.smithi153.stdout:0/521: mkdir d4/d32/d7f/db3 0 2024-02-28T16:24:39.490 INFO:tasks.workunit.client.1.smithi153.stdout:6/474: fdatasync d0/d1d/d33/d9c/d2e/f42 0 2024-02-28T16:24:39.493 INFO:tasks.workunit.client.1.smithi153.stdout:1/465: mknod d0/d62/cae 0 2024-02-28T16:24:39.494 INFO:tasks.workunit.client.1.smithi153.stdout:7/505: fsync d1/d25/df/d26/d3a/f83 0 2024-02-28T16:24:39.494 INFO:tasks.workunit.client.1.smithi153.stdout:6/475: read - d0/d1d/d33/d9c/f7d zero size 2024-02-28T16:24:39.495 INFO:tasks.workunit.client.1.smithi153.stdout:1/466: read - d0/d3d/f64 zero size 2024-02-28T16:24:39.496 INFO:tasks.workunit.client.1.smithi153.stdout:9/419: dwrite d1/d5/d11/d1f/d40/f8b [0,4194304] 0 2024-02-28T16:24:39.500 INFO:tasks.workunit.client.1.smithi153.stdout:1/467: write d0/dd/f5d [61447,10164] 0 2024-02-28T16:24:39.500 INFO:tasks.workunit.client.1.smithi153.stdout:0/522: creat d4/d89/fb4 x:0 0 0 2024-02-28T16:24:39.501 INFO:tasks.workunit.client.1.smithi153.stdout:3/467: rename d4/le to d4/d2c/la4 0 2024-02-28T16:24:39.508 INFO:tasks.workunit.client.1.smithi153.stdout:1/468: stat d0/dd/c33 0 2024-02-28T16:24:39.510 INFO:tasks.workunit.client.1.smithi153.stdout:0/523: readlink d4/d27/d9a/l61 0 2024-02-28T16:24:39.514 INFO:tasks.workunit.client.1.smithi153.stdout:6/476: fdatasync d0/d17/f75 0 2024-02-28T16:24:39.515 INFO:tasks.workunit.client.1.smithi153.stdout:2/504: write d2/d25/d49/f97 [2377859,98808] 0 2024-02-28T16:24:39.515 INFO:tasks.workunit.client.1.smithi153.stdout:8/468: write d0/d19/d89/f90 [581070,128307] 0 2024-02-28T16:24:39.515 INFO:tasks.workunit.client.1.smithi153.stdout:3/468: fsync d4/d8/d1e/f3c 0 2024-02-28T16:24:39.520 INFO:tasks.workunit.client.1.smithi153.stdout:7/506: rename d1/d25/df/d26/d3a/d5e/ca8 to d1/d25/df/d5a/dae/cb2 0 2024-02-28T16:24:39.524 INFO:tasks.workunit.client.1.smithi153.stdout:1/469: fsync d0/d62/d66/d7c/f82 0 2024-02-28T16:24:39.526 INFO:tasks.workunit.client.1.smithi153.stdout:3/469: chown d4/d8/d1e/d23/l25 6264401 1 2024-02-28T16:24:39.526 INFO:tasks.workunit.client.1.smithi153.stdout:6/477: rename d0/d66/f6a to d0/d66/d85/fad 0 2024-02-28T16:24:39.528 INFO:tasks.workunit.client.1.smithi153.stdout:9/420: dwrite d1/f15 [0,4194304] 0 2024-02-28T16:24:39.529 INFO:tasks.workunit.client.1.smithi153.stdout:7/507: truncate d1/d25/fe 1072133 0 2024-02-28T16:24:39.532 INFO:tasks.workunit.client.1.smithi153.stdout:3/470: truncate d4/d8/d1e/d2a/f89 38090 0 2024-02-28T16:24:39.534 INFO:tasks.workunit.client.1.smithi153.stdout:0/524: getdents d4/d27 0 2024-02-28T16:24:39.537 INFO:tasks.workunit.client.1.smithi153.stdout:9/421: write d1/f34 [243938,10696] 0 2024-02-28T16:24:39.539 INFO:tasks.workunit.client.1.smithi153.stdout:6/478: rmdir d0/d1d/d33/d9c/d2e/d99 39 2024-02-28T16:24:39.541 INFO:tasks.workunit.client.1.smithi153.stdout:6/479: readlink d0/d17/la5 0 2024-02-28T16:24:39.545 INFO:tasks.workunit.client.1.smithi153.stdout:9/422: readlink d1/d5/l56 0 2024-02-28T16:24:39.545 INFO:tasks.workunit.client.1.smithi153.stdout:9/423: fdatasync d1/ff 0 2024-02-28T16:24:39.547 INFO:tasks.workunit.client.1.smithi153.stdout:8/469: truncate d0/d19/d2b/f6f 3034537 0 2024-02-28T16:24:39.549 INFO:tasks.workunit.client.1.smithi153.stdout:6/480: write d0/d1d/d33/d9c/d2e/f53 [48633,60669] 0 2024-02-28T16:24:39.550 INFO:tasks.workunit.client.1.smithi153.stdout:1/470: truncate d0/d3d/d4a/d59/f5a 639493 0 2024-02-28T16:24:39.551 INFO:tasks.workunit.client.1.smithi153.stdout:7/508: rename d1/d25/df/d26/d3a/d95/ca0 to d1/d25/df/d26/cb3 0 2024-02-28T16:24:39.551 INFO:tasks.workunit.client.1.smithi153.stdout:4/423: sync 2024-02-28T16:24:39.554 INFO:tasks.workunit.client.1.smithi153.stdout:2/505: dwrite d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:39.555 INFO:tasks.workunit.client.1.smithi153.stdout:8/470: symlink d0/d19/d2b/la0 0 2024-02-28T16:24:39.557 INFO:tasks.workunit.client.1.smithi153.stdout:1/471: fsync d0/dd/d67/d89/f9e 0 2024-02-28T16:24:39.564 INFO:tasks.workunit.client.1.smithi153.stdout:7/509: dread - d1/d25/d27/f9b zero size 2024-02-28T16:24:39.574 INFO:tasks.workunit.client.1.smithi153.stdout:7/510: write d1/d25/df/d5a/f78 [1192544,42617] 0 2024-02-28T16:24:39.574 INFO:tasks.workunit.client.1.smithi153.stdout:3/471: truncate d4/d13/f27 238765 0 2024-02-28T16:24:39.580 INFO:tasks.workunit.client.1.smithi153.stdout:0/525: dwrite d4/d27/f9f [0,4194304] 0 2024-02-28T16:24:39.580 INFO:tasks.workunit.client.1.smithi153.stdout:1/472: creat d0/dd/d67/d89/faf x:0 0 0 2024-02-28T16:24:39.580 INFO:tasks.workunit.client.1.smithi153.stdout:2/506: creat d2/d19/d2a/d3b/d5e/f9c x:0 0 0 2024-02-28T16:24:39.580 INFO:tasks.workunit.client.1.smithi153.stdout:4/424: fsync d4/de/f57 0 2024-02-28T16:24:39.582 INFO:tasks.workunit.client.1.smithi153.stdout:1/473: readlink d0/l52 0 2024-02-28T16:24:39.584 INFO:tasks.workunit.client.1.smithi153.stdout:3/472: read d4/d8/d1e/d23/f24 [623925,75432] 0 2024-02-28T16:24:39.588 INFO:tasks.workunit.client.1.smithi153.stdout:1/474: readlink d0/d62/l79 0 2024-02-28T16:24:39.588 INFO:tasks.workunit.client.1.smithi153.stdout:3/473: chown d4/d8/d1e/d2a/f83 15091831 1 2024-02-28T16:24:39.588 INFO:tasks.workunit.client.1.smithi153.stdout:0/526: dread - d4/d32/d7f/d8a/dab/d8e/d90/fa6 zero size 2024-02-28T16:24:39.590 INFO:tasks.workunit.client.1.smithi153.stdout:4/425: symlink d4/de/d13/d1b/d4e/l8f 0 2024-02-28T16:24:39.593 INFO:tasks.workunit.client.1.smithi153.stdout:3/474: chown d4/d8/d1e/d2a/l30 1 1 2024-02-28T16:24:39.593 INFO:tasks.workunit.client.1.smithi153.stdout:1/475: write d0/d62/f8f [2112094,52389] 0 2024-02-28T16:24:39.594 INFO:tasks.workunit.client.1.smithi153.stdout:7/511: creat d1/d25/df/fb4 x:0 0 0 2024-02-28T16:24:39.594 INFO:tasks.workunit.client.1.smithi153.stdout:8/471: link d0/d12/d67/d30/l3c d0/d12/d67/la1 0 2024-02-28T16:24:39.598 INFO:tasks.workunit.client.1.smithi153.stdout:2/507: mknod d2/d19/d2a/d3b/d87/c9d 0 2024-02-28T16:24:39.606 INFO:tasks.workunit.client.1.smithi153.stdout:4/426: readlink d4/de/d13/d1b/d4e/l7b 0 2024-02-28T16:24:39.608 INFO:tasks.workunit.client.1.smithi153.stdout:5/490: sync 2024-02-28T16:24:39.609 INFO:tasks.workunit.client.1.smithi153.stdout:2/508: write d2/d19/d2a/d3b/d5e/f6c [109939,5862] 0 2024-02-28T16:24:39.611 INFO:tasks.workunit.client.1.smithi153.stdout:7/512: chown d1/d25/df/fb1 3 1 2024-02-28T16:24:39.611 INFO:tasks.workunit.client.1.smithi153.stdout:1/476: creat d0/dd/d67/fb0 x:0 0 0 2024-02-28T16:24:39.612 INFO:tasks.workunit.client.1.smithi153.stdout:3/475: read d4/d8/d1e/f3c [695225,37745] 0 2024-02-28T16:24:39.613 INFO:tasks.workunit.client.1.smithi153.stdout:8/472: creat d0/d19/d89/fa2 x:0 0 0 2024-02-28T16:24:39.615 INFO:tasks.workunit.client.1.smithi153.stdout:4/427: dread - d4/de/d23/d2b/d4b/f87 zero size 2024-02-28T16:24:39.616 INFO:tasks.workunit.client.1.smithi153.stdout:9/424: dwrite d1/d5/d27/d61/f18 [0,4194304] 0 2024-02-28T16:24:39.617 INFO:tasks.workunit.client.1.smithi153.stdout:3/476: write d4/f17 [2979585,52400] 0 2024-02-28T16:24:39.632 INFO:tasks.workunit.client.1.smithi153.stdout:5/491: unlink da/dd/ff 0 2024-02-28T16:24:39.633 INFO:tasks.workunit.client.1.smithi153.stdout:6/481: dread d0/d1d/d33/d9c/f86 [0,4194304] 0 2024-02-28T16:24:39.635 INFO:tasks.workunit.client.1.smithi153.stdout:9/425: stat d1/d5/l7 0 2024-02-28T16:24:39.638 INFO:tasks.workunit.client.1.smithi153.stdout:0/527: dread d4/fe [0,4194304] 0 2024-02-28T16:24:39.639 INFO:tasks.workunit.client.1.smithi153.stdout:3/477: symlink d4/d8/d1e/d2a/d35/d54/la5 0 2024-02-28T16:24:39.643 INFO:tasks.workunit.client.1.smithi153.stdout:3/478: fsync d4/d49/f9a 0 2024-02-28T16:24:39.644 INFO:tasks.workunit.client.1.smithi153.stdout:7/513: truncate d1/d25/dc/d50/d66/f86 3550324 0 2024-02-28T16:24:39.644 INFO:tasks.workunit.client.1.smithi153.stdout:9/426: rmdir d1/d5/d11/d1f/d52 39 2024-02-28T16:24:39.646 INFO:tasks.workunit.client.1.smithi153.stdout:2/509: link d2/lb d2/d25/d49/l9e 0 2024-02-28T16:24:39.646 INFO:tasks.workunit.client.1.smithi153.stdout:7/514: dread - d1/f82 zero size 2024-02-28T16:24:39.648 INFO:tasks.workunit.client.1.smithi153.stdout:0/528: creat d4/d27/d9a/fb5 x:0 0 0 2024-02-28T16:24:39.651 INFO:tasks.workunit.client.1.smithi153.stdout:8/473: getdents d0/d12/d67/d30/d63 0 2024-02-28T16:24:39.652 INFO:tasks.workunit.client.1.smithi153.stdout:9/427: read d1/f4e [36166,19693] 0 2024-02-28T16:24:39.653 INFO:tasks.workunit.client.1.smithi153.stdout:3/479: creat d4/d7d/d41/d71/fa6 x:0 0 0 2024-02-28T16:24:39.654 INFO:tasks.workunit.client.1.smithi153.stdout:1/477: dwrite d0/dd/f21 [0,4194304] 0 2024-02-28T16:24:39.657 INFO:tasks.workunit.client.1.smithi153.stdout:4/428: getdents d4/de/d23/d83 0 2024-02-28T16:24:39.664 INFO:tasks.workunit.client.1.smithi153.stdout:4/429: fdatasync d4/de/d47/f67 0 2024-02-28T16:24:39.664 INFO:tasks.workunit.client.1.smithi153.stdout:9/428: dread - d1/d5/d11/d1f/d20/f49 zero size 2024-02-28T16:24:39.669 INFO:tasks.workunit.client.1.smithi153.stdout:7/515: fdatasync d1/d25/dc/d50/d66/f86 0 2024-02-28T16:24:39.670 INFO:tasks.workunit.client.1.smithi153.stdout:1/478: write d0/d3d/f87 [129993,29091] 0 2024-02-28T16:24:39.673 INFO:tasks.workunit.client.1.smithi153.stdout:4/430: fdatasync d4/de/d13/f18 0 2024-02-28T16:24:39.677 INFO:tasks.workunit.client.1.smithi153.stdout:5/492: dwrite da/dd/d25/d41/d7c/f84 [0,4194304] 0 2024-02-28T16:24:39.679 INFO:tasks.workunit.client.1.smithi153.stdout:6/482: dwrite d0/d66/d85/fad [0,4194304] 0 2024-02-28T16:24:39.679 INFO:tasks.workunit.client.1.smithi153.stdout:0/529: dread d4/d32/d7f/d8a/dab/f1f [0,4194304] 0 2024-02-28T16:24:39.687 INFO:tasks.workunit.client.1.smithi153.stdout:6/483: readlink d0/d1d/l54 0 2024-02-28T16:24:39.688 INFO:tasks.workunit.client.1.smithi153.stdout:1/479: unlink d0/d3d/f6d 0 2024-02-28T16:24:39.693 INFO:tasks.workunit.client.1.smithi153.stdout:4/431: truncate d4/f5 877809 0 2024-02-28T16:24:39.696 INFO:tasks.workunit.client.1.smithi153.stdout:6/484: chown d0/c40 546726707 1 2024-02-28T16:24:39.696 INFO:tasks.workunit.client.1.smithi153.stdout:9/429: rename d1/d5/d11/d1f/d20/d45/f53 to d1/d5/d11/d1f/d20/f8d 0 2024-02-28T16:24:39.698 INFO:tasks.workunit.client.1.smithi153.stdout:2/510: dwrite d2/d19/d8b/f90 [0,4194304] 0 2024-02-28T16:24:39.700 INFO:tasks.workunit.client.1.smithi153.stdout:3/480: dwrite d4/f17 [0,4194304] 0 2024-02-28T16:24:39.700 INFO:tasks.workunit.client.1.smithi153.stdout:5/493: creat da/dd/d25/fab x:0 0 0 2024-02-28T16:24:39.704 INFO:tasks.workunit.client.1.smithi153.stdout:1/480: symlink d0/d3d/d4a/d59/d9a/lb1 0 2024-02-28T16:24:39.707 INFO:tasks.workunit.client.1.smithi153.stdout:7/516: write d1/f23 [3233555,3268] 0 2024-02-28T16:24:39.711 INFO:tasks.workunit.client.1.smithi153.stdout:8/474: dwrite d0/d19/d2b/d2d/f70 [0,4194304] 0 2024-02-28T16:24:39.718 INFO:tasks.workunit.client.1.smithi153.stdout:4/432: symlink d4/d8d/l90 0 2024-02-28T16:24:39.722 INFO:tasks.workunit.client.1.smithi153.stdout:3/481: chown d4/d8/d1e/d2a/d55/f92 425881847 1 2024-02-28T16:24:39.722 INFO:tasks.workunit.client.1.smithi153.stdout:2/511: creat d2/d19/d8b/f9f x:0 0 0 2024-02-28T16:24:39.724 INFO:tasks.workunit.client.1.smithi153.stdout:6/485: mknod d0/d1d/d33/d9c/d68/da2/cae 0 2024-02-28T16:24:39.728 INFO:tasks.workunit.client.1.smithi153.stdout:5/494: mkdir da/dd/d25/d8a/dac 0 2024-02-28T16:24:39.733 INFO:tasks.workunit.client.1.smithi153.stdout:8/475: symlink d0/d12/d67/d88/d8e/la3 0 2024-02-28T16:24:39.733 INFO:tasks.workunit.client.1.smithi153.stdout:5/495: readlink da/dd/d54/l7a 0 2024-02-28T16:24:39.734 INFO:tasks.workunit.client.1.smithi153.stdout:7/517: mkdir d1/d25/d27/d7c/db5 0 2024-02-28T16:24:39.738 INFO:tasks.workunit.client.1.smithi153.stdout:2/512: truncate d2/d19/d31/f58 1001293 0 2024-02-28T16:24:39.739 INFO:tasks.workunit.client.1.smithi153.stdout:3/482: symlink d4/la7 0 2024-02-28T16:24:39.744 INFO:tasks.workunit.client.1.smithi153.stdout:1/481: dwrite d0/d3d/d4a/f7b [0,4194304] 0 2024-02-28T16:24:39.744 INFO:tasks.workunit.client.1.smithi153.stdout:0/530: link d4/d32/d7f/d8a/dab/d8e/d90/f18 d4/d32/d7f/d8a/fb6 0 2024-02-28T16:24:39.745 INFO:tasks.workunit.client.1.smithi153.stdout:6/486: chown d0/d1d/d33/d9c/d48/l50 17848 1 2024-02-28T16:24:39.745 INFO:tasks.workunit.client.1.smithi153.stdout:7/518: write d1/d25/df/f8f [637934,8197] 0 2024-02-28T16:24:39.752 INFO:tasks.workunit.client.1.smithi153.stdout:1/482: truncate d0/dd/d67/fa2 487898 0 2024-02-28T16:24:39.754 INFO:tasks.workunit.client.1.smithi153.stdout:3/483: unlink d4/f18 0 2024-02-28T16:24:39.754 INFO:tasks.workunit.client.1.smithi153.stdout:9/430: write d1/d5/d11/d1f/d43/f4d [2029058,115680] 0 2024-02-28T16:24:39.759 INFO:tasks.workunit.client.1.smithi153.stdout:3/484: read - d4/d2c/f4e zero size 2024-02-28T16:24:39.760 INFO:tasks.workunit.client.1.smithi153.stdout:9/431: dread - d1/d5/d11/d64/f87 zero size 2024-02-28T16:24:39.761 INFO:tasks.workunit.client.1.smithi153.stdout:3/485: chown d4/f1f 1907 1 2024-02-28T16:24:39.767 INFO:tasks.workunit.client.1.smithi153.stdout:3/486: write d4/d13/f67 [591940,37426] 0 2024-02-28T16:24:39.769 INFO:tasks.workunit.client.1.smithi153.stdout:6/487: rename d0/d1d/d33/d9c/d48/d72/f97 to d0/d1d/d33/faf 0 2024-02-28T16:24:39.771 INFO:tasks.workunit.client.1.smithi153.stdout:7/519: rmdir d1/d25 39 2024-02-28T16:24:39.773 INFO:tasks.workunit.client.1.smithi153.stdout:0/531: rmdir d4/d32/d7f 39 2024-02-28T16:24:39.774 INFO:tasks.workunit.client.1.smithi153.stdout:8/476: dwrite d0/d25/f6b [0,4194304] 0 2024-02-28T16:24:39.776 INFO:tasks.workunit.client.1.smithi153.stdout:8/477: dread - d0/d34/f8f zero size 2024-02-28T16:24:39.781 INFO:tasks.workunit.client.1.smithi153.stdout:4/433: link d4/de/d13/d1b/l4f d4/de/d13/d1b/l91 0 2024-02-28T16:24:39.788 INFO:tasks.workunit.client.1.smithi153.stdout:5/496: truncate da/f19 2198255 0 2024-02-28T16:24:39.792 INFO:tasks.workunit.client.1.smithi153.stdout:9/432: link d1/d5/d27/d61/f63 d1/d5/d27/f8e 0 2024-02-28T16:24:39.794 INFO:tasks.workunit.client.1.smithi153.stdout:2/513: dread d2/d19/d2a/f45 [0,4194304] 0 2024-02-28T16:24:39.795 INFO:tasks.workunit.client.1.smithi153.stdout:5/497: write da/dd/f65 [995880,49308] 0 2024-02-28T16:24:39.796 INFO:tasks.workunit.client.1.smithi153.stdout:1/483: rename d0/dd/d67 to d0/dd/db2 0 2024-02-28T16:24:39.797 INFO:tasks.workunit.client.1.smithi153.stdout:4/434: write d4/f10 [2011244,77874] 0 2024-02-28T16:24:39.797 INFO:tasks.workunit.client.1.smithi153.stdout:0/532: mkdir d4/d32/db7 0 2024-02-28T16:24:39.802 INFO:tasks.workunit.client.1.smithi153.stdout:0/533: readlink d4/d27/l95 0 2024-02-28T16:24:39.803 INFO:tasks.workunit.client.1.smithi153.stdout:6/488: symlink d0/d1d/d33/d9c/d2e/d99/lb0 0 2024-02-28T16:24:39.809 INFO:tasks.workunit.client.1.smithi153.stdout:5/498: rename da/dd/d25/f71 to da/dd/d25/d82/fad 0 2024-02-28T16:24:39.811 INFO:tasks.workunit.client.1.smithi153.stdout:0/534: mknod d4/d99/cb8 0 2024-02-28T16:24:39.814 INFO:tasks.workunit.client.1.smithi153.stdout:1/484: mknod d0/dd/d84/cb3 0 2024-02-28T16:24:39.814 INFO:tasks.workunit.client.1.smithi153.stdout:5/499: read da/f51 [2622176,62903] 0 2024-02-28T16:24:39.814 INFO:tasks.workunit.client.1.smithi153.stdout:3/487: dwrite d4/d7d/f8c [4194304,4194304] 0 2024-02-28T16:24:39.818 INFO:tasks.workunit.client.1.smithi153.stdout:7/520: dwrite d1/d25/fa5 [0,4194304] 0 2024-02-28T16:24:39.833 INFO:tasks.workunit.client.1.smithi153.stdout:3/488: chown d4/d8/d1e/d63 5 1 2024-02-28T16:24:39.834 INFO:tasks.workunit.client.1.smithi153.stdout:2/514: dwrite d2/f7d [0,4194304] 0 2024-02-28T16:24:39.835 INFO:tasks.workunit.client.1.smithi153.stdout:6/489: write d0/d1d/d30/f58 [920684,84796] 0 2024-02-28T16:24:39.846 INFO:tasks.workunit.client.1.smithi153.stdout:6/490: chown d0/d1d/d33/faf 21159825 1 2024-02-28T16:24:39.846 INFO:tasks.workunit.client.1.smithi153.stdout:9/433: truncate d1/d5/d11/d1f/d20/d45/f4a 1406890 0 2024-02-28T16:24:39.849 INFO:tasks.workunit.client.1.smithi153.stdout:1/485: creat d0/dd/db2/d89/daa/fb4 x:0 0 0 2024-02-28T16:24:39.850 INFO:tasks.workunit.client.1.smithi153.stdout:4/435: dwrite d4/de/d40/d4d/f82 [0,4194304] 0 2024-02-28T16:24:39.850 INFO:tasks.workunit.client.1.smithi153.stdout:6/491: dread - d0/d1d/d33/d9c/f7d zero size 2024-02-28T16:24:39.855 INFO:tasks.workunit.client.1.smithi153.stdout:0/535: dwrite d4/d27/f85 [0,4194304] 0 2024-02-28T16:24:39.867 INFO:tasks.workunit.client.1.smithi153.stdout:3/489: creat d4/d8/d1e/fa8 x:0 0 0 2024-02-28T16:24:39.871 INFO:tasks.workunit.client.1.smithi153.stdout:2/515: dwrite d2/d19/d31/f6a [0,4194304] 0 2024-02-28T16:24:39.871 INFO:tasks.workunit.client.1.smithi153.stdout:1/486: mknod d0/dd/db2/cb5 0 2024-02-28T16:24:39.872 INFO:tasks.workunit.client.1.smithi153.stdout:1/487: fsync d0/d3d/f4f 0 2024-02-28T16:24:39.879 INFO:tasks.workunit.client.1.smithi153.stdout:1/488: readlink d0/d3d/l54 0 2024-02-28T16:24:39.881 INFO:tasks.workunit.client.1.smithi153.stdout:6/492: creat d0/d1d/d30/d71/d91/fb1 x:0 0 0 2024-02-28T16:24:39.882 INFO:tasks.workunit.client.1.smithi153.stdout:5/500: dwrite da/dd/f3d [0,4194304] 0 2024-02-28T16:24:39.883 INFO:tasks.workunit.client.1.smithi153.stdout:6/493: readlink d0/d17/la5 0 2024-02-28T16:24:39.885 INFO:tasks.workunit.client.1.smithi153.stdout:7/521: dread d1/d25/fe [0,4194304] 0 2024-02-28T16:24:39.885 INFO:tasks.workunit.client.1.smithi153.stdout:2/516: mkdir d2/d86/da0 0 2024-02-28T16:24:39.886 INFO:tasks.workunit.client.1.smithi153.stdout:3/490: symlink d4/la9 0 2024-02-28T16:24:39.888 INFO:tasks.workunit.client.1.smithi153.stdout:6/494: write d0/f18 [2065878,34559] 0 2024-02-28T16:24:39.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/489: read d0/d3d/d4a/f61 [579750,63914] 0 2024-02-28T16:24:39.890 INFO:tasks.workunit.client.1.smithi153.stdout:0/536: creat d4/fb9 x:0 0 0 2024-02-28T16:24:39.892 INFO:tasks.workunit.client.1.smithi153.stdout:8/478: sync 2024-02-28T16:24:39.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/434: dread d1/d5/d27/d61/f3d [0,4194304] 0 2024-02-28T16:24:39.895 INFO:tasks.workunit.client.1.smithi153.stdout:8/479: chown d0/d19 13276 1 2024-02-28T16:24:39.898 INFO:tasks.workunit.client.1.smithi153.stdout:5/501: creat da/dd/d25/d8a/fae x:0 0 0 2024-02-28T16:24:39.898 INFO:tasks.workunit.client.1.smithi153.stdout:1/490: read d0/d3d/f3e [3254105,64908] 0 2024-02-28T16:24:39.909 INFO:tasks.workunit.client.1.smithi153.stdout:0/537: creat d4/d32/fba x:0 0 0 2024-02-28T16:24:39.910 INFO:tasks.workunit.client.1.smithi153.stdout:1/491: creat d0/dd/db2/fb6 x:0 0 0 2024-02-28T16:24:39.911 INFO:tasks.workunit.client.1.smithi153.stdout:0/538: readlink d4/d27/d9a/l61 0 2024-02-28T16:24:39.911 INFO:tasks.workunit.client.1.smithi153.stdout:7/522: dwrite d1/d25/d27/f4d [0,4194304] 0 2024-02-28T16:24:39.915 INFO:tasks.workunit.client.1.smithi153.stdout:1/492: fdatasync d0/f16 0 2024-02-28T16:24:39.917 INFO:tasks.workunit.client.1.smithi153.stdout:8/480: dread d0/d19/d2b/f54 [0,4194304] 0 2024-02-28T16:24:39.923 INFO:tasks.workunit.client.1.smithi153.stdout:8/481: write d0/d34/f3d [798125,103287] 0 2024-02-28T16:24:39.927 INFO:tasks.workunit.client.1.smithi153.stdout:4/436: dread d4/d3c/f42 [0,4194304] 0 2024-02-28T16:24:39.928 INFO:tasks.workunit.client.1.smithi153.stdout:3/491: dwrite d4/d8/d1e/d63/f80 [0,4194304] 0 2024-02-28T16:24:39.932 INFO:tasks.workunit.client.1.smithi153.stdout:9/435: truncate d1/f34 4417675 0 2024-02-28T16:24:39.938 INFO:tasks.workunit.client.1.smithi153.stdout:2/517: dwrite d2/f21 [0,4194304] 0 2024-02-28T16:24:39.940 INFO:tasks.workunit.client.1.smithi153.stdout:8/482: rmdir d0/d34 39 2024-02-28T16:24:39.945 INFO:tasks.workunit.client.1.smithi153.stdout:4/437: mknod d4/de/d40/d4d/c92 0 2024-02-28T16:24:39.947 INFO:tasks.workunit.client.1.smithi153.stdout:4/438: dread - d4/de/f6c zero size 2024-02-28T16:24:39.947 INFO:tasks.workunit.client.1.smithi153.stdout:6/495: dread d0/d1d/d5d/d6b/da4/f26 [0,4194304] 0 2024-02-28T16:24:39.952 INFO:tasks.workunit.client.1.smithi153.stdout:5/502: getdents da/dd/d54 0 2024-02-28T16:24:39.953 INFO:tasks.workunit.client.1.smithi153.stdout:4/439: readlink d4/de/d13/d1b/d4e/l8f 0 2024-02-28T16:24:39.954 INFO:tasks.workunit.client.1.smithi153.stdout:1/493: symlink d0/dd/db2/d89/dad/lb7 0 2024-02-28T16:24:39.955 INFO:tasks.workunit.client.1.smithi153.stdout:1/494: readlink d0/l31 0 2024-02-28T16:24:39.958 INFO:tasks.workunit.client.1.smithi153.stdout:2/518: rmdir d2/d25/d49 39 2024-02-28T16:24:39.961 INFO:tasks.workunit.client.1.smithi153.stdout:3/492: link d4/f17 d4/d6a/faa 0 2024-02-28T16:24:39.963 INFO:tasks.workunit.client.1.smithi153.stdout:0/539: rename d4/d27/d9a/c5d to d4/d32/d7f/cbb 0 2024-02-28T16:24:39.965 INFO:tasks.workunit.client.1.smithi153.stdout:8/483: creat d0/d12/d67/d88/fa4 x:0 0 0 2024-02-28T16:24:39.967 INFO:tasks.workunit.client.1.smithi153.stdout:5/503: readlink da/dd/d25/d82/d8f/daa/la6 0 2024-02-28T16:24:39.970 INFO:tasks.workunit.client.1.smithi153.stdout:4/440: chown d4/f5 315026988 1 2024-02-28T16:24:39.971 INFO:tasks.workunit.client.1.smithi153.stdout:7/523: getdents d1/d25/df/d26/d3a/d95 0 2024-02-28T16:24:39.974 INFO:tasks.workunit.client.1.smithi153.stdout:5/504: write da/dd/d25/f57 [408371,58038] 0 2024-02-28T16:24:39.976 INFO:tasks.workunit.client.1.smithi153.stdout:3/493: dread d4/f66 [0,4194304] 0 2024-02-28T16:24:39.977 INFO:tasks.workunit.client.1.smithi153.stdout:9/436: dwrite d1/d5/f59 [0,4194304] 0 2024-02-28T16:24:39.981 INFO:tasks.workunit.client.1.smithi153.stdout:4/441: chown d4/de/d13/d1b/d4e/d50 6305469 1 2024-02-28T16:24:39.982 INFO:tasks.workunit.client.1.smithi153.stdout:8/484: mkdir d0/da5 0 2024-02-28T16:24:39.982 INFO:tasks.workunit.client.1.smithi153.stdout:7/524: read d1/d25/df/d5a/f78 [714996,42340] 0 2024-02-28T16:24:39.986 INFO:tasks.workunit.client.1.smithi153.stdout:5/505: chown da/l80 26403575 1 2024-02-28T16:24:39.987 INFO:tasks.workunit.client.1.smithi153.stdout:2/519: dread d2/f7d [0,4194304] 0 2024-02-28T16:24:39.989 INFO:tasks.workunit.client.1.smithi153.stdout:4/442: write d4/de/f19 [3348673,116596] 0 2024-02-28T16:24:39.991 INFO:tasks.workunit.client.1.smithi153.stdout:5/506: write da/dd/d25/d8a/fae [618686,59629] 0 2024-02-28T16:24:39.992 INFO:tasks.workunit.client.1.smithi153.stdout:1/495: getdents d0/dd 0 2024-02-28T16:24:39.994 INFO:tasks.workunit.client.1.smithi153.stdout:8/485: read d0/d12/d67/d30/d63/f9a [55320,67883] 0 2024-02-28T16:24:39.994 INFO:tasks.workunit.client.1.smithi153.stdout:4/443: write d4/f10 [252378,124520] 0 2024-02-28T16:24:39.998 INFO:tasks.workunit.client.1.smithi153.stdout:7/525: creat d1/d25/df/d26/d3a/d95/fb6 x:0 0 0 2024-02-28T16:24:40.005 INFO:tasks.workunit.client.1.smithi153.stdout:3/494: dwrite d4/f7 [0,4194304] 0 2024-02-28T16:24:40.010 INFO:tasks.workunit.client.1.smithi153.stdout:9/437: link d1/d2a/c88 d1/d58/c8f 0 2024-02-28T16:24:40.013 INFO:tasks.workunit.client.1.smithi153.stdout:8/486: mknod d0/da5/ca6 0 2024-02-28T16:24:40.020 INFO:tasks.workunit.client.1.smithi153.stdout:6/496: dread d0/d1d/d33/d9c/d2e/f37 [0,4194304] 0 2024-02-28T16:24:40.025 INFO:tasks.workunit.client.1.smithi153.stdout:4/444: truncate d4/de/d23/f3a 3415887 0 2024-02-28T16:24:40.029 INFO:tasks.workunit.client.1.smithi153.stdout:0/540: write d4/d32/d7f/f86 [1312869,123348] 0 2024-02-28T16:24:40.040 INFO:tasks.workunit.client.1.smithi153.stdout:9/438: getdents d1/d5/d11/d1f/d20 0 2024-02-28T16:24:40.045 INFO:tasks.workunit.client.1.smithi153.stdout:7/526: dwrite d1/d25/df/d26/f92 [0,4194304] 0 2024-02-28T16:24:40.048 INFO:tasks.workunit.client.1.smithi153.stdout:8/487: link d0/d12/d67/d88/d8e/d9d/l5b d0/la7 0 2024-02-28T16:24:40.049 INFO:tasks.workunit.client.1.smithi153.stdout:3/495: dwrite d4/d13/f1d [0,4194304] 0 2024-02-28T16:24:40.049 INFO:tasks.workunit.client.1.smithi153.stdout:4/445: creat d4/de/d13/d1b/d4e/d50/f93 x:0 0 0 2024-02-28T16:24:40.059 INFO:tasks.workunit.client.1.smithi153.stdout:3/496: chown d4/d8/d1e/f58 3448921 1 2024-02-28T16:24:40.060 INFO:tasks.workunit.client.1.smithi153.stdout:6/497: truncate d0/d1d/d33/d9c/d2e/f5b 2319568 0 2024-02-28T16:24:40.063 INFO:tasks.workunit.client.1.smithi153.stdout:1/496: dwrite d0/fe [4194304,4194304] 0 2024-02-28T16:24:40.065 INFO:tasks.workunit.client.1.smithi153.stdout:7/527: unlink d1/d25/dc/d50/d66/f86 0 2024-02-28T16:24:40.066 INFO:tasks.workunit.client.1.smithi153.stdout:8/488: creat d0/d12/d15/fa8 x:0 0 0 2024-02-28T16:24:40.076 INFO:tasks.workunit.client.1.smithi153.stdout:1/497: write d0/d62/d66/d8e/f97 [189358,50567] 0 2024-02-28T16:24:40.080 INFO:tasks.workunit.client.1.smithi153.stdout:0/541: dwrite d4/d32/d7f/d8a/dab/f7e [0,4194304] 0 2024-02-28T16:24:40.085 INFO:tasks.workunit.client.1.smithi153.stdout:8/489: symlink d0/d12/d67/d88/la9 0 2024-02-28T16:24:40.088 INFO:tasks.workunit.client.1.smithi153.stdout:7/528: creat d1/d25/df/d26/d3a/d95/d97/fb7 x:0 0 0 2024-02-28T16:24:40.088 INFO:tasks.workunit.client.1.smithi153.stdout:3/497: getdents d4/d7d/d70 0 2024-02-28T16:24:40.092 INFO:tasks.workunit.client.1.smithi153.stdout:1/498: creat d0/dd/db2/d89/dad/fb8 x:0 0 0 2024-02-28T16:24:40.097 INFO:tasks.workunit.client.1.smithi153.stdout:8/490: rmdir d0/d19/d2b/d2d 39 2024-02-28T16:24:40.111 INFO:tasks.workunit.client.1.smithi153.stdout:8/491: unlink d0/d12/d15/f36 0 2024-02-28T16:24:40.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/498: dwrite d0/d1d/d30/f6e [0,4194304] 0 2024-02-28T16:24:40.116 INFO:tasks.workunit.client.1.smithi153.stdout:3/498: rename d4/d7d/d41/l5d to d4/d8/d1e/d2a/lab 0 2024-02-28T16:24:40.120 INFO:tasks.workunit.client.1.smithi153.stdout:8/492: chown d0/d34/l37 29511 1 2024-02-28T16:24:40.122 INFO:tasks.workunit.client.1.smithi153.stdout:3/499: read - d4/d7d/d41/d71/fa6 zero size 2024-02-28T16:24:40.130 INFO:tasks.workunit.client.1.smithi153.stdout:2/520: dread d2/d19/d3e/f65 [0,4194304] 0 2024-02-28T16:24:40.131 INFO:tasks.workunit.client.1.smithi153.stdout:3/500: write d4/d8/d1e/d2a/f89 [338152,8507] 0 2024-02-28T16:24:40.132 INFO:tasks.workunit.client.1.smithi153.stdout:8/493: chown d0/d19/d2b/f6f 103583412 1 2024-02-28T16:24:40.136 INFO:tasks.workunit.client.1.smithi153.stdout:3/501: truncate d4/d2c/f9e 977075 0 2024-02-28T16:24:40.138 INFO:tasks.workunit.client.1.smithi153.stdout:0/542: dwrite d4/d27/d9a/da1/f7a [0,4194304] 0 2024-02-28T16:24:40.147 INFO:tasks.workunit.client.1.smithi153.stdout:0/543: dread - d4/f3c zero size 2024-02-28T16:24:40.149 INFO:tasks.workunit.client.1.smithi153.stdout:4/446: sync 2024-02-28T16:24:40.154 INFO:tasks.workunit.client.1.smithi153.stdout:5/507: dread da/dd/f47 [4194304,4194304] 0 2024-02-28T16:24:40.158 INFO:tasks.workunit.client.1.smithi153.stdout:9/439: dread d1/d5/d11/d1f/d43/f4d [0,4194304] 0 2024-02-28T16:24:40.158 INFO:tasks.workunit.client.1.smithi153.stdout:1/499: dread d0/f16 [0,4194304] 0 2024-02-28T16:24:40.159 INFO:tasks.workunit.client.1.smithi153.stdout:1/500: chown d0/f40 234222679 1 2024-02-28T16:24:40.160 INFO:tasks.workunit.client.1.smithi153.stdout:4/447: creat d4/de/d40/d4d/f94 x:0 0 0 2024-02-28T16:24:40.161 INFO:tasks.workunit.client.1.smithi153.stdout:1/501: fdatasync d0/d62/d66/d8e/fa5 0 2024-02-28T16:24:40.173 INFO:tasks.workunit.client.1.smithi153.stdout:4/448: mknod d4/de/d23/c95 0 2024-02-28T16:24:40.174 INFO:tasks.workunit.client.1.smithi153.stdout:9/440: truncate d1/d5/d27/f8e 477171 0 2024-02-28T16:24:40.174 INFO:tasks.workunit.client.1.smithi153.stdout:7/529: write d1/d25/df/f61 [80967,39407] 0 2024-02-28T16:24:40.175 INFO:tasks.workunit.client.1.smithi153.stdout:1/502: creat d0/dd/db2/d89/daa/fb9 x:0 0 0 2024-02-28T16:24:40.182 INFO:tasks.workunit.client.1.smithi153.stdout:6/499: truncate d0/d66/d85/fad 4968295 0 2024-02-28T16:24:40.193 INFO:tasks.workunit.client.1.smithi153.stdout:2/521: dwrite d2/d19/d2a/f30 [0,4194304] 0 2024-02-28T16:24:40.196 INFO:tasks.workunit.client.1.smithi153.stdout:6/500: dread d0/d1d/d5d/d6b/da4/d60/f67 [0,4194304] 0 2024-02-28T16:24:40.198 INFO:tasks.workunit.client.1.smithi153.stdout:6/501: truncate d0/f81 167786 0 2024-02-28T16:24:40.206 INFO:tasks.workunit.client.1.smithi153.stdout:1/503: creat d0/d62/d66/fba x:0 0 0 2024-02-28T16:24:40.210 INFO:tasks.workunit.client.1.smithi153.stdout:2/522: creat d2/d19/d3e/fa1 x:0 0 0 2024-02-28T16:24:40.212 INFO:tasks.workunit.client.1.smithi153.stdout:2/523: chown d2/d19/d2a/d99 2563 1 2024-02-28T16:24:40.213 INFO:tasks.workunit.client.1.smithi153.stdout:1/504: dread d0/dd/f49 [0,4194304] 0 2024-02-28T16:24:40.219 INFO:tasks.workunit.client.1.smithi153.stdout:2/524: creat d2/d19/d2a/d3b/d87/fa2 x:0 0 0 2024-02-28T16:24:40.224 INFO:tasks.workunit.client.1.smithi153.stdout:6/502: dwrite d0/d1d/d30/d71/f7f [0,4194304] 0 2024-02-28T16:24:40.228 INFO:tasks.workunit.client.1.smithi153.stdout:9/441: rename d1/d74/l8a to d1/d5/d11/d1f/l90 0 2024-02-28T16:24:40.230 INFO:tasks.workunit.client.1.smithi153.stdout:6/503: dread d0/d1d/d33/d9c/d68/f6f [0,4194304] 0 2024-02-28T16:24:40.231 INFO:tasks.workunit.client.1.smithi153.stdout:7/530: write d1/d25/dc/d50/f65 [1423498,33816] 0 2024-02-28T16:24:40.233 INFO:tasks.workunit.client.1.smithi153.stdout:6/504: write d0/d1d/d30/f36 [1339149,79756] 0 2024-02-28T16:24:40.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/531: write d1/d25/df/d26/f57 [825632,98977] 0 2024-02-28T16:24:40.235 INFO:tasks.workunit.client.1.smithi153.stdout:9/442: mknod d1/d5/d11/d1f/d20/d5d/c91 0 2024-02-28T16:24:40.237 INFO:tasks.workunit.client.1.smithi153.stdout:4/449: truncate d4/de/f60 222790 0 2024-02-28T16:24:40.240 INFO:tasks.workunit.client.1.smithi153.stdout:9/443: read d1/d5/d27/d61/f3d [680610,50867] 0 2024-02-28T16:24:40.241 INFO:tasks.workunit.client.1.smithi153.stdout:2/525: mkdir d2/d25/d49/da3 0 2024-02-28T16:24:40.241 INFO:tasks.workunit.client.1.smithi153.stdout:7/532: read d1/f6c [719945,120613] 0 2024-02-28T16:24:40.242 INFO:tasks.workunit.client.1.smithi153.stdout:4/450: rmdir d4/de/d47 39 2024-02-28T16:24:40.244 INFO:tasks.workunit.client.1.smithi153.stdout:1/505: getdents d0/d62/d66/d8e 0 2024-02-28T16:24:40.245 INFO:tasks.workunit.client.1.smithi153.stdout:2/526: write d2/d19/d8b/f90 [2845734,62048] 0 2024-02-28T16:24:40.247 INFO:tasks.workunit.client.1.smithi153.stdout:7/533: chown d1/d25/df/d60/da4 555 1 2024-02-28T16:24:40.249 INFO:tasks.workunit.client.1.smithi153.stdout:4/451: creat d4/de/d23/d2b/d31/f96 x:0 0 0 2024-02-28T16:24:40.250 INFO:tasks.workunit.client.1.smithi153.stdout:9/444: link d1/d5/d27/d61/l22 d1/d58/l92 0 2024-02-28T16:24:40.250 INFO:tasks.workunit.client.1.smithi153.stdout:1/506: mknod d0/d62/d66/d8e/cbb 0 2024-02-28T16:24:40.254 INFO:tasks.workunit.client.1.smithi153.stdout:9/445: chown d1/d5/l56 619304 1 2024-02-28T16:24:40.257 INFO:tasks.workunit.client.1.smithi153.stdout:4/452: fdatasync d4/de/d23/d2b/d31/f34 0 2024-02-28T16:24:40.258 INFO:tasks.workunit.client.1.smithi153.stdout:6/505: dwrite d0/d1d/d30/f36 [0,4194304] 0 2024-02-28T16:24:40.266 INFO:tasks.workunit.client.1.smithi153.stdout:6/506: fsync d0/d1d/d33/d8d/fa8 0 2024-02-28T16:24:40.275 INFO:tasks.workunit.client.1.smithi153.stdout:6/507: write d0/d1d/d34/f77 [647070,92040] 0 2024-02-28T16:24:40.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/527: dwrite d2/d19/d3e/fa1 [0,4194304] 0 2024-02-28T16:24:40.281 INFO:tasks.workunit.client.1.smithi153.stdout:2/528: read - d2/d19/d2a/d3b/d5e/f9c zero size 2024-02-28T16:24:40.284 INFO:tasks.workunit.client.1.smithi153.stdout:1/507: dwrite d0/dd/d84/fa4 [0,4194304] 0 2024-02-28T16:24:40.289 INFO:tasks.workunit.client.1.smithi153.stdout:6/508: dread - d0/d1d/d33/d9c/d48/d72/f76 zero size 2024-02-28T16:24:40.292 INFO:tasks.workunit.client.1.smithi153.stdout:9/446: dread d1/d5/d27/d61/f18 [0,4194304] 0 2024-02-28T16:24:40.295 INFO:tasks.workunit.client.1.smithi153.stdout:1/508: rename d0/dd/db2/fb6 to d0/fbc 0 2024-02-28T16:24:40.302 INFO:tasks.workunit.client.1.smithi153.stdout:9/447: write d1/d5/d11/d1f/d20/f8d [995875,129529] 0 2024-02-28T16:24:40.302 INFO:tasks.workunit.client.1.smithi153.stdout:6/509: rename d0/d1d/d34 to d0/d1d/d33/db2 0 2024-02-28T16:24:40.304 INFO:tasks.workunit.client.1.smithi153.stdout:1/509: rmdir d0/d3d/d4a/d59/d9a 39 2024-02-28T16:24:40.305 INFO:tasks.workunit.client.1.smithi153.stdout:9/448: write d1/d5/f19 [459432,93557] 0 2024-02-28T16:24:40.305 INFO:tasks.workunit.client.1.smithi153.stdout:2/529: truncate d2/d19/d31/f58 828705 0 2024-02-28T16:24:40.307 INFO:tasks.workunit.client.1.smithi153.stdout:6/510: mkdir d0/d66/db3 0 2024-02-28T16:24:40.312 INFO:tasks.workunit.client.1.smithi153.stdout:1/510: creat d0/d3d/d4a/fbd x:0 0 0 2024-02-28T16:24:40.312 INFO:tasks.workunit.client.1.smithi153.stdout:1/511: dread - d0/f48 zero size 2024-02-28T16:24:40.315 INFO:tasks.workunit.client.1.smithi153.stdout:6/511: truncate d0/d1d/d33/d9c/d68/f7b 286482 0 2024-02-28T16:24:40.316 INFO:tasks.workunit.client.1.smithi153.stdout:2/530: link d2/l59 d2/d19/d2a/d3b/d5e/la4 0 2024-02-28T16:24:40.319 INFO:tasks.workunit.client.1.smithi153.stdout:4/453: dread d4/f9 [0,4194304] 0 2024-02-28T16:24:40.320 INFO:tasks.workunit.client.1.smithi153.stdout:2/531: mkdir d2/d19/d2a/d3b/d87/da5 0 2024-02-28T16:24:40.320 INFO:tasks.workunit.client.1.smithi153.stdout:6/512: mkdir d0/d1d/d5d/d6b/da4/d6c/db4 0 2024-02-28T16:24:40.328 INFO:tasks.workunit.client.1.smithi153.stdout:6/513: chown d0/d1d/d33/d9c/d48/l79 8616 1 2024-02-28T16:24:40.330 INFO:tasks.workunit.client.1.smithi153.stdout:6/514: chown d0/l7 254911 1 2024-02-28T16:24:40.333 INFO:tasks.workunit.client.1.smithi153.stdout:9/449: dwrite d1/d5/d11/d1f/d43/f4d [0,4194304] 0 2024-02-28T16:24:40.337 INFO:tasks.workunit.client.1.smithi153.stdout:6/515: symlink d0/d1d/d5d/d6b/da4/d60/d96/lb5 0 2024-02-28T16:24:40.339 INFO:tasks.workunit.client.1.smithi153.stdout:9/450: write d1/f15 [1827505,40923] 0 2024-02-28T16:24:40.339 INFO:tasks.workunit.client.1.smithi153.stdout:1/512: dwrite d0/dd/db2/fa2 [0,4194304] 0 2024-02-28T16:24:40.349 INFO:tasks.workunit.client.1.smithi153.stdout:9/451: chown d1/d5/d11/d1f/d20/d36/f2d 30825217 1 2024-02-28T16:24:40.350 INFO:tasks.workunit.client.1.smithi153.stdout:4/454: dwrite d4/de/d13/f20 [0,4194304] 0 2024-02-28T16:24:40.351 INFO:tasks.workunit.client.1.smithi153.stdout:2/532: dwrite d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:40.356 INFO:tasks.workunit.client.1.smithi153.stdout:2/533: write d2/d19/d2a/d3b/d87/fa2 [859844,13362] 0 2024-02-28T16:24:40.356 INFO:tasks.workunit.client.1.smithi153.stdout:9/452: mkdir d1/d5/d11/d1f/d20/d36/d93 0 2024-02-28T16:24:40.368 INFO:tasks.workunit.client.1.smithi153.stdout:8/494: sync 2024-02-28T16:24:40.369 INFO:tasks.workunit.client.1.smithi153.stdout:0/544: sync 2024-02-28T16:24:40.369 INFO:tasks.workunit.client.1.smithi153.stdout:3/502: sync 2024-02-28T16:24:40.377 INFO:tasks.workunit.client.1.smithi153.stdout:2/534: link d2/d19/d2a/f76 d2/d19/d2a/d3b/fa6 0 2024-02-28T16:24:40.377 INFO:tasks.workunit.client.1.smithi153.stdout:4/455: getdents d4/de/d23 0 2024-02-28T16:24:40.378 INFO:tasks.workunit.client.1.smithi153.stdout:3/503: creat d4/d49/fac x:0 0 0 2024-02-28T16:24:40.379 INFO:tasks.workunit.client.1.smithi153.stdout:1/513: dwrite d0/d3d/d4a/d59/f8c [0,4194304] 0 2024-02-28T16:24:40.385 INFO:tasks.workunit.client.1.smithi153.stdout:0/545: unlink d4/d32/d7f/d8a/dab/d8e/d90/fa6 0 2024-02-28T16:24:40.385 INFO:tasks.workunit.client.1.smithi153.stdout:8/495: truncate d0/d12/d67/d30/d63/f9a 407641 0 2024-02-28T16:24:40.390 INFO:tasks.workunit.client.1.smithi153.stdout:1/514: unlink d0/d3d/d4a/c98 0 2024-02-28T16:24:40.390 INFO:tasks.workunit.client.1.smithi153.stdout:8/496: dread - d0/d19/f2a zero size 2024-02-28T16:24:40.392 INFO:tasks.workunit.client.1.smithi153.stdout:3/504: rename d4/d8/fd to d4/d8/d1e/d64/fad 0 2024-02-28T16:24:40.403 INFO:tasks.workunit.client.1.smithi153.stdout:6/516: write d0/f52 [4460172,56435] 0 2024-02-28T16:24:40.403 INFO:tasks.workunit.client.1.smithi153.stdout:4/456: dwrite d4/de/d40/d4d/f82 [0,4194304] 0 2024-02-28T16:24:40.407 INFO:tasks.workunit.client.1.smithi153.stdout:8/497: mknod d0/caa 0 2024-02-28T16:24:40.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/457: chown d4/de/d13/l6d 3 1 2024-02-28T16:24:40.415 INFO:tasks.workunit.client.1.smithi153.stdout:9/453: write d1/f34 [1923124,87653] 0 2024-02-28T16:24:40.421 INFO:tasks.workunit.client.1.smithi153.stdout:0/546: dwrite d4/d32/f48 [0,4194304] 0 2024-02-28T16:24:40.421 INFO:tasks.workunit.client.1.smithi153.stdout:3/505: dread d4/d8/d1e/f3c [0,4194304] 0 2024-02-28T16:24:40.424 INFO:tasks.workunit.client.1.smithi153.stdout:1/515: dwrite d0/d3d/f64 [0,4194304] 0 2024-02-28T16:24:40.426 INFO:tasks.workunit.client.1.smithi153.stdout:7/534: sync 2024-02-28T16:24:40.426 INFO:tasks.workunit.client.1.smithi153.stdout:5/508: sync 2024-02-28T16:24:40.430 INFO:tasks.workunit.client.1.smithi153.stdout:7/535: fsync d1/d25/df/d26/f84 0 2024-02-28T16:24:40.432 INFO:tasks.workunit.client.1.smithi153.stdout:9/454: truncate d1/d5/d11/d64/f86 372859 0 2024-02-28T16:24:40.434 INFO:tasks.workunit.client.1.smithi153.stdout:4/458: dread d4/de/d13/d1b/f5f [0,4194304] 0 2024-02-28T16:24:40.443 INFO:tasks.workunit.client.1.smithi153.stdout:2/535: dwrite d2/f1c [0,4194304] 0 2024-02-28T16:24:40.446 INFO:tasks.workunit.client.1.smithi153.stdout:9/455: creat d1/d69/f94 x:0 0 0 2024-02-28T16:24:40.447 INFO:tasks.workunit.client.1.smithi153.stdout:5/509: getdents da/dd/d54 0 2024-02-28T16:24:40.451 INFO:tasks.workunit.client.1.smithi153.stdout:7/536: truncate d1/d25/d27/f5c 1069668 0 2024-02-28T16:24:40.452 INFO:tasks.workunit.client.1.smithi153.stdout:2/536: readlink d2/d19/d2a/d3b/d5e/l66 0 2024-02-28T16:24:40.455 INFO:tasks.workunit.client.1.smithi153.stdout:7/537: read d1/d25/fe [468616,23940] 0 2024-02-28T16:24:40.456 INFO:tasks.workunit.client.1.smithi153.stdout:6/517: dwrite d0/d1d/d33/d9c/f86 [0,4194304] 0 2024-02-28T16:24:40.457 INFO:tasks.workunit.client.1.smithi153.stdout:4/459: link d4/de/d23/d2b/f63 d4/de/d40/d4d/d51/f97 0 2024-02-28T16:24:40.466 INFO:tasks.workunit.client.1.smithi153.stdout:4/460: read d4/f5 [434305,82941] 0 2024-02-28T16:24:40.466 INFO:tasks.workunit.client.1.smithi153.stdout:9/456: creat d1/d5/d11/d54/f95 x:0 0 0 2024-02-28T16:24:40.466 INFO:tasks.workunit.client.1.smithi153.stdout:2/537: mkdir d2/d19/d3e/da7 0 2024-02-28T16:24:40.469 INFO:tasks.workunit.client.1.smithi153.stdout:7/538: write d1/d25/dc/faa [781724,87506] 0 2024-02-28T16:24:40.474 INFO:tasks.workunit.client.1.smithi153.stdout:9/457: rmdir d1 39 2024-02-28T16:24:40.478 INFO:tasks.workunit.client.1.smithi153.stdout:5/510: getdents da/d29/d43/d5a/d77 0 2024-02-28T16:24:40.479 INFO:tasks.workunit.client.1.smithi153.stdout:1/516: dwrite d0/dd/db2/d80/f99 [0,4194304] 0 2024-02-28T16:24:40.491 INFO:tasks.workunit.client.1.smithi153.stdout:1/517: stat d0/dd/c50 0 2024-02-28T16:24:40.491 INFO:tasks.workunit.client.1.smithi153.stdout:6/518: link d0/d1d/d5d/d6b/da4/d6c/ca0 d0/d17/cb6 0 2024-02-28T16:24:40.491 INFO:tasks.workunit.client.1.smithi153.stdout:5/511: chown da/dd/d25/d41/f9b 2363 1 2024-02-28T16:24:40.491 INFO:tasks.workunit.client.1.smithi153.stdout:4/461: write d4/de/d23/d2b/d31/f34 [5088826,128535] 0 2024-02-28T16:24:40.491 INFO:tasks.workunit.client.1.smithi153.stdout:7/539: dread - d1/d25/d27/f9b zero size 2024-02-28T16:24:40.491 INFO:tasks.workunit.client.1.smithi153.stdout:6/519: chown d0/l7 44803849 1 2024-02-28T16:24:40.491 INFO:tasks.workunit.client.1.smithi153.stdout:0/547: dwrite d4/d32/d7f/d8a/f9d [0,4194304] 0 2024-02-28T16:24:40.492 INFO:tasks.workunit.client.1.smithi153.stdout:1/518: rmdir d0/dd/db2 39 2024-02-28T16:24:40.496 INFO:tasks.workunit.client.1.smithi153.stdout:6/520: fsync d0/d1d/d30/f36 0 2024-02-28T16:24:40.502 INFO:tasks.workunit.client.1.smithi153.stdout:2/538: dwrite d2/f21 [0,4194304] 0 2024-02-28T16:24:40.502 INFO:tasks.workunit.client.1.smithi153.stdout:9/458: mkdir d1/d58/d96 0 2024-02-28T16:24:40.505 INFO:tasks.workunit.client.1.smithi153.stdout:0/548: mknod d4/d27/cbc 0 2024-02-28T16:24:40.508 INFO:tasks.workunit.client.1.smithi153.stdout:1/519: dread d0/d3d/d4a/f61 [0,4194304] 0 2024-02-28T16:24:40.511 INFO:tasks.workunit.client.1.smithi153.stdout:9/459: write d1/d2a/f5c [361913,36968] 0 2024-02-28T16:24:40.519 INFO:tasks.workunit.client.1.smithi153.stdout:2/539: creat d2/d25/fa8 x:0 0 0 2024-02-28T16:24:40.519 INFO:tasks.workunit.client.1.smithi153.stdout:6/521: link d0/d1d/d33/d9c/l4a d0/d1d/d30/d71/lb7 0 2024-02-28T16:24:40.519 INFO:tasks.workunit.client.1.smithi153.stdout:2/540: readlink l0 0 2024-02-28T16:24:40.520 INFO:tasks.workunit.client.1.smithi153.stdout:0/549: creat d4/d27/d9a/da1/db0/fbd x:0 0 0 2024-02-28T16:24:40.521 INFO:tasks.workunit.client.1.smithi153.stdout:9/460: mkdir d1/d5/d11/d1f/d40/d97 0 2024-02-28T16:24:40.523 INFO:tasks.workunit.client.1.smithi153.stdout:2/541: write d2/d23/f29 [4316791,17561] 0 2024-02-28T16:24:40.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/550: write d4/d32/d7f/d8a/dab/d8e/d90/f33 [3806161,21892] 0 2024-02-28T16:24:40.529 INFO:tasks.workunit.client.1.smithi153.stdout:8/498: dread d0/d25/f47 [0,4194304] 0 2024-02-28T16:24:40.530 INFO:tasks.workunit.client.1.smithi153.stdout:6/522: symlink d0/d1d/d33/d8d/lb8 0 2024-02-28T16:24:40.540 INFO:tasks.workunit.client.1.smithi153.stdout:8/499: mkdir d0/d12/d15/dab 0 2024-02-28T16:24:40.545 INFO:tasks.workunit.client.1.smithi153.stdout:2/542: link d2/d19/d2a/d3b/f4e d2/d63/fa9 0 2024-02-28T16:24:40.549 INFO:tasks.workunit.client.1.smithi153.stdout:6/523: write d0/d1d/d33/faf [1166752,42468] 0 2024-02-28T16:24:40.550 INFO:tasks.workunit.client.1.smithi153.stdout:2/543: read d2/d19/d3e/f65 [553629,36808] 0 2024-02-28T16:24:40.550 INFO:tasks.workunit.client.1.smithi153.stdout:3/506: dread d4/d8/d1e/d2a/d35/f47 [0,4194304] 0 2024-02-28T16:24:40.551 INFO:tasks.workunit.client.1.smithi153.stdout:8/500: creat d0/d12/d67/d88/d8e/fac x:0 0 0 2024-02-28T16:24:40.554 INFO:tasks.workunit.client.1.smithi153.stdout:4/462: dwrite d4/de/d13/f2c [0,4194304] 0 2024-02-28T16:24:40.555 INFO:tasks.workunit.client.1.smithi153.stdout:0/551: write d4/f97 [1514855,15849] 0 2024-02-28T16:24:40.557 INFO:tasks.workunit.client.1.smithi153.stdout:3/507: chown d4/d49/f9a 5 1 2024-02-28T16:24:40.558 INFO:tasks.workunit.client.1.smithi153.stdout:5/512: sync 2024-02-28T16:24:40.559 INFO:tasks.workunit.client.1.smithi153.stdout:8/501: fdatasync d0/d12/d67/d30/f7a 0 2024-02-28T16:24:40.560 INFO:tasks.workunit.client.1.smithi153.stdout:0/552: unlink d4/f3b 0 2024-02-28T16:24:40.560 INFO:tasks.workunit.client.1.smithi153.stdout:2/544: mknod d2/d19/d31/caa 0 2024-02-28T16:24:40.560 INFO:tasks.workunit.client.1.smithi153.stdout:9/461: write d1/d5/d27/d61/f4f [625474,44462] 0 2024-02-28T16:24:40.565 INFO:tasks.workunit.client.1.smithi153.stdout:9/462: fsync d1/d5/d11/d1f/d20/f3e 0 2024-02-28T16:24:40.566 INFO:tasks.workunit.client.1.smithi153.stdout:5/513: write da/d29/f59 [1852190,12008] 0 2024-02-28T16:24:40.567 INFO:tasks.workunit.client.1.smithi153.stdout:0/553: write d4/d27/f7c [4567047,20250] 0 2024-02-28T16:24:40.572 INFO:tasks.workunit.client.1.smithi153.stdout:3/508: link d4/d7d/d41/d71/fa6 d4/d13/d28/d99/fae 0 2024-02-28T16:24:40.574 INFO:tasks.workunit.client.1.smithi153.stdout:8/502: symlink d0/d12/d67/d88/d85/lad 0 2024-02-28T16:24:40.576 INFO:tasks.workunit.client.1.smithi153.stdout:5/514: rmdir da/d29/d43 39 2024-02-28T16:24:40.578 INFO:tasks.workunit.client.1.smithi153.stdout:2/545: creat d2/d25/fab x:0 0 0 2024-02-28T16:24:40.578 INFO:tasks.workunit.client.1.smithi153.stdout:7/540: dread d1/d25/f9 [0,4194304] 0 2024-02-28T16:24:40.579 INFO:tasks.workunit.client.1.smithi153.stdout:8/503: readlink d0/d25/l87 0 2024-02-28T16:24:40.580 INFO:tasks.workunit.client.1.smithi153.stdout:0/554: read d4/d27/f42 [5055425,20030] 0 2024-02-28T16:24:40.582 INFO:tasks.workunit.client.1.smithi153.stdout:3/509: creat d4/d7d/d70/faf x:0 0 0 2024-02-28T16:24:40.584 INFO:tasks.workunit.client.1.smithi153.stdout:0/555: dread - d4/d9b/fa7 zero size 2024-02-28T16:24:40.585 INFO:tasks.workunit.client.1.smithi153.stdout:9/463: rename d1/d5/d11/d1f/d43/f4d to d1/d5/d11/d29/f98 0 2024-02-28T16:24:40.586 INFO:tasks.workunit.client.1.smithi153.stdout:1/520: dread d0/fe [0,4194304] 0 2024-02-28T16:24:40.586 INFO:tasks.workunit.client.1.smithi153.stdout:7/541: rmdir d1/d25/d27 39 2024-02-28T16:24:40.587 INFO:tasks.workunit.client.1.smithi153.stdout:8/504: chown d0/d34/f7b 3916122 1 2024-02-28T16:24:40.587 INFO:tasks.workunit.client.1.smithi153.stdout:5/515: fdatasync da/f44 0 2024-02-28T16:24:40.592 INFO:tasks.workunit.client.1.smithi153.stdout:3/510: read d4/d8/d1e/f58 [373857,89597] 0 2024-02-28T16:24:40.595 INFO:tasks.workunit.client.1.smithi153.stdout:0/556: dread - d4/d27/d9a/da1/f72 zero size 2024-02-28T16:24:40.595 INFO:tasks.workunit.client.1.smithi153.stdout:9/464: write d1/d5/d11/d64/f86 [143855,77234] 0 2024-02-28T16:24:40.597 INFO:tasks.workunit.client.1.smithi153.stdout:3/511: chown d4/l50 289567 1 2024-02-28T16:24:40.598 INFO:tasks.workunit.client.1.smithi153.stdout:5/516: mknod da/dd/d25/d82/d8f/daa/caf 0 2024-02-28T16:24:40.600 INFO:tasks.workunit.client.1.smithi153.stdout:4/463: dread d4/f7 [0,4194304] 0 2024-02-28T16:24:40.601 INFO:tasks.workunit.client.1.smithi153.stdout:5/517: dread - da/f3a zero size 2024-02-28T16:24:40.604 INFO:tasks.workunit.client.1.smithi153.stdout:0/557: mknod d4/d89/cbe 0 2024-02-28T16:24:40.611 INFO:tasks.workunit.client.1.smithi153.stdout:9/465: mkdir d1/d5/d11/d1f/d20/d99 0 2024-02-28T16:24:40.612 INFO:tasks.workunit.client.1.smithi153.stdout:4/464: chown d4/de/d13/d1b/d4e/l8f 1502752 1 2024-02-28T16:24:40.612 INFO:tasks.workunit.client.1.smithi153.stdout:5/518: mkdir da/dd/d54/db0 0 2024-02-28T16:24:40.612 INFO:tasks.workunit.client.1.smithi153.stdout:2/546: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:24:40.616 INFO:tasks.workunit.client.1.smithi153.stdout:4/465: chown d4/de/d40/d4d/d51/f97 0 1 2024-02-28T16:24:40.619 INFO:tasks.workunit.client.1.smithi153.stdout:4/466: chown d4/d3c 6 1 2024-02-28T16:24:40.622 INFO:tasks.workunit.client.1.smithi153.stdout:6/524: dread d0/d66/f98 [0,4194304] 0 2024-02-28T16:24:40.624 INFO:tasks.workunit.client.1.smithi153.stdout:8/505: getdents d0/d19/d2b/d2d 0 2024-02-28T16:24:40.625 INFO:tasks.workunit.client.1.smithi153.stdout:0/558: getdents d4/d32/db7 0 2024-02-28T16:24:40.628 INFO:tasks.workunit.client.1.smithi153.stdout:8/506: chown d0/d12/d15/f6d 39161652 1 2024-02-28T16:24:40.629 INFO:tasks.workunit.client.1.smithi153.stdout:4/467: write d4/de/f45 [1478640,65283] 0 2024-02-28T16:24:40.631 INFO:tasks.workunit.client.1.smithi153.stdout:8/507: readlink d0/d12/l8b 0 2024-02-28T16:24:40.634 INFO:tasks.workunit.client.1.smithi153.stdout:5/519: getdents da/dd/d25/d8a 0 2024-02-28T16:24:40.640 INFO:tasks.workunit.client.1.smithi153.stdout:9/466: fdatasync d1/d5/d11/d1f/d20/d45/f4a 0 2024-02-28T16:24:40.642 INFO:tasks.workunit.client.1.smithi153.stdout:7/542: dread d1/d25/dc/d50/f5b [0,4194304] 0 2024-02-28T16:24:40.645 INFO:tasks.workunit.client.1.smithi153.stdout:9/467: dread - d1/d5/d11/d1f/d20/f49 zero size 2024-02-28T16:24:40.646 INFO:tasks.workunit.client.1.smithi153.stdout:5/520: unlink da/dd/f40 0 2024-02-28T16:24:40.646 INFO:tasks.workunit.client.1.smithi153.stdout:1/521: dwrite d0/dd/db2/d80/f99 [0,4194304] 0 2024-02-28T16:24:40.648 INFO:tasks.workunit.client.1.smithi153.stdout:7/543: chown d1/d25/dc/d7e/l9f 968486969 1 2024-02-28T16:24:40.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/508: symlink d0/d25/d79/lae 0 2024-02-28T16:24:40.653 INFO:tasks.workunit.client.1.smithi153.stdout:2/547: truncate d2/d23/f29 2101736 0 2024-02-28T16:24:40.654 INFO:tasks.workunit.client.1.smithi153.stdout:3/512: dread d4/d8/d1e/d2a/d35/f51 [0,4194304] 0 2024-02-28T16:24:40.655 INFO:tasks.workunit.client.1.smithi153.stdout:8/509: write d0/d19/d89/fa2 [808786,70011] 0 2024-02-28T16:24:40.656 INFO:tasks.workunit.client.1.smithi153.stdout:5/521: unlink da/f38 0 2024-02-28T16:24:40.664 INFO:tasks.workunit.client.1.smithi153.stdout:3/513: chown d4/d7d/d41/d71/c9d 251233 1 2024-02-28T16:24:40.664 INFO:tasks.workunit.client.1.smithi153.stdout:1/522: read d0/d3d/d4a/d59/f5a [276271,117833] 0 2024-02-28T16:24:40.667 INFO:tasks.workunit.client.1.smithi153.stdout:0/559: dwrite d4/d27/d9a/fb5 [0,4194304] 0 2024-02-28T16:24:40.676 INFO:tasks.workunit.client.1.smithi153.stdout:4/468: write d4/de/f60 [427944,44574] 0 2024-02-28T16:24:40.679 INFO:tasks.workunit.client.1.smithi153.stdout:3/514: creat d4/d13/d8f/fb0 x:0 0 0 2024-02-28T16:24:40.685 INFO:tasks.workunit.client.1.smithi153.stdout:0/560: rename d4/d32/l56 to d4/d32/d7f/d8a/dab/d8e/d90/lbf 0 2024-02-28T16:24:40.686 INFO:tasks.workunit.client.1.smithi153.stdout:2/548: dwrite d2/d19/d3e/fa1 [4194304,4194304] 0 2024-02-28T16:24:40.687 INFO:tasks.workunit.client.1.smithi153.stdout:7/544: write d1/d25/f49 [1500775,14958] 0 2024-02-28T16:24:40.694 INFO:tasks.workunit.client.1.smithi153.stdout:7/545: dread - d1/f82 zero size 2024-02-28T16:24:40.695 INFO:tasks.workunit.client.1.smithi153.stdout:5/522: write da/d29/f5b [64786,64531] 0 2024-02-28T16:24:40.695 INFO:tasks.workunit.client.1.smithi153.stdout:1/523: getdents d0/dd/db2/d89/daa 0 2024-02-28T16:24:40.696 INFO:tasks.workunit.client.1.smithi153.stdout:4/469: rmdir d4/de/d47 39 2024-02-28T16:24:40.701 INFO:tasks.workunit.client.1.smithi153.stdout:3/515: rename d4/d8/d1e/d2a/d35/d96 to d4/d8/d1e/d2a/d55/da3/db1 0 2024-02-28T16:24:40.702 INFO:tasks.workunit.client.1.smithi153.stdout:2/549: write d2/d19/d2a/d3b/d87/fa2 [1645182,68886] 0 2024-02-28T16:24:40.706 INFO:tasks.workunit.client.1.smithi153.stdout:7/546: write d1/f23 [3244731,104973] 0 2024-02-28T16:24:40.709 INFO:tasks.workunit.client.1.smithi153.stdout:6/525: dread d0/f19 [4194304,4194304] 0 2024-02-28T16:24:40.713 INFO:tasks.workunit.client.1.smithi153.stdout:7/547: fdatasync d1/d25/df/f8f 0 2024-02-28T16:24:40.715 INFO:tasks.workunit.client.1.smithi153.stdout:7/548: chown d1/d70/c73 2078 1 2024-02-28T16:24:40.717 INFO:tasks.workunit.client.1.smithi153.stdout:4/470: read d4/de/f57 [1080192,30033] 0 2024-02-28T16:24:40.718 INFO:tasks.workunit.client.1.smithi153.stdout:3/516: rename d4/d13/c62 to d4/d7d/d41/d71/cb2 0 2024-02-28T16:24:40.719 INFO:tasks.workunit.client.1.smithi153.stdout:0/561: truncate d4/d27/f85 1610138 0 2024-02-28T16:24:40.720 INFO:tasks.workunit.client.1.smithi153.stdout:1/524: link d0/dd/f32 d0/d3d/d4a/fbe 0 2024-02-28T16:24:40.724 INFO:tasks.workunit.client.1.smithi153.stdout:7/549: symlink d1/d25/df/d26/d3a/d95/lb8 0 2024-02-28T16:24:40.724 INFO:tasks.workunit.client.1.smithi153.stdout:0/562: read - d4/d32/fba zero size 2024-02-28T16:24:40.724 INFO:tasks.workunit.client.1.smithi153.stdout:9/468: dread d1/d5/d11/d1f/d20/d36/f37 [0,4194304] 0 2024-02-28T16:24:40.725 INFO:tasks.workunit.client.1.smithi153.stdout:8/510: dread d0/d19/d2b/d2d/f35 [0,4194304] 0 2024-02-28T16:24:40.732 INFO:tasks.workunit.client.1.smithi153.stdout:3/517: creat d4/d8/d1e/d87/fb3 x:0 0 0 2024-02-28T16:24:40.734 INFO:tasks.workunit.client.1.smithi153.stdout:2/550: dread d2/d86/f53 [0,4194304] 0 2024-02-28T16:24:40.734 INFO:tasks.workunit.client.1.smithi153.stdout:1/525: chown d0/d3d/l9b 42 1 2024-02-28T16:24:40.735 INFO:tasks.workunit.client.1.smithi153.stdout:4/471: creat d4/de/d47/d5e/d62/f98 x:0 0 0 2024-02-28T16:24:40.737 INFO:tasks.workunit.client.1.smithi153.stdout:9/469: mkdir d1/d5/d11/d64/d85/d9a 0 2024-02-28T16:24:40.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/472: chown d4/de/d13/l6d 53 1 2024-02-28T16:24:40.739 INFO:tasks.workunit.client.1.smithi153.stdout:1/526: write d0/dd/db2/d80/fa7 [398005,81084] 0 2024-02-28T16:24:40.741 INFO:tasks.workunit.client.1.smithi153.stdout:2/551: write d2/d19/d2a/d93/f83 [769358,93143] 0 2024-02-28T16:24:40.742 INFO:tasks.workunit.client.1.smithi153.stdout:1/527: readlink d0/l6a 0 2024-02-28T16:24:40.743 INFO:tasks.workunit.client.1.smithi153.stdout:7/550: symlink d1/d25/dc/d50/d66/lb9 0 2024-02-28T16:24:40.743 INFO:tasks.workunit.client.1.smithi153.stdout:4/473: chown d4/f5 7 1 2024-02-28T16:24:40.743 INFO:tasks.workunit.client.1.smithi153.stdout:5/523: dwrite da/dd/d54/f69 [0,4194304] 0 2024-02-28T16:24:40.747 INFO:tasks.workunit.client.1.smithi153.stdout:6/526: link d0/d1d/d30/d71/d91/fb1 d0/d1d/d33/d9c/d2e/d99/fb9 0 2024-02-28T16:24:40.747 INFO:tasks.workunit.client.1.smithi153.stdout:9/470: unlink d1/d5/d27/d61/l22 0 2024-02-28T16:24:40.748 INFO:tasks.workunit.client.1.smithi153.stdout:7/551: readlink d1/l18 0 2024-02-28T16:24:40.750 INFO:tasks.workunit.client.1.smithi153.stdout:2/552: creat d2/d86/fac x:0 0 0 2024-02-28T16:24:40.752 INFO:tasks.workunit.client.1.smithi153.stdout:8/511: rename d0/d25/l87 to d0/d19/laf 0 2024-02-28T16:24:40.754 INFO:tasks.workunit.client.1.smithi153.stdout:5/524: truncate da/d29/f5b 1155828 0 2024-02-28T16:24:40.757 INFO:tasks.workunit.client.1.smithi153.stdout:4/474: symlink d4/de/d23/l99 0 2024-02-28T16:24:40.757 INFO:tasks.workunit.client.1.smithi153.stdout:2/553: chown d2/d86/da0 736833 1 2024-02-28T16:24:40.766 INFO:tasks.workunit.client.1.smithi153.stdout:2/554: write d2/d19/d2a/d3b/f68 [705287,50519] 0 2024-02-28T16:24:40.766 INFO:tasks.workunit.client.1.smithi153.stdout:5/525: fsync da/dd/d25/f5c 0 2024-02-28T16:24:40.766 INFO:tasks.workunit.client.1.smithi153.stdout:3/518: dwrite d4/d8/f65 [0,4194304] 0 2024-02-28T16:24:40.771 INFO:tasks.workunit.client.1.smithi153.stdout:6/527: rename d0/d1d/d5d/d6b/da4/d6c/ca0 to d0/d1d/d5d/d6b/da4/d60/d96/cba 0 2024-02-28T16:24:40.772 INFO:tasks.workunit.client.1.smithi153.stdout:4/475: creat d4/d53/d7c/f9a x:0 0 0 2024-02-28T16:24:40.776 INFO:tasks.workunit.client.1.smithi153.stdout:2/555: write d2/d19/d2a/d3b/f68 [1385550,3155] 0 2024-02-28T16:24:40.778 INFO:tasks.workunit.client.1.smithi153.stdout:5/526: readlink da/dd/d25/d82/d8f/daa/la6 0 2024-02-28T16:24:40.783 INFO:tasks.workunit.client.1.smithi153.stdout:5/527: fsync da/dd/f93 0 2024-02-28T16:24:40.785 INFO:tasks.workunit.client.1.smithi153.stdout:4/476: read d4/de/d23/f48 [1529422,128340] 0 2024-02-28T16:24:40.787 INFO:tasks.workunit.client.1.smithi153.stdout:6/528: creat d0/d1d/d33/d9c/d2e/d99/fbb x:0 0 0 2024-02-28T16:24:40.789 INFO:tasks.workunit.client.1.smithi153.stdout:6/529: chown d0/d1d/d33/db2 30006809 1 2024-02-28T16:24:40.790 INFO:tasks.workunit.client.1.smithi153.stdout:4/477: rmdir d4 39 2024-02-28T16:24:40.795 INFO:tasks.workunit.client.1.smithi153.stdout:5/528: write da/d29/f5e [1618161,82425] 0 2024-02-28T16:24:40.797 INFO:tasks.workunit.client.1.smithi153.stdout:2/556: creat d2/d19/d2a/d3b/d87/fad x:0 0 0 2024-02-28T16:24:40.797 INFO:tasks.workunit.client.1.smithi153.stdout:8/512: dread d0/d19/d1e/f53 [0,4194304] 0 2024-02-28T16:24:40.798 INFO:tasks.workunit.client.1.smithi153.stdout:9/471: dwrite d1/d5/d11/d64/f86 [0,4194304] 0 2024-02-28T16:24:40.808 INFO:tasks.workunit.client.1.smithi153.stdout:9/472: read - d1/d5/d11/d64/f84 zero size 2024-02-28T16:24:40.808 INFO:tasks.workunit.client.1.smithi153.stdout:6/530: write d0/d1d/d30/d71/d91/fb1 [59910,124201] 0 2024-02-28T16:24:40.810 INFO:tasks.workunit.client.1.smithi153.stdout:3/519: dread d4/d8/d1e/d2a/d35/f51 [0,4194304] 0 2024-02-28T16:24:40.810 INFO:tasks.workunit.client.1.smithi153.stdout:7/552: dread d1/f2c [0,4194304] 0 2024-02-28T16:24:40.810 INFO:tasks.workunit.client.1.smithi153.stdout:4/478: truncate d4/de/d40/d4d/d51/f97 582127 0 2024-02-28T16:24:40.810 INFO:tasks.workunit.client.1.smithi153.stdout:2/557: mknod d2/d19/d2a/cae 0 2024-02-28T16:24:40.813 INFO:tasks.workunit.client.1.smithi153.stdout:9/473: write d1/ff [1036864,18482] 0 2024-02-28T16:24:40.814 INFO:tasks.workunit.client.1.smithi153.stdout:6/531: readlink d0/d1d/d33/d9c/d2e/l32 0 2024-02-28T16:24:40.816 INFO:tasks.workunit.client.1.smithi153.stdout:3/520: write d4/d8/d1e/d2a/f83 [2216982,34457] 0 2024-02-28T16:24:40.816 INFO:tasks.workunit.client.1.smithi153.stdout:9/474: chown d1/d7e 25 1 2024-02-28T16:24:40.817 INFO:tasks.workunit.client.1.smithi153.stdout:4/479: readlink d4/l7f 0 2024-02-28T16:24:40.819 INFO:tasks.workunit.client.1.smithi153.stdout:6/532: fdatasync d0/d17/f28 0 2024-02-28T16:24:40.820 INFO:tasks.workunit.client.1.smithi153.stdout:5/529: rename da/d29/f56 to da/d29/d43/d5a/d77/fb1 0 2024-02-28T16:24:40.822 INFO:tasks.workunit.client.1.smithi153.stdout:6/533: dread - d0/d66/f82 zero size 2024-02-28T16:24:40.824 INFO:tasks.workunit.client.1.smithi153.stdout:7/553: dread d1/d25/df/f8f [0,4194304] 0 2024-02-28T16:24:40.825 INFO:tasks.workunit.client.1.smithi153.stdout:3/521: write d4/d8/d1e/d63/f98 [352268,5477] 0 2024-02-28T16:24:40.845 INFO:tasks.workunit.client.1.smithi153.stdout:5/530: dread da/d29/d43/d5a/d77/f8b [0,4194304] 0 2024-02-28T16:24:40.850 INFO:tasks.workunit.client.1.smithi153.stdout:7/554: link d1/d25/dc/l45 d1/d25/df/lba 0 2024-02-28T16:24:40.850 INFO:tasks.workunit.client.1.smithi153.stdout:9/475: dread d1/d5/d11/d64/f86 [0,4194304] 0 2024-02-28T16:24:40.852 INFO:tasks.workunit.client.1.smithi153.stdout:8/513: dread d0/d19/d2b/d2d/f5e [0,4194304] 0 2024-02-28T16:24:40.853 INFO:tasks.workunit.client.1.smithi153.stdout:9/476: fdatasync d1/d5/f7a 0 2024-02-28T16:24:40.854 INFO:tasks.workunit.client.1.smithi153.stdout:7/555: chown d1/f8d 82 1 2024-02-28T16:24:40.854 INFO:tasks.workunit.client.1.smithi153.stdout:3/522: dwrite d4/d8/d1e/d2a/f83 [0,4194304] 0 2024-02-28T16:24:40.855 INFO:tasks.workunit.client.1.smithi153.stdout:8/514: stat d0/c45 0 2024-02-28T16:24:40.856 INFO:tasks.workunit.client.1.smithi153.stdout:6/534: dwrite d0/d1d/d30/f31 [4194304,4194304] 0 2024-02-28T16:24:40.856 INFO:tasks.workunit.client.1.smithi153.stdout:9/477: fdatasync d1/ff 0 2024-02-28T16:24:40.861 INFO:tasks.workunit.client.1.smithi153.stdout:9/478: read d1/f4e [251147,89302] 0 2024-02-28T16:24:40.862 INFO:tasks.workunit.client.1.smithi153.stdout:7/556: read d1/d25/df/d26/d76/f9a [829684,97933] 0 2024-02-28T16:24:40.863 INFO:tasks.workunit.client.1.smithi153.stdout:3/523: creat d4/d7d/fb4 x:0 0 0 2024-02-28T16:24:40.864 INFO:tasks.workunit.client.1.smithi153.stdout:2/558: dread d2/d19/d5d/f7a [0,4194304] 0 2024-02-28T16:24:40.866 INFO:tasks.workunit.client.1.smithi153.stdout:9/479: chown d1/d5/d11/d1f/d20/d45/f4a 42161106 1 2024-02-28T16:24:40.867 INFO:tasks.workunit.client.1.smithi153.stdout:9/480: readlink d1/d5/l56 0 2024-02-28T16:24:40.868 INFO:tasks.workunit.client.1.smithi153.stdout:6/535: link d0/d1d/d33/d9c/d48/d72/f76 d0/d1d/d33/db2/fbc 0 2024-02-28T16:24:40.868 INFO:tasks.workunit.client.1.smithi153.stdout:7/557: mkdir d1/d25/df/d26/d3a/d52/dbb 0 2024-02-28T16:24:40.874 INFO:tasks.workunit.client.1.smithi153.stdout:6/536: write d0/f18 [4313428,4303] 0 2024-02-28T16:24:40.877 INFO:tasks.workunit.client.1.smithi153.stdout:2/559: symlink d2/d86/da0/laf 0 2024-02-28T16:24:40.878 INFO:tasks.workunit.client.1.smithi153.stdout:6/537: truncate d0/d1d/d30/f58 2013679 0 2024-02-28T16:24:40.878 INFO:tasks.workunit.client.1.smithi153.stdout:5/531: dread da/f16 [0,4194304] 0 2024-02-28T16:24:40.881 INFO:tasks.workunit.client.1.smithi153.stdout:7/558: creat d1/fbc x:0 0 0 2024-02-28T16:24:40.881 INFO:tasks.workunit.client.1.smithi153.stdout:2/560: mkdir d2/d19/d3e/db0 0 2024-02-28T16:24:40.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/481: dwrite d1/d5/d27/d61/f4f [0,4194304] 0 2024-02-28T16:24:40.887 INFO:tasks.workunit.client.1.smithi153.stdout:9/482: write d1/ff [785320,80304] 0 2024-02-28T16:24:40.891 INFO:tasks.workunit.client.1.smithi153.stdout:2/561: mkdir d2/d19/d3e/da7/db1 0 2024-02-28T16:24:40.898 INFO:tasks.workunit.client.1.smithi153.stdout:5/532: creat da/d29/d43/fb2 x:0 0 0 2024-02-28T16:24:40.898 INFO:tasks.workunit.client.1.smithi153.stdout:6/538: dwrite d0/d1d/d33/d9c/d2e/f53 [0,4194304] 0 2024-02-28T16:24:40.907 INFO:tasks.workunit.client.1.smithi153.stdout:2/562: symlink d2/d25/lb2 0 2024-02-28T16:24:40.908 INFO:tasks.workunit.client.1.smithi153.stdout:9/483: dread d1/ff [0,4194304] 0 2024-02-28T16:24:40.911 INFO:tasks.workunit.client.1.smithi153.stdout:6/539: unlink d0/d1d/d33/d9c/d2e/f5b 0 2024-02-28T16:24:40.912 INFO:tasks.workunit.client.1.smithi153.stdout:7/559: link d1/d25/df/l10 d1/lbd 0 2024-02-28T16:24:40.912 INFO:tasks.workunit.client.1.smithi153.stdout:9/484: dread - d1/d5/d11/d64/f84 zero size 2024-02-28T16:24:40.914 INFO:tasks.workunit.client.1.smithi153.stdout:2/563: truncate d2/d19/d2a/d3b/d5e/f9c 876402 0 2024-02-28T16:24:40.914 INFO:tasks.workunit.client.1.smithi153.stdout:9/485: chown d1/d5/d11/d1f 0 1 2024-02-28T16:24:40.916 INFO:tasks.workunit.client.1.smithi153.stdout:3/524: dwrite d4/d8/d1e/f3c [0,4194304] 0 2024-02-28T16:24:40.919 INFO:tasks.workunit.client.1.smithi153.stdout:2/564: unlink d2/d23/d36/l64 0 2024-02-28T16:24:40.923 INFO:tasks.workunit.client.1.smithi153.stdout:0/563: sync 2024-02-28T16:24:40.923 INFO:tasks.workunit.client.1.smithi153.stdout:5/533: dwrite da/fc [0,4194304] 0 2024-02-28T16:24:40.926 INFO:tasks.workunit.client.1.smithi153.stdout:3/525: mkdir d4/d8/d1e/d2a/d55/da3/db5 0 2024-02-28T16:24:40.930 INFO:tasks.workunit.client.1.smithi153.stdout:2/565: fdatasync d2/d25/f6d 0 2024-02-28T16:24:40.931 INFO:tasks.workunit.client.1.smithi153.stdout:9/486: symlink d1/d5/d11/d1f/d20/d99/l9b 0 2024-02-28T16:24:40.934 INFO:tasks.workunit.client.1.smithi153.stdout:9/487: chown d1/f15 88 1 2024-02-28T16:24:40.938 INFO:tasks.workunit.client.1.smithi153.stdout:5/534: mkdir da/dd/d25/d8a/db3 0 2024-02-28T16:24:40.939 INFO:tasks.workunit.client.1.smithi153.stdout:3/526: symlink d4/d8/d1e/d2a/d55/da3/db1/lb6 0 2024-02-28T16:24:40.942 INFO:tasks.workunit.client.1.smithi153.stdout:5/535: rename da/dd/d25/d82/d8f to da/dd/d25/d82/d8f/db4 22 2024-02-28T16:24:40.944 INFO:tasks.workunit.client.1.smithi153.stdout:0/564: mknod d4/d9b/cc0 0 2024-02-28T16:24:40.946 INFO:tasks.workunit.client.1.smithi153.stdout:9/488: write d1/d5/d27/d61/f18 [4299409,82399] 0 2024-02-28T16:24:40.948 INFO:tasks.workunit.client.1.smithi153.stdout:3/527: mknod d4/d7d/d70/cb7 0 2024-02-28T16:24:40.949 INFO:tasks.workunit.client.1.smithi153.stdout:2/566: dread d2/d63/f78 [0,4194304] 0 2024-02-28T16:24:40.951 INFO:tasks.workunit.client.1.smithi153.stdout:5/536: mknod da/d29/d43/d5a/cb5 0 2024-02-28T16:24:40.955 INFO:tasks.workunit.client.1.smithi153.stdout:3/528: creat d4/d49/fb8 x:0 0 0 2024-02-28T16:24:40.959 INFO:tasks.workunit.client.1.smithi153.stdout:6/540: dread d0/d66/d85/fad [0,4194304] 0 2024-02-28T16:24:40.967 INFO:tasks.workunit.client.1.smithi153.stdout:3/529: dwrite d4/d8/d1e/f3c [4194304,4194304] 0 2024-02-28T16:24:40.970 INFO:tasks.workunit.client.1.smithi153.stdout:9/489: creat d1/d5/d11/d64/d85/d8c/f9c x:0 0 0 2024-02-28T16:24:40.971 INFO:tasks.workunit.client.1.smithi153.stdout:9/490: stat d1/d2a/f5c 0 2024-02-28T16:24:40.975 INFO:tasks.workunit.client.1.smithi153.stdout:5/537: write da/dd/d25/d41/f49 [2612611,55603] 0 2024-02-28T16:24:40.985 INFO:tasks.workunit.client.1.smithi153.stdout:3/530: unlink d4/d2c/f86 0 2024-02-28T16:24:40.986 INFO:tasks.workunit.client.1.smithi153.stdout:3/531: fdatasync d4/d7d/d41/f79 0 2024-02-28T16:24:40.987 INFO:tasks.workunit.client.1.smithi153.stdout:3/532: stat d4/d8/d1e/d2a/d35/c72 0 2024-02-28T16:24:40.991 INFO:tasks.workunit.client.1.smithi153.stdout:9/491: fsync d1/d5/d11/d29/f98 0 2024-02-28T16:24:40.991 INFO:tasks.workunit.client.1.smithi153.stdout:2/567: creat d2/d19/d2a/d3b/fb3 x:0 0 0 2024-02-28T16:24:40.993 INFO:tasks.workunit.client.1.smithi153.stdout:5/538: chown da/d29/l6f 11885325 1 2024-02-28T16:24:40.995 INFO:tasks.workunit.client.1.smithi153.stdout:5/539: write f9 [4269934,12432] 0 2024-02-28T16:24:40.995 INFO:tasks.workunit.client.1.smithi153.stdout:6/541: symlink d0/d1d/d33/d9c/d2e/lbd 0 2024-02-28T16:24:40.996 INFO:tasks.workunit.client.1.smithi153.stdout:0/565: getdents d4/d32/d7f/d8a/dab/d8e 0 2024-02-28T16:24:40.998 INFO:tasks.workunit.client.1.smithi153.stdout:3/533: creat d4/d13/d8f/fb9 x:0 0 0 2024-02-28T16:24:40.999 INFO:tasks.workunit.client.1.smithi153.stdout:3/534: fsync d4/d2c/f7e 0 2024-02-28T16:24:41.003 INFO:tasks.workunit.client.1.smithi153.stdout:6/542: fsync d0/d1d/d33/d9c/f3a 0 2024-02-28T16:24:41.006 INFO:tasks.workunit.client.1.smithi153.stdout:6/543: chown d0/f18 276490496 1 2024-02-28T16:24:41.009 INFO:tasks.workunit.client.1.smithi153.stdout:2/568: mkdir d2/d25/db4 0 2024-02-28T16:24:41.013 INFO:tasks.workunit.client.1.smithi153.stdout:5/540: dwrite da/dd/d25/d41/f9b [0,4194304] 0 2024-02-28T16:24:41.013 INFO:tasks.workunit.client.1.smithi153.stdout:0/566: dwrite d4/f6b [0,4194304] 0 2024-02-28T16:24:41.017 INFO:tasks.workunit.client.1.smithi153.stdout:9/492: rename d1/d2a/f5c to d1/d5/d11/d1f/d43/f9d 0 2024-02-28T16:24:41.023 INFO:tasks.workunit.client.1.smithi153.stdout:6/544: creat d0/d1d/d5d/d6b/da4/d60/d96/fbe x:0 0 0 2024-02-28T16:24:41.024 INFO:tasks.workunit.client.1.smithi153.stdout:5/541: unlink da/dd/d25/d41/d7c/f81 0 2024-02-28T16:24:41.024 INFO:tasks.workunit.client.1.smithi153.stdout:0/567: mkdir d4/d27/dc1 0 2024-02-28T16:24:41.026 INFO:tasks.workunit.client.1.smithi153.stdout:6/545: fsync d0/d1d/d33/d9c/d2e/d99/fbb 0 2024-02-28T16:24:41.026 INFO:tasks.workunit.client.1.smithi153.stdout:0/568: fsync d4/d27/d9a/da1/f84 0 2024-02-28T16:24:41.026 INFO:tasks.workunit.client.1.smithi153.stdout:9/493: symlink d1/d5/d11/d64/d85/d8c/l9e 0 2024-02-28T16:24:41.028 INFO:tasks.workunit.client.1.smithi153.stdout:3/535: dread d4/d8/d1e/d63/f80 [0,4194304] 0 2024-02-28T16:24:41.028 INFO:tasks.workunit.client.1.smithi153.stdout:2/569: symlink d2/d25/d49/lb5 0 2024-02-28T16:24:41.030 INFO:tasks.workunit.client.1.smithi153.stdout:2/570: chown d2/d19/l32 1 1 2024-02-28T16:24:41.032 INFO:tasks.workunit.client.1.smithi153.stdout:5/542: symlink da/d29/d43/d5a/d77/lb6 0 2024-02-28T16:24:41.034 INFO:tasks.workunit.client.1.smithi153.stdout:5/543: write da/d29/d43/fb2 [174816,107438] 0 2024-02-28T16:24:41.034 INFO:tasks.workunit.client.1.smithi153.stdout:6/546: mknod d0/d17/cbf 0 2024-02-28T16:24:41.039 INFO:tasks.workunit.client.1.smithi153.stdout:3/536: creat d4/d8/d1e/d2a/d55/da3/fba x:0 0 0 2024-02-28T16:24:41.044 INFO:tasks.workunit.client.1.smithi153.stdout:0/569: mkdir d4/d32/d7f/db3/dc2 0 2024-02-28T16:24:41.044 INFO:tasks.workunit.client.1.smithi153.stdout:9/494: dwrite d1/d2a/f65 [0,4194304] 0 2024-02-28T16:24:41.044 INFO:tasks.workunit.client.1.smithi153.stdout:6/547: creat d0/d1d/d33/d9c/d48/fc0 x:0 0 0 2024-02-28T16:24:41.044 INFO:tasks.workunit.client.1.smithi153.stdout:5/544: symlink da/dd/lb7 0 2024-02-28T16:24:41.051 INFO:tasks.workunit.client.1.smithi153.stdout:4/480: sync 2024-02-28T16:24:41.052 INFO:tasks.workunit.client.1.smithi153.stdout:1/528: sync 2024-02-28T16:24:41.052 INFO:tasks.workunit.client.1.smithi153.stdout:3/537: mkdir d4/d8/d1e/dbb 0 2024-02-28T16:24:41.055 INFO:tasks.workunit.client.1.smithi153.stdout:9/495: creat d1/d74/d7c/f9f x:0 0 0 2024-02-28T16:24:41.056 INFO:tasks.workunit.client.1.smithi153.stdout:2/571: getdents d2/d23 0 2024-02-28T16:24:41.058 INFO:tasks.workunit.client.1.smithi153.stdout:5/545: mknod da/d29/d43/cb8 0 2024-02-28T16:24:41.061 INFO:tasks.workunit.client.1.smithi153.stdout:4/481: read d4/de/f12 [232256,51786] 0 2024-02-28T16:24:41.063 INFO:tasks.workunit.client.1.smithi153.stdout:6/548: mknod d0/d1d/d33/d9c/cc1 0 2024-02-28T16:24:41.065 INFO:tasks.workunit.client.1.smithi153.stdout:0/570: creat d4/fc3 x:0 0 0 2024-02-28T16:24:41.065 INFO:tasks.workunit.client.1.smithi153.stdout:6/549: chown d0/d1d/d33/d9c/c5c 114914 1 2024-02-28T16:24:41.066 INFO:tasks.workunit.client.1.smithi153.stdout:4/482: dread d4/de/d47/f67 [0,4194304] 0 2024-02-28T16:24:41.067 INFO:tasks.workunit.client.1.smithi153.stdout:0/571: write d4/d27/d9a/da1/f72 [347951,5563] 0 2024-02-28T16:24:41.070 INFO:tasks.workunit.client.1.smithi153.stdout:1/529: unlink d0/dd/f30 0 2024-02-28T16:24:41.075 INFO:tasks.workunit.client.1.smithi153.stdout:3/538: fdatasync d4/d2c/f57 0 2024-02-28T16:24:41.080 INFO:tasks.workunit.client.1.smithi153.stdout:9/496: mknod d1/d5/d11/d1f/d43/ca0 0 2024-02-28T16:24:41.092 INFO:tasks.workunit.client.1.smithi153.stdout:1/530: dwrite d0/dd/db2/f91 [0,4194304] 0 2024-02-28T16:24:41.097 INFO:tasks.workunit.client.1.smithi153.stdout:5/546: rename da/c6b to da/dd/d25/d82/d8f/daa/cb9 0 2024-02-28T16:24:41.099 INFO:tasks.workunit.client.1.smithi153.stdout:6/550: creat d0/d1d/d5d/d6b/da4/d6c/db4/fc2 x:0 0 0 2024-02-28T16:24:41.102 INFO:tasks.workunit.client.1.smithi153.stdout:7/560: sync 2024-02-28T16:24:41.102 INFO:tasks.workunit.client.1.smithi153.stdout:8/515: sync 2024-02-28T16:24:41.106 INFO:tasks.workunit.client.1.smithi153.stdout:2/572: creat d2/d25/fb6 x:0 0 0 2024-02-28T16:24:41.111 INFO:tasks.workunit.client.1.smithi153.stdout:1/531: symlink d0/d62/d66/d8e/lbf 0 2024-02-28T16:24:41.118 INFO:tasks.workunit.client.1.smithi153.stdout:4/483: rename d4/de/d40/d4d/d51 to d4/de/d23/d2b/d9b 0 2024-02-28T16:24:41.120 INFO:tasks.workunit.client.1.smithi153.stdout:6/551: dwrite d0/d1d/d33/d9c/d2e/f42 [0,4194304] 0 2024-02-28T16:24:41.120 INFO:tasks.workunit.client.1.smithi153.stdout:5/547: creat da/d29/d43/d5a/d77/fba x:0 0 0 2024-02-28T16:24:41.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/548: chown da/dd/d25/d82/fad 705617 1 2024-02-28T16:24:41.125 INFO:tasks.workunit.client.1.smithi153.stdout:6/552: read - d0/d1d/d30/d71/f84 zero size 2024-02-28T16:24:41.127 INFO:tasks.workunit.client.1.smithi153.stdout:5/549: write da/d29/d43/fb2 [183141,111709] 0 2024-02-28T16:24:41.129 INFO:tasks.workunit.client.1.smithi153.stdout:2/573: mknod d2/d23/d88/cb7 0 2024-02-28T16:24:41.136 INFO:tasks.workunit.client.1.smithi153.stdout:3/539: rename d4/d2c/c7c to d4/d8/d1e/d23/da0/cbc 0 2024-02-28T16:24:41.139 INFO:tasks.workunit.client.1.smithi153.stdout:7/561: creat d1/d25/d27/d7c/fbe x:0 0 0 2024-02-28T16:24:41.142 INFO:tasks.workunit.client.1.smithi153.stdout:0/572: link d4/d27/f55 d4/d32/d7f/fc4 0 2024-02-28T16:24:41.142 INFO:tasks.workunit.client.1.smithi153.stdout:8/516: creat d0/d19/d2b/d2d/d3f/d9f/fb0 x:0 0 0 2024-02-28T16:24:41.147 INFO:tasks.workunit.client.1.smithi153.stdout:6/553: unlink d0/d1d/d33/d8d/lb8 0 2024-02-28T16:24:41.150 INFO:tasks.workunit.client.1.smithi153.stdout:4/484: mkdir d4/d9c 0 2024-02-28T16:24:41.154 INFO:tasks.workunit.client.1.smithi153.stdout:3/540: mknod d4/d8/d1e/d87/cbd 0 2024-02-28T16:24:41.155 INFO:tasks.workunit.client.1.smithi153.stdout:7/562: mkdir d1/d70/dbf 0 2024-02-28T16:24:41.155 INFO:tasks.workunit.client.1.smithi153.stdout:3/541: chown d4/d13/d8f/fb0 13298 1 2024-02-28T16:24:41.158 INFO:tasks.workunit.client.1.smithi153.stdout:0/573: mknod d4/d27/cc5 0 2024-02-28T16:24:41.158 INFO:tasks.workunit.client.1.smithi153.stdout:3/542: write d4/d7d/d41/f79 [468528,58251] 0 2024-02-28T16:24:41.162 INFO:tasks.workunit.client.1.smithi153.stdout:2/574: truncate d2/d63/fa9 3134114 0 2024-02-28T16:24:41.162 INFO:tasks.workunit.client.1.smithi153.stdout:8/517: dread d0/d34/f3d [0,4194304] 0 2024-02-28T16:24:41.165 INFO:tasks.workunit.client.1.smithi153.stdout:4/485: creat d4/d53/d7c/f9d x:0 0 0 2024-02-28T16:24:41.166 INFO:tasks.workunit.client.1.smithi153.stdout:4/486: write d4/de/d23/d2b/d31/f64 [1242697,43747] 0 2024-02-28T16:24:41.166 INFO:tasks.workunit.client.1.smithi153.stdout:1/532: rename d0/dd/c1d to d0/dd/db2/d80/cc0 0 2024-02-28T16:24:41.170 INFO:tasks.workunit.client.1.smithi153.stdout:7/563: creat d1/d25/df/d26/d3a/d52/fc0 x:0 0 0 2024-02-28T16:24:41.172 INFO:tasks.workunit.client.1.smithi153.stdout:9/497: write d1/d5/d11/f71 [583738,68049] 0 2024-02-28T16:24:41.176 INFO:tasks.workunit.client.1.smithi153.stdout:3/543: creat d4/d8/d1e/d23/da0/fbe x:0 0 0 2024-02-28T16:24:41.191 INFO:tasks.workunit.client.1.smithi153.stdout:5/550: link da/dd/d25/d82/d8f/f98 da/dd/d25/fbb 0 2024-02-28T16:24:41.192 INFO:tasks.workunit.client.1.smithi153.stdout:8/518: creat d0/d12/d15/fb1 x:0 0 0 2024-02-28T16:24:41.193 INFO:tasks.workunit.client.1.smithi153.stdout:4/487: mkdir d4/de/d23/d2b/d4b/d80/d9e 0 2024-02-28T16:24:41.194 INFO:tasks.workunit.client.1.smithi153.stdout:7/564: creat d1/d25/d88/fc1 x:0 0 0 2024-02-28T16:24:41.195 INFO:tasks.workunit.client.1.smithi153.stdout:5/551: write da/dd/f3d [3417831,16863] 0 2024-02-28T16:24:41.196 INFO:tasks.workunit.client.1.smithi153.stdout:3/544: write d4/d8/d1e/d63/f93 [730551,49266] 0 2024-02-28T16:24:41.198 INFO:tasks.workunit.client.1.smithi153.stdout:7/565: write d1/d25/df/d26/f84 [409014,128667] 0 2024-02-28T16:24:41.201 INFO:tasks.workunit.client.1.smithi153.stdout:5/552: fsync da/dd/f3d 0 2024-02-28T16:24:41.206 INFO:tasks.workunit.client.1.smithi153.stdout:2/575: dread d2/d25/f34 [0,4194304] 0 2024-02-28T16:24:41.209 INFO:tasks.workunit.client.1.smithi153.stdout:9/498: dwrite d1/d5/d27/d61/f4f [0,4194304] 0 2024-02-28T16:24:41.223 INFO:tasks.workunit.client.1.smithi153.stdout:6/554: truncate d0/d17/f28 671898 0 2024-02-28T16:24:41.226 INFO:tasks.workunit.client.1.smithi153.stdout:8/519: stat d0/la7 0 2024-02-28T16:24:41.229 INFO:tasks.workunit.client.1.smithi153.stdout:4/488: mknod d4/de/d23/d2b/c9f 0 2024-02-28T16:24:41.229 INFO:tasks.workunit.client.1.smithi153.stdout:8/520: truncate d0/d19/d89/fa2 1422858 0 2024-02-28T16:24:41.232 INFO:tasks.workunit.client.1.smithi153.stdout:7/566: mknod d1/d25/d88/cc2 0 2024-02-28T16:24:41.232 INFO:tasks.workunit.client.1.smithi153.stdout:3/545: write d4/d8/d1e/d2a/d35/f47 [198417,73608] 0 2024-02-28T16:24:41.232 INFO:tasks.workunit.client.1.smithi153.stdout:4/489: truncate d4/de/d23/d2b/d31/f33 629642 0 2024-02-28T16:24:41.234 INFO:tasks.workunit.client.1.smithi153.stdout:6/555: mkdir d0/d1d/d33/d9c/d48/d63/d8c/dc3 0 2024-02-28T16:24:41.234 INFO:tasks.workunit.client.1.smithi153.stdout:7/567: write d1/d25/df/f4e [1859419,50774] 0 2024-02-28T16:24:41.235 INFO:tasks.workunit.client.1.smithi153.stdout:8/521: creat d0/d34/fb2 x:0 0 0 2024-02-28T16:24:41.236 INFO:tasks.workunit.client.1.smithi153.stdout:5/553: creat da/dd/d54/db0/fbc x:0 0 0 2024-02-28T16:24:41.237 INFO:tasks.workunit.client.1.smithi153.stdout:4/490: chown d4/de/d47/d5e/d62/l74 1688913 1 2024-02-28T16:24:41.237 INFO:tasks.workunit.client.1.smithi153.stdout:2/576: symlink d2/d25/db4/lb8 0 2024-02-28T16:24:41.239 INFO:tasks.workunit.client.1.smithi153.stdout:8/522: mkdir d0/d25/d79/db3 0 2024-02-28T16:24:41.241 INFO:tasks.workunit.client.1.smithi153.stdout:3/546: link d4/d13/d28/d36/f90 d4/d8/d1e/d23/fbf 0 2024-02-28T16:24:41.242 INFO:tasks.workunit.client.1.smithi153.stdout:2/577: mkdir d2/d19/d3e/db9 0 2024-02-28T16:24:41.248 INFO:tasks.workunit.client.1.smithi153.stdout:8/523: dread d0/d19/d2b/d2d/f5a [0,4194304] 0 2024-02-28T16:24:41.248 INFO:tasks.workunit.client.1.smithi153.stdout:5/554: creat da/d29/d43/d5a/fbd x:0 0 0 2024-02-28T16:24:41.248 INFO:tasks.workunit.client.1.smithi153.stdout:3/547: mknod d4/d2c/cc0 0 2024-02-28T16:24:41.248 INFO:tasks.workunit.client.1.smithi153.stdout:8/524: stat d0/d12/d67/d88/d85 0 2024-02-28T16:24:41.248 INFO:tasks.workunit.client.1.smithi153.stdout:5/555: fdatasync da/f6c 0 2024-02-28T16:24:41.248 INFO:tasks.workunit.client.1.smithi153.stdout:3/548: stat d4/d8/d1e/d2a/d35/d54/la5 0 2024-02-28T16:24:41.248 INFO:tasks.workunit.client.1.smithi153.stdout:0/574: truncate d4/d32/d7f/d8a/dab/f37 568924 0 2024-02-28T16:24:41.251 INFO:tasks.workunit.client.1.smithi153.stdout:3/549: truncate d4/d7d/d41/f79 529600 0 2024-02-28T16:24:41.255 INFO:tasks.workunit.client.1.smithi153.stdout:8/525: mkdir d0/d12/d67/d30/d63/d74/db4 0 2024-02-28T16:24:41.259 INFO:tasks.workunit.client.1.smithi153.stdout:6/556: rename d0/d1d/d33/d9c/l16 to d0/d1d/d33/d9c/d2e/lc4 0 2024-02-28T16:24:41.260 INFO:tasks.workunit.client.1.smithi153.stdout:0/575: creat d4/d32/d7f/d8a/fc6 x:0 0 0 2024-02-28T16:24:41.261 INFO:tasks.workunit.client.1.smithi153.stdout:3/550: creat d4/d2c/fc1 x:0 0 0 2024-02-28T16:24:41.262 INFO:tasks.workunit.client.1.smithi153.stdout:8/526: truncate d0/d19/d2b/d2d/f5e 5226763 0 2024-02-28T16:24:41.265 INFO:tasks.workunit.client.1.smithi153.stdout:6/557: chown d0/d1d/d33/d9c/d68/f7b 0 1 2024-02-28T16:24:41.266 INFO:tasks.workunit.client.1.smithi153.stdout:3/551: mknod d4/d7d/d41/cc2 0 2024-02-28T16:24:41.266 INFO:tasks.workunit.client.1.smithi153.stdout:8/527: mknod d0/d19/d2b/d2d/d3f/d9f/cb5 0 2024-02-28T16:24:41.267 INFO:tasks.workunit.client.1.smithi153.stdout:6/558: fdatasync d0/d1d/d33/d9c/d48/d63/f9f 0 2024-02-28T16:24:41.268 INFO:tasks.workunit.client.1.smithi153.stdout:3/552: readlink d4/d8/d1e/d23/l4b 0 2024-02-28T16:24:41.269 INFO:tasks.workunit.client.1.smithi153.stdout:9/499: truncate d1/d5/d27/d61/f25 1394453 0 2024-02-28T16:24:41.270 INFO:tasks.workunit.client.1.smithi153.stdout:8/528: mkdir d0/d12/d67/d88/d85/db6 0 2024-02-28T16:24:41.274 INFO:tasks.workunit.client.1.smithi153.stdout:8/529: creat d0/d12/d67/d88/d8e/d9d/fb7 x:0 0 0 2024-02-28T16:24:41.276 INFO:tasks.workunit.client.1.smithi153.stdout:5/556: rmdir da/d29/d43 39 2024-02-28T16:24:41.281 INFO:tasks.workunit.client.1.smithi153.stdout:3/553: creat d4/fc3 x:0 0 0 2024-02-28T16:24:41.282 INFO:tasks.workunit.client.1.smithi153.stdout:4/491: truncate d4/f38 3617330 0 2024-02-28T16:24:41.286 INFO:tasks.workunit.client.1.smithi153.stdout:6/559: dwrite d0/d1d/d33/d9c/f3e [4194304,4194304] 0 2024-02-28T16:24:41.287 INFO:tasks.workunit.client.1.smithi153.stdout:8/530: rename d0/d19/f43 to d0/d12/d67/d88/d96/fb8 0 2024-02-28T16:24:41.293 INFO:tasks.workunit.client.1.smithi153.stdout:3/554: fsync d4/d8/d1e/d2a/d35/f39 0 2024-02-28T16:24:41.298 INFO:tasks.workunit.client.1.smithi153.stdout:4/492: dread d4/f5 [0,4194304] 0 2024-02-28T16:24:41.302 INFO:tasks.workunit.client.1.smithi153.stdout:4/493: dread d4/de/d23/d2b/d31/f33 [0,4194304] 0 2024-02-28T16:24:41.303 INFO:tasks.workunit.client.1.smithi153.stdout:3/555: creat d4/d7d/d41/d71/fc4 x:0 0 0 2024-02-28T16:24:41.306 INFO:tasks.workunit.client.1.smithi153.stdout:8/531: creat d0/d12/d67/d88/d85/db6/fb9 x:0 0 0 2024-02-28T16:24:41.308 INFO:tasks.workunit.client.1.smithi153.stdout:8/532: chown d0/d12/d67/d30/f3a 7 1 2024-02-28T16:24:41.309 INFO:tasks.workunit.client.1.smithi153.stdout:6/560: link d0/d1d/d5d/d6b/da4/d60/f74 d0/d1d/d33/d9c/d68/da1/fc5 0 2024-02-28T16:24:41.310 INFO:tasks.workunit.client.1.smithi153.stdout:3/556: stat d4/d7d/d41/l48 0 2024-02-28T16:24:41.311 INFO:tasks.workunit.client.1.smithi153.stdout:3/557: fdatasync d4/d8/f10 0 2024-02-28T16:24:41.312 INFO:tasks.workunit.client.1.smithi153.stdout:4/494: creat d4/de/d23/d2b/d4b/fa0 x:0 0 0 2024-02-28T16:24:41.314 INFO:tasks.workunit.client.1.smithi153.stdout:3/558: chown d4/d8/d1e/d23/l4b 6530649 1 2024-02-28T16:24:41.314 INFO:tasks.workunit.client.1.smithi153.stdout:8/533: unlink d0/d12/d67/d88/d8e/fac 0 2024-02-28T16:24:41.315 INFO:tasks.workunit.client.1.smithi153.stdout:9/500: truncate d1/d5/d11/d1f/d20/f68 1609966 0 2024-02-28T16:24:41.315 INFO:tasks.workunit.client.1.smithi153.stdout:3/559: fdatasync d4/d13/d8f/fb9 0 2024-02-28T16:24:41.323 INFO:tasks.workunit.client.1.smithi153.stdout:6/561: mknod d0/d1d/cc6 0 2024-02-28T16:24:41.326 INFO:tasks.workunit.client.1.smithi153.stdout:1/533: sync 2024-02-28T16:24:41.327 INFO:tasks.workunit.client.1.smithi153.stdout:3/560: mknod d4/d7d/d70/cc5 0 2024-02-28T16:24:41.329 INFO:tasks.workunit.client.1.smithi153.stdout:9/501: dwrite d1/d69/f94 [0,4194304] 0 2024-02-28T16:24:41.335 INFO:tasks.workunit.client.1.smithi153.stdout:1/534: chown d0/dd/db2/d89/fa8 3777494 1 2024-02-28T16:24:41.337 INFO:tasks.workunit.client.1.smithi153.stdout:3/561: symlink d4/d8/d1e/d2a/d35/d54/lc6 0 2024-02-28T16:24:41.338 INFO:tasks.workunit.client.1.smithi153.stdout:3/562: read - d4/d8/d1e/fa8 zero size 2024-02-28T16:24:41.341 INFO:tasks.workunit.client.1.smithi153.stdout:6/562: symlink d0/d1d/lc7 0 2024-02-28T16:24:41.341 INFO:tasks.workunit.client.1.smithi153.stdout:3/563: chown d4/d8/d1e/d2a/d55/da3/db1/lb6 31483 1 2024-02-28T16:24:41.342 INFO:tasks.workunit.client.1.smithi153.stdout:3/564: stat d4/d7d 0 2024-02-28T16:24:41.346 INFO:tasks.workunit.client.1.smithi153.stdout:9/502: creat d1/d5/d11/d1f/d52/fa1 x:0 0 0 2024-02-28T16:24:41.348 INFO:tasks.workunit.client.1.smithi153.stdout:8/534: write d0/d19/d2b/f72 [8501214,22629] 0 2024-02-28T16:24:41.350 INFO:tasks.workunit.client.1.smithi153.stdout:1/535: mkdir d0/dc1 0 2024-02-28T16:24:41.352 INFO:tasks.workunit.client.1.smithi153.stdout:3/565: mknod d4/d8/d1e/d23/da0/cc7 0 2024-02-28T16:24:41.353 INFO:tasks.workunit.client.1.smithi153.stdout:8/535: write d0/d12/d67/d88/d8e/f9c [781542,125035] 0 2024-02-28T16:24:41.353 INFO:tasks.workunit.client.1.smithi153.stdout:6/563: dread d0/d1d/d33/d9c/f86 [0,4194304] 0 2024-02-28T16:24:41.355 INFO:tasks.workunit.client.1.smithi153.stdout:4/495: dread d4/de/d13/f20 [0,4194304] 0 2024-02-28T16:24:41.358 INFO:tasks.workunit.client.1.smithi153.stdout:3/566: write d4/d7d/f3d [8616003,103881] 0 2024-02-28T16:24:41.360 INFO:tasks.workunit.client.1.smithi153.stdout:1/536: creat d0/d3d/d4a/d59/d9a/fc2 x:0 0 0 2024-02-28T16:24:41.363 INFO:tasks.workunit.client.1.smithi153.stdout:8/536: rmdir d0/d12/d67/d30/d63/d74 39 2024-02-28T16:24:41.367 INFO:tasks.workunit.client.1.smithi153.stdout:3/567: symlink d4/d8/d1e/d2a/d55/da3/db5/lc8 0 2024-02-28T16:24:41.369 INFO:tasks.workunit.client.1.smithi153.stdout:8/537: symlink d0/d12/lba 0 2024-02-28T16:24:41.396 INFO:tasks.workunit.client.1.smithi153.stdout:6/564: write d0/d1d/d33/f3b [1405993,72246] 0 2024-02-28T16:24:41.398 INFO:tasks.workunit.client.1.smithi153.stdout:9/503: dread d1/d5/d11/d1f/d20/d5d/f5f [0,4194304] 0 2024-02-28T16:24:41.399 INFO:tasks.workunit.client.1.smithi153.stdout:3/568: creat d4/d8/d1e/d2a/d35/fc9 x:0 0 0 2024-02-28T16:24:41.401 INFO:tasks.workunit.client.1.smithi153.stdout:8/538: write d0/d12/d67/d88/d85/db6/fb9 [198386,1585] 0 2024-02-28T16:24:41.405 INFO:tasks.workunit.client.1.smithi153.stdout:3/569: rmdir d4/d13/d28/d36 39 2024-02-28T16:24:41.405 INFO:tasks.workunit.client.1.smithi153.stdout:1/537: dwrite d0/d3d/f72 [0,4194304] 0 2024-02-28T16:24:41.406 INFO:tasks.workunit.client.1.smithi153.stdout:3/570: chown d4/d2c/cc0 2 1 2024-02-28T16:24:41.408 INFO:tasks.workunit.client.1.smithi153.stdout:8/539: creat d0/d25/fbb x:0 0 0 2024-02-28T16:24:41.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/540: readlink d0/d19/d1e/l3b 0 2024-02-28T16:24:41.411 INFO:tasks.workunit.client.1.smithi153.stdout:8/541: chown d0/d12/c94 1382186 1 2024-02-28T16:24:41.414 INFO:tasks.workunit.client.1.smithi153.stdout:9/504: link d1/d5/d11/c1b d1/d5/d11/d1f/d20/d36/ca2 0 2024-02-28T16:24:41.418 INFO:tasks.workunit.client.1.smithi153.stdout:9/505: write d1/ff [1826049,119569] 0 2024-02-28T16:24:41.419 INFO:tasks.workunit.client.1.smithi153.stdout:8/542: mknod d0/d12/d67/d88/d85/db6/cbc 0 2024-02-28T16:24:41.420 INFO:tasks.workunit.client.1.smithi153.stdout:3/571: link d4/d8/d1e/d63/c78 d4/d8/d1e/d2a/cca 0 2024-02-28T16:24:41.423 INFO:tasks.workunit.client.1.smithi153.stdout:7/568: sync 2024-02-28T16:24:41.423 INFO:tasks.workunit.client.1.smithi153.stdout:8/543: symlink d0/d12/d67/d88/lbd 0 2024-02-28T16:24:41.424 INFO:tasks.workunit.client.1.smithi153.stdout:1/538: dwrite d0/f40 [0,4194304] 0 2024-02-28T16:24:41.424 INFO:tasks.workunit.client.1.smithi153.stdout:9/506: mkdir d1/d5/d11/d1f/d43/da3 0 2024-02-28T16:24:41.425 INFO:tasks.workunit.client.1.smithi153.stdout:7/569: chown d1/d25/dc/d50 1 1 2024-02-28T16:24:41.426 INFO:tasks.workunit.client.1.smithi153.stdout:7/570: fsync d1/f82 0 2024-02-28T16:24:41.430 INFO:tasks.workunit.client.1.smithi153.stdout:1/539: creat d0/d62/d66/fc3 x:0 0 0 2024-02-28T16:24:41.433 INFO:tasks.workunit.client.1.smithi153.stdout:3/572: getdents d4/d8/d1e/d87 0 2024-02-28T16:24:41.439 INFO:tasks.workunit.client.1.smithi153.stdout:7/571: mknod d1/d25/df/d26/d3a/d52/cc3 0 2024-02-28T16:24:41.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/507: mknod d1/d5/d11/d64/d85/d9a/ca4 0 2024-02-28T16:24:41.442 INFO:tasks.workunit.client.1.smithi153.stdout:3/573: symlink d4/d8/d1e/d87/lcb 0 2024-02-28T16:24:41.444 INFO:tasks.workunit.client.1.smithi153.stdout:8/544: rename d0/d12/d67/d30/d63/f9a to d0/d25/d79/db3/fbe 0 2024-02-28T16:24:41.444 INFO:tasks.workunit.client.1.smithi153.stdout:7/572: rmdir d1/d25 39 2024-02-28T16:24:41.445 INFO:tasks.workunit.client.1.smithi153.stdout:1/540: truncate d0/dd/f37 1605676 0 2024-02-28T16:24:41.447 INFO:tasks.workunit.client.1.smithi153.stdout:9/508: write d1/d5/d11/d64/f67 [3687210,68370] 0 2024-02-28T16:24:41.447 INFO:tasks.workunit.client.1.smithi153.stdout:1/541: dread - d0/dd/db2/d89/f92 zero size 2024-02-28T16:24:41.448 INFO:tasks.workunit.client.1.smithi153.stdout:3/574: write d4/d13/d28/d36/f56 [1458972,14038] 0 2024-02-28T16:24:41.452 INFO:tasks.workunit.client.1.smithi153.stdout:7/573: chown d1/d25/df/d26/d3a/d95/d97 1950500018 1 2024-02-28T16:24:41.453 INFO:tasks.workunit.client.1.smithi153.stdout:9/509: mknod d1/d5/d11/d29/ca5 0 2024-02-28T16:24:41.453 INFO:tasks.workunit.client.1.smithi153.stdout:3/575: mkdir d4/d13/dcc 0 2024-02-28T16:24:41.454 INFO:tasks.workunit.client.1.smithi153.stdout:9/510: dread - d1/d5/d11/d64/f87 zero size 2024-02-28T16:24:41.458 INFO:tasks.workunit.client.1.smithi153.stdout:8/545: dwrite d0/f51 [0,4194304] 0 2024-02-28T16:24:41.461 INFO:tasks.workunit.client.1.smithi153.stdout:9/511: chown d1/d5/d11/c1b 55 1 2024-02-28T16:24:41.462 INFO:tasks.workunit.client.1.smithi153.stdout:1/542: rename d0/d3d/d4a/f7b to d0/fc4 0 2024-02-28T16:24:41.466 INFO:tasks.workunit.client.1.smithi153.stdout:9/512: creat d1/d5/d11/d64/fa6 x:0 0 0 2024-02-28T16:24:41.476 INFO:tasks.workunit.client.1.smithi153.stdout:7/574: rename d1/d25/df/d26/d3a/d52 to d1/d25/d27/d7c/dc4 0 2024-02-28T16:24:41.480 INFO:tasks.workunit.client.1.smithi153.stdout:9/513: mknod d1/d5/d11/d1f/ca7 0 2024-02-28T16:24:41.482 INFO:tasks.workunit.client.1.smithi153.stdout:1/543: link d0/d3d/f71 d0/dd/fc5 0 2024-02-28T16:24:41.483 INFO:tasks.workunit.client.1.smithi153.stdout:8/546: dwrite d0/d25/fbb [0,4194304] 0 2024-02-28T16:24:41.488 INFO:tasks.workunit.client.1.smithi153.stdout:9/514: rename d1/d5/d27/d61 to d1/d74/d80/da8 0 2024-02-28T16:24:41.491 INFO:tasks.workunit.client.1.smithi153.stdout:9/515: chown d1/d74/d80/da8/f4f 132019 1 2024-02-28T16:24:41.495 INFO:tasks.workunit.client.1.smithi153.stdout:1/544: getdents d0/d3d/d4a 0 2024-02-28T16:24:41.496 INFO:tasks.workunit.client.1.smithi153.stdout:7/575: dwrite d1/d25/dc/f64 [0,4194304] 0 2024-02-28T16:24:41.505 INFO:tasks.workunit.client.1.smithi153.stdout:8/547: write d0/d19/f48 [379605,128401] 0 2024-02-28T16:24:41.508 INFO:tasks.workunit.client.1.smithi153.stdout:8/548: rmdir d0/d12/d67/d88/d96 39 2024-02-28T16:24:41.510 INFO:tasks.workunit.client.1.smithi153.stdout:8/549: read - d0/d34/fb2 zero size 2024-02-28T16:24:41.512 INFO:tasks.workunit.client.1.smithi153.stdout:7/576: dwrite d1/d25/df/d26/d3a/d95/fb6 [0,4194304] 0 2024-02-28T16:24:41.514 INFO:tasks.workunit.client.1.smithi153.stdout:8/550: fsync d0/d12/d67/f4e 0 2024-02-28T16:24:41.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/576: sync 2024-02-28T16:24:41.528 INFO:tasks.workunit.client.1.smithi153.stdout:2/578: sync 2024-02-28T16:24:41.530 INFO:tasks.workunit.client.1.smithi153.stdout:2/579: stat d2/d19/d2a/f45 0 2024-02-28T16:24:41.531 INFO:tasks.workunit.client.1.smithi153.stdout:7/577: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:24:41.531 INFO:tasks.workunit.client.1.smithi153.stdout:8/551: dwrite d0/d19/d2b/d2d/f35 [0,4194304] 0 2024-02-28T16:24:41.533 INFO:tasks.workunit.client.1.smithi153.stdout:7/578: chown d1/d25/dc/c22 3919471 1 2024-02-28T16:24:41.538 INFO:tasks.workunit.client.1.smithi153.stdout:0/577: symlink d4/d32/d7f/db3/dc2/lc7 0 2024-02-28T16:24:41.543 INFO:tasks.workunit.client.1.smithi153.stdout:7/579: read d1/d25/dc/faa [389770,70043] 0 2024-02-28T16:24:41.544 INFO:tasks.workunit.client.1.smithi153.stdout:8/552: creat d0/d19/d2b/d2d/d3f/fbf x:0 0 0 2024-02-28T16:24:41.544 INFO:tasks.workunit.client.1.smithi153.stdout:0/578: chown d4/d27/l95 31697 1 2024-02-28T16:24:41.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/580: fsync d1/d25/df/d26/f92 0 2024-02-28T16:24:41.551 INFO:tasks.workunit.client.1.smithi153.stdout:2/580: dwrite d2/f67 [0,4194304] 0 2024-02-28T16:24:41.563 INFO:tasks.workunit.client.1.smithi153.stdout:2/581: unlink d2/c5 0 2024-02-28T16:24:41.568 INFO:tasks.workunit.client.1.smithi153.stdout:8/553: creat d0/fc0 x:0 0 0 2024-02-28T16:24:41.570 INFO:tasks.workunit.client.1.smithi153.stdout:7/581: creat d1/d70/dbf/fc5 x:0 0 0 2024-02-28T16:24:41.576 INFO:tasks.workunit.client.1.smithi153.stdout:0/579: write d4/d9b/fa7 [602770,122416] 0 2024-02-28T16:24:41.577 INFO:tasks.workunit.client.1.smithi153.stdout:8/554: dread d0/d25/d79/db3/fbe [0,4194304] 0 2024-02-28T16:24:41.612 INFO:tasks.workunit.client.1.smithi153.stdout:5/557: sync 2024-02-28T16:24:41.612 INFO:tasks.workunit.client.1.smithi153.stdout:4/496: sync 2024-02-28T16:24:41.612 INFO:tasks.workunit.client.1.smithi153.stdout:6/565: sync 2024-02-28T16:24:41.620 INFO:tasks.workunit.client.1.smithi153.stdout:7/582: dwrite d1/d25/df/d60/f89 [0,4194304] 0 2024-02-28T16:24:41.623 INFO:tasks.workunit.client.1.smithi153.stdout:5/558: unlink da/dd/d25/f5d 0 2024-02-28T16:24:41.625 INFO:tasks.workunit.client.1.smithi153.stdout:6/566: unlink d0/d1d/d5d/d6b/da4/d60/f74 0 2024-02-28T16:24:41.628 INFO:tasks.workunit.client.1.smithi153.stdout:7/583: write d1/d25/d27/d7c/dc4/fc0 [89744,90706] 0 2024-02-28T16:24:41.629 INFO:tasks.workunit.client.1.smithi153.stdout:8/555: dwrite d0/d12/d67/f4e [4194304,4194304] 0 2024-02-28T16:24:41.634 INFO:tasks.workunit.client.1.smithi153.stdout:8/556: truncate d0/d34/f8f 178976 0 2024-02-28T16:24:41.634 INFO:tasks.workunit.client.1.smithi153.stdout:5/559: rmdir da/dd/d25/d8a 39 2024-02-28T16:24:41.635 INFO:tasks.workunit.client.1.smithi153.stdout:6/567: fsync d0/d1d/d5d/d6b/da4/f26 0 2024-02-28T16:24:41.636 INFO:tasks.workunit.client.1.smithi153.stdout:8/557: chown d0/d12/d67/d88/f2c 1345 1 2024-02-28T16:24:41.638 INFO:tasks.workunit.client.1.smithi153.stdout:4/497: truncate d4/d53/f76 639032 0 2024-02-28T16:24:41.638 INFO:tasks.workunit.client.1.smithi153.stdout:6/568: readlink d0/d1d/d33/d9c/d48/l79 0 2024-02-28T16:24:41.650 INFO:tasks.workunit.client.1.smithi153.stdout:7/584: dwrite d1/d70/dbf/fc5 [0,4194304] 0 2024-02-28T16:24:41.650 INFO:tasks.workunit.client.1.smithi153.stdout:0/580: dread d4/d32/d7f/d8a/dab/f24 [4194304,4194304] 0 2024-02-28T16:24:41.653 INFO:tasks.workunit.client.1.smithi153.stdout:0/581: dread - d4/d27/d9a/da1/db0/fbd zero size 2024-02-28T16:24:41.654 INFO:tasks.workunit.client.1.smithi153.stdout:0/582: stat d4/d99/cb8 0 2024-02-28T16:24:41.655 INFO:tasks.workunit.client.1.smithi153.stdout:4/498: link d4/d8d/l90 d4/de/d47/la1 0 2024-02-28T16:24:41.657 INFO:tasks.workunit.client.1.smithi153.stdout:5/560: getdents da/dd/d54 0 2024-02-28T16:24:41.658 INFO:tasks.workunit.client.1.smithi153.stdout:5/561: read - da/f73 zero size 2024-02-28T16:24:41.663 INFO:tasks.workunit.client.1.smithi153.stdout:5/562: write da/dd/d54/fa1 [337951,109449] 0 2024-02-28T16:24:41.664 INFO:tasks.workunit.client.1.smithi153.stdout:5/563: chown da/dd/f3d 303 1 2024-02-28T16:24:41.667 INFO:tasks.workunit.client.1.smithi153.stdout:8/558: dwrite d0/d12/d67/d30/f3a [0,4194304] 0 2024-02-28T16:24:41.667 INFO:tasks.workunit.client.1.smithi153.stdout:0/583: symlink d4/d32/d7f/d8a/dab/d8e/d94/lc8 0 2024-02-28T16:24:41.668 INFO:tasks.workunit.client.1.smithi153.stdout:5/564: dread - da/dd/d25/d82/d8f/f98 zero size 2024-02-28T16:24:41.668 INFO:tasks.workunit.client.1.smithi153.stdout:8/559: readlink d0/d34/l46 0 2024-02-28T16:24:41.668 INFO:tasks.workunit.client.1.smithi153.stdout:0/584: chown d4/d32/f36 1801 1 2024-02-28T16:24:41.669 INFO:tasks.workunit.client.1.smithi153.stdout:4/499: mkdir d4/de/d23/d2b/d31/da2 0 2024-02-28T16:24:41.676 INFO:tasks.workunit.client.1.smithi153.stdout:4/500: mkdir d4/d8d/da3 0 2024-02-28T16:24:41.682 INFO:tasks.workunit.client.1.smithi153.stdout:0/585: rename d4/d32/d7f/d8a/f9d to d4/d27/dc1/fc9 0 2024-02-28T16:24:41.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/560: truncate d0/d12/d15/f6d 1601323 0 2024-02-28T16:24:41.683 INFO:tasks.workunit.client.1.smithi153.stdout:6/569: truncate d0/d1d/f47 3864995 0 2024-02-28T16:24:41.685 INFO:tasks.workunit.client.1.smithi153.stdout:8/561: write d0/d12/d67/d30/f65 [4269811,95173] 0 2024-02-28T16:24:41.690 INFO:tasks.workunit.client.1.smithi153.stdout:4/501: rmdir d4/de 39 2024-02-28T16:24:41.691 INFO:tasks.workunit.client.1.smithi153.stdout:7/585: truncate d1/d25/df/d5a/f78 344678 0 2024-02-28T16:24:41.694 INFO:tasks.workunit.client.1.smithi153.stdout:0/586: creat d4/d99/da5/fca x:0 0 0 2024-02-28T16:24:41.701 INFO:tasks.workunit.client.1.smithi153.stdout:5/565: write da/dd/f31 [4195425,23350] 0 2024-02-28T16:24:41.705 INFO:tasks.workunit.client.1.smithi153.stdout:4/502: truncate d4/de/d40/d4d/f94 387143 0 2024-02-28T16:24:41.706 INFO:tasks.workunit.client.1.smithi153.stdout:6/570: mknod d0/d1d/d5d/d6b/da4/cc8 0 2024-02-28T16:24:41.707 INFO:tasks.workunit.client.1.smithi153.stdout:0/587: dread d4/f53 [0,4194304] 0 2024-02-28T16:24:41.708 INFO:tasks.workunit.client.1.smithi153.stdout:7/586: dwrite d1/d25/df/d26/f92 [0,4194304] 0 2024-02-28T16:24:41.710 INFO:tasks.workunit.client.1.smithi153.stdout:0/588: stat d4/d32/d7f/d8a/dab/d8e/d90/l10 0 2024-02-28T16:24:41.711 INFO:tasks.workunit.client.1.smithi153.stdout:3/576: sync 2024-02-28T16:24:41.715 INFO:tasks.workunit.client.1.smithi153.stdout:4/503: mkdir d4/d53/d7c/da4 0 2024-02-28T16:24:41.716 INFO:tasks.workunit.client.1.smithi153.stdout:6/571: symlink d0/d1d/d33/d9c/d48/d63/lc9 0 2024-02-28T16:24:41.717 INFO:tasks.workunit.client.1.smithi153.stdout:8/562: link d0/la7 d0/d12/d67/d88/d85/lc1 0 2024-02-28T16:24:41.720 INFO:tasks.workunit.client.1.smithi153.stdout:0/589: creat d4/d32/d7f/db3/dc2/fcb x:0 0 0 2024-02-28T16:24:41.722 INFO:tasks.workunit.client.1.smithi153.stdout:3/577: write d4/d8/d1e/d2a/d35/f51 [2624400,111732] 0 2024-02-28T16:24:41.726 INFO:tasks.workunit.client.1.smithi153.stdout:6/572: stat d0/d1d/d33/d9c/d2e/lc4 0 2024-02-28T16:24:41.726 INFO:tasks.workunit.client.1.smithi153.stdout:7/587: dwrite d1/d25/f33 [0,4194304] 0 2024-02-28T16:24:41.728 INFO:tasks.workunit.client.1.smithi153.stdout:7/588: chown d1/d25/d27/d43/c46 25440 1 2024-02-28T16:24:41.729 INFO:tasks.workunit.client.1.smithi153.stdout:5/566: write da/d29/d43/d5a/d77/f8b [259314,103732] 0 2024-02-28T16:24:41.731 INFO:tasks.workunit.client.1.smithi153.stdout:4/504: mkdir d4/de/d23/d2b/d31/da2/da5 0 2024-02-28T16:24:41.733 INFO:tasks.workunit.client.1.smithi153.stdout:6/573: dread d0/d1d/d33/f7a [0,4194304] 0 2024-02-28T16:24:41.733 INFO:tasks.workunit.client.1.smithi153.stdout:5/567: write da/dd/d25/d82/d8f/f91 [431248,58016] 0 2024-02-28T16:24:41.736 INFO:tasks.workunit.client.1.smithi153.stdout:5/568: write f9 [2586813,90094] 0 2024-02-28T16:24:41.737 INFO:tasks.workunit.client.1.smithi153.stdout:8/563: symlink d0/d12/d67/d30/d63/d74/lc2 0 2024-02-28T16:24:41.737 INFO:tasks.workunit.client.1.smithi153.stdout:3/578: mkdir d4/d13/d28/dcd 0 2024-02-28T16:24:41.739 INFO:tasks.workunit.client.1.smithi153.stdout:5/569: write da/fc [75394,90286] 0 2024-02-28T16:24:41.743 INFO:tasks.workunit.client.1.smithi153.stdout:7/589: rename d1/d25/d27/c2e to d1/d25/d27/d7c/cc6 0 2024-02-28T16:24:41.745 INFO:tasks.workunit.client.1.smithi153.stdout:6/574: creat d0/d1d/d33/d9c/d48/d72/fca x:0 0 0 2024-02-28T16:24:41.749 INFO:tasks.workunit.client.1.smithi153.stdout:0/590: link d4/d32/d7f/db3/dc2/lc7 d4/d27/dc1/lcc 0 2024-02-28T16:24:41.752 INFO:tasks.workunit.client.1.smithi153.stdout:4/505: getdents d4/d8d/da3 0 2024-02-28T16:24:41.753 INFO:tasks.workunit.client.1.smithi153.stdout:9/516: sync 2024-02-28T16:24:41.753 INFO:tasks.workunit.client.1.smithi153.stdout:1/545: sync 2024-02-28T16:24:41.753 INFO:tasks.workunit.client.1.smithi153.stdout:2/582: sync 2024-02-28T16:24:41.755 INFO:tasks.workunit.client.1.smithi153.stdout:4/506: write d4/de/d23/d2b/d31/f96 [105379,121245] 0 2024-02-28T16:24:41.756 INFO:tasks.workunit.client.1.smithi153.stdout:1/546: write d0/dd/db2/d89/dad/fb8 [834819,127620] 0 2024-02-28T16:24:41.758 INFO:tasks.workunit.client.1.smithi153.stdout:6/575: unlink d0/d1d/d33/d9c/f3a 0 2024-02-28T16:24:41.759 INFO:tasks.workunit.client.1.smithi153.stdout:6/576: fdatasync d0/f52 0 2024-02-28T16:24:41.762 INFO:tasks.workunit.client.1.smithi153.stdout:3/579: symlink d4/d13/d28/lce 0 2024-02-28T16:24:41.763 INFO:tasks.workunit.client.1.smithi153.stdout:3/580: truncate d4/f81 1042635 0 2024-02-28T16:24:41.764 INFO:tasks.workunit.client.1.smithi153.stdout:3/581: chown d4/d7d/d41/d71/fa6 170 1 2024-02-28T16:24:41.766 INFO:tasks.workunit.client.1.smithi153.stdout:2/583: mknod d2/d19/d3e/da7/cba 0 2024-02-28T16:24:41.768 INFO:tasks.workunit.client.1.smithi153.stdout:9/517: mknod d1/d5/d11/d1f/d20/d99/ca9 0 2024-02-28T16:24:41.768 INFO:tasks.workunit.client.1.smithi153.stdout:8/564: write d0/d12/f28 [156820,100334] 0 2024-02-28T16:24:41.770 INFO:tasks.workunit.client.1.smithi153.stdout:8/565: write d0/d12/d15/fb1 [943680,35637] 0 2024-02-28T16:24:41.770 INFO:tasks.workunit.client.1.smithi153.stdout:4/507: fsync d4/de/f57 0 2024-02-28T16:24:41.772 INFO:tasks.workunit.client.1.smithi153.stdout:8/566: chown d0/d12/d67/d30/d63/d74/db4 7003 1 2024-02-28T16:24:41.772 INFO:tasks.workunit.client.1.smithi153.stdout:4/508: chown d4/de/d23/d2b/d31/c52 65282 1 2024-02-28T16:24:41.775 INFO:tasks.workunit.client.1.smithi153.stdout:8/567: chown d0/d19/d2b/d2d/d3f/d9f/fb0 25 1 2024-02-28T16:24:41.776 INFO:tasks.workunit.client.1.smithi153.stdout:6/577: mkdir d0/d1d/d33/d9c/d68/dcb 0 2024-02-28T16:24:41.777 INFO:tasks.workunit.client.1.smithi153.stdout:8/568: chown d0/d34/fb2 1498 1 2024-02-28T16:24:41.777 INFO:tasks.workunit.client.1.smithi153.stdout:5/570: getdents da/dd/d25/d41 0 2024-02-28T16:24:41.778 INFO:tasks.workunit.client.1.smithi153.stdout:3/582: creat d4/d8/d1e/d87/fcf x:0 0 0 2024-02-28T16:24:41.782 INFO:tasks.workunit.client.1.smithi153.stdout:7/590: dwrite d1/d25/df/d26/d76/f9a [0,4194304] 0 2024-02-28T16:24:41.782 INFO:tasks.workunit.client.1.smithi153.stdout:4/509: unlink d4/de/c25 0 2024-02-28T16:24:41.787 INFO:tasks.workunit.client.1.smithi153.stdout:2/584: mkdir d2/d23/d88/d95/dbb 0 2024-02-28T16:24:41.789 INFO:tasks.workunit.client.1.smithi153.stdout:2/585: write d2/d25/f6d [18756,67830] 0 2024-02-28T16:24:41.789 INFO:tasks.workunit.client.1.smithi153.stdout:1/547: dwrite d0/dd/d84/fa4 [0,4194304] 0 2024-02-28T16:24:41.790 INFO:tasks.workunit.client.1.smithi153.stdout:1/548: chown d0/c24 51061 1 2024-02-28T16:24:41.790 INFO:tasks.workunit.client.1.smithi153.stdout:2/586: write d2/d25/fa8 [577429,19406] 0 2024-02-28T16:24:41.791 INFO:tasks.workunit.client.1.smithi153.stdout:6/578: rmdir d0/d1d/d33/d9c/d48/d72 39 2024-02-28T16:24:41.799 INFO:tasks.workunit.client.1.smithi153.stdout:3/583: unlink d4/d13/d28/d36/f90 0 2024-02-28T16:24:41.804 INFO:tasks.workunit.client.1.smithi153.stdout:5/571: rename da/dd/d25/d82/d8f/daa to da/d29/d43/d5a/dbe 0 2024-02-28T16:24:41.806 INFO:tasks.workunit.client.1.smithi153.stdout:5/572: write da/fc [540853,120106] 0 2024-02-28T16:24:41.807 INFO:tasks.workunit.client.1.smithi153.stdout:8/569: write d0/d12/d15/f29 [593860,60625] 0 2024-02-28T16:24:41.809 INFO:tasks.workunit.client.1.smithi153.stdout:0/591: getdents d4/d32/d7f/d8a 0 2024-02-28T16:24:41.810 INFO:tasks.workunit.client.1.smithi153.stdout:7/591: creat d1/d25/dc/d50/d66/fc7 x:0 0 0 2024-02-28T16:24:41.812 INFO:tasks.workunit.client.1.smithi153.stdout:6/579: fsync d0/d66/d85/fad 0 2024-02-28T16:24:41.814 INFO:tasks.workunit.client.1.smithi153.stdout:1/549: creat d0/dd/db2/d89/dad/fc6 x:0 0 0 2024-02-28T16:24:41.815 INFO:tasks.workunit.client.1.smithi153.stdout:3/584: creat d4/d8/d1e/d2a/d55/da3/fd0 x:0 0 0 2024-02-28T16:24:41.818 INFO:tasks.workunit.client.1.smithi153.stdout:1/550: truncate d0/d3d/d4a/f56 5290332 0 2024-02-28T16:24:41.818 INFO:tasks.workunit.client.1.smithi153.stdout:9/518: rename d1/d74/d7c/f9f to d1/d58/d96/faa 0 2024-02-28T16:24:41.823 INFO:tasks.workunit.client.1.smithi153.stdout:9/519: read d1/f34 [734925,35071] 0 2024-02-28T16:24:41.832 INFO:tasks.workunit.client.1.smithi153.stdout:1/551: unlink d0/d3d/l9b 0 2024-02-28T16:24:41.835 INFO:tasks.workunit.client.1.smithi153.stdout:0/592: symlink d4/lcd 0 2024-02-28T16:24:41.836 INFO:tasks.workunit.client.1.smithi153.stdout:2/587: truncate d2/f7 1380881 0 2024-02-28T16:24:41.837 INFO:tasks.workunit.client.1.smithi153.stdout:4/510: dread d4/f32 [4194304,4194304] 0 2024-02-28T16:24:41.838 INFO:tasks.workunit.client.1.smithi153.stdout:8/570: mknod d0/d12/cc3 0 2024-02-28T16:24:41.842 INFO:tasks.workunit.client.1.smithi153.stdout:5/573: rename da/dd/f3d to da/dd/d25/d8a/db3/fbf 0 2024-02-28T16:24:41.842 INFO:tasks.workunit.client.1.smithi153.stdout:8/571: dread d0/d19/d2b/d2d/f5a [0,4194304] 0 2024-02-28T16:24:41.842 INFO:tasks.workunit.client.1.smithi153.stdout:7/592: dwrite d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:41.844 INFO:tasks.workunit.client.1.smithi153.stdout:9/520: write d1/d5/d11/d1f/d20/d36/f38 [7631331,44169] 0 2024-02-28T16:24:41.844 INFO:tasks.workunit.client.1.smithi153.stdout:5/574: read da/fb [1159910,30891] 0 2024-02-28T16:24:41.845 INFO:tasks.workunit.client.1.smithi153.stdout:6/580: mknod d0/d1d/d33/d9c/d48/d72/ccc 0 2024-02-28T16:24:41.851 INFO:tasks.workunit.client.1.smithi153.stdout:5/575: chown da/dd/d25/d41/c72 841 1 2024-02-28T16:24:41.860 INFO:tasks.workunit.client.1.smithi153.stdout:1/552: dwrite d0/d3d/d4a/d59/d9a/fc2 [0,4194304] 0 2024-02-28T16:24:41.860 INFO:tasks.workunit.client.1.smithi153.stdout:5/576: readlink da/d29/d43/d5a/d77/lb6 0 2024-02-28T16:24:41.860 INFO:tasks.workunit.client.1.smithi153.stdout:4/511: dwrite f0 [0,4194304] 0 2024-02-28T16:24:41.862 INFO:tasks.workunit.client.1.smithi153.stdout:1/553: write d0/f16 [4399014,44085] 0 2024-02-28T16:24:41.863 INFO:tasks.workunit.client.1.smithi153.stdout:7/593: mkdir d1/d25/df/d26/d3a/d5e/dc8 0 2024-02-28T16:24:41.871 INFO:tasks.workunit.client.1.smithi153.stdout:9/521: truncate d1/d5/d11/d1f/d20/d36/f37 1725364 0 2024-02-28T16:24:41.873 INFO:tasks.workunit.client.1.smithi153.stdout:8/572: symlink d0/d12/d67/d30/d63/lc4 0 2024-02-28T16:24:41.873 INFO:tasks.workunit.client.1.smithi153.stdout:6/581: dwrite d0/d1d/d33/d9c/f7d [0,4194304] 0 2024-02-28T16:24:41.876 INFO:tasks.workunit.client.1.smithi153.stdout:5/577: creat da/d29/d43/d5a/d77/fc0 x:0 0 0 2024-02-28T16:24:41.878 INFO:tasks.workunit.client.1.smithi153.stdout:3/585: dwrite d4/d8/d1e/d23/fbf [0,4194304] 0 2024-02-28T16:24:41.880 INFO:tasks.workunit.client.1.smithi153.stdout:6/582: chown d0/f81 885 1 2024-02-28T16:24:41.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: pgmap v10: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 MiB/s rd, 130 MiB/s wr, 260 op/s 2024-02-28T16:24:41.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:24:41.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:24:41.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:24:41.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:24:41.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:24:41.881 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:41.882 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:41.882 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:41 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:41.882 INFO:tasks.workunit.client.1.smithi153.stdout:1/554: mkdir d0/dd/db2/d89/dc7 0 2024-02-28T16:24:41.884 INFO:tasks.workunit.client.1.smithi153.stdout:6/583: chown d0/d17/cbf 88 1 2024-02-28T16:24:41.884 INFO:tasks.workunit.client.1.smithi153.stdout:2/588: dread d2/f7d [0,4194304] 0 2024-02-28T16:24:41.888 INFO:tasks.workunit.client.1.smithi153.stdout:7/594: dwrite d1/f82 [0,4194304] 0 2024-02-28T16:24:41.888 INFO:tasks.workunit.client.1.smithi153.stdout:3/586: readlink d4/d49/l7f 0 2024-02-28T16:24:41.891 INFO:tasks.workunit.client.1.smithi153.stdout:0/593: link d4/d32/d7f/d8a/dab/f37 d4/d27/dc1/fce 0 2024-02-28T16:24:41.893 INFO:tasks.workunit.client.1.smithi153.stdout:1/555: creat d0/dd/db2/d89/daa/fc8 x:0 0 0 2024-02-28T16:24:41.896 INFO:tasks.workunit.client.1.smithi153.stdout:1/556: write d0/d3d/d4a/d59/f8c [2703296,11815] 0 2024-02-28T16:24:41.896 INFO:tasks.workunit.client.1.smithi153.stdout:2/589: dread - d2/d19/d2a/f6b zero size 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: pgmap v10: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 MiB/s rd, 130 MiB/s wr, 260 op/s 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/3249237400' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:41.899 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:41 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:41.900 INFO:tasks.workunit.client.1.smithi153.stdout:3/587: mknod d4/d2c/cd1 0 2024-02-28T16:24:41.902 INFO:tasks.workunit.client.1.smithi153.stdout:7/595: mknod d1/d25/d27/d7c/dc4/d63/d75/cc9 0 2024-02-28T16:24:41.904 INFO:tasks.workunit.client.1.smithi153.stdout:7/596: fdatasync d1/d70/dbf/fc5 0 2024-02-28T16:24:41.908 INFO:tasks.workunit.client.1.smithi153.stdout:1/557: mknod d0/d62/d66/cc9 0 2024-02-28T16:24:41.912 INFO:tasks.workunit.client.1.smithi153.stdout:0/594: mkdir d4/d32/dcf 0 2024-02-28T16:24:41.914 INFO:tasks.workunit.client.1.smithi153.stdout:0/595: chown d4/d32/d7f/d8a/dab/f67 5 1 2024-02-28T16:24:41.917 INFO:tasks.workunit.client.1.smithi153.stdout:7/597: dread d1/f6c [0,4194304] 0 2024-02-28T16:24:41.919 INFO:tasks.workunit.client.1.smithi153.stdout:2/590: creat d2/d19/d3e/db9/fbc x:0 0 0 2024-02-28T16:24:41.920 INFO:tasks.workunit.client.1.smithi153.stdout:6/584: getdents d0/d1d/d30/d71/d91 0 2024-02-28T16:24:41.922 INFO:tasks.workunit.client.1.smithi153.stdout:1/558: symlink d0/dd/db2/d89/dc7/lca 0 2024-02-28T16:24:41.930 INFO:tasks.workunit.client.1.smithi153.stdout:0/596: dwrite d4/d32/d7f/d8a/dab/d8e/d90/faf [0,4194304] 0 2024-02-28T16:24:41.934 INFO:tasks.workunit.client.1.smithi153.stdout:6/585: creat d0/d1d/d33/db2/fcd x:0 0 0 2024-02-28T16:24:41.935 INFO:tasks.workunit.client.1.smithi153.stdout:1/559: creat d0/d3d/d4a/fcb x:0 0 0 2024-02-28T16:24:41.940 INFO:tasks.workunit.client.1.smithi153.stdout:2/591: link d2/d19/d2a/d3b/f92 d2/d25/d49/da3/fbd 0 2024-02-28T16:24:41.945 INFO:tasks.workunit.client.1.smithi153.stdout:0/597: rmdir d4/d32/d7f/db3 39 2024-02-28T16:24:41.959 INFO:tasks.workunit.client.1.smithi153.stdout:4/512: dwrite d4/de/d23/f30 [0,4194304] 0 2024-02-28T16:24:41.959 INFO:tasks.workunit.client.1.smithi153.stdout:3/588: rename d4/d8/d1e/d23/l4b to d4/d8/d1e/d2a/d55/da3/db1/ld2 0 2024-02-28T16:24:41.960 INFO:tasks.workunit.client.1.smithi153.stdout:9/522: truncate d1/d74/d80/da8/f3d 799975 0 2024-02-28T16:24:41.961 INFO:tasks.workunit.client.1.smithi153.stdout:1/560: unlink d0/dd/l10 0 2024-02-28T16:24:41.963 INFO:tasks.workunit.client.1.smithi153.stdout:5/578: dwrite da/f19 [0,4194304] 0 2024-02-28T16:24:41.967 INFO:tasks.workunit.client.1.smithi153.stdout:3/589: write d4/d7d/fb4 [116059,67871] 0 2024-02-28T16:24:41.967 INFO:tasks.workunit.client.1.smithi153.stdout:4/513: write d4/de/f19 [4944413,13047] 0 2024-02-28T16:24:41.969 INFO:tasks.workunit.client.1.smithi153.stdout:2/592: creat d2/d19/d2a/d3b/d87/da5/fbe x:0 0 0 2024-02-28T16:24:41.969 INFO:tasks.workunit.client.1.smithi153.stdout:9/523: stat d1/d5/d11/d1f/d20/d5d/c83 0 2024-02-28T16:24:41.972 INFO:tasks.workunit.client.1.smithi153.stdout:8/573: dwrite d0/d19/d2b/d2d/f5e [0,4194304] 0 2024-02-28T16:24:41.980 INFO:tasks.workunit.client.1.smithi153.stdout:4/514: symlink d4/de/d23/d83/la6 0 2024-02-28T16:24:41.982 INFO:tasks.workunit.client.1.smithi153.stdout:7/598: write d1/d25/dc/faa [901295,37317] 0 2024-02-28T16:24:41.985 INFO:tasks.workunit.client.1.smithi153.stdout:3/590: dwrite d4/d8/d1e/f5e [0,4194304] 0 2024-02-28T16:24:41.985 INFO:tasks.workunit.client.1.smithi153.stdout:4/515: write d4/de/f19 [1092178,30591] 0 2024-02-28T16:24:41.986 INFO:tasks.workunit.client.1.smithi153.stdout:1/561: write d0/d3d/fa6 [669358,43659] 0 2024-02-28T16:24:41.986 INFO:tasks.workunit.client.1.smithi153.stdout:2/593: mkdir d2/d23/d88/dbf 0 2024-02-28T16:24:41.991 INFO:tasks.workunit.client.1.smithi153.stdout:6/586: rename d0/d17/la6 to d0/d1d/d33/d9c/lce 0 2024-02-28T16:24:41.994 INFO:tasks.workunit.client.1.smithi153.stdout:6/587: chown d0/d1d/d30/f36 2 1 2024-02-28T16:24:41.994 INFO:tasks.workunit.client.1.smithi153.stdout:5/579: truncate da/d29/d43/d5a/d77/fb1 1398835 0 2024-02-28T16:24:41.995 INFO:tasks.workunit.client.1.smithi153.stdout:7/599: creat d1/d25/d27/fca x:0 0 0 2024-02-28T16:24:41.997 INFO:tasks.workunit.client.1.smithi153.stdout:8/574: dwrite d0/d34/f7b [0,4194304] 0 2024-02-28T16:24:41.999 INFO:tasks.workunit.client.1.smithi153.stdout:3/591: mknod d4/d13/d28/d36/d9f/cd3 0 2024-02-28T16:24:42.000 INFO:tasks.workunit.client.1.smithi153.stdout:4/516: write d4/de/d23/f48 [5047452,104462] 0 2024-02-28T16:24:42.000 INFO:tasks.workunit.client.1.smithi153.stdout:1/562: write d0/d3d/f88 [5312513,107455] 0 2024-02-28T16:24:42.012 INFO:tasks.workunit.client.1.smithi153.stdout:8/575: symlink d0/d19/d89/lc5 0 2024-02-28T16:24:42.013 INFO:tasks.workunit.client.1.smithi153.stdout:2/594: getdents d2/d25/db4 0 2024-02-28T16:24:42.014 INFO:tasks.workunit.client.1.smithi153.stdout:7/600: dread d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:42.015 INFO:tasks.workunit.client.1.smithi153.stdout:2/595: write d2/d19/d8b/f90 [1445682,26169] 0 2024-02-28T16:24:42.016 INFO:tasks.workunit.client.1.smithi153.stdout:7/601: chown d1/f2c 487630 1 2024-02-28T16:24:42.017 INFO:tasks.workunit.client.1.smithi153.stdout:3/592: rename d4/d13/d28/d99/fae to d4/d8/d1e/d2a/d35/d54/fd4 0 2024-02-28T16:24:42.017 INFO:tasks.workunit.client.1.smithi153.stdout:5/580: mknod da/dd/d25/d8a/dac/cc1 0 2024-02-28T16:24:42.019 INFO:tasks.workunit.client.1.smithi153.stdout:7/602: readlink d1/d25/d27/d43/l55 0 2024-02-28T16:24:42.019 INFO:tasks.workunit.client.1.smithi153.stdout:9/524: dread d1/d74/d80/da8/f3d [0,4194304] 0 2024-02-28T16:24:42.021 INFO:tasks.workunit.client.1.smithi153.stdout:5/581: truncate da/f44 610559 0 2024-02-28T16:24:42.021 INFO:tasks.workunit.client.1.smithi153.stdout:1/563: mkdir d0/dd/db2/dcc 0 2024-02-28T16:24:42.021 INFO:tasks.workunit.client.1.smithi153.stdout:3/593: dread - d4/d8/d1e/d2a/d35/fc9 zero size 2024-02-28T16:24:42.022 INFO:tasks.workunit.client.1.smithi153.stdout:9/525: chown d1/d5/d11/d1f/d43 6369 1 2024-02-28T16:24:42.022 INFO:tasks.workunit.client.1.smithi153.stdout:6/588: creat d0/d1d/d5d/d6b/da4/fcf x:0 0 0 2024-02-28T16:24:42.023 INFO:tasks.workunit.client.1.smithi153.stdout:7/603: fdatasync d1/d25/df/d26/d3a/d95/fb6 0 2024-02-28T16:24:42.025 INFO:tasks.workunit.client.1.smithi153.stdout:8/576: fsync d0/d25/d79/db3/fbe 0 2024-02-28T16:24:42.027 INFO:tasks.workunit.client.1.smithi153.stdout:8/577: write d0/d12/d15/f29 [4193764,105618] 0 2024-02-28T16:24:42.029 INFO:tasks.workunit.client.1.smithi153.stdout:3/594: mkdir d4/d8/dd5 0 2024-02-28T16:24:42.032 INFO:tasks.workunit.client.1.smithi153.stdout:5/582: mknod da/d29/d43/d5a/dbe/cc2 0 2024-02-28T16:24:42.037 INFO:tasks.workunit.client.1.smithi153.stdout:1/564: rename d0/dd/db2/f83 to d0/dd/db2/d89/dad/fcd 0 2024-02-28T16:24:42.039 INFO:tasks.workunit.client.1.smithi153.stdout:8/578: mknod d0/d12/d67/d88/d8e/d9d/cc6 0 2024-02-28T16:24:42.042 INFO:tasks.workunit.client.1.smithi153.stdout:9/526: rename d1/d5/d11/f75 to d1/d5/d27/fab 0 2024-02-28T16:24:42.042 INFO:tasks.workunit.client.1.smithi153.stdout:2/596: dread d2/d19/d2a/f45 [0,4194304] 0 2024-02-28T16:24:42.043 INFO:tasks.workunit.client.1.smithi153.stdout:7/604: dread d1/f23 [0,4194304] 0 2024-02-28T16:24:42.043 INFO:tasks.workunit.client.1.smithi153.stdout:9/527: readlink d1/d74/d80/da8/l2f 0 2024-02-28T16:24:42.044 INFO:tasks.workunit.client.1.smithi153.stdout:1/565: stat d0/dd/db2/d80/cc0 0 2024-02-28T16:24:42.044 INFO:tasks.workunit.client.1.smithi153.stdout:8/579: fdatasync d0/f66 0 2024-02-28T16:24:42.047 INFO:tasks.workunit.client.1.smithi153.stdout:2/597: mknod d2/d4b/cc0 0 2024-02-28T16:24:42.051 INFO:tasks.workunit.client.1.smithi153.stdout:8/580: creat d0/d25/d79/fc7 x:0 0 0 2024-02-28T16:24:42.055 INFO:tasks.workunit.client.1.smithi153.stdout:5/583: rename f1 to da/fc3 0 2024-02-28T16:24:42.056 INFO:tasks.workunit.client.1.smithi153.stdout:8/581: chown d0/d12/c14 207 1 2024-02-28T16:24:42.057 INFO:tasks.workunit.client.1.smithi153.stdout:8/582: write d0/d34/f9e [703274,94398] 0 2024-02-28T16:24:42.064 INFO:tasks.workunit.client.1.smithi153.stdout:7/605: getdents d1/d25/df/d26/d76 0 2024-02-28T16:24:42.064 INFO:tasks.workunit.client.1.smithi153.stdout:5/584: fsync da/dd/d25/d82/d8f/f98 0 2024-02-28T16:24:42.064 INFO:tasks.workunit.client.1.smithi153.stdout:9/528: getdents d1/d5/d11/d54 0 2024-02-28T16:24:42.069 INFO:tasks.workunit.client.1.smithi153.stdout:7/606: creat d1/d25/d27/d7c/dc4/d63/fcb x:0 0 0 2024-02-28T16:24:42.072 INFO:tasks.workunit.client.1.smithi153.stdout:9/529: mknod d1/d5/d11/d1f/d20/d5d/cac 0 2024-02-28T16:24:42.075 INFO:tasks.workunit.client.1.smithi153.stdout:2/598: rename d2/d25/fa8 to d2/d19/fc1 0 2024-02-28T16:24:42.085 INFO:tasks.workunit.client.1.smithi153.stdout:8/583: dwrite d0/d19/f38 [0,4194304] 0 2024-02-28T16:24:42.089 INFO:tasks.workunit.client.1.smithi153.stdout:3/595: truncate d4/d2c/f9e 388564 0 2024-02-28T16:24:42.091 INFO:tasks.workunit.client.1.smithi153.stdout:5/585: dread da/dd/d25/f5c [0,4194304] 0 2024-02-28T16:24:42.091 INFO:tasks.workunit.client.1.smithi153.stdout:8/584: chown d0/d12/d67 7 1 2024-02-28T16:24:42.097 INFO:tasks.workunit.client.1.smithi153.stdout:6/589: dwrite d0/d1d/d33/f7a [0,4194304] 0 2024-02-28T16:24:42.099 INFO:tasks.workunit.client.1.smithi153.stdout:2/599: link d2/d19/d2a/c74 d2/d4b/cc2 0 2024-02-28T16:24:42.108 INFO:tasks.workunit.client.1.smithi153.stdout:8/585: mknod d0/d19/d2b/d2d/d3f/d9f/cc8 0 2024-02-28T16:24:42.108 INFO:tasks.workunit.client.1.smithi153.stdout:6/590: fdatasync d0/d1d/d30/d71/f7f 0 2024-02-28T16:24:42.111 INFO:tasks.workunit.client.1.smithi153.stdout:9/530: dwrite d1/d74/d80/da8/f4f [0,4194304] 0 2024-02-28T16:24:42.115 INFO:tasks.workunit.client.1.smithi153.stdout:2/600: rmdir d2/d19/d3e/db9 39 2024-02-28T16:24:42.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/596: getdents d4/d8 0 2024-02-28T16:24:42.115 INFO:tasks.workunit.client.1.smithi153.stdout:1/566: dwrite d0/dd/db2/d89/fa8 [0,4194304] 0 2024-02-28T16:24:42.115 INFO:tasks.workunit.client.1.smithi153.stdout:0/598: sync 2024-02-28T16:24:42.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/607: write d1/d25/df/d26/d3a/f98 [1610594,55264] 0 2024-02-28T16:24:42.122 INFO:tasks.workunit.client.1.smithi153.stdout:2/601: chown d2/d19/d31/l96 210977147 1 2024-02-28T16:24:42.128 INFO:tasks.workunit.client.1.smithi153.stdout:6/591: mkdir d0/d1d/d30/dd0 0 2024-02-28T16:24:42.134 INFO:tasks.workunit.client.1.smithi153.stdout:7/608: chown d1/d25/d27/f5c 8059 1 2024-02-28T16:24:42.135 INFO:tasks.workunit.client.1.smithi153.stdout:0/599: rmdir d4/d32/d7f/d8a/dab/d8e/d90 39 2024-02-28T16:24:42.136 INFO:tasks.workunit.client.1.smithi153.stdout:1/567: symlink d0/d62/d66/lce 0 2024-02-28T16:24:42.140 INFO:tasks.workunit.client.1.smithi153.stdout:5/586: dwrite da/f73 [0,4194304] 0 2024-02-28T16:24:42.149 INFO:tasks.workunit.client.1.smithi153.stdout:3/597: getdents d4/d7d 0 2024-02-28T16:24:42.150 INFO:tasks.workunit.client.1.smithi153.stdout:2/602: unlink d2/d19/d2a/c74 0 2024-02-28T16:24:42.159 INFO:tasks.workunit.client.1.smithi153.stdout:6/592: mkdir d0/d1d/d33/d9c/d48/d63/d8c/dd1 0 2024-02-28T16:24:42.159 INFO:tasks.workunit.client.1.smithi153.stdout:0/600: mknod d4/cd0 0 2024-02-28T16:24:42.160 INFO:tasks.workunit.client.1.smithi153.stdout:1/568: write d0/d3d/f4f [1905030,92515] 0 2024-02-28T16:24:42.161 INFO:tasks.workunit.client.1.smithi153.stdout:6/593: stat d0/d1d/d30/d71 0 2024-02-28T16:24:42.165 INFO:tasks.workunit.client.1.smithi153.stdout:9/531: dwrite d1/d74/d80/da8/f18 [0,4194304] 0 2024-02-28T16:24:42.168 INFO:tasks.workunit.client.1.smithi153.stdout:2/603: write d2/d63/f78 [890150,63743] 0 2024-02-28T16:24:42.168 INFO:tasks.workunit.client.1.smithi153.stdout:6/594: chown d0/d1d/d33/db2 4305465 1 2024-02-28T16:24:42.175 INFO:tasks.workunit.client.1.smithi153.stdout:9/532: chown d1/d5/d11/c1b 93186 1 2024-02-28T16:24:42.181 INFO:tasks.workunit.client.1.smithi153.stdout:4/517: sync 2024-02-28T16:24:42.189 INFO:tasks.workunit.client.1.smithi153.stdout:3/598: rename d4/d49/fb8 to d4/d8/d1e/d23/fd6 0 2024-02-28T16:24:42.199 INFO:tasks.workunit.client.1.smithi153.stdout:8/586: dwrite d0/d19/d2b/f54 [0,4194304] 0 2024-02-28T16:24:42.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/609: dwrite d1/fbc [0,4194304] 0 2024-02-28T16:24:42.207 INFO:tasks.workunit.client.1.smithi153.stdout:8/587: chown d0/d19/d2b/d2d/f8c 112508 1 2024-02-28T16:24:42.209 INFO:tasks.workunit.client.1.smithi153.stdout:1/569: dread d0/dd/db2/d89/fa8 [0,4194304] 0 2024-02-28T16:24:42.211 INFO:tasks.workunit.client.1.smithi153.stdout:5/587: dwrite da/dd/d25/d82/fad [0,4194304] 0 2024-02-28T16:24:42.212 INFO:tasks.workunit.client.1.smithi153.stdout:8/588: chown d0/d19/d89 334003 1 2024-02-28T16:24:42.221 INFO:tasks.workunit.client.1.smithi153.stdout:6/595: mkdir d0/d1d/d30/d71/d91/dd2 0 2024-02-28T16:24:42.223 INFO:tasks.workunit.client.1.smithi153.stdout:9/533: creat d1/d58/d96/fad x:0 0 0 2024-02-28T16:24:42.225 INFO:tasks.workunit.client.1.smithi153.stdout:0/601: dread d4/d32/d7f/d8a/dab/f30 [0,4194304] 0 2024-02-28T16:24:42.226 INFO:tasks.workunit.client.1.smithi153.stdout:4/518: mknod d4/de/d23/d83/ca7 0 2024-02-28T16:24:42.226 INFO:tasks.workunit.client.1.smithi153.stdout:6/596: write d0/d1d/d5d/d6b/da4/d60/f8b [916849,118209] 0 2024-02-28T16:24:42.227 INFO:tasks.workunit.client.1.smithi153.stdout:7/610: dwrite d1/d25/df/d26/d3a/d95/d97/fb7 [0,4194304] 0 2024-02-28T16:24:42.228 INFO:tasks.workunit.client.1.smithi153.stdout:3/599: fdatasync d4/d7d/d41/d71/fa6 0 2024-02-28T16:24:42.232 INFO:tasks.workunit.client.1.smithi153.stdout:2/604: dread d2/d23/d36/f77 [0,4194304] 0 2024-02-28T16:24:42.234 INFO:tasks.workunit.client.1.smithi153.stdout:2/605: chown d2/d23/d48/f75 26213 1 2024-02-28T16:24:42.234 INFO:tasks.workunit.client.1.smithi153.stdout:6/597: write d0/d1d/d33/d9c/d2e/f53 [2478131,106570] 0 2024-02-28T16:24:42.236 INFO:tasks.workunit.client.1.smithi153.stdout:2/606: stat d2/l13 0 2024-02-28T16:24:42.239 INFO:tasks.workunit.client.1.smithi153.stdout:5/588: symlink da/dd/d25/d41/d7c/lc4 0 2024-02-28T16:24:42.257 INFO:tasks.workunit.client.1.smithi153.stdout:7/611: dread d1/d25/fe [0,4194304] 0 2024-02-28T16:24:42.261 INFO:tasks.workunit.client.1.smithi153.stdout:4/519: dwrite d4/de/d13/f2c [0,4194304] 0 2024-02-28T16:24:42.264 INFO:tasks.workunit.client.1.smithi153.stdout:8/589: creat d0/d19/fc9 x:0 0 0 2024-02-28T16:24:42.265 INFO:tasks.workunit.client.1.smithi153.stdout:1/570: write d0/d3d/d4a/f61 [1132332,35216] 0 2024-02-28T16:24:42.268 INFO:tasks.workunit.client.1.smithi153.stdout:0/602: creat d4/d32/fd1 x:0 0 0 2024-02-28T16:24:42.271 INFO:tasks.workunit.client.1.smithi153.stdout:3/600: dwrite d4/d8/f10 [4194304,4194304] 0 2024-02-28T16:24:42.272 INFO:tasks.workunit.client.1.smithi153.stdout:5/589: dwrite da/dd/d54/f69 [0,4194304] 0 2024-02-28T16:24:42.274 INFO:tasks.workunit.client.1.smithi153.stdout:6/598: dwrite d0/d1d/d33/f7a [0,4194304] 0 2024-02-28T16:24:42.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/607: getdents d2/d23/d36 0 2024-02-28T16:24:42.279 INFO:tasks.workunit.client.1.smithi153.stdout:9/534: dread d1/d5/d11/d1f/d40/f8b [0,4194304] 0 2024-02-28T16:24:42.279 INFO:tasks.workunit.client.1.smithi153.stdout:1/571: creat d0/d3d/d4a/d59/d9a/fcf x:0 0 0 2024-02-28T16:24:42.283 INFO:tasks.workunit.client.1.smithi153.stdout:7/612: dread d1/fbc [0,4194304] 0 2024-02-28T16:24:42.285 INFO:tasks.workunit.client.1.smithi153.stdout:4/520: symlink d4/de/d13/d1b/la8 0 2024-02-28T16:24:42.285 INFO:tasks.workunit.client.1.smithi153.stdout:9/535: truncate d1/d5/d11/d1f/d52/f6c 28220 0 2024-02-28T16:24:42.286 INFO:tasks.workunit.client.1.smithi153.stdout:8/590: rename d0/d12/c13 to d0/d19/d2b/d2d/d3f/cca 0 2024-02-28T16:24:42.288 INFO:tasks.workunit.client.1.smithi153.stdout:3/601: symlink d4/d7d/ld7 0 2024-02-28T16:24:42.290 INFO:tasks.workunit.client.1.smithi153.stdout:6/599: stat d0/d1d/d33/d8d/ca3 0 2024-02-28T16:24:42.291 INFO:tasks.workunit.client.1.smithi153.stdout:0/603: unlink d4/d27/f55 0 2024-02-28T16:24:42.294 INFO:tasks.workunit.client.1.smithi153.stdout:2/608: symlink d2/d63/lc3 0 2024-02-28T16:24:42.294 INFO:tasks.workunit.client.1.smithi153.stdout:7/613: unlink d1/f8b 0 2024-02-28T16:24:42.297 INFO:tasks.workunit.client.1.smithi153.stdout:2/609: chown d2/f67 850 1 2024-02-28T16:24:42.300 INFO:tasks.workunit.client.1.smithi153.stdout:8/591: dread d0/d19/f48 [0,4194304] 0 2024-02-28T16:24:42.301 INFO:tasks.workunit.client.1.smithi153.stdout:4/521: mkdir d4/de/d23/d2b/d4b/da9 0 2024-02-28T16:24:42.301 INFO:tasks.workunit.client.1.smithi153.stdout:9/536: mkdir d1/d5/d11/d1f/d20/d99/dae 0 2024-02-28T16:24:42.303 INFO:tasks.workunit.client.1.smithi153.stdout:9/537: chown d1/d74/d80/da8 5431 1 2024-02-28T16:24:42.303 INFO:tasks.workunit.client.1.smithi153.stdout:8/592: fsync d0/d12/d15/f77 0 2024-02-28T16:24:42.304 INFO:tasks.workunit.client.1.smithi153.stdout:5/590: dwrite da/dd/f93 [0,4194304] 0 2024-02-28T16:24:42.304 INFO:tasks.workunit.client.1.smithi153.stdout:9/538: chown d1/d7e 95821214 1 2024-02-28T16:24:42.305 INFO:tasks.workunit.client.1.smithi153.stdout:4/522: write d4/de/d47/d5e/d62/f98 [909804,38002] 0 2024-02-28T16:24:42.306 INFO:tasks.workunit.client.1.smithi153.stdout:7/614: unlink d1/d25/dc/l36 0 2024-02-28T16:24:42.309 INFO:tasks.workunit.client.1.smithi153.stdout:6/600: creat d0/d1d/d33/d9c/d68/dcb/fd3 x:0 0 0 2024-02-28T16:24:42.310 INFO:tasks.workunit.client.1.smithi153.stdout:1/572: rename d0/d3d/d4a/fbe to d0/dd/fd0 0 2024-02-28T16:24:42.312 INFO:tasks.workunit.client.1.smithi153.stdout:1/573: chown d0/d3d/f4e 3339 1 2024-02-28T16:24:42.313 INFO:tasks.workunit.client.1.smithi153.stdout:8/593: creat d0/d12/d67/d88/d8e/d9d/fcb x:0 0 0 2024-02-28T16:24:42.320 INFO:tasks.workunit.client.1.smithi153.stdout:4/523: creat d4/de/d23/d2b/d9b/faa x:0 0 0 2024-02-28T16:24:42.321 INFO:tasks.workunit.client.1.smithi153.stdout:4/524: chown f1 0 1 2024-02-28T16:24:42.325 INFO:tasks.workunit.client.1.smithi153.stdout:0/604: rename d4/d27/d9a/fa4 to d4/d32/d7f/d8a/dab/d8e/d94/fd2 0 2024-02-28T16:24:42.329 INFO:tasks.workunit.client.1.smithi153.stdout:1/574: creat d0/dd/db2/d89/dc7/fd1 x:0 0 0 2024-02-28T16:24:42.331 INFO:tasks.workunit.client.1.smithi153.stdout:8/594: dwrite d0/d12/d67/d30/f7a [0,4194304] 0 2024-02-28T16:24:42.332 INFO:tasks.workunit.client.1.smithi153.stdout:9/539: creat d1/d5/d11/d1f/d40/d97/faf x:0 0 0 2024-02-28T16:24:42.333 INFO:tasks.workunit.client.1.smithi153.stdout:7/615: creat d1/d25/df/d8a/fcc x:0 0 0 2024-02-28T16:24:42.333 INFO:tasks.workunit.client.1.smithi153.stdout:3/602: write d4/d8/d1e/d2a/d35/f39 [892635,24720] 0 2024-02-28T16:24:42.335 INFO:tasks.workunit.client.1.smithi153.stdout:9/540: stat d1/d5 0 2024-02-28T16:24:42.343 INFO:tasks.workunit.client.1.smithi153.stdout:4/525: dwrite d4/de/d13/d1b/d4e/d50/f93 [0,4194304] 0 2024-02-28T16:24:42.344 INFO:tasks.workunit.client.1.smithi153.stdout:6/601: dread d0/d1d/d33/d9c/f86 [0,4194304] 0 2024-02-28T16:24:42.346 INFO:tasks.workunit.client.1.smithi153.stdout:5/591: getdents da/dd/d25/d8a/dac 0 2024-02-28T16:24:42.347 INFO:tasks.workunit.client.1.smithi153.stdout:4/526: chown d4/de/d23/d83/ca7 320 1 2024-02-28T16:24:42.348 INFO:tasks.workunit.client.1.smithi153.stdout:2/610: dwrite d2/d19/d3e/f65 [0,4194304] 0 2024-02-28T16:24:42.354 INFO:tasks.workunit.client.1.smithi153.stdout:5/592: creat da/dd/d54/db0/fc5 x:0 0 0 2024-02-28T16:24:42.356 INFO:tasks.workunit.client.1.smithi153.stdout:2/611: creat d2/d23/fc4 x:0 0 0 2024-02-28T16:24:42.358 INFO:tasks.workunit.client.1.smithi153.stdout:7/616: dwrite d1/d25/df/d26/d76/f9a [0,4194304] 0 2024-02-28T16:24:42.358 INFO:tasks.workunit.client.1.smithi153.stdout:2/612: write d2/d86/f85 [3951719,130844] 0 2024-02-28T16:24:42.361 INFO:tasks.workunit.client.1.smithi153.stdout:4/527: unlink d4/de/d23/d2b/d4b/d80/f81 0 2024-02-28T16:24:42.364 INFO:tasks.workunit.client.1.smithi153.stdout:4/528: dread - d4/d53/d7c/f9a zero size 2024-02-28T16:24:42.365 INFO:tasks.workunit.client.1.smithi153.stdout:9/541: creat d1/fb0 x:0 0 0 2024-02-28T16:24:42.365 INFO:tasks.workunit.client.1.smithi153.stdout:4/529: write d4/de/f19 [4389954,56327] 0 2024-02-28T16:24:42.367 INFO:tasks.workunit.client.1.smithi153.stdout:4/530: readlink d4/de/d13/d1b/d4e/l8f 0 2024-02-28T16:24:42.369 INFO:tasks.workunit.client.1.smithi153.stdout:6/602: link d0/d1d/d30/d71/f84 d0/d1d/d30/dd0/fd4 0 2024-02-28T16:24:42.370 INFO:tasks.workunit.client.1.smithi153.stdout:6/603: fdatasync d0/d1d/d30/f31 0 2024-02-28T16:24:42.371 INFO:tasks.workunit.client.1.smithi153.stdout:5/593: mkdir da/dd/d25/d8a/dac/dc6 0 2024-02-28T16:24:42.379 INFO:tasks.workunit.client.1.smithi153.stdout:0/605: write d4/d27/f3a [2621971,53515] 0 2024-02-28T16:24:42.383 INFO:tasks.workunit.client.1.smithi153.stdout:3/603: getdents d4/d13/d28/d99 0 2024-02-28T16:24:42.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/542: symlink d1/d5/d11/d1f/d40/d97/lb1 0 2024-02-28T16:24:42.386 INFO:tasks.workunit.client.1.smithi153.stdout:8/595: truncate d0/d12/d67/d30/f3a 3298365 0 2024-02-28T16:24:42.387 INFO:tasks.workunit.client.1.smithi153.stdout:7/617: dwrite d1/d25/fa5 [0,4194304] 0 2024-02-28T16:24:42.390 INFO:tasks.workunit.client.1.smithi153.stdout:8/596: dread d0/d34/f8f [0,4194304] 0 2024-02-28T16:24:42.391 INFO:tasks.workunit.client.1.smithi153.stdout:6/604: mknod d0/d1d/d33/d9c/d68/da2/cd5 0 2024-02-28T16:24:42.393 INFO:tasks.workunit.client.1.smithi153.stdout:2/613: dwrite d2/d19/fc1 [0,4194304] 0 2024-02-28T16:24:42.393 INFO:tasks.workunit.client.1.smithi153.stdout:8/597: fdatasync d0/d25/fbb 0 2024-02-28T16:24:42.399 INFO:tasks.workunit.client.1.smithi153.stdout:8/598: read d0/d19/d2b/d2d/f5a [142201,98233] 0 2024-02-28T16:24:42.401 INFO:tasks.workunit.client.1.smithi153.stdout:4/531: mknod d4/de/d23/d2b/d4b/da9/cab 0 2024-02-28T16:24:42.406 INFO:tasks.workunit.client.1.smithi153.stdout:9/543: rmdir d1 39 2024-02-28T16:24:42.407 INFO:tasks.workunit.client.1.smithi153.stdout:7/618: rmdir d1/d25/df/d8a 39 2024-02-28T16:24:42.415 INFO:tasks.workunit.client.1.smithi153.stdout:2/614: dread d2/d19/d2a/d3b/d87/fa2 [0,4194304] 0 2024-02-28T16:24:42.420 INFO:tasks.workunit.client.1.smithi153.stdout:8/599: rename d0/d19/d89 to d0/d19/d2b/d2d/d3f/d9f/dcc 0 2024-02-28T16:24:42.427 INFO:tasks.workunit.client.1.smithi153.stdout:4/532: dwrite f0 [0,4194304] 0 2024-02-28T16:24:42.427 INFO:tasks.workunit.client.1.smithi153.stdout:5/594: dread da/d29/d43/f4f [4194304,4194304] 0 2024-02-28T16:24:42.428 INFO:tasks.workunit.client.1.smithi153.stdout:9/544: write d1/d58/d96/fad [507241,107145] 0 2024-02-28T16:24:42.430 INFO:tasks.workunit.client.1.smithi153.stdout:3/604: truncate d4/d8/f4d 4306972 0 2024-02-28T16:24:42.434 INFO:tasks.workunit.client.1.smithi153.stdout:2/615: symlink d2/d19/d2a/d3b/d5e/lc5 0 2024-02-28T16:24:42.435 INFO:tasks.workunit.client.1.smithi153.stdout:8/600: creat d0/d19/d2b/d2d/d3f/d9f/dcc/fcd x:0 0 0 2024-02-28T16:24:42.435 INFO:tasks.workunit.client.1.smithi153.stdout:6/605: dwrite d0/d1d/d33/d9c/f86 [4194304,4194304] 0 2024-02-28T16:24:42.435 INFO:tasks.workunit.client.1.smithi153.stdout:3/605: stat d4/d49 0 2024-02-28T16:24:42.437 INFO:tasks.workunit.client.1.smithi153.stdout:5/595: fsync da/dd/d25/d82/d8f/fa9 0 2024-02-28T16:24:42.440 INFO:tasks.workunit.client.1.smithi153.stdout:7/619: dwrite d1/d25/df/f4e [0,4194304] 0 2024-02-28T16:24:42.440 INFO:tasks.workunit.client.1.smithi153.stdout:6/606: readlink d0/d1d/d5d/d6b/da4/d60/d96/lb5 0 2024-02-28T16:24:42.441 INFO:tasks.workunit.client.1.smithi153.stdout:4/533: link d4/de/d40/d4d/f82 d4/d8d/da3/fac 0 2024-02-28T16:24:42.444 INFO:tasks.workunit.client.1.smithi153.stdout:6/607: chown d0/d1d/d33/f3b 95644 1 2024-02-28T16:24:42.450 INFO:tasks.workunit.client.1.smithi153.stdout:9/545: creat d1/fb2 x:0 0 0 2024-02-28T16:24:42.450 INFO:tasks.workunit.client.1.smithi153.stdout:8/601: dread d0/d34/f8f [0,4194304] 0 2024-02-28T16:24:42.453 INFO:tasks.workunit.client.1.smithi153.stdout:5/596: mkdir da/dd/d25/d8a/dac/dc7 0 2024-02-28T16:24:42.455 INFO:tasks.workunit.client.1.smithi153.stdout:4/534: creat d4/de/d47/d5e/d62/fad x:0 0 0 2024-02-28T16:24:42.457 INFO:tasks.workunit.client.1.smithi153.stdout:9/546: dread - d1/d58/d96/faa zero size 2024-02-28T16:24:42.460 INFO:tasks.workunit.client.1.smithi153.stdout:0/606: link d4/d32/d7f/d8a/dab/d8e/d90/c4e d4/d32/dcf/cd3 0 2024-02-28T16:24:42.460 INFO:tasks.workunit.client.1.smithi153.stdout:9/547: dread - d1/fb0 zero size 2024-02-28T16:24:42.465 INFO:tasks.workunit.client.1.smithi153.stdout:0/607: dread - d4/d99/da5/fca zero size 2024-02-28T16:24:42.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/575: sync 2024-02-28T16:24:42.466 INFO:tasks.workunit.client.1.smithi153.stdout:6/608: symlink d0/d1d/d5d/d6b/da4/ld6 0 2024-02-28T16:24:42.467 INFO:tasks.workunit.client.1.smithi153.stdout:3/606: dwrite d4/d8/d1e/d2a/d55/da3/fd0 [0,4194304] 0 2024-02-28T16:24:42.470 INFO:tasks.workunit.client.1.smithi153.stdout:1/576: dread - d0/dd/db2/d89/f9e zero size 2024-02-28T16:24:42.475 INFO:tasks.workunit.client.1.smithi153.stdout:5/597: creat da/dd/d25/d8a/fc8 x:0 0 0 2024-02-28T16:24:42.477 INFO:tasks.workunit.client.1.smithi153.stdout:7/620: creat d1/d25/fcd x:0 0 0 2024-02-28T16:24:42.477 INFO:tasks.workunit.client.1.smithi153.stdout:2/616: dread d2/d4b/f50 [0,4194304] 0 2024-02-28T16:24:42.477 INFO:tasks.workunit.client.1.smithi153.stdout:0/608: mkdir d4/d99/da5/dd4 0 2024-02-28T16:24:42.479 INFO:tasks.workunit.client.1.smithi153.stdout:0/609: chown d4/d27/f5a 51740221 1 2024-02-28T16:24:42.483 INFO:tasks.workunit.client.1.smithi153.stdout:6/609: mkdir d0/d1d/d33/d9c/d48/d63/d8c/dd7 0 2024-02-28T16:24:42.492 INFO:tasks.workunit.client.1.smithi153.stdout:8/602: dwrite d0/d12/f81 [0,4194304] 0 2024-02-28T16:24:42.495 INFO:tasks.workunit.client.1.smithi153.stdout:7/621: creat d1/d25/df/d60/da4/fce x:0 0 0 2024-02-28T16:24:42.495 INFO:tasks.workunit.client.1.smithi153.stdout:0/610: mknod d4/d32/d7f/db3/dc2/cd5 0 2024-02-28T16:24:42.499 INFO:tasks.workunit.client.1.smithi153.stdout:1/577: write d0/d3d/f7d [694882,34216] 0 2024-02-28T16:24:42.500 INFO:tasks.workunit.client.1.smithi153.stdout:4/535: dread d4/f38 [0,4194304] 0 2024-02-28T16:24:42.502 INFO:tasks.workunit.client.1.smithi153.stdout:0/611: write d4/f97 [422729,66846] 0 2024-02-28T16:24:42.502 INFO:tasks.workunit.client.1.smithi153.stdout:2/617: link d2/f67 d2/d25/d49/da3/fc6 0 2024-02-28T16:24:42.505 INFO:tasks.workunit.client.1.smithi153.stdout:3/607: truncate d4/d8/d1e/f42 1761122 0 2024-02-28T16:24:42.507 INFO:tasks.workunit.client.1.smithi153.stdout:6/610: dread d0/d1d/d30/f58 [0,4194304] 0 2024-02-28T16:24:42.509 INFO:tasks.workunit.client.1.smithi153.stdout:9/548: dwrite d1/d5/d27/f41 [0,4194304] 0 2024-02-28T16:24:42.513 INFO:tasks.workunit.client.1.smithi153.stdout:6/611: unlink d0/f52 0 2024-02-28T16:24:42.514 INFO:tasks.workunit.client.1.smithi153.stdout:1/578: mkdir d0/d62/dd2 0 2024-02-28T16:24:42.517 INFO:tasks.workunit.client.1.smithi153.stdout:4/536: dread d4/de/d23/d2b/d9b/f97 [0,4194304] 0 2024-02-28T16:24:42.517 INFO:tasks.workunit.client.1.smithi153.stdout:9/549: truncate d1/d5/d11/d1f/d43/f9d 721605 0 2024-02-28T16:24:42.524 INFO:tasks.workunit.client.1.smithi153.stdout:6/612: truncate d0/d1d/d5d/d6b/da4/fcf 765368 0 2024-02-28T16:24:42.525 INFO:tasks.workunit.client.1.smithi153.stdout:1/579: truncate d0/dd/db2/d89/f9e 798253 0 2024-02-28T16:24:42.528 INFO:tasks.workunit.client.1.smithi153.stdout:4/537: mknod d4/d53/d7c/cae 0 2024-02-28T16:24:42.528 INFO:tasks.workunit.client.1.smithi153.stdout:7/622: dwrite d1/d25/df/d60/f67 [0,4194304] 0 2024-02-28T16:24:42.528 INFO:tasks.workunit.client.1.smithi153.stdout:2/618: getdents d2/d19/d8b 0 2024-02-28T16:24:42.536 INFO:tasks.workunit.client.1.smithi153.stdout:6/613: symlink d0/d1d/d5d/d6b/da4/d60/ld8 0 2024-02-28T16:24:42.540 INFO:tasks.workunit.client.1.smithi153.stdout:0/612: dread d4/d89/f92 [0,4194304] 0 2024-02-28T16:24:42.545 INFO:tasks.workunit.client.1.smithi153.stdout:3/608: truncate d4/d13/d28/d36/f56 32816 0 2024-02-28T16:24:42.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/623: mknod d1/d25/df/d60/da4/ccf 0 2024-02-28T16:24:42.547 INFO:tasks.workunit.client.1.smithi153.stdout:9/550: rename d1/d74/d80/da8/f63 to d1/d5/d11/d29/d79/fb3 0 2024-02-28T16:24:42.548 INFO:tasks.workunit.client.1.smithi153.stdout:3/609: fsync d4/d13/f1d 0 2024-02-28T16:24:42.551 INFO:tasks.workunit.client.1.smithi153.stdout:6/614: dread d0/d1d/d33/db2/f77 [0,4194304] 0 2024-02-28T16:24:42.552 INFO:tasks.workunit.client.1.smithi153.stdout:1/580: dwrite d0/d3d/d4a/f61 [0,4194304] 0 2024-02-28T16:24:42.552 INFO:tasks.workunit.client.1.smithi153.stdout:4/538: dwrite d4/de/d47/f67 [0,4194304] 0 2024-02-28T16:24:42.555 INFO:tasks.workunit.client.1.smithi153.stdout:0/613: mkdir d4/d32/d7f/dd6 0 2024-02-28T16:24:42.560 INFO:tasks.workunit.client.1.smithi153.stdout:1/581: dread - d0/dd/db2/d89/daa/fb9 zero size 2024-02-28T16:24:42.562 INFO:tasks.workunit.client.1.smithi153.stdout:4/539: truncate d4/de/d23/d2b/d4b/f87 931950 0 2024-02-28T16:24:42.564 INFO:tasks.workunit.client.1.smithi153.stdout:6/615: truncate d0/d1d/d33/d9c/d2e/d99/fb9 761676 0 2024-02-28T16:24:42.566 INFO:tasks.workunit.client.1.smithi153.stdout:2/619: write d2/f20 [1689062,60508] 0 2024-02-28T16:24:42.568 INFO:tasks.workunit.client.1.smithi153.stdout:7/624: mkdir d1/d25/df/d26/d3a/d95/d97/dd0 0 2024-02-28T16:24:42.568 INFO:tasks.workunit.client.1.smithi153.stdout:1/582: truncate d0/dd/db2/d89/dad/fcd 413666 0 2024-02-28T16:24:42.571 INFO:tasks.workunit.client.1.smithi153.stdout:3/610: rename d4/d8/d1e/c68 to d4/d8/d1e/d2a/d35/d54/cd8 0 2024-02-28T16:24:42.573 INFO:tasks.workunit.client.1.smithi153.stdout:2/620: dread - d2/d19/d2a/d3b/d87/da5/fbe zero size 2024-02-28T16:24:42.574 INFO:tasks.workunit.client.1.smithi153.stdout:0/614: mkdir d4/d32/d7f/d8a/dab/d8e/d94/dd7 0 2024-02-28T16:24:42.577 INFO:tasks.workunit.client.1.smithi153.stdout:4/540: mkdir d4/de/d13/d1b/d4e/d50/daf 0 2024-02-28T16:24:42.578 INFO:tasks.workunit.client.1.smithi153.stdout:1/583: mknod d0/d3d/cd3 0 2024-02-28T16:24:42.579 INFO:tasks.workunit.client.1.smithi153.stdout:7/625: creat d1/d25/df/d5a/fd1 x:0 0 0 2024-02-28T16:24:42.581 INFO:tasks.workunit.client.1.smithi153.stdout:6/616: dwrite d0/d1d/d30/f6e [0,4194304] 0 2024-02-28T16:24:42.583 INFO:tasks.workunit.client.1.smithi153.stdout:0/615: write d4/f53 [568000,4227] 0 2024-02-28T16:24:42.584 INFO:tasks.workunit.client.1.smithi153.stdout:6/617: chown d0/d1d/d30/f5e 0 1 2024-02-28T16:24:42.587 INFO:tasks.workunit.client.1.smithi153.stdout:0/616: fsync d4/d32/d7f/d8a/dab/d8e/d90/f33 0 2024-02-28T16:24:42.591 INFO:tasks.workunit.client.1.smithi153.stdout:7/626: mkdir d1/d25/df/d26/d76/dd2 0 2024-02-28T16:24:42.598 INFO:tasks.workunit.client.1.smithi153.stdout:9/551: dwrite d1/d5/d11/d29/d79/fb3 [0,4194304] 0 2024-02-28T16:24:42.602 INFO:tasks.workunit.client.1.smithi153.stdout:0/617: creat d4/d32/d7f/db3/fd8 x:0 0 0 2024-02-28T16:24:42.605 INFO:tasks.workunit.client.1.smithi153.stdout:2/621: rename d2/d19/c4a to d2/d25/cc7 0 2024-02-28T16:24:42.609 INFO:tasks.workunit.client.1.smithi153.stdout:9/552: creat d1/d5/d11/d1f/d62/fb4 x:0 0 0 2024-02-28T16:24:42.609 INFO:tasks.workunit.client.1.smithi153.stdout:6/618: dwrite d0/d1d/d5d/d6b/da4/d60/f8b [0,4194304] 0 2024-02-28T16:24:42.611 INFO:tasks.workunit.client.1.smithi153.stdout:7/627: dread d1/d25/df/d26/f84 [0,4194304] 0 2024-02-28T16:24:42.613 INFO:tasks.workunit.client.1.smithi153.stdout:4/541: dread d4/de/d23/f48 [0,4194304] 0 2024-02-28T16:24:42.614 INFO:tasks.workunit.client.1.smithi153.stdout:3/611: dwrite d4/d13/f3f [0,4194304] 0 2024-02-28T16:24:42.614 INFO:tasks.workunit.client.1.smithi153.stdout:2/622: fdatasync d2/d19/d31/f40 0 2024-02-28T16:24:42.616 INFO:tasks.workunit.client.1.smithi153.stdout:7/628: write d1/d25/df/fb4 [1033514,91097] 0 2024-02-28T16:24:42.618 INFO:tasks.workunit.client.1.smithi153.stdout:1/584: rename d0/dd/c44 to d0/d3d/d4a/d59/d9a/cd4 0 2024-02-28T16:24:42.621 INFO:tasks.workunit.client.1.smithi153.stdout:6/619: symlink d0/d1d/d33/d9c/d48/ld9 0 2024-02-28T16:24:42.626 INFO:tasks.workunit.client.1.smithi153.stdout:4/542: creat d4/de/d23/d2b/d9b/fb0 x:0 0 0 2024-02-28T16:24:42.628 INFO:tasks.workunit.client.1.smithi153.stdout:2/623: creat d2/d19/d2a/d3b/d5e/fc8 x:0 0 0 2024-02-28T16:24:42.630 INFO:tasks.workunit.client.1.smithi153.stdout:1/585: mkdir d0/dd/dd5 0 2024-02-28T16:24:42.635 INFO:tasks.workunit.client.1.smithi153.stdout:5/598: sync 2024-02-28T16:24:42.636 INFO:tasks.workunit.client.1.smithi153.stdout:9/553: dwrite d1/d74/d80/da8/f18 [0,4194304] 0 2024-02-28T16:24:42.641 INFO:tasks.workunit.client.1.smithi153.stdout:7/629: dwrite d1/d25/d27/f9b [0,4194304] 0 2024-02-28T16:24:42.664 INFO:tasks.workunit.client.1.smithi153.stdout:3/612: dread d4/f1f [0,4194304] 0 2024-02-28T16:24:42.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:42 smithi023 ceph-mon[29137]: mgrmap e30: smithi023.bbebnt(active, since 15s), standbys: smithi153.qlkchp 2024-02-28T16:24:42.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:42 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:24:42.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:42 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:42.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:42 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:42.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:42 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:42.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:42 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:42.708 INFO:tasks.workunit.client.1.smithi153.stdout:8/603: sync 2024-02-28T16:24:42.713 INFO:tasks.workunit.client.1.smithi153.stdout:2/624: write d2/d19/d2a/f45 [1911743,14022] 0 2024-02-28T16:24:42.716 INFO:tasks.workunit.client.1.smithi153.stdout:1/586: write d0/dd/f2d [1153359,7970] 0 2024-02-28T16:24:42.724 INFO:tasks.workunit.client.1.smithi153.stdout:5/599: unlink da/dd/d25/d41/d7c/lc4 0 2024-02-28T16:24:42.726 INFO:tasks.workunit.client.1.smithi153.stdout:5/600: write da/dd/d25/d8a/f90 [111798,8541] 0 2024-02-28T16:24:42.726 INFO:tasks.workunit.client.1.smithi153.stdout:7/630: unlink d1/fbc 0 2024-02-28T16:24:42.728 INFO:tasks.workunit.client.1.smithi153.stdout:5/601: write da/f73 [2201734,115511] 0 2024-02-28T16:24:42.731 INFO:tasks.workunit.client.1.smithi153.stdout:5/602: write da/d29/d43/d5a/d77/f8b [792760,84152] 0 2024-02-28T16:24:42.733 INFO:tasks.workunit.client.1.smithi153.stdout:5/603: truncate da/dd/d54/f96 527836 0 2024-02-28T16:24:42.734 INFO:tasks.workunit.client.1.smithi153.stdout:5/604: truncate da/f3a 740061 0 2024-02-28T16:24:42.737 INFO:tasks.workunit.client.1.smithi153.stdout:5/605: truncate da/d29/d43/d5a/d77/fc0 60469 0 2024-02-28T16:24:42.738 INFO:tasks.workunit.client.1.smithi153.stdout:5/606: chown da/fc 1 1 2024-02-28T16:24:42.739 INFO:tasks.workunit.client.1.smithi153.stdout:0/618: write d4/d32/d7f/d8a/dab/f1d [529320,5320] 0 2024-02-28T16:24:42.751 INFO:tasks.workunit.client.1.smithi153.stdout:5/607: dwrite da/d29/f5b [0,4194304] 0 2024-02-28T16:24:42.762 INFO:tasks.workunit.client.1.smithi153.stdout:4/543: link d4/de/d47/d5e/d62/fad d4/de/d23/d2b/d31/da2/fb1 0 2024-02-28T16:24:42.781 INFO:tasks.workunit.client.1.smithi153.stdout:3/613: dread d4/d7d/d41/f79 [0,4194304] 0 2024-02-28T16:24:42.781 INFO:tasks.workunit.client.1.smithi153.stdout:2/625: fdatasync d2/d19/d2a/d3b/f4e 0 2024-02-28T16:24:42.782 INFO:tasks.workunit.client.1.smithi153.stdout:3/614: write d4/d8/f65 [3560380,34149] 0 2024-02-28T16:24:42.784 INFO:tasks.workunit.client.1.smithi153.stdout:5/608: creat da/d29/d43/d5a/dbe/fc9 x:0 0 0 2024-02-28T16:24:42.788 INFO:tasks.workunit.client.1.smithi153.stdout:1/587: symlink d0/ld6 0 2024-02-28T16:24:42.789 INFO:tasks.workunit.client.1.smithi153.stdout:7/631: dread d1/d25/df/d26/d3a/d3f/f74 [0,4194304] 0 2024-02-28T16:24:42.797 INFO:tasks.workunit.client.1.smithi153.stdout:7/632: dread d1/d25/dc/d50/f5b [0,4194304] 0 2024-02-28T16:24:42.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:42 smithi153 ceph-mon[35341]: mgrmap e30: smithi023.bbebnt(active, since 15s), standbys: smithi153.qlkchp 2024-02-28T16:24:42.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:42 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:24:42.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:42 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:42.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:42 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:42.801 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:42 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:42.802 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:42 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:42.803 INFO:tasks.workunit.client.1.smithi153.stdout:2/626: fsync d2/d23/d36/f77 0 2024-02-28T16:24:42.821 INFO:tasks.workunit.client.1.smithi153.stdout:5/609: creat da/dd/d25/d8a/dac/dc7/fca x:0 0 0 2024-02-28T16:24:42.824 INFO:tasks.workunit.client.1.smithi153.stdout:3/615: mkdir d4/d8/d1e/d23/da0/dd9 0 2024-02-28T16:24:42.829 INFO:tasks.workunit.client.1.smithi153.stdout:2/627: mknod d2/d25/d49/da3/cc9 0 2024-02-28T16:24:42.830 INFO:tasks.workunit.client.1.smithi153.stdout:2/628: stat d2/d25/db4/lb8 0 2024-02-28T16:24:42.837 INFO:tasks.workunit.client.1.smithi153.stdout:5/610: dwrite da/dd/f65 [0,4194304] 0 2024-02-28T16:24:42.840 INFO:tasks.workunit.client.1.smithi153.stdout:1/588: rmdir d0/d62/d66/d8e 39 2024-02-28T16:24:42.850 INFO:tasks.workunit.client.1.smithi153.stdout:3/616: dwrite d4/d7d/d41/f79 [0,4194304] 0 2024-02-28T16:24:42.850 INFO:tasks.workunit.client.1.smithi153.stdout:5/611: dread da/d29/f5b [0,4194304] 0 2024-02-28T16:24:42.850 INFO:tasks.workunit.client.1.smithi153.stdout:8/604: link d0/d19/d1e/f40 d0/d34/fce 0 2024-02-28T16:24:42.852 INFO:tasks.workunit.client.1.smithi153.stdout:3/617: dread - d4/d7d/d41/d71/fa6 zero size 2024-02-28T16:24:42.862 INFO:tasks.workunit.client.1.smithi153.stdout:8/605: chown d0/d34/l99 1772 1 2024-02-28T16:24:42.864 INFO:tasks.workunit.client.1.smithi153.stdout:5/612: unlink da/dd/d25/fbb 0 2024-02-28T16:24:42.876 INFO:tasks.workunit.client.1.smithi153.stdout:3/618: mkdir d4/d13/d28/dcd/dda 0 2024-02-28T16:24:42.885 INFO:tasks.workunit.client.1.smithi153.stdout:5/613: mkdir da/dd/d25/dcb 0 2024-02-28T16:24:42.889 INFO:tasks.workunit.client.1.smithi153.stdout:6/620: rename d0/d1d/d33/db2/c64 to d0/d1d/d33/d9c/d48/cda 0 2024-02-28T16:24:42.892 INFO:tasks.workunit.client.1.smithi153.stdout:6/621: write d0/d1d/d33/d9c/d2e/d99/fbb [289863,60897] 0 2024-02-28T16:24:42.895 INFO:tasks.workunit.client.1.smithi153.stdout:6/622: chown d0/d1d/d33/d9c/d48/d72/f8f 1007 1 2024-02-28T16:24:42.896 INFO:tasks.workunit.client.1.smithi153.stdout:5/614: creat da/dd/d25/d8a/dac/dc7/fcc x:0 0 0 2024-02-28T16:24:42.903 INFO:tasks.workunit.client.1.smithi153.stdout:9/554: rename d1/d58/d96 to d1/d5/d11/d1f/d20/d36/d93/db5 0 2024-02-28T16:24:42.904 INFO:tasks.workunit.client.1.smithi153.stdout:6/623: write d0/d1d/d33/db2/f77 [293398,28649] 0 2024-02-28T16:24:42.906 INFO:tasks.workunit.client.1.smithi153.stdout:9/555: truncate d1/d5/d27/fab 791156 0 2024-02-28T16:24:42.907 INFO:tasks.workunit.client.1.smithi153.stdout:3/619: creat d4/d8/d1e/d23/fdb x:0 0 0 2024-02-28T16:24:42.911 INFO:tasks.workunit.client.1.smithi153.stdout:6/624: creat d0/d1d/d5d/d6b/da4/d6c/db4/fdb x:0 0 0 2024-02-28T16:24:42.915 INFO:tasks.workunit.client.1.smithi153.stdout:9/556: write d1/d5/d11/d1f/d40/f8b [2598955,80931] 0 2024-02-28T16:24:42.917 INFO:tasks.workunit.client.1.smithi153.stdout:6/625: mknod d0/d17/d7e/cdc 0 2024-02-28T16:24:42.922 INFO:tasks.workunit.client.1.smithi153.stdout:9/557: rename d1/d5/d11/d1f/d43/d76/f82 to d1/d74/d7c/fb6 0 2024-02-28T16:24:42.925 INFO:tasks.workunit.client.1.smithi153.stdout:6/626: mknod d0/d1d/d33/d9c/d2e/cdd 0 2024-02-28T16:24:42.926 INFO:tasks.workunit.client.1.smithi153.stdout:9/558: creat d1/d7e/fb7 x:0 0 0 2024-02-28T16:24:42.930 INFO:tasks.workunit.client.1.smithi153.stdout:6/627: creat d0/d1d/d33/d9c/d48/d63/d8c/dc3/fde x:0 0 0 2024-02-28T16:24:42.935 INFO:tasks.workunit.client.1.smithi153.stdout:4/544: dwrite d4/de/d23/d2b/f63 [0,4194304] 0 2024-02-28T16:24:42.937 INFO:tasks.workunit.client.1.smithi153.stdout:9/559: link d1/d5/d11/d1f/d62/fb4 d1/d5/d27/fb8 0 2024-02-28T16:24:42.938 INFO:tasks.workunit.client.1.smithi153.stdout:4/545: write d4/de/d13/f84 [528863,9708] 0 2024-02-28T16:24:42.942 INFO:tasks.workunit.client.1.smithi153.stdout:7/633: dwrite d1/d25/df/f47 [4194304,4194304] 0 2024-02-28T16:24:42.942 INFO:tasks.workunit.client.1.smithi153.stdout:9/560: chown d1/d5/d11/d1f/d20/d45/f4a 3335319 1 2024-02-28T16:24:42.946 INFO:tasks.workunit.client.1.smithi153.stdout:0/619: mkdir d4/d32/dd9 0 2024-02-28T16:24:42.954 INFO:tasks.workunit.client.1.smithi153.stdout:9/561: creat d1/d5/d11/d1f/d20/d5d/fb9 x:0 0 0 2024-02-28T16:24:42.960 INFO:tasks.workunit.client.1.smithi153.stdout:2/629: truncate d2/d23/d48/f75 2778554 0 2024-02-28T16:24:42.965 INFO:tasks.workunit.client.1.smithi153.stdout:0/620: getdents d4 0 2024-02-28T16:24:42.968 INFO:tasks.workunit.client.1.smithi153.stdout:0/621: chown d4/d32/d7f/d8a/dab/d8e/d90/c8d 7293 1 2024-02-28T16:24:42.970 INFO:tasks.workunit.client.1.smithi153.stdout:1/589: dwrite d0/dd/fd0 [0,4194304] 0 2024-02-28T16:24:42.973 INFO:tasks.workunit.client.1.smithi153.stdout:0/622: fdatasync d4/d27/f85 0 2024-02-28T16:24:42.976 INFO:tasks.workunit.client.1.smithi153.stdout:8/606: truncate d0/d12/d67/d88/d96/fb8 1487970 0 2024-02-28T16:24:42.979 INFO:tasks.workunit.client.1.smithi153.stdout:2/630: dwrite d2/d19/d2a/d3b/d5e/f6c [0,4194304] 0 2024-02-28T16:24:42.991 INFO:tasks.workunit.client.1.smithi153.stdout:1/590: mknod d0/d62/dd2/cd7 0 2024-02-28T16:24:42.994 INFO:tasks.workunit.client.1.smithi153.stdout:0/623: mknod d4/d9b/cda 0 2024-02-28T16:24:42.998 INFO:tasks.workunit.client.1.smithi153.stdout:8/607: creat d0/d34/fcf x:0 0 0 2024-02-28T16:24:43.001 INFO:tasks.workunit.client.1.smithi153.stdout:2/631: rmdir d2/d23/d88 39 2024-02-28T16:24:43.002 INFO:tasks.workunit.client.1.smithi153.stdout:5/615: truncate da/dd/fe 463204 0 2024-02-28T16:24:43.004 INFO:tasks.workunit.client.1.smithi153.stdout:1/591: unlink d0/d3d/d4a/d59/l5f 0 2024-02-28T16:24:43.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/592: fsync d0/dd/db2/d89/daa/fb9 0 2024-02-28T16:24:43.006 INFO:tasks.workunit.client.1.smithi153.stdout:2/632: dread d2/d19/d2a/d93/f83 [0,4194304] 0 2024-02-28T16:24:43.008 INFO:tasks.workunit.client.1.smithi153.stdout:6/628: rename d0/d1d/d5d/d6b to d0/d1d/d33/d9c/d2e/d99/ddf 0 2024-02-28T16:24:43.008 INFO:tasks.workunit.client.1.smithi153.stdout:1/593: truncate d0/d62/d66/fc3 753460 0 2024-02-28T16:24:43.010 INFO:tasks.workunit.client.1.smithi153.stdout:6/629: fsync d0/d1d/d33/d9c/d48/fc0 0 2024-02-28T16:24:43.010 INFO:tasks.workunit.client.1.smithi153.stdout:0/624: creat d4/d32/d7f/d8a/dab/d8e/d94/fdb x:0 0 0 2024-02-28T16:24:43.012 INFO:tasks.workunit.client.1.smithi153.stdout:5/616: rmdir da/dd/d25/d41 39 2024-02-28T16:24:43.013 INFO:tasks.workunit.client.1.smithi153.stdout:3/620: write d4/d2c/f9e [172290,3572] 0 2024-02-28T16:24:43.015 INFO:tasks.workunit.client.1.smithi153.stdout:3/621: fsync d4/d13/d8f/fb0 0 2024-02-28T16:24:43.016 INFO:tasks.workunit.client.1.smithi153.stdout:4/546: rename d4/de/d23/d83 to d4/de/d23/d2b/d31/da2/da5/db2 0 2024-02-28T16:24:43.016 INFO:tasks.workunit.client.1.smithi153.stdout:1/594: rmdir d0/dd/db2/d89 39 2024-02-28T16:24:43.018 INFO:tasks.workunit.client.1.smithi153.stdout:4/547: read - d4/de/d23/d2b/d31/da2/fb1 zero size 2024-02-28T16:24:43.021 INFO:tasks.workunit.client.1.smithi153.stdout:2/633: fdatasync d2/d23/d48/f75 0 2024-02-28T16:24:43.024 INFO:tasks.workunit.client.1.smithi153.stdout:2/634: stat d2/d19/d2a/d3b/d87/da5 0 2024-02-28T16:24:43.025 INFO:tasks.workunit.client.1.smithi153.stdout:6/630: dwrite d0/f20 [0,4194304] 0 2024-02-28T16:24:43.026 INFO:tasks.workunit.client.1.smithi153.stdout:6/631: stat d0/l7 0 2024-02-28T16:24:43.026 INFO:tasks.workunit.client.1.smithi153.stdout:1/595: stat d0/d3d/d4a/d59/d9a/cd4 0 2024-02-28T16:24:43.029 INFO:tasks.workunit.client.1.smithi153.stdout:4/548: unlink d4/de/f6c 0 2024-02-28T16:24:43.030 INFO:tasks.workunit.client.1.smithi153.stdout:5/617: mknod da/ccd 0 2024-02-28T16:24:43.033 INFO:tasks.workunit.client.1.smithi153.stdout:9/562: write d1/d5/d11/d1f/d20/d45/f4a [718934,8167] 0 2024-02-28T16:24:43.041 INFO:tasks.workunit.client.1.smithi153.stdout:1/596: write d0/dd/db2/d89/daa/fc8 [623283,98044] 0 2024-02-28T16:24:43.042 INFO:tasks.workunit.client.1.smithi153.stdout:3/622: rename d4/fc3 to d4/d13/d28/fdc 0 2024-02-28T16:24:43.042 INFO:tasks.workunit.client.1.smithi153.stdout:7/634: dwrite d1/f6c [0,4194304] 0 2024-02-28T16:24:43.044 INFO:tasks.workunit.client.1.smithi153.stdout:2/635: dread d2/d19/d2a/d3b/d87/fa2 [0,4194304] 0 2024-02-28T16:24:43.050 INFO:tasks.workunit.client.1.smithi153.stdout:1/597: write d0/d3d/fa1 [538130,39978] 0 2024-02-28T16:24:43.051 INFO:tasks.workunit.client.1.smithi153.stdout:6/632: dwrite d0/d1d/d33/d9c/d2e/f53 [0,4194304] 0 2024-02-28T16:24:43.055 INFO:tasks.workunit.client.1.smithi153.stdout:2/636: mkdir d2/d25/db4/dca 0 2024-02-28T16:24:43.073 INFO:tasks.workunit.client.1.smithi153.stdout:2/637: rmdir d2/d19/d8b 39 2024-02-28T16:24:43.079 INFO:tasks.workunit.client.1.smithi153.stdout:4/549: getdents d4/de/d23/d2b/d31 0 2024-02-28T16:24:43.080 INFO:tasks.workunit.client.1.smithi153.stdout:9/563: link d1/d74/c89 d1/d74/cba 0 2024-02-28T16:24:43.081 INFO:tasks.workunit.client.1.smithi153.stdout:8/608: truncate d0/d19/d2b/d2d/f8a 750197 0 2024-02-28T16:24:43.082 INFO:tasks.workunit.client.1.smithi153.stdout:9/564: chown d1/d5/d11/d1f/d20/d5d/c7d 41 1 2024-02-28T16:24:43.083 INFO:tasks.workunit.client.1.smithi153.stdout:3/623: creat d4/d13/d28/fdd x:0 0 0 2024-02-28T16:24:43.084 INFO:tasks.workunit.client.1.smithi153.stdout:1/598: dread d0/f85 [0,4194304] 0 2024-02-28T16:24:43.087 INFO:tasks.workunit.client.1.smithi153.stdout:1/599: write d0/d3d/d4a/d59/f8c [3778982,22920] 0 2024-02-28T16:24:43.088 INFO:tasks.workunit.client.1.smithi153.stdout:6/633: mkdir d0/d1d/d33/d9c/d48/d63/d8c/dd7/de0 0 2024-02-28T16:24:43.089 INFO:tasks.workunit.client.1.smithi153.stdout:4/550: rename d4/d3c to d4/d53/d7c/db3 0 2024-02-28T16:24:43.090 INFO:tasks.workunit.client.1.smithi153.stdout:6/634: chown d0/d1d/d33/d9c/d68/dcb 39 1 2024-02-28T16:24:43.092 INFO:tasks.workunit.client.1.smithi153.stdout:9/565: mkdir d1/d69/dbb 0 2024-02-28T16:24:43.094 INFO:tasks.workunit.client.1.smithi153.stdout:2/638: mkdir d2/d19/d3e/dcb 0 2024-02-28T16:24:43.096 INFO:tasks.workunit.client.1.smithi153.stdout:9/566: read - d1/d5/d11/d1f/d62/fb4 zero size 2024-02-28T16:24:43.098 INFO:tasks.workunit.client.1.smithi153.stdout:7/635: getdents d1/d25/df/d8a 0 2024-02-28T16:24:43.102 INFO:tasks.workunit.client.1.smithi153.stdout:3/624: dwrite d4/d2c/f7e [0,4194304] 0 2024-02-28T16:24:43.104 INFO:tasks.workunit.client.1.smithi153.stdout:3/625: dread - d4/d8/d1e/fa8 zero size 2024-02-28T16:24:43.109 INFO:tasks.workunit.client.1.smithi153.stdout:8/609: dread d0/d19/d1e/f40 [0,4194304] 0 2024-02-28T16:24:43.114 INFO:tasks.workunit.client.1.smithi153.stdout:4/551: dwrite d4/de/d23/d2b/f63 [0,4194304] 0 2024-02-28T16:24:43.116 INFO:tasks.workunit.client.1.smithi153.stdout:1/600: dwrite d0/d3d/d4a/d59/d9a/fcf [0,4194304] 0 2024-02-28T16:24:43.119 INFO:tasks.workunit.client.1.smithi153.stdout:6/635: rename d0/d1d/d33/d8d/l93 to d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/le1 0 2024-02-28T16:24:43.122 INFO:tasks.workunit.client.1.smithi153.stdout:8/610: read d0/d12/d67/d30/f58 [162337,83317] 0 2024-02-28T16:24:43.127 INFO:tasks.workunit.client.1.smithi153.stdout:9/567: mkdir d1/d69/dbb/dbc 0 2024-02-28T16:24:43.128 INFO:tasks.workunit.client.1.smithi153.stdout:3/626: write d4/d7d/f3d [6565736,50189] 0 2024-02-28T16:24:43.134 INFO:tasks.workunit.client.1.smithi153.stdout:7/636: dread d1/d25/df/d5a/f78 [0,4194304] 0 2024-02-28T16:24:43.134 INFO:tasks.workunit.client.1.smithi153.stdout:4/552: mkdir d4/de/d23/d2b/d31/db4 0 2024-02-28T16:24:43.135 INFO:tasks.workunit.client.1.smithi153.stdout:4/553: readlink d4/l7f 0 2024-02-28T16:24:43.143 INFO:tasks.workunit.client.1.smithi153.stdout:0/625: sync 2024-02-28T16:24:43.146 INFO:tasks.workunit.client.1.smithi153.stdout:0/626: write d4/d32/d7f/d8a/dab/d8e/d90/f3f [946135,39445] 0 2024-02-28T16:24:43.153 INFO:tasks.workunit.client.1.smithi153.stdout:3/627: rmdir d4/d8/d1e/d87 39 2024-02-28T16:24:43.157 INFO:tasks.workunit.client.1.smithi153.stdout:9/568: rename d1/d5/d11/d1f/d20/f49 to d1/d5/d11/d1f/d62/fbd 0 2024-02-28T16:24:43.162 INFO:tasks.workunit.client.1.smithi153.stdout:1/601: symlink d0/d62/d66/d8e/ld8 0 2024-02-28T16:24:43.170 INFO:tasks.workunit.client.1.smithi153.stdout:7/637: mknod d1/d25/df/d26/d3a/d5e/cd3 0 2024-02-28T16:24:43.173 INFO:tasks.workunit.client.1.smithi153.stdout:8/611: fsync d0/d12/d67/d88/d96/fb8 0 2024-02-28T16:24:43.179 INFO:tasks.workunit.client.1.smithi153.stdout:0/627: dwrite d4/d27/f44 [0,4194304] 0 2024-02-28T16:24:43.182 INFO:tasks.workunit.client.1.smithi153.stdout:5/618: dwrite da/dd/d25/f58 [0,4194304] 0 2024-02-28T16:24:43.183 INFO:tasks.workunit.client.1.smithi153.stdout:3/628: dwrite d4/d8/f65 [0,4194304] 0 2024-02-28T16:24:43.192 INFO:tasks.workunit.client.1.smithi153.stdout:9/569: mkdir d1/d5/d11/d1f/d20/d36/d93/db5/dbe 0 2024-02-28T16:24:43.193 INFO:tasks.workunit.client.1.smithi153.stdout:4/554: mknod d4/de/cb5 0 2024-02-28T16:24:43.194 INFO:tasks.workunit.client.1.smithi153.stdout:9/570: chown d1/d5/d27 12 1 2024-02-28T16:24:43.195 INFO:tasks.workunit.client.1.smithi153.stdout:4/555: read d4/de/d13/d1b/f5f [286623,48172] 0 2024-02-28T16:24:43.197 INFO:tasks.workunit.client.1.smithi153.stdout:4/556: dread - d4/d53/d7c/f9a zero size 2024-02-28T16:24:43.198 INFO:tasks.workunit.client.1.smithi153.stdout:1/602: mkdir d0/d3d/d4a/dd9 0 2024-02-28T16:24:43.207 INFO:tasks.workunit.client.1.smithi153.stdout:7/638: mkdir d1/d25/df/d26/d76/dd4 0 2024-02-28T16:24:43.221 INFO:tasks.workunit.client.1.smithi153.stdout:2/639: write d2/d19/d31/f58 [497066,95972] 0 2024-02-28T16:24:43.222 INFO:tasks.workunit.client.1.smithi153.stdout:0/628: write d4/d27/dc1/fc9 [2827010,62716] 0 2024-02-28T16:24:43.222 INFO:tasks.workunit.client.1.smithi153.stdout:5/619: symlink da/d29/d43/d5a/d77/lce 0 2024-02-28T16:24:43.223 INFO:tasks.workunit.client.1.smithi153.stdout:0/629: chown d4/f3e 14801 1 2024-02-28T16:24:43.225 INFO:tasks.workunit.client.1.smithi153.stdout:3/629: dread d4/d2c/f57 [4194304,4194304] 0 2024-02-28T16:24:43.236 INFO:tasks.workunit.client.1.smithi153.stdout:7/639: dread d1/f82 [0,4194304] 0 2024-02-28T16:24:43.263 INFO:tasks.workunit.client.1.smithi153.stdout:6/636: getdents d0/d1d/d33/d9c/d2e/d99 0 2024-02-28T16:24:43.268 INFO:tasks.workunit.client.1.smithi153.stdout:8/612: mkdir d0/d12/d15/dab/dd0 0 2024-02-28T16:24:43.269 INFO:tasks.workunit.client.1.smithi153.stdout:8/613: chown d0/d34/fb2 5093 1 2024-02-28T16:24:43.271 INFO:tasks.workunit.client.1.smithi153.stdout:5/620: mkdir da/d29/d43/d5a/dcf 0 2024-02-28T16:24:43.272 INFO:tasks.workunit.client.1.smithi153.stdout:0/630: creat d4/d27/d9a/fdc x:0 0 0 2024-02-28T16:24:43.273 INFO:tasks.workunit.client.1.smithi153.stdout:0/631: chown d4/d89/fb4 323324899 1 2024-02-28T16:24:43.275 INFO:tasks.workunit.client.1.smithi153.stdout:7/640: mkdir d1/d25/dc/d50/d66/dd5 0 2024-02-28T16:24:43.279 INFO:tasks.workunit.client.1.smithi153.stdout:9/571: creat d1/d5/d11/d1f/d20/d36/d93/db5/dbe/fbf x:0 0 0 2024-02-28T16:24:43.285 INFO:tasks.workunit.client.1.smithi153.stdout:8/614: creat d0/d19/d2b/d2d/d3f/d9f/fd1 x:0 0 0 2024-02-28T16:24:43.286 INFO:tasks.workunit.client.1.smithi153.stdout:2/640: creat d2/d23/d88/d95/fcc x:0 0 0 2024-02-28T16:24:43.286 INFO:tasks.workunit.client.1.smithi153.stdout:8/615: stat d0/d19/d2b/d2d/f5e 0 2024-02-28T16:24:43.286 INFO:tasks.workunit.client.1.smithi153.stdout:5/621: fsync da/dd/d54/d63/fa5 0 2024-02-28T16:24:43.292 INFO:tasks.workunit.client.1.smithi153.stdout:4/557: rmdir d4/d9c 0 2024-02-28T16:24:43.292 INFO:tasks.workunit.client.1.smithi153.stdout:2/641: chown d2/d19/d31/l96 8208 1 2024-02-28T16:24:43.292 INFO:tasks.workunit.client.1.smithi153.stdout:9/572: symlink d1/d5/d11/d64/d85/d9a/lc0 0 2024-02-28T16:24:43.292 INFO:tasks.workunit.client.1.smithi153.stdout:1/603: rename d0/dd/db2/d89/f9e to d0/dd/fda 0 2024-02-28T16:24:43.292 INFO:tasks.workunit.client.1.smithi153.stdout:2/642: truncate d2/d19/d2a/d3b/d5e/fc8 234461 0 2024-02-28T16:24:43.295 INFO:tasks.workunit.client.1.smithi153.stdout:9/573: rmdir d1/d5/d11/d64 39 2024-02-28T16:24:43.296 INFO:tasks.workunit.client.1.smithi153.stdout:5/622: dread da/dd/f4c [0,4194304] 0 2024-02-28T16:24:43.297 INFO:tasks.workunit.client.1.smithi153.stdout:1/604: symlink d0/dd/db2/d89/dad/ldb 0 2024-02-28T16:24:43.298 INFO:tasks.workunit.client.1.smithi153.stdout:4/558: symlink d4/de/d13/d1b/lb6 0 2024-02-28T16:24:43.299 INFO:tasks.workunit.client.1.smithi153.stdout:5/623: dread - da/dd/d54/db0/fbc zero size 2024-02-28T16:24:43.302 INFO:tasks.workunit.client.1.smithi153.stdout:0/632: dwrite d4/d32/d7f/d8a/dab/d8e/d94/fd2 [0,4194304] 0 2024-02-28T16:24:43.305 INFO:tasks.workunit.client.1.smithi153.stdout:9/574: symlink d1/d74/d7c/lc1 0 2024-02-28T16:24:43.306 INFO:tasks.workunit.client.1.smithi153.stdout:1/605: stat d0/dd/f37 0 2024-02-28T16:24:43.308 INFO:tasks.workunit.client.1.smithi153.stdout:1/606: truncate d0/f74 9187034 0 2024-02-28T16:24:43.308 INFO:tasks.workunit.client.1.smithi153.stdout:8/616: link d0/d34/l46 d0/d12/ld2 0 2024-02-28T16:24:43.309 INFO:tasks.workunit.client.1.smithi153.stdout:9/575: write d1/d5/d11/d1f/d52/fa1 [190327,4388] 0 2024-02-28T16:24:43.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/624: dwrite da/f73 [0,4194304] 0 2024-02-28T16:24:43.322 INFO:tasks.workunit.client.1.smithi153.stdout:0/633: dwrite d4/d32/d7f/d8a/dab/d8e/d94/fdb [0,4194304] 0 2024-02-28T16:24:43.322 INFO:tasks.workunit.client.1.smithi153.stdout:1/607: creat d0/fdc x:0 0 0 2024-02-28T16:24:43.323 INFO:tasks.workunit.client.1.smithi153.stdout:4/559: link d4/de/d13/d1b/d4e/d50/l7a d4/de/d23/d2b/d4b/da9/lb7 0 2024-02-28T16:24:43.327 INFO:tasks.workunit.client.1.smithi153.stdout:9/576: rename d1/d5/d11/d1f/d43/c5b to d1/d5/d11/d1f/d20/d99/cc2 0 2024-02-28T16:24:43.327 INFO:tasks.workunit.client.1.smithi153.stdout:0/634: truncate d4/d32/fad 788398 0 2024-02-28T16:24:43.330 INFO:tasks.workunit.client.1.smithi153.stdout:5/625: symlink da/dd/d25/d8a/dac/dc7/ld0 0 2024-02-28T16:24:43.331 INFO:tasks.workunit.client.1.smithi153.stdout:9/577: write d1/fb0 [650633,95572] 0 2024-02-28T16:24:43.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/635: readlink d4/d89/l98 0 2024-02-28T16:24:43.342 INFO:tasks.workunit.client.1.smithi153.stdout:6/637: dwrite d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/f8b [4194304,4194304] 0 2024-02-28T16:24:43.344 INFO:tasks.workunit.client.1.smithi153.stdout:9/578: write d1/d5/d11/d1f/d20/d36/d93/db5/dbe/fbf [313300,79013] 0 2024-02-28T16:24:43.346 INFO:tasks.workunit.client.1.smithi153.stdout:8/617: dwrite d0/ff [0,4194304] 0 2024-02-28T16:24:43.348 INFO:tasks.workunit.client.1.smithi153.stdout:5/626: mkdir da/dd/dd1 0 2024-02-28T16:24:43.352 INFO:tasks.workunit.client.1.smithi153.stdout:6/638: creat d0/d17/fe2 x:0 0 0 2024-02-28T16:24:43.355 INFO:tasks.workunit.client.1.smithi153.stdout:0/636: unlink d4/d32/d7f/cbb 0 2024-02-28T16:24:43.358 INFO:tasks.workunit.client.1.smithi153.stdout:2/643: dwrite d2/d19/d2a/d3b/f4e [0,4194304] 0 2024-02-28T16:24:43.360 INFO:tasks.workunit.client.1.smithi153.stdout:5/627: rename da/dd/d25/d82/d8f/c95 to da/dd/dd1/cd2 0 2024-02-28T16:24:43.361 INFO:tasks.workunit.client.1.smithi153.stdout:4/560: write d4/f5 [411515,79511] 0 2024-02-28T16:24:43.363 INFO:tasks.workunit.client.1.smithi153.stdout:2/644: write d2/d25/fb6 [776459,119492] 0 2024-02-28T16:24:43.364 INFO:tasks.workunit.client.1.smithi153.stdout:6/639: unlink d0/d1d/d30/dd0/fd4 0 2024-02-28T16:24:43.366 INFO:tasks.workunit.client.1.smithi153.stdout:4/561: chown d4/de/d23/d2b/d31/da2/da5/db2/l88 1030361 1 2024-02-28T16:24:43.370 INFO:tasks.workunit.client.1.smithi153.stdout:9/579: link d1/d5/d27/f41 d1/d74/d80/da8/fc3 0 2024-02-28T16:24:43.374 INFO:tasks.workunit.client.1.smithi153.stdout:1/608: dread d0/d3d/f4f [0,4194304] 0 2024-02-28T16:24:43.374 INFO:tasks.workunit.client.1.smithi153.stdout:8/618: rename d0/d25/f57 to d0/d19/d2b/d2d/d3f/d9f/fd3 0 2024-02-28T16:24:43.376 INFO:tasks.workunit.client.1.smithi153.stdout:4/562: creat d4/de/d47/fb8 x:0 0 0 2024-02-28T16:24:43.376 INFO:tasks.workunit.client.1.smithi153.stdout:3/630: sync 2024-02-28T16:24:43.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/631: write d4/d13/d8f/fb9 [291665,130552] 0 2024-02-28T16:24:43.381 INFO:tasks.workunit.client.1.smithi153.stdout:0/637: rename d4/d32/d7f/d8a/dab/d8e/d90/f2e to d4/d32/d7f/d8a/dab/d8e/d94/fdd 0 2024-02-28T16:24:43.383 INFO:tasks.workunit.client.1.smithi153.stdout:4/563: write d4/de/f19 [4121297,42928] 0 2024-02-28T16:24:43.384 INFO:tasks.workunit.client.1.smithi153.stdout:8/619: dread d0/d19/f76 [0,4194304] 0 2024-02-28T16:24:43.391 INFO:tasks.workunit.client.1.smithi153.stdout:2/645: dwrite d2/d19/d2a/d3b/d87/fad [0,4194304] 0 2024-02-28T16:24:43.393 INFO:tasks.workunit.client.1.smithi153.stdout:5/628: getdents da/dd/d25/d82 0 2024-02-28T16:24:43.393 INFO:tasks.workunit.client.1.smithi153.stdout:9/580: dwrite d1/d5/d11/d1f/d20/d36/f38 [8388608,4194304] 0 2024-02-28T16:24:43.396 INFO:tasks.workunit.client.1.smithi153.stdout:3/632: creat d4/d13/d28/d36/d9f/fde x:0 0 0 2024-02-28T16:24:43.402 INFO:tasks.workunit.client.1.smithi153.stdout:6/640: write d0/d1d/d33/d9c/d2e/f4e [657689,128079] 0 2024-02-28T16:24:43.409 INFO:tasks.workunit.client.1.smithi153.stdout:3/633: read - d4/d49/f9a zero size 2024-02-28T16:24:43.409 INFO:tasks.workunit.client.1.smithi153.stdout:4/564: mkdir d4/db9 0 2024-02-28T16:24:43.411 INFO:tasks.workunit.client.1.smithi153.stdout:0/638: getdents d4/d32/d7f/d8a/dab/d8e/d94/dd7 0 2024-02-28T16:24:43.411 INFO:tasks.workunit.client.1.smithi153.stdout:6/641: creat d0/d17/d7e/fe3 x:0 0 0 2024-02-28T16:24:43.412 INFO:tasks.workunit.client.1.smithi153.stdout:3/634: chown d4/l50 50427 1 2024-02-28T16:24:43.412 INFO:tasks.workunit.client.1.smithi153.stdout:2/646: symlink d2/d25/d49/lcd 0 2024-02-28T16:24:43.415 INFO:tasks.workunit.client.1.smithi153.stdout:9/581: mknod d1/d5/d11/d64/cc4 0 2024-02-28T16:24:43.416 INFO:tasks.workunit.client.1.smithi153.stdout:2/647: fdatasync d2/d23/d36/f3c 0 2024-02-28T16:24:43.419 INFO:tasks.workunit.client.1.smithi153.stdout:9/582: creat d1/d5/d27/fc5 x:0 0 0 2024-02-28T16:24:43.422 INFO:tasks.workunit.client.1.smithi153.stdout:3/635: creat d4/d8/d1e/d2a/fdf x:0 0 0 2024-02-28T16:24:43.424 INFO:tasks.workunit.client.1.smithi153.stdout:2/648: write d2/d23/d88/f9a [400548,107401] 0 2024-02-28T16:24:43.424 INFO:tasks.workunit.client.1.smithi153.stdout:4/565: dread d4/de/d13/f18 [0,4194304] 0 2024-02-28T16:24:43.426 INFO:tasks.workunit.client.1.smithi153.stdout:5/629: dwrite da/dd/d25/f57 [0,4194304] 0 2024-02-28T16:24:43.426 INFO:tasks.workunit.client.1.smithi153.stdout:1/609: dread d0/dd/d84/fa4 [0,4194304] 0 2024-02-28T16:24:43.429 INFO:tasks.workunit.client.1.smithi153.stdout:4/566: chown d4/de/d23/f70 0 1 2024-02-28T16:24:43.430 INFO:tasks.workunit.client.1.smithi153.stdout:0/639: rename d4/d99/da5/la9 to d4/d32/d7f/d8a/dab/d8e/d94/lde 0 2024-02-28T16:24:43.434 INFO:tasks.workunit.client.1.smithi153.stdout:4/567: dread - d4/de/d47/d5e/d62/fad zero size 2024-02-28T16:24:43.435 INFO:tasks.workunit.client.1.smithi153.stdout:5/630: dread da/dd/d54/f96 [0,4194304] 0 2024-02-28T16:24:43.439 INFO:tasks.workunit.client.1.smithi153.stdout:1/610: symlink d0/d62/ldd 0 2024-02-28T16:24:43.442 INFO:tasks.workunit.client.1.smithi153.stdout:4/568: chown d4/de/d47/d5e/d62/l66 2 1 2024-02-28T16:24:43.443 INFO:tasks.workunit.client.1.smithi153.stdout:5/631: mknod da/d29/d43/d5a/cd3 0 2024-02-28T16:24:43.444 INFO:tasks.workunit.client.1.smithi153.stdout:4/569: chown d4/de/d23/d2b/c86 25 1 2024-02-28T16:24:43.445 INFO:tasks.workunit.client.1.smithi153.stdout:8/620: dread d0/d12/d67/d30/f3a [0,4194304] 0 2024-02-28T16:24:43.447 INFO:tasks.workunit.client.1.smithi153.stdout:6/642: link d0/d1d/d33/d9c/d48/d72/f76 d0/d1d/d33/d9c/d68/dcb/fe4 0 2024-02-28T16:24:43.447 INFO:tasks.workunit.client.1.smithi153.stdout:2/649: write d2/d25/d49/da3/fc6 [2136041,69744] 0 2024-02-28T16:24:43.448 INFO:tasks.workunit.client.1.smithi153.stdout:9/583: write d1/d74/d80/da8/f25 [165389,59713] 0 2024-02-28T16:24:43.449 INFO:tasks.workunit.client.1.smithi153.stdout:3/636: creat d4/d13/fe0 x:0 0 0 2024-02-28T16:24:43.449 INFO:tasks.workunit.client.1.smithi153.stdout:1/611: stat d0/dd/c73 0 2024-02-28T16:24:43.451 INFO:tasks.workunit.client.1.smithi153.stdout:9/584: stat d1/l2c 0 2024-02-28T16:24:43.453 INFO:tasks.workunit.client.1.smithi153.stdout:0/640: dwrite d4/d99/da5/fb1 [0,4194304] 0 2024-02-28T16:24:43.454 INFO:tasks.workunit.client.1.smithi153.stdout:8/621: creat d0/d12/d15/fd4 x:0 0 0 2024-02-28T16:24:43.457 INFO:tasks.workunit.client.1.smithi153.stdout:7/641: sync 2024-02-28T16:24:43.457 INFO:tasks.workunit.client.1.smithi153.stdout:1/612: dread - d0/d62/d66/fba zero size 2024-02-28T16:24:43.457 INFO:tasks.workunit.client.1.smithi153.stdout:4/570: dread d4/de/d13/f84 [0,4194304] 0 2024-02-28T16:24:43.467 INFO:tasks.workunit.client.1.smithi153.stdout:8/622: write d0/d25/d79/fc7 [920652,129458] 0 2024-02-28T16:24:43.468 INFO:tasks.workunit.client.1.smithi153.stdout:1/613: dread - d0/dd/db2/d89/daa/fb9 zero size 2024-02-28T16:24:43.469 INFO:tasks.workunit.client.1.smithi153.stdout:5/632: dwrite da/f16 [0,4194304] 0 2024-02-28T16:24:43.471 INFO:tasks.workunit.client.1.smithi153.stdout:8/623: chown d0/d12/f81 57 1 2024-02-28T16:24:43.482 INFO:tasks.workunit.client.1.smithi153.stdout:1/614: write d0/dd/f21 [4282375,100028] 0 2024-02-28T16:24:43.482 INFO:tasks.workunit.client.1.smithi153.stdout:3/637: dwrite d4/d13/d28/fdc [0,4194304] 0 2024-02-28T16:24:43.483 INFO:tasks.workunit.client.1.smithi153.stdout:7/642: dread d1/d25/d27/f9b [0,4194304] 0 2024-02-28T16:24:43.488 INFO:tasks.workunit.client.1.smithi153.stdout:9/585: write d1/d74/d80/da8/f46 [872490,116451] 0 2024-02-28T16:24:43.489 INFO:tasks.workunit.client.1.smithi153.stdout:6/643: link d0/d1d/d33/d9c/f1a d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/fe5 0 2024-02-28T16:24:43.489 INFO:tasks.workunit.client.1.smithi153.stdout:5/633: creat da/dd/d25/d8a/db3/fd4 x:0 0 0 2024-02-28T16:24:43.490 INFO:tasks.workunit.client.1.smithi153.stdout:6/644: dread - d0/d1d/d33/db2/fcd zero size 2024-02-28T16:24:43.491 INFO:tasks.workunit.client.1.smithi153.stdout:4/571: getdents d4/de/d23 0 2024-02-28T16:24:43.495 INFO:tasks.workunit.client.1.smithi153.stdout:1/615: read d0/d62/f8f [1263515,2178] 0 2024-02-28T16:24:43.499 INFO:tasks.workunit.client.1.smithi153.stdout:2/650: dread d2/d25/d49/da3/fc6 [0,4194304] 0 2024-02-28T16:24:43.500 INFO:tasks.workunit.client.1.smithi153.stdout:0/641: truncate d4/d27/d9a/da1/f7a 517883 0 2024-02-28T16:24:43.507 INFO:tasks.workunit.client.1.smithi153.stdout:7/643: dwrite d1/d25/df/f47 [0,4194304] 0 2024-02-28T16:24:43.512 INFO:tasks.workunit.client.1.smithi153.stdout:1/616: dwrite d0/dd/fd0 [4194304,4194304] 0 2024-02-28T16:24:43.521 INFO:tasks.workunit.client.1.smithi153.stdout:9/586: mkdir d1/d5/d11/d1f/d20/dc6 0 2024-02-28T16:24:43.522 INFO:tasks.workunit.client.1.smithi153.stdout:5/634: unlink da/d29/d43/d5a/cb5 0 2024-02-28T16:24:43.523 INFO:tasks.workunit.client.1.smithi153.stdout:7/644: dread d1/d25/df/f8f [0,4194304] 0 2024-02-28T16:24:43.523 INFO:tasks.workunit.client.1.smithi153.stdout:0/642: dwrite d4/d99/da5/fca [0,4194304] 0 2024-02-28T16:24:43.525 INFO:tasks.workunit.client.1.smithi153.stdout:4/572: rename d4/de/d13/d1b/d4e to d4/de/d23/d2b/d4b/dba 0 2024-02-28T16:24:43.526 INFO:tasks.workunit.client.1.smithi153.stdout:8/624: creat d0/d12/d67/fd5 x:0 0 0 2024-02-28T16:24:43.527 INFO:tasks.workunit.client.1.smithi153.stdout:7/645: readlink d1/d25/d27/d43/l44 0 2024-02-28T16:24:43.531 INFO:tasks.workunit.client.1.smithi153.stdout:2/651: mkdir d2/d86/da0/dce 0 2024-02-28T16:24:43.535 INFO:tasks.workunit.client.1.smithi153.stdout:6/645: mknod d0/d66/db3/ce6 0 2024-02-28T16:24:43.538 INFO:tasks.workunit.client.1.smithi153.stdout:7/646: mkdir d1/d25/d27/d7c/dc4/dd6 0 2024-02-28T16:24:43.548 INFO:tasks.workunit.client.1.smithi153.stdout:8/625: symlink d0/d19/ld6 0 2024-02-28T16:24:43.549 INFO:tasks.workunit.client.1.smithi153.stdout:9/587: dwrite d1/d74/d80/da8/f4f [0,4194304] 0 2024-02-28T16:24:43.552 INFO:tasks.workunit.client.1.smithi153.stdout:3/638: link d4/d8/f4d d4/d8/d1e/d2a/d91/fe1 0 2024-02-28T16:24:43.553 INFO:tasks.workunit.client.1.smithi153.stdout:9/588: write d1/d5/fb [624039,48455] 0 2024-02-28T16:24:43.555 INFO:tasks.workunit.client.1.smithi153.stdout:2/652: dwrite d2/d86/fac [0,4194304] 0 2024-02-28T16:24:43.556 INFO:tasks.workunit.client.1.smithi153.stdout:6/646: creat d0/d17/fe7 x:0 0 0 2024-02-28T16:24:43.563 INFO:tasks.workunit.client.1.smithi153.stdout:4/573: creat d4/d53/d7c/da4/fbb x:0 0 0 2024-02-28T16:24:43.565 INFO:tasks.workunit.client.1.smithi153.stdout:9/589: write d1/d5/d11/d1f/d52/f6c [932996,16766] 0 2024-02-28T16:24:43.575 INFO:tasks.workunit.client.1.smithi153.stdout:2/653: fdatasync d2/d19/d8b/f9f 0 2024-02-28T16:24:43.575 INFO:tasks.workunit.client.1.smithi153.stdout:5/635: dwrite da/fb [0,4194304] 0 2024-02-28T16:24:43.576 INFO:tasks.workunit.client.1.smithi153.stdout:6/647: creat d0/d1d/d30/d71/fe8 x:0 0 0 2024-02-28T16:24:43.582 INFO:tasks.workunit.client.1.smithi153.stdout:1/617: getdents d0/dd/db2/d80 0 2024-02-28T16:24:43.582 INFO:tasks.workunit.client.1.smithi153.stdout:0/643: dread d4/d27/f3a [0,4194304] 0 2024-02-28T16:24:43.586 INFO:tasks.workunit.client.1.smithi153.stdout:6/648: mkdir d0/d1d/d5d/de9 0 2024-02-28T16:24:43.593 INFO:tasks.workunit.client.1.smithi153.stdout:9/590: mknod d1/d5/cc7 0 2024-02-28T16:24:43.593 INFO:tasks.workunit.client.1.smithi153.stdout:2/654: mkdir d2/d19/d8b/dcf 0 2024-02-28T16:24:43.594 INFO:tasks.workunit.client.1.smithi153.stdout:0/644: mkdir d4/d99/da5/ddf 0 2024-02-28T16:24:43.597 INFO:tasks.workunit.client.1.smithi153.stdout:1/618: mkdir d0/dd/db2/d89/dad/dde 0 2024-02-28T16:24:43.597 INFO:tasks.workunit.client.1.smithi153.stdout:8/626: dread d0/d12/d15/f29 [0,4194304] 0 2024-02-28T16:24:43.599 INFO:tasks.workunit.client.1.smithi153.stdout:2/655: write d2/d19/d2a/d3b/d87/da5/fbe [396452,206] 0 2024-02-28T16:24:43.600 INFO:tasks.workunit.client.1.smithi153.stdout:5/636: creat da/d29/d43/fd5 x:0 0 0 2024-02-28T16:24:43.601 INFO:tasks.workunit.client.1.smithi153.stdout:9/591: chown d1/d5/d11/d64/d85 4 1 2024-02-28T16:24:43.603 INFO:tasks.workunit.client.1.smithi153.stdout:8/627: chown d0/d12/d67/c95 14077856 1 2024-02-28T16:24:43.604 INFO:tasks.workunit.client.1.smithi153.stdout:0/645: creat d4/d27/d9a/da1/db0/fe0 x:0 0 0 2024-02-28T16:24:43.605 INFO:tasks.workunit.client.1.smithi153.stdout:1/619: rmdir d0/d3d/d4a 39 2024-02-28T16:24:43.605 INFO:tasks.workunit.client.1.smithi153.stdout:5/637: write da/f19 [163807,5332] 0 2024-02-28T16:24:43.606 INFO:tasks.workunit.client.1.smithi153.stdout:2/656: mkdir d2/d63/dd0 0 2024-02-28T16:24:43.613 INFO:tasks.workunit.client.1.smithi153.stdout:4/574: dwrite d4/de/d40/d4d/f5d [0,4194304] 0 2024-02-28T16:24:43.615 INFO:tasks.workunit.client.1.smithi153.stdout:2/657: mkdir d2/d19/d31/dd1 0 2024-02-28T16:24:43.615 INFO:tasks.workunit.client.1.smithi153.stdout:0/646: rename d4/d32 to d4/d32/d7f/d8a/dab/d8e/d90/de1 22 2024-02-28T16:24:43.618 INFO:tasks.workunit.client.1.smithi153.stdout:7/647: dread d1/d25/df/f4e [0,4194304] 0 2024-02-28T16:24:43.621 INFO:tasks.workunit.client.1.smithi153.stdout:5/638: mkdir da/d29/d43/d5a/d77/dd6 0 2024-02-28T16:24:43.623 INFO:tasks.workunit.client.1.smithi153.stdout:0/647: truncate d4/d32/f82 905215 0 2024-02-28T16:24:43.627 INFO:tasks.workunit.client.1.smithi153.stdout:9/592: dwrite d1/d5/f7a [0,4194304] 0 2024-02-28T16:24:43.632 INFO:tasks.workunit.client.1.smithi153.stdout:8/628: link d0/d12/d67/d30/f65 d0/d12/d67/d30/d63/d74/fd7 0 2024-02-28T16:24:43.634 INFO:tasks.workunit.client.1.smithi153.stdout:0/648: write d4/d32/d7f/d8a/fc6 [1024708,27572] 0 2024-02-28T16:24:43.635 INFO:tasks.workunit.client.1.smithi153.stdout:3/639: dread d4/d8/d1e/d23/f24 [0,4194304] 0 2024-02-28T16:24:43.637 INFO:tasks.workunit.client.1.smithi153.stdout:4/575: creat d4/fbc x:0 0 0 2024-02-28T16:24:43.638 INFO:tasks.workunit.client.1.smithi153.stdout:1/620: dwrite d0/fc4 [0,4194304] 0 2024-02-28T16:24:43.648 INFO:tasks.workunit.client.1.smithi153.stdout:8/629: chown d0/d19/d2b/la0 15 1 2024-02-28T16:24:43.650 INFO:tasks.workunit.client.1.smithi153.stdout:2/658: getdents d2/d86 0 2024-02-28T16:24:43.650 INFO:tasks.workunit.client.1.smithi153.stdout:9/593: truncate d1/d5/d11/d29/f6e 4281285 0 2024-02-28T16:24:43.652 INFO:tasks.workunit.client.1.smithi153.stdout:8/630: write d0/d25/f6b [3648964,14010] 0 2024-02-28T16:24:43.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/649: write d4/fa [930586,48673] 0 2024-02-28T16:24:43.654 INFO:tasks.workunit.client.1.smithi153.stdout:3/640: read d4/d7d/f44 [1094373,16626] 0 2024-02-28T16:24:43.656 INFO:tasks.workunit.client.1.smithi153.stdout:8/631: stat d0/d12 0 2024-02-28T16:24:43.659 INFO:tasks.workunit.client.1.smithi153.stdout:2/659: creat d2/d23/d88/fd2 x:0 0 0 2024-02-28T16:24:43.664 INFO:tasks.workunit.client.1.smithi153.stdout:9/594: write d1/d5/d11/d1f/d20/d36/d93/db5/faa [950491,12947] 0 2024-02-28T16:24:43.664 INFO:tasks.workunit.client.1.smithi153.stdout:8/632: unlink d0/l10 0 2024-02-28T16:24:43.667 INFO:tasks.workunit.client.1.smithi153.stdout:5/639: dwrite da/dd/d54/f69 [0,4194304] 0 2024-02-28T16:24:43.667 INFO:tasks.workunit.client.1.smithi153.stdout:3/641: mkdir d4/d8/d1e/d2a/d35/d54/de2 0 2024-02-28T16:24:43.670 INFO:tasks.workunit.client.1.smithi153.stdout:9/595: stat d1/d5/d11/d1f/d20 0 2024-02-28T16:24:43.676 INFO:tasks.workunit.client.1.smithi153.stdout:4/576: dwrite d4/de/d13/d1b/f5f [0,4194304] 0 2024-02-28T16:24:43.677 INFO:tasks.workunit.client.1.smithi153.stdout:9/596: creat d1/d74/d80/fc8 x:0 0 0 2024-02-28T16:24:43.681 INFO:tasks.workunit.client.1.smithi153.stdout:0/650: link d4/d99/cac d4/d32/db7/ce2 0 2024-02-28T16:24:43.681 INFO:tasks.workunit.client.1.smithi153.stdout:7/648: dread d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:43.687 INFO:tasks.workunit.client.1.smithi153.stdout:2/660: rename d2/d19/d2a/d3b/d87/da5/fbe to d2/d19/d2a/d3b/d5e/fd3 0 2024-02-28T16:24:43.691 INFO:tasks.workunit.client.1.smithi153.stdout:3/642: mknod d4/d8/d1e/d23/ce3 0 2024-02-28T16:24:43.695 INFO:tasks.workunit.client.1.smithi153.stdout:1/621: dread d0/d62/d66/d8e/fa5 [0,4194304] 0 2024-02-28T16:24:43.701 INFO:tasks.workunit.client.1.smithi153.stdout:9/597: rename d1/d5/d11/d1f/d20/d36/d93/db5/faa to d1/d5/d11/d64/fc9 0 2024-02-28T16:24:43.704 INFO:tasks.workunit.client.1.smithi153.stdout:6/649: sync 2024-02-28T16:24:43.705 INFO:tasks.workunit.client.1.smithi153.stdout:5/640: write da/d29/f5b [2672767,128740] 0 2024-02-28T16:24:43.705 INFO:tasks.workunit.client.1.smithi153.stdout:4/577: dread d4/de/f16 [0,4194304] 0 2024-02-28T16:24:43.707 INFO:tasks.workunit.client.1.smithi153.stdout:8/633: write d0/d12/d67/d30/d63/d74/fd7 [4748612,25199] 0 2024-02-28T16:24:43.708 INFO:tasks.workunit.client.1.smithi153.stdout:4/578: chown d4/de/cb5 4017343 1 2024-02-28T16:24:43.708 INFO:tasks.workunit.client.1.smithi153.stdout:1/622: write d0/d3d/d4a/f56 [1895758,2573] 0 2024-02-28T16:24:43.709 INFO:tasks.workunit.client.1.smithi153.stdout:3/643: creat d4/d8/d1e/d2a/d55/da3/fe4 x:0 0 0 2024-02-28T16:24:43.717 INFO:tasks.workunit.client.1.smithi153.stdout:4/579: dread d4/de/d23/d2b/d31/f96 [0,4194304] 0 2024-02-28T16:24:43.719 INFO:tasks.workunit.client.1.smithi153.stdout:7/649: write d1/d25/df/d26/d3a/d3f/f74 [4088272,122157] 0 2024-02-28T16:24:43.720 INFO:tasks.workunit.client.1.smithi153.stdout:5/641: creat da/dd/d54/db0/fd7 x:0 0 0 2024-02-28T16:24:43.720 INFO:tasks.workunit.client.1.smithi153.stdout:2/661: write d2/d19/d2a/f76 [2248601,43206] 0 2024-02-28T16:24:43.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/650: unlink d0/d1d/d33/d9c/d68/da2/fa7 0 2024-02-28T16:24:43.725 INFO:tasks.workunit.client.1.smithi153.stdout:0/651: write d4/d27/d9a/da1/f7a [370517,26254] 0 2024-02-28T16:24:43.725 INFO:tasks.workunit.client.1.smithi153.stdout:6/651: write d0/d1d/d33/db2/fcd [908248,66251] 0 2024-02-28T16:24:43.726 INFO:tasks.workunit.client.1.smithi153.stdout:8/634: creat d0/d19/d1e/fd8 x:0 0 0 2024-02-28T16:24:43.727 INFO:tasks.workunit.client.1.smithi153.stdout:6/652: chown d0/d1d/d33/d8d 1891 1 2024-02-28T16:24:43.733 INFO:tasks.workunit.client.1.smithi153.stdout:3/644: rename d4/d8/d1e/d2a/d35/d54/lc6 to d4/d8/d1e/d2a/d55/da3/le5 0 2024-02-28T16:24:43.742 INFO:tasks.workunit.client.1.smithi153.stdout:2/662: write d2/ff [2830827,15851] 0 2024-02-28T16:24:43.743 INFO:tasks.workunit.client.1.smithi153.stdout:5/642: creat da/dd/d25/d8a/fd8 x:0 0 0 2024-02-28T16:24:43.743 INFO:tasks.workunit.client.1.smithi153.stdout:9/598: truncate d1/fb0 455548 0 2024-02-28T16:24:43.745 INFO:tasks.workunit.client.1.smithi153.stdout:7/650: symlink d1/d25/df/d26/d3a/d95/ld7 0 2024-02-28T16:24:43.745 INFO:tasks.workunit.client.1.smithi153.stdout:4/580: write d4/de/f12 [1348340,96911] 0 2024-02-28T16:24:43.745 INFO:tasks.workunit.client.1.smithi153.stdout:2/663: fdatasync d2/ff 0 2024-02-28T16:24:43.747 INFO:tasks.workunit.client.1.smithi153.stdout:9/599: write d1/d5/d11/d1f/d20/d45/f4a [270184,35427] 0 2024-02-28T16:24:43.749 INFO:tasks.workunit.client.1.smithi153.stdout:8/635: symlink d0/d19/d2b/d2d/d3f/d9f/dcc/ld9 0 2024-02-28T16:24:43.749 INFO:tasks.workunit.client.1.smithi153.stdout:7/651: write d1/d25/df/d5a/fd1 [639000,54721] 0 2024-02-28T16:24:43.749 INFO:tasks.workunit.client.1.smithi153.stdout:6/653: mknod d0/d1d/d33/d9c/d48/d63/d8c/dc3/cea 0 2024-02-28T16:24:43.751 INFO:tasks.workunit.client.1.smithi153.stdout:4/581: write d4/de/d23/d2b/d31/f64 [1853011,92490] 0 2024-02-28T16:24:43.751 INFO:tasks.workunit.client.1.smithi153.stdout:9/600: dread - d1/d74/d80/fc8 zero size 2024-02-28T16:24:43.752 INFO:tasks.workunit.client.1.smithi153.stdout:6/654: fdatasync d0/d1d/d30/d71/fe8 0 2024-02-28T16:24:43.753 INFO:tasks.workunit.client.1.smithi153.stdout:5/643: creat da/dd/d25/d82/d8f/fd9 x:0 0 0 2024-02-28T16:24:43.756 INFO:tasks.workunit.client.1.smithi153.stdout:7/652: truncate d1/d25/d27/d7c/dc4/fc0 268435 0 2024-02-28T16:24:43.756 INFO:tasks.workunit.client.1.smithi153.stdout:0/652: mknod d4/d99/da5/dd4/ce3 0 2024-02-28T16:24:43.757 INFO:tasks.workunit.client.1.smithi153.stdout:4/582: readlink d4/de/d47/la1 0 2024-02-28T16:24:43.757 INFO:tasks.workunit.client.1.smithi153.stdout:6/655: chown d0/d1d/d33/d9c/d48/d72/fca 8158327 1 2024-02-28T16:24:43.759 INFO:tasks.workunit.client.1.smithi153.stdout:4/583: stat d4/de/d47/d5e/d62/l74 0 2024-02-28T16:24:43.760 INFO:tasks.workunit.client.1.smithi153.stdout:5/644: unlink da/ccd 0 2024-02-28T16:24:43.761 INFO:tasks.workunit.client.1.smithi153.stdout:5/645: truncate da/f86 717386 0 2024-02-28T16:24:43.761 INFO:tasks.workunit.client.1.smithi153.stdout:9/601: mkdir d1/d5/d11/d1f/d62/dca 0 2024-02-28T16:24:43.762 INFO:tasks.workunit.client.1.smithi153.stdout:5/646: stat da/f3a 0 2024-02-28T16:24:43.763 INFO:tasks.workunit.client.1.smithi153.stdout:7/653: mknod d1/d25/d27/d43/cd8 0 2024-02-28T16:24:43.765 INFO:tasks.workunit.client.1.smithi153.stdout:9/602: rmdir d1/d74 39 2024-02-28T16:24:43.766 INFO:tasks.workunit.client.1.smithi153.stdout:5/647: read da/dd/d25/f58 [2783686,45470] 0 2024-02-28T16:24:43.768 INFO:tasks.workunit.client.1.smithi153.stdout:4/584: rename d4/de/d40/d4d/c92 to d4/de/d23/d2b/d9b/cbd 0 2024-02-28T16:24:43.771 INFO:tasks.workunit.client.1.smithi153.stdout:4/585: truncate d4/d53/d7c/f9a 336684 0 2024-02-28T16:24:43.776 INFO:tasks.workunit.client.1.smithi153.stdout:4/586: stat d4/de/d40/d4d/f82 0 2024-02-28T16:24:43.781 INFO:tasks.workunit.client.1.smithi153.stdout:5/648: mkdir da/dd/d25/d41/dda 0 2024-02-28T16:24:43.785 INFO:tasks.workunit.client.1.smithi153.stdout:2/664: dread d2/d23/d36/f51 [0,4194304] 0 2024-02-28T16:24:43.785 INFO:tasks.workunit.client.1.smithi153.stdout:5/649: mknod da/dd/d25/d82/d8f/cdb 0 2024-02-28T16:24:43.788 INFO:tasks.workunit.client.1.smithi153.stdout:9/603: dwrite d1/d5/d27/fab [0,4194304] 0 2024-02-28T16:24:43.788 INFO:tasks.workunit.client.1.smithi153.stdout:8/636: dread d0/d12/d15/f5f [0,4194304] 0 2024-02-28T16:24:43.790 INFO:tasks.workunit.client.1.smithi153.stdout:5/650: truncate da/d29/d43/d5a/dbe/fc9 63425 0 2024-02-28T16:24:43.791 INFO:tasks.workunit.client.1.smithi153.stdout:2/665: unlink d2/d19/d2a/d3b/c82 0 2024-02-28T16:24:43.794 INFO:tasks.workunit.client.1.smithi153.stdout:0/653: write d4/d27/dc1/fce [1023796,115294] 0 2024-02-28T16:24:43.795 INFO:tasks.workunit.client.1.smithi153.stdout:8/637: rename d0/d34/fce to d0/d19/d2b/d2d/fda 0 2024-02-28T16:24:43.796 INFO:tasks.workunit.client.1.smithi153.stdout:0/654: fsync d4/d32/d7f/db3/fd8 0 2024-02-28T16:24:43.796 INFO:tasks.workunit.client.1.smithi153.stdout:7/654: dread d1/d25/d27/d7c/dc4/f6e [0,4194304] 0 2024-02-28T16:24:43.797 INFO:tasks.workunit.client.1.smithi153.stdout:7/655: readlink d1/d25/d88/la1 0 2024-02-28T16:24:43.798 INFO:tasks.workunit.client.1.smithi153.stdout:2/666: symlink d2/d19/d31/ld4 0 2024-02-28T16:24:43.807 INFO:tasks.workunit.client.1.smithi153.stdout:5/651: dwrite da/fc [4194304,4194304] 0 2024-02-28T16:24:43.808 INFO:tasks.workunit.client.1.smithi153.stdout:2/667: dread d2/d23/d88/f9a [0,4194304] 0 2024-02-28T16:24:43.816 INFO:tasks.workunit.client.1.smithi153.stdout:7/656: dwrite d1/d25/fcd [0,4194304] 0 2024-02-28T16:24:43.819 INFO:tasks.workunit.client.1.smithi153.stdout:9/604: link d1/d74/d80/da8/l77 d1/d74/d7c/lcb 0 2024-02-28T16:24:43.821 INFO:tasks.workunit.client.1.smithi153.stdout:8/638: getdents d0/d25/d79 0 2024-02-28T16:24:43.822 INFO:tasks.workunit.client.1.smithi153.stdout:0/655: getdents d4/d32/d7f/d8a/dab/d8e 0 2024-02-28T16:24:43.827 INFO:tasks.workunit.client.1.smithi153.stdout:2/668: creat d2/fd5 x:0 0 0 2024-02-28T16:24:43.832 INFO:tasks.workunit.client.1.smithi153.stdout:0/656: mknod d4/d27/d9a/da1/db0/ce4 0 2024-02-28T16:24:43.833 INFO:tasks.workunit.client.1.smithi153.stdout:7/657: dread d1/d25/d27/f5c [0,4194304] 0 2024-02-28T16:24:43.834 INFO:tasks.workunit.client.1.smithi153.stdout:2/669: creat d2/d23/d88/fd6 x:0 0 0 2024-02-28T16:24:43.837 INFO:tasks.workunit.client.1.smithi153.stdout:2/670: write d2/d19/fc1 [3107545,63078] 0 2024-02-28T16:24:43.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/652: write da/d29/f92 [296966,79128] 0 2024-02-28T16:24:43.854 INFO:tasks.workunit.client.1.smithi153.stdout:0/657: dwrite d4/fa [0,4194304] 0 2024-02-28T16:24:43.854 INFO:tasks.workunit.client.1.smithi153.stdout:5/653: write da/dd/d25/d82/d8f/fd9 [322512,66814] 0 2024-02-28T16:24:43.857 INFO:tasks.workunit.client.1.smithi153.stdout:9/605: dread d1/d5/d11/d1f/d20/d36/f2d [0,4194304] 0 2024-02-28T16:24:43.862 INFO:tasks.workunit.client.1.smithi153.stdout:7/658: dwrite d1/d25/d88/fc1 [0,4194304] 0 2024-02-28T16:24:43.865 INFO:tasks.workunit.client.1.smithi153.stdout:2/671: dwrite d2/d19/d31/f58 [0,4194304] 0 2024-02-28T16:24:43.867 INFO:tasks.workunit.client.1.smithi153.stdout:0/658: chown d4/d32/d7f/d8a/dab/d8e/d90/f18 4 1 2024-02-28T16:24:43.868 INFO:tasks.workunit.client.1.smithi153.stdout:9/606: write d1/d5/d11/d54/f95 [297768,120816] 0 2024-02-28T16:24:43.869 INFO:tasks.workunit.client.1.smithi153.stdout:5/654: mknod da/dd/d25/d8a/db3/cdc 0 2024-02-28T16:24:43.870 INFO:tasks.workunit.client.1.smithi153.stdout:0/659: readlink d4/d27/l41 0 2024-02-28T16:24:43.873 INFO:tasks.workunit.client.1.smithi153.stdout:2/672: unlink d2/d25/f34 0 2024-02-28T16:24:43.876 INFO:tasks.workunit.client.1.smithi153.stdout:5/655: mkdir da/dd/dd1/ddd 0 2024-02-28T16:24:43.876 INFO:tasks.workunit.client.1.smithi153.stdout:8/639: dread d0/d12/d67/d30/f65 [0,4194304] 0 2024-02-28T16:24:43.878 INFO:tasks.workunit.client.1.smithi153.stdout:5/656: write da/d29/d43/d5a/d77/f83 [563202,58982] 0 2024-02-28T16:24:43.879 INFO:tasks.workunit.client.1.smithi153.stdout:9/607: mkdir d1/d69/dbb/dcc 0 2024-02-28T16:24:43.880 INFO:tasks.workunit.client.1.smithi153.stdout:8/640: write d0/d12/d67/d30/f7a [4037151,22515] 0 2024-02-28T16:24:43.881 INFO:tasks.workunit.client.1.smithi153.stdout:7/659: rename d1/d25/df/d26/d3a/d95/ld7 to d1/d25/d27/d7c/dc4/d63/d75/ld9 0 2024-02-28T16:24:43.883 INFO:tasks.workunit.client.1.smithi153.stdout:8/641: chown d0/d19/d1e/l6a 2 1 2024-02-28T16:24:43.885 INFO:tasks.workunit.client.1.smithi153.stdout:5/657: dread - da/d29/d43/fa2 zero size 2024-02-28T16:24:43.886 INFO:tasks.workunit.client.1.smithi153.stdout:0/660: dread d4/d99/da5/fb1 [0,4194304] 0 2024-02-28T16:24:43.888 INFO:tasks.workunit.client.1.smithi153.stdout:2/673: creat d2/d23/d88/d95/dbb/fd7 x:0 0 0 2024-02-28T16:24:43.891 INFO:tasks.workunit.client.1.smithi153.stdout:8/642: rmdir d0/d19/d1e 39 2024-02-28T16:24:43.895 INFO:tasks.workunit.client.1.smithi153.stdout:8/643: creat d0/d25/d79/db3/fdb x:0 0 0 2024-02-28T16:24:43.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:43 smithi153 ceph-mon[35341]: pgmap v11: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 MiB/s rd, 130 MiB/s wr, 260 op/s 2024-02-28T16:24:43.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:43 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:24:43.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:43 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:24:43.897 INFO:tasks.workunit.client.1.smithi153.stdout:5/658: rename da/dd/d25/d41/d7c/f84 to da/dd/d25/dcb/fde 0 2024-02-28T16:24:43.899 INFO:tasks.workunit.client.1.smithi153.stdout:8/644: write d0/d19/d2b/d2d/f5e [3377647,103247] 0 2024-02-28T16:24:43.899 INFO:tasks.workunit.client.1.smithi153.stdout:2/674: creat d2/d19/d31/dd1/fd8 x:0 0 0 2024-02-28T16:24:43.899 INFO:tasks.workunit.client.1.smithi153.stdout:5/659: dread - da/dd/d54/db0/fbc zero size 2024-02-28T16:24:43.902 INFO:tasks.workunit.client.1.smithi153.stdout:8/645: fsync d0/d12/d15/f77 0 2024-02-28T16:24:43.906 INFO:tasks.workunit.client.1.smithi153.stdout:2/675: creat d2/d19/d31/dd1/fd9 x:0 0 0 2024-02-28T16:24:43.912 INFO:tasks.workunit.client.1.smithi153.stdout:2/676: write d2/d19/d2a/d3b/d5e/fd3 [332026,7522] 0 2024-02-28T16:24:43.912 INFO:tasks.workunit.client.1.smithi153.stdout:5/660: mknod da/d29/d43/d5a/d77/dd6/cdf 0 2024-02-28T16:24:43.914 INFO:tasks.workunit.client.1.smithi153.stdout:7/660: dread d1/f6c [0,4194304] 0 2024-02-28T16:24:43.915 INFO:tasks.workunit.client.1.smithi153.stdout:1/623: sync 2024-02-28T16:24:43.917 INFO:tasks.workunit.client.1.smithi153.stdout:1/624: fdatasync d0/dd/db2/d89/faf 0 2024-02-28T16:24:43.917 INFO:tasks.workunit.client.1.smithi153.stdout:8/646: rename d0/d19/d1e/f2e to d0/d25/d79/db3/fdc 0 2024-02-28T16:24:43.918 INFO:tasks.workunit.client.1.smithi153.stdout:5/661: fsync da/f51 0 2024-02-28T16:24:43.918 INFO:tasks.workunit.client.1.smithi153.stdout:8/647: fsync d0/d25/fbb 0 2024-02-28T16:24:43.920 INFO:tasks.workunit.client.1.smithi153.stdout:9/608: dread d1/d5/d27/f30 [0,4194304] 0 2024-02-28T16:24:43.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:43 smithi023 ceph-mon[29137]: pgmap v11: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 MiB/s rd, 130 MiB/s wr, 260 op/s 2024-02-28T16:24:43.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:43 smithi023 ceph-mon[29137]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:24:43.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:43 smithi023 ceph-mon[29137]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:24:43.932 INFO:tasks.workunit.client.1.smithi153.stdout:5/662: symlink da/dd/d25/d8a/le0 0 2024-02-28T16:24:43.934 INFO:tasks.workunit.client.1.smithi153.stdout:0/661: dwrite d4/d27/f5a [0,4194304] 0 2024-02-28T16:24:43.935 INFO:tasks.workunit.client.1.smithi153.stdout:8/648: rmdir d0/d12/d67/d30/d63 39 2024-02-28T16:24:43.937 INFO:tasks.workunit.client.1.smithi153.stdout:9/609: stat d1/d5/d11/d1f/d20/d99/cc2 0 2024-02-28T16:24:43.942 INFO:tasks.workunit.client.1.smithi153.stdout:2/677: creat d2/d19/d3e/db9/fda x:0 0 0 2024-02-28T16:24:43.948 INFO:tasks.workunit.client.1.smithi153.stdout:1/625: mkdir d0/d62/ddf 0 2024-02-28T16:24:43.950 INFO:tasks.workunit.client.1.smithi153.stdout:8/649: dwrite d0/d12/d15/f77 [0,4194304] 0 2024-02-28T16:24:43.952 INFO:tasks.workunit.client.1.smithi153.stdout:3/645: sync 2024-02-28T16:24:43.952 INFO:tasks.workunit.client.1.smithi153.stdout:6/656: sync 2024-02-28T16:24:43.954 INFO:tasks.workunit.client.1.smithi153.stdout:9/610: creat d1/d5/d11/d1f/d40/d97/fcd x:0 0 0 2024-02-28T16:24:43.955 INFO:tasks.workunit.client.1.smithi153.stdout:2/678: dread d2/d19/d2a/d3b/f4e [0,4194304] 0 2024-02-28T16:24:43.956 INFO:tasks.workunit.client.1.smithi153.stdout:7/661: creat d1/d25/df/fda x:0 0 0 2024-02-28T16:24:43.957 INFO:tasks.workunit.client.1.smithi153.stdout:9/611: fsync d1/d5/d11/d1f/d40/d97/faf 0 2024-02-28T16:24:43.957 INFO:tasks.workunit.client.1.smithi153.stdout:2/679: chown d2/d86/f79 15 1 2024-02-28T16:24:43.958 INFO:tasks.workunit.client.1.smithi153.stdout:2/680: write d2/f20 [1247442,47377] 0 2024-02-28T16:24:43.967 INFO:tasks.workunit.client.1.smithi153.stdout:5/663: mkdir da/de1 0 2024-02-28T16:24:43.972 INFO:tasks.workunit.client.1.smithi153.stdout:7/662: dwrite d1/d25/df/d26/f57 [0,4194304] 0 2024-02-28T16:24:43.979 INFO:tasks.workunit.client.1.smithi153.stdout:5/664: dread da/dd/d25/f36 [0,4194304] 0 2024-02-28T16:24:44.002 INFO:tasks.workunit.client.1.smithi153.stdout:0/662: dwrite d4/d27/f73 [0,4194304] 0 2024-02-28T16:24:44.005 INFO:tasks.workunit.client.1.smithi153.stdout:7/663: creat d1/d25/df/d26/d3a/d95/fdb x:0 0 0 2024-02-28T16:24:44.005 INFO:tasks.workunit.client.1.smithi153.stdout:3/646: write d4/d8/d1e/f7b [1265619,51704] 0 2024-02-28T16:24:44.006 INFO:tasks.workunit.client.1.smithi153.stdout:2/681: creat d2/d19/d3e/da7/db1/fdb x:0 0 0 2024-02-28T16:24:44.010 INFO:tasks.workunit.client.1.smithi153.stdout:2/682: read - d2/d19/d31/dd1/fd8 zero size 2024-02-28T16:24:44.012 INFO:tasks.workunit.client.1.smithi153.stdout:6/657: link d0/d17/f75 d0/d1d/d5d/feb 0 2024-02-28T16:24:44.014 INFO:tasks.workunit.client.1.smithi153.stdout:6/658: stat d0/d66/f98 0 2024-02-28T16:24:44.014 INFO:tasks.workunit.client.1.smithi153.stdout:8/650: dwrite d0/f64 [0,4194304] 0 2024-02-28T16:24:44.023 INFO:tasks.workunit.client.1.smithi153.stdout:7/664: unlink d1/d25/df/f4e 0 2024-02-28T16:24:44.024 INFO:tasks.workunit.client.1.smithi153.stdout:1/626: link d0/dd/c20 d0/d62/d66/d8e/ce0 0 2024-02-28T16:24:44.025 INFO:tasks.workunit.client.1.smithi153.stdout:1/627: stat d0/dd/fc5 0 2024-02-28T16:24:44.026 INFO:tasks.workunit.client.1.smithi153.stdout:1/628: write d0/d3d/d4a/d59/f9f [739324,95529] 0 2024-02-28T16:24:44.028 INFO:tasks.workunit.client.1.smithi153.stdout:2/683: mknod d2/d86/cdc 0 2024-02-28T16:24:44.031 INFO:tasks.workunit.client.1.smithi153.stdout:9/612: link d1/d5/d11/l1a d1/d5/d11/d64/d85/d9a/lce 0 2024-02-28T16:24:44.035 INFO:tasks.workunit.client.1.smithi153.stdout:7/665: unlink d1/d25/d27/d7c/dc4/d63/fcb 0 2024-02-28T16:24:44.038 INFO:tasks.workunit.client.1.smithi153.stdout:3/647: link d4/d8/d1e/d63/f80 d4/d7d/d41/fe6 0 2024-02-28T16:24:44.041 INFO:tasks.workunit.client.1.smithi153.stdout:6/659: mkdir d0/d1d/d33/d9c/d48/dec 0 2024-02-28T16:24:44.044 INFO:tasks.workunit.client.1.smithi153.stdout:6/660: write d0/d1d/d33/f3b [2364525,105996] 0 2024-02-28T16:24:44.046 INFO:tasks.workunit.client.1.smithi153.stdout:8/651: creat d0/d12/d15/dab/dd0/fdd x:0 0 0 2024-02-28T16:24:44.049 INFO:tasks.workunit.client.1.smithi153.stdout:6/661: write d0/d1d/d33/db2/f77 [529253,115051] 0 2024-02-28T16:24:44.054 INFO:tasks.workunit.client.1.smithi153.stdout:2/684: symlink d2/d19/d2a/d99/ldd 0 2024-02-28T16:24:44.054 INFO:tasks.workunit.client.1.smithi153.stdout:7/666: dwrite d1/d25/dc/d50/f65 [0,4194304] 0 2024-02-28T16:24:44.058 INFO:tasks.workunit.client.1.smithi153.stdout:7/667: write d1/d25/df/f61 [1015531,2003] 0 2024-02-28T16:24:44.058 INFO:tasks.workunit.client.1.smithi153.stdout:1/629: dwrite d0/dd/f49 [0,4194304] 0 2024-02-28T16:24:44.058 INFO:tasks.workunit.client.1.smithi153.stdout:3/648: mkdir d4/d13/d28/dcd/dda/de7 0 2024-02-28T16:24:44.063 INFO:tasks.workunit.client.1.smithi153.stdout:6/662: mknod d0/d1d/d33/d9c/d48/d63/d8c/dc3/ced 0 2024-02-28T16:24:44.067 INFO:tasks.workunit.client.1.smithi153.stdout:8/652: rmdir d0/d12/d67/d88 39 2024-02-28T16:24:44.077 INFO:tasks.workunit.client.1.smithi153.stdout:0/663: truncate d4/d27/f7c 1988404 0 2024-02-28T16:24:44.077 INFO:tasks.workunit.client.1.smithi153.stdout:3/649: mkdir d4/d2c/de8 0 2024-02-28T16:24:44.083 INFO:tasks.workunit.client.1.smithi153.stdout:4/587: sync 2024-02-28T16:24:44.083 INFO:tasks.workunit.client.1.smithi153.stdout:0/664: chown d4/d27/f42 58 1 2024-02-28T16:24:44.086 INFO:tasks.workunit.client.1.smithi153.stdout:0/665: dread - d4/d32/f96 zero size 2024-02-28T16:24:44.089 INFO:tasks.workunit.client.1.smithi153.stdout:7/668: rmdir d1/d25/dc/d50/d66/dd5 0 2024-02-28T16:24:44.092 INFO:tasks.workunit.client.1.smithi153.stdout:2/685: getdents d2/d19/d2a/d3b 0 2024-02-28T16:24:44.095 INFO:tasks.workunit.client.1.smithi153.stdout:4/588: mknod d4/de/d23/d2b/d31/da2/da5/cbe 0 2024-02-28T16:24:44.095 INFO:tasks.workunit.client.1.smithi153.stdout:6/663: dwrite d0/d1d/d30/d71/d91/fb1 [0,4194304] 0 2024-02-28T16:24:44.097 INFO:tasks.workunit.client.1.smithi153.stdout:0/666: mknod d4/d32/d7f/d8a/dab/ce5 0 2024-02-28T16:24:44.100 INFO:tasks.workunit.client.1.smithi153.stdout:6/664: chown d0/d17/d7e 418 1 2024-02-28T16:24:44.110 INFO:tasks.workunit.client.1.smithi153.stdout:5/665: sync 2024-02-28T16:24:44.112 INFO:tasks.workunit.client.1.smithi153.stdout:3/650: link d4/d8/d1e/d23/da0/cbc d4/d2c/ce9 0 2024-02-28T16:24:44.113 INFO:tasks.workunit.client.1.smithi153.stdout:0/667: mknod d4/d32/d7f/d8a/dab/d8e/d94/dd7/ce6 0 2024-02-28T16:24:44.117 INFO:tasks.workunit.client.1.smithi153.stdout:6/665: creat d0/d1d/d33/d9c/d2e/d99/dab/fee x:0 0 0 2024-02-28T16:24:44.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/669: dwrite d1/d25/dc/d50/d66/fc7 [0,4194304] 0 2024-02-28T16:24:44.121 INFO:tasks.workunit.client.1.smithi153.stdout:3/651: symlink d4/d7d/d41/d71/lea 0 2024-02-28T16:24:44.124 INFO:tasks.workunit.client.1.smithi153.stdout:9/613: truncate d1/d5/fb 329515 0 2024-02-28T16:24:44.125 INFO:tasks.workunit.client.1.smithi153.stdout:0/668: creat d4/d32/dd9/fe7 x:0 0 0 2024-02-28T16:24:44.126 INFO:tasks.workunit.client.1.smithi153.stdout:1/630: write d0/d3d/f71 [3393764,57732] 0 2024-02-28T16:24:44.130 INFO:tasks.workunit.client.1.smithi153.stdout:8/653: write d0/d34/f80 [751830,21896] 0 2024-02-28T16:24:44.131 INFO:tasks.workunit.client.1.smithi153.stdout:5/666: dwrite da/dd/d25/d8a/f90 [0,4194304] 0 2024-02-28T16:24:44.133 INFO:tasks.workunit.client.1.smithi153.stdout:4/589: write d4/de/d13/f35 [519453,21612] 0 2024-02-28T16:24:44.137 INFO:tasks.workunit.client.1.smithi153.stdout:4/590: stat d4/de/d23/d2b/d9b/f97 0 2024-02-28T16:24:44.143 INFO:tasks.workunit.client.1.smithi153.stdout:7/670: rmdir d1/d25/df/d26/d76/dd2 0 2024-02-28T16:24:44.147 INFO:tasks.workunit.client.1.smithi153.stdout:6/666: link d0/d1d/d33/d9c/d68/da2/cae d0/d66/d85/cef 0 2024-02-28T16:24:44.152 INFO:tasks.workunit.client.1.smithi153.stdout:5/667: dwrite da/dd/d25/d82/fa0 [0,4194304] 0 2024-02-28T16:24:44.159 INFO:tasks.workunit.client.1.smithi153.stdout:3/652: write d4/d8/d1e/d2a/d35/f5f [1845616,57314] 0 2024-02-28T16:24:44.159 INFO:tasks.workunit.client.1.smithi153.stdout:4/591: mkdir d4/de/d23/d2b/d4b/dbf 0 2024-02-28T16:24:44.160 INFO:tasks.workunit.client.1.smithi153.stdout:4/592: stat d4/de/f16 0 2024-02-28T16:24:44.162 INFO:tasks.workunit.client.1.smithi153.stdout:1/631: mkdir d0/d3d/d4a/dd9/de1 0 2024-02-28T16:24:44.163 INFO:tasks.workunit.client.1.smithi153.stdout:5/668: dread da/d29/d43/d5a/d77/f8b [0,4194304] 0 2024-02-28T16:24:44.165 INFO:tasks.workunit.client.1.smithi153.stdout:1/632: write d0/dd/db2/d89/dad/fb8 [1285641,35144] 0 2024-02-28T16:24:44.167 INFO:tasks.workunit.client.1.smithi153.stdout:7/671: mkdir d1/d25/dc/ddc 0 2024-02-28T16:24:44.173 INFO:tasks.workunit.client.1.smithi153.stdout:6/667: symlink d0/d1d/d33/d9c/d48/d63/d8c/dc3/lf0 0 2024-02-28T16:24:44.177 INFO:tasks.workunit.client.1.smithi153.stdout:6/668: write d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fc2 [750463,110038] 0 2024-02-28T16:24:44.177 INFO:tasks.workunit.client.1.smithi153.stdout:9/614: dwrite d1/d5/d11/d1f/d20/f68 [0,4194304] 0 2024-02-28T16:24:44.180 INFO:tasks.workunit.client.1.smithi153.stdout:6/669: readlink d0/d1d/d33/d9c/d48/d63/lc9 0 2024-02-28T16:24:44.180 INFO:tasks.workunit.client.1.smithi153.stdout:3/653: mkdir d4/d7d/d41/d71/deb 0 2024-02-28T16:24:44.181 INFO:tasks.workunit.client.1.smithi153.stdout:4/593: fdatasync d4/de/d23/f4a 0 2024-02-28T16:24:44.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/633: chown d0/dd/c8d 2206 1 2024-02-28T16:24:44.198 INFO:tasks.workunit.client.1.smithi153.stdout:1/634: dread - d0/fbc zero size 2024-02-28T16:24:44.198 INFO:tasks.workunit.client.1.smithi153.stdout:7/672: rename d1/d25/dc/faa to d1/d25/dc/d7e/fdd 0 2024-02-28T16:24:44.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/635: chown d0/c1a 29464596 1 2024-02-28T16:24:44.203 INFO:tasks.workunit.client.1.smithi153.stdout:0/669: truncate d4/d32/d7f/d8a/dab/d8e/d90/f33 3957375 0 2024-02-28T16:24:44.206 INFO:tasks.workunit.client.1.smithi153.stdout:6/670: dwrite d0/d1d/d33/d9c/d2e/d99/dab/fee [0,4194304] 0 2024-02-28T16:24:44.209 INFO:tasks.workunit.client.1.smithi153.stdout:5/669: dread da/dd/d25/d41/f49 [0,4194304] 0 2024-02-28T16:24:44.209 INFO:tasks.workunit.client.1.smithi153.stdout:3/654: fdatasync d4/d8/f1c 0 2024-02-28T16:24:44.210 INFO:tasks.workunit.client.1.smithi153.stdout:4/594: creat d4/de/d23/d2b/d4b/fc0 x:0 0 0 2024-02-28T16:24:44.215 INFO:tasks.workunit.client.1.smithi153.stdout:3/655: write d4/d8/d1e/d23/da0/fbe [388731,102504] 0 2024-02-28T16:24:44.230 INFO:tasks.workunit.client.1.smithi153.stdout:2/686: sync 2024-02-28T16:24:44.233 INFO:tasks.workunit.client.1.smithi153.stdout:2/687: chown d2/d23/d48/l5f 7 1 2024-02-28T16:24:44.239 INFO:tasks.workunit.client.1.smithi153.stdout:8/654: link d0/d12/d67/d88/c4f d0/d19/d2b/d2d/cde 0 2024-02-28T16:24:44.239 INFO:tasks.workunit.client.1.smithi153.stdout:1/636: write d0/dd/fda [580079,106619] 0 2024-02-28T16:24:44.240 INFO:tasks.workunit.client.1.smithi153.stdout:8/655: readlink d0/d12/lba 0 2024-02-28T16:24:44.243 INFO:tasks.workunit.client.1.smithi153.stdout:0/670: creat d4/d27/d9a/da1/fe8 x:0 0 0 2024-02-28T16:24:44.245 INFO:tasks.workunit.client.1.smithi153.stdout:6/671: mknod d0/d1d/d33/d9c/d48/d63/d8c/dc3/cf1 0 2024-02-28T16:24:44.252 INFO:tasks.workunit.client.1.smithi153.stdout:2/688: unlink d2/d19/d3e/da7/db1/fdb 0 2024-02-28T16:24:44.253 INFO:tasks.workunit.client.1.smithi153.stdout:9/615: sync 2024-02-28T16:24:44.254 INFO:tasks.workunit.client.1.smithi153.stdout:9/616: dread - d1/d74/d80/fc8 zero size 2024-02-28T16:24:44.254 INFO:tasks.workunit.client.1.smithi153.stdout:7/673: mkdir d1/d25/df/d26/d3a/d95/d97/dd0/dde 0 2024-02-28T16:24:44.256 INFO:tasks.workunit.client.1.smithi153.stdout:1/637: unlink d0/d3d/d4a/d59/f63 0 2024-02-28T16:24:44.258 INFO:tasks.workunit.client.1.smithi153.stdout:8/656: creat d0/d19/d1e/fdf x:0 0 0 2024-02-28T16:24:44.259 INFO:tasks.workunit.client.1.smithi153.stdout:0/671: creat d4/d27/dc1/fe9 x:0 0 0 2024-02-28T16:24:44.260 INFO:tasks.workunit.client.1.smithi153.stdout:8/657: write d0/d19/d2b/d2d/f5e [4792090,10980] 0 2024-02-28T16:24:44.261 INFO:tasks.workunit.client.1.smithi153.stdout:0/672: write d4/d27/f44 [1336343,42180] 0 2024-02-28T16:24:44.262 INFO:tasks.workunit.client.1.smithi153.stdout:8/658: write d0/f9 [3389989,85248] 0 2024-02-28T16:24:44.262 INFO:tasks.workunit.client.1.smithi153.stdout:6/672: mkdir d0/d1d/d33/d9c/d68/dcb/df2 0 2024-02-28T16:24:44.266 INFO:tasks.workunit.client.1.smithi153.stdout:6/673: read d0/d1d/d30/f58 [353258,67455] 0 2024-02-28T16:24:44.272 INFO:tasks.workunit.client.1.smithi153.stdout:9/617: dread d1/d5/d11/d1f/d40/f48 [0,4194304] 0 2024-02-28T16:24:44.272 INFO:tasks.workunit.client.1.smithi153.stdout:7/674: rename d1/d25/d88/la1 to d1/d70/dbf/ldf 0 2024-02-28T16:24:44.274 INFO:tasks.workunit.client.1.smithi153.stdout:1/638: symlink d0/dd/db2/d80/le2 0 2024-02-28T16:24:44.277 INFO:tasks.workunit.client.1.smithi153.stdout:0/673: fdatasync d4/d32/d7f/d8a/dab/f24 0 2024-02-28T16:24:44.278 INFO:tasks.workunit.client.1.smithi153.stdout:8/659: symlink d0/d19/d2b/d2d/le0 0 2024-02-28T16:24:44.279 INFO:tasks.workunit.client.1.smithi153.stdout:4/595: getdents d4/de/d47/d5e 0 2024-02-28T16:24:44.281 INFO:tasks.workunit.client.1.smithi153.stdout:2/689: fdatasync d2/d19/d2a/f47 0 2024-02-28T16:24:44.286 INFO:tasks.workunit.client.1.smithi153.stdout:7/675: mknod d1/d25/df/d5a/ce0 0 2024-02-28T16:24:44.291 INFO:tasks.workunit.client.1.smithi153.stdout:4/596: unlink d4/de/f19 0 2024-02-28T16:24:44.291 INFO:tasks.workunit.client.1.smithi153.stdout:5/670: truncate da/fc3 6921521 0 2024-02-28T16:24:44.292 INFO:tasks.workunit.client.1.smithi153.stdout:3/656: truncate d4/f7 1795460 0 2024-02-28T16:24:44.297 INFO:tasks.workunit.client.1.smithi153.stdout:9/618: dwrite d1/d5/d11/d64/f86 [0,4194304] 0 2024-02-28T16:24:44.301 INFO:tasks.workunit.client.1.smithi153.stdout:7/676: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:24:44.302 INFO:tasks.workunit.client.1.smithi153.stdout:0/674: mkdir d4/d32/dea 0 2024-02-28T16:24:44.305 INFO:tasks.workunit.client.1.smithi153.stdout:0/675: chown d4/d32/d7f/d8a/dab/d8e/d90/c7d 1975941545 1 2024-02-28T16:24:44.308 INFO:tasks.workunit.client.1.smithi153.stdout:5/671: fsync da/dd/d54/f96 0 2024-02-28T16:24:44.311 INFO:tasks.workunit.client.1.smithi153.stdout:4/597: dread - d4/de/d23/d2b/d9b/f89 zero size 2024-02-28T16:24:44.316 INFO:tasks.workunit.client.1.smithi153.stdout:7/677: dread d1/d25/df/fb4 [0,4194304] 0 2024-02-28T16:24:44.327 INFO:tasks.workunit.client.1.smithi153.stdout:8/660: creat d0/d19/d2b/fe1 x:0 0 0 2024-02-28T16:24:44.329 INFO:tasks.workunit.client.1.smithi153.stdout:9/619: dwrite d1/d5/d11/d1f/d20/f68 [4194304,4194304] 0 2024-02-28T16:24:44.333 INFO:tasks.workunit.client.1.smithi153.stdout:2/690: dwrite d2/d25/d49/da3/fbd [0,4194304] 0 2024-02-28T16:24:44.336 INFO:tasks.workunit.client.1.smithi153.stdout:1/639: getdents d0/dd/d84 0 2024-02-28T16:24:44.339 INFO:tasks.workunit.client.1.smithi153.stdout:3/657: rename d4/d8/d1e/d2a/d35/d54/cd8 to d4/d2c/de8/cec 0 2024-02-28T16:24:44.343 INFO:tasks.workunit.client.1.smithi153.stdout:8/661: symlink d0/d12/d15/dab/le2 0 2024-02-28T16:24:44.343 INFO:tasks.workunit.client.1.smithi153.stdout:2/691: stat d2/d19/d2a/f30 0 2024-02-28T16:24:44.345 INFO:tasks.workunit.client.1.smithi153.stdout:7/678: dwrite d1/d25/dc/f64 [0,4194304] 0 2024-02-28T16:24:44.347 INFO:tasks.workunit.client.1.smithi153.stdout:5/672: creat da/d29/fe2 x:0 0 0 2024-02-28T16:24:44.349 INFO:tasks.workunit.client.1.smithi153.stdout:5/673: chown da/dd/d25/d82 6577 1 2024-02-28T16:24:44.350 INFO:tasks.workunit.client.1.smithi153.stdout:4/598: rename d4/de/d23/d2b/d4b/c77 to d4/d8d/cc1 0 2024-02-28T16:24:44.361 INFO:tasks.workunit.client.1.smithi153.stdout:7/679: creat d1/d25/dc/fe1 x:0 0 0 2024-02-28T16:24:44.362 INFO:tasks.workunit.client.1.smithi153.stdout:9/620: write d1/d5/d27/f30 [3654717,28215] 0 2024-02-28T16:24:44.364 INFO:tasks.workunit.client.1.smithi153.stdout:4/599: mkdir d4/de/d23/d2b/d31/da2/da5/db2/dc2 0 2024-02-28T16:24:44.366 INFO:tasks.workunit.client.1.smithi153.stdout:2/692: mknod d2/d4b/cde 0 2024-02-28T16:24:44.366 INFO:tasks.workunit.client.1.smithi153.stdout:9/621: dread - d1/d7e/fb7 zero size 2024-02-28T16:24:44.366 INFO:tasks.workunit.client.1.smithi153.stdout:7/680: stat d1/d25/df/l10 0 2024-02-28T16:24:44.367 INFO:tasks.workunit.client.1.smithi153.stdout:8/662: dwrite d0/d12/d67/d88/d8e/f9c [0,4194304] 0 2024-02-28T16:24:44.369 INFO:tasks.workunit.client.1.smithi153.stdout:4/600: chown d4/de/d23/f4a 3552 1 2024-02-28T16:24:44.370 INFO:tasks.workunit.client.1.smithi153.stdout:2/693: write d2/d19/d3e/db9/fbc [168546,8587] 0 2024-02-28T16:24:44.371 INFO:tasks.workunit.client.1.smithi153.stdout:4/601: stat d4/de/f12 0 2024-02-28T16:24:44.375 INFO:tasks.workunit.client.1.smithi153.stdout:7/681: symlink d1/d25/d27/le2 0 2024-02-28T16:24:44.377 INFO:tasks.workunit.client.1.smithi153.stdout:1/640: dread d0/dd/f21 [0,4194304] 0 2024-02-28T16:24:44.377 INFO:tasks.workunit.client.1.smithi153.stdout:9/622: symlink d1/d5/d11/d1f/d20/d99/lcf 0 2024-02-28T16:24:44.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/658: dread d4/d8/f10 [4194304,4194304] 0 2024-02-28T16:24:44.383 INFO:tasks.workunit.client.1.smithi153.stdout:3/659: readlink d4/d7d/d41/l48 0 2024-02-28T16:24:44.385 INFO:tasks.workunit.client.1.smithi153.stdout:4/602: unlink d4/de/d40/d4d/f82 0 2024-02-28T16:24:44.386 INFO:tasks.workunit.client.1.smithi153.stdout:2/694: mknod d2/d63/cdf 0 2024-02-28T16:24:44.389 INFO:tasks.workunit.client.1.smithi153.stdout:7/682: truncate d1/d25/dc/f35 4595105 0 2024-02-28T16:24:44.391 INFO:tasks.workunit.client.1.smithi153.stdout:5/674: dread da/f2f [0,4194304] 0 2024-02-28T16:24:44.392 INFO:tasks.workunit.client.1.smithi153.stdout:8/663: creat d0/d12/d67/d30/d63/d74/db4/fe3 x:0 0 0 2024-02-28T16:24:44.392 INFO:tasks.workunit.client.1.smithi153.stdout:6/674: sync 2024-02-28T16:24:44.394 INFO:tasks.workunit.client.1.smithi153.stdout:1/641: unlink d0/dd/f1c 0 2024-02-28T16:24:44.395 INFO:tasks.workunit.client.1.smithi153.stdout:9/623: dwrite d1/d5/d11/d1f/d40/d97/faf [0,4194304] 0 2024-02-28T16:24:44.402 INFO:tasks.workunit.client.1.smithi153.stdout:8/664: mknod d0/d12/d15/dab/dd0/ce4 0 2024-02-28T16:24:44.403 INFO:tasks.workunit.client.1.smithi153.stdout:3/660: write d4/d7d/d41/f4a [1338067,66155] 0 2024-02-28T16:24:44.404 INFO:tasks.workunit.client.1.smithi153.stdout:6/675: creat d0/d1d/d33/d9c/d68/da2/ff3 x:0 0 0 2024-02-28T16:24:44.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/695: mknod d2/d23/d88/dbf/ce0 0 2024-02-28T16:24:44.407 INFO:tasks.workunit.client.1.smithi153.stdout:2/696: readlink d2/d19/d31/ld4 0 2024-02-28T16:24:44.408 INFO:tasks.workunit.client.1.smithi153.stdout:2/697: stat d2/c37 0 2024-02-28T16:24:44.408 INFO:tasks.workunit.client.1.smithi153.stdout:9/624: creat d1/d5/d11/d1f/d62/fd0 x:0 0 0 2024-02-28T16:24:44.414 INFO:tasks.workunit.client.1.smithi153.stdout:7/683: creat d1/d25/df/fe3 x:0 0 0 2024-02-28T16:24:44.415 INFO:tasks.workunit.client.1.smithi153.stdout:1/642: symlink d0/dd/le3 0 2024-02-28T16:24:44.416 INFO:tasks.workunit.client.1.smithi153.stdout:7/684: chown d1/d25/d88/fc1 0 1 2024-02-28T16:24:44.417 INFO:tasks.workunit.client.1.smithi153.stdout:8/665: rename d0/d12/d67/d88/d8e/d9d/c69 to d0/d19/d2b/d2d/ce5 0 2024-02-28T16:24:44.417 INFO:tasks.workunit.client.1.smithi153.stdout:2/698: rmdir d2/d25/db4 39 2024-02-28T16:24:44.419 INFO:tasks.workunit.client.1.smithi153.stdout:9/625: mkdir d1/d7e/dd1 0 2024-02-28T16:24:44.420 INFO:tasks.workunit.client.1.smithi153.stdout:5/675: creat da/dd/d25/fe3 x:0 0 0 2024-02-28T16:24:44.421 INFO:tasks.workunit.client.1.smithi153.stdout:6/676: mknod d0/d1d/d33/d9c/cf4 0 2024-02-28T16:24:44.422 INFO:tasks.workunit.client.1.smithi153.stdout:9/626: chown d1/d5/d11/d1f/d40/f8b 946345334 1 2024-02-28T16:24:44.424 INFO:tasks.workunit.client.1.smithi153.stdout:7/685: rename d1/d25/df/d26/f84 to d1/d25/dc/d50/fe4 0 2024-02-28T16:24:44.426 INFO:tasks.workunit.client.1.smithi153.stdout:8/666: creat d0/d12/d67/d88/d8e/d9d/fe6 x:0 0 0 2024-02-28T16:24:44.427 INFO:tasks.workunit.client.1.smithi153.stdout:1/643: mkdir d0/dc1/de4 0 2024-02-28T16:24:44.431 INFO:tasks.workunit.client.1.smithi153.stdout:7/686: mknod d1/d25/df/d26/d76/ce5 0 2024-02-28T16:24:44.433 INFO:tasks.workunit.client.1.smithi153.stdout:3/661: dread d4/d6a/faa [0,4194304] 0 2024-02-28T16:24:44.434 INFO:tasks.workunit.client.1.smithi153.stdout:6/677: symlink d0/d1d/d33/d9c/d68/dcb/df2/lf5 0 2024-02-28T16:24:44.436 INFO:tasks.workunit.client.1.smithi153.stdout:9/627: dread d1/d74/d80/da8/f25 [0,4194304] 0 2024-02-28T16:24:44.437 INFO:tasks.workunit.client.1.smithi153.stdout:8/667: rename d0/d19/d2b/d2d/d3f/d9f/dcc/ld9 to d0/d19/d2b/d2d/d3f/d9f/le7 0 2024-02-28T16:24:44.439 INFO:tasks.workunit.client.1.smithi153.stdout:1/644: mkdir d0/dd/db2/de5 0 2024-02-28T16:24:44.440 INFO:tasks.workunit.client.1.smithi153.stdout:7/687: mkdir d1/d25/df/d5a/de6 0 2024-02-28T16:24:44.440 INFO:tasks.workunit.client.1.smithi153.stdout:6/678: dread - d0/d1d/d33/d9c/d48/d72/f8f zero size 2024-02-28T16:24:44.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/628: symlink d1/d5/d11/d1f/d40/d97/ld2 0 2024-02-28T16:24:44.443 INFO:tasks.workunit.client.1.smithi153.stdout:9/629: stat d1/d5/d11/d29/d79/fb3 0 2024-02-28T16:24:44.444 INFO:tasks.workunit.client.1.smithi153.stdout:3/662: rename d4/f66 to d4/d7d/d41/d71/deb/fed 0 2024-02-28T16:24:44.444 INFO:tasks.workunit.client.1.smithi153.stdout:6/679: truncate d0/d1d/d33/d9c/d2e/f4e 1600322 0 2024-02-28T16:24:44.444 INFO:tasks.workunit.client.1.smithi153.stdout:8/668: mkdir d0/d19/d2b/d2d/de8 0 2024-02-28T16:24:44.445 INFO:tasks.workunit.client.1.smithi153.stdout:9/630: readlink d1/d5/d11/d1f/d20/d99/l9b 0 2024-02-28T16:24:44.446 INFO:tasks.workunit.client.1.smithi153.stdout:1/645: mkdir d0/dd/db2/d89/dc7/de6 0 2024-02-28T16:24:44.446 INFO:tasks.workunit.client.1.smithi153.stdout:6/680: fdatasync d0/d1d/d33/f3b 0 2024-02-28T16:24:44.447 INFO:tasks.workunit.client.1.smithi153.stdout:9/631: write d1/fb2 [465252,39461] 0 2024-02-28T16:24:44.450 INFO:tasks.workunit.client.1.smithi153.stdout:9/632: chown d1/d5/d11/d1f/d20/d45/f4a 741 1 2024-02-28T16:24:44.450 INFO:tasks.workunit.client.1.smithi153.stdout:7/688: creat d1/d25/dc/d50/fe7 x:0 0 0 2024-02-28T16:24:44.452 INFO:tasks.workunit.client.1.smithi153.stdout:5/676: truncate da/d29/f5e 1315694 0 2024-02-28T16:24:44.452 INFO:tasks.workunit.client.1.smithi153.stdout:9/633: write d1/d5/d27/fc5 [543349,126235] 0 2024-02-28T16:24:44.457 INFO:tasks.workunit.client.1.smithi153.stdout:8/669: mkdir d0/d12/d15/dab/dd0/de9 0 2024-02-28T16:24:44.464 INFO:tasks.workunit.client.1.smithi153.stdout:8/670: mknod d0/d12/d67/d88/d85/db6/cea 0 2024-02-28T16:24:44.466 INFO:tasks.workunit.client.1.smithi153.stdout:7/689: mkdir d1/d25/df/d5a/de6/de8 0 2024-02-28T16:24:44.466 INFO:tasks.workunit.client.1.smithi153.stdout:6/681: dwrite d0/d1d/d33/d9c/d2e/d99/fbb [0,4194304] 0 2024-02-28T16:24:44.466 INFO:tasks.workunit.client.1.smithi153.stdout:1/646: dwrite d0/dd/db2/d89/dad/fb8 [0,4194304] 0 2024-02-28T16:24:44.472 INFO:tasks.workunit.client.1.smithi153.stdout:6/682: creat d0/d1d/d33/d9c/d68/dcb/ff6 x:0 0 0 2024-02-28T16:24:44.474 INFO:tasks.workunit.client.1.smithi153.stdout:7/690: creat d1/d25/d27/d7c/db5/fe9 x:0 0 0 2024-02-28T16:24:44.486 INFO:tasks.workunit.client.1.smithi153.stdout:1/647: mkdir d0/dd/db2/de5/de7 0 2024-02-28T16:24:44.489 INFO:tasks.workunit.client.1.smithi153.stdout:6/683: dwrite d0/d17/fe7 [0,4194304] 0 2024-02-28T16:24:44.490 INFO:tasks.workunit.client.1.smithi153.stdout:8/671: link d0/d19/d2b/d2d/f70 d0/d12/d67/d30/feb 0 2024-02-28T16:24:44.490 INFO:tasks.workunit.client.1.smithi153.stdout:3/663: write d4/f7 [2251650,94069] 0 2024-02-28T16:24:44.493 INFO:tasks.workunit.client.1.smithi153.stdout:1/648: mknod d0/dd/db2/d89/dc7/ce8 0 2024-02-28T16:24:44.494 INFO:tasks.workunit.client.1.smithi153.stdout:8/672: readlink d0/d19/d1e/l6a 0 2024-02-28T16:24:44.501 INFO:tasks.workunit.client.1.smithi153.stdout:8/673: truncate d0/d19/fc9 843874 0 2024-02-28T16:24:44.502 INFO:tasks.workunit.client.1.smithi153.stdout:8/674: chown d0/d34 8667 1 2024-02-28T16:24:44.503 INFO:tasks.workunit.client.1.smithi153.stdout:3/664: write d4/d8/d1e/d63/f93 [1177199,18894] 0 2024-02-28T16:24:44.503 INFO:tasks.workunit.client.1.smithi153.stdout:6/684: write d0/d1d/d33/d9c/d48/d63/f92 [201134,112383] 0 2024-02-28T16:24:44.506 INFO:tasks.workunit.client.1.smithi153.stdout:1/649: mknod d0/dd/db2/d89/dc7/de6/ce9 0 2024-02-28T16:24:44.507 INFO:tasks.workunit.client.1.smithi153.stdout:5/677: dwrite da/d29/d43/fa2 [0,4194304] 0 2024-02-28T16:24:44.512 INFO:tasks.workunit.client.1.smithi153.stdout:5/678: read da/dd/d25/f57 [294510,114475] 0 2024-02-28T16:24:44.514 INFO:tasks.workunit.client.1.smithi153.stdout:9/634: dread d1/d74/d80/da8/f32 [0,4194304] 0 2024-02-28T16:24:44.514 INFO:tasks.workunit.client.1.smithi153.stdout:8/675: rename d0/d19/d2b/d2d/f5e to d0/d19/d2b/d2d/d3f/d9f/dcc/fec 0 2024-02-28T16:24:44.516 INFO:tasks.workunit.client.1.smithi153.stdout:8/676: chown d0/d25/d79/db3/fdb 44143074 1 2024-02-28T16:24:44.520 INFO:tasks.workunit.client.1.smithi153.stdout:5/679: truncate da/f44 1292122 0 2024-02-28T16:24:44.525 INFO:tasks.workunit.client.1.smithi153.stdout:1/650: link d0/l7 d0/dd/db2/dcc/lea 0 2024-02-28T16:24:44.527 INFO:tasks.workunit.client.1.smithi153.stdout:3/665: write d4/d7d/d41/f3e [2826207,9129] 0 2024-02-28T16:24:44.527 INFO:tasks.workunit.client.1.smithi153.stdout:1/651: chown d0/d3d/d4a/f56 32802 1 2024-02-28T16:24:44.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/685: link d0/d1d/d33/d9c/f1a d0/d1d/d5d/de9/ff7 0 2024-02-28T16:24:44.532 INFO:tasks.workunit.client.1.smithi153.stdout:9/635: rename d1/d5/d11/d64/fc9 to d1/d74/d80/da8/fd3 0 2024-02-28T16:24:44.533 INFO:tasks.workunit.client.1.smithi153.stdout:8/677: write d0/d19/f2a [463155,89609] 0 2024-02-28T16:24:44.534 INFO:tasks.workunit.client.1.smithi153.stdout:3/666: rmdir d4/d6a 39 2024-02-28T16:24:44.535 INFO:tasks.workunit.client.1.smithi153.stdout:9/636: read d1/d5/f7a [2552819,61897] 0 2024-02-28T16:24:44.536 INFO:tasks.workunit.client.1.smithi153.stdout:3/667: chown d4/d8/d1e/f58 0 1 2024-02-28T16:24:44.537 INFO:tasks.workunit.client.1.smithi153.stdout:1/652: creat d0/dc1/feb x:0 0 0 2024-02-28T16:24:44.539 INFO:tasks.workunit.client.1.smithi153.stdout:3/668: truncate d4/d13/d28/fdc 4238435 0 2024-02-28T16:24:44.539 INFO:tasks.workunit.client.1.smithi153.stdout:5/680: truncate da/dd/f47 2924121 0 2024-02-28T16:24:44.540 INFO:tasks.workunit.client.1.smithi153.stdout:0/676: sync 2024-02-28T16:24:44.547 INFO:tasks.workunit.client.1.smithi153.stdout:1/653: symlink d0/dc1/lec 0 2024-02-28T16:24:44.548 INFO:tasks.workunit.client.1.smithi153.stdout:6/686: write d0/d1d/d30/f5e [167565,3779] 0 2024-02-28T16:24:44.551 INFO:tasks.workunit.client.1.smithi153.stdout:1/654: fsync d0/dd/db2/f91 0 2024-02-28T16:24:44.554 INFO:tasks.workunit.client.1.smithi153.stdout:8/678: dwrite d0/d19/d2b/f72 [8388608,4194304] 0 2024-02-28T16:24:44.558 INFO:tasks.workunit.client.1.smithi153.stdout:6/687: chown d0/d1d/d5d/c90 15375 1 2024-02-28T16:24:44.559 INFO:tasks.workunit.client.1.smithi153.stdout:9/637: dread d1/d5/d11/d1f/d20/d36/f37 [0,4194304] 0 2024-02-28T16:24:44.565 INFO:tasks.workunit.client.1.smithi153.stdout:8/679: rename d0/d34/f7b to d0/d12/d15/fed 0 2024-02-28T16:24:44.568 INFO:tasks.workunit.client.1.smithi153.stdout:0/677: getdents d4/d32/d7f/d8a 0 2024-02-28T16:24:44.569 INFO:tasks.workunit.client.1.smithi153.stdout:1/655: dread d0/d3d/f4e [0,4194304] 0 2024-02-28T16:24:44.573 INFO:tasks.workunit.client.1.smithi153.stdout:8/680: chown d0/d12/cc3 14182754 1 2024-02-28T16:24:44.574 INFO:tasks.workunit.client.1.smithi153.stdout:0/678: write d4/d27/d9a/da1/db0/fe0 [152839,72036] 0 2024-02-28T16:24:44.579 INFO:tasks.workunit.client.1.smithi153.stdout:5/681: dwrite da/dd/d25/f36 [0,4194304] 0 2024-02-28T16:24:44.580 INFO:tasks.workunit.client.1.smithi153.stdout:9/638: rename d1/d5/d11/d1f/d20/d36/d93/db5 to d1/d5/d11/dd4 0 2024-02-28T16:24:44.585 INFO:tasks.workunit.client.1.smithi153.stdout:6/688: dwrite d0/d17/d7e/fe3 [0,4194304] 0 2024-02-28T16:24:44.592 INFO:tasks.workunit.client.1.smithi153.stdout:3/669: dwrite d4/d13/f27 [0,4194304] 0 2024-02-28T16:24:44.593 INFO:tasks.workunit.client.1.smithi153.stdout:8/681: creat d0/d12/d67/d30/d63/d74/fee x:0 0 0 2024-02-28T16:24:44.597 INFO:tasks.workunit.client.1.smithi153.stdout:9/639: truncate d1/d74/d80/da8/f46 3843812 0 2024-02-28T16:24:44.602 INFO:tasks.workunit.client.1.smithi153.stdout:1/656: getdents d0/d62/d66/d7c 0 2024-02-28T16:24:44.605 INFO:tasks.workunit.client.1.smithi153.stdout:5/682: rename da/d29/d43/d5a/l75 to da/dd/d25/d8a/dac/dc6/le4 0 2024-02-28T16:24:44.606 INFO:tasks.workunit.client.1.smithi153.stdout:3/670: write d4/d8/f65 [4661363,19767] 0 2024-02-28T16:24:44.608 INFO:tasks.workunit.client.1.smithi153.stdout:8/682: creat d0/d12/d67/d88/d96/fef x:0 0 0 2024-02-28T16:24:44.610 INFO:tasks.workunit.client.1.smithi153.stdout:3/671: stat d4/d7d/f44 0 2024-02-28T16:24:44.611 INFO:tasks.workunit.client.1.smithi153.stdout:4/603: sync 2024-02-28T16:24:44.616 INFO:tasks.workunit.client.1.smithi153.stdout:0/679: dwrite d4/d32/fad [0,4194304] 0 2024-02-28T16:24:44.616 INFO:tasks.workunit.client.1.smithi153.stdout:1/657: symlink d0/d3d/d4a/led 0 2024-02-28T16:24:44.616 INFO:tasks.workunit.client.1.smithi153.stdout:3/672: stat d4/d7d/d41/d71/l8b 0 2024-02-28T16:24:44.617 INFO:tasks.workunit.client.1.smithi153.stdout:5/683: write da/dd/d25/f57 [1359819,79299] 0 2024-02-28T16:24:44.621 INFO:tasks.workunit.client.1.smithi153.stdout:6/689: dwrite d0/d1d/d33/d9c/d2e/f42 [0,4194304] 0 2024-02-28T16:24:44.628 INFO:tasks.workunit.client.1.smithi153.stdout:6/690: fdatasync d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/f67 0 2024-02-28T16:24:44.628 INFO:tasks.workunit.client.1.smithi153.stdout:4/604: mkdir d4/de/d23/d2b/d31/dc3 0 2024-02-28T16:24:44.630 INFO:tasks.workunit.client.1.smithi153.stdout:6/691: write d0/d1d/d33/f73 [779409,27149] 0 2024-02-28T16:24:44.631 INFO:tasks.workunit.client.1.smithi153.stdout:6/692: stat d0 0 2024-02-28T16:24:44.633 INFO:tasks.workunit.client.1.smithi153.stdout:9/640: getdents d1/d5/d11/d29/d79 0 2024-02-28T16:24:44.636 INFO:tasks.workunit.client.1.smithi153.stdout:9/641: dread - d1/d5/d11/d1f/d20/d5d/fb9 zero size 2024-02-28T16:24:44.639 INFO:tasks.workunit.client.1.smithi153.stdout:8/683: creat d0/d12/d67/ff0 x:0 0 0 2024-02-28T16:24:44.640 INFO:tasks.workunit.client.1.smithi153.stdout:1/658: dwrite d0/dd/fc5 [0,4194304] 0 2024-02-28T16:24:44.642 INFO:tasks.workunit.client.1.smithi153.stdout:4/605: unlink d4/de/d23/d2b/d31/da2/da5/db2/la6 0 2024-02-28T16:24:44.642 INFO:tasks.workunit.client.1.smithi153.stdout:6/693: dread - d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fdb zero size 2024-02-28T16:24:44.642 INFO:tasks.workunit.client.1.smithi153.stdout:8/684: chown d0/d19/f38 678 1 2024-02-28T16:24:44.645 INFO:tasks.workunit.client.1.smithi153.stdout:8/685: dread - d0/d12/d67/d88/fa4 zero size 2024-02-28T16:24:44.649 INFO:tasks.workunit.client.1.smithi153.stdout:0/680: getdents d4/d89 0 2024-02-28T16:24:44.651 INFO:tasks.workunit.client.1.smithi153.stdout:9/642: rename d1/d5/d11/d1f/d43/da3 to d1/d5/d11/d64/dd5 0 2024-02-28T16:24:44.652 INFO:tasks.workunit.client.1.smithi153.stdout:3/673: dwrite d4/d7d/fb4 [0,4194304] 0 2024-02-28T16:24:44.654 INFO:tasks.workunit.client.1.smithi153.stdout:6/694: truncate d0/d1d/d33/d9c/d68/dcb/fd3 559131 0 2024-02-28T16:24:44.660 INFO:tasks.workunit.client.1.smithi153.stdout:8/686: symlink d0/d12/lf1 0 2024-02-28T16:24:44.662 INFO:tasks.workunit.client.1.smithi153.stdout:0/681: unlink d4/d32/d7f/d8a/dab/f1d 0 2024-02-28T16:24:44.668 INFO:tasks.workunit.client.1.smithi153.stdout:5/684: truncate f9 1181710 0 2024-02-28T16:24:44.672 INFO:tasks.workunit.client.1.smithi153.stdout:9/643: truncate d1/d74/d80/da8/f32 4404838 0 2024-02-28T16:24:44.675 INFO:tasks.workunit.client.1.smithi153.stdout:8/687: symlink d0/d25/d79/lf2 0 2024-02-28T16:24:44.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/682: symlink d4/d32/d7f/d8a/dab/d8e/leb 0 2024-02-28T16:24:44.677 INFO:tasks.workunit.client.1.smithi153.stdout:6/695: creat d0/d1d/d33/d9c/d48/d63/d8c/dd1/ff8 x:0 0 0 2024-02-28T16:24:44.679 INFO:tasks.workunit.client.1.smithi153.stdout:6/696: chown d0/d17 40 1 2024-02-28T16:24:44.679 INFO:tasks.workunit.client.1.smithi153.stdout:5/685: dread - da/d29/f4b zero size 2024-02-28T16:24:44.679 INFO:tasks.workunit.client.1.smithi153.stdout:4/606: dwrite d4/f29 [0,4194304] 0 2024-02-28T16:24:44.681 INFO:tasks.workunit.client.1.smithi153.stdout:9/644: rename d1/d5/d11/d54 to d1/d5/d27/dd6 0 2024-02-28T16:24:44.682 INFO:tasks.workunit.client.1.smithi153.stdout:6/697: fsync d0/d1d/d33/d9c/d2e/f4e 0 2024-02-28T16:24:44.682 INFO:tasks.workunit.client.1.smithi153.stdout:5/686: write da/dd/d25/d82/fa0 [2690941,108760] 0 2024-02-28T16:24:44.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/688: mkdir d0/d19/d1e/df3 0 2024-02-28T16:24:44.685 INFO:tasks.workunit.client.1.smithi153.stdout:6/698: chown d0/d1d/d33/d9c/d48/d63/d8c/dd1 1823243597 1 2024-02-28T16:24:44.685 INFO:tasks.workunit.client.1.smithi153.stdout:9/645: dread - d1/d5/d11/d1f/d40/d97/fcd zero size 2024-02-28T16:24:44.687 INFO:tasks.workunit.client.1.smithi153.stdout:5/687: write da/dd/d25/d82/d8f/f91 [133784,73499] 0 2024-02-28T16:24:44.689 INFO:tasks.workunit.client.1.smithi153.stdout:0/683: creat d4/d32/d7f/d8a/dab/fec x:0 0 0 2024-02-28T16:24:44.693 INFO:tasks.workunit.client.1.smithi153.stdout:4/607: dread d4/de/d23/d2b/d31/f96 [0,4194304] 0 2024-02-28T16:24:44.698 INFO:tasks.workunit.client.1.smithi153.stdout:3/674: getdents d4/d8/d1e/d2a/d55/da3/db1 0 2024-02-28T16:24:44.698 INFO:tasks.workunit.client.1.smithi153.stdout:8/689: unlink d0/c83 0 2024-02-28T16:24:44.698 INFO:tasks.workunit.client.1.smithi153.stdout:0/684: truncate d4/d27/d9a/da1/db0/fe0 428399 0 2024-02-28T16:24:44.701 INFO:tasks.workunit.client.1.smithi153.stdout:9/646: rmdir d1/d5/d11/d64/d85 39 2024-02-28T16:24:44.705 INFO:tasks.workunit.client.1.smithi153.stdout:5/688: dwrite da/dd/f31 [0,4194304] 0 2024-02-28T16:24:44.718 INFO:tasks.workunit.client.1.smithi153.stdout:0/685: fsync d4/d27/f3a 0 2024-02-28T16:24:44.723 INFO:tasks.workunit.client.1.smithi153.stdout:8/690: creat d0/d12/d67/d88/d85/db6/ff4 x:0 0 0 2024-02-28T16:24:44.724 INFO:tasks.workunit.client.1.smithi153.stdout:7/691: sync 2024-02-28T16:24:44.724 INFO:tasks.workunit.client.1.smithi153.stdout:2/699: sync 2024-02-28T16:24:44.727 INFO:tasks.workunit.client.1.smithi153.stdout:4/608: symlink d4/de/d23/d2b/d31/db4/lc4 0 2024-02-28T16:24:44.727 INFO:tasks.workunit.client.1.smithi153.stdout:4/609: stat d4/d8d 0 2024-02-28T16:24:44.733 INFO:tasks.workunit.client.1.smithi153.stdout:2/700: mknod d2/d86/ce1 0 2024-02-28T16:24:44.734 INFO:tasks.workunit.client.1.smithi153.stdout:3/675: rmdir d4/d8/d1e/d2a/d35/d54/de2 0 2024-02-28T16:24:44.734 INFO:tasks.workunit.client.1.smithi153.stdout:7/692: chown d1/d70/dbf/ldf 205107135 1 2024-02-28T16:24:44.738 INFO:tasks.workunit.client.1.smithi153.stdout:6/699: dwrite d0/d1d/d33/d9c/d68/dcb/fe4 [0,4194304] 0 2024-02-28T16:24:44.738 INFO:tasks.workunit.client.1.smithi153.stdout:2/701: write d2/d23/d88/d95/fcc [103315,116684] 0 2024-02-28T16:24:44.738 INFO:tasks.workunit.client.1.smithi153.stdout:9/647: creat d1/fd7 x:0 0 0 2024-02-28T16:24:44.741 INFO:tasks.workunit.client.1.smithi153.stdout:5/689: dwrite da/d29/d43/d5a/d77/fb1 [0,4194304] 0 2024-02-28T16:24:44.743 INFO:tasks.workunit.client.1.smithi153.stdout:0/686: unlink d4/d32/d7f/d8a/dab/d8e/d90/f19 0 2024-02-28T16:24:44.743 INFO:tasks.workunit.client.1.smithi153.stdout:8/691: dread d0/d19/d2b/d2d/d3f/d9f/fd3 [0,4194304] 0 2024-02-28T16:24:44.743 INFO:tasks.workunit.client.1.smithi153.stdout:7/693: symlink d1/d25/df/d26/lea 0 2024-02-28T16:24:44.750 INFO:tasks.workunit.client.1.smithi153.stdout:5/690: unlink da/dd/d25/d82/d8f/fd9 0 2024-02-28T16:24:44.753 INFO:tasks.workunit.client.1.smithi153.stdout:3/676: symlink d4/d8/d1e/d23/da0/dd9/lee 0 2024-02-28T16:24:44.753 INFO:tasks.workunit.client.1.smithi153.stdout:4/610: dwrite d4/d53/d7c/db3/f42 [4194304,4194304] 0 2024-02-28T16:24:44.755 INFO:tasks.workunit.client.1.smithi153.stdout:9/648: creat d1/d5/d11/d1f/d62/fd8 x:0 0 0 2024-02-28T16:24:44.756 INFO:tasks.workunit.client.1.smithi153.stdout:6/700: mknod d0/d1d/d5d/de9/cf9 0 2024-02-28T16:24:44.757 INFO:tasks.workunit.client.1.smithi153.stdout:1/659: sync 2024-02-28T16:24:44.766 INFO:tasks.workunit.client.1.smithi153.stdout:0/687: mkdir d4/d32/ded 0 2024-02-28T16:24:44.766 INFO:tasks.workunit.client.1.smithi153.stdout:7/694: mkdir d1/d25/dc/d50/d66/da9/deb 0 2024-02-28T16:24:44.768 INFO:tasks.workunit.client.1.smithi153.stdout:5/691: rename da/dd/d54/db0/fc5 to da/dd/d54/d63/fe5 0 2024-02-28T16:24:44.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/688: fdatasync d4/d27/d9a/da1/f7a 0 2024-02-28T16:24:44.770 INFO:tasks.workunit.client.1.smithi153.stdout:6/701: mkdir d0/d1d/d5d/dfa 0 2024-02-28T16:24:44.776 INFO:tasks.workunit.client.1.smithi153.stdout:7/695: creat d1/d25/df/d26/d3a/d5e/fec x:0 0 0 2024-02-28T16:24:44.776 INFO:tasks.workunit.client.1.smithi153.stdout:3/677: dwrite d4/d8/d1e/d2a/d35/f5f [0,4194304] 0 2024-02-28T16:24:44.780 INFO:tasks.workunit.client.1.smithi153.stdout:8/692: link d0/d19/d1e/l6a d0/d12/d67/d88/d85/lf5 0 2024-02-28T16:24:44.783 INFO:tasks.workunit.client.1.smithi153.stdout:4/611: write d4/de/d13/d1b/f69 [641975,22770] 0 2024-02-28T16:24:44.783 INFO:tasks.workunit.client.1.smithi153.stdout:9/649: creat d1/d5/d11/d1f/d20/d99/dae/fd9 x:0 0 0 2024-02-28T16:24:44.784 INFO:tasks.workunit.client.1.smithi153.stdout:6/702: creat d0/d1d/d33/d9c/d68/ffb x:0 0 0 2024-02-28T16:24:44.784 INFO:tasks.workunit.client.1.smithi153.stdout:4/612: chown d4 3825 1 2024-02-28T16:24:44.785 INFO:tasks.workunit.client.1.smithi153.stdout:0/689: write d4/d32/d7f/d8a/dab/f1f [1232562,82386] 0 2024-02-28T16:24:44.786 INFO:tasks.workunit.client.1.smithi153.stdout:9/650: read - d1/d5/d11/d64/f84 zero size 2024-02-28T16:24:44.787 INFO:tasks.workunit.client.1.smithi153.stdout:4/613: chown d4/de/d23/d2b/d9b/f89 17976 1 2024-02-28T16:24:44.789 INFO:tasks.workunit.client.1.smithi153.stdout:0/690: chown d4/d89/fb4 8103603 1 2024-02-28T16:24:44.790 INFO:tasks.workunit.client.1.smithi153.stdout:6/703: stat d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fdb 0 2024-02-28T16:24:44.791 INFO:tasks.workunit.client.1.smithi153.stdout:5/692: mkdir da/d29/d43/de6 0 2024-02-28T16:24:44.793 INFO:tasks.workunit.client.1.smithi153.stdout:3/678: fsync d4/d8/d1e/f5e 0 2024-02-28T16:24:44.795 INFO:tasks.workunit.client.1.smithi153.stdout:5/693: chown da/dd/d25/fab 12475472 1 2024-02-28T16:24:44.797 INFO:tasks.workunit.client.1.smithi153.stdout:9/651: fdatasync d1/d5/f47 0 2024-02-28T16:24:44.799 INFO:tasks.workunit.client.1.smithi153.stdout:5/694: chown da/l94 420044701 1 2024-02-28T16:24:44.799 INFO:tasks.workunit.client.1.smithi153.stdout:0/691: stat d4/d32/d7f/d8a/dab/d8e/d94/dd7 0 2024-02-28T16:24:44.806 INFO:tasks.workunit.client.1.smithi153.stdout:1/660: dread d0/d3d/d4a/d59/f8c [0,4194304] 0 2024-02-28T16:24:44.807 INFO:tasks.workunit.client.1.smithi153.stdout:7/696: write d1/d25/dc/d50/f5b [1774548,79317] 0 2024-02-28T16:24:44.809 INFO:tasks.workunit.client.1.smithi153.stdout:2/702: dread d2/f1c [0,4194304] 0 2024-02-28T16:24:44.810 INFO:tasks.workunit.client.1.smithi153.stdout:7/697: stat d1/d25/df/d26/c39 0 2024-02-28T16:24:44.811 INFO:tasks.workunit.client.1.smithi153.stdout:2/703: chown d2/d23/d36/c5b 0 1 2024-02-28T16:24:44.812 INFO:tasks.workunit.client.1.smithi153.stdout:7/698: readlink d1/d25/d27/d43/l94 0 2024-02-28T16:24:44.812 INFO:tasks.workunit.client.1.smithi153.stdout:8/693: truncate d0/d12/d67/d30/f58 3791333 0 2024-02-28T16:24:44.815 INFO:tasks.workunit.client.1.smithi153.stdout:2/704: write d2/d25/d49/da3/fbd [1462731,95068] 0 2024-02-28T16:24:44.815 INFO:tasks.workunit.client.1.smithi153.stdout:4/614: write d4/f15 [128744,89902] 0 2024-02-28T16:24:44.815 INFO:tasks.workunit.client.1.smithi153.stdout:0/692: dwrite d4/d27/f73 [0,4194304] 0 2024-02-28T16:24:44.819 INFO:tasks.workunit.client.1.smithi153.stdout:3/679: link d4/d8/d1e/d23/da0/fbe d4/d8/d1e/d87/fef 0 2024-02-28T16:24:44.821 INFO:tasks.workunit.client.1.smithi153.stdout:3/680: dread - d4/d8/d1e/d87/fcf zero size 2024-02-28T16:24:44.823 INFO:tasks.workunit.client.1.smithi153.stdout:8/694: symlink d0/d25/d79/db3/lf6 0 2024-02-28T16:24:44.824 INFO:tasks.workunit.client.1.smithi153.stdout:7/699: creat d1/d25/d27/d43/fed x:0 0 0 2024-02-28T16:24:44.825 INFO:tasks.workunit.client.1.smithi153.stdout:1/661: creat d0/dd/dd5/fee x:0 0 0 2024-02-28T16:24:44.831 INFO:tasks.workunit.client.1.smithi153.stdout:6/704: getdents d0/d1d/d33/d9c/d2e 0 2024-02-28T16:24:44.832 INFO:tasks.workunit.client.1.smithi153.stdout:0/693: symlink d4/d89/lee 0 2024-02-28T16:24:44.834 INFO:tasks.workunit.client.1.smithi153.stdout:7/700: dread d1/d25/d27/f5c [0,4194304] 0 2024-02-28T16:24:44.836 INFO:tasks.workunit.client.1.smithi153.stdout:7/701: chown d1/l18 1484441 1 2024-02-28T16:24:44.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/695: creat d0/d19/d2b/d2d/d3f/ff7 x:0 0 0 2024-02-28T16:24:44.842 INFO:tasks.workunit.client.1.smithi153.stdout:1/662: chown d0/dd/f5d 0 1 2024-02-28T16:24:44.845 INFO:tasks.workunit.client.1.smithi153.stdout:2/705: dread d2/d23/d36/f77 [0,4194304] 0 2024-02-28T16:24:44.847 INFO:tasks.workunit.client.1.smithi153.stdout:7/702: write d1/f23 [1808671,101279] 0 2024-02-28T16:24:44.850 INFO:tasks.workunit.client.1.smithi153.stdout:3/681: truncate d4/d13/f67 441802 0 2024-02-28T16:24:44.851 INFO:tasks.workunit.client.1.smithi153.stdout:8/696: mkdir d0/d12/d67/d88/df8 0 2024-02-28T16:24:44.853 INFO:tasks.workunit.client.1.smithi153.stdout:6/705: link d0/d1d/c95 d0/d66/db3/cfc 0 2024-02-28T16:24:44.854 INFO:tasks.workunit.client.1.smithi153.stdout:3/682: write d4/d7d/fb4 [3813338,57963] 0 2024-02-28T16:24:44.854 INFO:tasks.workunit.client.1.smithi153.stdout:4/615: dwrite d4/de/f16 [0,4194304] 0 2024-02-28T16:24:44.855 INFO:tasks.workunit.client.1.smithi153.stdout:0/694: dwrite d4/d27/d9a/da1/f84 [0,4194304] 0 2024-02-28T16:24:44.855 INFO:tasks.workunit.client.1.smithi153.stdout:1/663: mkdir d0/d3d/def 0 2024-02-28T16:24:44.856 INFO:tasks.workunit.client.1.smithi153.stdout:2/706: dread d2/d86/f53 [0,4194304] 0 2024-02-28T16:24:44.858 INFO:tasks.workunit.client.1.smithi153.stdout:7/703: mkdir d1/d25/df/d60/da4/dee 0 2024-02-28T16:24:44.864 INFO:tasks.workunit.client.1.smithi153.stdout:6/706: mkdir d0/d1d/d30/d71/dfd 0 2024-02-28T16:24:44.864 INFO:tasks.workunit.client.1.smithi153.stdout:6/707: readlink d0/d1d/d33/d9c/l4a 0 2024-02-28T16:24:44.866 INFO:tasks.workunit.client.1.smithi153.stdout:0/695: chown d4/d32/dcf/cd3 2666784 1 2024-02-28T16:24:44.867 INFO:tasks.workunit.client.1.smithi153.stdout:1/664: creat d0/dd/db2/d89/dc7/ff0 x:0 0 0 2024-02-28T16:24:44.871 INFO:tasks.workunit.client.1.smithi153.stdout:2/707: mkdir d2/d23/d36/de2 0 2024-02-28T16:24:44.877 INFO:tasks.workunit.client.1.smithi153.stdout:8/697: creat d0/d12/d67/d88/ff9 x:0 0 0 2024-02-28T16:24:44.883 INFO:tasks.workunit.client.1.smithi153.stdout:2/708: creat d2/d23/d88/dbf/fe3 x:0 0 0 2024-02-28T16:24:44.884 INFO:tasks.workunit.client.1.smithi153.stdout:2/709: fdatasync d2/ff 0 2024-02-28T16:24:44.887 INFO:tasks.workunit.client.1.smithi153.stdout:8/698: symlink d0/d19/d2b/d2d/lfa 0 2024-02-28T16:24:44.887 INFO:tasks.workunit.client.1.smithi153.stdout:2/710: dread - d2/d23/d88/fd6 zero size 2024-02-28T16:24:44.887 INFO:tasks.workunit.client.1.smithi153.stdout:0/696: mkdir d4/d99/da5/ddf/def 0 2024-02-28T16:24:44.888 INFO:tasks.workunit.client.1.smithi153.stdout:2/711: write d2/f20 [1231455,21147] 0 2024-02-28T16:24:44.888 INFO:tasks.workunit.client.1.smithi153.stdout:4/616: write d4/de/f56 [469473,95360] 0 2024-02-28T16:24:44.891 INFO:tasks.workunit.client.1.smithi153.stdout:7/704: rename d1/d25/d27/d7c/dc4/fc0 to d1/d25/df/d26/d3a/fef 0 2024-02-28T16:24:44.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:44 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:24:44.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:44 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:24:44.899 INFO:tasks.workunit.client.1.smithi153.stdout:6/708: getdents d0/d66/d85 0 2024-02-28T16:24:44.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/683: dwrite d4/d8/d1e/d2a/d91/fe1 [4194304,4194304] 0 2024-02-28T16:24:44.901 INFO:tasks.workunit.client.1.smithi153.stdout:1/665: truncate d0/dd/fc5 1665657 0 2024-02-28T16:24:44.905 INFO:tasks.workunit.client.1.smithi153.stdout:8/699: mknod d0/d12/d67/cfb 0 2024-02-28T16:24:44.905 INFO:tasks.workunit.client.1.smithi153.stdout:6/709: chown d0/d1d/d33/d9c/d2e/d99/ddf/da4/fcf 91940656 1 2024-02-28T16:24:44.907 INFO:tasks.workunit.client.1.smithi153.stdout:0/697: mkdir d4/d32/df0 0 2024-02-28T16:24:44.908 INFO:tasks.workunit.client.1.smithi153.stdout:1/666: mkdir d0/d62/dd2/df1 0 2024-02-28T16:24:44.908 INFO:tasks.workunit.client.1.smithi153.stdout:5/695: sync 2024-02-28T16:24:44.908 INFO:tasks.workunit.client.1.smithi153.stdout:9/652: sync 2024-02-28T16:24:44.909 INFO:tasks.workunit.client.1.smithi153.stdout:3/684: chown d4/d8/d1e/d2a/d35/d54/fd4 26 1 2024-02-28T16:24:44.912 INFO:tasks.workunit.client.1.smithi153.stdout:8/700: mkdir d0/d12/d67/d88/d96/dfc 0 2024-02-28T16:24:44.915 INFO:tasks.workunit.client.1.smithi153.stdout:6/710: fsync d0/d1d/d33/d9c/d2e/d99/fbb 0 2024-02-28T16:24:44.918 INFO:tasks.workunit.client.1.smithi153.stdout:1/667: truncate d0/d3d/fa6 1585515 0 2024-02-28T16:24:44.919 INFO:tasks.workunit.client.1.smithi153.stdout:4/617: dwrite d4/f7 [0,4194304] 0 2024-02-28T16:24:44.922 INFO:tasks.workunit.client.1.smithi153.stdout:1/668: chown d0/d3d/f64 1103822 1 2024-02-28T16:24:44.922 INFO:tasks.workunit.client.1.smithi153.stdout:6/711: write d0/d1d/d33/faf [1825378,29235] 0 2024-02-28T16:24:44.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:44 smithi023 ceph-mon[29137]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:24:44.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:44 smithi023 ceph-mon[29137]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:24:44.928 INFO:tasks.workunit.client.1.smithi153.stdout:9/653: readlink d1/d5/d11/d64/d85/d9a/lc0 0 2024-02-28T16:24:44.928 INFO:tasks.workunit.client.1.smithi153.stdout:2/712: dread d2/d25/d49/f97 [0,4194304] 0 2024-02-28T16:24:44.931 INFO:tasks.workunit.client.1.smithi153.stdout:5/696: truncate da/f2f 2319909 0 2024-02-28T16:24:44.932 INFO:tasks.workunit.client.1.smithi153.stdout:7/705: dwrite d1/d25/f7 [0,4194304] 0 2024-02-28T16:24:44.932 INFO:tasks.workunit.client.1.smithi153.stdout:9/654: chown d1/d5/d11/d29/d79/fb3 318360 1 2024-02-28T16:24:44.932 INFO:tasks.workunit.client.1.smithi153.stdout:1/669: creat d0/dd/db2/d89/dc7/ff2 x:0 0 0 2024-02-28T16:24:44.935 INFO:tasks.workunit.client.1.smithi153.stdout:1/670: write d0/dd/db2/fa2 [3164164,129673] 0 2024-02-28T16:24:44.937 INFO:tasks.workunit.client.1.smithi153.stdout:8/701: rmdir d0 39 2024-02-28T16:24:44.943 INFO:tasks.workunit.client.1.smithi153.stdout:0/698: truncate d4/d27/f44 815992 0 2024-02-28T16:24:44.948 INFO:tasks.workunit.client.1.smithi153.stdout:2/713: symlink d2/d19/d3e/db0/le4 0 2024-02-28T16:24:44.949 INFO:tasks.workunit.client.1.smithi153.stdout:7/706: mknod d1/d25/cf0 0 2024-02-28T16:24:45.033 INFO:tasks.workunit.client.1.smithi153.stdout:5/697: write da/d29/d43/d5a/d77/f8b [712145,598] 0 2024-02-28T16:24:45.034 INFO:tasks.workunit.client.1.smithi153.stdout:2/714: write d2/f7 [2155969,127135] 0 2024-02-28T16:24:45.034 INFO:tasks.workunit.client.1.smithi153.stdout:9/655: dwrite d1/d5/d11/d1f/d52/fa1 [0,4194304] 0 2024-02-28T16:24:45.036 INFO:tasks.workunit.client.1.smithi153.stdout:8/702: creat d0/d19/d1e/ffd x:0 0 0 2024-02-28T16:24:45.039 INFO:tasks.workunit.client.1.smithi153.stdout:0/699: write d4/d32/d7f/d8a/dab/d8e/d90/f18 [835347,90704] 0 2024-02-28T16:24:45.044 INFO:tasks.workunit.client.1.smithi153.stdout:2/715: stat d2/d19/d2a/d3b/d87/da5 0 2024-02-28T16:24:45.054 INFO:tasks.workunit.client.1.smithi153.stdout:5/698: mkdir da/d29/d43/d5a/dbe/de7 0 2024-02-28T16:24:45.054 INFO:tasks.workunit.client.1.smithi153.stdout:7/707: truncate d1/d25/df/fb4 1449750 0 2024-02-28T16:24:45.054 INFO:tasks.workunit.client.1.smithi153.stdout:9/656: truncate d1/d5/d27/fb8 651867 0 2024-02-28T16:24:45.068 INFO:tasks.workunit.client.1.smithi153.stdout:2/716: symlink d2/d86/da0/dce/le5 0 2024-02-28T16:24:45.071 INFO:tasks.workunit.client.1.smithi153.stdout:2/717: chown d2/d19/d31/caa 72643875 1 2024-02-28T16:24:45.073 INFO:tasks.workunit.client.1.smithi153.stdout:7/708: link d1/d25/d27/d43/l44 d1/d25/df/d26/d3a/d95/d97/dd0/lf1 0 2024-02-28T16:24:45.075 INFO:tasks.workunit.client.1.smithi153.stdout:8/703: dwrite d0/d12/d67/d88/d8e/f9c [0,4194304] 0 2024-02-28T16:24:45.077 INFO:tasks.workunit.client.1.smithi153.stdout:2/718: symlink d2/d19/d3e/db0/le6 0 2024-02-28T16:24:45.078 INFO:tasks.workunit.client.1.smithi153.stdout:8/704: dread - d0/d19/d2b/d2d/d3f/d9f/dcc/fcd zero size 2024-02-28T16:24:45.083 INFO:tasks.workunit.client.1.smithi153.stdout:8/705: symlink d0/d19/d2b/d2d/d3f/lfe 0 2024-02-28T16:24:45.085 INFO:tasks.workunit.client.1.smithi153.stdout:2/719: creat d2/d19/d8b/dcf/fe7 x:0 0 0 2024-02-28T16:24:45.088 INFO:tasks.workunit.client.1.smithi153.stdout:8/706: fsync d0/d19/d2b/d2d/d3f/d9f/dcc/fcd 0 2024-02-28T16:24:45.092 INFO:tasks.workunit.client.1.smithi153.stdout:8/707: unlink d0/d19/d2b/fe1 0 2024-02-28T16:24:45.092 INFO:tasks.workunit.client.1.smithi153.stdout:7/709: dwrite d1/d25/df/d26/d76/f9a [0,4194304] 0 2024-02-28T16:24:45.096 INFO:tasks.workunit.client.1.smithi153.stdout:9/657: dread d1/d5/d11/d1f/d20/d36/f38 [0,4194304] 0 2024-02-28T16:24:45.097 INFO:tasks.workunit.client.1.smithi153.stdout:8/708: creat d0/d19/d1e/fff x:0 0 0 2024-02-28T16:24:45.097 INFO:tasks.workunit.client.1.smithi153.stdout:9/658: chown d1/d58 9 1 2024-02-28T16:24:45.103 INFO:tasks.workunit.client.1.smithi153.stdout:7/710: rename d1/l38 to d1/d25/d27/d7c/db5/lf2 0 2024-02-28T16:24:45.103 INFO:tasks.workunit.client.1.smithi153.stdout:8/709: truncate d0/d19/d2b/d2d/f5a 636093 0 2024-02-28T16:24:45.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/700: truncate d4/d27/f73 3232951 0 2024-02-28T16:24:45.121 INFO:tasks.workunit.client.1.smithi153.stdout:0/701: dread d4/d32/d7f/d8a/fc6 [0,4194304] 0 2024-02-28T16:24:45.121 INFO:tasks.workunit.client.1.smithi153.stdout:5/699: dwrite da/dd/d25/f55 [8388608,4194304] 0 2024-02-28T16:24:45.123 INFO:tasks.workunit.client.1.smithi153.stdout:7/711: dwrite d1/d25/df/f61 [0,4194304] 0 2024-02-28T16:24:45.124 INFO:tasks.workunit.client.1.smithi153.stdout:0/702: write d4/d27/dc1/fe9 [152435,16756] 0 2024-02-28T16:24:45.126 INFO:tasks.workunit.client.1.smithi153.stdout:7/712: fsync d1/d25/df/d60/da4/fce 0 2024-02-28T16:24:45.132 INFO:tasks.workunit.client.1.smithi153.stdout:8/710: dwrite d0/d12/d67/d30/f65 [0,4194304] 0 2024-02-28T16:24:45.133 INFO:tasks.workunit.client.1.smithi153.stdout:8/711: write d0/d19/d1e/fdf [777847,48188] 0 2024-02-28T16:24:45.135 INFO:tasks.workunit.client.1.smithi153.stdout:9/659: write d1/d5/d11/d1f/d62/fb4 [310914,129905] 0 2024-02-28T16:24:45.137 INFO:tasks.workunit.client.1.smithi153.stdout:5/700: creat da/dd/dd1/fe8 x:0 0 0 2024-02-28T16:24:45.137 INFO:tasks.workunit.client.1.smithi153.stdout:0/703: truncate d4/f8 982651 0 2024-02-28T16:24:45.139 INFO:tasks.workunit.client.1.smithi153.stdout:0/704: chown d4/c16 24765029 1 2024-02-28T16:24:45.139 INFO:tasks.workunit.client.1.smithi153.stdout:7/713: mknod d1/d25/df/d26/d3a/d95/d97/cf3 0 2024-02-28T16:24:45.141 INFO:tasks.workunit.client.1.smithi153.stdout:9/660: creat d1/d5/d11/d64/dd5/fda x:0 0 0 2024-02-28T16:24:45.144 INFO:tasks.workunit.client.1.smithi153.stdout:9/661: read - d1/d5/d11/d1f/d40/d97/fcd zero size 2024-02-28T16:24:45.145 INFO:tasks.workunit.client.1.smithi153.stdout:8/712: mkdir d0/d12/d15/dab/dd0/de9/d100 0 2024-02-28T16:24:45.146 INFO:tasks.workunit.client.1.smithi153.stdout:9/662: chown d1/d5/d11/d1f/ca7 247369530 1 2024-02-28T16:24:45.146 INFO:tasks.workunit.client.1.smithi153.stdout:5/701: mkdir da/de1/de9 0 2024-02-28T16:24:45.147 INFO:tasks.workunit.client.1.smithi153.stdout:0/705: fdatasync d4/d27/f85 0 2024-02-28T16:24:45.149 INFO:tasks.workunit.client.1.smithi153.stdout:0/706: write d4/fe [3711197,113434] 0 2024-02-28T16:24:45.157 INFO:tasks.workunit.client.1.smithi153.stdout:0/707: creat d4/d32/d7f/d8a/dab/d8e/d94/dd7/ff1 x:0 0 0 2024-02-28T16:24:45.157 INFO:tasks.workunit.client.1.smithi153.stdout:7/714: dread d1/d25/fe [0,4194304] 0 2024-02-28T16:24:45.160 INFO:tasks.workunit.client.1.smithi153.stdout:8/713: mknod d0/d12/d67/d88/df8/c101 0 2024-02-28T16:24:45.161 INFO:tasks.workunit.client.1.smithi153.stdout:9/663: dread d1/ff [0,4194304] 0 2024-02-28T16:24:45.162 INFO:tasks.workunit.client.1.smithi153.stdout:5/702: symlink da/d29/d43/lea 0 2024-02-28T16:24:45.165 INFO:tasks.workunit.client.1.smithi153.stdout:8/714: truncate d0/d12/f8d 3200503 0 2024-02-28T16:24:45.168 INFO:tasks.workunit.client.1.smithi153.stdout:0/708: creat d4/d32/d7f/dd6/ff2 x:0 0 0 2024-02-28T16:24:45.169 INFO:tasks.workunit.client.1.smithi153.stdout:8/715: dread d0/d25/d79/db3/fbe [0,4194304] 0 2024-02-28T16:24:45.171 INFO:tasks.workunit.client.1.smithi153.stdout:5/703: read da/dd/fe [142066,39720] 0 2024-02-28T16:24:45.176 INFO:tasks.workunit.client.1.smithi153.stdout:4/618: sync 2024-02-28T16:24:45.176 INFO:tasks.workunit.client.1.smithi153.stdout:6/712: sync 2024-02-28T16:24:45.176 INFO:tasks.workunit.client.1.smithi153.stdout:3/685: sync 2024-02-28T16:24:45.177 INFO:tasks.workunit.client.1.smithi153.stdout:0/709: rmdir d4/d27/d9a/da1 39 2024-02-28T16:24:45.178 INFO:tasks.workunit.client.1.smithi153.stdout:8/716: write d0/d12/d15/fa8 [165081,21247] 0 2024-02-28T16:24:45.178 INFO:tasks.workunit.client.1.smithi153.stdout:4/619: fsync d4/de/d23/d2b/f63 0 2024-02-28T16:24:45.180 INFO:tasks.workunit.client.1.smithi153.stdout:3/686: chown d4/d8/d1e/d2a/d55/da3/db1 389727761 1 2024-02-28T16:24:45.183 INFO:tasks.workunit.client.1.smithi153.stdout:6/713: fsync d0/d1d/d33/d9c/d48/fc0 0 2024-02-28T16:24:45.191 INFO:tasks.workunit.client.1.smithi153.stdout:6/714: dread d0/d1d/d33/d9c/d2e/d99/ddf/da4/fcf [0,4194304] 0 2024-02-28T16:24:45.192 INFO:tasks.workunit.client.1.smithi153.stdout:4/620: dread d4/de/d13/d1b/f69 [0,4194304] 0 2024-02-28T16:24:45.193 INFO:tasks.workunit.client.1.smithi153.stdout:6/715: fsync d0/d17/fe7 0 2024-02-28T16:24:45.193 INFO:tasks.workunit.client.1.smithi153.stdout:4/621: chown d4/de 284676 1 2024-02-28T16:24:45.194 INFO:tasks.workunit.client.1.smithi153.stdout:9/664: dwrite d1/d5/d11/d1f/d20/d36/f38 [8388608,4194304] 0 2024-02-28T16:24:45.195 INFO:tasks.workunit.client.1.smithi153.stdout:4/622: stat f0 0 2024-02-28T16:24:45.195 INFO:tasks.workunit.client.1.smithi153.stdout:6/716: chown d0/d1d/d5d/dfa 1397413 1 2024-02-28T16:24:45.206 INFO:tasks.workunit.client.1.smithi153.stdout:8/717: rename d0/d19/d2b/c49 to d0/d19/d2b/d2d/d3f/d9f/c102 0 2024-02-28T16:24:45.212 INFO:tasks.workunit.client.1.smithi153.stdout:8/718: write d0/d12/d67/d88/d8e/d9d/fb7 [387343,79573] 0 2024-02-28T16:24:45.216 INFO:tasks.workunit.client.1.smithi153.stdout:3/687: dwrite d4/d7d/d70/faf [0,4194304] 0 2024-02-28T16:24:45.221 INFO:tasks.workunit.client.1.smithi153.stdout:5/704: dread da/fc3 [0,4194304] 0 2024-02-28T16:24:45.233 INFO:tasks.workunit.client.1.smithi153.stdout:4/623: symlink d4/de/d23/d2b/lc5 0 2024-02-28T16:24:45.236 INFO:tasks.workunit.client.1.smithi153.stdout:8/719: creat d0/d25/f103 x:0 0 0 2024-02-28T16:24:45.236 INFO:tasks.workunit.client.1.smithi153.stdout:9/665: symlink d1/d5/d11/d64/d85/d8c/ldb 0 2024-02-28T16:24:45.238 INFO:tasks.workunit.client.1.smithi153.stdout:0/710: dread d4/d32/d7f/d8a/dab/f21 [0,4194304] 0 2024-02-28T16:24:45.239 INFO:tasks.workunit.client.1.smithi153.stdout:6/717: creat d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/ffe x:0 0 0 2024-02-28T16:24:45.240 INFO:tasks.workunit.client.1.smithi153.stdout:9/666: fdatasync d1/d5/d11/d1f/d52/f6c 0 2024-02-28T16:24:45.240 INFO:tasks.workunit.client.1.smithi153.stdout:3/688: creat d4/d13/d28/d36/d9f/ff0 x:0 0 0 2024-02-28T16:24:45.243 INFO:tasks.workunit.client.1.smithi153.stdout:4/624: creat d4/de/d23/d2b/d31/da2/da5/fc6 x:0 0 0 2024-02-28T16:24:45.245 INFO:tasks.workunit.client.1.smithi153.stdout:4/625: dread - d4/de/d23/d2b/d4b/fa0 zero size 2024-02-28T16:24:45.247 INFO:tasks.workunit.client.1.smithi153.stdout:8/720: mkdir d0/d19/d2b/d2d/d3f/d9f/dcc/d104 0 2024-02-28T16:24:45.250 INFO:tasks.workunit.client.1.smithi153.stdout:6/718: mkdir d0/d1d/d33/d9c/d68/da2/dff 0 2024-02-28T16:24:45.253 INFO:tasks.workunit.client.1.smithi153.stdout:0/711: mkdir d4/d32/df3 0 2024-02-28T16:24:45.256 INFO:tasks.workunit.client.1.smithi153.stdout:5/705: rename da/dd/d25/d8a/f8d to da/dd/d25/feb 0 2024-02-28T16:24:45.258 INFO:tasks.workunit.client.1.smithi153.stdout:3/689: symlink d4/d8/d1e/dbb/lf1 0 2024-02-28T16:24:45.259 INFO:tasks.workunit.client.1.smithi153.stdout:9/667: link d1/d5/d11/d1f/d20/f3e d1/d5/d11/d1f/d52/fdc 0 2024-02-28T16:24:45.260 INFO:tasks.workunit.client.1.smithi153.stdout:8/721: dwrite d0/d12/d67/d30/f7a [0,4194304] 0 2024-02-28T16:24:45.260 INFO:tasks.workunit.client.1.smithi153.stdout:3/690: chown d4/d8/d1e/d2a/d55/da3/db5 19 1 2024-02-28T16:24:45.262 INFO:tasks.workunit.client.1.smithi153.stdout:6/719: symlink d0/d1d/d33/d9c/d2e/d99/dab/l100 0 2024-02-28T16:24:45.265 INFO:tasks.workunit.client.1.smithi153.stdout:5/706: fsync da/dd/d25/dcb/fde 0 2024-02-28T16:24:45.271 INFO:tasks.workunit.client.1.smithi153.stdout:3/691: symlink d4/d7d/d41/lf2 0 2024-02-28T16:24:45.272 INFO:tasks.workunit.client.1.smithi153.stdout:0/712: dread d4/d27/f73 [0,4194304] 0 2024-02-28T16:24:45.273 INFO:tasks.workunit.client.1.smithi153.stdout:9/668: creat d1/d5/d11/d1f/d40/fdd x:0 0 0 2024-02-28T16:24:45.275 INFO:tasks.workunit.client.1.smithi153.stdout:5/707: truncate da/dd/f4c 1700267 0 2024-02-28T16:24:45.280 INFO:tasks.workunit.client.1.smithi153.stdout:0/713: rename d4/d32/d7f/db3/fd8 to d4/d32/d7f/d8a/ff4 0 2024-02-28T16:24:45.284 INFO:tasks.workunit.client.1.smithi153.stdout:3/692: rename d4/d8/d1e/d2a/d35/f39 to d4/d6a/ff3 0 2024-02-28T16:24:45.284 INFO:tasks.workunit.client.1.smithi153.stdout:6/720: link d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/l9e d0/d1d/d33/d9c/d68/da2/dff/l101 0 2024-02-28T16:24:45.287 INFO:tasks.workunit.client.1.smithi153.stdout:3/693: write d4/d13/f1d [2655092,72870] 0 2024-02-28T16:24:45.287 INFO:tasks.workunit.client.1.smithi153.stdout:0/714: mkdir d4/d32/d7f/d8a/dab/d8e/d94/df5 0 2024-02-28T16:24:45.289 INFO:tasks.workunit.client.1.smithi153.stdout:6/721: symlink d0/d1d/d33/l102 0 2024-02-28T16:24:45.292 INFO:tasks.workunit.client.1.smithi153.stdout:3/694: symlink d4/d49/lf4 0 2024-02-28T16:24:45.292 INFO:tasks.workunit.client.1.smithi153.stdout:5/708: dwrite da/dd/d25/f5c [0,4194304] 0 2024-02-28T16:24:45.293 INFO:tasks.workunit.client.1.smithi153.stdout:9/669: dwrite d1/f15 [4194304,4194304] 0 2024-02-28T16:24:45.301 INFO:tasks.workunit.client.1.smithi153.stdout:8/722: write d0/d19/d2b/d2d/fda [1310275,123037] 0 2024-02-28T16:24:45.305 INFO:tasks.workunit.client.1.smithi153.stdout:0/715: dread d4/d32/d7f/d8a/dab/f4b [0,4194304] 0 2024-02-28T16:24:45.305 INFO:tasks.workunit.client.1.smithi153.stdout:9/670: fdatasync d1/d5/d11/d1f/d20/d5d/f5f 0 2024-02-28T16:24:45.308 INFO:tasks.workunit.client.1.smithi153.stdout:3/695: fsync d4/d8/d1e/d87/fef 0 2024-02-28T16:24:45.310 INFO:tasks.workunit.client.1.smithi153.stdout:6/722: creat d0/d1d/d33/d9c/f103 x:0 0 0 2024-02-28T16:24:45.316 INFO:tasks.workunit.client.1.smithi153.stdout:1/671: sync 2024-02-28T16:24:45.317 INFO:tasks.workunit.client.1.smithi153.stdout:5/709: dwrite da/d29/f59 [0,4194304] 0 2024-02-28T16:24:45.318 INFO:tasks.workunit.client.1.smithi153.stdout:9/671: dread d1/d74/d80/da8/f3d [0,4194304] 0 2024-02-28T16:24:45.320 INFO:tasks.workunit.client.1.smithi153.stdout:2/720: sync 2024-02-28T16:24:45.322 INFO:tasks.workunit.client.1.smithi153.stdout:6/723: stat d0/d17/f75 0 2024-02-28T16:24:45.322 INFO:tasks.workunit.client.1.smithi153.stdout:1/672: write d0/d3d/d4a/fcb [195321,47156] 0 2024-02-28T16:24:45.324 INFO:tasks.workunit.client.1.smithi153.stdout:0/716: mkdir d4/d32/dcf/df6 0 2024-02-28T16:24:45.327 INFO:tasks.workunit.client.1.smithi153.stdout:5/710: rmdir da/dd/d25/dcb 39 2024-02-28T16:24:45.331 INFO:tasks.workunit.client.1.smithi153.stdout:5/711: stat da/d29/d43/d5a/dbe 0 2024-02-28T16:24:45.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/673: dread - d0/f14 zero size 2024-02-28T16:24:45.332 INFO:tasks.workunit.client.1.smithi153.stdout:9/672: dread d1/f4e [0,4194304] 0 2024-02-28T16:24:45.333 INFO:tasks.workunit.client.1.smithi153.stdout:8/723: dwrite d0/d34/fcf [0,4194304] 0 2024-02-28T16:24:45.344 INFO:tasks.workunit.client.1.smithi153.stdout:1/674: read d0/d3d/d4a/d59/f5a [386160,34898] 0 2024-02-28T16:24:45.344 INFO:tasks.workunit.client.1.smithi153.stdout:8/724: mknod d0/d19/d1e/c105 0 2024-02-28T16:24:45.349 INFO:tasks.workunit.client.1.smithi153.stdout:2/721: link d2/d19/d2a/d3b/f71 d2/d19/d2a/d93/d9b/fe8 0 2024-02-28T16:24:45.351 INFO:tasks.workunit.client.1.smithi153.stdout:2/722: write d2/fd5 [616874,97650] 0 2024-02-28T16:24:45.356 INFO:tasks.workunit.client.1.smithi153.stdout:8/725: mkdir d0/d12/d67/d88/d96/dfc/d106 0 2024-02-28T16:24:45.357 INFO:tasks.workunit.client.1.smithi153.stdout:6/724: dwrite d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/ffe [0,4194304] 0 2024-02-28T16:24:45.357 INFO:tasks.workunit.client.1.smithi153.stdout:0/717: dwrite d4/d32/fba [0,4194304] 0 2024-02-28T16:24:45.361 INFO:tasks.workunit.client.1.smithi153.stdout:0/718: write d4/f3c [1142513,39484] 0 2024-02-28T16:24:45.361 INFO:tasks.workunit.client.1.smithi153.stdout:2/723: mknod d2/d19/d2a/d3b/d5e/ce9 0 2024-02-28T16:24:45.362 INFO:tasks.workunit.client.1.smithi153.stdout:6/725: read d0/d1d/d33/d9c/d68/da1/fc5 [1546925,16216] 0 2024-02-28T16:24:45.371 INFO:tasks.workunit.client.1.smithi153.stdout:5/712: dwrite da/dd/d25/d41/d7c/f7e [0,4194304] 0 2024-02-28T16:24:45.372 INFO:tasks.workunit.client.1.smithi153.stdout:9/673: dread d1/d74/d80/da8/f4f [0,4194304] 0 2024-02-28T16:24:45.375 INFO:tasks.workunit.client.1.smithi153.stdout:1/675: getdents d0/d3d/d4a 0 2024-02-28T16:24:45.380 INFO:tasks.workunit.client.1.smithi153.stdout:6/726: link d0/f18 d0/d1d/d33/db2/f104 0 2024-02-28T16:24:45.383 INFO:tasks.workunit.client.1.smithi153.stdout:6/727: stat d0/d1d/d33/d9c/d48/d63/d8c/dd1 0 2024-02-28T16:24:45.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/674: mknod d1/d5/d11/d1f/d20/d99/dae/cde 0 2024-02-28T16:24:45.384 INFO:tasks.workunit.client.1.smithi153.stdout:1/676: rmdir d0/d62/d66/d8e 39 2024-02-28T16:24:45.384 INFO:tasks.workunit.client.1.smithi153.stdout:5/713: creat da/d29/d43/d5a/d77/dd6/fec x:0 0 0 2024-02-28T16:24:45.387 INFO:tasks.workunit.client.1.smithi153.stdout:1/677: chown d0/dd/db2/d89/lab 505357833 1 2024-02-28T16:24:45.388 INFO:tasks.workunit.client.1.smithi153.stdout:1/678: chown d0/d62/ldd 31897150 1 2024-02-28T16:24:45.391 INFO:tasks.workunit.client.1.smithi153.stdout:9/675: mknod d1/d5/d11/d64/cdf 0 2024-02-28T16:24:45.391 INFO:tasks.workunit.client.1.smithi153.stdout:3/696: sync 2024-02-28T16:24:45.391 INFO:tasks.workunit.client.1.smithi153.stdout:4/626: sync 2024-02-28T16:24:45.391 INFO:tasks.workunit.client.1.smithi153.stdout:7/715: sync 2024-02-28T16:24:45.393 INFO:tasks.workunit.client.1.smithi153.stdout:6/728: creat d0/d1d/d5d/dfa/f105 x:0 0 0 2024-02-28T16:24:45.395 INFO:tasks.workunit.client.1.smithi153.stdout:2/724: truncate d2/f67 2067081 0 2024-02-28T16:24:45.397 INFO:tasks.workunit.client.1.smithi153.stdout:7/716: dread - d1/d25/d27/d7c/db5/fe9 zero size 2024-02-28T16:24:45.398 INFO:tasks.workunit.client.1.smithi153.stdout:9/676: symlink d1/d5/d11/le0 0 2024-02-28T16:24:45.401 INFO:tasks.workunit.client.1.smithi153.stdout:3/697: mknod d4/d8/d1e/cf5 0 2024-02-28T16:24:45.402 INFO:tasks.workunit.client.1.smithi153.stdout:4/627: chown d4/de/d23/d2b/d9b/cbd 20108 1 2024-02-28T16:24:45.407 INFO:tasks.workunit.client.1.smithi153.stdout:6/729: unlink d0/d1d/d33/d9c/d68/da2/cae 0 2024-02-28T16:24:45.407 INFO:tasks.workunit.client.1.smithi153.stdout:9/677: read d1/d74/d80/da8/f4f [3505076,113563] 0 2024-02-28T16:24:45.408 INFO:tasks.workunit.client.1.smithi153.stdout:2/725: creat d2/d4b/fea x:0 0 0 2024-02-28T16:24:45.412 INFO:tasks.workunit.client.1.smithi153.stdout:8/726: dwrite d0/d12/d67/d88/d96/fb8 [0,4194304] 0 2024-02-28T16:24:45.412 INFO:tasks.workunit.client.1.smithi153.stdout:2/726: stat d2/d23/l98 0 2024-02-28T16:24:45.417 INFO:tasks.workunit.client.1.smithi153.stdout:1/679: dwrite d0/d3d/fa6 [0,4194304] 0 2024-02-28T16:24:45.417 INFO:tasks.workunit.client.1.smithi153.stdout:0/719: dwrite d4/f8 [0,4194304] 0 2024-02-28T16:24:45.417 INFO:tasks.workunit.client.1.smithi153.stdout:3/698: read d4/d8/d1e/d2a/f83 [836674,115583] 0 2024-02-28T16:24:45.420 INFO:tasks.workunit.client.1.smithi153.stdout:8/727: chown d0/c45 20428 1 2024-02-28T16:24:45.421 INFO:tasks.workunit.client.1.smithi153.stdout:4/628: symlink d4/de/d23/d2b/d4b/da9/lc7 0 2024-02-28T16:24:45.429 INFO:tasks.workunit.client.1.smithi153.stdout:1/680: mknod d0/dd/db2/de5/cf3 0 2024-02-28T16:24:45.434 INFO:tasks.workunit.client.1.smithi153.stdout:9/678: dwrite d1/d5/d11/d1f/d40/f8b [0,4194304] 0 2024-02-28T16:24:45.445 INFO:tasks.workunit.client.1.smithi153.stdout:4/629: mknod d4/de/d23/d2b/d4b/cc8 0 2024-02-28T16:24:45.447 INFO:tasks.workunit.client.1.smithi153.stdout:4/630: chown d4/de/cb5 2 1 2024-02-28T16:24:45.448 INFO:tasks.workunit.client.1.smithi153.stdout:1/681: chown d0/dd/c17 1411 1 2024-02-28T16:24:45.449 INFO:tasks.workunit.client.1.smithi153.stdout:7/717: truncate d1/f6c 964463 0 2024-02-28T16:24:45.450 INFO:tasks.workunit.client.1.smithi153.stdout:6/730: dread d0/d1d/d33/d9c/d68/da1/fc5 [0,4194304] 0 2024-02-28T16:24:45.450 INFO:tasks.workunit.client.1.smithi153.stdout:1/682: chown d0/dd/db2/cb5 0 1 2024-02-28T16:24:45.451 INFO:tasks.workunit.client.1.smithi153.stdout:0/720: fsync d4/d32/d7f/d8a/dab/f31 0 2024-02-28T16:24:45.453 INFO:tasks.workunit.client.1.smithi153.stdout:3/699: creat d4/d13/d28/ff6 x:0 0 0 2024-02-28T16:24:45.456 INFO:tasks.workunit.client.1.smithi153.stdout:8/728: rename d0/d12/d67/d88/d85/lf5 to d0/da5/l107 0 2024-02-28T16:24:45.458 INFO:tasks.workunit.client.1.smithi153.stdout:8/729: write d0/ff [198000,123080] 0 2024-02-28T16:24:45.458 INFO:tasks.workunit.client.1.smithi153.stdout:2/727: link d2/d19/d2a/f76 d2/d25/db4/dca/feb 0 2024-02-28T16:24:45.470 INFO:tasks.workunit.client.1.smithi153.stdout:6/731: mkdir d0/d1d/d5d/d106 0 2024-02-28T16:24:45.472 INFO:tasks.workunit.client.1.smithi153.stdout:6/732: dread - d0/d1d/d33/d9c/d68/dcb/ff6 zero size 2024-02-28T16:24:45.474 INFO:tasks.workunit.client.1.smithi153.stdout:0/721: dread d4/d32/d7f/d8a/dab/f31 [0,4194304] 0 2024-02-28T16:24:45.474 INFO:tasks.workunit.client.1.smithi153.stdout:6/733: chown d0/d1d/d30/d71/d91/fb1 4 1 2024-02-28T16:24:45.481 INFO:tasks.workunit.client.1.smithi153.stdout:8/730: mkdir d0/d19/d2b/d2d/d108 0 2024-02-28T16:24:45.482 INFO:tasks.workunit.client.1.smithi153.stdout:8/731: fdatasync d0/d12/d67/d30/f7a 0 2024-02-28T16:24:45.484 INFO:tasks.workunit.client.1.smithi153.stdout:2/728: truncate d2/d23/d48/f8d 5188296 0 2024-02-28T16:24:45.489 INFO:tasks.workunit.client.1.smithi153.stdout:6/734: dwrite d0/d1d/d33/d9c/f86 [4194304,4194304] 0 2024-02-28T16:24:45.491 INFO:tasks.workunit.client.1.smithi153.stdout:3/700: write d4/d8/f1c [317129,42880] 0 2024-02-28T16:24:45.491 INFO:tasks.workunit.client.1.smithi153.stdout:5/714: sync 2024-02-28T16:24:45.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/631: dwrite d4/de/d47/f8c [0,4194304] 0 2024-02-28T16:24:45.494 INFO:tasks.workunit.client.1.smithi153.stdout:5/715: write da/d29/d43/d5a/fbd [12241,106053] 0 2024-02-28T16:24:45.497 INFO:tasks.workunit.client.1.smithi153.stdout:1/683: creat d0/d62/d66/d8e/ff4 x:0 0 0 2024-02-28T16:24:45.499 INFO:tasks.workunit.client.1.smithi153.stdout:7/718: truncate d1/d25/f49 1070426 0 2024-02-28T16:24:45.500 INFO:tasks.workunit.client.1.smithi153.stdout:9/679: link d1/d5/d11/d64/d85/d9a/lc0 d1/d5/d11/d1f/d20/d99/le1 0 2024-02-28T16:24:45.504 INFO:tasks.workunit.client.1.smithi153.stdout:8/732: symlink d0/d34/l109 0 2024-02-28T16:24:45.508 INFO:tasks.workunit.client.1.smithi153.stdout:7/719: truncate d1/d25/df/d26/d3a/d95/fdb 555249 0 2024-02-28T16:24:45.512 INFO:tasks.workunit.client.1.smithi153.stdout:3/701: stat d4/d7d/d41/d71/cb2 0 2024-02-28T16:24:45.514 INFO:tasks.workunit.client.1.smithi153.stdout:5/716: rmdir da/d29/d43 39 2024-02-28T16:24:45.519 INFO:tasks.workunit.client.1.smithi153.stdout:9/680: readlink d1/d5/l56 0 2024-02-28T16:24:45.520 INFO:tasks.workunit.client.1.smithi153.stdout:1/684: mkdir d0/dd/db2/d89/dad/dde/df5 0 2024-02-28T16:24:45.522 INFO:tasks.workunit.client.1.smithi153.stdout:3/702: symlink d4/d8/d1e/d23/lf7 0 2024-02-28T16:24:45.522 INFO:tasks.workunit.client.1.smithi153.stdout:4/632: dwrite d4/de/d23/d2b/d9b/fb0 [0,4194304] 0 2024-02-28T16:24:45.522 INFO:tasks.workunit.client.1.smithi153.stdout:0/722: dread d4/d32/f36 [0,4194304] 0 2024-02-28T16:24:45.524 INFO:tasks.workunit.client.1.smithi153.stdout:1/685: fdatasync d0/f48 0 2024-02-28T16:24:45.527 INFO:tasks.workunit.client.1.smithi153.stdout:5/717: symlink da/d29/d43/d5a/d77/led 0 2024-02-28T16:24:45.527 INFO:tasks.workunit.client.1.smithi153.stdout:1/686: fdatasync d0/d3d/d4a/fcb 0 2024-02-28T16:24:45.534 INFO:tasks.workunit.client.1.smithi153.stdout:1/687: dread d0/d3d/d4a/fcb [0,4194304] 0 2024-02-28T16:24:45.535 INFO:tasks.workunit.client.1.smithi153.stdout:4/633: symlink d4/db9/lc9 0 2024-02-28T16:24:45.535 INFO:tasks.workunit.client.1.smithi153.stdout:6/735: write d0/d1d/d33/d9c/d2e/f37 [4711857,97358] 0 2024-02-28T16:24:45.538 INFO:tasks.workunit.client.1.smithi153.stdout:5/718: unlink da/dd/d54/fa1 0 2024-02-28T16:24:45.541 INFO:tasks.workunit.client.1.smithi153.stdout:6/736: chown d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/d96/fbe 16551880 1 2024-02-28T16:24:45.543 INFO:tasks.workunit.client.1.smithi153.stdout:0/723: dwrite d4/f6b [0,4194304] 0 2024-02-28T16:24:45.543 INFO:tasks.workunit.client.1.smithi153.stdout:5/719: chown da/dd/d54/c87 83 1 2024-02-28T16:24:45.544 INFO:tasks.workunit.client.1.smithi153.stdout:6/737: chown d0/d1d/d33/d9c/d68 31018 1 2024-02-28T16:24:45.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/720: link d1/d25/df/l20 d1/d25/df/d60/da4/dee/lf4 0 2024-02-28T16:24:45.547 INFO:tasks.workunit.client.1.smithi153.stdout:6/738: chown d0/d1d/d33/d9c/d2e/f4e 2767798 1 2024-02-28T16:24:45.548 INFO:tasks.workunit.client.1.smithi153.stdout:7/721: fdatasync d1/d70/dbf/fc5 0 2024-02-28T16:24:45.550 INFO:tasks.workunit.client.1.smithi153.stdout:8/733: dwrite d0/d19/d1e/f53 [0,4194304] 0 2024-02-28T16:24:45.554 INFO:tasks.workunit.client.1.smithi153.stdout:9/681: link d1/d5/d11/d64/f86 d1/d5/d11/d1f/fe2 0 2024-02-28T16:24:45.556 INFO:tasks.workunit.client.1.smithi153.stdout:4/634: rename d4/de/d23/d2b/d31/l41 to d4/de/d23/d2b/d4b/d80/d9e/lca 0 2024-02-28T16:24:45.562 INFO:tasks.workunit.client.1.smithi153.stdout:1/688: creat d0/dd/db2/dcc/ff6 x:0 0 0 2024-02-28T16:24:45.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:45 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:24:45.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:45 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:24:45.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:45 smithi153 ceph-mon[35341]: pgmap v12: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 53 MiB/s rd, 198 MiB/s wr, 423 op/s 2024-02-28T16:24:45.565 INFO:tasks.workunit.client.1.smithi153.stdout:5/720: read da/d29/d43/fb2 [154890,86341] 0 2024-02-28T16:24:45.569 INFO:tasks.workunit.client.1.smithi153.stdout:4/635: dread d4/de/d13/f84 [0,4194304] 0 2024-02-28T16:24:45.570 INFO:tasks.workunit.client.1.smithi153.stdout:3/703: getdents d4/d7d/d41/d71 0 2024-02-28T16:24:45.571 INFO:tasks.workunit.client.1.smithi153.stdout:7/722: dwrite d1/d25/df/f47 [4194304,4194304] 0 2024-02-28T16:24:45.573 INFO:tasks.workunit.client.1.smithi153.stdout:8/734: dwrite d0/d12/d67/d88/ff9 [0,4194304] 0 2024-02-28T16:24:45.574 INFO:tasks.workunit.client.1.smithi153.stdout:8/735: stat d0/d34/f3d 0 2024-02-28T16:24:45.575 INFO:tasks.workunit.client.1.smithi153.stdout:1/689: unlink d0/d62/dd2/cd7 0 2024-02-28T16:24:45.575 INFO:tasks.workunit.client.1.smithi153.stdout:9/682: readlink d1/d5/l7 0 2024-02-28T16:24:45.577 INFO:tasks.workunit.client.1.smithi153.stdout:5/721: creat da/dd/d25/d41/fee x:0 0 0 2024-02-28T16:24:45.582 INFO:tasks.workunit.client.1.smithi153.stdout:4/636: rmdir d4/d53/d7c/db3 39 2024-02-28T16:24:45.591 INFO:tasks.workunit.client.1.smithi153.stdout:1/690: rmdir d0/dd/db2/d89/daa 39 2024-02-28T16:24:45.592 INFO:tasks.workunit.client.1.smithi153.stdout:1/691: dread - d0/fdc zero size 2024-02-28T16:24:45.593 INFO:tasks.workunit.client.1.smithi153.stdout:6/739: creat d0/f107 x:0 0 0 2024-02-28T16:24:45.597 INFO:tasks.workunit.client.1.smithi153.stdout:6/740: chown d0/d1d/d33/d9c/d48/d63/d8c/dd1/ff8 2672765 1 2024-02-28T16:24:45.599 INFO:tasks.workunit.client.1.smithi153.stdout:6/741: truncate d0/d1d/d30/d71/fe8 710115 0 2024-02-28T16:24:45.600 INFO:tasks.workunit.client.1.smithi153.stdout:1/692: creat d0/d3d/d4a/ff7 x:0 0 0 2024-02-28T16:24:45.602 INFO:tasks.workunit.client.1.smithi153.stdout:3/704: link d4/d7d/d41/l40 d4/d8/d1e/d2a/lf8 0 2024-02-28T16:24:45.603 INFO:tasks.workunit.client.1.smithi153.stdout:6/742: mkdir d0/d1d/d33/d108 0 2024-02-28T16:24:45.604 INFO:tasks.workunit.client.1.smithi153.stdout:5/722: truncate da/dd/d25/d82/d8f/fa9 222245 0 2024-02-28T16:24:45.606 INFO:tasks.workunit.client.1.smithi153.stdout:3/705: write d4/d8/f1c [2275112,115763] 0 2024-02-28T16:24:45.607 INFO:tasks.workunit.client.1.smithi153.stdout:7/723: write d1/d25/d27/d7c/dc4/d63/d75/f99 [543456,16625] 0 2024-02-28T16:24:45.609 INFO:tasks.workunit.client.1.smithi153.stdout:3/706: readlink d4/d49/l7f 0 2024-02-28T16:24:45.612 INFO:tasks.workunit.client.1.smithi153.stdout:6/743: dread - d0/d1d/d30/d71/f84 zero size 2024-02-28T16:24:45.615 INFO:tasks.workunit.client.1.smithi153.stdout:9/683: dwrite d1/d74/d80/da8/fd3 [0,4194304] 0 2024-02-28T16:24:45.616 INFO:tasks.workunit.client.1.smithi153.stdout:4/637: dread d4/f6 [0,4194304] 0 2024-02-28T16:24:45.620 INFO:tasks.workunit.client.1.smithi153.stdout:6/744: write d0/d1d/d33/d9c/d68/dcb/fd3 [1302547,104347] 0 2024-02-28T16:24:45.621 INFO:tasks.workunit.client.1.smithi153.stdout:5/723: link da/dd/d25/d8a/fae da/dd/d25/d82/fef 0 2024-02-28T16:24:45.623 INFO:tasks.workunit.client.1.smithi153.stdout:4/638: read f0 [3219299,123785] 0 2024-02-28T16:24:45.624 INFO:tasks.workunit.client.1.smithi153.stdout:8/736: dwrite d0/f66 [0,4194304] 0 2024-02-28T16:24:45.628 INFO:tasks.workunit.client.1.smithi153.stdout:2/729: sync 2024-02-28T16:24:45.632 INFO:tasks.workunit.client.1.smithi153.stdout:6/745: fdatasync d0/f19 0 2024-02-28T16:24:45.635 INFO:tasks.workunit.client.1.smithi153.stdout:5/724: stat da/dd/d25/d8a/dac/dc6/le4 0 2024-02-28T16:24:45.639 INFO:tasks.workunit.client.1.smithi153.stdout:2/730: fsync d2/d19/d2a/f47 0 2024-02-28T16:24:45.644 INFO:tasks.workunit.client.1.smithi153.stdout:7/724: dwrite d1/d25/df/d26/d3a/fef [0,4194304] 0 2024-02-28T16:24:45.646 INFO:tasks.workunit.client.1.smithi153.stdout:2/731: creat d2/d19/d31/fec x:0 0 0 2024-02-28T16:24:45.648 INFO:tasks.workunit.client.1.smithi153.stdout:7/725: read d1/d70/dbf/fc5 [346275,115680] 0 2024-02-28T16:24:45.655 INFO:tasks.workunit.client.1.smithi153.stdout:2/732: symlink d2/d19/d3e/db0/led 0 2024-02-28T16:24:45.661 INFO:tasks.workunit.client.1.smithi153.stdout:7/726: creat d1/d25/dc/d7e/d91/ff5 x:0 0 0 2024-02-28T16:24:45.666 INFO:tasks.workunit.client.1.smithi153.stdout:8/737: dread d0/d19/d2b/d2d/d3f/d9f/dcc/f90 [0,4194304] 0 2024-02-28T16:24:45.666 INFO:tasks.workunit.client.1.smithi153.stdout:2/733: fsync d2/d19/d2a/f30 0 2024-02-28T16:24:45.667 INFO:tasks.workunit.client.1.smithi153.stdout:2/734: stat d2/d19/d2a/d3b/d5e/lc5 0 2024-02-28T16:24:45.668 INFO:tasks.workunit.client.1.smithi153.stdout:9/684: dread d1/d74/d80/da8/f46 [0,4194304] 0 2024-02-28T16:24:45.668 INFO:tasks.workunit.client.1.smithi153.stdout:7/727: creat d1/d25/df/d60/ff6 x:0 0 0 2024-02-28T16:24:45.673 INFO:tasks.workunit.client.1.smithi153.stdout:5/725: write da/dd/d25/d82/d8f/f98 [768877,69740] 0 2024-02-28T16:24:45.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:45 smithi023 ceph-mon[29137]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:24:45.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:45 smithi023 ceph-mon[29137]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:24:45.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:45 smithi023 ceph-mon[29137]: pgmap v12: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 53 MiB/s rd, 198 MiB/s wr, 423 op/s 2024-02-28T16:24:45.677 INFO:tasks.workunit.client.1.smithi153.stdout:7/728: chown d1/d25/d27/d7c/dc4/d63/d75/ld9 1 1 2024-02-28T16:24:45.677 INFO:tasks.workunit.client.1.smithi153.stdout:4/639: dread d4/de/d13/f2c [0,4194304] 0 2024-02-28T16:24:45.677 INFO:tasks.workunit.client.1.smithi153.stdout:9/685: mkdir d1/d5/d11/d1f/d20/de3 0 2024-02-28T16:24:45.678 INFO:tasks.workunit.client.1.smithi153.stdout:6/746: dwrite d0/d1d/d30/f58 [0,4194304] 0 2024-02-28T16:24:45.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/726: mkdir da/dd/d54/db0/df0 0 2024-02-28T16:24:45.681 INFO:tasks.workunit.client.1.smithi153.stdout:7/729: write d1/d25/dc/d50/d66/fc7 [1771498,38197] 0 2024-02-28T16:24:45.682 INFO:tasks.workunit.client.1.smithi153.stdout:8/738: truncate d0/d19/d2b/f72 1055656 0 2024-02-28T16:24:45.684 INFO:tasks.workunit.client.1.smithi153.stdout:7/730: read d1/d25/fe [833920,32408] 0 2024-02-28T16:24:45.685 INFO:tasks.workunit.client.1.smithi153.stdout:9/686: symlink d1/d5/d11/d1f/d43/d76/le4 0 2024-02-28T16:24:45.689 INFO:tasks.workunit.client.1.smithi153.stdout:9/687: readlink d1/d5/d11/d1f/d20/d99/l9b 0 2024-02-28T16:24:45.691 INFO:tasks.workunit.client.1.smithi153.stdout:2/735: dwrite d2/f10 [0,4194304] 0 2024-02-28T16:24:45.695 INFO:tasks.workunit.client.1.smithi153.stdout:5/727: truncate da/dd/d25/fab 844432 0 2024-02-28T16:24:45.699 INFO:tasks.workunit.client.1.smithi153.stdout:2/736: truncate d2/d19/d2a/d3b/f68 1470343 0 2024-02-28T16:24:45.701 INFO:tasks.workunit.client.1.smithi153.stdout:4/640: dwrite d4/de/d40/d4d/f5d [0,4194304] 0 2024-02-28T16:24:45.701 INFO:tasks.workunit.client.1.smithi153.stdout:6/747: rename d0/d1d/d33/d9c/d48/d63/d8c/dc3/fde to d0/d1d/d33/d9c/d2e/f109 0 2024-02-28T16:24:45.709 INFO:tasks.workunit.client.1.smithi153.stdout:4/641: unlink d4/de/f16 0 2024-02-28T16:24:45.711 INFO:tasks.workunit.client.1.smithi153.stdout:6/748: rmdir d0/d1d/d33/db2 39 2024-02-28T16:24:45.714 INFO:tasks.workunit.client.1.smithi153.stdout:8/739: rmdir d0/d19/d2b/d2d/d108 0 2024-02-28T16:24:45.715 INFO:tasks.workunit.client.1.smithi153.stdout:9/688: link d1/d5/d11/d29/f98 d1/d5/d11/d1f/d20/d5d/fe5 0 2024-02-28T16:24:45.722 INFO:tasks.workunit.client.1.smithi153.stdout:4/642: rename d4/de/d23/d2b/d4b/f87 to d4/de/d23/d2b/d4b/dba/d50/daf/fcb 0 2024-02-28T16:24:45.722 INFO:tasks.workunit.client.1.smithi153.stdout:4/643: chown d4/db9 1 1 2024-02-28T16:24:45.727 INFO:tasks.workunit.client.1.smithi153.stdout:2/737: creat d2/d25/fee x:0 0 0 2024-02-28T16:24:45.729 INFO:tasks.workunit.client.1.smithi153.stdout:6/749: rename d0/d1d/d33/d9c/d48/l50 to d0/d1d/d30/d71/d91/l10a 0 2024-02-28T16:24:45.733 INFO:tasks.workunit.client.1.smithi153.stdout:8/740: truncate d0/d19/d2b/f72 1127263 0 2024-02-28T16:24:45.735 INFO:tasks.workunit.client.1.smithi153.stdout:5/728: getdents da/dd/d54 0 2024-02-28T16:24:45.739 INFO:tasks.workunit.client.1.smithi153.stdout:2/738: mknod d2/d4b/cef 0 2024-02-28T16:24:45.739 INFO:tasks.workunit.client.1.smithi153.stdout:9/689: dwrite d1/d74/d80/da8/f25 [0,4194304] 0 2024-02-28T16:24:45.743 INFO:tasks.workunit.client.1.smithi153.stdout:2/739: truncate d2/d23/d88/fd6 914170 0 2024-02-28T16:24:45.747 INFO:tasks.workunit.client.1.smithi153.stdout:5/729: creat da/de1/ff1 x:0 0 0 2024-02-28T16:24:45.749 INFO:tasks.workunit.client.1.smithi153.stdout:4/644: creat d4/de/d40/fcc x:0 0 0 2024-02-28T16:24:45.749 INFO:tasks.workunit.client.1.smithi153.stdout:7/731: dread d1/d25/f9 [0,4194304] 0 2024-02-28T16:24:45.749 INFO:tasks.workunit.client.1.smithi153.stdout:8/741: dwrite d0/d19/d1e/f40 [0,4194304] 0 2024-02-28T16:24:45.750 INFO:tasks.workunit.client.1.smithi153.stdout:4/645: chown d4/f15 5328535 1 2024-02-28T16:24:45.755 INFO:tasks.workunit.client.1.smithi153.stdout:2/740: rmdir d2/d19/d2a/d3b/d87 39 2024-02-28T16:24:45.758 INFO:tasks.workunit.client.1.smithi153.stdout:2/741: fsync d2/d23/d88/dbf/fe3 0 2024-02-28T16:24:45.765 INFO:tasks.workunit.client.1.smithi153.stdout:5/730: dwrite da/d29/d43/fa2 [0,4194304] 0 2024-02-28T16:24:45.773 INFO:tasks.workunit.client.1.smithi153.stdout:2/742: rmdir d2/d19/d2a/d3b 39 2024-02-28T16:24:45.776 INFO:tasks.workunit.client.1.smithi153.stdout:4/646: link d4/de/d13/c1d d4/d53/ccd 0 2024-02-28T16:24:45.779 INFO:tasks.workunit.client.1.smithi153.stdout:5/731: creat da/d29/d43/de6/ff2 x:0 0 0 2024-02-28T16:24:45.779 INFO:tasks.workunit.client.1.smithi153.stdout:9/690: dread d1/d2a/f42 [0,4194304] 0 2024-02-28T16:24:45.780 INFO:tasks.workunit.client.1.smithi153.stdout:7/732: getdents d1/d25/d27 0 2024-02-28T16:24:45.781 INFO:tasks.workunit.client.1.smithi153.stdout:8/742: getdents d0/d19/d2b/d2d/d3f/d9f/dcc 0 2024-02-28T16:24:45.785 INFO:tasks.workunit.client.1.smithi153.stdout:4/647: creat d4/d53/d7c/db3/fce x:0 0 0 2024-02-28T16:24:45.786 INFO:tasks.workunit.client.1.smithi153.stdout:5/732: mkdir da/dd/d25/d41/dda/df3 0 2024-02-28T16:24:45.787 INFO:tasks.workunit.client.1.smithi153.stdout:7/733: rmdir d1/d25/df/d5a/de6 39 2024-02-28T16:24:45.791 INFO:tasks.workunit.client.1.smithi153.stdout:7/734: creat d1/d25/d27/d7c/ff7 x:0 0 0 2024-02-28T16:24:45.792 INFO:tasks.workunit.client.1.smithi153.stdout:0/724: sync 2024-02-28T16:24:45.793 INFO:tasks.workunit.client.1.smithi153.stdout:8/743: dread d0/d34/fcf [0,4194304] 0 2024-02-28T16:24:45.794 INFO:tasks.workunit.client.1.smithi153.stdout:7/735: write d1/d25/df/f8f [359417,97770] 0 2024-02-28T16:24:45.795 INFO:tasks.workunit.client.1.smithi153.stdout:0/725: readlink d4/d32/l50 0 2024-02-28T16:24:45.796 INFO:tasks.workunit.client.1.smithi153.stdout:5/733: creat da/d29/d43/d5a/dbe/de7/ff4 x:0 0 0 2024-02-28T16:24:45.797 INFO:tasks.workunit.client.1.smithi153.stdout:8/744: dread - d0/d19/d2b/d2d/d3f/d9f/fb0 zero size 2024-02-28T16:24:45.799 INFO:tasks.workunit.client.1.smithi153.stdout:5/734: write da/dd/f31 [2975056,118944] 0 2024-02-28T16:24:45.800 INFO:tasks.workunit.client.1.smithi153.stdout:7/736: truncate d1/d25/df/d60/ff6 143729 0 2024-02-28T16:24:45.801 INFO:tasks.workunit.client.1.smithi153.stdout:9/691: write d1/d74/d80/da8/f3d [1232718,20465] 0 2024-02-28T16:24:45.803 INFO:tasks.workunit.client.1.smithi153.stdout:8/745: mkdir d0/d19/d2b/d2d/d3f/d10a 0 2024-02-28T16:24:45.805 INFO:tasks.workunit.client.1.smithi153.stdout:8/746: fdatasync d0/d19/d2b/f54 0 2024-02-28T16:24:45.806 INFO:tasks.workunit.client.1.smithi153.stdout:5/735: creat da/dd/dd1/ff5 x:0 0 0 2024-02-28T16:24:45.807 INFO:tasks.workunit.client.1.smithi153.stdout:0/726: write d4/d32/d7f/d8a/fa0 [1000672,92606] 0 2024-02-28T16:24:45.809 INFO:tasks.workunit.client.1.smithi153.stdout:8/747: fsync d0/d19/f38 0 2024-02-28T16:24:45.810 INFO:tasks.workunit.client.1.smithi153.stdout:7/737: symlink d1/d25/df/d26/d3a/lf8 0 2024-02-28T16:24:45.812 INFO:tasks.workunit.client.1.smithi153.stdout:5/736: read da/d29/d43/d5a/dbe/fc9 [9851,102234] 0 2024-02-28T16:24:45.814 INFO:tasks.workunit.client.1.smithi153.stdout:7/738: fdatasync d1/d25/df/d26/f57 0 2024-02-28T16:24:45.814 INFO:tasks.workunit.client.1.smithi153.stdout:9/692: write d1/d5/d11/d29/f98 [2434121,56727] 0 2024-02-28T16:24:45.819 INFO:tasks.workunit.client.1.smithi153.stdout:7/739: rmdir d1/d25/df/d8a 39 2024-02-28T16:24:45.819 INFO:tasks.workunit.client.1.smithi153.stdout:4/648: dread d4/de/d23/f3a [0,4194304] 0 2024-02-28T16:24:45.821 INFO:tasks.workunit.client.1.smithi153.stdout:9/693: readlink d1/d74/d80/da8/l77 0 2024-02-28T16:24:45.824 INFO:tasks.workunit.client.1.smithi153.stdout:7/740: truncate d1/d25/dc/fe1 437833 0 2024-02-28T16:24:45.825 INFO:tasks.workunit.client.1.smithi153.stdout:9/694: write d1/d5/d27/f8e [1466474,5518] 0 2024-02-28T16:24:45.826 INFO:tasks.workunit.client.1.smithi153.stdout:4/649: stat d4/de/d23/d2b/c4c 0 2024-02-28T16:24:45.833 INFO:tasks.workunit.client.1.smithi153.stdout:8/748: dwrite d0/d12/d67/d88/d85/db6/ff4 [0,4194304] 0 2024-02-28T16:24:45.836 INFO:tasks.workunit.client.1.smithi153.stdout:0/727: dread d4/d89/f92 [0,4194304] 0 2024-02-28T16:24:45.837 INFO:tasks.workunit.client.1.smithi153.stdout:7/741: creat d1/d25/df/d26/d3a/d5e/dc8/ff9 x:0 0 0 2024-02-28T16:24:45.839 INFO:tasks.workunit.client.1.smithi153.stdout:7/742: write d1/f23 [3574740,100013] 0 2024-02-28T16:24:45.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/749: symlink d0/d12/d15/dab/l10b 0 2024-02-28T16:24:45.841 INFO:tasks.workunit.client.1.smithi153.stdout:4/650: creat d4/de/d23/fcf x:0 0 0 2024-02-28T16:24:45.843 INFO:tasks.workunit.client.1.smithi153.stdout:9/695: rename d1/d74/d80/fc8 to d1/fe6 0 2024-02-28T16:24:45.845 INFO:tasks.workunit.client.1.smithi153.stdout:0/728: dread d4/d9b/fa7 [0,4194304] 0 2024-02-28T16:24:45.848 INFO:tasks.workunit.client.1.smithi153.stdout:7/743: unlink d1/l2f 0 2024-02-28T16:24:45.849 INFO:tasks.workunit.client.1.smithi153.stdout:5/737: dread da/dd/d25/d82/fa0 [0,4194304] 0 2024-02-28T16:24:45.850 INFO:tasks.workunit.client.1.smithi153.stdout:7/744: write d1/d25/df/d26/f92 [1798453,96150] 0 2024-02-28T16:24:45.851 INFO:tasks.workunit.client.1.smithi153.stdout:5/738: write da/fb [4768456,29721] 0 2024-02-28T16:24:45.855 INFO:tasks.workunit.client.1.smithi153.stdout:5/739: chown da/d29/d43/d5a/fbd 42095 1 2024-02-28T16:24:45.856 INFO:tasks.workunit.client.1.smithi153.stdout:5/740: chown da/de1/de9 404330 1 2024-02-28T16:24:45.856 INFO:tasks.workunit.client.1.smithi153.stdout:9/696: rename d1/d7e/fb7 to d1/d5/d27/dd6/fe7 0 2024-02-28T16:24:45.866 INFO:tasks.workunit.client.1.smithi153.stdout:5/741: unlink da/dd/d25/d8a/ca8 0 2024-02-28T16:24:45.867 INFO:tasks.workunit.client.1.smithi153.stdout:0/729: dread d4/d27/d9a/da1/f7a [0,4194304] 0 2024-02-28T16:24:45.868 INFO:tasks.workunit.client.1.smithi153.stdout:8/750: write d0/d19/d2b/f61 [328868,34829] 0 2024-02-28T16:24:45.869 INFO:tasks.workunit.client.1.smithi153.stdout:5/742: chown da/dd/d25/f36 278 1 2024-02-28T16:24:45.869 INFO:tasks.workunit.client.1.smithi153.stdout:9/697: unlink d1/d5/d11/d1f/d20/d5d/fb9 0 2024-02-28T16:24:45.873 INFO:tasks.workunit.client.1.smithi153.stdout:0/730: unlink d4/d27/dc1/fe9 0 2024-02-28T16:24:45.875 INFO:tasks.workunit.client.1.smithi153.stdout:0/731: write d4/f78 [456594,43440] 0 2024-02-28T16:24:45.877 INFO:tasks.workunit.client.1.smithi153.stdout:4/651: dwrite d4/f38 [4194304,4194304] 0 2024-02-28T16:24:45.878 INFO:tasks.workunit.client.1.smithi153.stdout:5/743: mknod da/dd/d25/d8a/cf6 0 2024-02-28T16:24:45.879 INFO:tasks.workunit.client.1.smithi153.stdout:5/744: fdatasync da/d29/d43/d5a/d77/dd6/fec 0 2024-02-28T16:24:45.882 INFO:tasks.workunit.client.1.smithi153.stdout:7/745: dread d1/d25/df/d26/d3a/d95/fb6 [0,4194304] 0 2024-02-28T16:24:45.882 INFO:tasks.workunit.client.1.smithi153.stdout:8/751: mkdir d0/d10c 0 2024-02-28T16:24:45.888 INFO:tasks.workunit.client.1.smithi153.stdout:0/732: write d4/d9b/fa7 [356191,39697] 0 2024-02-28T16:24:45.890 INFO:tasks.workunit.client.1.smithi153.stdout:0/733: chown d4/lcd 0 1 2024-02-28T16:24:45.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/693: sync 2024-02-28T16:24:45.890 INFO:tasks.workunit.client.1.smithi153.stdout:3/707: sync 2024-02-28T16:24:45.891 INFO:tasks.workunit.client.1.smithi153.stdout:9/698: getdents d1/d5/d11/d1f/d62/dca 0 2024-02-28T16:24:45.893 INFO:tasks.workunit.client.1.smithi153.stdout:0/734: chown d4/d32/d7f/d8a/dab/c81 150 1 2024-02-28T16:24:45.895 INFO:tasks.workunit.client.1.smithi153.stdout:7/746: creat d1/d25/d27/d7c/db5/ffa x:0 0 0 2024-02-28T16:24:45.898 INFO:tasks.workunit.client.1.smithi153.stdout:3/708: creat d4/d8/d1e/d2a/d91/ff9 x:0 0 0 2024-02-28T16:24:45.898 INFO:tasks.workunit.client.1.smithi153.stdout:0/735: mknod d4/d89/cf7 0 2024-02-28T16:24:45.900 INFO:tasks.workunit.client.1.smithi153.stdout:9/699: link d1/d5/f7a d1/d69/fe8 0 2024-02-28T16:24:45.902 INFO:tasks.workunit.client.1.smithi153.stdout:7/747: symlink d1/d25/df/d5a/de6/lfb 0 2024-02-28T16:24:45.902 INFO:tasks.workunit.client.1.smithi153.stdout:9/700: write d1/d5/d11/d64/f84 [507363,81237] 0 2024-02-28T16:24:45.905 INFO:tasks.workunit.client.1.smithi153.stdout:1/694: dread d0/d3d/fa6 [0,4194304] 0 2024-02-28T16:24:45.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/652: truncate d4/de/f12 400577 0 2024-02-28T16:24:45.911 INFO:tasks.workunit.client.1.smithi153.stdout:8/752: dwrite d0/d12/d15/fed [4194304,4194304] 0 2024-02-28T16:24:45.918 INFO:tasks.workunit.client.1.smithi153.stdout:5/745: dwrite da/dd/d25/f32 [0,4194304] 0 2024-02-28T16:24:45.924 INFO:tasks.workunit.client.1.smithi153.stdout:5/746: fdatasync da/dd/d25/d82/fa0 0 2024-02-28T16:24:45.928 INFO:tasks.workunit.client.1.smithi153.stdout:7/748: dwrite d1/d25/f33 [4194304,4194304] 0 2024-02-28T16:24:45.931 INFO:tasks.workunit.client.1.smithi153.stdout:7/749: dread - d1/d25/d27/d7c/ff7 zero size 2024-02-28T16:24:45.933 INFO:tasks.workunit.client.1.smithi153.stdout:3/709: dread d4/d13/f3f [0,4194304] 0 2024-02-28T16:24:45.936 INFO:tasks.workunit.client.1.smithi153.stdout:8/753: fsync d0/d12/d15/fed 0 2024-02-28T16:24:45.937 INFO:tasks.workunit.client.1.smithi153.stdout:5/747: mknod da/dd/dd1/ddd/cf7 0 2024-02-28T16:24:45.937 INFO:tasks.workunit.client.1.smithi153.stdout:9/701: dwrite d1/d5/fb [0,4194304] 0 2024-02-28T16:24:45.938 INFO:tasks.workunit.client.1.smithi153.stdout:7/750: symlink d1/d70/dbf/lfc 0 2024-02-28T16:24:45.940 INFO:tasks.workunit.client.1.smithi153.stdout:4/653: dread d4/de/f12 [0,4194304] 0 2024-02-28T16:24:45.944 INFO:tasks.workunit.client.1.smithi153.stdout:3/710: fdatasync d4/d8/d1e/d23/f24 0 2024-02-28T16:24:45.947 INFO:tasks.workunit.client.1.smithi153.stdout:8/754: symlink d0/d12/d67/d88/d96/l10d 0 2024-02-28T16:24:45.952 INFO:tasks.workunit.client.1.smithi153.stdout:9/702: chown d1/d5/d11/d64/c7b 54 1 2024-02-28T16:24:45.953 INFO:tasks.workunit.client.1.smithi153.stdout:5/748: mknod da/dd/d54/d63/cf8 0 2024-02-28T16:24:45.954 INFO:tasks.workunit.client.1.smithi153.stdout:5/749: write da/dd/d54/db0/fbc [425953,41644] 0 2024-02-28T16:24:45.955 INFO:tasks.workunit.client.1.smithi153.stdout:7/751: dread d1/d25/df/d26/d3a/f98 [0,4194304] 0 2024-02-28T16:24:45.956 INFO:tasks.workunit.client.1.smithi153.stdout:3/711: symlink d4/d8/d1e/d63/lfa 0 2024-02-28T16:24:45.958 INFO:tasks.workunit.client.1.smithi153.stdout:9/703: fsync d1/d5/d27/dd6/fe7 0 2024-02-28T16:24:45.961 INFO:tasks.workunit.client.1.smithi153.stdout:5/750: symlink da/dd/d25/d8a/dac/lf9 0 2024-02-28T16:24:45.963 INFO:tasks.workunit.client.1.smithi153.stdout:9/704: stat d1/d5/d11/d29/f6e 0 2024-02-28T16:24:45.965 INFO:tasks.workunit.client.1.smithi153.stdout:5/751: fdatasync da/dd/f13 0 2024-02-28T16:24:45.967 INFO:tasks.workunit.client.1.smithi153.stdout:3/712: link d4/d8/d1e/d64/fad d4/d8/d1e/d63/ffb 0 2024-02-28T16:24:45.969 INFO:tasks.workunit.client.1.smithi153.stdout:8/755: dwrite d0/d12/d67/d88/d96/fef [0,4194304] 0 2024-02-28T16:24:45.971 INFO:tasks.workunit.client.1.smithi153.stdout:8/756: stat d0/c45 0 2024-02-28T16:24:45.973 INFO:tasks.workunit.client.1.smithi153.stdout:4/654: dwrite f0 [0,4194304] 0 2024-02-28T16:24:45.977 INFO:tasks.workunit.client.1.smithi153.stdout:5/752: mkdir da/dd/d54/db0/df0/dfa 0 2024-02-28T16:24:45.979 INFO:tasks.workunit.client.1.smithi153.stdout:4/655: chown d4/de/d23/d2b/d4b/da9 259 1 2024-02-28T16:24:45.979 INFO:tasks.workunit.client.1.smithi153.stdout:7/752: dwrite d1/d25/df/d26/d3a/d95/fb6 [0,4194304] 0 2024-02-28T16:24:45.981 INFO:tasks.workunit.client.1.smithi153.stdout:9/705: dread d1/fb0 [0,4194304] 0 2024-02-28T16:24:45.983 INFO:tasks.workunit.client.1.smithi153.stdout:3/713: dread d4/d2c/f9e [0,4194304] 0 2024-02-28T16:24:45.987 INFO:tasks.workunit.client.1.smithi153.stdout:5/753: rmdir da/dd/d25/d8a/dac/dc6 39 2024-02-28T16:24:45.989 INFO:tasks.workunit.client.1.smithi153.stdout:4/656: truncate d4/de/d23/d2b/d9b/faa 364401 0 2024-02-28T16:24:45.994 INFO:tasks.workunit.client.1.smithi153.stdout:5/754: unlink da/d29/d43/de6/ff2 0 2024-02-28T16:24:45.995 INFO:tasks.workunit.client.1.smithi153.stdout:8/757: dwrite d0/d19/f38 [0,4194304] 0 2024-02-28T16:24:45.999 INFO:tasks.workunit.client.1.smithi153.stdout:7/753: creat d1/d25/df/d5a/de6/de8/ffd x:0 0 0 2024-02-28T16:24:45.999 INFO:tasks.workunit.client.1.smithi153.stdout:2/743: sync 2024-02-28T16:24:45.999 INFO:tasks.workunit.client.1.smithi153.stdout:6/750: sync 2024-02-28T16:24:46.008 INFO:tasks.workunit.client.1.smithi153.stdout:9/706: write d1/d5/d11/d64/f86 [1588835,83282] 0 2024-02-28T16:24:46.010 INFO:tasks.workunit.client.1.smithi153.stdout:9/707: chown d1/d5/d11/d1f/d40/f8b 2 1 2024-02-28T16:24:46.016 INFO:tasks.workunit.client.1.smithi153.stdout:5/755: dread da/dd/d25/fab [0,4194304] 0 2024-02-28T16:24:46.016 INFO:tasks.workunit.client.1.smithi153.stdout:7/754: creat d1/d25/dc/d50/d66/da9/ffe x:0 0 0 2024-02-28T16:24:46.016 INFO:tasks.workunit.client.1.smithi153.stdout:7/755: dread - d1/d25/df/d5a/de6/de8/ffd zero size 2024-02-28T16:24:46.016 INFO:tasks.workunit.client.1.smithi153.stdout:3/714: rename d4/d13/d28/d36 to d4/dfc 0 2024-02-28T16:24:46.019 INFO:tasks.workunit.client.1.smithi153.stdout:6/751: fsync d0/d1d/d33/d9c/d2e/f37 0 2024-02-28T16:24:46.022 INFO:tasks.workunit.client.1.smithi153.stdout:5/756: mknod da/d29/d43/d5a/d77/cfb 0 2024-02-28T16:24:46.024 INFO:tasks.workunit.client.1.smithi153.stdout:8/758: creat d0/f10e x:0 0 0 2024-02-28T16:24:46.024 INFO:tasks.workunit.client.1.smithi153.stdout:9/708: dwrite d1/d69/f94 [0,4194304] 0 2024-02-28T16:24:46.028 INFO:tasks.workunit.client.1.smithi153.stdout:2/744: rename d2/d19/d2a to d2/d23/d48/df0 0 2024-02-28T16:24:46.030 INFO:tasks.workunit.client.1.smithi153.stdout:7/756: chown d1/d25/dc/f35 3263 1 2024-02-28T16:24:46.032 INFO:tasks.workunit.client.1.smithi153.stdout:4/657: link d4/de/d13/d1b/l91 d4/de/d47/d5e/d62/ld0 0 2024-02-28T16:24:46.037 INFO:tasks.workunit.client.1.smithi153.stdout:5/757: creat da/dd/d25/d8a/db3/ffc x:0 0 0 2024-02-28T16:24:46.038 INFO:tasks.workunit.client.1.smithi153.stdout:8/759: creat d0/d19/d2b/d2d/f10f x:0 0 0 2024-02-28T16:24:46.042 INFO:tasks.workunit.client.1.smithi153.stdout:9/709: creat d1/d5/d11/d1f/d43/d76/fe9 x:0 0 0 2024-02-28T16:24:46.043 INFO:tasks.workunit.client.1.smithi153.stdout:2/745: creat d2/d19/d3e/da7/ff1 x:0 0 0 2024-02-28T16:24:46.044 INFO:tasks.workunit.client.1.smithi153.stdout:0/736: sync 2024-02-28T16:24:46.046 INFO:tasks.workunit.client.1.smithi153.stdout:7/757: chown d1/d25/dc/c93 1751 1 2024-02-28T16:24:46.047 INFO:tasks.workunit.client.1.smithi153.stdout:4/658: dwrite d4/de/d23/d2b/d31/da2/da5/fc6 [0,4194304] 0 2024-02-28T16:24:46.047 INFO:tasks.workunit.client.1.smithi153.stdout:2/746: truncate d2/d19/d31/dd1/fd8 1022260 0 2024-02-28T16:24:46.049 INFO:tasks.workunit.client.1.smithi153.stdout:6/752: mknod d0/d1d/d33/d9c/d2e/d99/dab/c10b 0 2024-02-28T16:24:46.050 INFO:tasks.workunit.client.1.smithi153.stdout:7/758: write d1/d25/d27/d43/fed [901619,102444] 0 2024-02-28T16:24:46.050 INFO:tasks.workunit.client.1.smithi153.stdout:4/659: dread - d4/de/d23/d2b/d31/da2/fb1 zero size 2024-02-28T16:24:46.054 INFO:tasks.workunit.client.1.smithi153.stdout:7/759: truncate d1/d25/df/f8f 1236886 0 2024-02-28T16:24:46.054 INFO:tasks.workunit.client.1.smithi153.stdout:8/760: dread d0/d34/f3d [0,4194304] 0 2024-02-28T16:24:46.055 INFO:tasks.workunit.client.1.smithi153.stdout:7/760: stat d1/d25/df/d5a/de6/de8 0 2024-02-28T16:24:46.056 INFO:tasks.workunit.client.1.smithi153.stdout:3/715: link d4/d49/fac d4/d8/d1e/ffd 0 2024-02-28T16:24:46.057 INFO:tasks.workunit.client.1.smithi153.stdout:7/761: stat d1/d25/df/d60/da4/dee 0 2024-02-28T16:24:46.059 INFO:tasks.workunit.client.1.smithi153.stdout:7/762: stat d1/d25/d27/d7c/dc4/c53 0 2024-02-28T16:24:46.060 INFO:tasks.workunit.client.1.smithi153.stdout:6/753: mkdir d0/d1d/d30/d71/d10c 0 2024-02-28T16:24:46.066 INFO:tasks.workunit.client.1.smithi153.stdout:2/747: dwrite d2/d4b/fea [0,4194304] 0 2024-02-28T16:24:46.068 INFO:tasks.workunit.client.1.smithi153.stdout:3/716: rmdir d4/d8/d1e/dbb 39 2024-02-28T16:24:46.069 INFO:tasks.workunit.client.1.smithi153.stdout:3/717: chown d4/d2c 125635 1 2024-02-28T16:24:46.069 INFO:tasks.workunit.client.1.smithi153.stdout:2/748: truncate d2/d23/d88/fd2 829571 0 2024-02-28T16:24:46.078 INFO:tasks.workunit.client.1.smithi153.stdout:9/710: rmdir d1/d5/d11/d1f/d43/d76 39 2024-02-28T16:24:46.079 INFO:tasks.workunit.client.1.smithi153.stdout:5/758: getdents da/dd/d25/d41/d7c 0 2024-02-28T16:24:46.081 INFO:tasks.workunit.client.1.smithi153.stdout:5/759: write da/d29/d43/fd5 [547724,68006] 0 2024-02-28T16:24:46.082 INFO:tasks.workunit.client.1.smithi153.stdout:8/761: mknod d0/d12/d15/dab/dd0/de9/d100/c110 0 2024-02-28T16:24:46.086 INFO:tasks.workunit.client.1.smithi153.stdout:3/718: dread d4/dfc/f56 [0,4194304] 0 2024-02-28T16:24:46.087 INFO:tasks.workunit.client.1.smithi153.stdout:6/754: dwrite d0/d1d/d33/d9c/d2e/f42 [0,4194304] 0 2024-02-28T16:24:46.087 INFO:tasks.workunit.client.1.smithi153.stdout:2/749: mkdir d2/d86/df2 0 2024-02-28T16:24:46.093 INFO:tasks.workunit.client.1.smithi153.stdout:7/763: link d1/d25/dc/f64 d1/d25/df/d26/d3a/d81/fff 0 2024-02-28T16:24:46.099 INFO:tasks.workunit.client.1.smithi153.stdout:5/760: mknod da/dd/d54/cfd 0 2024-02-28T16:24:46.102 INFO:tasks.workunit.client.1.smithi153.stdout:8/762: rmdir d0/d12/d67/d30/d63/d74 39 2024-02-28T16:24:46.102 INFO:tasks.workunit.client.1.smithi153.stdout:5/761: write da/dd/d54/db0/fd7 [745366,5831] 0 2024-02-28T16:24:46.103 INFO:tasks.workunit.client.1.smithi153.stdout:8/763: stat d0/d12/d15/fd4 0 2024-02-28T16:24:46.105 INFO:tasks.workunit.client.1.smithi153.stdout:3/719: creat d4/d8/d1e/d64/ffe x:0 0 0 2024-02-28T16:24:46.105 INFO:tasks.workunit.client.1.smithi153.stdout:5/762: truncate da/dd/f31 4409026 0 2024-02-28T16:24:46.105 INFO:tasks.workunit.client.1.smithi153.stdout:0/737: write d4/fb9 [983451,71181] 0 2024-02-28T16:24:46.109 INFO:tasks.workunit.client.1.smithi153.stdout:8/764: chown d0/d12/d15/fd4 2341 1 2024-02-28T16:24:46.110 INFO:tasks.workunit.client.1.smithi153.stdout:9/711: rename d1/d69/fe8 to d1/d5/d11/d1f/d43/d76/fea 0 2024-02-28T16:24:46.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/755: mkdir d0/d1d/d33/d108/d10d 0 2024-02-28T16:24:46.112 INFO:tasks.workunit.client.1.smithi153.stdout:2/750: mkdir d2/d23/df3 0 2024-02-28T16:24:46.112 INFO:tasks.workunit.client.1.smithi153.stdout:2/751: stat d2 0 2024-02-28T16:24:46.115 INFO:tasks.workunit.client.1.smithi153.stdout:7/764: unlink d1/d25/df/d26/l40 0 2024-02-28T16:24:46.116 INFO:tasks.workunit.client.1.smithi153.stdout:3/720: creat d4/d8/d1e/d2a/d35/d54/fff x:0 0 0 2024-02-28T16:24:46.118 INFO:tasks.workunit.client.1.smithi153.stdout:4/660: write d4/de/d23/d2b/d9b/f89 [365774,38102] 0 2024-02-28T16:24:46.120 INFO:tasks.workunit.client.1.smithi153.stdout:8/765: mkdir d0/d19/d2b/d2d/d111 0 2024-02-28T16:24:46.121 INFO:tasks.workunit.client.1.smithi153.stdout:4/661: chown d4/de/d23/d2b/c9f 80876259 1 2024-02-28T16:24:46.122 INFO:tasks.workunit.client.1.smithi153.stdout:6/756: mknod d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/c10e 0 2024-02-28T16:24:46.124 INFO:tasks.workunit.client.1.smithi153.stdout:4/662: chown d4/f10 22122881 1 2024-02-28T16:24:46.128 INFO:tasks.workunit.client.1.smithi153.stdout:4/663: write f0 [721112,125726] 0 2024-02-28T16:24:46.128 INFO:tasks.workunit.client.1.smithi153.stdout:7/765: creat d1/d25/d27/d7c/dc4/d63/f100 x:0 0 0 2024-02-28T16:24:46.133 INFO:tasks.workunit.client.1.smithi153.stdout:4/664: chown d4/de/d23/d2b/d31/db4 0 1 2024-02-28T16:24:46.134 INFO:tasks.workunit.client.1.smithi153.stdout:5/763: link da/dd/d25/d41/fa4 da/ffe 0 2024-02-28T16:24:46.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/695: sync 2024-02-28T16:24:46.135 INFO:tasks.workunit.client.1.smithi153.stdout:3/721: mkdir d4/d13/d28/d100 0 2024-02-28T16:24:46.139 INFO:tasks.workunit.client.1.smithi153.stdout:8/766: creat d0/d12/d67/d30/d63/d74/f112 x:0 0 0 2024-02-28T16:24:46.145 INFO:tasks.workunit.client.1.smithi153.stdout:3/722: chown d4/d8/d1e/d2a/d35 54528 1 2024-02-28T16:24:46.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/696: chown d0/d62/d66/d8e/lbf 4 1 2024-02-28T16:24:46.147 INFO:tasks.workunit.client.1.smithi153.stdout:7/766: dread d1/d25/dc/d50/fe4 [0,4194304] 0 2024-02-28T16:24:46.153 INFO:tasks.workunit.client.1.smithi153.stdout:7/767: stat d1/d25/d27 0 2024-02-28T16:24:46.156 INFO:tasks.workunit.client.1.smithi153.stdout:9/712: dwrite d1/d5/f19 [0,4194304] 0 2024-02-28T16:24:46.156 INFO:tasks.workunit.client.1.smithi153.stdout:4/665: rename d4/de/f12 to d4/d53/d7c/fd1 0 2024-02-28T16:24:46.158 INFO:tasks.workunit.client.1.smithi153.stdout:6/757: dwrite d0/f107 [0,4194304] 0 2024-02-28T16:24:46.160 INFO:tasks.workunit.client.1.smithi153.stdout:4/666: write d4/d53/f76 [2247065,9816] 0 2024-02-28T16:24:46.161 INFO:tasks.workunit.client.1.smithi153.stdout:9/713: chown d1/f4e 1 1 2024-02-28T16:24:46.162 INFO:tasks.workunit.client.1.smithi153.stdout:8/767: symlink d0/d19/d2b/d2d/d3f/d9f/l113 0 2024-02-28T16:24:46.164 INFO:tasks.workunit.client.1.smithi153.stdout:9/714: fdatasync d1/d5/d11/d1f/d62/fd0 0 2024-02-28T16:24:46.164 INFO:tasks.workunit.client.1.smithi153.stdout:6/758: dread - d0/d1d/d33/d9c/d48/d63/d8c/dd1/ff8 zero size 2024-02-28T16:24:46.166 INFO:tasks.workunit.client.1.smithi153.stdout:3/723: creat d4/d13/d28/dcd/dda/f101 x:0 0 0 2024-02-28T16:24:46.168 INFO:tasks.workunit.client.1.smithi153.stdout:1/697: mkdir d0/dd/db2/d89/daa/df8 0 2024-02-28T16:24:46.171 INFO:tasks.workunit.client.1.smithi153.stdout:7/768: creat d1/d25/df/d26/d3a/d3f/f101 x:0 0 0 2024-02-28T16:24:46.173 INFO:tasks.workunit.client.1.smithi153.stdout:0/738: write d4/f45 [2027846,90513] 0 2024-02-28T16:24:46.177 INFO:tasks.workunit.client.1.smithi153.stdout:8/768: creat d0/d19/d2b/d2d/d3f/f114 x:0 0 0 2024-02-28T16:24:46.181 INFO:tasks.workunit.client.1.smithi153.stdout:7/769: truncate d1/d25/d27/d7c/dc4/d63/f100 7187 0 2024-02-28T16:24:46.183 INFO:tasks.workunit.client.1.smithi153.stdout:7/770: chown d1/d25/f33 4 1 2024-02-28T16:24:46.185 INFO:tasks.workunit.client.1.smithi153.stdout:9/715: creat d1/d5/d11/d1f/d20/d99/dae/feb x:0 0 0 2024-02-28T16:24:46.186 INFO:tasks.workunit.client.1.smithi153.stdout:7/771: fdatasync d1/d25/df/d26/f92 0 2024-02-28T16:24:46.188 INFO:tasks.workunit.client.1.smithi153.stdout:4/667: mknod d4/de/d13/cd2 0 2024-02-28T16:24:46.192 INFO:tasks.workunit.client.1.smithi153.stdout:5/764: rename da/d29/d43/d5a/d77/fc0 to da/dd/d25/fff 0 2024-02-28T16:24:46.192 INFO:tasks.workunit.client.1.smithi153.stdout:2/752: write d2/f67 [1640482,77199] 0 2024-02-28T16:24:46.195 INFO:tasks.workunit.client.1.smithi153.stdout:5/765: write da/dd/d54/d63/fa5 [1902437,25898] 0 2024-02-28T16:24:46.199 INFO:tasks.workunit.client.1.smithi153.stdout:5/766: read da/d29/f5b [3083284,13982] 0 2024-02-28T16:24:46.200 INFO:tasks.workunit.client.1.smithi153.stdout:9/716: dread d1/d5/d27/dd6/f95 [0,4194304] 0 2024-02-28T16:24:46.201 INFO:tasks.workunit.client.1.smithi153.stdout:7/772: mkdir d1/d25/df/d26/d3a/d5e/d72/d9c/d102 0 2024-02-28T16:24:46.211 INFO:tasks.workunit.client.1.smithi153.stdout:1/698: truncate d0/d62/d66/d8e/fa5 1789934 0 2024-02-28T16:24:46.211 INFO:tasks.workunit.client.1.smithi153.stdout:3/724: getdents d4/d8/d1e/d2a/d91 0 2024-02-28T16:24:46.214 INFO:tasks.workunit.client.1.smithi153.stdout:5/767: symlink da/dd/dd1/ddd/l100 0 2024-02-28T16:24:46.223 INFO:tasks.workunit.client.1.smithi153.stdout:0/739: dwrite d4/d32/d7f/d8a/dab/f21 [0,4194304] 0 2024-02-28T16:24:46.234 INFO:tasks.workunit.client.1.smithi153.stdout:5/768: dread da/fc [4194304,4194304] 0 2024-02-28T16:24:46.235 INFO:tasks.workunit.client.1.smithi153.stdout:5/769: chown da/dd/d54/c7d 1767273 1 2024-02-28T16:24:46.257 INFO:tasks.workunit.client.1.smithi153.stdout:8/769: rename d0/d12/c4c to d0/d12/d67/d30/c115 0 2024-02-28T16:24:46.258 INFO:tasks.workunit.client.1.smithi153.stdout:3/725: mkdir d4/d6a/d102 0 2024-02-28T16:24:46.259 INFO:tasks.workunit.client.1.smithi153.stdout:2/753: mknod d2/d23/d48/df0/d3b/d87/da5/cf4 0 2024-02-28T16:24:46.260 INFO:tasks.workunit.client.1.smithi153.stdout:1/699: truncate d0/dd/db2/fb0 894603 0 2024-02-28T16:24:46.261 INFO:tasks.workunit.client.1.smithi153.stdout:1/700: chown d0/d62/d66/d7c/f82 8151021 1 2024-02-28T16:24:46.269 INFO:tasks.workunit.client.1.smithi153.stdout:4/668: rename d4/de/d47/d5e/d62/fad to d4/de/d23/d2b/d4b/dba/d50/daf/fd3 0 2024-02-28T16:24:46.270 INFO:tasks.workunit.client.1.smithi153.stdout:4/669: truncate d4/f5 1240570 0 2024-02-28T16:24:46.273 INFO:tasks.workunit.client.1.smithi153.stdout:2/754: mknod d2/d23/d36/cf5 0 2024-02-28T16:24:46.280 INFO:tasks.workunit.client.1.smithi153.stdout:9/717: rename d1/d5/d11/d1f/d43/d76/fe9 to d1/d5/d11/d29/d79/fec 0 2024-02-28T16:24:46.284 INFO:tasks.workunit.client.1.smithi153.stdout:8/770: mknod d0/d10c/c116 0 2024-02-28T16:24:46.286 INFO:tasks.workunit.client.1.smithi153.stdout:9/718: dread d1/d5/d11/dd4/dbe/fbf [0,4194304] 0 2024-02-28T16:24:46.287 INFO:tasks.workunit.client.1.smithi153.stdout:4/670: unlink d4/f32 0 2024-02-28T16:24:46.291 INFO:tasks.workunit.client.1.smithi153.stdout:6/759: sync 2024-02-28T16:24:46.295 INFO:tasks.workunit.client.1.smithi153.stdout:6/760: dread - d0/d1d/d33/d9c/d48/d72/fca zero size 2024-02-28T16:24:46.296 INFO:tasks.workunit.client.1.smithi153.stdout:2/755: read d2/d19/d5d/f84 [552003,3277] 0 2024-02-28T16:24:46.297 INFO:tasks.workunit.client.1.smithi153.stdout:7/773: link d1/d25/df/d26/d3a/d95/d97/dd0/lf1 d1/d25/df/d60/da4/l103 0 2024-02-28T16:24:46.298 INFO:tasks.workunit.client.1.smithi153.stdout:1/701: creat d0/dd/db2/d89/dad/dde/df5/ff9 x:0 0 0 2024-02-28T16:24:46.300 INFO:tasks.workunit.client.1.smithi153.stdout:9/719: dwrite d1/fd7 [0,4194304] 0 2024-02-28T16:24:46.302 INFO:tasks.workunit.client.1.smithi153.stdout:8/771: creat d0/d19/d2b/d2d/d3f/f117 x:0 0 0 2024-02-28T16:24:46.305 INFO:tasks.workunit.client.1.smithi153.stdout:4/671: mkdir d4/d53/d7c/da4/dd4 0 2024-02-28T16:24:46.307 INFO:tasks.workunit.client.1.smithi153.stdout:6/761: creat d0/d1d/d33/d9c/d48/d63/f10f x:0 0 0 2024-02-28T16:24:46.309 INFO:tasks.workunit.client.1.smithi153.stdout:6/762: stat d0/d17/l1b 0 2024-02-28T16:24:46.318 INFO:tasks.workunit.client.1.smithi153.stdout:8/772: dread d0/d19/f38 [0,4194304] 0 2024-02-28T16:24:46.318 INFO:tasks.workunit.client.1.smithi153.stdout:4/672: unlink d4/de/d23/d2b/d31/f34 0 2024-02-28T16:24:46.321 INFO:tasks.workunit.client.1.smithi153.stdout:5/770: write da/fc3 [7638894,91200] 0 2024-02-28T16:24:46.321 INFO:tasks.workunit.client.1.smithi153.stdout:4/673: fdatasync d4/de/d40/d4d/f94 0 2024-02-28T16:24:46.323 INFO:tasks.workunit.client.1.smithi153.stdout:3/726: write d4/d8/d1e/d2a/d35/f47 [985773,129893] 0 2024-02-28T16:24:46.326 INFO:tasks.workunit.client.1.smithi153.stdout:4/674: write d4/f15 [872759,52400] 0 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi153.stdout:2/756: link d2/c8 d2/d23/d48/df0/d3b/d87/da5/cf6 0 2024-02-28T16:24:46.330 INFO:tasks.workunit.client.1.smithi153.stdout:6/763: dread d0/d1d/d33/d9c/d68/da1/fc5 [0,4194304] 0 2024-02-28T16:24:46.333 INFO:tasks.workunit.client.1.smithi153.stdout:0/740: dwrite d4/d32/d7f/d8a/dab/f4b [0,4194304] 0 2024-02-28T16:24:46.333 INFO:tasks.workunit.client.1.smithi153.stdout:5/771: truncate da/d29/d43/d5a/dbe/de7/ff4 589558 0 2024-02-28T16:24:46.338 INFO:tasks.workunit.client.1.smithi153.stdout:9/720: dread d1/d5/d11/d1f/d40/f8b [0,4194304] 0 2024-02-28T16:24:46.344 INFO:tasks.workunit.client.1.smithi153.stdout:4/675: mkdir d4/de/d13/dd5 0 2024-02-28T16:24:46.345 INFO:tasks.workunit.client.1.smithi153.stdout:4/676: stat d4/de/d47/d5e/c75 0 2024-02-28T16:24:46.348 INFO:tasks.workunit.client.1.smithi153.stdout:0/741: rename d4/d32/c87 to d4/d27/dc1/cf8 0 2024-02-28T16:24:46.353 INFO:tasks.workunit.client.1.smithi153.stdout:4/677: rename d4/de/d23/d2b/d31/f64 to d4/de/d23/d2b/d31/da2/da5/db2/fd6 0 2024-02-28T16:24:46.356 INFO:tasks.workunit.client.1.smithi153.stdout:7/774: write d1/f6c [1303897,14286] 0 2024-02-28T16:24:46.357 INFO:tasks.workunit.client.1.smithi153.stdout:2/757: dread d2/d23/d36/f77 [0,4194304] 0 2024-02-28T16:24:46.357 INFO:tasks.workunit.client.1.smithi153.stdout:7/775: readlink d1/l18 0 2024-02-28T16:24:46.359 INFO:tasks.workunit.client.1.smithi153.stdout:7/776: write d1/d70/dbf/fc5 [4210143,116105] 0 2024-02-28T16:24:46.366 INFO:tasks.workunit.client.1.smithi153.stdout:2/758: creat d2/d86/da0/ff7 x:0 0 0 2024-02-28T16:24:46.369 INFO:tasks.workunit.client.1.smithi153.stdout:0/742: rmdir d4/d27 39 2024-02-28T16:24:46.375 INFO:tasks.workunit.client.1.smithi153.stdout:6/764: dread d0/d1d/d30/f36 [0,4194304] 0 2024-02-28T16:24:46.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/678: dwrite d4/de/d13/f84 [0,4194304] 0 2024-02-28T16:24:46.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/727: dwrite d4/d7d/f8c [8388608,4194304] 0 2024-02-28T16:24:46.384 INFO:tasks.workunit.client.1.smithi153.stdout:2/759: dwrite d2/d19/d3e/da7/ff1 [0,4194304] 0 2024-02-28T16:24:46.387 INFO:tasks.workunit.client.1.smithi153.stdout:3/728: mknod d4/d49/c103 0 2024-02-28T16:24:46.388 INFO:tasks.workunit.client.1.smithi153.stdout:4/679: mknod d4/de/d23/d2b/d4b/d80/cd7 0 2024-02-28T16:24:46.392 INFO:tasks.workunit.client.1.smithi153.stdout:0/743: dwrite d4/d27/dc1/fc9 [0,4194304] 0 2024-02-28T16:24:46.394 INFO:tasks.workunit.client.1.smithi153.stdout:3/729: creat d4/d7d/d41/d71/f104 x:0 0 0 2024-02-28T16:24:46.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/760: rename d2/d63 to d2/d23/d48/df0/d3b/d87/df8 0 2024-02-28T16:24:46.397 INFO:tasks.workunit.client.1.smithi153.stdout:3/730: readlink d4/d8/d1e/d2a/d55/da3/db1/lb6 0 2024-02-28T16:24:46.400 INFO:tasks.workunit.client.1.smithi153.stdout:3/731: read d4/f1f [1751189,124653] 0 2024-02-28T16:24:46.402 INFO:tasks.workunit.client.1.smithi153.stdout:2/761: mknod d2/d19/d3e/db9/cf9 0 2024-02-28T16:24:46.403 INFO:tasks.workunit.client.1.smithi153.stdout:6/765: dread d0/f18 [4194304,4194304] 0 2024-02-28T16:24:46.405 INFO:tasks.workunit.client.1.smithi153.stdout:0/744: symlink d4/d32/ded/lf9 0 2024-02-28T16:24:46.408 INFO:tasks.workunit.client.1.smithi153.stdout:3/732: mknod d4/c105 0 2024-02-28T16:24:46.413 INFO:tasks.workunit.client.1.smithi153.stdout:2/762: unlink d2/c8 0 2024-02-28T16:24:46.418 INFO:tasks.workunit.client.1.smithi153.stdout:3/733: creat d4/d8/d1e/d87/f106 x:0 0 0 2024-02-28T16:24:46.423 INFO:tasks.workunit.client.1.smithi153.stdout:6/766: dwrite d0/d1d/d30/d71/d91/fb1 [0,4194304] 0 2024-02-28T16:24:46.426 INFO:tasks.workunit.client.1.smithi153.stdout:2/763: truncate d2/d19/f2c 312121 0 2024-02-28T16:24:46.428 INFO:tasks.workunit.client.1.smithi153.stdout:0/745: dwrite d4/f53 [0,4194304] 0 2024-02-28T16:24:46.432 INFO:tasks.workunit.client.1.smithi153.stdout:0/746: mkdir d4/d99/dfa 0 2024-02-28T16:24:46.432 INFO:tasks.workunit.client.1.smithi153.stdout:2/764: symlink d2/d25/db4/dca/lfa 0 2024-02-28T16:24:46.434 INFO:tasks.workunit.client.1.smithi153.stdout:1/702: sync 2024-02-28T16:24:46.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/747: mkdir d4/d27/d9a/dfb 0 2024-02-28T16:24:46.440 INFO:tasks.workunit.client.1.smithi153.stdout:6/767: dread d0/f107 [0,4194304] 0 2024-02-28T16:24:46.443 INFO:tasks.workunit.client.1.smithi153.stdout:1/703: mknod d0/cfa 0 2024-02-28T16:24:46.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/768: read d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fc2 [11441,93281] 0 2024-02-28T16:24:46.457 INFO:tasks.workunit.client.1.smithi153.stdout:3/734: write d4/d8/d1e/d87/fef [1358607,788] 0 2024-02-28T16:24:46.458 INFO:tasks.workunit.client.1.smithi153.stdout:0/748: dwrite d4/d9b/fa7 [0,4194304] 0 2024-02-28T16:24:46.460 INFO:tasks.workunit.client.1.smithi153.stdout:4/680: dwrite d4/f10 [0,4194304] 0 2024-02-28T16:24:46.466 INFO:tasks.workunit.client.1.smithi153.stdout:2/765: dread d2/d23/d48/df0/d3b/d87/df8/fa9 [0,4194304] 0 2024-02-28T16:24:46.467 INFO:tasks.workunit.client.1.smithi153.stdout:6/769: link d0/d1d/d33/d9c/d48/d72/c83 d0/d1d/d33/d9c/d48/d72/c110 0 2024-02-28T16:24:46.468 INFO:tasks.workunit.client.1.smithi153.stdout:4/681: dread - d4/de/d23/d2b/d31/da2/fb1 zero size 2024-02-28T16:24:46.470 INFO:tasks.workunit.client.1.smithi153.stdout:3/735: creat d4/d8/d1e/d2a/d55/da3/db1/f107 x:0 0 0 2024-02-28T16:24:46.471 INFO:tasks.workunit.client.1.smithi153.stdout:0/749: creat d4/d32/d7f/d8a/dab/d8e/d94/ffc x:0 0 0 2024-02-28T16:24:46.471 INFO:tasks.workunit.client.1.smithi153.stdout:3/736: stat d4/f17 0 2024-02-28T16:24:46.472 INFO:tasks.workunit.client.1.smithi153.stdout:4/682: fsync d4/de/d23/d2b/f63 0 2024-02-28T16:24:46.477 INFO:tasks.workunit.client.1.smithi153.stdout:1/704: dwrite d0/f41 [0,4194304] 0 2024-02-28T16:24:46.481 INFO:tasks.workunit.client.1.smithi153.stdout:1/705: truncate d0/d3d/fa1 664486 0 2024-02-28T16:24:46.481 INFO:tasks.workunit.client.1.smithi153.stdout:4/683: rmdir d4/de/d23/d2b/d4b 39 2024-02-28T16:24:46.488 INFO:tasks.workunit.client.1.smithi153.stdout:2/766: mkdir d2/d23/d48/df0/d93/d9b/dfb 0 2024-02-28T16:24:46.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/737: dwrite d4/d8/d1e/d2a/d35/f5f [0,4194304] 0 2024-02-28T16:24:46.491 INFO:tasks.workunit.client.1.smithi153.stdout:3/738: dread - d4/d8/d1e/d23/fd6 zero size 2024-02-28T16:24:46.499 INFO:tasks.workunit.client.1.smithi153.stdout:3/739: dread d4/d13/d8f/fb9 [0,4194304] 0 2024-02-28T16:24:46.504 INFO:tasks.workunit.client.1.smithi153.stdout:4/684: chown d4/de/d23/d2b/d4b/d80/cd7 90782 1 2024-02-28T16:24:46.506 INFO:tasks.workunit.client.1.smithi153.stdout:2/767: dwrite d2/d19/d8b/f90 [4194304,4194304] 0 2024-02-28T16:24:46.507 INFO:tasks.workunit.client.1.smithi153.stdout:6/770: link d0/d1d/d33/db2/fcd d0/d1d/d33/d9c/d68/da2/dff/f111 0 2024-02-28T16:24:46.508 INFO:tasks.workunit.client.1.smithi153.stdout:6/771: fdatasync d0/d17/fe7 0 2024-02-28T16:24:46.510 INFO:tasks.workunit.client.1.smithi153.stdout:3/740: creat d4/d8/d1e/d87/f108 x:0 0 0 2024-02-28T16:24:46.512 INFO:tasks.workunit.client.1.smithi153.stdout:0/750: dread d4/d32/d7f/d8a/dab/d8e/d94/fdd [0,4194304] 0 2024-02-28T16:24:46.517 INFO:tasks.workunit.client.1.smithi153.stdout:2/768: truncate d2/d19/d31/f40 3519456 0 2024-02-28T16:24:46.518 INFO:tasks.workunit.client.1.smithi153.stdout:8/773: sync 2024-02-28T16:24:46.520 INFO:tasks.workunit.client.1.smithi153.stdout:0/751: creat d4/d99/da5/dd4/ffd x:0 0 0 2024-02-28T16:24:46.521 INFO:tasks.workunit.client.1.smithi153.stdout:3/741: mkdir d4/d109 0 2024-02-28T16:24:46.524 INFO:tasks.workunit.client.1.smithi153.stdout:2/769: symlink d2/d19/d3e/da7/db1/lfc 0 2024-02-28T16:24:46.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/752: fsync d4/d27/f73 0 2024-02-28T16:24:46.529 INFO:tasks.workunit.client.1.smithi153.stdout:1/706: write d0/dd/db2/d89/daa/fb4 [342554,61967] 0 2024-02-28T16:24:46.531 INFO:tasks.workunit.client.1.smithi153.stdout:0/753: write d4/d32/fba [3805281,9858] 0 2024-02-28T16:24:46.538 INFO:tasks.workunit.client.1.smithi153.stdout:1/707: truncate d0/d3d/f43 84560 0 2024-02-28T16:24:46.539 INFO:tasks.workunit.client.1.smithi153.stdout:2/770: dwrite d2/d19/d8b/dcf/fe7 [0,4194304] 0 2024-02-28T16:24:46.570 INFO:tasks.workunit.client.1.smithi153.stdout:8/774: write d0/f8 [1734542,123784] 0 2024-02-28T16:24:46.571 INFO:tasks.workunit.client.1.smithi153.stdout:0/754: mkdir d4/d32/df0/dfe 0 2024-02-28T16:24:46.573 INFO:tasks.workunit.client.1.smithi153.stdout:8/775: chown d0/d34/f8f 20704084 1 2024-02-28T16:24:46.578 INFO:tasks.workunit.client.1.smithi153.stdout:2/771: write d2/d25/d49/f97 [739128,23282] 0 2024-02-28T16:24:46.580 INFO:tasks.workunit.client.1.smithi153.stdout:0/755: getdents d4/d27/d9a/dfb 0 2024-02-28T16:24:46.580 INFO:tasks.workunit.client.1.smithi153.stdout:6/772: dwrite d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/d96/fbe [0,4194304] 0 2024-02-28T16:24:46.582 INFO:tasks.workunit.client.1.smithi153.stdout:8/776: rename d0/d10c/c116 to d0/d12/d67/d88/d96/c118 0 2024-02-28T16:24:46.584 INFO:tasks.workunit.client.1.smithi153.stdout:2/772: chown d2/d23/d48/df0/d3b/d87/df8/l70 3781 1 2024-02-28T16:24:46.588 INFO:tasks.workunit.client.1.smithi153.stdout:0/756: getdents d4/d32/dcf/df6 0 2024-02-28T16:24:46.590 INFO:tasks.workunit.client.1.smithi153.stdout:3/742: dread d4/d8/d1e/d2a/d35/d54/f82 [0,4194304] 0 2024-02-28T16:24:46.591 INFO:tasks.workunit.client.1.smithi153.stdout:1/708: dwrite d0/dd/f76 [4194304,4194304] 0 2024-02-28T16:24:46.594 INFO:tasks.workunit.client.1.smithi153.stdout:6/773: rename d0/d1d/d33/d9c/d68/da2/dff/f111 to d0/d1d/d33/d9c/d2e/d99/f112 0 2024-02-28T16:24:46.597 INFO:tasks.workunit.client.1.smithi153.stdout:5/772: sync 2024-02-28T16:24:46.600 INFO:tasks.workunit.client.1.smithi153.stdout:5/773: write da/dd/d25/d8a/f90 [1865023,80414] 0 2024-02-28T16:24:46.615 INFO:tasks.workunit.client.1.smithi153.stdout:5/774: dread da/f51 [4194304,4194304] 0 2024-02-28T16:24:46.616 INFO:tasks.workunit.client.1.smithi153.stdout:6/774: write d0/d1d/d30/d71/f87 [4973712,100521] 0 2024-02-28T16:24:46.618 INFO:tasks.workunit.client.1.smithi153.stdout:0/757: dwrite d4/d32/d7f/d8a/dab/f39 [0,4194304] 0 2024-02-28T16:24:46.620 INFO:tasks.workunit.client.1.smithi153.stdout:3/743: dread d4/d13/d28/fdc [0,4194304] 0 2024-02-28T16:24:46.622 INFO:tasks.workunit.client.1.smithi153.stdout:1/709: link d0/d62/d66/d8e/f97 d0/dd/db2/de5/de7/ffb 0 2024-02-28T16:24:46.624 INFO:tasks.workunit.client.1.smithi153.stdout:8/777: getdents d0/d12/d67/d88/d85 0 2024-02-28T16:24:46.625 INFO:tasks.workunit.client.1.smithi153.stdout:2/773: dwrite d2/d25/db4/dca/feb [0,4194304] 0 2024-02-28T16:24:46.627 INFO:tasks.workunit.client.1.smithi153.stdout:8/778: readlink d0/d34/l7d 0 2024-02-28T16:24:46.627 INFO:tasks.workunit.client.1.smithi153.stdout:3/744: creat d4/d13/d28/dcd/dda/f10a x:0 0 0 2024-02-28T16:24:46.627 INFO:tasks.workunit.client.1.smithi153.stdout:5/775: mknod da/dd/d25/dcb/c101 0 2024-02-28T16:24:46.627 INFO:tasks.workunit.client.1.smithi153.stdout:9/721: sync 2024-02-28T16:24:46.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/745: chown d4/d8/d1e/d2a/d55/da3 1747419602 1 2024-02-28T16:24:46.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/776: symlink da/dd/dd1/l102 0 2024-02-28T16:24:46.638 INFO:tasks.workunit.client.1.smithi153.stdout:1/710: mkdir d0/d3d/d4a/dd9/de1/dfc 0 2024-02-28T16:24:46.638 INFO:tasks.workunit.client.1.smithi153.stdout:9/722: symlink d1/d5/d11/d1f/d20/led 0 2024-02-28T16:24:46.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/746: symlink d4/d8/d1e/d2a/d55/da3/db1/l10b 0 2024-02-28T16:24:46.643 INFO:tasks.workunit.client.1.smithi153.stdout:3/747: fdatasync d4/d8/f1c 0 2024-02-28T16:24:46.646 INFO:tasks.workunit.client.1.smithi153.stdout:1/711: mknod d0/dd/dd5/cfd 0 2024-02-28T16:24:46.648 INFO:tasks.workunit.client.1.smithi153.stdout:2/774: dwrite d2/d25/d49/f97 [0,4194304] 0 2024-02-28T16:24:46.653 INFO:tasks.workunit.client.1.smithi153.stdout:8/779: link d0/d19/d2b/l2f d0/d19/d2b/d2d/d111/l119 0 2024-02-28T16:24:46.657 INFO:tasks.workunit.client.1.smithi153.stdout:9/723: truncate d1/d5/d11/dd4/dbe/fbf 1206671 0 2024-02-28T16:24:46.657 INFO:tasks.workunit.client.1.smithi153.stdout:2/775: mknod d2/d19/d31/cfd 0 2024-02-28T16:24:46.661 INFO:tasks.workunit.client.1.smithi153.stdout:8/780: stat d0/d12/d67/c82 0 2024-02-28T16:24:46.661 INFO:tasks.workunit.client.1.smithi153.stdout:3/748: mknod d4/d109/c10c 0 2024-02-28T16:24:46.661 INFO:tasks.workunit.client.1.smithi153.stdout:6/775: dwrite d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fc2 [0,4194304] 0 2024-02-28T16:24:46.664 INFO:tasks.workunit.client.1.smithi153.stdout:5/777: creat da/dd/d25/d8a/dac/f103 x:0 0 0 2024-02-28T16:24:46.665 INFO:tasks.workunit.client.1.smithi153.stdout:3/749: creat d4/d8/f10d x:0 0 0 2024-02-28T16:24:46.666 INFO:tasks.workunit.client.1.smithi153.stdout:0/758: dread d4/d99/da5/fb1 [0,4194304] 0 2024-02-28T16:24:46.666 INFO:tasks.workunit.client.1.smithi153.stdout:2/776: link d2/d25/d49/l9e d2/d23/d48/lfe 0 2024-02-28T16:24:46.669 INFO:tasks.workunit.client.1.smithi153.stdout:0/759: read d4/d32/d7f/d8a/dab/f1f [95053,73097] 0 2024-02-28T16:24:46.670 INFO:tasks.workunit.client.1.smithi153.stdout:8/781: rename d0/d12/d67/d30/d63/d74/lc2 to d0/d12/d15/dab/dd0/de9/d100/l11a 0 2024-02-28T16:24:46.672 INFO:tasks.workunit.client.1.smithi153.stdout:8/782: read d0/d12/d15/fed [8067260,125226] 0 2024-02-28T16:24:46.674 INFO:tasks.workunit.client.1.smithi153.stdout:3/750: rename d4/d8/d1e/d2a/d35/d54/la5 to d4/d6a/l10e 0 2024-02-28T16:24:46.677 INFO:tasks.workunit.client.1.smithi153.stdout:8/783: readlink d0/d19/d2b/d2d/d111/l119 0 2024-02-28T16:24:46.679 INFO:tasks.workunit.client.1.smithi153.stdout:5/778: rename da/dd/d25/f32 to da/dd/d25/d8a/dac/dc6/f104 0 2024-02-28T16:24:46.683 INFO:tasks.workunit.client.1.smithi153.stdout:3/751: symlink d4/d13/d28/d100/l10f 0 2024-02-28T16:24:46.685 INFO:tasks.workunit.client.1.smithi153.stdout:3/752: write d4/d2c/f7e [4395405,83413] 0 2024-02-28T16:24:46.686 INFO:tasks.workunit.client.1.smithi153.stdout:0/760: dwrite d4/d27/d9a/da1/fe8 [0,4194304] 0 2024-02-28T16:24:46.688 INFO:tasks.workunit.client.1.smithi153.stdout:8/784: symlink d0/l11b 0 2024-02-28T16:24:46.694 INFO:tasks.workunit.client.1.smithi153.stdout:8/785: mknod d0/d19/d1e/c11c 0 2024-02-28T16:24:46.696 INFO:tasks.workunit.client.1.smithi153.stdout:0/761: mkdir d4/d32/d7f/dd6/dff 0 2024-02-28T16:24:46.700 INFO:tasks.workunit.client.1.smithi153.stdout:8/786: mknod d0/d12/d67/d88/d8e/d9d/c11d 0 2024-02-28T16:24:46.701 INFO:tasks.workunit.client.1.smithi153.stdout:5/779: dwrite da/dd/d25/d8a/dac/dc6/f104 [0,4194304] 0 2024-02-28T16:24:46.705 INFO:tasks.workunit.client.1.smithi153.stdout:8/787: read d0/d12/d67/d30/f7a [1993803,55866] 0 2024-02-28T16:24:46.750 INFO:tasks.workunit.client.1.smithi153.stdout:7/777: sync 2024-02-28T16:24:46.750 INFO:tasks.workunit.client.1.smithi153.stdout:4/685: sync 2024-02-28T16:24:46.755 INFO:tasks.workunit.client.1.smithi153.stdout:0/762: rmdir d4/d32/d7f/d8a/dab/d8e/d90 39 2024-02-28T16:24:46.756 INFO:tasks.workunit.client.1.smithi153.stdout:5/780: read da/f73 [3765287,91050] 0 2024-02-28T16:24:46.756 INFO:tasks.workunit.client.1.smithi153.stdout:3/753: dwrite d4/d7d/d41/f4a [0,4194304] 0 2024-02-28T16:24:46.762 INFO:tasks.workunit.client.1.smithi153.stdout:5/781: dread - da/dd/d25/d8a/dac/dc7/fcc zero size 2024-02-28T16:24:46.762 INFO:tasks.workunit.client.1.smithi153.stdout:3/754: chown d4/d8/d1e/d23/ce3 181 1 2024-02-28T16:24:46.763 INFO:tasks.workunit.client.1.smithi153.stdout:8/788: chown d0/d12/d67/d30/d63/d74/db4/fe3 11 1 2024-02-28T16:24:46.764 INFO:tasks.workunit.client.1.smithi153.stdout:5/782: write da/d29/d43/fa2 [1902347,100191] 0 2024-02-28T16:24:46.770 INFO:tasks.workunit.client.1.smithi153.stdout:5/783: dread da/d29/f92 [0,4194304] 0 2024-02-28T16:24:46.773 INFO:tasks.workunit.client.1.smithi153.stdout:4/686: mknod d4/de/d23/d2b/d4b/d80/d9e/cd8 0 2024-02-28T16:24:46.774 INFO:tasks.workunit.client.1.smithi153.stdout:4/687: chown d4/de/d13/dd5 369951627 1 2024-02-28T16:24:46.777 INFO:tasks.workunit.client.1.smithi153.stdout:8/789: mkdir d0/d12/d15/dab/dd0/de9/d11e 0 2024-02-28T16:24:46.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/763: mknod d4/d32/db7/c100 0 2024-02-28T16:24:46.780 INFO:tasks.workunit.client.1.smithi153.stdout:7/778: creat d1/d25/df/d60/da4/dee/f104 x:0 0 0 2024-02-28T16:24:46.780 INFO:tasks.workunit.client.1.smithi153.stdout:0/764: chown d4/d32/dd9 0 1 2024-02-28T16:24:46.781 INFO:tasks.workunit.client.1.smithi153.stdout:7/779: fdatasync d1/d25/df/f61 0 2024-02-28T16:24:46.782 INFO:tasks.workunit.client.1.smithi153.stdout:4/688: mknod d4/de/d23/d2b/d31/cd9 0 2024-02-28T16:24:46.789 INFO:tasks.workunit.client.1.smithi153.stdout:5/784: dread da/dd/d25/d82/fef [0,4194304] 0 2024-02-28T16:24:46.790 INFO:tasks.workunit.client.1.smithi153.stdout:7/780: symlink d1/d25/df/d26/d3a/d5e/d72/l105 0 2024-02-28T16:24:46.791 INFO:tasks.workunit.client.1.smithi153.stdout:3/755: link d4/d8/d1e/d63/c78 d4/dfc/c110 0 2024-02-28T16:24:46.795 INFO:tasks.workunit.client.1.smithi153.stdout:3/756: write d4/d8/d1e/d64/ffe [712662,57774] 0 2024-02-28T16:24:46.796 INFO:tasks.workunit.client.1.smithi153.stdout:4/689: link d4/de/d23/d2b/d31/da2/da5/fc6 d4/d53/d7c/fda 0 2024-02-28T16:24:46.797 INFO:tasks.workunit.client.1.smithi153.stdout:8/790: write d0/d34/f68 [10171,120866] 0 2024-02-28T16:24:46.802 INFO:tasks.workunit.client.1.smithi153.stdout:0/765: dwrite d4/d27/dc1/fce [0,4194304] 0 2024-02-28T16:24:46.804 INFO:tasks.workunit.client.1.smithi153.stdout:8/791: unlink d0/f66 0 2024-02-28T16:24:46.805 INFO:tasks.workunit.client.1.smithi153.stdout:0/766: write d4/fa [2009922,61798] 0 2024-02-28T16:24:46.807 INFO:tasks.workunit.client.1.smithi153.stdout:4/690: write d4/de/d23/d2b/d31/da2/da5/fc6 [1760441,55905] 0 2024-02-28T16:24:46.809 INFO:tasks.workunit.client.1.smithi153.stdout:8/792: chown d0/d12/l8b 259676 1 2024-02-28T16:24:46.810 INFO:tasks.workunit.client.1.smithi153.stdout:3/757: creat d4/d8/d1e/dbb/f111 x:0 0 0 2024-02-28T16:24:46.812 INFO:tasks.workunit.client.1.smithi153.stdout:5/785: dwrite da/dd/d25/d82/d8f/f91 [0,4194304] 0 2024-02-28T16:24:46.814 INFO:tasks.workunit.client.1.smithi153.stdout:7/781: dwrite d1/d25/dc/d7e/d91/ff5 [0,4194304] 0 2024-02-28T16:24:46.814 INFO:tasks.workunit.client.1.smithi153.stdout:8/793: chown d0/d19/d2b/d2d/d3f/fbf 28778 1 2024-02-28T16:24:46.817 INFO:tasks.workunit.client.1.smithi153.stdout:4/691: readlink d4/de/d13/d1b/l7d 0 2024-02-28T16:24:46.822 INFO:tasks.workunit.client.1.smithi153.stdout:0/767: rename d4/d27/d9a/da1/db0 to d4/d27/d101 0 2024-02-28T16:24:46.834 INFO:tasks.workunit.client.1.smithi153.stdout:3/758: dwrite d4/d7d/f8c [4194304,4194304] 0 2024-02-28T16:24:46.834 INFO:tasks.workunit.client.1.smithi153.stdout:1/712: sync 2024-02-28T16:24:46.836 INFO:tasks.workunit.client.1.smithi153.stdout:4/692: creat d4/d53/fdb x:0 0 0 2024-02-28T16:24:46.838 INFO:tasks.workunit.client.1.smithi153.stdout:0/768: mknod d4/d89/c102 0 2024-02-28T16:24:46.843 INFO:tasks.workunit.client.1.smithi153.stdout:8/794: fdatasync d0/d12/f8d 0 2024-02-28T16:24:46.845 INFO:tasks.workunit.client.1.smithi153.stdout:3/759: creat d4/d6a/f112 x:0 0 0 2024-02-28T16:24:46.845 INFO:tasks.workunit.client.1.smithi153.stdout:7/782: chown d1/d25/df/d26/d3a/d3f/l4b 8793 1 2024-02-28T16:24:46.850 INFO:tasks.workunit.client.1.smithi153.stdout:0/769: unlink d4/d27/d9a/c5f 0 2024-02-28T16:24:46.860 INFO:tasks.workunit.client.1.smithi153.stdout:1/713: rename d0/dd/d84/c9c to d0/dd/db2/de5/de7/cfe 0 2024-02-28T16:24:46.861 INFO:tasks.workunit.client.1.smithi153.stdout:9/724: sync 2024-02-28T16:24:46.861 INFO:tasks.workunit.client.1.smithi153.stdout:6/776: sync 2024-02-28T16:24:46.861 INFO:tasks.workunit.client.1.smithi153.stdout:2/777: sync 2024-02-28T16:24:46.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/693: mknod d4/d53/d7c/cdc 0 2024-02-28T16:24:46.868 INFO:tasks.workunit.client.1.smithi153.stdout:8/795: unlink d0/d12/d67/d88/d8e/d9d/c78 0 2024-02-28T16:24:46.873 INFO:tasks.workunit.client.1.smithi153.stdout:5/786: dread da/dd/d25/f57 [0,4194304] 0 2024-02-28T16:24:46.877 INFO:tasks.workunit.client.1.smithi153.stdout:7/783: dread d1/f82 [0,4194304] 0 2024-02-28T16:24:46.882 INFO:tasks.workunit.client.1.smithi153.stdout:1/714: write d0/d3d/d4a/d59/f5a [1177812,34583] 0 2024-02-28T16:24:46.882 INFO:tasks.workunit.client.1.smithi153.stdout:6/777: write d0/d1d/d30/f58 [2327429,79182] 0 2024-02-28T16:24:46.884 INFO:tasks.workunit.client.1.smithi153.stdout:1/715: chown d0/dd/db2/d89/dad/dde 23488360 1 2024-02-28T16:24:46.886 INFO:tasks.workunit.client.1.smithi153.stdout:6/778: write d0/d1d/d30/d71/d91/fb1 [4912467,63150] 0 2024-02-28T16:24:46.888 INFO:tasks.workunit.client.1.smithi153.stdout:8/796: creat d0/d25/f11f x:0 0 0 2024-02-28T16:24:46.889 INFO:tasks.workunit.client.1.smithi153.stdout:6/779: fdatasync d0/d66/f98 0 2024-02-28T16:24:46.889 INFO:tasks.workunit.client.1.smithi153.stdout:9/725: write d1/d2a/f65 [5091832,106562] 0 2024-02-28T16:24:46.892 INFO:tasks.workunit.client.1.smithi153.stdout:9/726: write d1/d69/f94 [4024716,43043] 0 2024-02-28T16:24:46.892 INFO:tasks.workunit.client.1.smithi153.stdout:0/770: symlink d4/d32/dcf/df6/l103 0 2024-02-28T16:24:46.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:46 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:24:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:46 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:24:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:46 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:46 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:46 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:46 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:46 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.896 INFO:tasks.workunit.client.1.smithi153.stdout:3/760: truncate d4/d7d/f44 348688 0 2024-02-28T16:24:46.896 INFO:tasks.workunit.client.1.smithi153.stdout:5/787: read - da/d29/d43/d5a/d77/fba zero size 2024-02-28T16:24:46.897 INFO:tasks.workunit.client.1.smithi153.stdout:7/784: rmdir d1/d25/df/d26/d3a/d5e/d72/d9c 39 2024-02-28T16:24:46.897 INFO:tasks.workunit.client.1.smithi153.stdout:2/778: dwrite d2/d23/d48/df0/d3b/f68 [0,4194304] 0 2024-02-28T16:24:46.901 INFO:tasks.workunit.client.1.smithi153.stdout:2/779: fsync d2/d19/d31/dd1/fd8 0 2024-02-28T16:24:46.905 INFO:tasks.workunit.client.1.smithi153.stdout:1/716: dread d0/d3d/f4f [0,4194304] 0 2024-02-28T16:24:46.906 INFO:tasks.workunit.client.1.smithi153.stdout:1/717: chown d0/dd/db2/d80/le2 20170 1 2024-02-28T16:24:46.908 INFO:tasks.workunit.client.1.smithi153.stdout:1/718: stat d0/dd/db2/d89/dc7/de6/ce9 0 2024-02-28T16:24:46.913 INFO:tasks.workunit.client.1.smithi153.stdout:8/797: mkdir d0/d12/d15/dab/dd0/d120 0 2024-02-28T16:24:46.919 INFO:tasks.workunit.client.1.smithi153.stdout:0/771: mkdir d4/d32/dd9/d104 0 2024-02-28T16:24:46.921 INFO:tasks.workunit.client.1.smithi153.stdout:3/761: mknod d4/d8/d1e/d2a/d55/da3/db5/c113 0 2024-02-28T16:24:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:46 smithi023 ceph-mon[29137]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:24:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:46 smithi023 ceph-mon[29137]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:24:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:46 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:46 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:46 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:46 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:46 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:24:46.923 INFO:tasks.workunit.client.1.smithi153.stdout:7/785: rename d1/d25/d27/d7c/dc4/fa7 to d1/d25/df/d5a/de6/f106 0 2024-02-28T16:24:46.925 INFO:tasks.workunit.client.1.smithi153.stdout:4/694: link d4/de/d23/d2b/d4b/d80/cd7 d4/d53/d7c/db3/cdd 0 2024-02-28T16:24:46.926 INFO:tasks.workunit.client.1.smithi153.stdout:1/719: write d0/d62/f8f [1653642,105210] 0 2024-02-28T16:24:46.929 INFO:tasks.workunit.client.1.smithi153.stdout:6/780: symlink d0/d1d/d33/d9c/l113 0 2024-02-28T16:24:46.931 INFO:tasks.workunit.client.1.smithi153.stdout:3/762: creat d4/d6a/f114 x:0 0 0 2024-02-28T16:24:46.935 INFO:tasks.workunit.client.1.smithi153.stdout:4/695: mkdir d4/de/d23/d2b/d31/da2/da5/db2/dde 0 2024-02-28T16:24:46.938 INFO:tasks.workunit.client.1.smithi153.stdout:5/788: rmdir da/dd/d54/db0/df0/dfa 0 2024-02-28T16:24:46.943 INFO:tasks.workunit.client.1.smithi153.stdout:6/781: readlink d0/d1d/d33/d9c/d2e/lc4 0 2024-02-28T16:24:46.945 INFO:tasks.workunit.client.1.smithi153.stdout:5/789: dread da/dd/d25/d82/d8f/f98 [0,4194304] 0 2024-02-28T16:24:46.947 INFO:tasks.workunit.client.1.smithi153.stdout:1/720: symlink d0/d3d/lff 0 2024-02-28T16:24:46.949 INFO:tasks.workunit.client.1.smithi153.stdout:5/790: dread da/dd/d25/d8a/fae [0,4194304] 0 2024-02-28T16:24:46.952 INFO:tasks.workunit.client.1.smithi153.stdout:0/772: truncate d4/d99/da5/fb1 3517584 0 2024-02-28T16:24:46.952 INFO:tasks.workunit.client.1.smithi153.stdout:5/791: dread - da/dd/d25/d8a/db3/fd4 zero size 2024-02-28T16:24:46.956 INFO:tasks.workunit.client.1.smithi153.stdout:2/780: dwrite d2/d23/d48/df0/d3b/f4e [0,4194304] 0 2024-02-28T16:24:46.957 INFO:tasks.workunit.client.1.smithi153.stdout:4/696: dread d4/de/d40/f49 [0,4194304] 0 2024-02-28T16:24:46.966 INFO:tasks.workunit.client.1.smithi153.stdout:6/782: dread d0/d1d/d33/d9c/d2e/d99/dab/fee [0,4194304] 0 2024-02-28T16:24:46.966 INFO:tasks.workunit.client.1.smithi153.stdout:0/773: creat d4/d32/df0/f105 x:0 0 0 2024-02-28T16:24:46.969 INFO:tasks.workunit.client.1.smithi153.stdout:3/763: write d4/d8/f4d [725992,53478] 0 2024-02-28T16:24:46.970 INFO:tasks.workunit.client.1.smithi153.stdout:7/786: link d1/d25/d27/c8e d1/d25/dc/ddc/c107 0 2024-02-28T16:24:46.972 INFO:tasks.workunit.client.1.smithi153.stdout:2/781: readlink d2/d23/d48/df0/d3b/d5e/l6f 0 2024-02-28T16:24:46.972 INFO:tasks.workunit.client.1.smithi153.stdout:7/787: write d1/f23 [442647,27335] 0 2024-02-28T16:24:46.975 INFO:tasks.workunit.client.1.smithi153.stdout:7/788: write d1/d25/df/fda [495398,35430] 0 2024-02-28T16:24:46.978 INFO:tasks.workunit.client.1.smithi153.stdout:8/798: creat d0/d12/d67/d30/d63/f121 x:0 0 0 2024-02-28T16:24:46.979 INFO:tasks.workunit.client.1.smithi153.stdout:4/697: mkdir d4/de/d23/d2b/d31/ddf 0 2024-02-28T16:24:46.982 INFO:tasks.workunit.client.1.smithi153.stdout:0/774: creat d4/d27/f106 x:0 0 0 2024-02-28T16:24:46.984 INFO:tasks.workunit.client.1.smithi153.stdout:6/783: dwrite d0/d1d/d33/d9c/d68/ffb [0,4194304] 0 2024-02-28T16:24:46.985 INFO:tasks.workunit.client.1.smithi153.stdout:3/764: mkdir d4/d13/d28/d99/d115 0 2024-02-28T16:24:46.986 INFO:tasks.workunit.client.1.smithi153.stdout:7/789: mkdir d1/d25/df/d26/d3a/d95/d108 0 2024-02-28T16:24:46.987 INFO:tasks.workunit.client.1.smithi153.stdout:3/765: chown d4/d7d/d70/cc5 102 1 2024-02-28T16:24:46.989 INFO:tasks.workunit.client.1.smithi153.stdout:5/792: creat da/dd/d25/f105 x:0 0 0 2024-02-28T16:24:46.990 INFO:tasks.workunit.client.1.smithi153.stdout:4/698: creat d4/de/d23/d2b/d4b/da9/fe0 x:0 0 0 2024-02-28T16:24:46.991 INFO:tasks.workunit.client.1.smithi153.stdout:5/793: fsync da/d29/d43/d5a/d77/f83 0 2024-02-28T16:24:46.992 INFO:tasks.workunit.client.1.smithi153.stdout:1/721: getdents d0/dd/db2/d89 0 2024-02-28T16:24:46.996 INFO:tasks.workunit.client.1.smithi153.stdout:5/794: write da/de1/ff1 [801267,110504] 0 2024-02-28T16:24:46.997 INFO:tasks.workunit.client.1.smithi153.stdout:6/784: fdatasync d0/d1d/d33/d9c/d2e/f53 0 2024-02-28T16:24:46.997 INFO:tasks.workunit.client.1.smithi153.stdout:8/799: symlink d0/l122 0 2024-02-28T16:24:46.998 INFO:tasks.workunit.client.1.smithi153.stdout:7/790: chown d1/d25/df/l20 195559 1 2024-02-28T16:24:46.999 INFO:tasks.workunit.client.1.smithi153.stdout:4/699: readlink d4/de/d23/l99 0 2024-02-28T16:24:47.000 INFO:tasks.workunit.client.1.smithi153.stdout:0/775: creat d4/d99/da5/ddf/def/f107 x:0 0 0 2024-02-28T16:24:47.000 INFO:tasks.workunit.client.1.smithi153.stdout:7/791: readlink d1/d70/dbf/ldf 0 2024-02-28T16:24:47.004 INFO:tasks.workunit.client.1.smithi153.stdout:2/782: dread d2/f7d [0,4194304] 0 2024-02-28T16:24:47.008 INFO:tasks.workunit.client.1.smithi153.stdout:7/792: dread d1/d25/df/d5a/fd1 [0,4194304] 0 2024-02-28T16:24:47.010 INFO:tasks.workunit.client.1.smithi153.stdout:6/785: creat d0/d1d/d33/d9c/d48/d63/d8c/dc3/f114 x:0 0 0 2024-02-28T16:24:47.013 INFO:tasks.workunit.client.1.smithi153.stdout:0/776: mkdir d4/d32/df0/d108 0 2024-02-28T16:24:47.022 INFO:tasks.workunit.client.1.smithi153.stdout:8/800: symlink d0/d12/d15/dab/dd0/de9/d11e/l123 0 2024-02-28T16:24:47.023 INFO:tasks.workunit.client.1.smithi153.stdout:4/700: dread d4/f6 [0,4194304] 0 2024-02-28T16:24:47.023 INFO:tasks.workunit.client.1.smithi153.stdout:7/793: chown d1/d25/df/d26/d3a/d3f/f74 7391878 1 2024-02-28T16:24:47.028 INFO:tasks.workunit.client.1.smithi153.stdout:4/701: rmdir d4/db9 39 2024-02-28T16:24:47.031 INFO:tasks.workunit.client.1.smithi153.stdout:2/783: dread d2/d23/d36/f3c [0,4194304] 0 2024-02-28T16:24:47.032 INFO:tasks.workunit.client.1.smithi153.stdout:6/786: dwrite d0/d1d/d33/d9c/f3e [0,4194304] 0 2024-02-28T16:24:47.032 INFO:tasks.workunit.client.1.smithi153.stdout:1/722: dwrite d0/d3d/d4a/fbd [0,4194304] 0 2024-02-28T16:24:47.036 INFO:tasks.workunit.client.1.smithi153.stdout:8/801: symlink d0/d12/d15/dab/dd0/d120/l124 0 2024-02-28T16:24:47.036 INFO:tasks.workunit.client.1.smithi153.stdout:6/787: dread - d0/d1d/d30/d71/f84 zero size 2024-02-28T16:24:47.038 INFO:tasks.workunit.client.1.smithi153.stdout:0/777: dwrite d4/d27/d101/fe0 [0,4194304] 0 2024-02-28T16:24:47.042 INFO:tasks.workunit.client.1.smithi153.stdout:6/788: chown d0/d1d/d33/d9c/d48/d72/f76 2 1 2024-02-28T16:24:47.052 INFO:tasks.workunit.client.1.smithi153.stdout:6/789: write d0/d1d/d33/d9c/d48/d63/d8c/dc3/f114 [69459,23001] 0 2024-02-28T16:24:47.057 INFO:tasks.workunit.client.1.smithi153.stdout:0/778: unlink d4/d27/f44 0 2024-02-28T16:24:47.061 INFO:tasks.workunit.client.1.smithi153.stdout:4/702: getdents d4/de/d23/d2b/d9b 0 2024-02-28T16:24:47.062 INFO:tasks.workunit.client.1.smithi153.stdout:1/723: dwrite d0/d3d/f88 [0,4194304] 0 2024-02-28T16:24:47.062 INFO:tasks.workunit.client.1.smithi153.stdout:8/802: creat d0/d12/d67/d30/d63/f125 x:0 0 0 2024-02-28T16:24:47.064 INFO:tasks.workunit.client.1.smithi153.stdout:8/803: dread - d0/d19/d1e/fd8 zero size 2024-02-28T16:24:47.065 INFO:tasks.workunit.client.1.smithi153.stdout:6/790: mkdir d0/d1d/d33/d9c/d48/dec/d115 0 2024-02-28T16:24:47.067 INFO:tasks.workunit.client.1.smithi153.stdout:8/804: fdatasync d0/d19/d2b/f54 0 2024-02-28T16:24:47.069 INFO:tasks.workunit.client.1.smithi153.stdout:7/794: dread d1/d25/df/d26/d3a/fef [0,4194304] 0 2024-02-28T16:24:47.072 INFO:tasks.workunit.client.1.smithi153.stdout:1/724: dread d0/d3d/f43 [0,4194304] 0 2024-02-28T16:24:47.072 INFO:tasks.workunit.client.1.smithi153.stdout:9/727: sync 2024-02-28T16:24:47.076 INFO:tasks.workunit.client.1.smithi153.stdout:7/795: rmdir d1/d25/d27/d7c/db5 39 2024-02-28T16:24:47.080 INFO:tasks.workunit.client.1.smithi153.stdout:0/779: dread d4/d32/d7f/d8a/fc6 [0,4194304] 0 2024-02-28T16:24:47.080 INFO:tasks.workunit.client.1.smithi153.stdout:7/796: readlink d1/d25/dc/l21 0 2024-02-28T16:24:47.083 INFO:tasks.workunit.client.1.smithi153.stdout:9/728: symlink d1/d2a/lee 0 2024-02-28T16:24:47.085 INFO:tasks.workunit.client.1.smithi153.stdout:7/797: write d1/d25/df/d26/d3a/d95/d97/fb7 [3685531,105241] 0 2024-02-28T16:24:47.086 INFO:tasks.workunit.client.1.smithi153.stdout:8/805: dwrite d0/d34/f68 [0,4194304] 0 2024-02-28T16:24:47.088 INFO:tasks.workunit.client.1.smithi153.stdout:1/725: symlink d0/d3d/d4a/d59/l100 0 2024-02-28T16:24:47.091 INFO:tasks.workunit.client.1.smithi153.stdout:0/780: unlink d4/d32/d7f/d8a/dab/f4b 0 2024-02-28T16:24:47.093 INFO:tasks.workunit.client.1.smithi153.stdout:9/729: rename d1/d5/d11/d1f/d62/l70 to d1/d7e/lef 0 2024-02-28T16:24:47.093 INFO:tasks.workunit.client.1.smithi153.stdout:1/726: write d0/dd/db2/d89/faf [397109,129839] 0 2024-02-28T16:24:47.096 INFO:tasks.workunit.client.1.smithi153.stdout:1/727: chown d0/dc1/de4 39 1 2024-02-28T16:24:47.096 INFO:tasks.workunit.client.1.smithi153.stdout:6/791: link d0/l7c d0/l116 0 2024-02-28T16:24:47.100 INFO:tasks.workunit.client.1.smithi153.stdout:1/728: write d0/dd/db2/f91 [3095169,123637] 0 2024-02-28T16:24:47.103 INFO:tasks.workunit.client.1.smithi153.stdout:3/766: sync 2024-02-28T16:24:47.105 INFO:tasks.workunit.client.1.smithi153.stdout:0/781: chown d4/d32/c77 784726 1 2024-02-28T16:24:47.113 INFO:tasks.workunit.client.1.smithi153.stdout:9/730: fsync d1/d5/d11/dd4/dbe/fbf 0 2024-02-28T16:24:47.115 INFO:tasks.workunit.client.1.smithi153.stdout:2/784: dwrite d2/d23/d48/df0/d3b/d87/fa2 [0,4194304] 0 2024-02-28T16:24:47.115 INFO:tasks.workunit.client.1.smithi153.stdout:8/806: link d0/d12/d15/dab/l10b d0/d25/d79/l126 0 2024-02-28T16:24:47.116 INFO:tasks.workunit.client.1.smithi153.stdout:6/792: rmdir d0/d1d/d33/d9c/d68/da2/dff 39 2024-02-28T16:24:47.119 INFO:tasks.workunit.client.1.smithi153.stdout:4/703: dread d4/de/d23/f48 [0,4194304] 0 2024-02-28T16:24:47.121 INFO:tasks.workunit.client.1.smithi153.stdout:2/785: write d2/ff [110570,5453] 0 2024-02-28T16:24:47.124 INFO:tasks.workunit.client.1.smithi153.stdout:3/767: write d4/d8/d1e/d23/fd6 [433732,96719] 0 2024-02-28T16:24:47.126 INFO:tasks.workunit.client.1.smithi153.stdout:0/782: stat d4/d32/d7f/d8a/dab/d8e/d90/l2a 0 2024-02-28T16:24:47.126 INFO:tasks.workunit.client.1.smithi153.stdout:9/731: chown d1/d74/d80/da8/f32 14242 1 2024-02-28T16:24:47.131 INFO:tasks.workunit.client.1.smithi153.stdout:2/786: chown d2/d23/d48/df0/d3b/d87/df8/dd0 1058 1 2024-02-28T16:24:47.132 INFO:tasks.workunit.client.1.smithi153.stdout:8/807: chown d0/d12/d67/d88/d8e/d9d/c9b 10 1 2024-02-28T16:24:47.132 INFO:tasks.workunit.client.1.smithi153.stdout:6/793: chown d0/d1d/d33/d9c/d68/dcb/fe4 588539940 1 2024-02-28T16:24:47.138 INFO:tasks.workunit.client.1.smithi153.stdout:9/732: write d1/d5/d11/d1f/d43/f9d [1077812,83588] 0 2024-02-28T16:24:47.139 INFO:tasks.workunit.client.1.smithi153.stdout:1/729: link d0/dd/f37 d0/d62/d66/f101 0 2024-02-28T16:24:47.142 INFO:tasks.workunit.client.1.smithi153.stdout:7/798: dread d1/d25/df/d26/d76/f9a [0,4194304] 0 2024-02-28T16:24:47.143 INFO:tasks.workunit.client.1.smithi153.stdout:1/730: write d0/d3d/f88 [460471,112190] 0 2024-02-28T16:24:47.144 INFO:tasks.workunit.client.1.smithi153.stdout:3/768: rename d4/d8/d1e/c61 to d4/d7d/d41/d71/c116 0 2024-02-28T16:24:47.146 INFO:tasks.workunit.client.1.smithi153.stdout:8/808: unlink d0/d25/d79/lae 0 2024-02-28T16:24:47.150 INFO:tasks.workunit.client.1.smithi153.stdout:6/794: creat d0/d1d/d33/d9c/d68/dcb/df2/f117 x:0 0 0 2024-02-28T16:24:47.155 INFO:tasks.workunit.client.1.smithi153.stdout:3/769: mkdir d4/d8/d1e/d2a/d55/d117 0 2024-02-28T16:24:47.158 INFO:tasks.workunit.client.1.smithi153.stdout:8/809: creat d0/d12/d15/dab/dd0/de9/d100/f127 x:0 0 0 2024-02-28T16:24:47.160 INFO:tasks.workunit.client.1.smithi153.stdout:5/795: sync 2024-02-28T16:24:47.160 INFO:tasks.workunit.client.1.smithi153.stdout:9/733: chown d1/d7e/lef 169553 1 2024-02-28T16:24:47.163 INFO:tasks.workunit.client.1.smithi153.stdout:4/704: link d4/de/d47/d5e/d62/c68 d4/de/d23/d2b/ce1 0 2024-02-28T16:24:47.163 INFO:tasks.workunit.client.1.smithi153.stdout:8/810: write d0/d19/d2b/d2d/d3f/d9f/dcc/fcd [536326,97666] 0 2024-02-28T16:24:47.163 INFO:tasks.workunit.client.1.smithi153.stdout:9/734: write d1/d5/d11/d64/fa6 [986540,76337] 0 2024-02-28T16:24:47.167 INFO:tasks.workunit.client.1.smithi153.stdout:0/783: dread d4/d32/f48 [0,4194304] 0 2024-02-28T16:24:47.168 INFO:tasks.workunit.client.1.smithi153.stdout:2/787: rename d2/d19/d3e/c46 to d2/cff 0 2024-02-28T16:24:47.169 INFO:tasks.workunit.client.1.smithi153.stdout:2/788: chown d2/d23/d36/de2 3 1 2024-02-28T16:24:47.171 INFO:tasks.workunit.client.1.smithi153.stdout:7/799: link d1/d25/df/d5a/f78 d1/d25/df/d60/da4/f109 0 2024-02-28T16:24:47.174 INFO:tasks.workunit.client.1.smithi153.stdout:3/770: creat d4/d13/d28/f118 x:0 0 0 2024-02-28T16:24:47.177 INFO:tasks.workunit.client.1.smithi153.stdout:1/731: rename d0/dd/db2/de5/cf3 to d0/dd/dd5/c102 0 2024-02-28T16:24:47.179 INFO:tasks.workunit.client.1.smithi153.stdout:2/789: unlink d2/d19/d3e/db0/led 0 2024-02-28T16:24:47.181 INFO:tasks.workunit.client.1.smithi153.stdout:1/732: fsync d0/d3d/f7d 0 2024-02-28T16:24:47.181 INFO:tasks.workunit.client.1.smithi153.stdout:4/705: dread d4/de/f57 [0,4194304] 0 2024-02-28T16:24:47.183 INFO:tasks.workunit.client.1.smithi153.stdout:6/795: link d0/d1d/lc7 d0/d1d/d33/d9c/d68/da2/dff/l118 0 2024-02-28T16:24:47.185 INFO:tasks.workunit.client.1.smithi153.stdout:8/811: dwrite d0/d12/d67/d88/d8e/d9d/fb7 [0,4194304] 0 2024-02-28T16:24:47.186 INFO:tasks.workunit.client.1.smithi153.stdout:1/733: readlink d0/d3d/d4a/l9d 0 2024-02-28T16:24:47.186 INFO:tasks.workunit.client.1.smithi153.stdout:4/706: read f1 [1129230,120000] 0 2024-02-28T16:24:47.187 INFO:tasks.workunit.client.1.smithi153.stdout:0/784: dwrite d4/f78 [0,4194304] 0 2024-02-28T16:24:47.191 INFO:tasks.workunit.client.1.smithi153.stdout:5/796: getdents da/dd/d25/dcb 0 2024-02-28T16:24:47.193 INFO:tasks.workunit.client.1.smithi153.stdout:9/735: getdents d1/d5/d11/d1f/d20/d5d 0 2024-02-28T16:24:47.195 INFO:tasks.workunit.client.1.smithi153.stdout:5/797: dread - da/dd/dd1/fe8 zero size 2024-02-28T16:24:47.198 INFO:tasks.workunit.client.1.smithi153.stdout:6/796: fsync d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/ffe 0 2024-02-28T16:24:47.201 INFO:tasks.workunit.client.1.smithi153.stdout:3/771: dwrite d4/d2c/f7e [0,4194304] 0 2024-02-28T16:24:47.202 INFO:tasks.workunit.client.1.smithi153.stdout:1/734: mkdir d0/dd/db2/d89/dc7/d103 0 2024-02-28T16:24:47.210 INFO:tasks.workunit.client.1.smithi153.stdout:0/785: dread - d4/d32/d7f/faa zero size 2024-02-28T16:24:47.213 INFO:tasks.workunit.client.1.smithi153.stdout:2/790: dwrite d2/d23/d88/fd6 [0,4194304] 0 2024-02-28T16:24:47.216 INFO:tasks.workunit.client.1.smithi153.stdout:8/812: creat d0/d19/d2b/d2d/d3f/d10a/f128 x:0 0 0 2024-02-28T16:24:47.219 INFO:tasks.workunit.client.1.smithi153.stdout:1/735: creat d0/d3d/d4a/f104 x:0 0 0 2024-02-28T16:24:47.219 INFO:tasks.workunit.client.1.smithi153.stdout:4/707: truncate d4/de/d40/f5a 322116 0 2024-02-28T16:24:47.219 INFO:tasks.workunit.client.1.smithi153.stdout:6/797: mknod d0/d1d/d30/c119 0 2024-02-28T16:24:47.221 INFO:tasks.workunit.client.1.smithi153.stdout:0/786: chown d4/d32/d7f/d8a/ff4 5603601 1 2024-02-28T16:24:47.226 INFO:tasks.workunit.client.1.smithi153.stdout:7/800: dwrite d1/f8d [0,4194304] 0 2024-02-28T16:24:47.228 INFO:tasks.workunit.client.1.smithi153.stdout:5/798: write da/dd/fe [160330,76823] 0 2024-02-28T16:24:47.247 INFO:tasks.workunit.client.1.smithi153.stdout:7/801: dwrite d1/d25/d27/d43/fed [0,4194304] 0 2024-02-28T16:24:47.249 INFO:tasks.workunit.client.1.smithi153.stdout:1/736: dread d0/dd/db2/f91 [0,4194304] 0 2024-02-28T16:24:47.254 INFO:tasks.workunit.client.1.smithi153.stdout:1/737: dread - d0/dd/db2/d89/dc7/ff0 zero size 2024-02-28T16:24:47.256 INFO:tasks.workunit.client.1.smithi153.stdout:1/738: readlink d0/d3d/d4a/d59/d9a/lac 0 2024-02-28T16:24:47.260 INFO:tasks.workunit.client.1.smithi153.stdout:2/791: symlink d2/d19/d8b/l100 0 2024-02-28T16:24:47.261 INFO:tasks.workunit.client.1.smithi153.stdout:3/772: symlink d4/d8/d1e/d2a/d55/d117/l119 0 2024-02-28T16:24:47.263 INFO:tasks.workunit.client.1.smithi153.stdout:4/708: mkdir d4/d53/d7c/db3/de2 0 2024-02-28T16:24:47.265 INFO:tasks.workunit.client.1.smithi153.stdout:4/709: chown d4/de/d13/d1b/l4f 5454312 1 2024-02-28T16:24:47.269 INFO:tasks.workunit.client.1.smithi153.stdout:1/739: mknod d0/dd/db2/d89/dad/c105 0 2024-02-28T16:24:47.270 INFO:tasks.workunit.client.1.smithi153.stdout:1/740: stat d0/d3d/l54 0 2024-02-28T16:24:47.270 INFO:tasks.workunit.client.1.smithi153.stdout:9/736: rename d1/d5/d11/d1f/d43/ca0 to d1/d5/d11/d1f/d43/cf0 0 2024-02-28T16:24:47.271 INFO:tasks.workunit.client.1.smithi153.stdout:1/741: stat d0/d3d/d4a/ff7 0 2024-02-28T16:24:47.271 INFO:tasks.workunit.client.1.smithi153.stdout:1/742: readlink d0/l55 0 2024-02-28T16:24:47.279 INFO:tasks.workunit.client.1.smithi153.stdout:0/787: creat d4/d32/d7f/d8a/dab/d8e/d94/df5/f109 x:0 0 0 2024-02-28T16:24:47.279 INFO:tasks.workunit.client.1.smithi153.stdout:6/798: mknod d0/d1d/d33/d9c/d48/d63/d8c/dd7/de0/c11a 0 2024-02-28T16:24:47.280 INFO:tasks.workunit.client.1.smithi153.stdout:6/799: write d0/d1d/d33/d9c/f86 [5874234,92401] 0 2024-02-28T16:24:47.282 INFO:tasks.workunit.client.1.smithi153.stdout:2/792: creat d2/d23/d48/df0/d93/d9b/dfb/f101 x:0 0 0 2024-02-28T16:24:47.283 INFO:tasks.workunit.client.1.smithi153.stdout:1/743: symlink d0/d62/d66/d7c/l106 0 2024-02-28T16:24:47.293 INFO:tasks.workunit.client.1.smithi153.stdout:0/788: symlink d4/d32/d7f/d8a/dab/d8e/d94/dd7/l10a 0 2024-02-28T16:24:47.295 INFO:tasks.workunit.client.1.smithi153.stdout:0/789: dread - d4/d27/f106 zero size 2024-02-28T16:24:47.295 INFO:tasks.workunit.client.1.smithi153.stdout:0/790: write d4/d27/f42 [35088,59126] 0 2024-02-28T16:24:47.296 INFO:tasks.workunit.client.1.smithi153.stdout:6/800: dread - d0/d1d/d33/d9c/d48/d63/d8c/faa zero size 2024-02-28T16:24:47.297 INFO:tasks.workunit.client.1.smithi153.stdout:0/791: stat d4/d99/dfa 0 2024-02-28T16:24:47.297 INFO:tasks.workunit.client.1.smithi153.stdout:1/744: creat d0/dd/db2/de5/f107 x:0 0 0 2024-02-28T16:24:47.297 INFO:tasks.workunit.client.1.smithi153.stdout:6/801: chown d0/d17/d7e 1848 1 2024-02-28T16:24:47.299 INFO:tasks.workunit.client.1.smithi153.stdout:3/773: rename d4/d8/d1e/d2a/d55/da3/db1/l10b to d4/d13/d28/l11a 0 2024-02-28T16:24:47.300 INFO:tasks.workunit.client.1.smithi153.stdout:7/802: getdents d1/d25/df/d5a/de6 0 2024-02-28T16:24:47.301 INFO:tasks.workunit.client.1.smithi153.stdout:9/737: creat d1/d5/d11/ff1 x:0 0 0 2024-02-28T16:24:47.302 INFO:tasks.workunit.client.1.smithi153.stdout:3/774: truncate d4/d8/d1e/dbb/f111 861337 0 2024-02-28T16:24:47.303 INFO:tasks.workunit.client.1.smithi153.stdout:1/745: mknod d0/dd/db2/d89/daa/c108 0 2024-02-28T16:24:47.303 INFO:tasks.workunit.client.1.smithi153.stdout:3/775: chown d4/d2c/f4e 509969082 1 2024-02-28T16:24:47.307 INFO:tasks.workunit.client.1.smithi153.stdout:7/803: creat d1/d25/df/d26/d3a/d95/f10a x:0 0 0 2024-02-28T16:24:47.308 INFO:tasks.workunit.client.1.smithi153.stdout:9/738: unlink d1/f4e 0 2024-02-28T16:24:47.312 INFO:tasks.workunit.client.1.smithi153.stdout:3/776: mkdir d4/d7d/d41/d11b 0 2024-02-28T16:24:47.313 INFO:tasks.workunit.client.1.smithi153.stdout:6/802: dwrite d0/d1d/d33/d9c/d2e/f42 [4194304,4194304] 0 2024-02-28T16:24:47.316 INFO:tasks.workunit.client.1.smithi153.stdout:1/746: rmdir d0/d3d/d4a/d59/d9a 39 2024-02-28T16:24:47.318 INFO:tasks.workunit.client.1.smithi153.stdout:1/747: dread - d0/dd/dd5/fee zero size 2024-02-28T16:24:47.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/799: dwrite da/d29/f4b [0,4194304] 0 2024-02-28T16:24:47.320 INFO:tasks.workunit.client.1.smithi153.stdout:1/748: chown d0/dd/d84/cb3 47 1 2024-02-28T16:24:47.322 INFO:tasks.workunit.client.1.smithi153.stdout:8/813: truncate d0/d25/d79/fc7 725382 0 2024-02-28T16:24:47.323 INFO:tasks.workunit.client.1.smithi153.stdout:9/739: mkdir d1/d74/d80/df2 0 2024-02-28T16:24:47.324 INFO:tasks.workunit.client.1.smithi153.stdout:5/800: read da/dd/d25/f36 [2178601,80423] 0 2024-02-28T16:24:47.333 INFO:tasks.workunit.client.1.smithi153.stdout:5/801: dread da/f86 [0,4194304] 0 2024-02-28T16:24:47.335 INFO:tasks.workunit.client.1.smithi153.stdout:5/802: chown da/d29/d43/d5a/dbe/de7/ff4 32031 1 2024-02-28T16:24:47.338 INFO:tasks.workunit.client.1.smithi153.stdout:6/803: symlink d0/d1d/d30/dd0/l11b 0 2024-02-28T16:24:47.340 INFO:tasks.workunit.client.1.smithi153.stdout:3/777: rmdir d4/d8/d1e 39 2024-02-28T16:24:47.343 INFO:tasks.workunit.client.1.smithi153.stdout:3/778: read d4/d2c/f5a [2188208,94310] 0 2024-02-28T16:24:47.347 INFO:tasks.workunit.client.1.smithi153.stdout:1/749: rmdir d0/dd/db2/de5/de7 39 2024-02-28T16:24:47.349 INFO:tasks.workunit.client.1.smithi153.stdout:0/792: truncate d4/d27/f5a 1272797 0 2024-02-28T16:24:47.351 INFO:tasks.workunit.client.1.smithi153.stdout:8/814: creat d0/d12/d67/d88/d85/f129 x:0 0 0 2024-02-28T16:24:47.363 INFO:tasks.workunit.client.1.smithi153.stdout:7/804: rmdir d1/d25/df/d26/d3a/d95/d108 0 2024-02-28T16:24:47.366 INFO:tasks.workunit.client.1.smithi153.stdout:3/779: stat d4/d8/d1e/d87/f108 0 2024-02-28T16:24:47.369 INFO:tasks.workunit.client.1.smithi153.stdout:1/750: unlink d0/c2 0 2024-02-28T16:24:47.372 INFO:tasks.workunit.client.1.smithi153.stdout:8/815: rmdir d0/d12/d15/dab 39 2024-02-28T16:24:47.377 INFO:tasks.workunit.client.1.smithi153.stdout:6/804: creat d0/d1d/d5d/d106/f11c x:0 0 0 2024-02-28T16:24:47.382 INFO:tasks.workunit.client.1.smithi153.stdout:7/805: rename d1/d25/df/d60/da4/fce to d1/d25/df/d60/da4/f10b 0 2024-02-28T16:24:47.388 INFO:tasks.workunit.client.1.smithi153.stdout:9/740: rename d1/d5/d11/d1f/d20/d36/ca2 to d1/d5/d11/d64/cf3 0 2024-02-28T16:24:47.392 INFO:tasks.workunit.client.1.smithi153.stdout:9/741: chown d1/d74/d80/da8/l77 3720168 1 2024-02-28T16:24:47.393 INFO:tasks.workunit.client.1.smithi153.stdout:5/803: rmdir da/d29/d43/d5a/dcf 0 2024-02-28T16:24:47.398 INFO:tasks.workunit.client.1.smithi153.stdout:6/805: dwrite d0/f18 [4194304,4194304] 0 2024-02-28T16:24:47.401 INFO:tasks.workunit.client.1.smithi153.stdout:1/751: mkdir d0/dc1/de4/d109 0 2024-02-28T16:24:47.402 INFO:tasks.workunit.client.1.smithi153.stdout:4/710: sync 2024-02-28T16:24:47.403 INFO:tasks.workunit.client.1.smithi153.stdout:0/793: creat d4/d32/d7f/d8a/dab/d8e/f10b x:0 0 0 2024-02-28T16:24:47.404 INFO:tasks.workunit.client.1.smithi153.stdout:3/780: write d4/d49/fac [338714,29206] 0 2024-02-28T16:24:47.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/781: fsync d4/d8/d1e/d87/f108 0 2024-02-28T16:24:47.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/782: fsync d4/d8/d1e/d2a/d35/f47 0 2024-02-28T16:24:47.412 INFO:tasks.workunit.client.1.smithi153.stdout:3/783: stat d4/d8/d1e/d2a/l53 0 2024-02-28T16:24:47.417 INFO:tasks.workunit.client.1.smithi153.stdout:9/742: rename d1/d74/d80/da8/l2f to d1/d69/dbb/dcc/lf4 0 2024-02-28T16:24:47.418 INFO:tasks.workunit.client.1.smithi153.stdout:7/806: mknod d1/d25/dc/d50/d66/da9/deb/c10c 0 2024-02-28T16:24:47.420 INFO:tasks.workunit.client.1.smithi153.stdout:9/743: fdatasync d1/d74/d80/da8/f3d 0 2024-02-28T16:24:47.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/744: readlink d1/d5/l7 0 2024-02-28T16:24:47.423 INFO:tasks.workunit.client.1.smithi153.stdout:6/806: creat d0/d1d/d33/d108/f11d x:0 0 0 2024-02-28T16:24:47.428 INFO:tasks.workunit.client.1.smithi153.stdout:4/711: unlink d4/d53/l79 0 2024-02-28T16:24:47.430 INFO:tasks.workunit.client.1.smithi153.stdout:4/712: readlink d4/de/d47/d5e/d62/l66 0 2024-02-28T16:24:47.432 INFO:tasks.workunit.client.1.smithi153.stdout:3/784: creat d4/d7d/d41/d71/deb/f11c x:0 0 0 2024-02-28T16:24:47.435 INFO:tasks.workunit.client.1.smithi153.stdout:0/794: rename d4/d27/dc1 to d4/d32/dcf/df6/d10c 0 2024-02-28T16:24:47.440 INFO:tasks.workunit.client.1.smithi153.stdout:5/804: truncate da/f3a 458744 0 2024-02-28T16:24:47.444 INFO:tasks.workunit.client.1.smithi153.stdout:0/795: creat d4/d32/ded/f10d x:0 0 0 2024-02-28T16:24:47.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/807: dwrite d0/d1d/d30/f58 [0,4194304] 0 2024-02-28T16:24:47.446 INFO:tasks.workunit.client.1.smithi153.stdout:9/745: mknod d1/d5/d11/d1f/d62/dca/cf5 0 2024-02-28T16:24:47.446 INFO:tasks.workunit.client.1.smithi153.stdout:8/816: getdents d0/d12/d15/dab 0 2024-02-28T16:24:47.446 INFO:tasks.workunit.client.1.smithi153.stdout:7/807: rename d1/d25/df/d8a/fcc to d1/d25/d27/d7c/dc4/d63/d75/f10d 0 2024-02-28T16:24:47.448 INFO:tasks.workunit.client.1.smithi153.stdout:5/805: write da/d29/fe2 [655900,46134] 0 2024-02-28T16:24:47.451 INFO:tasks.workunit.client.1.smithi153.stdout:1/752: write d0/d3d/d4a/d59/f5a [1373829,10210] 0 2024-02-28T16:24:47.454 INFO:tasks.workunit.client.1.smithi153.stdout:3/785: unlink d4/dfc/c5b 0 2024-02-28T16:24:47.457 INFO:tasks.workunit.client.1.smithi153.stdout:6/808: write d0/d1d/d33/d9c/d2e/f42 [4939152,115358] 0 2024-02-28T16:24:47.461 INFO:tasks.workunit.client.1.smithi153.stdout:3/786: dread - d4/d8/d1e/d2a/d35/d54/fff zero size 2024-02-28T16:24:47.461 INFO:tasks.workunit.client.1.smithi153.stdout:0/796: symlink d4/d99/da5/ddf/def/l10e 0 2024-02-28T16:24:47.462 INFO:tasks.workunit.client.1.smithi153.stdout:5/806: creat da/dd/d25/d8a/db3/f106 x:0 0 0 2024-02-28T16:24:47.462 INFO:tasks.workunit.client.1.smithi153.stdout:4/713: dwrite d4/de/d23/fcf [0,4194304] 0 2024-02-28T16:24:47.472 INFO:tasks.workunit.client.1.smithi153.stdout:5/807: mkdir da/de1/de9/d107 0 2024-02-28T16:24:47.477 INFO:tasks.workunit.client.1.smithi153.stdout:4/714: mknod d4/de/d23/d2b/d31/ddf/ce3 0 2024-02-28T16:24:47.480 INFO:tasks.workunit.client.1.smithi153.stdout:1/753: dwrite d0/dd/fda [0,4194304] 0 2024-02-28T16:24:47.487 INFO:tasks.workunit.client.1.smithi153.stdout:0/797: dwrite d4/fa [4194304,4194304] 0 2024-02-28T16:24:47.488 INFO:tasks.workunit.client.1.smithi153.stdout:3/787: dwrite d4/d13/d28/fdc [0,4194304] 0 2024-02-28T16:24:47.496 INFO:tasks.workunit.client.1.smithi153.stdout:0/798: creat d4/d32/d7f/db3/dc2/f10f x:0 0 0 2024-02-28T16:24:47.499 INFO:tasks.workunit.client.1.smithi153.stdout:9/746: truncate d1/d74/d80/da8/fd3 3854158 0 2024-02-28T16:24:47.500 INFO:tasks.workunit.client.1.smithi153.stdout:5/808: link da/dd/d25/dcb/fde da/dd/d25/d8a/dac/dc6/f108 0 2024-02-28T16:24:47.501 INFO:tasks.workunit.client.1.smithi153.stdout:4/715: truncate d4/de/d23/d2b/f63 797057 0 2024-02-28T16:24:47.506 INFO:tasks.workunit.client.1.smithi153.stdout:7/808: dread d1/d25/f33 [0,4194304] 0 2024-02-28T16:24:47.509 INFO:tasks.workunit.client.1.smithi153.stdout:0/799: rename d4/d27/f73 to d4/d99/dfa/f110 0 2024-02-28T16:24:47.511 INFO:tasks.workunit.client.1.smithi153.stdout:0/800: readlink d4/d27/l71 0 2024-02-28T16:24:47.515 INFO:tasks.workunit.client.1.smithi153.stdout:5/809: rename da/dd/d25/d8a/db3/fbf to da/d29/d43/de6/f109 0 2024-02-28T16:24:47.516 INFO:tasks.workunit.client.1.smithi153.stdout:6/809: dwrite d0/d1d/d33/db2/fcd [0,4194304] 0 2024-02-28T16:24:47.516 INFO:tasks.workunit.client.1.smithi153.stdout:2/793: sync 2024-02-28T16:24:47.519 INFO:tasks.workunit.client.1.smithi153.stdout:3/788: dwrite d4/d7d/f3d [4194304,4194304] 0 2024-02-28T16:24:47.519 INFO:tasks.workunit.client.1.smithi153.stdout:4/716: creat d4/d53/d7c/fe4 x:0 0 0 2024-02-28T16:24:47.520 INFO:tasks.workunit.client.1.smithi153.stdout:5/810: symlink da/dd/d25/d41/l10a 0 2024-02-28T16:24:47.532 INFO:tasks.workunit.client.1.smithi153.stdout:5/811: truncate da/dd/d25/d8a/fd8 185317 0 2024-02-28T16:24:47.532 INFO:tasks.workunit.client.1.smithi153.stdout:1/754: dread d0/f16 [0,4194304] 0 2024-02-28T16:24:47.535 INFO:tasks.workunit.client.1.smithi153.stdout:3/789: mknod d4/d13/dcc/c11d 0 2024-02-28T16:24:47.541 INFO:tasks.workunit.client.1.smithi153.stdout:3/790: readlink d4/d7d/ld7 0 2024-02-28T16:24:47.542 INFO:tasks.workunit.client.1.smithi153.stdout:9/747: write d1/d5/d11/d29/f6e [1108466,12584] 0 2024-02-28T16:24:47.542 INFO:tasks.workunit.client.1.smithi153.stdout:7/809: dwrite d1/d25/d27/d7c/db5/ffa [0,4194304] 0 2024-02-28T16:24:47.546 INFO:tasks.workunit.client.1.smithi153.stdout:8/817: sync 2024-02-28T16:24:47.547 INFO:tasks.workunit.client.1.smithi153.stdout:2/794: dwrite d2/d86/da0/ff7 [0,4194304] 0 2024-02-28T16:24:47.547 INFO:tasks.workunit.client.1.smithi153.stdout:6/810: link d0/d1d/d33/f7a d0/d1d/d33/d9c/d68/da2/f11e 0 2024-02-28T16:24:47.552 INFO:tasks.workunit.client.1.smithi153.stdout:6/811: chown d0/d17/f4f 56 1 2024-02-28T16:24:47.555 INFO:tasks.workunit.client.1.smithi153.stdout:8/818: symlink d0/d12/d15/dab/l12a 0 2024-02-28T16:24:47.556 INFO:tasks.workunit.client.1.smithi153.stdout:5/812: truncate da/dd/d25/d41/fa4 2070550 0 2024-02-28T16:24:47.556 INFO:tasks.workunit.client.1.smithi153.stdout:9/748: truncate d1/d5/d11/d1f/d20/d5d/fe5 4656386 0 2024-02-28T16:24:47.557 INFO:tasks.workunit.client.1.smithi153.stdout:8/819: readlink d0/d19/ld6 0 2024-02-28T16:24:47.557 INFO:tasks.workunit.client.1.smithi153.stdout:5/813: readlink da/dd/l76 0 2024-02-28T16:24:47.561 INFO:tasks.workunit.client.1.smithi153.stdout:0/801: dread d4/f8 [0,4194304] 0 2024-02-28T16:24:47.562 INFO:tasks.workunit.client.1.smithi153.stdout:2/795: mkdir d2/d19/d31/d102 0 2024-02-28T16:24:47.563 INFO:tasks.workunit.client.1.smithi153.stdout:6/812: creat d0/d1d/d5d/de9/f11f x:0 0 0 2024-02-28T16:24:47.565 INFO:tasks.workunit.client.1.smithi153.stdout:7/810: symlink d1/d25/df/d26/d3a/d3f/l10e 0 2024-02-28T16:24:47.569 INFO:tasks.workunit.client.1.smithi153.stdout:4/717: dread d4/de/d40/d4d/f5d [0,4194304] 0 2024-02-28T16:24:47.570 INFO:tasks.workunit.client.1.smithi153.stdout:9/749: rmdir d1/d74/d80 39 2024-02-28T16:24:47.576 INFO:tasks.workunit.client.1.smithi153.stdout:2/796: creat d2/d19/d3e/da7/f103 x:0 0 0 2024-02-28T16:24:47.576 INFO:tasks.workunit.client.1.smithi153.stdout:1/755: getdents d0/dd/db2/d80 0 2024-02-28T16:24:47.576 INFO:tasks.workunit.client.1.smithi153.stdout:8/820: read d0/d19/d2b/f72 [298807,27414] 0 2024-02-28T16:24:47.578 INFO:tasks.workunit.client.1.smithi153.stdout:6/813: fsync d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/f80 0 2024-02-28T16:24:47.579 INFO:tasks.workunit.client.1.smithi153.stdout:5/814: dwrite da/de1/ff1 [0,4194304] 0 2024-02-28T16:24:47.583 INFO:tasks.workunit.client.1.smithi153.stdout:2/797: readlink d2/d86/da0/laf 0 2024-02-28T16:24:47.585 INFO:tasks.workunit.client.1.smithi153.stdout:7/811: dread d1/f82 [0,4194304] 0 2024-02-28T16:24:47.588 INFO:tasks.workunit.client.1.smithi153.stdout:5/815: fsync da/dd/f60 0 2024-02-28T16:24:47.590 INFO:tasks.workunit.client.1.smithi153.stdout:6/814: chown d0/d1d/d33/d9c/d48/d72/f8f 4072 1 2024-02-28T16:24:47.590 INFO:tasks.workunit.client.1.smithi153.stdout:3/791: dwrite d4/d8/d1e/d23/f24 [0,4194304] 0 2024-02-28T16:24:47.592 INFO:tasks.workunit.client.1.smithi153.stdout:9/750: link d1/d5/d11/dd4/dbe/fbf d1/d58/ff6 0 2024-02-28T16:24:47.594 INFO:tasks.workunit.client.1.smithi153.stdout:2/798: write d2/d25/d49/f97 [2039891,89633] 0 2024-02-28T16:24:47.594 INFO:tasks.workunit.client.1.smithi153.stdout:4/718: write d4/de/d23/d2b/d4b/dba/d50/daf/fd3 [410399,78950] 0 2024-02-28T16:24:47.597 INFO:tasks.workunit.client.1.smithi153.stdout:1/756: truncate d0/dd/db2/d89/daa/fb4 1409923 0 2024-02-28T16:24:47.598 INFO:tasks.workunit.client.1.smithi153.stdout:6/815: chown d0/d1d/d30/d71/lb7 258835 1 2024-02-28T16:24:47.603 INFO:tasks.workunit.client.1.smithi153.stdout:7/812: dread d1/d25/df/d60/da4/f109 [0,4194304] 0 2024-02-28T16:24:47.608 INFO:tasks.workunit.client.1.smithi153.stdout:8/821: link d0/d19/d2b/d2d/d3f/fbf d0/d12/d67/d88/f12b 0 2024-02-28T16:24:47.611 INFO:tasks.workunit.client.1.smithi153.stdout:1/757: fdatasync d0/dd/f58 0 2024-02-28T16:24:47.616 INFO:tasks.workunit.client.1.smithi153.stdout:2/799: rename d2/d23/d48/df0/d93/d9b to d2/d23/d48/df0/d3b/d87/df8/dd0/d104 0 2024-02-28T16:24:47.616 INFO:tasks.workunit.client.1.smithi153.stdout:0/802: dread d4/d27/d9a/da1/fe8 [0,4194304] 0 2024-02-28T16:24:47.623 INFO:tasks.workunit.client.1.smithi153.stdout:6/816: dwrite d0/d1d/d33/d9c/d48/d72/fca [0,4194304] 0 2024-02-28T16:24:47.627 INFO:tasks.workunit.client.1.smithi153.stdout:0/803: creat d4/d32/d7f/dd6/f111 x:0 0 0 2024-02-28T16:24:47.627 INFO:tasks.workunit.client.1.smithi153.stdout:4/719: write d4/de/d23/f3a [1122763,67852] 0 2024-02-28T16:24:47.629 INFO:tasks.workunit.client.1.smithi153.stdout:2/800: rename d2/d25/l39 to d2/d23/d88/d95/l105 0 2024-02-28T16:24:47.634 INFO:tasks.workunit.client.1.smithi153.stdout:5/816: dwrite da/dd/d25/d41/f49 [0,4194304] 0 2024-02-28T16:24:47.645 INFO:tasks.workunit.client.1.smithi153.stdout:3/792: dwrite d4/d8/d1e/d2a/f89 [0,4194304] 0 2024-02-28T16:24:47.648 INFO:tasks.workunit.client.1.smithi153.stdout:1/758: dread d0/dd/f76 [0,4194304] 0 2024-02-28T16:24:47.648 INFO:tasks.workunit.client.1.smithi153.stdout:8/822: dwrite d0/d12/d15/dab/dd0/de9/d100/f127 [0,4194304] 0 2024-02-28T16:24:47.657 INFO:tasks.workunit.client.1.smithi153.stdout:9/751: dread d1/d74/d80/da8/f25 [0,4194304] 0 2024-02-28T16:24:47.668 INFO:tasks.workunit.client.1.smithi153.stdout:8/823: dwrite d0/d12/f81 [0,4194304] 0 2024-02-28T16:24:47.671 INFO:tasks.workunit.client.1.smithi153.stdout:8/824: chown d0/d12/d67/d88/d85/f129 1433740054 1 2024-02-28T16:24:47.697 INFO:tasks.workunit.client.1.smithi153.stdout:7/813: sync 2024-02-28T16:24:47.698 INFO:tasks.workunit.client.1.smithi153.stdout:7/814: stat d1/d25/d27/d7c/db5 0 2024-02-28T16:24:47.705 INFO:tasks.workunit.client.1.smithi153.stdout:4/720: write d4/de/d23/f30 [362973,119420] 0 2024-02-28T16:24:47.729 INFO:tasks.workunit.client.1.smithi153.stdout:4/721: dread d4/d53/f76 [0,4194304] 0 2024-02-28T16:24:47.740 INFO:tasks.workunit.client.1.smithi153.stdout:8/825: chown d0/d19/d2b/d2d/d3f/d9f/le7 24 1 2024-02-28T16:24:47.753 INFO:tasks.workunit.client.1.smithi153.stdout:8/826: dwrite d0/d12/d67/d88/d8e/d9d/fb7 [0,4194304] 0 2024-02-28T16:24:47.757 INFO:tasks.workunit.client.1.smithi153.stdout:8/827: chown d0/d19/d2b/d2d/f8a 11200 1 2024-02-28T16:24:47.772 INFO:tasks.workunit.client.1.smithi153.stdout:3/793: getdents d4/d49 0 2024-02-28T16:24:47.773 INFO:tasks.workunit.client.1.smithi153.stdout:4/722: creat d4/de/d40/fe5 x:0 0 0 2024-02-28T16:24:47.775 INFO:tasks.workunit.client.1.smithi153.stdout:3/794: truncate d4/d6a/f114 763879 0 2024-02-28T16:24:47.775 INFO:tasks.workunit.client.1.smithi153.stdout:7/815: rmdir d1/d25/df/d26/d3a/d5e/d72/d9c/d102 0 2024-02-28T16:24:47.778 INFO:tasks.workunit.client.1.smithi153.stdout:3/795: write d4/d2c/f9e [290299,4702] 0 2024-02-28T16:24:47.780 INFO:tasks.workunit.client.1.smithi153.stdout:4/723: truncate d4/de/d40/f5a 181555 0 2024-02-28T16:24:47.781 INFO:tasks.workunit.client.1.smithi153.stdout:6/817: rmdir d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4 39 2024-02-28T16:24:47.787 INFO:tasks.workunit.client.1.smithi153.stdout:4/724: truncate d4/de/d23/f4a 408542 0 2024-02-28T16:24:47.789 INFO:tasks.workunit.client.1.smithi153.stdout:4/725: chown d4/d53/d7c/cdc 520832532 1 2024-02-28T16:24:47.793 INFO:tasks.workunit.client.1.smithi153.stdout:6/818: dread d0/d1d/d33/d9c/d2e/f37 [4194304,4194304] 0 2024-02-28T16:24:47.804 INFO:tasks.workunit.client.1.smithi153.stdout:6/819: dwrite d0/d1d/d30/d71/f87 [0,4194304] 0 2024-02-28T16:24:47.809 INFO:tasks.workunit.client.1.smithi153.stdout:6/820: symlink d0/d1d/d33/d9c/d48/d63/d8c/dd7/l120 0 2024-02-28T16:24:47.818 INFO:tasks.workunit.client.1.smithi153.stdout:4/726: symlink d4/de/d23/d2b/d31/le6 0 2024-02-28T16:24:47.820 INFO:tasks.workunit.client.1.smithi153.stdout:2/801: write d2/d23/d36/f51 [3692523,55414] 0 2024-02-28T16:24:47.820 INFO:tasks.workunit.client.1.smithi153.stdout:4/727: chown d4/de/d13/f2c 102513 1 2024-02-28T16:24:47.830 INFO:tasks.workunit.client.1.smithi153.stdout:4/728: creat d4/de/d13/d1b/fe7 x:0 0 0 2024-02-28T16:24:47.830 INFO:tasks.workunit.client.1.smithi153.stdout:4/729: chown d4/d53/d7c/db3 0 1 2024-02-28T16:24:47.832 INFO:tasks.workunit.client.1.smithi153.stdout:4/730: chown d4/de/d23/d2b/d4b/d80/cd7 909025588 1 2024-02-28T16:24:47.835 INFO:tasks.workunit.client.1.smithi153.stdout:0/804: rename d4/f25 to d4/d32/db7/f112 0 2024-02-28T16:24:47.840 INFO:tasks.workunit.client.1.smithi153.stdout:4/731: link d4/de/d23/d2b/c86 d4/de/d23/d2b/d31/dc3/ce8 0 2024-02-28T16:24:47.843 INFO:tasks.workunit.client.1.smithi153.stdout:0/805: creat d4/d32/df0/d108/f113 x:0 0 0 2024-02-28T16:24:47.843 INFO:tasks.workunit.client.1.smithi153.stdout:4/732: chown d4/de/d13/d1b/lb6 2109180 1 2024-02-28T16:24:47.845 INFO:tasks.workunit.client.1.smithi153.stdout:9/752: truncate d1/d74/d80/da8/f46 2215391 0 2024-02-28T16:24:47.850 INFO:tasks.workunit.client.1.smithi153.stdout:9/753: mknod d1/d69/dbb/cf7 0 2024-02-28T16:24:47.851 INFO:tasks.workunit.client.1.smithi153.stdout:1/759: dwrite d0/f14 [0,4194304] 0 2024-02-28T16:24:47.852 INFO:tasks.workunit.client.1.smithi153.stdout:0/806: creat d4/d32/d7f/d8a/dab/d8e/d94/df5/f114 x:0 0 0 2024-02-28T16:24:47.852 INFO:tasks.workunit.client.1.smithi153.stdout:4/733: truncate d4/de/d23/f48 574967 0 2024-02-28T16:24:47.861 INFO:tasks.workunit.client.1.smithi153.stdout:1/760: mkdir d0/dd/db2/de5/d10a 0 2024-02-28T16:24:47.865 INFO:tasks.workunit.client.1.smithi153.stdout:7/816: dwrite d1/d25/d27/f5c [0,4194304] 0 2024-02-28T16:24:47.866 INFO:tasks.workunit.client.1.smithi153.stdout:9/754: dread d1/ff [0,4194304] 0 2024-02-28T16:24:47.866 INFO:tasks.workunit.client.1.smithi153.stdout:5/817: rmdir da/d29 39 2024-02-28T16:24:47.867 INFO:tasks.workunit.client.1.smithi153.stdout:0/807: link d4/d89/f92 d4/d32/dcf/df6/f115 0 2024-02-28T16:24:47.869 INFO:tasks.workunit.client.1.smithi153.stdout:3/796: dwrite d4/d2c/fc1 [0,4194304] 0 2024-02-28T16:24:47.869 INFO:tasks.workunit.client.1.smithi153.stdout:1/761: creat d0/dd/db2/de5/d10a/f10b x:0 0 0 2024-02-28T16:24:47.875 INFO:tasks.workunit.client.1.smithi153.stdout:5/818: unlink da/dd/d25/d8a/dac/f103 0 2024-02-28T16:24:47.875 INFO:tasks.workunit.client.1.smithi153.stdout:3/797: write d4/d8/d1e/d2a/d35/f5f [3573335,52828] 0 2024-02-28T16:24:47.875 INFO:tasks.workunit.client.1.smithi153.stdout:8/828: mknod d0/d19/d2b/c12c 0 2024-02-28T16:24:47.877 INFO:tasks.workunit.client.1.smithi153.stdout:9/755: rmdir d1/d5/d11/d29/d79 39 2024-02-28T16:24:47.881 INFO:tasks.workunit.client.1.smithi153.stdout:9/756: dread - d1/d5/d11/d1f/d20/d99/dae/fd9 zero size 2024-02-28T16:24:47.881 INFO:tasks.workunit.client.1.smithi153.stdout:0/808: rename d4/d32/d7f/d8a/fc6 to d4/d32/dd9/f116 0 2024-02-28T16:24:47.883 INFO:tasks.workunit.client.1.smithi153.stdout:7/817: creat d1/d25/df/d26/d3a/d3f/f10f x:0 0 0 2024-02-28T16:24:47.886 INFO:tasks.workunit.client.1.smithi153.stdout:8/829: chown d0/d25/d79/l126 77 1 2024-02-28T16:24:47.887 INFO:tasks.workunit.client.1.smithi153.stdout:6/821: sync 2024-02-28T16:24:47.890 INFO:tasks.workunit.client.1.smithi153.stdout:2/802: truncate d2/d23/f29 1183357 0 2024-02-28T16:24:47.892 INFO:tasks.workunit.client.1.smithi153.stdout:1/762: creat d0/dc1/de4/d109/f10c x:0 0 0 2024-02-28T16:24:47.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:47 smithi153 ceph-mon[35341]: Reconfiguring prometheus.smithi023 (dependencies changed)... 2024-02-28T16:24:47.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:47 smithi153 ceph-mon[35341]: Reconfiguring daemon prometheus.smithi023 on smithi023 2024-02-28T16:24:47.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:47 smithi153 ceph-mon[35341]: pgmap v13: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 133 MiB/s wr, 304 op/s 2024-02-28T16:24:47.897 INFO:tasks.workunit.client.1.smithi153.stdout:5/819: creat da/dd/f10b x:0 0 0 2024-02-28T16:24:47.899 INFO:tasks.workunit.client.1.smithi153.stdout:4/734: mknod d4/de/d23/d2b/ce9 0 2024-02-28T16:24:47.903 INFO:tasks.workunit.client.1.smithi153.stdout:6/822: dwrite d0/d1d/d33/d9c/d48/d72/fca [4194304,4194304] 0 2024-02-28T16:24:47.909 INFO:tasks.workunit.client.1.smithi153.stdout:1/763: creat d0/dd/dd5/f10d x:0 0 0 2024-02-28T16:24:47.912 INFO:tasks.workunit.client.1.smithi153.stdout:1/764: truncate d0/dd/f2d 1439912 0 2024-02-28T16:24:47.912 INFO:tasks.workunit.client.1.smithi153.stdout:7/818: rename d1/d25/df/d26/f92 to d1/d25/df/f110 0 2024-02-28T16:24:47.915 INFO:tasks.workunit.client.1.smithi153.stdout:3/798: getdents d4/d7d/d41 0 2024-02-28T16:24:47.918 INFO:tasks.workunit.client.1.smithi153.stdout:3/799: truncate d4/d2c/f7e 4711687 0 2024-02-28T16:24:47.921 INFO:tasks.workunit.client.1.smithi153.stdout:5/820: creat da/d29/d43/d5a/d77/f10c x:0 0 0 2024-02-28T16:24:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:47 smithi023 ceph-mon[29137]: Reconfiguring prometheus.smithi023 (dependencies changed)... 2024-02-28T16:24:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:47 smithi023 ceph-mon[29137]: Reconfiguring daemon prometheus.smithi023 on smithi023 2024-02-28T16:24:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:47 smithi023 ceph-mon[29137]: pgmap v13: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 133 MiB/s wr, 304 op/s 2024-02-28T16:24:47.926 INFO:tasks.workunit.client.1.smithi153.stdout:8/830: getdents d0/d19/d2b 0 2024-02-28T16:24:47.930 INFO:tasks.workunit.client.1.smithi153.stdout:0/809: truncate d4/d27/f4a 3134081 0 2024-02-28T16:24:47.931 INFO:tasks.workunit.client.1.smithi153.stdout:1/765: unlink d0/d62/d66/d8e/ld8 0 2024-02-28T16:24:47.933 INFO:tasks.workunit.client.1.smithi153.stdout:4/735: creat d4/de/fea x:0 0 0 2024-02-28T16:24:47.933 INFO:tasks.workunit.client.1.smithi153.stdout:7/819: creat d1/d25/df/d26/d3a/d81/f111 x:0 0 0 2024-02-28T16:24:47.934 INFO:tasks.workunit.client.1.smithi153.stdout:4/736: chown d4/de/f56 717612378 1 2024-02-28T16:24:47.935 INFO:tasks.workunit.client.1.smithi153.stdout:8/831: creat d0/d25/f12d x:0 0 0 2024-02-28T16:24:47.935 INFO:tasks.workunit.client.1.smithi153.stdout:2/803: link d2/l59 d2/d23/d48/df0/d3b/d87/l106 0 2024-02-28T16:24:47.935 INFO:tasks.workunit.client.1.smithi153.stdout:7/820: fsync d1/d25/d27/d7c/db5/ffa 0 2024-02-28T16:24:47.939 INFO:tasks.workunit.client.1.smithi153.stdout:0/810: unlink d4/f14 0 2024-02-28T16:24:47.946 INFO:tasks.workunit.client.1.smithi153.stdout:6/823: write d0/d1d/d33/d9c/d48/d63/f9f [330110,81648] 0 2024-02-28T16:24:47.950 INFO:tasks.workunit.client.1.smithi153.stdout:2/804: dwrite d2/d23/d88/fd6 [0,4194304] 0 2024-02-28T16:24:47.954 INFO:tasks.workunit.client.1.smithi153.stdout:8/832: symlink d0/d12/d67/d88/d85/db6/l12e 0 2024-02-28T16:24:47.955 INFO:tasks.workunit.client.1.smithi153.stdout:7/821: creat d1/d25/dc/d50/d66/f112 x:0 0 0 2024-02-28T16:24:47.957 INFO:tasks.workunit.client.1.smithi153.stdout:2/805: write d2/d23/d48/df0/d3b/d87/fad [2216831,45006] 0 2024-02-28T16:24:47.963 INFO:tasks.workunit.client.1.smithi153.stdout:4/737: creat d4/de/d23/d2b/d31/dc3/feb x:0 0 0 2024-02-28T16:24:47.963 INFO:tasks.workunit.client.1.smithi153.stdout:5/821: dwrite da/d29/d43/d5a/d77/fba [0,4194304] 0 2024-02-28T16:24:47.967 INFO:tasks.workunit.client.1.smithi153.stdout:3/800: link d4/d8/d1e/d23/c52 d4/d13/d28/d99/c11e 0 2024-02-28T16:24:47.968 INFO:tasks.workunit.client.1.smithi153.stdout:6/824: dwrite d0/d1d/d33/d9c/d48/d63/f10f [0,4194304] 0 2024-02-28T16:24:47.969 INFO:tasks.workunit.client.1.smithi153.stdout:1/766: dread d0/fe [4194304,4194304] 0 2024-02-28T16:24:47.972 INFO:tasks.workunit.client.1.smithi153.stdout:2/806: creat d2/d86/da0/dce/f107 x:0 0 0 2024-02-28T16:24:47.975 INFO:tasks.workunit.client.1.smithi153.stdout:5/822: symlink da/dd/dd1/ddd/l10d 0 2024-02-28T16:24:47.975 INFO:tasks.workunit.client.1.smithi153.stdout:2/807: truncate d2/d19/d31/dd1/fd8 1745966 0 2024-02-28T16:24:47.977 INFO:tasks.workunit.client.1.smithi153.stdout:2/808: dread - d2/d19/d3e/db9/fda zero size 2024-02-28T16:24:47.979 INFO:tasks.workunit.client.1.smithi153.stdout:5/823: write da/dd/d25/d8a/dac/dc6/f104 [1851387,41864] 0 2024-02-28T16:24:47.981 INFO:tasks.workunit.client.1.smithi153.stdout:8/833: mknod d0/d12/d15/c12f 0 2024-02-28T16:24:47.982 INFO:tasks.workunit.client.1.smithi153.stdout:8/834: stat d0/da5 0 2024-02-28T16:24:47.985 INFO:tasks.workunit.client.1.smithi153.stdout:6/825: symlink d0/d1d/d33/d9c/d68/l121 0 2024-02-28T16:24:47.988 INFO:tasks.workunit.client.1.smithi153.stdout:1/767: creat d0/d3d/d4a/dd9/f10e x:0 0 0 2024-02-28T16:24:47.988 INFO:tasks.workunit.client.1.smithi153.stdout:6/826: read d0/d1d/d33/d9c/d68/dcb/fd3 [725992,64607] 0 2024-02-28T16:24:47.994 INFO:tasks.workunit.client.1.smithi153.stdout:7/822: getdents d1/d25/df/d5a/de6 0 2024-02-28T16:24:47.995 INFO:tasks.workunit.client.1.smithi153.stdout:5/824: read da/dd/d54/f69 [1149129,52997] 0 2024-02-28T16:24:47.998 INFO:tasks.workunit.client.1.smithi153.stdout:8/835: creat d0/d12/d67/d88/d96/dfc/f130 x:0 0 0 2024-02-28T16:24:47.998 INFO:tasks.workunit.client.1.smithi153.stdout:5/825: read da/d29/f59 [3730409,17292] 0 2024-02-28T16:24:47.999 INFO:tasks.workunit.client.1.smithi153.stdout:5/826: stat da/f19 0 2024-02-28T16:24:47.999 INFO:tasks.workunit.client.1.smithi153.stdout:8/836: fdatasync d0/d12/d67/d30/d63/f125 0 2024-02-28T16:24:48.004 INFO:tasks.workunit.client.1.smithi153.stdout:6/827: mknod d0/d1d/d33/d9c/d48/d63/d8c/dd1/c122 0 2024-02-28T16:24:48.005 INFO:tasks.workunit.client.1.smithi153.stdout:3/801: write d4/d8/d1e/f42 [424828,20783] 0 2024-02-28T16:24:48.006 INFO:tasks.workunit.client.1.smithi153.stdout:0/811: write d4/d27/f3a [2699172,123626] 0 2024-02-28T16:24:48.007 INFO:tasks.workunit.client.1.smithi153.stdout:7/823: mknod d1/d25/df/d60/da4/c113 0 2024-02-28T16:24:48.018 INFO:tasks.workunit.client.1.smithi153.stdout:4/738: getdents d4/de/d47 0 2024-02-28T16:24:48.019 INFO:tasks.workunit.client.1.smithi153.stdout:8/837: symlink d0/d10c/l131 0 2024-02-28T16:24:48.020 INFO:tasks.workunit.client.1.smithi153.stdout:6/828: dwrite d0/d1d/d33/d9c/d2e/d99/fbb [0,4194304] 0 2024-02-28T16:24:48.021 INFO:tasks.workunit.client.1.smithi153.stdout:4/739: write d4/de/d13/f35 [423137,63572] 0 2024-02-28T16:24:48.021 INFO:tasks.workunit.client.1.smithi153.stdout:7/824: dwrite d1/d25/d27/d7c/db5/fe9 [0,4194304] 0 2024-02-28T16:24:48.024 INFO:tasks.workunit.client.1.smithi153.stdout:5/827: truncate da/dd/d25/d8a/fae 689701 0 2024-02-28T16:24:48.024 INFO:tasks.workunit.client.1.smithi153.stdout:1/768: symlink d0/dd/db2/de5/l10f 0 2024-02-28T16:24:48.026 INFO:tasks.workunit.client.1.smithi153.stdout:3/802: mkdir d4/d13/d28/d99/d11f 0 2024-02-28T16:24:48.028 INFO:tasks.workunit.client.1.smithi153.stdout:5/828: readlink da/dd/d25/d8a/dac/dc7/ld0 0 2024-02-28T16:24:48.030 INFO:tasks.workunit.client.1.smithi153.stdout:5/829: readlink da/d29/d43/d5a/dbe/la6 0 2024-02-28T16:24:48.033 INFO:tasks.workunit.client.1.smithi153.stdout:8/838: mkdir d0/d25/d132 0 2024-02-28T16:24:48.040 INFO:tasks.workunit.client.1.smithi153.stdout:4/740: mkdir d4/de/d23/d2b/d31/ddf/dec 0 2024-02-28T16:24:48.046 INFO:tasks.workunit.client.1.smithi153.stdout:6/829: mknod d0/c123 0 2024-02-28T16:24:48.047 INFO:tasks.workunit.client.1.smithi153.stdout:1/769: dwrite d0/dd/db2/de5/d10a/f10b [0,4194304] 0 2024-02-28T16:24:48.049 INFO:tasks.workunit.client.1.smithi153.stdout:7/825: dread d1/d25/df/d26/d3a/f98 [0,4194304] 0 2024-02-28T16:24:48.051 INFO:tasks.workunit.client.1.smithi153.stdout:7/826: chown d1/d25/df/f8f 199295 1 2024-02-28T16:24:48.055 INFO:tasks.workunit.client.1.smithi153.stdout:5/830: rename da/c6a to da/d29/d43/de6/c10e 0 2024-02-28T16:24:48.060 INFO:tasks.workunit.client.1.smithi153.stdout:0/812: getdents d4/d32 0 2024-02-28T16:24:48.062 INFO:tasks.workunit.client.1.smithi153.stdout:3/803: creat d4/d8/d1e/f120 x:0 0 0 2024-02-28T16:24:48.063 INFO:tasks.workunit.client.1.smithi153.stdout:4/741: dwrite d4/de/d47/d5e/d62/f98 [0,4194304] 0 2024-02-28T16:24:48.066 INFO:tasks.workunit.client.1.smithi153.stdout:4/742: write d4/d53/d7c/db3/fce [574138,103014] 0 2024-02-28T16:24:48.066 INFO:tasks.workunit.client.1.smithi153.stdout:8/839: rename d0/d19/d2b/d2d/f70 to d0/d19/d2b/d2d/d3f/d9f/dcc/d104/f133 0 2024-02-28T16:24:48.067 INFO:tasks.workunit.client.1.smithi153.stdout:5/831: creat da/dd/dd1/f10f x:0 0 0 2024-02-28T16:24:48.070 INFO:tasks.workunit.client.1.smithi153.stdout:3/804: creat d4/d13/d28/dcd/dda/f121 x:0 0 0 2024-02-28T16:24:48.076 INFO:tasks.workunit.client.1.smithi153.stdout:0/813: creat d4/d32/d7f/dd6/dff/f117 x:0 0 0 2024-02-28T16:24:48.078 INFO:tasks.workunit.client.1.smithi153.stdout:5/832: rmdir da/dd/d25/d41/d7c 39 2024-02-28T16:24:48.079 INFO:tasks.workunit.client.1.smithi153.stdout:4/743: symlink d4/de/d47/d5e/d62/led 0 2024-02-28T16:24:48.080 INFO:tasks.workunit.client.1.smithi153.stdout:1/770: dwrite d0/d3d/d4a/d59/d9a/fcf [0,4194304] 0 2024-02-28T16:24:48.082 INFO:tasks.workunit.client.1.smithi153.stdout:9/757: sync 2024-02-28T16:24:48.082 INFO:tasks.workunit.client.1.smithi153.stdout:8/840: mkdir d0/d12/d67/d88/d85/db6/d134 0 2024-02-28T16:24:48.083 INFO:tasks.workunit.client.1.smithi153.stdout:8/841: readlink d0/d12/d15/dab/le2 0 2024-02-28T16:24:48.084 INFO:tasks.workunit.client.1.smithi153.stdout:8/842: readlink d0/d19/ld6 0 2024-02-28T16:24:48.086 INFO:tasks.workunit.client.1.smithi153.stdout:5/833: symlink da/dd/d54/db0/df0/l110 0 2024-02-28T16:24:48.090 INFO:tasks.workunit.client.1.smithi153.stdout:1/771: creat d0/dd/db2/d89/dc7/f110 x:0 0 0 2024-02-28T16:24:48.096 INFO:tasks.workunit.client.1.smithi153.stdout:5/834: creat da/dd/dd1/ddd/f111 x:0 0 0 2024-02-28T16:24:48.102 INFO:tasks.workunit.client.1.smithi153.stdout:6/830: rename d0/d66/d85/fac to d0/d1d/d33/d9c/d48/f124 0 2024-02-28T16:24:48.104 INFO:tasks.workunit.client.1.smithi153.stdout:6/831: chown d0/d1d/d33/d9c/d2e/d99/ddf/da4/ld6 404193 1 2024-02-28T16:24:48.106 INFO:tasks.workunit.client.1.smithi153.stdout:8/843: mkdir d0/d12/d67/d88/d85/db6/d134/d135 0 2024-02-28T16:24:48.107 INFO:tasks.workunit.client.1.smithi153.stdout:5/835: mknod da/dd/d25/d8a/dac/dc6/c112 0 2024-02-28T16:24:48.109 INFO:tasks.workunit.client.1.smithi153.stdout:4/744: rename d4/de/d23/f3a to d4/d53/d7c/db3/fee 0 2024-02-28T16:24:48.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/827: truncate d1/d25/d27/d7c/db5/fe9 2161929 0 2024-02-28T16:24:48.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/828: write d1/d25/fcd [5036335,116824] 0 2024-02-28T16:24:48.117 INFO:tasks.workunit.client.1.smithi153.stdout:6/832: creat d0/d1d/d33/d9c/d2e/d99/ddf/da4/f125 x:0 0 0 2024-02-28T16:24:48.120 INFO:tasks.workunit.client.1.smithi153.stdout:1/772: rename d0/d3d/d4a to d0/dd/d111 0 2024-02-28T16:24:48.124 INFO:tasks.workunit.client.1.smithi153.stdout:6/833: rmdir d0/d1d/d5d/de9 39 2024-02-28T16:24:48.124 INFO:tasks.workunit.client.1.smithi153.stdout:7/829: mknod d1/d25/df/d5a/de6/c114 0 2024-02-28T16:24:48.125 INFO:tasks.workunit.client.1.smithi153.stdout:4/745: rename d4/de/d23/d2b/d4b/dba/d50/daf to d4/de/d23/d2b/d4b/d80/d9e/def 0 2024-02-28T16:24:48.132 INFO:tasks.workunit.client.1.smithi153.stdout:6/834: mkdir d0/d1d/d33/d9c/d48/d72/d126 0 2024-02-28T16:24:48.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/805: write d4/d8/d1e/d63/f98 [732554,38602] 0 2024-02-28T16:24:48.139 INFO:tasks.workunit.client.1.smithi153.stdout:7/830: rename d1/d25/f9 to d1/d25/df/d60/da4/dee/f115 0 2024-02-28T16:24:48.139 INFO:tasks.workunit.client.1.smithi153.stdout:3/806: write d4/d8/f1c [4901550,35905] 0 2024-02-28T16:24:48.146 INFO:tasks.workunit.client.1.smithi153.stdout:3/807: fsync d4/d13/d28/fdc 0 2024-02-28T16:24:48.151 INFO:tasks.workunit.client.1.smithi153.stdout:9/758: write d1/d5/d11/dd4/dbe/fbf [1663540,17074] 0 2024-02-28T16:24:48.151 INFO:tasks.workunit.client.1.smithi153.stdout:0/814: dwrite d4/d27/f47 [0,4194304] 0 2024-02-28T16:24:48.157 INFO:tasks.workunit.client.1.smithi153.stdout:7/831: symlink d1/d25/df/d26/d3a/d95/d97/l116 0 2024-02-28T16:24:48.158 INFO:tasks.workunit.client.1.smithi153.stdout:6/835: truncate d0/d1d/d33/d9c/d68/da2/f11e 1311938 0 2024-02-28T16:24:48.159 INFO:tasks.workunit.client.1.smithi153.stdout:5/836: dread da/dd/f93 [0,4194304] 0 2024-02-28T16:24:48.159 INFO:tasks.workunit.client.1.smithi153.stdout:3/808: creat d4/d13/d28/dcd/dda/f122 x:0 0 0 2024-02-28T16:24:48.161 INFO:tasks.workunit.client.1.smithi153.stdout:0/815: fdatasync d4/f3e 0 2024-02-28T16:24:48.163 INFO:tasks.workunit.client.1.smithi153.stdout:2/809: sync 2024-02-28T16:24:48.163 INFO:tasks.workunit.client.1.smithi153.stdout:9/759: read d1/d69/f94 [2708585,28924] 0 2024-02-28T16:24:48.166 INFO:tasks.workunit.client.1.smithi153.stdout:3/809: read - d4/d8/d1e/d2a/d35/d54/fd4 zero size 2024-02-28T16:24:48.170 INFO:tasks.workunit.client.1.smithi153.stdout:6/836: truncate d0/d1d/d5d/d106/f11c 560811 0 2024-02-28T16:24:48.172 INFO:tasks.workunit.client.1.smithi153.stdout:6/837: chown d0/d1d/d33/d9c/d68/dcb 33310 1 2024-02-28T16:24:48.174 INFO:tasks.workunit.client.1.smithi153.stdout:7/832: creat d1/d25/df/d26/d3a/d81/f117 x:0 0 0 2024-02-28T16:24:48.174 INFO:tasks.workunit.client.1.smithi153.stdout:3/810: truncate d4/d8/d1e/d2a/d55/da3/fe4 814565 0 2024-02-28T16:24:48.179 INFO:tasks.workunit.client.1.smithi153.stdout:1/773: dread d0/d3d/f72 [0,4194304] 0 2024-02-28T16:24:48.181 INFO:tasks.workunit.client.1.smithi153.stdout:0/816: creat d4/d99/da5/dd4/f118 x:0 0 0 2024-02-28T16:24:48.183 INFO:tasks.workunit.client.1.smithi153.stdout:1/774: write d0/d3d/f7d [747396,126051] 0 2024-02-28T16:24:48.185 INFO:tasks.workunit.client.1.smithi153.stdout:9/760: rename d1/d5/d27/fc5 to d1/d5/d11/d1f/d20/ff8 0 2024-02-28T16:24:48.186 INFO:tasks.workunit.client.1.smithi153.stdout:1/775: readlink d0/dd/d111/l9d 0 2024-02-28T16:24:48.187 INFO:tasks.workunit.client.1.smithi153.stdout:5/837: mkdir da/d29/d43/d113 0 2024-02-28T16:24:48.191 INFO:tasks.workunit.client.1.smithi153.stdout:1/776: fdatasync d0/dd/db2/dcc/ff6 0 2024-02-28T16:24:48.192 INFO:tasks.workunit.client.1.smithi153.stdout:2/810: dwrite d2/d19/d31/dd1/fd8 [0,4194304] 0 2024-02-28T16:24:48.192 INFO:tasks.workunit.client.1.smithi153.stdout:7/833: creat d1/d25/df/d26/d76/f118 x:0 0 0 2024-02-28T16:24:48.194 INFO:tasks.workunit.client.1.smithi153.stdout:3/811: symlink d4/d8/d1e/d23/da0/l123 0 2024-02-28T16:24:48.194 INFO:tasks.workunit.client.1.smithi153.stdout:6/838: read d0/d17/f28 [502576,15928] 0 2024-02-28T16:24:48.195 INFO:tasks.workunit.client.1.smithi153.stdout:5/838: truncate da/dd/d25/d8a/fc8 901956 0 2024-02-28T16:24:48.197 INFO:tasks.workunit.client.1.smithi153.stdout:3/812: chown d4/d7d/d70/cb7 993831 1 2024-02-28T16:24:48.198 INFO:tasks.workunit.client.1.smithi153.stdout:3/813: stat c3 0 2024-02-28T16:24:48.198 INFO:tasks.workunit.client.1.smithi153.stdout:5/839: chown da/dd/d25/fe3 966163 1 2024-02-28T16:24:48.200 INFO:tasks.workunit.client.1.smithi153.stdout:4/746: write d4/d53/d7c/f9d [583060,49742] 0 2024-02-28T16:24:48.201 INFO:tasks.workunit.client.1.smithi153.stdout:3/814: fsync d4/d7d/d41/d71/f104 0 2024-02-28T16:24:48.203 INFO:tasks.workunit.client.1.smithi153.stdout:8/844: sync 2024-02-28T16:24:48.204 INFO:tasks.workunit.client.1.smithi153.stdout:4/747: fdatasync d4/de/d23/d2b/d9b/faa 0 2024-02-28T16:24:48.205 INFO:tasks.workunit.client.1.smithi153.stdout:9/761: chown d1/d5/d11/d1f/d43/cf0 54502793 1 2024-02-28T16:24:48.208 INFO:tasks.workunit.client.1.smithi153.stdout:2/811: symlink d2/d23/d48/df0/d93/l108 0 2024-02-28T16:24:48.212 INFO:tasks.workunit.client.1.smithi153.stdout:5/840: readlink da/d29/d43/l85 0 2024-02-28T16:24:48.213 INFO:tasks.workunit.client.1.smithi153.stdout:6/839: mknod d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/d96/c127 0 2024-02-28T16:24:48.215 INFO:tasks.workunit.client.1.smithi153.stdout:9/762: dread d1/d5/d11/d1f/d62/fb4 [0,4194304] 0 2024-02-28T16:24:48.222 INFO:tasks.workunit.client.1.smithi153.stdout:6/840: stat d0/d1d/d33/d9c/d48/d63/f10f 0 2024-02-28T16:24:48.225 INFO:tasks.workunit.client.1.smithi153.stdout:9/763: fdatasync d1/d5/d11/d64/f84 0 2024-02-28T16:24:48.230 INFO:tasks.workunit.client.1.smithi153.stdout:8/845: dwrite d0/ff [0,4194304] 0 2024-02-28T16:24:48.233 INFO:tasks.workunit.client.1.smithi153.stdout:4/748: dwrite d4/de/d40/d4d/f5d [0,4194304] 0 2024-02-28T16:24:48.236 INFO:tasks.workunit.client.1.smithi153.stdout:4/749: chown d4/de/d23/d2b/d31/da2/da5/db2/dde 65588435 1 2024-02-28T16:24:48.239 INFO:tasks.workunit.client.1.smithi153.stdout:4/750: dread - d4/d53/d7c/da4/fbb zero size 2024-02-28T16:24:48.246 INFO:tasks.workunit.client.1.smithi153.stdout:2/812: dread d2/d25/d49/da3/fbd [0,4194304] 0 2024-02-28T16:24:48.249 INFO:tasks.workunit.client.1.smithi153.stdout:9/764: dread d1/fd7 [0,4194304] 0 2024-02-28T16:24:48.272 INFO:tasks.workunit.client.1.smithi153.stdout:3/815: sync 2024-02-28T16:24:48.273 INFO:tasks.workunit.client.1.smithi153.stdout:3/816: fdatasync d4/d8/d1e/d2a/d55/da3/fe4 0 2024-02-28T16:24:48.279 INFO:tasks.workunit.client.1.smithi153.stdout:9/765: dread d1/d5/d11/d1f/d20/d5d/f5f [0,4194304] 0 2024-02-28T16:24:48.343 INFO:tasks.workunit.client.1.smithi153.stdout:0/817: dwrite d4/d32/d7f/d8a/dab/d8e/d90/f8f [0,4194304] 0 2024-02-28T16:24:48.350 INFO:tasks.workunit.client.1.smithi153.stdout:1/777: truncate d0/dd/db2/d89/daa/fc8 21572 0 2024-02-28T16:24:48.355 INFO:tasks.workunit.client.1.smithi153.stdout:3/817: sync 2024-02-28T16:24:48.377 INFO:tasks.workunit.client.1.smithi153.stdout:1/778: dwrite d0/d3d/fa1 [0,4194304] 0 2024-02-28T16:24:48.388 INFO:tasks.workunit.client.1.smithi153.stdout:7/834: creat d1/d25/f119 x:0 0 0 2024-02-28T16:24:48.389 INFO:tasks.workunit.client.1.smithi153.stdout:6/841: mkdir d0/d1d/d33/d9c/d48/d72/d128 0 2024-02-28T16:24:48.389 INFO:tasks.workunit.client.1.smithi153.stdout:5/841: creat da/dd/d25/d8a/dac/dc6/f114 x:0 0 0 2024-02-28T16:24:48.390 INFO:tasks.workunit.client.1.smithi153.stdout:8/846: rename d0/d12/d67/d30/d63/d74/db4 to d0/d12/d67/d88/d85/db6/d134/d136 0 2024-02-28T16:24:48.391 INFO:tasks.workunit.client.1.smithi153.stdout:4/751: readlink d4/de/d23/d2b/d4b/dba/d50/l7a 0 2024-02-28T16:24:48.397 INFO:tasks.workunit.client.1.smithi153.stdout:9/766: read d1/d5/d27/fb8 [506799,99173] 0 2024-02-28T16:24:48.397 INFO:tasks.workunit.client.1.smithi153.stdout:7/835: truncate d1/f8d 4969585 0 2024-02-28T16:24:48.398 INFO:tasks.workunit.client.1.smithi153.stdout:5/842: write da/dd/d25/d8a/db3/ffc [144666,63437] 0 2024-02-28T16:24:48.399 INFO:tasks.workunit.client.1.smithi153.stdout:0/818: creat d4/d32/dcf/f119 x:0 0 0 2024-02-28T16:24:48.403 INFO:tasks.workunit.client.1.smithi153.stdout:5/843: readlink da/dd/d54/l97 0 2024-02-28T16:24:48.405 INFO:tasks.workunit.client.1.smithi153.stdout:7/836: truncate d1/d25/dc/d50/fe4 562511 0 2024-02-28T16:24:48.406 INFO:tasks.workunit.client.1.smithi153.stdout:1/779: symlink d0/dd/d111/dd9/de1/l112 0 2024-02-28T16:24:48.408 INFO:tasks.workunit.client.1.smithi153.stdout:0/819: truncate d4/d32/d7f/d8a/dab/fec 719718 0 2024-02-28T16:24:48.409 INFO:tasks.workunit.client.1.smithi153.stdout:6/842: chown d0/d1d/d33/d9c/d2e/cdd 65183 1 2024-02-28T16:24:48.410 INFO:tasks.workunit.client.1.smithi153.stdout:4/752: fsync d4/d53/d7c/db3/fee 0 2024-02-28T16:24:48.411 INFO:tasks.workunit.client.1.smithi153.stdout:5/844: dread da/dd/d25/d8a/db3/ffc [0,4194304] 0 2024-02-28T16:24:48.411 INFO:tasks.workunit.client.1.smithi153.stdout:7/837: write d1/d25/df/d26/d3a/d3f/f74 [731590,102528] 0 2024-02-28T16:24:48.412 INFO:tasks.workunit.client.1.smithi153.stdout:0/820: write d4/d32/df0/f105 [845020,70659] 0 2024-02-28T16:24:48.414 INFO:tasks.workunit.client.1.smithi153.stdout:9/767: fdatasync d1/d5/d27/fb8 0 2024-02-28T16:24:48.419 INFO:tasks.workunit.client.1.smithi153.stdout:5/845: read da/fc3 [6013132,95944] 0 2024-02-28T16:24:48.423 INFO:tasks.workunit.client.1.smithi153.stdout:6/843: mkdir d0/d1d/d33/d9c/d2e/d99/d129 0 2024-02-28T16:24:48.425 INFO:tasks.workunit.client.1.smithi153.stdout:0/821: read - d4/d32/fd1 zero size 2024-02-28T16:24:48.426 INFO:tasks.workunit.client.1.smithi153.stdout:7/838: unlink d1/d25/d27/d43/cd8 0 2024-02-28T16:24:48.428 INFO:tasks.workunit.client.1.smithi153.stdout:2/813: dread d2/d25/f6d [4194304,4194304] 0 2024-02-28T16:24:48.433 INFO:tasks.workunit.client.1.smithi153.stdout:8/847: link d0/d12/d67/d88/d96/fef d0/f137 0 2024-02-28T16:24:48.436 INFO:tasks.workunit.client.1.smithi153.stdout:5/846: creat da/dd/d25/d8a/f115 x:0 0 0 2024-02-28T16:24:48.443 INFO:tasks.workunit.client.1.smithi153.stdout:7/839: dwrite d1/d25/dc/fe1 [0,4194304] 0 2024-02-28T16:24:48.443 INFO:tasks.workunit.client.1.smithi153.stdout:6/844: rmdir d0/d1d/d33/d9c/d68/dcb 39 2024-02-28T16:24:48.445 INFO:tasks.workunit.client.1.smithi153.stdout:7/840: chown d1/d25/df/d60 453 1 2024-02-28T16:24:48.446 INFO:tasks.workunit.client.1.smithi153.stdout:6/845: write d0/d1d/d33/d9c/d48/d63/f92 [123825,38811] 0 2024-02-28T16:24:48.447 INFO:tasks.workunit.client.1.smithi153.stdout:0/822: mknod d4/d32/d7f/db3/c11a 0 2024-02-28T16:24:48.452 INFO:tasks.workunit.client.1.smithi153.stdout:4/753: creat d4/de/d23/d2b/d31/da2/da5/db2/dc2/ff0 x:0 0 0 2024-02-28T16:24:48.453 INFO:tasks.workunit.client.1.smithi153.stdout:4/754: chown d4/fbc 149517 1 2024-02-28T16:24:48.457 INFO:tasks.workunit.client.1.smithi153.stdout:2/814: fdatasync d2/d19/d5d/f84 0 2024-02-28T16:24:48.460 INFO:tasks.workunit.client.1.smithi153.stdout:9/768: creat d1/d69/dbb/dbc/ff9 x:0 0 0 2024-02-28T16:24:48.463 INFO:tasks.workunit.client.1.smithi153.stdout:2/815: dread d2/d23/d48/df0/d3b/d5e/fc8 [0,4194304] 0 2024-02-28T16:24:48.464 INFO:tasks.workunit.client.1.smithi153.stdout:9/769: write d1/d5/d11/d64/fa6 [1873171,118682] 0 2024-02-28T16:24:48.466 INFO:tasks.workunit.client.1.smithi153.stdout:0/823: dwrite d4/d99/da5/dd4/ffd [0,4194304] 0 2024-02-28T16:24:48.467 INFO:tasks.workunit.client.1.smithi153.stdout:3/818: truncate d4/d8/d1e/d64/ffe 302320 0 2024-02-28T16:24:48.471 INFO:tasks.workunit.client.1.smithi153.stdout:7/841: mkdir d1/d25/dc/d50/d11a 0 2024-02-28T16:24:48.477 INFO:tasks.workunit.client.1.smithi153.stdout:1/780: write d0/d62/d66/d8e/f97 [633398,72129] 0 2024-02-28T16:24:48.483 INFO:tasks.workunit.client.1.smithi153.stdout:5/847: creat da/d29/d43/d113/f116 x:0 0 0 2024-02-28T16:24:48.487 INFO:tasks.workunit.client.1.smithi153.stdout:2/816: symlink d2/d23/d88/dbf/l109 0 2024-02-28T16:24:48.493 INFO:tasks.workunit.client.1.smithi153.stdout:3/819: stat d4/d8/d1e/d23/da0/cbc 0 2024-02-28T16:24:48.501 INFO:tasks.workunit.client.1.smithi153.stdout:8/848: truncate d0/d12/d67/d88/d96/fef 497872 0 2024-02-28T16:24:48.504 INFO:tasks.workunit.client.1.smithi153.stdout:4/755: creat d4/de/d23/d2b/d31/ddf/dec/ff1 x:0 0 0 2024-02-28T16:24:48.505 INFO:tasks.workunit.client.1.smithi153.stdout:0/824: dread d4/d27/f7c [0,4194304] 0 2024-02-28T16:24:48.506 INFO:tasks.workunit.client.1.smithi153.stdout:1/781: fdatasync d0/d3d/f43 0 2024-02-28T16:24:48.513 INFO:tasks.workunit.client.1.smithi153.stdout:4/756: dread d4/de/f56 [0,4194304] 0 2024-02-28T16:24:48.516 INFO:tasks.workunit.client.1.smithi153.stdout:4/757: write d4/de/d23/fcf [5186153,77104] 0 2024-02-28T16:24:48.520 INFO:tasks.workunit.client.1.smithi153.stdout:7/842: creat d1/d25/dc/d50/d11a/f11b x:0 0 0 2024-02-28T16:24:48.520 INFO:tasks.workunit.client.1.smithi153.stdout:6/846: creat d0/d1d/d33/d9c/f12a x:0 0 0 2024-02-28T16:24:48.522 INFO:tasks.workunit.client.1.smithi153.stdout:6/847: fdatasync d0/d1d/d30/f58 0 2024-02-28T16:24:48.523 INFO:tasks.workunit.client.1.smithi153.stdout:1/782: symlink d0/dd/d111/dd9/l113 0 2024-02-28T16:24:48.525 INFO:tasks.workunit.client.1.smithi153.stdout:9/770: creat d1/d5/ffa x:0 0 0 2024-02-28T16:24:48.528 INFO:tasks.workunit.client.1.smithi153.stdout:2/817: link d2/d25/db4/dca/feb d2/d19/d31/dd1/f10a 0 2024-02-28T16:24:48.530 INFO:tasks.workunit.client.1.smithi153.stdout:5/848: dwrite da/dd/d25/f2e [0,4194304] 0 2024-02-28T16:24:48.530 INFO:tasks.workunit.client.1.smithi153.stdout:4/758: rename d4/f9 to d4/de/d23/d2b/d9b/ff2 0 2024-02-28T16:24:48.531 INFO:tasks.workunit.client.1.smithi153.stdout:9/771: readlink d1/d5/d11/d64/d85/d9a/lce 0 2024-02-28T16:24:48.533 INFO:tasks.workunit.client.1.smithi153.stdout:8/849: symlink d0/d19/l138 0 2024-02-28T16:24:48.537 INFO:tasks.workunit.client.1.smithi153.stdout:3/820: dwrite d4/d7d/d70/f7a [0,4194304] 0 2024-02-28T16:24:48.540 INFO:tasks.workunit.client.1.smithi153.stdout:0/825: mknod d4/d32/d7f/c11b 0 2024-02-28T16:24:48.541 INFO:tasks.workunit.client.1.smithi153.stdout:1/783: mkdir d0/dd/db2/d89/dad/dde/d114 0 2024-02-28T16:24:48.542 INFO:tasks.workunit.client.1.smithi153.stdout:3/821: write d4/d8/d1e/d2a/f89 [999769,7884] 0 2024-02-28T16:24:48.544 INFO:tasks.workunit.client.1.smithi153.stdout:2/818: mknod d2/d23/d48/df0/d99/c10b 0 2024-02-28T16:24:48.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/849: rename da/d29/f59 to da/de1/f117 0 2024-02-28T16:24:48.549 INFO:tasks.workunit.client.1.smithi153.stdout:9/772: symlink d1/d5/d11/d1f/d43/d76/lfb 0 2024-02-28T16:24:48.550 INFO:tasks.workunit.client.1.smithi153.stdout:9/773: stat d1/d2a 0 2024-02-28T16:24:48.554 INFO:tasks.workunit.client.1.smithi153.stdout:1/784: mkdir d0/dd/d84/d115 0 2024-02-28T16:24:48.558 INFO:tasks.workunit.client.1.smithi153.stdout:3/822: unlink d4/d13/d28/dcd/dda/f10a 0 2024-02-28T16:24:48.558 INFO:tasks.workunit.client.1.smithi153.stdout:6/848: dread d0/d1d/d33/d9c/f86 [0,4194304] 0 2024-02-28T16:24:48.559 INFO:tasks.workunit.client.1.smithi153.stdout:7/843: dwrite d1/d25/d27/d7c/dc4/f6e [0,4194304] 0 2024-02-28T16:24:48.560 INFO:tasks.workunit.client.1.smithi153.stdout:2/819: unlink d2/d19/d31/c73 0 2024-02-28T16:24:48.560 INFO:tasks.workunit.client.1.smithi153.stdout:3/823: dread - d4/d7d/d41/d71/fa6 zero size 2024-02-28T16:24:48.563 INFO:tasks.workunit.client.1.smithi153.stdout:0/826: mkdir d4/d32/d7f/d8a/dab/d8e/d94/df5/d11c 0 2024-02-28T16:24:48.569 INFO:tasks.workunit.client.1.smithi153.stdout:5/850: truncate da/dd/d54/f96 56053 0 2024-02-28T16:24:48.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/851: stat da/d29/d43/de6 0 2024-02-28T16:24:48.572 INFO:tasks.workunit.client.1.smithi153.stdout:1/785: truncate d0/d62/d66/d7c/f82 730091 0 2024-02-28T16:24:48.576 INFO:tasks.workunit.client.1.smithi153.stdout:5/852: write da/dd/fe [872495,10394] 0 2024-02-28T16:24:48.577 INFO:tasks.workunit.client.1.smithi153.stdout:2/820: mkdir d2/d19/d31/dd1/d10c 0 2024-02-28T16:24:48.577 INFO:tasks.workunit.client.1.smithi153.stdout:3/824: mkdir d4/d8/d1e/dbb/d124 0 2024-02-28T16:24:48.579 INFO:tasks.workunit.client.1.smithi153.stdout:5/853: readlink da/d29/d43/d5a/d77/lb6 0 2024-02-28T16:24:48.580 INFO:tasks.workunit.client.1.smithi153.stdout:4/759: dwrite d4/de/f57 [0,4194304] 0 2024-02-28T16:24:48.580 INFO:tasks.workunit.client.1.smithi153.stdout:3/825: chown d4/d7d/d41/d71 11025 1 2024-02-28T16:24:48.582 INFO:tasks.workunit.client.1.smithi153.stdout:1/786: dread - d0/f48 zero size 2024-02-28T16:24:48.589 INFO:tasks.workunit.client.1.smithi153.stdout:8/850: getdents d0/d25/d79 0 2024-02-28T16:24:48.589 INFO:tasks.workunit.client.1.smithi153.stdout:9/774: write d1/d5/d11/d64/f87 [335856,1813] 0 2024-02-28T16:24:48.591 INFO:tasks.workunit.client.1.smithi153.stdout:0/827: creat d4/d32/df0/dfe/f11d x:0 0 0 2024-02-28T16:24:48.593 INFO:tasks.workunit.client.1.smithi153.stdout:9/775: chown d1/d5/d11/dd4/dbe/fbf 70191809 1 2024-02-28T16:24:48.593 INFO:tasks.workunit.client.1.smithi153.stdout:2/821: creat d2/d23/d48/df0/d99/f10d x:0 0 0 2024-02-28T16:24:48.596 INFO:tasks.workunit.client.1.smithi153.stdout:2/822: read d2/fd5 [131985,22650] 0 2024-02-28T16:24:48.599 INFO:tasks.workunit.client.1.smithi153.stdout:7/844: write d1/d25/dc/f35 [2107461,46051] 0 2024-02-28T16:24:48.599 INFO:tasks.workunit.client.1.smithi153.stdout:2/823: chown d2/d19/d5d/f84 58172 1 2024-02-28T16:24:48.603 INFO:tasks.workunit.client.1.smithi153.stdout:1/787: dwrite d0/dd/db2/de5/d10a/f10b [0,4194304] 0 2024-02-28T16:24:48.603 INFO:tasks.workunit.client.1.smithi153.stdout:2/824: write d2/d4b/fea [4754879,59360] 0 2024-02-28T16:24:48.606 INFO:tasks.workunit.client.1.smithi153.stdout:0/828: rename d4/d32/ded/f10d to d4/d32/d7f/db3/f11e 0 2024-02-28T16:24:48.613 INFO:tasks.workunit.client.1.smithi153.stdout:3/826: mkdir d4/d7d/d41/d11b/d125 0 2024-02-28T16:24:48.614 INFO:tasks.workunit.client.1.smithi153.stdout:6/849: dread d0/f10 [0,4194304] 0 2024-02-28T16:24:48.615 INFO:tasks.workunit.client.1.smithi153.stdout:3/827: chown d4/d8/d1e/d63/f80 6766438 1 2024-02-28T16:24:48.617 INFO:tasks.workunit.client.1.smithi153.stdout:6/850: truncate d0/d1d/d33/db2/f104 8695676 0 2024-02-28T16:24:48.619 INFO:tasks.workunit.client.1.smithi153.stdout:9/776: mknod d1/d5/d11/cfc 0 2024-02-28T16:24:48.624 INFO:tasks.workunit.client.1.smithi153.stdout:2/825: unlink d2/d23/d88/dbf/fe3 0 2024-02-28T16:24:48.624 INFO:tasks.workunit.client.1.smithi153.stdout:5/854: write da/dd/d25/feb [194459,67567] 0 2024-02-28T16:24:48.625 INFO:tasks.workunit.client.1.smithi153.stdout:0/829: symlink d4/d32/dcf/l11f 0 2024-02-28T16:24:48.626 INFO:tasks.workunit.client.1.smithi153.stdout:0/830: stat d4/f45 0 2024-02-28T16:24:48.626 INFO:tasks.workunit.client.1.smithi153.stdout:5/855: readlink da/dd/lb7 0 2024-02-28T16:24:48.631 INFO:tasks.workunit.client.1.smithi153.stdout:7/845: mkdir d1/d25/df/d26/d3a/d11c 0 2024-02-28T16:24:48.631 INFO:tasks.workunit.client.1.smithi153.stdout:7/846: readlink d1/d25/d27/l28 0 2024-02-28T16:24:48.633 INFO:tasks.workunit.client.1.smithi153.stdout:1/788: dread d0/dd/f37 [0,4194304] 0 2024-02-28T16:24:48.635 INFO:tasks.workunit.client.1.smithi153.stdout:9/777: creat d1/d2a/ffd x:0 0 0 2024-02-28T16:24:48.637 INFO:tasks.workunit.client.1.smithi153.stdout:0/831: creat d4/d99/da5/ddf/f120 x:0 0 0 2024-02-28T16:24:48.637 INFO:tasks.workunit.client.1.smithi153.stdout:2/826: truncate d2/d23/d48/df0/f30 4956072 0 2024-02-28T16:24:48.638 INFO:tasks.workunit.client.1.smithi153.stdout:0/832: chown d4/d89/cf7 7630 1 2024-02-28T16:24:48.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/760: getdents d4/de/d23/d2b/d31/da2/da5/db2/dc2 0 2024-02-28T16:24:48.643 INFO:tasks.workunit.client.1.smithi153.stdout:8/851: getdents d0/d12/d67/d30/d63 0 2024-02-28T16:24:48.653 INFO:tasks.workunit.client.1.smithi153.stdout:7/847: symlink d1/d25/df/d26/d3a/d95/l11d 0 2024-02-28T16:24:48.655 INFO:tasks.workunit.client.1.smithi153.stdout:7/848: readlink d1/d25/df/d26/d3a/d95/lb8 0 2024-02-28T16:24:48.656 INFO:tasks.workunit.client.1.smithi153.stdout:2/827: truncate d2/f6 2816831 0 2024-02-28T16:24:48.660 INFO:tasks.workunit.client.1.smithi153.stdout:4/761: mkdir d4/de/d23/d2b/d31/ddf/df3 0 2024-02-28T16:24:48.662 INFO:tasks.workunit.client.1.smithi153.stdout:6/851: fdatasync d0/d1d/d5d/de9/ff7 0 2024-02-28T16:24:48.664 INFO:tasks.workunit.client.1.smithi153.stdout:3/828: dwrite d4/d13/f67 [0,4194304] 0 2024-02-28T16:24:48.665 INFO:tasks.workunit.client.1.smithi153.stdout:1/789: dwrite d0/f48 [0,4194304] 0 2024-02-28T16:24:48.673 INFO:tasks.workunit.client.1.smithi153.stdout:8/852: creat d0/d25/d132/f139 x:0 0 0 2024-02-28T16:24:48.674 INFO:tasks.workunit.client.1.smithi153.stdout:5/856: link da/dd/d25/d41/c72 da/dd/d25/d8a/dac/c118 0 2024-02-28T16:24:48.675 INFO:tasks.workunit.client.1.smithi153.stdout:6/852: rmdir d0/d1d/d5d/de9 39 2024-02-28T16:24:48.676 INFO:tasks.workunit.client.1.smithi153.stdout:3/829: mknod d4/dfc/c126 0 2024-02-28T16:24:48.683 INFO:tasks.workunit.client.1.smithi153.stdout:4/762: symlink d4/de/d23/d2b/lf4 0 2024-02-28T16:24:48.683 INFO:tasks.workunit.client.1.smithi153.stdout:0/833: truncate d4/f8 3574509 0 2024-02-28T16:24:48.687 INFO:tasks.workunit.client.1.smithi153.stdout:5/857: symlink da/dd/dd1/ddd/l119 0 2024-02-28T16:24:48.688 INFO:tasks.workunit.client.1.smithi153.stdout:1/790: mknod d0/dd/d111/dd9/de1/dfc/c116 0 2024-02-28T16:24:48.688 INFO:tasks.workunit.client.1.smithi153.stdout:5/858: chown da/d29/d43/d5a/d77/led 0 1 2024-02-28T16:24:48.692 INFO:tasks.workunit.client.1.smithi153.stdout:7/849: truncate d1/d25/f7 4107797 0 2024-02-28T16:24:48.693 INFO:tasks.workunit.client.1.smithi153.stdout:8/853: mkdir d0/d19/d2b/d2d/d111/d13a 0 2024-02-28T16:24:48.695 INFO:tasks.workunit.client.1.smithi153.stdout:4/763: mkdir d4/d8d/df5 0 2024-02-28T16:24:48.697 INFO:tasks.workunit.client.1.smithi153.stdout:0/834: dwrite d4/d27/d101/fe0 [0,4194304] 0 2024-02-28T16:24:48.699 INFO:tasks.workunit.client.1.smithi153.stdout:6/853: rmdir d0/d1d/d33/d9c/d68/dcb 39 2024-02-28T16:24:48.705 INFO:tasks.workunit.client.1.smithi153.stdout:1/791: mknod d0/dd/c117 0 2024-02-28T16:24:48.706 INFO:tasks.workunit.client.1.smithi153.stdout:5/859: mkdir da/d29/d11a 0 2024-02-28T16:24:48.763 INFO:tasks.workunit.client.1.smithi153.stdout:1/792: chown d0/dd/db2/f91 16113 1 2024-02-28T16:24:48.763 INFO:tasks.workunit.client.1.smithi153.stdout:8/854: fsync d0/d12/d67/d88/f12b 0 2024-02-28T16:24:48.764 INFO:tasks.workunit.client.1.smithi153.stdout:6/854: stat d0/d1d/d33/d9c/d68/dcb/fe4 0 2024-02-28T16:24:48.765 INFO:tasks.workunit.client.1.smithi153.stdout:0/835: fdatasync d4/d27/f5a 0 2024-02-28T16:24:48.766 INFO:tasks.workunit.client.1.smithi153.stdout:3/830: truncate d4/d8/f4d 466264 0 2024-02-28T16:24:48.768 INFO:tasks.workunit.client.1.smithi153.stdout:8/855: chown d0/c4b 1 1 2024-02-28T16:24:48.769 INFO:tasks.workunit.client.1.smithi153.stdout:4/764: creat d4/d53/d7c/ff6 x:0 0 0 2024-02-28T16:24:48.771 INFO:tasks.workunit.client.1.smithi153.stdout:5/860: mknod da/d29/d43/d5a/dbe/de7/c11b 0 2024-02-28T16:24:48.772 INFO:tasks.workunit.client.1.smithi153.stdout:3/831: chown d4/d7d/d41/d71/fa6 259733 1 2024-02-28T16:24:48.777 INFO:tasks.workunit.client.1.smithi153.stdout:5/861: truncate da/dd/d25/d8a/fc8 1885036 0 2024-02-28T16:24:48.778 INFO:tasks.workunit.client.1.smithi153.stdout:1/793: creat d0/dd/db2/dcc/f118 x:0 0 0 2024-02-28T16:24:48.779 INFO:tasks.workunit.client.1.smithi153.stdout:5/862: chown da/dd/d25/f57 152742771 1 2024-02-28T16:24:48.780 INFO:tasks.workunit.client.1.smithi153.stdout:0/836: creat d4/d32/d7f/db3/f121 x:0 0 0 2024-02-28T16:24:48.781 INFO:tasks.workunit.client.1.smithi153.stdout:1/794: chown d0/dd/db2/dcc/ff6 351439 1 2024-02-28T16:24:48.784 INFO:tasks.workunit.client.1.smithi153.stdout:8/856: mkdir d0/d19/d2b/d2d/d3f/d9f/d13b 0 2024-02-28T16:24:48.784 INFO:tasks.workunit.client.1.smithi153.stdout:4/765: truncate d4/d53/d7c/db3/f43 2779450 0 2024-02-28T16:24:48.785 INFO:tasks.workunit.client.1.smithi153.stdout:1/795: write d0/dd/fda [3459013,6138] 0 2024-02-28T16:24:48.789 INFO:tasks.workunit.client.1.smithi153.stdout:4/766: truncate d4/d53/d7c/fd1 505135 0 2024-02-28T16:24:48.792 INFO:tasks.workunit.client.1.smithi153.stdout:3/832: mknod d4/d13/d28/dcd/dda/de7/c127 0 2024-02-28T16:24:48.792 INFO:tasks.workunit.client.1.smithi153.stdout:3/833: readlink d4/l50 0 2024-02-28T16:24:48.799 INFO:tasks.workunit.client.1.smithi153.stdout:9/778: sync 2024-02-28T16:24:48.800 INFO:tasks.workunit.client.1.smithi153.stdout:0/837: getdents d4/d32/d7f/d8a/dab/d8e/d94/df5 0 2024-02-28T16:24:48.800 INFO:tasks.workunit.client.1.smithi153.stdout:5/863: dread f9 [0,4194304] 0 2024-02-28T16:24:48.803 INFO:tasks.workunit.client.1.smithi153.stdout:0/838: fdatasync d4/f6b 0 2024-02-28T16:24:48.807 INFO:tasks.workunit.client.1.smithi153.stdout:5/864: creat da/dd/d25/d82/f11c x:0 0 0 2024-02-28T16:24:48.807 INFO:tasks.workunit.client.1.smithi153.stdout:9/779: truncate d1/d5/d11/d1f/d52/f6c 1627932 0 2024-02-28T16:24:48.815 INFO:tasks.workunit.client.1.smithi153.stdout:5/865: write da/f86 [152644,13821] 0 2024-02-28T16:24:48.815 INFO:tasks.workunit.client.1.smithi153.stdout:1/796: write d0/dd/fc5 [1790630,10756] 0 2024-02-28T16:24:48.818 INFO:tasks.workunit.client.1.smithi153.stdout:8/857: dwrite d0/d25/f6b [4194304,4194304] 0 2024-02-28T16:24:48.819 INFO:tasks.workunit.client.1.smithi153.stdout:5/866: write da/dd/d25/d82/f11c [689264,113853] 0 2024-02-28T16:24:48.822 INFO:tasks.workunit.client.1.smithi153.stdout:8/858: stat d0/d12/d67/d88/d85 0 2024-02-28T16:24:48.825 INFO:tasks.workunit.client.1.smithi153.stdout:3/834: dread d4/d8/d1e/d63/ffb [0,4194304] 0 2024-02-28T16:24:48.826 INFO:tasks.workunit.client.1.smithi153.stdout:1/797: mknod d0/dd/db2/de5/c119 0 2024-02-28T16:24:48.829 INFO:tasks.workunit.client.1.smithi153.stdout:4/767: dwrite d4/de/d23/f48 [0,4194304] 0 2024-02-28T16:24:48.830 INFO:tasks.workunit.client.1.smithi153.stdout:9/780: truncate d1/d5/d11/d1f/fe2 453451 0 2024-02-28T16:24:48.833 INFO:tasks.workunit.client.1.smithi153.stdout:8/859: unlink d0/d12/l8b 0 2024-02-28T16:24:48.834 INFO:tasks.workunit.client.1.smithi153.stdout:0/839: dwrite d4/d32/dcf/df6/d10c/fc9 [0,4194304] 0 2024-02-28T16:24:48.835 INFO:tasks.workunit.client.1.smithi153.stdout:3/835: fdatasync d4/f17 0 2024-02-28T16:24:48.838 INFO:tasks.workunit.client.1.smithi153.stdout:1/798: dread d0/dd/db2/d80/fa7 [0,4194304] 0 2024-02-28T16:24:48.838 INFO:tasks.workunit.client.1.smithi153.stdout:3/836: write d4/d8/d1e/f120 [331786,17514] 0 2024-02-28T16:24:48.842 INFO:tasks.workunit.client.1.smithi153.stdout:4/768: rmdir d4/d53 39 2024-02-28T16:24:48.844 INFO:tasks.workunit.client.1.smithi153.stdout:9/781: unlink d1/d58/ff6 0 2024-02-28T16:24:48.846 INFO:tasks.workunit.client.1.smithi153.stdout:0/840: mknod d4/d27/d9a/da1/c122 0 2024-02-28T16:24:48.853 INFO:tasks.workunit.client.1.smithi153.stdout:1/799: mknod d0/dd/d84/c11a 0 2024-02-28T16:24:48.854 INFO:tasks.workunit.client.1.smithi153.stdout:7/850: sync 2024-02-28T16:24:48.854 INFO:tasks.workunit.client.1.smithi153.stdout:2/828: sync 2024-02-28T16:24:48.854 INFO:tasks.workunit.client.1.smithi153.stdout:3/837: mkdir d4/d7d/d128 0 2024-02-28T16:24:48.860 INFO:tasks.workunit.client.1.smithi153.stdout:5/867: dwrite da/f2f [0,4194304] 0 2024-02-28T16:24:48.861 INFO:tasks.workunit.client.1.smithi153.stdout:0/841: creat d4/d32/df0/d108/f123 x:0 0 0 2024-02-28T16:24:48.861 INFO:tasks.workunit.client.1.smithi153.stdout:4/769: creat d4/de/d13/dd5/ff7 x:0 0 0 2024-02-28T16:24:48.863 INFO:tasks.workunit.client.1.smithi153.stdout:3/838: creat d4/d13/d28/d100/f129 x:0 0 0 2024-02-28T16:24:48.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/770: fsync d4/de/d23/d2b/d31/dc3/feb 0 2024-02-28T16:24:48.869 INFO:tasks.workunit.client.1.smithi153.stdout:0/842: creat d4/d32/d7f/d8a/f124 x:0 0 0 2024-02-28T16:24:48.870 INFO:tasks.workunit.client.1.smithi153.stdout:8/860: dwrite d0/d25/f103 [0,4194304] 0 2024-02-28T16:24:48.871 INFO:tasks.workunit.client.1.smithi153.stdout:2/829: creat d2/d19/d3e/db0/f10e x:0 0 0 2024-02-28T16:24:48.874 INFO:tasks.workunit.client.1.smithi153.stdout:1/800: dread - d0/dd/db2/d89/f92 zero size 2024-02-28T16:24:48.877 INFO:tasks.workunit.client.1.smithi153.stdout:7/851: truncate d1/d25/d27/d7c/dc4/d63/f100 400401 0 2024-02-28T16:24:48.879 INFO:tasks.workunit.client.1.smithi153.stdout:0/843: unlink d4/d32/dcf/df6/d10c/cf8 0 2024-02-28T16:24:48.880 INFO:tasks.workunit.client.1.smithi153.stdout:2/830: readlink d2/d23/d88/d95/l105 0 2024-02-28T16:24:48.880 INFO:tasks.workunit.client.1.smithi153.stdout:9/782: write d1/d74/d80/da8/fc3 [3623581,13342] 0 2024-02-28T16:24:48.888 INFO:tasks.workunit.client.1.smithi153.stdout:2/831: unlink d2/d23/d48/df0/l91 0 2024-02-28T16:24:48.890 INFO:tasks.workunit.client.1.smithi153.stdout:0/844: getdents d4/d99/da5 0 2024-02-28T16:24:48.892 INFO:tasks.workunit.client.1.smithi153.stdout:9/783: truncate d1/d74/d80/da8/f32 2857706 0 2024-02-28T16:24:48.894 INFO:tasks.workunit.client.1.smithi153.stdout:1/801: dwrite d0/dd/f49 [0,4194304] 0 2024-02-28T16:24:48.898 INFO:tasks.workunit.client.1.smithi153.stdout:1/802: chown d0/dd/db2/f91 9187029 1 2024-02-28T16:24:48.898 INFO:tasks.workunit.client.1.smithi153.stdout:9/784: creat d1/d69/dbb/ffe x:0 0 0 2024-02-28T16:24:48.900 INFO:tasks.workunit.client.1.smithi153.stdout:2/832: getdents d2/d86 0 2024-02-28T16:24:48.900 INFO:tasks.workunit.client.1.smithi153.stdout:5/868: write da/dd/d25/d41/f9b [1918078,37232] 0 2024-02-28T16:24:48.900 INFO:tasks.workunit.client.1.smithi153.stdout:1/803: mknod d0/dd/db2/d89/dc7/c11b 0 2024-02-28T16:24:48.903 INFO:tasks.workunit.client.1.smithi153.stdout:8/861: write d0/d19/d2b/d2d/d3f/fbf [642880,31174] 0 2024-02-28T16:24:48.906 INFO:tasks.workunit.client.1.smithi153.stdout:2/833: mkdir d2/d19/d5d/d10f 0 2024-02-28T16:24:48.906 INFO:tasks.workunit.client.1.smithi153.stdout:3/839: truncate d4/d13/f3f 8320306 0 2024-02-28T16:24:48.907 INFO:tasks.workunit.client.1.smithi153.stdout:5/869: rmdir da/d29/d43/d5a/dbe 39 2024-02-28T16:24:48.908 INFO:tasks.workunit.client.1.smithi153.stdout:8/862: chown d0/d12/d67/d30/d63 51803 1 2024-02-28T16:24:48.911 INFO:tasks.workunit.client.1.smithi153.stdout:5/870: readlink da/d29/d43/d5a/d77/lce 0 2024-02-28T16:24:48.913 INFO:tasks.workunit.client.1.smithi153.stdout:3/840: creat d4/d109/f12a x:0 0 0 2024-02-28T16:24:48.914 INFO:tasks.workunit.client.1.smithi153.stdout:9/785: getdents d1/d5/d11/d64/dd5 0 2024-02-28T16:24:48.917 INFO:tasks.workunit.client.1.smithi153.stdout:2/834: rename d2/d23/d48/df0/d93/f83 to d2/d19/d5d/d10f/f110 0 2024-02-28T16:24:48.920 INFO:tasks.workunit.client.1.smithi153.stdout:1/804: dwrite d0/dd/db2/de5/d10a/f10b [0,4194304] 0 2024-02-28T16:24:48.923 INFO:tasks.workunit.client.1.smithi153.stdout:1/805: write d0/d3d/f87 [1371105,100665] 0 2024-02-28T16:24:48.926 INFO:tasks.workunit.client.1.smithi153.stdout:1/806: truncate d0/f14 4355032 0 2024-02-28T16:24:48.927 INFO:tasks.workunit.client.1.smithi153.stdout:3/841: rename d4/d13/d28/dcd/dda/de7/c127 to d4/d13/dcc/c12b 0 2024-02-28T16:24:48.928 INFO:tasks.workunit.client.1.smithi153.stdout:8/863: dwrite d0/d19/d1e/fff [0,4194304] 0 2024-02-28T16:24:48.930 INFO:tasks.workunit.client.1.smithi153.stdout:3/842: fdatasync d4/d8/d1e/d2a/d55/da3/db1/f107 0 2024-02-28T16:24:48.935 INFO:tasks.workunit.client.1.smithi153.stdout:9/786: creat d1/d5/d11/d29/d79/fff x:0 0 0 2024-02-28T16:24:48.939 INFO:tasks.workunit.client.1.smithi153.stdout:5/871: creat da/dd/d25/d41/f11d x:0 0 0 2024-02-28T16:24:48.942 INFO:tasks.workunit.client.1.smithi153.stdout:3/843: dread - d4/d13/d28/fdd zero size 2024-02-28T16:24:48.942 INFO:tasks.workunit.client.1.smithi153.stdout:6/855: sync 2024-02-28T16:24:48.944 INFO:tasks.workunit.client.1.smithi153.stdout:6/856: chown d0/d17/c4d 58 1 2024-02-28T16:24:48.944 INFO:tasks.workunit.client.1.smithi153.stdout:3/844: unlink d4/dfc/c95 0 2024-02-28T16:24:48.948 INFO:tasks.workunit.client.1.smithi153.stdout:5/872: mkdir da/dd/d25/d82/d8f/d11e 0 2024-02-28T16:24:48.953 INFO:tasks.workunit.client.1.smithi153.stdout:8/864: dwrite d0/d34/fcf [4194304,4194304] 0 2024-02-28T16:24:48.956 INFO:tasks.workunit.client.1.smithi153.stdout:6/857: creat d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/d96/f12b x:0 0 0 2024-02-28T16:24:48.962 INFO:tasks.workunit.client.1.smithi153.stdout:9/787: link d1/d5/d11/d1f/d40/d97/fcd d1/d5/d11/d64/f100 0 2024-02-28T16:24:48.964 INFO:tasks.workunit.client.1.smithi153.stdout:6/858: symlink d0/d17/l12c 0 2024-02-28T16:24:48.965 INFO:tasks.workunit.client.1.smithi153.stdout:8/865: symlink d0/d12/d67/d88/d96/dfc/l13c 0 2024-02-28T16:24:48.965 INFO:tasks.workunit.client.1.smithi153.stdout:2/835: dwrite d2/d23/d36/f7f [0,4194304] 0 2024-02-28T16:24:48.969 INFO:tasks.workunit.client.1.smithi153.stdout:8/866: mkdir d0/d19/d2b/d2d/d111/d13d 0 2024-02-28T16:24:48.970 INFO:tasks.workunit.client.1.smithi153.stdout:1/807: truncate d0/dd/fc5 57625 0 2024-02-28T16:24:48.972 INFO:tasks.workunit.client.1.smithi153.stdout:2/836: rename d2/d86/df2 to d2/d19/d3e/da7/d111 0 2024-02-28T16:24:48.977 INFO:tasks.workunit.client.1.smithi153.stdout:6/859: rename d0/d1d/d33/d9c/d68/da1 to d0/d1d/d33/d9c/d2e/d99/ddf/d12d 0 2024-02-28T16:24:48.978 INFO:tasks.workunit.client.1.smithi153.stdout:9/788: dread d1/d5/d11/f71 [0,4194304] 0 2024-02-28T16:24:48.981 INFO:tasks.workunit.client.1.smithi153.stdout:8/867: mknod d0/d12/d67/c13e 0 2024-02-28T16:24:48.984 INFO:tasks.workunit.client.1.smithi153.stdout:8/868: write d0/d12/d67/d88/d8e/f9c [2365129,116933] 0 2024-02-28T16:24:48.985 INFO:tasks.workunit.client.1.smithi153.stdout:2/837: mknod d2/d4b/c112 0 2024-02-28T16:24:48.988 INFO:tasks.workunit.client.1.smithi153.stdout:3/845: dwrite d4/f77 [0,4194304] 0 2024-02-28T16:24:48.988 INFO:tasks.workunit.client.1.smithi153.stdout:5/873: write da/d29/f5b [1260323,109725] 0 2024-02-28T16:24:48.996 INFO:tasks.workunit.client.1.smithi153.stdout:8/869: chown d0/d19/d2b/l2f 61416086 1 2024-02-28T16:24:48.996 INFO:tasks.workunit.client.1.smithi153.stdout:2/838: rmdir d2/d19/d3e 39 2024-02-28T16:24:49.004 INFO:tasks.workunit.client.1.smithi153.stdout:3/846: unlink d4/d8/d1e/d63/f93 0 2024-02-28T16:24:49.017 INFO:tasks.workunit.client.1.smithi153.stdout:6/860: write d0/d1d/d33/d9c/d68/f6f [109177,91146] 0 2024-02-28T16:24:49.018 INFO:tasks.workunit.client.1.smithi153.stdout:8/870: creat d0/d25/d132/f13f x:0 0 0 2024-02-28T16:24:49.020 INFO:tasks.workunit.client.1.smithi153.stdout:8/871: chown d0/d12/d67/d30/d63 110520722 1 2024-02-28T16:24:49.023 INFO:tasks.workunit.client.1.smithi153.stdout:9/789: dwrite d1/fb0 [0,4194304] 0 2024-02-28T16:24:49.023 INFO:tasks.workunit.client.1.smithi153.stdout:7/852: sync 2024-02-28T16:24:49.023 INFO:tasks.workunit.client.1.smithi153.stdout:0/845: sync 2024-02-28T16:24:49.024 INFO:tasks.workunit.client.1.smithi153.stdout:4/771: sync 2024-02-28T16:24:49.027 INFO:tasks.workunit.client.1.smithi153.stdout:7/853: write d1/d25/df/d60/f67 [3311528,130679] 0 2024-02-28T16:24:49.029 INFO:tasks.workunit.client.1.smithi153.stdout:2/839: read - d2/d23/d48/df0/d3b/d87/df8/dd0/d104/fe8 zero size 2024-02-28T16:24:49.030 INFO:tasks.workunit.client.1.smithi153.stdout:9/790: dread d1/d5/d11/f71 [0,4194304] 0 2024-02-28T16:24:49.032 INFO:tasks.workunit.client.1.smithi153.stdout:9/791: chown d1/d5/d11/d64/d85/d8c/l9e 1839 1 2024-02-28T16:24:49.034 INFO:tasks.workunit.client.1.smithi153.stdout:9/792: write d1/d5/d11/ff1 [236815,97338] 0 2024-02-28T16:24:49.037 INFO:tasks.workunit.client.1.smithi153.stdout:3/847: read d4/f81 [507583,28810] 0 2024-02-28T16:24:49.038 INFO:tasks.workunit.client.1.smithi153.stdout:3/848: read - d4/d13/d28/dcd/dda/f121 zero size 2024-02-28T16:24:49.040 INFO:tasks.workunit.client.1.smithi153.stdout:1/808: rename d0/dd/l2e to d0/dd/d111/d59/l11c 0 2024-02-28T16:24:49.041 INFO:tasks.workunit.client.1.smithi153.stdout:6/861: readlink d0/d1d/d33/d9c/lce 0 2024-02-28T16:24:49.044 INFO:tasks.workunit.client.1.smithi153.stdout:8/872: truncate d0/fc0 122010 0 2024-02-28T16:24:49.049 INFO:tasks.workunit.client.1.smithi153.stdout:7/854: dread d1/d25/dc/d50/f65 [0,4194304] 0 2024-02-28T16:24:49.052 INFO:tasks.workunit.client.1.smithi153.stdout:1/809: dread d0/dd/f49 [0,4194304] 0 2024-02-28T16:24:49.059 INFO:tasks.workunit.client.1.smithi153.stdout:3/849: rename d4/d8/d1e/d2a/d35/d54/fff to d4/d13/d28/d99/d115/f12c 0 2024-02-28T16:24:49.060 INFO:tasks.workunit.client.1.smithi153.stdout:5/874: truncate da/de1/ff1 1078658 0 2024-02-28T16:24:49.062 INFO:tasks.workunit.client.1.smithi153.stdout:8/873: mkdir d0/d19/d2b/d2d/d3f/d10a/d140 0 2024-02-28T16:24:49.064 INFO:tasks.workunit.client.1.smithi153.stdout:0/846: creat d4/d27/d9a/dfb/f125 x:0 0 0 2024-02-28T16:24:49.065 INFO:tasks.workunit.client.1.smithi153.stdout:7/855: symlink d1/d25/df/d26/d76/l11e 0 2024-02-28T16:24:49.067 INFO:tasks.workunit.client.1.smithi153.stdout:2/840: creat d2/d19/d3e/da7/db1/f113 x:0 0 0 2024-02-28T16:24:49.071 INFO:tasks.workunit.client.1.smithi153.stdout:1/810: mknod d0/dd/db2/d89/dad/c11d 0 2024-02-28T16:24:49.074 INFO:tasks.workunit.client.1.smithi153.stdout:3/850: dwrite d4/f17 [4194304,4194304] 0 2024-02-28T16:24:49.074 INFO:tasks.workunit.client.1.smithi153.stdout:4/772: rmdir d4/d8d/df5 0 2024-02-28T16:24:49.074 INFO:tasks.workunit.client.1.smithi153.stdout:1/811: fsync d0/dd/db2/d89/faf 0 2024-02-28T16:24:49.075 INFO:tasks.workunit.client.1.smithi153.stdout:5/875: mkdir da/dd/d25/d8a/db3/d11f 0 2024-02-28T16:24:49.077 INFO:tasks.workunit.client.1.smithi153.stdout:8/874: fdatasync d0/d25/d79/db3/fbe 0 2024-02-28T16:24:49.080 INFO:tasks.workunit.client.1.smithi153.stdout:4/773: fsync d4/de/d13/f18 0 2024-02-28T16:24:49.080 INFO:tasks.workunit.client.1.smithi153.stdout:9/793: link d1/d7e/lef d1/d5/d11/d1f/d40/l101 0 2024-02-28T16:24:49.083 INFO:tasks.workunit.client.1.smithi153.stdout:2/841: write d2/f7 [2434913,3979] 0 2024-02-28T16:24:49.083 INFO:tasks.workunit.client.1.smithi153.stdout:6/862: creat d0/d1d/d33/d9c/f12e x:0 0 0 2024-02-28T16:24:49.085 INFO:tasks.workunit.client.1.smithi153.stdout:1/812: readlink d0/l55 0 2024-02-28T16:24:49.086 INFO:tasks.workunit.client.1.smithi153.stdout:0/847: mkdir d4/d32/df3/d126 0 2024-02-28T16:24:49.089 INFO:tasks.workunit.client.1.smithi153.stdout:5/876: fsync da/f2c 0 2024-02-28T16:24:49.089 INFO:tasks.workunit.client.1.smithi153.stdout:7/856: dwrite d1/d25/dc/d50/d66/da9/ffe [0,4194304] 0 2024-02-28T16:24:49.090 INFO:tasks.workunit.client.1.smithi153.stdout:7/857: chown d1/d25/d88 4168025 1 2024-02-28T16:24:49.094 INFO:tasks.workunit.client.1.smithi153.stdout:7/858: stat d1/d25/dc/d50/d66/c7a 0 2024-02-28T16:24:49.095 INFO:tasks.workunit.client.1.smithi153.stdout:3/851: dread d4/f77 [0,4194304] 0 2024-02-28T16:24:49.098 INFO:tasks.workunit.client.1.smithi153.stdout:9/794: dread d1/fb2 [0,4194304] 0 2024-02-28T16:24:49.098 INFO:tasks.workunit.client.1.smithi153.stdout:8/875: mknod d0/d19/d2b/d2d/c141 0 2024-02-28T16:24:49.100 INFO:tasks.workunit.client.1.smithi153.stdout:7/859: chown d1/d25/df/d60/f67 94 1 2024-02-28T16:24:49.101 INFO:tasks.workunit.client.1.smithi153.stdout:1/813: fsync d0/fdc 0 2024-02-28T16:24:49.102 INFO:tasks.workunit.client.1.smithi153.stdout:3/852: write d4/d109/f12a [914520,101711] 0 2024-02-28T16:24:49.105 INFO:tasks.workunit.client.1.smithi153.stdout:2/842: creat d2/d19/d5d/d10f/f114 x:0 0 0 2024-02-28T16:24:49.105 INFO:tasks.workunit.client.1.smithi153.stdout:7/860: write d1/d25/df/d60/f67 [2286045,124666] 0 2024-02-28T16:24:49.108 INFO:tasks.workunit.client.1.smithi153.stdout:2/843: readlink d2/l13 0 2024-02-28T16:24:49.109 INFO:tasks.workunit.client.1.smithi153.stdout:8/876: rename d0/d34/l7d to d0/d34/l142 0 2024-02-28T16:24:49.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/814: mknod d0/dd/d111/c11e 0 2024-02-28T16:24:49.113 INFO:tasks.workunit.client.1.smithi153.stdout:1/815: stat d0/dd/db2/d80 0 2024-02-28T16:24:49.114 INFO:tasks.workunit.client.1.smithi153.stdout:4/774: dwrite d4/de/d23/d2b/d9b/f89 [0,4194304] 0 2024-02-28T16:24:49.118 INFO:tasks.workunit.client.1.smithi153.stdout:2/844: mkdir d2/d86/da0/dce/d115 0 2024-02-28T16:24:49.118 INFO:tasks.workunit.client.1.smithi153.stdout:8/877: chown d0/d12/d67/d30/d63/d74/f112 36972 1 2024-02-28T16:24:49.124 INFO:tasks.workunit.client.1.smithi153.stdout:8/878: chown d0/d19/d2b/d2d/d3f/d9f/dcc/fa2 461737565 1 2024-02-28T16:24:49.127 INFO:tasks.workunit.client.1.smithi153.stdout:6/863: dread d0/d1d/d30/f36 [0,4194304] 0 2024-02-28T16:24:49.131 INFO:tasks.workunit.client.1.smithi153.stdout:5/877: link da/d29/d43/c53 da/d29/d43/de6/c120 0 2024-02-28T16:24:49.136 INFO:tasks.workunit.client.1.smithi153.stdout:4/775: mknod d4/de/d13/d1b/cf8 0 2024-02-28T16:24:49.137 INFO:tasks.workunit.client.1.smithi153.stdout:8/879: symlink d0/d19/d2b/l143 0 2024-02-28T16:24:49.140 INFO:tasks.workunit.client.1.smithi153.stdout:8/880: readlink d0/d12/d67/d88/d96/dfc/l13c 0 2024-02-28T16:24:49.143 INFO:tasks.workunit.client.1.smithi153.stdout:0/848: dread d4/d32/d7f/d8a/dab/f30 [0,4194304] 0 2024-02-28T16:24:49.143 INFO:tasks.workunit.client.1.smithi153.stdout:6/864: mknod d0/d1d/d33/d9c/d48/dec/d115/c12f 0 2024-02-28T16:24:49.147 INFO:tasks.workunit.client.1.smithi153.stdout:4/776: creat d4/d53/ff9 x:0 0 0 2024-02-28T16:24:49.149 INFO:tasks.workunit.client.1.smithi153.stdout:4/777: write d4/f10 [1307121,95942] 0 2024-02-28T16:24:49.153 INFO:tasks.workunit.client.1.smithi153.stdout:4/778: readlink d4/de/d13/d1b/lb6 0 2024-02-28T16:24:49.158 INFO:tasks.workunit.client.1.smithi153.stdout:8/881: getdents d0/d19/d2b/d2d/de8 0 2024-02-28T16:24:49.158 INFO:tasks.workunit.client.1.smithi153.stdout:4/779: fsync d4/de/d13/dd5/ff7 0 2024-02-28T16:24:49.158 INFO:tasks.workunit.client.1.smithi153.stdout:9/795: write d1/d5/d11/d1f/d43/d76/fea [2196175,26337] 0 2024-02-28T16:24:49.166 INFO:tasks.workunit.client.1.smithi153.stdout:8/882: chown d0/d12/d67/d30/feb 121257 1 2024-02-28T16:24:49.181 INFO:tasks.workunit.client.1.smithi153.stdout:3/853: dwrite d4/d8/d1e/d2a/d35/f51 [0,4194304] 0 2024-02-28T16:24:49.185 INFO:tasks.workunit.client.1.smithi153.stdout:8/883: fsync d0/d19/f48 0 2024-02-28T16:24:49.185 INFO:tasks.workunit.client.1.smithi153.stdout:0/849: dwrite d4/d32/dcf/df6/d10c/fc9 [4194304,4194304] 0 2024-02-28T16:24:49.187 INFO:tasks.workunit.client.1.smithi153.stdout:4/780: creat d4/de/d23/d2b/d31/dc3/ffa x:0 0 0 2024-02-28T16:24:49.189 INFO:tasks.workunit.client.1.smithi153.stdout:7/861: dread d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:49.192 INFO:tasks.workunit.client.1.smithi153.stdout:1/816: dwrite d0/d3d/f72 [0,4194304] 0 2024-02-28T16:24:49.194 INFO:tasks.workunit.client.1.smithi153.stdout:4/781: write d4/f29 [2531807,20028] 0 2024-02-28T16:24:49.209 INFO:tasks.workunit.client.1.smithi153.stdout:1/817: rename d0/dd/d111/fbd to d0/dd/db2/d89/f11f 0 2024-02-28T16:24:49.211 INFO:tasks.workunit.client.1.smithi153.stdout:8/884: symlink d0/d12/d15/dab/dd0/de9/l144 0 2024-02-28T16:24:49.216 INFO:tasks.workunit.client.1.smithi153.stdout:0/850: fsync d4/d32/d7f/d8a/dab/f1f 0 2024-02-28T16:24:49.216 INFO:tasks.workunit.client.1.smithi153.stdout:3/854: write d4/d13/d28/d99/fa2 [319899,93802] 0 2024-02-28T16:24:49.217 INFO:tasks.workunit.client.1.smithi153.stdout:4/782: mknod d4/de/d47/d5e/d62/cfb 0 2024-02-28T16:24:49.220 INFO:tasks.workunit.client.1.smithi153.stdout:6/865: dwrite d0/d1d/d30/f31 [0,4194304] 0 2024-02-28T16:24:49.229 INFO:tasks.workunit.client.1.smithi153.stdout:3/855: creat d4/d6a/f12d x:0 0 0 2024-02-28T16:24:49.230 INFO:tasks.workunit.client.1.smithi153.stdout:8/885: truncate d0/d12/d67/d30/d63/d74/f112 815903 0 2024-02-28T16:24:49.230 INFO:tasks.workunit.client.1.smithi153.stdout:9/796: dwrite d1/d74/d80/da8/f4f [0,4194304] 0 2024-02-28T16:24:49.248 INFO:tasks.workunit.client.1.smithi153.stdout:8/886: dread d0/d19/d2b/f72 [0,4194304] 0 2024-02-28T16:24:49.285 INFO:tasks.workunit.client.1.smithi153.stdout:0/851: creat d4/d32/dd9/d104/f127 x:0 0 0 2024-02-28T16:24:49.285 INFO:tasks.workunit.client.1.smithi153.stdout:7/862: getdents d1/d25/df/d60/da4/dee 0 2024-02-28T16:24:49.286 INFO:tasks.workunit.client.1.smithi153.stdout:3/856: creat d4/d7d/d41/f12e x:0 0 0 2024-02-28T16:24:49.287 INFO:tasks.workunit.client.1.smithi153.stdout:0/852: write d4/d32/d7f/d8a/dab/f39 [206134,95677] 0 2024-02-28T16:24:49.287 INFO:tasks.workunit.client.1.smithi153.stdout:9/797: creat d1/d5/d11/d1f/d40/f102 x:0 0 0 2024-02-28T16:24:49.288 INFO:tasks.workunit.client.1.smithi153.stdout:6/866: truncate d0/d1d/d33/d8d/fa8 645438 0 2024-02-28T16:24:49.288 INFO:tasks.workunit.client.1.smithi153.stdout:3/857: write d4/d13/d28/f118 [40064,39741] 0 2024-02-28T16:24:49.290 INFO:tasks.workunit.client.1.smithi153.stdout:6/867: stat d0/d1d/d33/d9c/d48/d63 0 2024-02-28T16:24:49.290 INFO:tasks.workunit.client.1.smithi153.stdout:9/798: chown d1/d69/dbb/cf7 12 1 2024-02-28T16:24:49.293 INFO:tasks.workunit.client.1.smithi153.stdout:6/868: chown d0/d1d/d33/d9c/d48/ld9 1057371084 1 2024-02-28T16:24:49.293 INFO:tasks.workunit.client.1.smithi153.stdout:0/853: symlink d4/d89/l128 0 2024-02-28T16:24:49.295 INFO:tasks.workunit.client.1.smithi153.stdout:6/869: chown d0/l7 11 1 2024-02-28T16:24:49.295 INFO:tasks.workunit.client.1.smithi153.stdout:7/863: mknod d1/d25/c11f 0 2024-02-28T16:24:49.295 INFO:tasks.workunit.client.1.smithi153.stdout:3/858: readlink d4/d8/d1e/d2a/d55/da3/le5 0 2024-02-28T16:24:49.297 INFO:tasks.workunit.client.1.smithi153.stdout:3/859: readlink d4/d8/d1e/d2a/d55/da3/db5/lc8 0 2024-02-28T16:24:49.297 INFO:tasks.workunit.client.1.smithi153.stdout:9/799: creat d1/d74/d7c/f103 x:0 0 0 2024-02-28T16:24:49.299 INFO:tasks.workunit.client.1.smithi153.stdout:8/887: rmdir d0/d12/d67/d88/d85/db6/d134/d135 0 2024-02-28T16:24:49.301 INFO:tasks.workunit.client.1.smithi153.stdout:1/818: getdents d0/dd/db2/d89/dad/dde/df5 0 2024-02-28T16:24:49.303 INFO:tasks.workunit.client.1.smithi153.stdout:0/854: mknod d4/d32/d7f/d8a/dab/c129 0 2024-02-28T16:24:49.305 INFO:tasks.workunit.client.1.smithi153.stdout:6/870: write d0/d1d/d33/d9c/d2e/f37 [2002904,5339] 0 2024-02-28T16:24:49.307 INFO:tasks.workunit.client.1.smithi153.stdout:7/864: rename d1/d25/df/d26/d76 to d1/d25/df/d5a/de6/de8/d120 0 2024-02-28T16:24:49.310 INFO:tasks.workunit.client.1.smithi153.stdout:8/888: mknod d0/d12/d15/dab/dd0/de9/d11e/c145 0 2024-02-28T16:24:49.313 INFO:tasks.workunit.client.1.smithi153.stdout:8/889: chown d0/l11b 10202 1 2024-02-28T16:24:49.315 INFO:tasks.workunit.client.1.smithi153.stdout:9/800: dwrite d1/d5/d11/d1f/d20/d36/f38 [4194304,4194304] 0 2024-02-28T16:24:49.315 INFO:tasks.workunit.client.1.smithi153.stdout:0/855: creat d4/d32/df3/d126/f12a x:0 0 0 2024-02-28T16:24:49.317 INFO:tasks.workunit.client.1.smithi153.stdout:9/801: stat d1/d74/d80/da8/fc3 0 2024-02-28T16:24:49.320 INFO:tasks.workunit.client.1.smithi153.stdout:9/802: fsync d1/d5/d11/d1f/d20/d99/dae/fd9 0 2024-02-28T16:24:49.320 INFO:tasks.workunit.client.1.smithi153.stdout:1/819: creat d0/dd/db2/d89/daa/df8/f120 x:0 0 0 2024-02-28T16:24:49.321 INFO:tasks.workunit.client.1.smithi153.stdout:8/890: creat d0/d25/d132/f146 x:0 0 0 2024-02-28T16:24:49.323 INFO:tasks.workunit.client.1.smithi153.stdout:3/860: dread d4/d8/d1e/f5e [0,4194304] 0 2024-02-28T16:24:49.326 INFO:tasks.workunit.client.1.smithi153.stdout:5/878: sync 2024-02-28T16:24:49.326 INFO:tasks.workunit.client.1.smithi153.stdout:2/845: sync 2024-02-28T16:24:49.328 INFO:tasks.workunit.client.1.smithi153.stdout:9/803: fsync d1/d74/d7c/fb6 0 2024-02-28T16:24:49.331 INFO:tasks.workunit.client.1.smithi153.stdout:9/804: dread - d1/d69/dbb/ffe zero size 2024-02-28T16:24:49.334 INFO:tasks.workunit.client.1.smithi153.stdout:8/891: creat d0/d19/d2b/d2d/d3f/f147 x:0 0 0 2024-02-28T16:24:49.334 INFO:tasks.workunit.client.1.smithi153.stdout:7/865: link d1/d25/dc/d50/d66/da9/deb/c10c d1/d25/d27/d7c/dc4/dbb/c121 0 2024-02-28T16:24:49.337 INFO:tasks.workunit.client.1.smithi153.stdout:8/892: write d0/d25/f11f [995234,27597] 0 2024-02-28T16:24:49.340 INFO:tasks.workunit.client.1.smithi153.stdout:2/846: creat d2/d19/d31/d102/f116 x:0 0 0 2024-02-28T16:24:49.340 INFO:tasks.workunit.client.1.smithi153.stdout:1/820: link d0/d62/l79 d0/dd/db2/de5/d10a/l121 0 2024-02-28T16:24:49.341 INFO:tasks.workunit.client.1.smithi153.stdout:7/866: write d1/d25/df/d26/d3a/d95/fdb [1182508,56812] 0 2024-02-28T16:24:49.342 INFO:tasks.workunit.client.1.smithi153.stdout:8/893: chown d0/d25/d79/db3/fbe 20728 1 2024-02-28T16:24:49.344 INFO:tasks.workunit.client.1.smithi153.stdout:3/861: dwrite d4/dfc/d9f/ff0 [0,4194304] 0 2024-02-28T16:24:49.347 INFO:tasks.workunit.client.1.smithi153.stdout:8/894: truncate d0/d19/d2b/d2d/f10f 953346 0 2024-02-28T16:24:49.348 INFO:tasks.workunit.client.1.smithi153.stdout:5/879: link da/d29/f5e da/dd/dd1/ddd/f121 0 2024-02-28T16:24:49.350 INFO:tasks.workunit.client.1.smithi153.stdout:3/862: dread - d4/d8/d1e/d2a/fdf zero size 2024-02-28T16:24:49.352 INFO:tasks.workunit.client.1.smithi153.stdout:7/867: getdents d1/d70 0 2024-02-28T16:24:49.352 INFO:tasks.workunit.client.1.smithi153.stdout:8/895: truncate d0/d12/d15/f5f 5123033 0 2024-02-28T16:24:49.358 INFO:tasks.workunit.client.1.smithi153.stdout:7/868: truncate d1/d25/d27/fca 126722 0 2024-02-28T16:24:49.388 INFO:tasks.workunit.client.1.smithi153.stdout:6/871: write d0/d17/f28 [605726,120489] 0 2024-02-28T16:24:49.391 INFO:tasks.workunit.client.1.smithi153.stdout:9/805: write d1/d5/d11/d1f/d20/d36/f2d [831178,48832] 0 2024-02-28T16:24:49.394 INFO:tasks.workunit.client.1.smithi153.stdout:1/821: dwrite d0/dd/db2/d89/faf [0,4194304] 0 2024-02-28T16:24:49.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/847: dread d2/ff [0,4194304] 0 2024-02-28T16:24:49.399 INFO:tasks.workunit.client.1.smithi153.stdout:8/896: getdents d0/d19/d1e 0 2024-02-28T16:24:49.399 INFO:tasks.workunit.client.1.smithi153.stdout:1/822: chown d0/d3d/l5c 1816050 1 2024-02-28T16:24:49.401 INFO:tasks.workunit.client.1.smithi153.stdout:7/869: creat d1/d25/dc/ddc/f122 x:0 0 0 2024-02-28T16:24:49.406 INFO:tasks.workunit.client.1.smithi153.stdout:3/863: dwrite d4/d8/d1e/f3c [0,4194304] 0 2024-02-28T16:24:49.407 INFO:tasks.workunit.client.1.smithi153.stdout:1/823: dread - d0/d62/d66/d8e/fa0 zero size 2024-02-28T16:24:49.407 INFO:tasks.workunit.client.1.smithi153.stdout:9/806: dread d1/d5/d11/d1f/d52/f6c [0,4194304] 0 2024-02-28T16:24:49.411 INFO:tasks.workunit.client.1.smithi153.stdout:8/897: creat d0/d12/d15/dab/f148 x:0 0 0 2024-02-28T16:24:49.412 INFO:tasks.workunit.client.1.smithi153.stdout:2/848: rmdir d2/d23/d48/df0/d3b/d87/df8/dd0/d104 39 2024-02-28T16:24:49.413 INFO:tasks.workunit.client.1.smithi153.stdout:2/849: dread - d2/d86/f79 zero size 2024-02-28T16:24:49.416 INFO:tasks.workunit.client.1.smithi153.stdout:4/783: sync 2024-02-28T16:24:49.416 INFO:tasks.workunit.client.1.smithi153.stdout:6/872: creat d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/f130 x:0 0 0 2024-02-28T16:24:49.419 INFO:tasks.workunit.client.1.smithi153.stdout:7/870: symlink d1/d25/df/d26/d3a/d95/d97/dd0/l123 0 2024-02-28T16:24:49.419 INFO:tasks.workunit.client.1.smithi153.stdout:6/873: write d0/d1d/d33/db2/f104 [501015,113862] 0 2024-02-28T16:24:49.420 INFO:tasks.workunit.client.1.smithi153.stdout:3/864: dread - d4/d8/d1e/fa8 zero size 2024-02-28T16:24:49.422 INFO:tasks.workunit.client.1.smithi153.stdout:9/807: unlink d1/d5/d11/d1f/d20/d45/f4a 0 2024-02-28T16:24:49.424 INFO:tasks.workunit.client.1.smithi153.stdout:8/898: truncate d0/d34/f80 177454 0 2024-02-28T16:24:49.425 INFO:tasks.workunit.client.1.smithi153.stdout:2/850: creat d2/d23/d48/df0/d3b/d5e/f117 x:0 0 0 2024-02-28T16:24:49.427 INFO:tasks.workunit.client.1.smithi153.stdout:4/784: truncate d4/de/f45 2742373 0 2024-02-28T16:24:49.429 INFO:tasks.workunit.client.1.smithi153.stdout:4/785: fsync d4/de/d23/d2b/d4b/da9/fe0 0 2024-02-28T16:24:49.430 INFO:tasks.workunit.client.1.smithi153.stdout:6/874: mknod d0/d66/db3/c131 0 2024-02-28T16:24:49.432 INFO:tasks.workunit.client.1.smithi153.stdout:1/824: creat d0/dd/db2/d89/dc7/f122 x:0 0 0 2024-02-28T16:24:49.432 INFO:tasks.workunit.client.1.smithi153.stdout:4/786: read d4/de/d23/d2b/d31/f96 [217954,5785] 0 2024-02-28T16:24:49.439 INFO:tasks.workunit.client.1.smithi153.stdout:8/899: dwrite d0/d12/d67/d30/f7a [0,4194304] 0 2024-02-28T16:24:49.443 INFO:tasks.workunit.client.1.smithi153.stdout:8/900: read d0/d19/d1e/fff [24562,129256] 0 2024-02-28T16:24:49.444 INFO:tasks.workunit.client.1.smithi153.stdout:2/851: fdatasync d2/d19/d5d/d10f/f110 0 2024-02-28T16:24:49.446 INFO:tasks.workunit.client.1.smithi153.stdout:4/787: symlink d4/de/d47/d5e/lfc 0 2024-02-28T16:24:49.448 INFO:tasks.workunit.client.1.smithi153.stdout:9/808: truncate d1/d5/d11/d64/f86 371515 0 2024-02-28T16:24:49.451 INFO:tasks.workunit.client.1.smithi153.stdout:8/901: truncate d0/d19/d2b/d2d/d3f/d9f/dcc/fcd 695138 0 2024-02-28T16:24:49.451 INFO:tasks.workunit.client.1.smithi153.stdout:3/865: write d4/f81 [1928606,106499] 0 2024-02-28T16:24:49.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/875: mknod d0/d1d/c132 0 2024-02-28T16:24:49.451 INFO:tasks.workunit.client.1.smithi153.stdout:9/809: chown d1/d74/d80 1064380271 1 2024-02-28T16:24:49.452 INFO:tasks.workunit.client.1.smithi153.stdout:7/871: write d1/d25/df/d5a/fd1 [1202194,82971] 0 2024-02-28T16:24:49.453 INFO:tasks.workunit.client.1.smithi153.stdout:4/788: write d4/d53/fdb [968228,86171] 0 2024-02-28T16:24:49.456 INFO:tasks.workunit.client.1.smithi153.stdout:3/866: write d4/d6a/f112 [208546,110669] 0 2024-02-28T16:24:49.458 INFO:tasks.workunit.client.1.smithi153.stdout:0/856: sync 2024-02-28T16:24:49.461 INFO:tasks.workunit.client.1.smithi153.stdout:0/857: dread - d4/d32/d7f/dd6/ff2 zero size 2024-02-28T16:24:49.467 INFO:tasks.workunit.client.1.smithi153.stdout:9/810: fdatasync d1/fe6 0 2024-02-28T16:24:49.471 INFO:tasks.workunit.client.1.smithi153.stdout:4/789: mkdir d4/d53/d7c/db3/dfd 0 2024-02-28T16:24:49.473 INFO:tasks.workunit.client.1.smithi153.stdout:7/872: mkdir d1/d25/df/d60/d124 0 2024-02-28T16:24:49.473 INFO:tasks.workunit.client.1.smithi153.stdout:4/790: chown d4/d53/d7c/fda 0 1 2024-02-28T16:24:49.476 INFO:tasks.workunit.client.1.smithi153.stdout:8/902: rename d0/d19/d1e/f40 to d0/d19/d2b/d2d/d3f/f149 0 2024-02-28T16:24:49.476 INFO:tasks.workunit.client.1.smithi153.stdout:3/867: rmdir d4/d8/d1e/d2a/d55/d117 39 2024-02-28T16:24:49.478 INFO:tasks.workunit.client.1.smithi153.stdout:2/852: symlink d2/d23/d36/de2/l118 0 2024-02-28T16:24:49.479 INFO:tasks.workunit.client.1.smithi153.stdout:1/825: link d0/dd/db2/d89/dc7/fd1 d0/dd/db2/de5/d10a/f123 0 2024-02-28T16:24:49.486 INFO:tasks.workunit.client.1.smithi153.stdout:6/876: dread d0/d1d/d33/d9c/d2e/d99/dab/fee [0,4194304] 0 2024-02-28T16:24:49.489 INFO:tasks.workunit.client.1.smithi153.stdout:0/858: rename d4/f97 to d4/d9b/f12b 0 2024-02-28T16:24:49.489 INFO:tasks.workunit.client.1.smithi153.stdout:9/811: rename d1/d74 to d1/d74/d80/d104 22 2024-02-28T16:24:49.491 INFO:tasks.workunit.client.1.smithi153.stdout:0/859: stat d4/d32/d7f/d8a/dab/f21 0 2024-02-28T16:24:49.492 INFO:tasks.workunit.client.1.smithi153.stdout:4/791: dwrite d4/de/d23/d2b/d4b/d80/d9e/def/fd3 [0,4194304] 0 2024-02-28T16:24:49.493 INFO:tasks.workunit.client.1.smithi153.stdout:3/868: mkdir d4/d8/d1e/d87/d12f 0 2024-02-28T16:24:49.496 INFO:tasks.workunit.client.1.smithi153.stdout:2/853: fdatasync d2/f21 0 2024-02-28T16:24:49.499 INFO:tasks.workunit.client.1.smithi153.stdout:1/826: mknod d0/dd/db2/d89/dad/c124 0 2024-02-28T16:24:49.501 INFO:tasks.workunit.client.1.smithi153.stdout:1/827: write d0/d3d/f7d [1830940,64982] 0 2024-02-28T16:24:49.509 INFO:tasks.workunit.client.1.smithi153.stdout:7/873: symlink d1/d25/df/d5a/l125 0 2024-02-28T16:24:49.512 INFO:tasks.workunit.client.1.smithi153.stdout:8/903: creat d0/d19/d2b/d2d/d111/d13d/f14a x:0 0 0 2024-02-28T16:24:49.512 INFO:tasks.workunit.client.1.smithi153.stdout:1/828: write d0/dd/db2/d89/dad/dde/df5/ff9 [700352,40581] 0 2024-02-28T16:24:49.515 INFO:tasks.workunit.client.1.smithi153.stdout:3/869: dwrite d4/d7d/d41/f3e [0,4194304] 0 2024-02-28T16:24:49.515 INFO:tasks.workunit.client.1.smithi153.stdout:9/812: symlink d1/d5/d11/d1f/d20/dc6/l105 0 2024-02-28T16:24:49.516 INFO:tasks.workunit.client.1.smithi153.stdout:4/792: dwrite d4/d53/fdb [0,4194304] 0 2024-02-28T16:24:49.520 INFO:tasks.workunit.client.1.smithi153.stdout:6/877: getdents d0/d1d/d33/d9c/d48/d63 0 2024-02-28T16:24:49.521 INFO:tasks.workunit.client.1.smithi153.stdout:9/813: chown d1/d2a/f65 2754039 1 2024-02-28T16:24:49.527 INFO:tasks.workunit.client.1.smithi153.stdout:1/829: write d0/dd/db2/d89/dc7/ff2 [343310,1972] 0 2024-02-28T16:24:49.528 INFO:tasks.workunit.client.1.smithi153.stdout:2/854: dwrite d2/d19/d5d/d10f/f114 [0,4194304] 0 2024-02-28T16:24:49.533 INFO:tasks.workunit.client.1.smithi153.stdout:7/874: read d1/d25/df/d26/d3a/d95/fb6 [2161886,89646] 0 2024-02-28T16:24:49.534 INFO:tasks.workunit.client.1.smithi153.stdout:1/830: dread - d0/dd/db2/dcc/f118 zero size 2024-02-28T16:24:49.538 INFO:tasks.workunit.client.1.smithi153.stdout:4/793: creat d4/de/d23/ffe x:0 0 0 2024-02-28T16:24:49.540 INFO:tasks.workunit.client.1.smithi153.stdout:9/814: creat d1/d5/d11/d1f/d52/f106 x:0 0 0 2024-02-28T16:24:49.544 INFO:tasks.workunit.client.1.smithi153.stdout:2/855: read - d2/d23/d48/df0/d3b/f71 zero size 2024-02-28T16:24:49.544 INFO:tasks.workunit.client.1.smithi153.stdout:8/904: getdents d0/d12/d67/d88/d96/dfc 0 2024-02-28T16:24:49.544 INFO:tasks.workunit.client.1.smithi153.stdout:9/815: chown d1/d5/d11/ff1 43 1 2024-02-28T16:24:49.545 INFO:tasks.workunit.client.1.smithi153.stdout:3/870: dwrite d4/dfc/d9f/ff0 [0,4194304] 0 2024-02-28T16:24:49.550 INFO:tasks.workunit.client.1.smithi153.stdout:4/794: rename d4/d53/f76 to d4/d53/fff 0 2024-02-28T16:24:49.551 INFO:tasks.workunit.client.1.smithi153.stdout:5/880: sync 2024-02-28T16:24:49.553 INFO:tasks.workunit.client.1.smithi153.stdout:3/871: chown d4/d8/l37 1 1 2024-02-28T16:24:49.554 INFO:tasks.workunit.client.1.smithi153.stdout:6/878: dwrite d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fdb [0,4194304] 0 2024-02-28T16:24:49.555 INFO:tasks.workunit.client.1.smithi153.stdout:7/875: creat d1/d25/d27/d7c/dc4/dbb/f126 x:0 0 0 2024-02-28T16:24:49.558 INFO:tasks.workunit.client.1.smithi153.stdout:1/831: write d0/dd/db2/d80/fa7 [467176,73510] 0 2024-02-28T16:24:49.564 INFO:tasks.workunit.client.1.smithi153.stdout:3/872: symlink d4/d13/d28/d99/l130 0 2024-02-28T16:24:49.565 INFO:tasks.workunit.client.1.smithi153.stdout:5/881: dread da/f86 [0,4194304] 0 2024-02-28T16:24:49.566 INFO:tasks.workunit.client.1.smithi153.stdout:6/879: write d0/d1d/d5d/de9/f11f [223554,37328] 0 2024-02-28T16:24:49.567 INFO:tasks.workunit.client.1.smithi153.stdout:7/876: symlink d1/d70/dbf/l127 0 2024-02-28T16:24:49.568 INFO:tasks.workunit.client.1.smithi153.stdout:9/816: mkdir d1/d5/d11/d1f/d107 0 2024-02-28T16:24:49.570 INFO:tasks.workunit.client.1.smithi153.stdout:5/882: write da/dd/f10b [257561,3206] 0 2024-02-28T16:24:49.574 INFO:tasks.workunit.client.1.smithi153.stdout:2/856: getdents d2/d19/d31/dd1/d10c 0 2024-02-28T16:24:49.576 INFO:tasks.workunit.client.1.smithi153.stdout:4/795: dwrite d4/de/fea [0,4194304] 0 2024-02-28T16:24:49.578 INFO:tasks.workunit.client.1.smithi153.stdout:7/877: write d1/d25/df/d26/d3a/d3f/f101 [1031172,42764] 0 2024-02-28T16:24:49.578 INFO:tasks.workunit.client.1.smithi153.stdout:6/880: read d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fc2 [576711,113955] 0 2024-02-28T16:24:49.579 INFO:tasks.workunit.client.1.smithi153.stdout:2/857: write d2/d19/d31/d102/f116 [251327,42036] 0 2024-02-28T16:24:49.580 INFO:tasks.workunit.client.1.smithi153.stdout:3/873: symlink d4/d8/d1e/d2a/l131 0 2024-02-28T16:24:49.582 INFO:tasks.workunit.client.1.smithi153.stdout:5/883: write da/dd/d54/d63/fe5 [947112,75264] 0 2024-02-28T16:24:49.586 INFO:tasks.workunit.client.1.smithi153.stdout:9/817: symlink d1/d5/d11/d1f/d20/de3/l108 0 2024-02-28T16:24:49.587 INFO:tasks.workunit.client.1.smithi153.stdout:7/878: write d1/d25/df/d26/d3a/d3f/f74 [3711771,66324] 0 2024-02-28T16:24:49.593 INFO:tasks.workunit.client.1.smithi153.stdout:8/905: truncate d0/d25/f103 3308332 0 2024-02-28T16:24:49.598 INFO:tasks.workunit.client.1.smithi153.stdout:3/874: fdatasync d4/d13/fe0 0 2024-02-28T16:24:49.598 INFO:tasks.workunit.client.1.smithi153.stdout:1/832: write d0/f40 [1211765,60234] 0 2024-02-28T16:24:49.602 INFO:tasks.workunit.client.1.smithi153.stdout:7/879: dread d1/d25/df/d26/d3a/d95/fdb [0,4194304] 0 2024-02-28T16:24:49.602 INFO:tasks.workunit.client.1.smithi153.stdout:2/858: mkdir d2/d23/d48/df0/d3b/d87/df8/d119 0 2024-02-28T16:24:49.635 INFO:tasks.workunit.client.1.smithi153.stdout:0/860: sync 2024-02-28T16:24:49.644 INFO:tasks.workunit.client.1.smithi153.stdout:5/884: creat da/dd/d25/d8a/db3/f122 x:0 0 0 2024-02-28T16:24:49.646 INFO:tasks.workunit.client.1.smithi153.stdout:8/906: unlink d0/d34/fb2 0 2024-02-28T16:24:49.647 INFO:tasks.workunit.client.1.smithi153.stdout:3/875: dread d4/d8/d1e/d63/f98 [0,4194304] 0 2024-02-28T16:24:49.649 INFO:tasks.workunit.client.1.smithi153.stdout:1/833: chown d0/dd/dd5/c102 9 1 2024-02-28T16:24:49.649 INFO:tasks.workunit.client.1.smithi153.stdout:0/861: mknod d4/d32/dd9/c12c 0 2024-02-28T16:24:49.650 INFO:tasks.workunit.client.1.smithi153.stdout:5/885: readlink da/d29/d43/d5a/l6d 0 2024-02-28T16:24:49.651 INFO:tasks.workunit.client.1.smithi153.stdout:7/880: creat d1/d25/df/d26/d3a/d95/d97/f128 x:0 0 0 2024-02-28T16:24:49.654 INFO:tasks.workunit.client.1.smithi153.stdout:3/876: symlink d4/d2c/de8/l132 0 2024-02-28T16:24:49.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/881: fsync d1/d25/df/d26/d3a/d95/d97/fb7 0 2024-02-28T16:24:49.657 INFO:tasks.workunit.client.1.smithi153.stdout:2/859: creat d2/d23/d48/df0/d3b/d87/df8/dd0/f11a x:0 0 0 2024-02-28T16:24:49.658 INFO:tasks.workunit.client.1.smithi153.stdout:8/907: rename d0/d25/f47 to d0/d19/d2b/d2d/de8/f14b 0 2024-02-28T16:24:49.659 INFO:tasks.workunit.client.1.smithi153.stdout:5/886: fsync da/dd/f47 0 2024-02-28T16:24:49.664 INFO:tasks.workunit.client.1.smithi153.stdout:3/877: creat d4/d8/d1e/d2a/d91/f133 x:0 0 0 2024-02-28T16:24:49.665 INFO:tasks.workunit.client.1.smithi153.stdout:9/818: dwrite d1/d5/d11/d1f/d52/f6c [0,4194304] 0 2024-02-28T16:24:49.669 INFO:tasks.workunit.client.1.smithi153.stdout:1/834: creat d0/dd/db2/de5/f125 x:0 0 0 2024-02-28T16:24:49.669 INFO:tasks.workunit.client.1.smithi153.stdout:6/881: dwrite d0/d66/d85/fad [0,4194304] 0 2024-02-28T16:24:49.672 INFO:tasks.workunit.client.1.smithi153.stdout:9/819: dread - d1/d5/d11/d1f/d52/f106 zero size 2024-02-28T16:24:49.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/862: dwrite d4/d32/f5b [0,4194304] 0 2024-02-28T16:24:49.679 INFO:tasks.workunit.client.1.smithi153.stdout:2/860: unlink d2/d23/d48/df0/d3b/d87/l106 0 2024-02-28T16:24:49.683 INFO:tasks.workunit.client.1.smithi153.stdout:1/835: mknod d0/d62/dd2/c126 0 2024-02-28T16:24:49.684 INFO:tasks.workunit.client.1.smithi153.stdout:8/908: symlink d0/d12/d67/d88/d96/dfc/d106/l14c 0 2024-02-28T16:24:49.685 INFO:tasks.workunit.client.1.smithi153.stdout:9/820: symlink d1/d69/dbb/dbc/l109 0 2024-02-28T16:24:49.687 INFO:tasks.workunit.client.1.smithi153.stdout:3/878: symlink d4/d8/d1e/d2a/l134 0 2024-02-28T16:24:49.693 INFO:tasks.workunit.client.1.smithi153.stdout:3/879: chown d4/d8/d1e/dbb/d124 12367 1 2024-02-28T16:24:49.697 INFO:tasks.workunit.client.1.smithi153.stdout:1/836: read d0/d3d/f71 [9002,76395] 0 2024-02-28T16:24:49.701 INFO:tasks.workunit.client.1.smithi153.stdout:8/909: symlink d0/d19/d1e/df3/l14d 0 2024-02-28T16:24:49.701 INFO:tasks.workunit.client.1.smithi153.stdout:9/821: creat d1/d5/d11/d1f/d20/d45/f10a x:0 0 0 2024-02-28T16:24:49.705 INFO:tasks.workunit.client.1.smithi153.stdout:5/887: dread da/de1/f117 [0,4194304] 0 2024-02-28T16:24:49.708 INFO:tasks.workunit.client.1.smithi153.stdout:3/880: rename d4/d49/fac to d4/d8/d1e/d2a/d55/da3/f135 0 2024-02-28T16:24:49.712 INFO:tasks.workunit.client.1.smithi153.stdout:8/910: creat d0/d12/d15/dab/f14e x:0 0 0 2024-02-28T16:24:49.713 INFO:tasks.workunit.client.1.smithi153.stdout:7/882: dread d1/d25/dc/fe1 [0,4194304] 0 2024-02-28T16:24:49.714 INFO:tasks.workunit.client.1.smithi153.stdout:9/822: rename d1/d5/d11/d1f/d20/f31 to d1/d5/d11/d1f/d20/de3/f10b 0 2024-02-28T16:24:49.714 INFO:tasks.workunit.client.1.smithi153.stdout:8/911: chown d0/d19/d1e/df3/l14d 78 1 2024-02-28T16:24:49.715 INFO:tasks.workunit.client.1.smithi153.stdout:0/863: write d4/fc3 [932468,80461] 0 2024-02-28T16:24:49.719 INFO:tasks.workunit.client.1.smithi153.stdout:3/881: symlink d4/d8/d1e/d23/da0/dd9/l136 0 2024-02-28T16:24:49.719 INFO:tasks.workunit.client.1.smithi153.stdout:2/861: truncate d2/d19/d8b/dcf/fe7 1603707 0 2024-02-28T16:24:49.719 INFO:tasks.workunit.client.1.smithi153.stdout:7/883: dread - d1/d25/dc/d50/fe7 zero size 2024-02-28T16:24:49.721 INFO:tasks.workunit.client.1.smithi153.stdout:5/888: creat da/d29/d43/d5a/dbe/de7/f123 x:0 0 0 2024-02-28T16:24:49.723 INFO:tasks.workunit.client.1.smithi153.stdout:0/864: rmdir d4/d32/d7f/d8a/dab/d8e 39 2024-02-28T16:24:49.724 INFO:tasks.workunit.client.1.smithi153.stdout:8/912: chown d0/d12/d67/d88/d85/db6/fb9 234339714 1 2024-02-28T16:24:49.724 INFO:tasks.workunit.client.1.smithi153.stdout:1/837: dwrite d0/dd/d111/f61 [0,4194304] 0 2024-02-28T16:24:49.724 INFO:tasks.workunit.client.1.smithi153.stdout:7/884: chown d1/d25/dc/f35 244791298 1 2024-02-28T16:24:49.725 INFO:tasks.workunit.client.1.smithi153.stdout:2/862: write d2/d23/d88/d95/fcc [40613,106727] 0 2024-02-28T16:24:49.726 INFO:tasks.workunit.client.1.smithi153.stdout:3/882: mkdir d4/d2c/d137 0 2024-02-28T16:24:49.729 INFO:tasks.workunit.client.1.smithi153.stdout:0/865: chown d4/d32/d7f/d8a/dab/l6d 28462298 1 2024-02-28T16:24:49.729 INFO:tasks.workunit.client.1.smithi153.stdout:7/885: stat d1/d25/df/d26/d3a/d95/d97/dd0 0 2024-02-28T16:24:49.732 INFO:tasks.workunit.client.1.smithi153.stdout:6/882: dread d0/d1d/d33/d9c/d48/d72/f76 [0,4194304] 0 2024-02-28T16:24:49.732 INFO:tasks.workunit.client.1.smithi153.stdout:7/886: readlink d1/d25/df/d26/d3a/d95/lb8 0 2024-02-28T16:24:49.735 INFO:tasks.workunit.client.1.smithi153.stdout:7/887: write d1/d25/d27/d7c/dc4/d63/d75/f99 [949667,50520] 0 2024-02-28T16:24:49.737 INFO:tasks.workunit.client.1.smithi153.stdout:7/888: stat d1/d25/dc/d7e/d91/ff5 0 2024-02-28T16:24:49.747 INFO:tasks.workunit.client.1.smithi153.stdout:0/866: dread - d4/d32/d7f/d8a/dab/d8e/d94/ffc zero size 2024-02-28T16:24:49.750 INFO:tasks.workunit.client.1.smithi153.stdout:0/867: write d4/d32/d7f/d8a/dab/d8e/d94/df5/f109 [141269,127731] 0 2024-02-28T16:24:49.754 INFO:tasks.workunit.client.1.smithi153.stdout:4/796: sync 2024-02-28T16:24:49.755 INFO:tasks.workunit.client.1.smithi153.stdout:1/838: mkdir d0/d3d/def/d127 0 2024-02-28T16:24:49.756 INFO:tasks.workunit.client.1.smithi153.stdout:9/823: truncate d1/d5/d11/d1f/d20/d5d/fe5 2699332 0 2024-02-28T16:24:49.759 INFO:tasks.workunit.client.1.smithi153.stdout:9/824: fsync d1/d5/d11/d64/f87 0 2024-02-28T16:24:49.761 INFO:tasks.workunit.client.1.smithi153.stdout:2/863: dwrite d2/d19/d3e/fa1 [0,4194304] 0 2024-02-28T16:24:49.767 INFO:tasks.workunit.client.1.smithi153.stdout:6/883: truncate d0/d1d/d33/d9c/d68/da2/f11e 213957 0 2024-02-28T16:24:49.767 INFO:tasks.workunit.client.1.smithi153.stdout:9/825: readlink d1/d5/d11/d64/d85/d9a/lce 0 2024-02-28T16:24:49.767 INFO:tasks.workunit.client.1.smithi153.stdout:5/889: dwrite da/dd/f4c [0,4194304] 0 2024-02-28T16:24:49.767 INFO:tasks.workunit.client.1.smithi153.stdout:2/864: readlink d2/d19/d3e/db0/le4 0 2024-02-28T16:24:49.767 INFO:tasks.workunit.client.1.smithi153.stdout:9/826: stat d1/d5/cc7 0 2024-02-28T16:24:49.772 INFO:tasks.workunit.client.1.smithi153.stdout:8/913: rename d0/d12/d15/f77 to d0/d12/d67/d30/f14f 0 2024-02-28T16:24:49.773 INFO:tasks.workunit.client.1.smithi153.stdout:2/865: chown d2/d23/l43 60714698 1 2024-02-28T16:24:49.773 INFO:tasks.workunit.client.1.smithi153.stdout:0/868: write d4/f12 [372803,55914] 0 2024-02-28T16:24:49.775 INFO:tasks.workunit.client.1.smithi153.stdout:8/914: stat d0/d19/d2b/d2d/d3f/f147 0 2024-02-28T16:24:49.777 INFO:tasks.workunit.client.1.smithi153.stdout:1/839: write d0/dd/fc5 [500099,29396] 0 2024-02-28T16:24:49.778 INFO:tasks.workunit.client.1.smithi153.stdout:3/883: dwrite d4/d13/f3f [0,4194304] 0 2024-02-28T16:24:49.781 INFO:tasks.workunit.client.1.smithi153.stdout:1/840: stat d0/d62/d66/d8e/f97 0 2024-02-28T16:24:49.784 INFO:tasks.workunit.client.1.smithi153.stdout:2/866: chown d2/lb 1504 1 2024-02-28T16:24:49.784 INFO:tasks.workunit.client.1.smithi153.stdout:0/869: creat d4/d9b/f12d x:0 0 0 2024-02-28T16:24:49.787 INFO:tasks.workunit.client.1.smithi153.stdout:8/915: creat d0/d12/d67/d88/d96/f150 x:0 0 0 2024-02-28T16:24:49.789 INFO:tasks.workunit.client.1.smithi153.stdout:0/870: dread - d4/d32/dd9/d104/f127 zero size 2024-02-28T16:24:49.790 INFO:tasks.workunit.client.1.smithi153.stdout:3/884: mknod d4/d7d/d41/d71/c138 0 2024-02-28T16:24:49.794 INFO:tasks.workunit.client.1.smithi153.stdout:3/885: readlink d4/d8/d1e/d2a/l53 0 2024-02-28T16:24:49.795 INFO:tasks.workunit.client.1.smithi153.stdout:2/867: symlink d2/d25/db4/l11b 0 2024-02-28T16:24:49.795 INFO:tasks.workunit.client.1.smithi153.stdout:5/890: dwrite da/dd/dd1/ddd/f111 [0,4194304] 0 2024-02-28T16:24:49.796 INFO:tasks.workunit.client.1.smithi153.stdout:9/827: creat d1/d58/f10c x:0 0 0 2024-02-28T16:24:49.799 INFO:tasks.workunit.client.1.smithi153.stdout:3/886: write d4/d13/d28/dcd/dda/f121 [253969,95093] 0 2024-02-28T16:24:49.801 INFO:tasks.workunit.client.1.smithi153.stdout:4/797: link d4/d53/d7c/cdc d4/de/d13/d1b/c100 0 2024-02-28T16:24:49.803 INFO:tasks.workunit.client.1.smithi153.stdout:8/916: symlink d0/d12/d15/dab/dd0/d120/l151 0 2024-02-28T16:24:49.804 INFO:tasks.workunit.client.1.smithi153.stdout:4/798: write d4/f38 [2464960,80553] 0 2024-02-28T16:24:49.806 INFO:tasks.workunit.client.1.smithi153.stdout:0/871: fdatasync d4/d27/f9f 0 2024-02-28T16:24:49.809 INFO:tasks.workunit.client.1.smithi153.stdout:9/828: fdatasync d1/d69/f94 0 2024-02-28T16:24:49.811 INFO:tasks.workunit.client.1.smithi153.stdout:5/891: truncate da/dd/d25/d82/d8f/f98 1140876 0 2024-02-28T16:24:49.812 INFO:tasks.workunit.client.1.smithi153.stdout:2/868: rename d2/d19/d3e/f65 to d2/d23/d88/f11c 0 2024-02-28T16:24:49.815 INFO:tasks.workunit.client.1.smithi153.stdout:9/829: chown d1/d5/d27/c3c 190320 1 2024-02-28T16:24:49.816 INFO:tasks.workunit.client.1.smithi153.stdout:4/799: creat d4/de/d23/d2b/d31/da2/da5/f101 x:0 0 0 2024-02-28T16:24:49.817 INFO:tasks.workunit.client.1.smithi153.stdout:2/869: unlink d2/c1e 0 2024-02-28T16:24:49.818 INFO:tasks.workunit.client.1.smithi153.stdout:5/892: mknod da/d29/d43/de6/c124 0 2024-02-28T16:24:49.824 INFO:tasks.workunit.client.1.smithi153.stdout:4/800: write d4/de/d40/d4d/f5d [3397426,86912] 0 2024-02-28T16:24:49.832 INFO:tasks.workunit.client.1.smithi153.stdout:8/917: dwrite d0/d25/d132/f146 [0,4194304] 0 2024-02-28T16:24:49.832 INFO:tasks.workunit.client.1.smithi153.stdout:3/887: dwrite d4/d8/d1e/d2a/d91/f133 [0,4194304] 0 2024-02-28T16:24:49.837 INFO:tasks.workunit.client.1.smithi153.stdout:1/841: dwrite d0/f85 [4194304,4194304] 0 2024-02-28T16:24:49.839 INFO:tasks.workunit.client.1.smithi153.stdout:0/872: truncate d4/d32/f5b 2463947 0 2024-02-28T16:24:49.845 INFO:tasks.workunit.client.1.smithi153.stdout:8/918: dread d0/d25/d79/db3/fbe [0,4194304] 0 2024-02-28T16:24:49.846 INFO:tasks.workunit.client.1.smithi153.stdout:6/884: dread d0/d1d/d33/d9c/d48/d72/fca [0,4194304] 0 2024-02-28T16:24:49.847 INFO:tasks.workunit.client.1.smithi153.stdout:2/870: creat d2/d19/d8b/dcf/f11d x:0 0 0 2024-02-28T16:24:49.860 INFO:tasks.workunit.client.1.smithi153.stdout:9/830: rename d1/d5/d11/d64/cf3 to d1/d5/d11/d1f/d43/d76/c10d 0 2024-02-28T16:24:49.860 INFO:tasks.workunit.client.1.smithi153.stdout:7/889: sync 2024-02-28T16:24:49.860 INFO:tasks.workunit.client.1.smithi153.stdout:0/873: dwrite d4/d99/da5/ddf/f120 [0,4194304] 0 2024-02-28T16:24:49.861 INFO:tasks.workunit.client.1.smithi153.stdout:9/831: readlink d1/d69/dbb/dbc/l109 0 2024-02-28T16:24:49.862 INFO:tasks.workunit.client.1.smithi153.stdout:3/888: dread d4/d13/d8f/fb9 [0,4194304] 0 2024-02-28T16:24:49.869 INFO:tasks.workunit.client.1.smithi153.stdout:4/801: rename d4/d53/d7c/f9d to d4/de/d23/d2b/d31/da2/da5/f102 0 2024-02-28T16:24:49.884 INFO:tasks.workunit.client.1.smithi153.stdout:1/842: truncate d0/d3d/f72 2782132 0 2024-02-28T16:24:49.885 INFO:tasks.workunit.client.1.smithi153.stdout:8/919: rename d0/d12/d67/d88/d85/f129 to d0/d19/d2b/d2d/d3f/d10a/f152 0 2024-02-28T16:24:49.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/802: rmdir d4/de/d23/d2b/d31/da2/da5/db2/dc2 39 2024-02-28T16:24:49.888 INFO:tasks.workunit.client.1.smithi153.stdout:6/885: write d0/d1d/f47 [2910534,62728] 0 2024-02-28T16:24:49.889 INFO:tasks.workunit.client.1.smithi153.stdout:5/893: dwrite da/dd/d25/d82/d8f/fa9 [0,4194304] 0 2024-02-28T16:24:49.890 INFO:tasks.workunit.client.1.smithi153.stdout:2/871: write d2/d19/f2c [1279962,54948] 0 2024-02-28T16:24:49.892 INFO:tasks.workunit.client.1.smithi153.stdout:1/843: creat d0/d62/dd2/f128 x:0 0 0 2024-02-28T16:24:49.894 INFO:tasks.workunit.client.1.smithi153.stdout:2/872: readlink d2/d25/lb2 0 2024-02-28T16:24:49.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:49 smithi153 ceph-mon[35341]: pgmap v14: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 202 MiB/s wr, 464 op/s 2024-02-28T16:24:49.896 INFO:tasks.workunit.client.1.smithi153.stdout:4/803: read d4/de/d13/f18 [770365,45860] 0 2024-02-28T16:24:49.896 INFO:tasks.workunit.client.1.smithi153.stdout:8/920: rename d0/d12/d15/f29 to d0/d19/d2b/d2d/d3f/d9f/f153 0 2024-02-28T16:24:49.897 INFO:tasks.workunit.client.1.smithi153.stdout:2/873: stat d2/d19/d31/cfd 0 2024-02-28T16:24:49.899 INFO:tasks.workunit.client.1.smithi153.stdout:8/921: dread - d0/d19/d2b/d2d/d3f/f117 zero size 2024-02-28T16:24:49.901 INFO:tasks.workunit.client.1.smithi153.stdout:8/922: truncate d0/d12/f81 4905802 0 2024-02-28T16:24:49.902 INFO:tasks.workunit.client.1.smithi153.stdout:6/886: mknod d0/d1d/d33/d108/c133 0 2024-02-28T16:24:49.904 INFO:tasks.workunit.client.1.smithi153.stdout:1/844: unlink d0/dd/db2/de5/d10a/f123 0 2024-02-28T16:24:49.911 INFO:tasks.workunit.client.1.smithi153.stdout:5/894: fsync da/dd/d25/d82/fef 0 2024-02-28T16:24:49.914 INFO:tasks.workunit.client.1.smithi153.stdout:8/923: fdatasync d0/d25/f7e 0 2024-02-28T16:24:49.919 INFO:tasks.workunit.client.1.smithi153.stdout:4/804: dread d4/de/d23/d2b/d4b/d80/d9e/def/fd3 [0,4194304] 0 2024-02-28T16:24:49.919 INFO:tasks.workunit.client.1.smithi153.stdout:3/889: dwrite d4/d8/d1e/d2a/d35/d54/fd4 [0,4194304] 0 2024-02-28T16:24:49.920 INFO:tasks.workunit.client.1.smithi153.stdout:8/924: readlink d0/d19/d2b/d2d/d3f/l6c 0 2024-02-28T16:24:49.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:49 smithi023 ceph-mon[29137]: pgmap v14: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 202 MiB/s wr, 464 op/s 2024-02-28T16:24:49.923 INFO:tasks.workunit.client.1.smithi153.stdout:6/887: dread d0/d1d/d33/f73 [0,4194304] 0 2024-02-28T16:24:49.923 INFO:tasks.workunit.client.1.smithi153.stdout:3/890: chown d4/d2c/cc0 25417856 1 2024-02-28T16:24:49.924 INFO:tasks.workunit.client.1.smithi153.stdout:5/895: mkdir da/de1/de9/d125 0 2024-02-28T16:24:49.934 INFO:tasks.workunit.client.1.smithi153.stdout:7/890: dwrite d1/d25/d27/fca [0,4194304] 0 2024-02-28T16:24:49.937 INFO:tasks.workunit.client.1.smithi153.stdout:9/832: dwrite d1/d5/d11/d1f/d20/de3/f10b [0,4194304] 0 2024-02-28T16:24:49.939 INFO:tasks.workunit.client.1.smithi153.stdout:3/891: write d4/d8/d1e/d2a/d91/ff9 [351219,41560] 0 2024-02-28T16:24:49.940 INFO:tasks.workunit.client.1.smithi153.stdout:6/888: mknod d0/d1d/d33/d9c/d68/dcb/df2/c134 0 2024-02-28T16:24:49.941 INFO:tasks.workunit.client.1.smithi153.stdout:9/833: fsync d1/d5/d27/f8e 0 2024-02-28T16:24:49.941 INFO:tasks.workunit.client.1.smithi153.stdout:1/845: dwrite d0/dc1/feb [0,4194304] 0 2024-02-28T16:24:49.944 INFO:tasks.workunit.client.1.smithi153.stdout:7/891: write d1/d25/df/fda [1120399,93792] 0 2024-02-28T16:24:49.945 INFO:tasks.workunit.client.1.smithi153.stdout:2/874: dwrite d2/d23/fc4 [0,4194304] 0 2024-02-28T16:24:49.956 INFO:tasks.workunit.client.1.smithi153.stdout:4/805: dread d4/de/d13/f35 [0,4194304] 0 2024-02-28T16:24:49.962 INFO:tasks.workunit.client.1.smithi153.stdout:6/889: mkdir d0/d135 0 2024-02-28T16:24:49.963 INFO:tasks.workunit.client.1.smithi153.stdout:3/892: symlink d4/d7d/l139 0 2024-02-28T16:24:49.967 INFO:tasks.workunit.client.1.smithi153.stdout:9/834: truncate d1/d74/d80/da8/f46 360037 0 2024-02-28T16:24:49.967 INFO:tasks.workunit.client.1.smithi153.stdout:6/890: dread - d0/d1d/d30/d71/f84 zero size 2024-02-28T16:24:49.968 INFO:tasks.workunit.client.1.smithi153.stdout:4/806: mkdir d4/de/d23/d2b/d31/dc3/d103 0 2024-02-28T16:24:49.969 INFO:tasks.workunit.client.1.smithi153.stdout:5/896: getdents da/d29/d43/d113 0 2024-02-28T16:24:49.971 INFO:tasks.workunit.client.1.smithi153.stdout:9/835: chown d1/d5/cc7 4409602 1 2024-02-28T16:24:49.976 INFO:tasks.workunit.client.1.smithi153.stdout:9/836: creat d1/d69/dbb/f10e x:0 0 0 2024-02-28T16:24:49.977 INFO:tasks.workunit.client.1.smithi153.stdout:4/807: mknod d4/d53/d7c/db3/dfd/c104 0 2024-02-28T16:24:49.978 INFO:tasks.workunit.client.1.smithi153.stdout:9/837: dread - d1/d5/d11/d1f/d62/fd0 zero size 2024-02-28T16:24:49.982 INFO:tasks.workunit.client.1.smithi153.stdout:3/893: dread d4/dfc/d9f/ff0 [0,4194304] 0 2024-02-28T16:24:49.983 INFO:tasks.workunit.client.1.smithi153.stdout:4/808: chown d4/de/f45 2197 1 2024-02-28T16:24:49.988 INFO:tasks.workunit.client.1.smithi153.stdout:8/925: dread d0/d12/d67/d30/feb [0,4194304] 0 2024-02-28T16:24:49.989 INFO:tasks.workunit.client.1.smithi153.stdout:3/894: mkdir d4/d13/d8f/d13a 0 2024-02-28T16:24:49.991 INFO:tasks.workunit.client.1.smithi153.stdout:7/892: dread d1/d25/df/f61 [0,4194304] 0 2024-02-28T16:24:49.993 INFO:tasks.workunit.client.1.smithi153.stdout:4/809: unlink d4/de/c39 0 2024-02-28T16:24:49.997 INFO:tasks.workunit.client.1.smithi153.stdout:3/895: fdatasync d4/d13/d28/dcd/dda/f122 0 2024-02-28T16:24:49.999 INFO:tasks.workunit.client.1.smithi153.stdout:4/810: chown d4/de/l1a 0 1 2024-02-28T16:24:50.000 INFO:tasks.workunit.client.1.smithi153.stdout:5/897: dwrite da/f86 [0,4194304] 0 2024-02-28T16:24:50.000 INFO:tasks.workunit.client.1.smithi153.stdout:8/926: creat d0/d12/d67/d30/f154 x:0 0 0 2024-02-28T16:24:50.002 INFO:tasks.workunit.client.1.smithi153.stdout:2/875: dread d2/d19/d31/f58 [0,4194304] 0 2024-02-28T16:24:50.002 INFO:tasks.workunit.client.1.smithi153.stdout:4/811: write d4/f38 [4140271,83103] 0 2024-02-28T16:24:50.002 INFO:tasks.workunit.client.1.smithi153.stdout:6/891: dread d0/f10 [0,4194304] 0 2024-02-28T16:24:50.003 INFO:tasks.workunit.client.1.smithi153.stdout:3/896: write d4/d8/d1e/d87/f108 [800062,2711] 0 2024-02-28T16:24:50.004 INFO:tasks.workunit.client.1.smithi153.stdout:5/898: fsync da/dd/dd1/f10f 0 2024-02-28T16:24:50.006 INFO:tasks.workunit.client.1.smithi153.stdout:3/897: write d4/d8/f1c [216293,86134] 0 2024-02-28T16:24:50.010 INFO:tasks.workunit.client.1.smithi153.stdout:9/838: truncate d1/d5/d27/dd6/f95 11497 0 2024-02-28T16:24:50.010 INFO:tasks.workunit.client.1.smithi153.stdout:0/874: sync 2024-02-28T16:24:50.010 INFO:tasks.workunit.client.1.smithi153.stdout:4/812: dread d4/de/d13/f35 [0,4194304] 0 2024-02-28T16:24:50.011 INFO:tasks.workunit.client.1.smithi153.stdout:8/927: rmdir d0/d34 39 2024-02-28T16:24:50.012 INFO:tasks.workunit.client.1.smithi153.stdout:4/813: write d4/de/d40/d4d/f5d [170326,22370] 0 2024-02-28T16:24:50.017 INFO:tasks.workunit.client.1.smithi153.stdout:0/875: creat d4/d32/d7f/dd6/dff/f12e x:0 0 0 2024-02-28T16:24:50.021 INFO:tasks.workunit.client.1.smithi153.stdout:7/893: creat d1/d25/df/d26/d3a/d5e/d72/f129 x:0 0 0 2024-02-28T16:24:50.021 INFO:tasks.workunit.client.1.smithi153.stdout:5/899: mknod da/dd/d25/d41/c126 0 2024-02-28T16:24:50.025 INFO:tasks.workunit.client.1.smithi153.stdout:4/814: unlink d4/de/d47/d5e/lfc 0 2024-02-28T16:24:50.026 INFO:tasks.workunit.client.1.smithi153.stdout:0/876: truncate d4/d32/dd9/f116 1251920 0 2024-02-28T16:24:50.028 INFO:tasks.workunit.client.1.smithi153.stdout:3/898: symlink d4/d13/d28/l13b 0 2024-02-28T16:24:50.029 INFO:tasks.workunit.client.1.smithi153.stdout:9/839: write d1/d5/d27/fab [3349777,129233] 0 2024-02-28T16:24:50.031 INFO:tasks.workunit.client.1.smithi153.stdout:9/840: fsync d1/d69/f94 0 2024-02-28T16:24:50.032 INFO:tasks.workunit.client.1.smithi153.stdout:6/892: dwrite d0/d1d/d33/d9c/d48/fc0 [0,4194304] 0 2024-02-28T16:24:50.035 INFO:tasks.workunit.client.1.smithi153.stdout:2/876: dread d2/d23/d48/df0/d3b/f92 [0,4194304] 0 2024-02-28T16:24:50.045 INFO:tasks.workunit.client.1.smithi153.stdout:0/877: symlink d4/d99/l12f 0 2024-02-28T16:24:50.045 INFO:tasks.workunit.client.1.smithi153.stdout:5/900: creat da/d29/d11a/f127 x:0 0 0 2024-02-28T16:24:50.046 INFO:tasks.workunit.client.1.smithi153.stdout:2/877: chown d2/d23/d88/d95/fcc 19179 1 2024-02-28T16:24:50.049 INFO:tasks.workunit.client.1.smithi153.stdout:6/893: mkdir d0/d1d/d33/d9c/d48/d63/d8c/dc3/d136 0 2024-02-28T16:24:50.050 INFO:tasks.workunit.client.1.smithi153.stdout:8/928: dwrite d0/d12/d67/ff0 [0,4194304] 0 2024-02-28T16:24:50.056 INFO:tasks.workunit.client.1.smithi153.stdout:0/878: rmdir d4/d32/df0/dfe 39 2024-02-28T16:24:50.057 INFO:tasks.workunit.client.1.smithi153.stdout:5/901: chown da/d29/f5e 495330036 1 2024-02-28T16:24:50.062 INFO:tasks.workunit.client.1.smithi153.stdout:0/879: dread d4/f3e [0,4194304] 0 2024-02-28T16:24:50.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/929: truncate d0/d34/f60 842164 0 2024-02-28T16:24:50.065 INFO:tasks.workunit.client.1.smithi153.stdout:4/815: dwrite d4/de/f45 [0,4194304] 0 2024-02-28T16:24:50.070 INFO:tasks.workunit.client.1.smithi153.stdout:8/930: creat d0/d12/d15/dab/f155 x:0 0 0 2024-02-28T16:24:50.070 INFO:tasks.workunit.client.1.smithi153.stdout:0/880: truncate d4/d32/d7f/d8a/dab/d8e/d94/df5/f114 97741 0 2024-02-28T16:24:50.072 INFO:tasks.workunit.client.1.smithi153.stdout:7/894: dread d1/d25/df/d26/d3a/d95/d97/fb7 [0,4194304] 0 2024-02-28T16:24:50.073 INFO:tasks.workunit.client.1.smithi153.stdout:4/816: mkdir d4/d8d/da3/d105 0 2024-02-28T16:24:50.073 INFO:tasks.workunit.client.1.smithi153.stdout:8/931: dread - d0/d19/d2b/d2d/d3f/d10a/f128 zero size 2024-02-28T16:24:50.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/841: truncate d1/d2a/f65 9475 0 2024-02-28T16:24:50.081 INFO:tasks.workunit.client.1.smithi153.stdout:4/817: mkdir d4/de/d47/d5e/d106 0 2024-02-28T16:24:50.082 INFO:tasks.workunit.client.1.smithi153.stdout:8/932: mknod d0/d19/d2b/d2d/d3f/d9f/dcc/c156 0 2024-02-28T16:24:50.086 INFO:tasks.workunit.client.1.smithi153.stdout:1/846: sync 2024-02-28T16:24:50.086 INFO:tasks.workunit.client.1.smithi153.stdout:9/842: dread d1/fb2 [0,4194304] 0 2024-02-28T16:24:50.088 INFO:tasks.workunit.client.1.smithi153.stdout:8/933: write d0/d19/d2b/d2d/d3f/f114 [83541,118323] 0 2024-02-28T16:24:50.093 INFO:tasks.workunit.client.1.smithi153.stdout:9/843: stat d1/d5/d11/d1f/d52/f106 0 2024-02-28T16:24:50.094 INFO:tasks.workunit.client.1.smithi153.stdout:8/934: mknod d0/da5/c157 0 2024-02-28T16:24:50.100 INFO:tasks.workunit.client.1.smithi153.stdout:1/847: chown d0/dd/db2/l6c 2986272 1 2024-02-28T16:24:50.104 INFO:tasks.workunit.client.1.smithi153.stdout:0/881: write d4/d32/d7f/d8a/dab/d8e/d94/fdd [2681405,5783] 0 2024-02-28T16:24:50.109 INFO:tasks.workunit.client.1.smithi153.stdout:0/882: readlink d4/d89/lee 0 2024-02-28T16:24:50.109 INFO:tasks.workunit.client.1.smithi153.stdout:5/902: dwrite da/dd/d25/d82/fef [0,4194304] 0 2024-02-28T16:24:50.113 INFO:tasks.workunit.client.1.smithi153.stdout:0/883: read - d4/d32/dd9/d104/f127 zero size 2024-02-28T16:24:50.114 INFO:tasks.workunit.client.1.smithi153.stdout:8/935: link d0/d19/l138 d0/d19/d2b/d2d/d3f/d10a/l158 0 2024-02-28T16:24:50.116 INFO:tasks.workunit.client.1.smithi153.stdout:1/848: creat d0/dd/db2/d89/dc7/de6/f129 x:0 0 0 2024-02-28T16:24:50.120 INFO:tasks.workunit.client.1.smithi153.stdout:4/818: dwrite d4/f15 [0,4194304] 0 2024-02-28T16:24:50.122 INFO:tasks.workunit.client.1.smithi153.stdout:5/903: truncate da/d29/d43/d5a/d77/f8b 1352605 0 2024-02-28T16:24:50.129 INFO:tasks.workunit.client.1.smithi153.stdout:5/904: chown da/dd/d25/d8a/dac/dc6/c112 6648088 1 2024-02-28T16:24:50.131 INFO:tasks.workunit.client.1.smithi153.stdout:7/895: dread d1/d25/d27/f9b [0,4194304] 0 2024-02-28T16:24:50.136 INFO:tasks.workunit.client.1.smithi153.stdout:7/896: write d1/d25/dc/f35 [1092335,114806] 0 2024-02-28T16:24:50.139 INFO:tasks.workunit.client.1.smithi153.stdout:5/905: creat da/dd/dd1/ddd/f128 x:0 0 0 2024-02-28T16:24:50.144 INFO:tasks.workunit.client.1.smithi153.stdout:0/884: dwrite d4/d32/fba [4194304,4194304] 0 2024-02-28T16:24:50.146 INFO:tasks.workunit.client.1.smithi153.stdout:8/936: dread d0/d12/d67/d30/feb [0,4194304] 0 2024-02-28T16:24:50.153 INFO:tasks.workunit.client.1.smithi153.stdout:5/906: rename da/dd/d25/d82/d8f/f91 to da/d29/d43/d5a/dbe/f129 0 2024-02-28T16:24:50.159 INFO:tasks.workunit.client.1.smithi153.stdout:3/899: sync 2024-02-28T16:24:50.160 INFO:tasks.workunit.client.1.smithi153.stdout:4/819: dwrite d4/de/d13/f20 [0,4194304] 0 2024-02-28T16:24:50.163 INFO:tasks.workunit.client.1.smithi153.stdout:0/885: mknod d4/d32/d7f/d8a/dab/c130 0 2024-02-28T16:24:50.164 INFO:tasks.workunit.client.1.smithi153.stdout:7/897: dwrite d1/d25/df/d26/d3a/d5e/fec [0,4194304] 0 2024-02-28T16:24:50.164 INFO:tasks.workunit.client.1.smithi153.stdout:3/900: fdatasync d4/d7d/d70/f7a 0 2024-02-28T16:24:50.164 INFO:tasks.workunit.client.1.smithi153.stdout:1/849: dread d0/d62/f8f [0,4194304] 0 2024-02-28T16:24:50.171 INFO:tasks.workunit.client.1.smithi153.stdout:4/820: chown d4/de/d23/d2b/d31/cd9 1 1 2024-02-28T16:24:50.172 INFO:tasks.workunit.client.1.smithi153.stdout:0/886: chown d4/d27/d9a/da1/f72 0 1 2024-02-28T16:24:50.173 INFO:tasks.workunit.client.1.smithi153.stdout:4/821: write d4/de/d40/d4d/f5d [154723,57490] 0 2024-02-28T16:24:50.176 INFO:tasks.workunit.client.1.smithi153.stdout:5/907: dread da/d29/f5e [0,4194304] 0 2024-02-28T16:24:50.177 INFO:tasks.workunit.client.1.smithi153.stdout:1/850: chown d0/d62/c95 62 1 2024-02-28T16:24:50.177 INFO:tasks.workunit.client.1.smithi153.stdout:5/908: fsync da/dd/fe 0 2024-02-28T16:24:50.178 INFO:tasks.workunit.client.1.smithi153.stdout:7/898: fdatasync d1/d25/d27/f9b 0 2024-02-28T16:24:50.180 INFO:tasks.workunit.client.1.smithi153.stdout:3/901: truncate d4/d8/d1e/d2a/d55/f92 857899 0 2024-02-28T16:24:50.184 INFO:tasks.workunit.client.1.smithi153.stdout:0/887: symlink d4/d32/d7f/d8a/dab/d8e/d90/l131 0 2024-02-28T16:24:50.184 INFO:tasks.workunit.client.1.smithi153.stdout:4/822: rmdir d4/de/d23/d2b 39 2024-02-28T16:24:50.189 INFO:tasks.workunit.client.1.smithi153.stdout:7/899: fsync d1/d25/fa5 0 2024-02-28T16:24:50.190 INFO:tasks.workunit.client.1.smithi153.stdout:7/900: chown d1/d25/d27/d7c/dc4/dbb 2 1 2024-02-28T16:24:50.190 INFO:tasks.workunit.client.1.smithi153.stdout:3/902: mkdir d4/d8/d1e/d2a/d55/da3/db1/d13c 0 2024-02-28T16:24:50.190 INFO:tasks.workunit.client.1.smithi153.stdout:9/844: dread d1/d74/d7c/fb6 [0,4194304] 0 2024-02-28T16:24:50.193 INFO:tasks.workunit.client.1.smithi153.stdout:9/845: readlink d1/d5/d11/le0 0 2024-02-28T16:24:50.193 INFO:tasks.workunit.client.1.smithi153.stdout:1/851: unlink d0/dd/db2/d89/daa/fc8 0 2024-02-28T16:24:50.196 INFO:tasks.workunit.client.1.smithi153.stdout:9/846: chown d1/d5/d11/d1f/d43 0 1 2024-02-28T16:24:50.197 INFO:tasks.workunit.client.1.smithi153.stdout:5/909: getdents da/d29/d43/d5a/dbe/de7 0 2024-02-28T16:24:50.198 INFO:tasks.workunit.client.1.smithi153.stdout:4/823: dread - d4/de/d23/d2b/d31/da2/da5/db2/dc2/ff0 zero size 2024-02-28T16:24:50.198 INFO:tasks.workunit.client.1.smithi153.stdout:3/903: mkdir d4/d8/d1e/d23/d13d 0 2024-02-28T16:24:50.201 INFO:tasks.workunit.client.1.smithi153.stdout:9/847: read d1/fb0 [4144683,88199] 0 2024-02-28T16:24:50.204 INFO:tasks.workunit.client.1.smithi153.stdout:3/904: chown d4/d8/d1e/d23/l25 142 1 2024-02-28T16:24:50.204 INFO:tasks.workunit.client.1.smithi153.stdout:0/888: dwrite d4/d32/dcf/df6/d10c/fce [0,4194304] 0 2024-02-28T16:24:50.206 INFO:tasks.workunit.client.1.smithi153.stdout:1/852: rename d0/f14 to d0/dd/db2/d89/daa/df8/f12a 0 2024-02-28T16:24:50.207 INFO:tasks.workunit.client.1.smithi153.stdout:7/901: dread d1/d25/df/f61 [0,4194304] 0 2024-02-28T16:24:50.210 INFO:tasks.workunit.client.1.smithi153.stdout:2/878: sync 2024-02-28T16:24:50.210 INFO:tasks.workunit.client.1.smithi153.stdout:6/894: sync 2024-02-28T16:24:50.216 INFO:tasks.workunit.client.1.smithi153.stdout:0/889: symlink d4/d27/d9a/da1/l132 0 2024-02-28T16:24:50.216 INFO:tasks.workunit.client.1.smithi153.stdout:5/910: write da/f73 [1434912,126840] 0 2024-02-28T16:24:50.218 INFO:tasks.workunit.client.1.smithi153.stdout:5/911: chown da/dd/d25/d8a/f115 6441 1 2024-02-28T16:24:50.220 INFO:tasks.workunit.client.1.smithi153.stdout:9/848: write d1/d5/f47 [1111276,4101] 0 2024-02-28T16:24:50.224 INFO:tasks.workunit.client.1.smithi153.stdout:6/895: write d0/f10 [6397544,23303] 0 2024-02-28T16:24:50.228 INFO:tasks.workunit.client.1.smithi153.stdout:5/912: chown da/d29/d43/cb8 10 1 2024-02-28T16:24:50.233 INFO:tasks.workunit.client.1.smithi153.stdout:3/905: rmdir d4/d7d/d41/d11b/d125 0 2024-02-28T16:24:50.234 INFO:tasks.workunit.client.1.smithi153.stdout:9/849: creat d1/d5/d27/f10f x:0 0 0 2024-02-28T16:24:50.234 INFO:tasks.workunit.client.1.smithi153.stdout:0/890: symlink d4/d32/d7f/d8a/dab/d8e/l133 0 2024-02-28T16:24:50.234 INFO:tasks.workunit.client.1.smithi153.stdout:6/896: truncate d0/d1d/d33/d9c/f1a 1128992 0 2024-02-28T16:24:50.236 INFO:tasks.workunit.client.1.smithi153.stdout:7/902: creat d1/d25/d27/d7c/f12a x:0 0 0 2024-02-28T16:24:50.236 INFO:tasks.workunit.client.1.smithi153.stdout:9/850: chown d1/d5/d11/d1f/d20/d99/l9b 243054759 1 2024-02-28T16:24:50.239 INFO:tasks.workunit.client.1.smithi153.stdout:6/897: truncate d0/d1d/d33/d9c/d2e/d99/ddf/da4/f125 553790 0 2024-02-28T16:24:50.274 INFO:tasks.workunit.client.1.smithi153.stdout:4/824: rename d4/de/d23/d2b/d4b/d80/d9e/lca to d4/de/l107 0 2024-02-28T16:24:50.275 INFO:tasks.workunit.client.1.smithi153.stdout:1/853: getdents d0/dd/d111/dd9 0 2024-02-28T16:24:50.277 INFO:tasks.workunit.client.1.smithi153.stdout:7/903: write d1/d25/df/d5a/de6/de8/d120/f9a [3622176,12812] 0 2024-02-28T16:24:50.277 INFO:tasks.workunit.client.1.smithi153.stdout:9/851: creat d1/d5/d11/d1f/d62/dca/f110 x:0 0 0 2024-02-28T16:24:50.279 INFO:tasks.workunit.client.1.smithi153.stdout:4/825: dread - d4/d53/d7c/da4/fbb zero size 2024-02-28T16:24:50.281 INFO:tasks.workunit.client.1.smithi153.stdout:6/898: creat d0/d66/f137 x:0 0 0 2024-02-28T16:24:50.281 INFO:tasks.workunit.client.1.smithi153.stdout:3/906: mknod d4/d8/d1e/d2a/c13e 0 2024-02-28T16:24:50.283 INFO:tasks.workunit.client.1.smithi153.stdout:1/854: creat d0/dd/d111/dd9/f12b x:0 0 0 2024-02-28T16:24:50.287 INFO:tasks.workunit.client.1.smithi153.stdout:0/891: dread d4/d9b/f12b [0,4194304] 0 2024-02-28T16:24:50.288 INFO:tasks.workunit.client.1.smithi153.stdout:3/907: write d4/d13/d28/dcd/dda/f101 [960077,15764] 0 2024-02-28T16:24:50.289 INFO:tasks.workunit.client.1.smithi153.stdout:7/904: unlink d1/d25/d27/d7c/dc4/dbb/f126 0 2024-02-28T16:24:50.290 INFO:tasks.workunit.client.1.smithi153.stdout:6/899: mkdir d0/d1d/d33/d9c/d68/dcb/df2/d138 0 2024-02-28T16:24:50.292 INFO:tasks.workunit.client.1.smithi153.stdout:8/937: sync 2024-02-28T16:24:50.293 INFO:tasks.workunit.client.1.smithi153.stdout:3/908: chown d4/d7d/d41/d71/cb2 3593 1 2024-02-28T16:24:50.293 INFO:tasks.workunit.client.1.smithi153.stdout:7/905: chown d1/d25/d27 3495 1 2024-02-28T16:24:50.294 INFO:tasks.workunit.client.1.smithi153.stdout:9/852: getdents d1/d74/d80/da8 0 2024-02-28T16:24:50.298 INFO:tasks.workunit.client.1.smithi153.stdout:8/938: unlink d0/d25/d132/f146 0 2024-02-28T16:24:50.302 INFO:tasks.workunit.client.1.smithi153.stdout:5/913: dread da/dd/f60 [0,4194304] 0 2024-02-28T16:24:50.302 INFO:tasks.workunit.client.1.smithi153.stdout:6/900: rename d0/f81 to d0/d1d/d33/d9c/d2e/d99/f139 0 2024-02-28T16:24:50.302 INFO:tasks.workunit.client.1.smithi153.stdout:3/909: creat d4/d8/d1e/d2a/d91/f13f x:0 0 0 2024-02-28T16:24:50.303 INFO:tasks.workunit.client.1.smithi153.stdout:7/906: creat d1/d25/df/d26/d3a/d5e/dc8/f12b x:0 0 0 2024-02-28T16:24:50.305 INFO:tasks.workunit.client.1.smithi153.stdout:8/939: dread - d0/d12/d67/d88/fa4 zero size 2024-02-28T16:24:50.306 INFO:tasks.workunit.client.1.smithi153.stdout:3/910: chown d4/d13/d8f/fb0 8289 1 2024-02-28T16:24:50.309 INFO:tasks.workunit.client.1.smithi153.stdout:1/855: dwrite d0/dd/db2/de5/d10a/f10b [4194304,4194304] 0 2024-02-28T16:24:50.309 INFO:tasks.workunit.client.1.smithi153.stdout:4/826: dread d4/f29 [0,4194304] 0 2024-02-28T16:24:50.317 INFO:tasks.workunit.client.1.smithi153.stdout:5/914: dread da/d29/d43/d5a/d77/f8b [0,4194304] 0 2024-02-28T16:24:50.324 INFO:tasks.workunit.client.1.smithi153.stdout:9/853: link d1/d58/c7f d1/d5/d11/d1f/d40/c111 0 2024-02-28T16:24:50.328 INFO:tasks.workunit.client.1.smithi153.stdout:1/856: mkdir d0/dd/db2/d89/dad/dde/d114/d12c 0 2024-02-28T16:24:50.333 INFO:tasks.workunit.client.1.smithi153.stdout:5/915: dwrite da/dd/dd1/ddd/f128 [0,4194304] 0 2024-02-28T16:24:50.336 INFO:tasks.workunit.client.1.smithi153.stdout:8/940: write d0/d25/f103 [3328667,15052] 0 2024-02-28T16:24:50.339 INFO:tasks.workunit.client.1.smithi153.stdout:6/901: rename d0/d1d/d33/d9c/d48/d72/c110 to d0/d1d/d33/d9c/d48/c13a 0 2024-02-28T16:24:50.339 INFO:tasks.workunit.client.1.smithi153.stdout:9/854: truncate d1/d5/d27/dd6/f95 608038 0 2024-02-28T16:24:50.342 INFO:tasks.workunit.client.1.smithi153.stdout:8/941: chown d0/d12/d67/d30/d63/d74/fee 1 1 2024-02-28T16:24:50.343 INFO:tasks.workunit.client.1.smithi153.stdout:1/857: write d0/d62/d66/fc3 [1328022,87094] 0 2024-02-28T16:24:50.343 INFO:tasks.workunit.client.1.smithi153.stdout:5/916: dread da/d29/d43/fd5 [0,4194304] 0 2024-02-28T16:24:50.344 INFO:tasks.workunit.client.1.smithi153.stdout:4/827: rename d4/de/d47/d5e/d62/c7e to d4/de/d23/d2b/d31/dc3/c108 0 2024-02-28T16:24:50.346 INFO:tasks.workunit.client.1.smithi153.stdout:6/902: mkdir d0/d66/d13b 0 2024-02-28T16:24:50.347 INFO:tasks.workunit.client.1.smithi153.stdout:4/828: stat d4/d53/d7c/fd1 0 2024-02-28T16:24:50.349 INFO:tasks.workunit.client.1.smithi153.stdout:4/829: stat d4/d53/ff9 0 2024-02-28T16:24:50.349 INFO:tasks.workunit.client.1.smithi153.stdout:9/855: symlink d1/d5/d11/d64/l112 0 2024-02-28T16:24:50.352 INFO:tasks.workunit.client.1.smithi153.stdout:3/911: dwrite d4/d8/d1e/fa8 [0,4194304] 0 2024-02-28T16:24:50.352 INFO:tasks.workunit.client.1.smithi153.stdout:1/858: creat d0/dd/db2/de5/d10a/f12d x:0 0 0 2024-02-28T16:24:50.364 INFO:tasks.workunit.client.1.smithi153.stdout:5/917: dwrite da/dd/d25/fff [0,4194304] 0 2024-02-28T16:24:50.368 INFO:tasks.workunit.client.1.smithi153.stdout:3/912: symlink d4/d8/d1e/d23/da0/l140 0 2024-02-28T16:24:50.372 INFO:tasks.workunit.client.1.smithi153.stdout:1/859: creat d0/dd/db2/d89/dc7/d103/f12e x:0 0 0 2024-02-28T16:24:50.373 INFO:tasks.workunit.client.1.smithi153.stdout:5/918: fsync da/dd/d25/fab 0 2024-02-28T16:24:50.374 INFO:tasks.workunit.client.1.smithi153.stdout:3/913: mkdir d4/d49/d141 0 2024-02-28T16:24:50.375 INFO:tasks.workunit.client.1.smithi153.stdout:4/830: mknod d4/d8d/da3/d105/c109 0 2024-02-28T16:24:50.375 INFO:tasks.workunit.client.1.smithi153.stdout:3/914: chown d4/d8/d1e/d87 141183836 1 2024-02-28T16:24:50.379 INFO:tasks.workunit.client.1.smithi153.stdout:5/919: rmdir da/dd/d25/d82 39 2024-02-28T16:24:50.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/942: dread d0/d12/d67/d88/d8e/f9c [0,4194304] 0 2024-02-28T16:24:50.383 INFO:tasks.workunit.client.1.smithi153.stdout:1/860: write d0/dd/db2/d89/daa/df8/f12a [4789002,42925] 0 2024-02-28T16:24:50.384 INFO:tasks.workunit.client.1.smithi153.stdout:6/903: dwrite d0/d1d/d33/d9c/d2e/d99/f139 [0,4194304] 0 2024-02-28T16:24:50.386 INFO:tasks.workunit.client.1.smithi153.stdout:5/920: creat da/dd/d25/d8a/dac/f12a x:0 0 0 2024-02-28T16:24:50.388 INFO:tasks.workunit.client.1.smithi153.stdout:3/915: rename d4/d8/d1e/d2a/d91/fe1 to d4/d8/d1e/d23/da0/dd9/f142 0 2024-02-28T16:24:50.392 INFO:tasks.workunit.client.1.smithi153.stdout:1/861: mkdir d0/d62/dd2/d12f 0 2024-02-28T16:24:50.397 INFO:tasks.workunit.client.1.smithi153.stdout:5/921: mkdir da/dd/d25/d8a/dac/dc7/d12b 0 2024-02-28T16:24:50.398 INFO:tasks.workunit.client.1.smithi153.stdout:4/831: dwrite d4/f15 [0,4194304] 0 2024-02-28T16:24:50.399 INFO:tasks.workunit.client.1.smithi153.stdout:1/862: creat d0/dd/db2/d89/dc7/d103/f130 x:0 0 0 2024-02-28T16:24:50.401 INFO:tasks.workunit.client.1.smithi153.stdout:3/916: link d4/d7d/d41/d71/lea d4/d7d/d41/d71/l143 0 2024-02-28T16:24:50.409 INFO:tasks.workunit.client.1.smithi153.stdout:6/904: truncate d0/d66/d85/fad 1729914 0 2024-02-28T16:24:50.414 INFO:tasks.workunit.client.1.smithi153.stdout:1/863: write d0/dd/db2/d89/dad/fcd [102935,51607] 0 2024-02-28T16:24:50.415 INFO:tasks.workunit.client.1.smithi153.stdout:4/832: dwrite d4/de/d13/f18 [0,4194304] 0 2024-02-28T16:24:50.417 INFO:tasks.workunit.client.1.smithi153.stdout:1/864: write d0/fdc [10058,65485] 0 2024-02-28T16:24:50.418 INFO:tasks.workunit.client.1.smithi153.stdout:4/833: write d4/de/d47/f8c [1451766,110239] 0 2024-02-28T16:24:50.424 INFO:tasks.workunit.client.1.smithi153.stdout:4/834: read - d4/d53/ff9 zero size 2024-02-28T16:24:50.433 INFO:tasks.workunit.client.1.smithi153.stdout:1/865: dwrite d0/dd/db2/d89/dc7/ff2 [0,4194304] 0 2024-02-28T16:24:50.436 INFO:tasks.workunit.client.1.smithi153.stdout:6/905: truncate d0/d1d/d33/d9c/d48/d72/fca 7829879 0 2024-02-28T16:24:50.439 INFO:tasks.workunit.client.1.smithi153.stdout:2/879: sync 2024-02-28T16:24:50.443 INFO:tasks.workunit.client.1.smithi153.stdout:4/835: dwrite f1 [0,4194304] 0 2024-02-28T16:24:50.444 INFO:tasks.workunit.client.1.smithi153.stdout:2/880: readlink d2/d19/d31/l89 0 2024-02-28T16:24:50.449 INFO:tasks.workunit.client.1.smithi153.stdout:4/836: read d4/d53/d7c/db3/f43 [1799792,21727] 0 2024-02-28T16:24:50.454 INFO:tasks.workunit.client.1.smithi153.stdout:2/881: mknod d2/d23/d88/dbf/c11e 0 2024-02-28T16:24:50.456 INFO:tasks.workunit.client.1.smithi153.stdout:6/906: dwrite d0/d1d/d33/d9c/d68/dcb/df2/f117 [0,4194304] 0 2024-02-28T16:24:50.458 INFO:tasks.workunit.client.1.smithi153.stdout:1/866: write d0/dd/f29 [93126,100755] 0 2024-02-28T16:24:50.459 INFO:tasks.workunit.client.1.smithi153.stdout:4/837: truncate d4/de/d47/f67 1915321 0 2024-02-28T16:24:50.459 INFO:tasks.workunit.client.1.smithi153.stdout:6/907: fdatasync d0/d1d/d33/d9c/d2e/f42 0 2024-02-28T16:24:50.459 INFO:tasks.workunit.client.1.smithi153.stdout:1/867: readlink d0/dd/db2/d89/dc7/lca 0 2024-02-28T16:24:50.508 INFO:tasks.workunit.client.1.smithi153.stdout:2/882: rename d2/d19/l32 to d2/d86/da0/dce/d115/l11f 0 2024-02-28T16:24:50.516 INFO:tasks.workunit.client.1.smithi153.stdout:4/838: getdents d4/de/d23/d2b/d4b/d80/d9e/def 0 2024-02-28T16:24:50.519 INFO:tasks.workunit.client.1.smithi153.stdout:4/839: chown d4/de/d23/d2b/d9b/l8a 1382 1 2024-02-28T16:24:50.520 INFO:tasks.workunit.client.1.smithi153.stdout:2/883: creat d2/d23/d48/df0/d3b/d87/da5/f120 x:0 0 0 2024-02-28T16:24:50.523 INFO:tasks.workunit.client.1.smithi153.stdout:1/868: dwrite d0/dd/db2/d89/dc7/d103/f12e [0,4194304] 0 2024-02-28T16:24:50.523 INFO:tasks.workunit.client.1.smithi153.stdout:2/884: write d2/d86/da0/dce/f107 [237341,31166] 0 2024-02-28T16:24:50.525 INFO:tasks.workunit.client.1.smithi153.stdout:4/840: mkdir d4/de/d23/d2b/d10a 0 2024-02-28T16:24:50.537 INFO:tasks.workunit.client.1.smithi153.stdout:4/841: symlink d4/de/d13/d1b/l10b 0 2024-02-28T16:24:50.539 INFO:tasks.workunit.client.1.smithi153.stdout:1/869: getdents d0/dc1/de4/d109 0 2024-02-28T16:24:50.543 INFO:tasks.workunit.client.1.smithi153.stdout:1/870: truncate d0/dd/db2/d89/dc7/d103/f12e 4212548 0 2024-02-28T16:24:50.547 INFO:tasks.workunit.client.1.smithi153.stdout:0/892: sync 2024-02-28T16:24:50.552 INFO:tasks.workunit.client.1.smithi153.stdout:4/842: write d4/f7 [4345840,2273] 0 2024-02-28T16:24:50.564 INFO:tasks.workunit.client.1.smithi153.stdout:1/871: rename d0/dd/f2d to d0/f131 0 2024-02-28T16:24:50.566 INFO:tasks.workunit.client.1.smithi153.stdout:0/893: link d4/d32/d7f/d8a/dab/d8e/d90/f5e d4/d32/dcf/df6/d10c/f134 0 2024-02-28T16:24:50.567 INFO:tasks.workunit.client.1.smithi153.stdout:1/872: mknod d0/dd/d111/dd9/c132 0 2024-02-28T16:24:50.570 INFO:tasks.workunit.client.1.smithi153.stdout:4/843: creat d4/f10c x:0 0 0 2024-02-28T16:24:50.610 INFO:tasks.workunit.client.1.smithi153.stdout:4/844: mkdir d4/db9/d10d 0 2024-02-28T16:24:50.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.629+0000 7f1ac2c00700 1 -- 172.21.15.23:0/1888899545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 msgr2=0x7f1abc103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:50.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.629+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/1888899545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc103140 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009910 tx=0x7f1aac009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:50.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.630+0000 7f1ac2c00700 1 -- 172.21.15.23:0/1888899545 shutdown_connections 2024-02-28T16:24:50.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.630+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/1888899545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1abc103680 0x7f1abc105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:50.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.630+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/1888899545 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc103140 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:50.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.630+0000 7f1ac2c00700 1 -- 172.21.15.23:0/1888899545 >> 172.21.15.23:0/1888899545 conn(0x7f1abc0fa780 msgr2=0x7f1abc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:50.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.630+0000 7f1ac2c00700 1 -- 172.21.15.23:0/1888899545 shutdown_connections 2024-02-28T16:24:50.621 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.631+0000 7f1ac2c00700 1 -- 172.21.15.23:0/1888899545 wait complete. 2024-02-28T16:24:50.622 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.632+0000 7f1ac2c00700 1 Processor -- start 2024-02-28T16:24:50.622 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.632+0000 7f1ac2c00700 1 -- start start 2024-02-28T16:24:50.622 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.633+0000 7f1ac2c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc1938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:50.622 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.633+0000 7f1ac2c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1abc103680 0x7f1abc193de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:50.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.633+0000 7f1ac2c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc194400 con 0x7f1abc100d60 2024-02-28T16:24:50.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.633+0000 7f1ac2c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc194540 con 0x7f1abc103680 2024-02-28T16:24:50.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.634+0000 7f1abbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc1938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:50.624 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.634+0000 7f1abbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc1938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48868/0 (socket says 172.21.15.23:48868) 2024-02-28T16:24:50.624 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.634+0000 7f1abbe00700 1 -- 172.21.15.23:0/2109082616 learned_addr learned my addr 172.21.15.23:0/2109082616 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:50.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.635+0000 7f1abb400700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1abc103680 0x7f1abc193de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:50.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.635+0000 7f1abbe00700 1 -- 172.21.15.23:0/2109082616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1abc103680 msgr2=0x7f1abc193de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:50.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.635+0000 7f1abbe00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1abc103680 0x7f1abc193de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:50.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.635+0000 7f1abbe00700 1 -- 172.21.15.23:0/2109082616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0095f0 con 0x7f1abc100d60 2024-02-28T16:24:50.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.636+0000 7f1abbe00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc1938a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00bda0 tx=0x7f1aac00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:50.626 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.636+0000 7f1ab8c00700 1 -- 172.21.15.23:0/2109082616 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac01d070 con 0x7f1abc100d60 2024-02-28T16:24:50.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.636+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc198f90 con 0x7f1abc100d60 2024-02-28T16:24:50.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.636+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc199480 con 0x7f1abc100d60 2024-02-28T16:24:50.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.637+0000 7f1ab8c00700 1 -- 172.21.15.23:0/2109082616 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1aac00f460 con 0x7f1abc100d60 2024-02-28T16:24:50.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.637+0000 7f1ab8c00700 1 -- 172.21.15.23:0/2109082616 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac021640 con 0x7f1abc100d60 2024-02-28T16:24:50.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.638+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c005320 con 0x7f1abc100d60 2024-02-28T16:24:50.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.639+0000 7f1ab8c00700 1 -- 172.21.15.23:0/2109082616 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 30) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f1aac00f5d0 con 0x7f1abc100d60 2024-02-28T16:24:50.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.640+0000 7f1ab8c00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1aa006d660 0x7f1aa006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:50.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.640+0000 7f1ab8c00700 1 -- 172.21.15.23:0/2109082616 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1aac08e7d0 con 0x7f1abc100d60 2024-02-28T16:24:50.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.641+0000 7f1abb400700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1aa006d660 0x7f1aa006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:50.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.642+0000 7f1abb400700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1aa006d660 0x7f1aa006fb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8005950 tx=0x7f1aa80058e0 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:50.637 INFO:tasks.workunit.client.1.smithi153.stdout:1/873: dread d0/fc4 [0,4194304] 0 2024-02-28T16:24:50.637 INFO:tasks.workunit.client.1.smithi153.stdout:0/894: dread d4/d32/dcf/df6/d10c/fc9 [0,4194304] 0 2024-02-28T16:24:50.637 INFO:tasks.workunit.client.1.smithi153.stdout:7/907: sync 2024-02-28T16:24:50.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:50.648+0000 7f1ab8c00700 1 -- 172.21.15.23:0/2109082616 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f1aac05be40 con 0x7f1abc100d60 2024-02-28T16:24:50.638 INFO:tasks.workunit.client.1.smithi153.stdout:9/856: sync 2024-02-28T16:24:50.647 INFO:tasks.workunit.client.1.smithi153.stdout:7/908: write d1/d25/df/d60/da4/f10b [649389,10210] 0 2024-02-28T16:24:50.648 INFO:tasks.workunit.client.1.smithi153.stdout:4/845: dwrite d4/d53/d7c/ff6 [0,4194304] 0 2024-02-28T16:24:50.649 INFO:tasks.workunit.client.1.smithi153.stdout:9/857: getdents d1/d5/d11/d64/dd5 0 2024-02-28T16:24:50.651 INFO:tasks.workunit.client.1.smithi153.stdout:0/895: fsync d4/d32/d7f/d8a/dab/d8e/d90/f6c 0 2024-02-28T16:24:50.652 INFO:tasks.workunit.client.1.smithi153.stdout:4/846: write d4/de/d23/d2b/d9b/fb0 [2248132,52961] 0 2024-02-28T16:24:50.659 INFO:tasks.workunit.client.1.smithi153.stdout:4/847: chown d4/de/d23/d2b/d4b/dba/d50/l7a 323578945 1 2024-02-28T16:24:50.660 INFO:tasks.workunit.client.1.smithi153.stdout:9/858: fdatasync d1/d5/d11/d1f/d20/d5d/fe5 0 2024-02-28T16:24:50.662 INFO:tasks.workunit.client.1.smithi153.stdout:9/859: stat d1/d74/d80/da8/f18 0 2024-02-28T16:24:50.663 INFO:tasks.workunit.client.1.smithi153.stdout:4/848: rmdir d4/d53/d7c/db3/dfd 39 2024-02-28T16:24:50.666 INFO:tasks.workunit.client.1.smithi153.stdout:9/860: creat d1/d69/dbb/dbc/f113 x:0 0 0 2024-02-28T16:24:50.668 INFO:tasks.workunit.client.1.smithi153.stdout:0/896: getdents d4/d32/d7f/d8a/dab/d8e/d94/df5 0 2024-02-28T16:24:50.670 INFO:tasks.workunit.client.1.smithi153.stdout:4/849: mknod d4/de/d23/d2b/d10a/c10e 0 2024-02-28T16:24:50.671 INFO:tasks.workunit.client.1.smithi153.stdout:4/850: stat d4/f6 0 2024-02-28T16:24:50.671 INFO:tasks.workunit.client.1.smithi153.stdout:0/897: write d4/d32/d7f/d8a/dab/d8e/d94/fdd [805941,3920] 0 2024-02-28T16:24:50.671 INFO:tasks.workunit.client.1.smithi153.stdout:9/861: creat d1/d5/d27/dd6/f114 x:0 0 0 2024-02-28T16:24:50.674 INFO:tasks.workunit.client.1.smithi153.stdout:9/862: dread - d1/d5/d11/d1f/d20/d99/dae/fd9 zero size 2024-02-28T16:24:50.680 INFO:tasks.workunit.client.1.smithi153.stdout:4/851: getdents d4/d53 0 2024-02-28T16:24:50.682 INFO:tasks.workunit.client.1.smithi153.stdout:1/874: dread d0/dd/d111/d59/d9a/fcf [0,4194304] 0 2024-02-28T16:24:50.683 INFO:tasks.workunit.client.1.smithi153.stdout:9/863: creat d1/d5/d11/d1f/d107/f115 x:0 0 0 2024-02-28T16:24:50.686 INFO:tasks.workunit.client.1.smithi153.stdout:5/922: sync 2024-02-28T16:24:50.686 INFO:tasks.workunit.client.1.smithi153.stdout:4/852: chown d4/de/d23/d2b/d31/dc3/c108 3039689 1 2024-02-28T16:24:50.686 INFO:tasks.workunit.client.1.smithi153.stdout:8/943: sync 2024-02-28T16:24:50.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/909: dread d1/d25/df/d60/f89 [0,4194304] 0 2024-02-28T16:24:50.686 INFO:tasks.workunit.client.1.smithi153.stdout:3/917: sync 2024-02-28T16:24:50.688 INFO:tasks.workunit.client.1.smithi153.stdout:8/944: stat d0/d19/d2b/d2d/d3f/d10a/f128 0 2024-02-28T16:24:50.695 INFO:tasks.workunit.client.1.smithi153.stdout:9/864: write d1/d5/d11/d1f/d20/d36/f37 [2187406,103067] 0 2024-02-28T16:24:50.698 INFO:tasks.workunit.client.1.smithi153.stdout:5/923: symlink da/dd/d25/d8a/dac/dc7/l12c 0 2024-02-28T16:24:50.700 INFO:tasks.workunit.client.1.smithi153.stdout:0/898: dread d4/f6b [0,4194304] 0 2024-02-28T16:24:50.701 INFO:tasks.workunit.client.1.smithi153.stdout:1/875: rmdir d0/d62/dd2/df1 0 2024-02-28T16:24:50.703 INFO:tasks.workunit.client.1.smithi153.stdout:9/865: dread d1/d74/d80/da8/f46 [0,4194304] 0 2024-02-28T16:24:50.704 INFO:tasks.workunit.client.1.smithi153.stdout:7/910: dwrite d1/d25/dc/d7e/d91/ff5 [0,4194304] 0 2024-02-28T16:24:50.704 INFO:tasks.workunit.client.1.smithi153.stdout:3/918: mkdir d4/d7d/d128/d144 0 2024-02-28T16:24:50.705 INFO:tasks.workunit.client.1.smithi153.stdout:9/866: chown d1/d5/f7a 464 1 2024-02-28T16:24:50.706 INFO:tasks.workunit.client.1.smithi153.stdout:4/853: creat d4/de/d13/d1b/f10f x:0 0 0 2024-02-28T16:24:50.709 INFO:tasks.workunit.client.1.smithi153.stdout:6/908: sync 2024-02-28T16:24:50.709 INFO:tasks.workunit.client.1.smithi153.stdout:2/885: sync 2024-02-28T16:24:50.711 INFO:tasks.workunit.client.1.smithi153.stdout:9/867: creat d1/d74/d80/f116 x:0 0 0 2024-02-28T16:24:50.712 INFO:tasks.workunit.client.1.smithi153.stdout:9/868: chown d1/d74/d80/df2 30 1 2024-02-28T16:24:50.713 INFO:tasks.workunit.client.1.smithi153.stdout:8/945: dread d0/d12/d15/f6d [0,4194304] 0 2024-02-28T16:24:50.716 INFO:tasks.workunit.client.1.smithi153.stdout:1/876: unlink d0/f41 0 2024-02-28T16:24:50.716 INFO:tasks.workunit.client.1.smithi153.stdout:8/946: chown d0/d19/d2b/d2d/d3f/d10a/d140 77012 1 2024-02-28T16:24:50.717 INFO:tasks.workunit.client.1.smithi153.stdout:3/919: mkdir d4/d8/d1e/d2a/d55/da3/db1/d13c/d145 0 2024-02-28T16:24:50.719 INFO:tasks.workunit.client.1.smithi153.stdout:2/886: mkdir d2/d23/d48/df0/d93/d121 0 2024-02-28T16:24:50.720 INFO:tasks.workunit.client.1.smithi153.stdout:8/947: dread - d0/d12/d67/d30/d63/f125 zero size 2024-02-28T16:24:50.722 INFO:tasks.workunit.client.1.smithi153.stdout:3/920: dread - d4/d7d/d41/d71/f104 zero size 2024-02-28T16:24:50.725 INFO:tasks.workunit.client.1.smithi153.stdout:9/869: rmdir d1/d5/d11/d1f/d62/dca 39 2024-02-28T16:24:50.725 INFO:tasks.workunit.client.1.smithi153.stdout:2/887: symlink d2/d19/d8b/l122 0 2024-02-28T16:24:50.728 INFO:tasks.workunit.client.1.smithi153.stdout:7/911: dwrite d1/d25/df/d60/da4/dee/f104 [0,4194304] 0 2024-02-28T16:24:50.736 INFO:tasks.workunit.client.1.smithi153.stdout:4/854: write d4/d53/fff [3983861,13978] 0 2024-02-28T16:24:50.745 INFO:tasks.workunit.client.1.smithi153.stdout:9/870: write d1/d5/d11/d1f/d62/fbd [206220,45409] 0 2024-02-28T16:24:50.746 INFO:tasks.workunit.client.1.smithi153.stdout:6/909: dwrite d0/d1d/d30/d71/f7f [4194304,4194304] 0 2024-02-28T16:24:50.746 INFO:tasks.workunit.client.1.smithi153.stdout:7/912: creat d1/d25/dc/d50/d66/f12c x:0 0 0 2024-02-28T16:24:50.749 INFO:tasks.workunit.client.1.smithi153.stdout:3/921: write d4/d7d/d41/f9c [1044772,20822] 0 2024-02-28T16:24:50.750 INFO:tasks.workunit.client.1.smithi153.stdout:8/948: write d0/d12/d67/d30/d63/d74/fee [255254,7480] 0 2024-02-28T16:24:50.755 INFO:tasks.workunit.client.1.smithi153.stdout:4/855: creat d4/de/d23/d2b/d31/ddf/f110 x:0 0 0 2024-02-28T16:24:50.756 INFO:tasks.workunit.client.1.smithi153.stdout:2/888: write d2/d19/fc1 [2218237,80732] 0 2024-02-28T16:24:50.756 INFO:tasks.workunit.client.1.smithi153.stdout:1/877: dwrite d0/dd/db2/d89/fa8 [4194304,4194304] 0 2024-02-28T16:24:50.756 INFO:tasks.workunit.client.1.smithi153.stdout:6/910: dread d0/d1d/d33/d9c/d68/f6f [0,4194304] 0 2024-02-28T16:24:50.757 INFO:tasks.workunit.client.1.smithi153.stdout:1/878: stat d0/fdc 0 2024-02-28T16:24:50.757 INFO:tasks.workunit.client.1.smithi153.stdout:2/889: dread - d2/d25/fee zero size 2024-02-28T16:24:50.760 INFO:tasks.workunit.client.1.smithi153.stdout:6/911: chown d0/d1d/d33/d9c/d2e/d99/ddf/da4/fcf 0 1 2024-02-28T16:24:50.762 INFO:tasks.workunit.client.1.smithi153.stdout:9/871: mknod d1/d74/d80/da8/c117 0 2024-02-28T16:24:50.764 INFO:tasks.workunit.client.1.smithi153.stdout:9/872: read d1/d5/d27/fb8 [407182,472] 0 2024-02-28T16:24:50.769 INFO:tasks.workunit.client.1.smithi153.stdout:7/913: mkdir d1/d25/df/d60/da4/d12d 0 2024-02-28T16:24:50.772 INFO:tasks.workunit.client.1.smithi153.stdout:3/922: creat d4/d49/f146 x:0 0 0 2024-02-28T16:24:50.777 INFO:tasks.workunit.client.1.smithi153.stdout:2/890: fsync d2/d23/d48/f75 0 2024-02-28T16:24:50.777 INFO:tasks.workunit.client.1.smithi153.stdout:1/879: dread - d0/dd/db2/d89/dad/fc6 zero size 2024-02-28T16:24:50.782 INFO:tasks.workunit.client.1.smithi153.stdout:3/923: dread d4/d13/d28/dcd/dda/f101 [0,4194304] 0 2024-02-28T16:24:50.783 INFO:tasks.workunit.client.1.smithi153.stdout:7/914: mkdir d1/d25/df/d60/da4/dee/d12e 0 2024-02-28T16:24:50.783 INFO:tasks.workunit.client.1.smithi153.stdout:8/949: write d0/d34/f8f [441139,125515] 0 2024-02-28T16:24:50.788 INFO:tasks.workunit.client.1.smithi153.stdout:4/856: mkdir d4/d111 0 2024-02-28T16:24:50.794 INFO:tasks.workunit.client.1.smithi153.stdout:9/873: rename d1/d5/d11/d1f/d43/d76/c10d to d1/d7e/c118 0 2024-02-28T16:24:50.794 INFO:tasks.workunit.client.1.smithi153.stdout:6/912: dread d0/d1d/d33/d9c/f1a [0,4194304] 0 2024-02-28T16:24:50.795 INFO:tasks.workunit.client.1.smithi153.stdout:3/924: creat d4/d8/d1e/d23/da0/dd9/f147 x:0 0 0 2024-02-28T16:24:50.798 INFO:tasks.workunit.client.1.smithi153.stdout:4/857: creat d4/d53/d7c/da4/f112 x:0 0 0 2024-02-28T16:24:50.799 INFO:tasks.workunit.client.1.smithi153.stdout:2/891: mkdir d2/d25/d49/d123 0 2024-02-28T16:24:50.800 INFO:tasks.workunit.client.1.smithi153.stdout:3/925: dread d4/d13/d28/f118 [0,4194304] 0 2024-02-28T16:24:50.800 INFO:tasks.workunit.client.1.smithi153.stdout:7/915: dwrite d1/d70/dbf/fc5 [0,4194304] 0 2024-02-28T16:24:50.803 INFO:tasks.workunit.client.1.smithi153.stdout:4/858: read - d4/de/d23/d2b/d4b/fa0 zero size 2024-02-28T16:24:50.805 INFO:tasks.workunit.client.1.smithi153.stdout:6/913: creat d0/d1d/d33/d9c/d48/d63/f13c x:0 0 0 2024-02-28T16:24:50.805 INFO:tasks.workunit.client.1.smithi153.stdout:1/880: symlink d0/dd/d111/dd9/de1/dfc/l133 0 2024-02-28T16:24:50.807 INFO:tasks.workunit.client.1.smithi153.stdout:2/892: symlink d2/d19/d3e/db9/l124 0 2024-02-28T16:24:50.807 INFO:tasks.workunit.client.1.smithi153.stdout:4/859: readlink d4/de/d47/la1 0 2024-02-28T16:24:50.812 INFO:tasks.workunit.client.1.smithi153.stdout:8/950: dread d0/d19/d2b/d2d/fda [0,4194304] 0 2024-02-28T16:24:50.813 INFO:tasks.workunit.client.1.smithi153.stdout:8/951: readlink d0/d25/d79/l126 0 2024-02-28T16:24:50.814 INFO:tasks.workunit.client.1.smithi153.stdout:6/914: creat d0/d1d/d33/d9c/d48/d63/d8c/f13d x:0 0 0 2024-02-28T16:24:50.818 INFO:tasks.workunit.client.1.smithi153.stdout:8/952: readlink d0/d19/d1e/l6a 0 2024-02-28T16:24:50.822 INFO:tasks.workunit.client.1.smithi153.stdout:5/924: sync 2024-02-28T16:24:50.823 INFO:tasks.workunit.client.1.smithi153.stdout:4/860: mkdir d4/de/d13/d113 0 2024-02-28T16:24:50.823 INFO:tasks.workunit.client.1.smithi153.stdout:7/916: dwrite d1/d25/d27/d7c/db5/fe9 [0,4194304] 0 2024-02-28T16:24:50.823 INFO:tasks.workunit.client.1.smithi153.stdout:9/874: dwrite d1/fd7 [0,4194304] 0 2024-02-28T16:24:50.825 INFO:tasks.workunit.client.1.smithi153.stdout:3/926: getdents d4/d8/d1e/d2a 0 2024-02-28T16:24:50.827 INFO:tasks.workunit.client.1.smithi153.stdout:7/917: fsync d1/d25/f119 0 2024-02-28T16:24:50.831 INFO:tasks.workunit.client.1.smithi153.stdout:2/893: link d2/d19/d3e/l52 d2/d19/d8b/dcf/l125 0 2024-02-28T16:24:50.832 INFO:tasks.workunit.client.1.smithi153.stdout:1/881: getdents d0/dd/db2/d89/dad/dde/d114 0 2024-02-28T16:24:50.834 INFO:tasks.workunit.client.1.smithi153.stdout:2/894: read d2/d23/d88/fd2 [23848,47804] 0 2024-02-28T16:24:50.835 INFO:tasks.workunit.client.1.smithi153.stdout:6/915: dwrite d0/d1d/d30/d71/d91/fb1 [0,4194304] 0 2024-02-28T16:24:50.836 INFO:tasks.workunit.client.1.smithi153.stdout:9/875: fdatasync d1/d5/d11/d29/f98 0 2024-02-28T16:24:50.844 INFO:tasks.workunit.client.1.smithi153.stdout:8/953: link d0/d12/d67/d88/d96/f150 d0/d19/d2b/d2d/d111/d13d/f159 0 2024-02-28T16:24:50.851 INFO:tasks.workunit.client.1.smithi153.stdout:0/899: sync 2024-02-28T16:24:50.853 INFO:tasks.workunit.client.1.smithi153.stdout:8/954: fdatasync d0/d25/d132/f139 0 2024-02-28T16:24:50.855 INFO:tasks.workunit.client.1.smithi153.stdout:0/900: chown d4/c62 5511 1 2024-02-28T16:24:50.856 INFO:tasks.workunit.client.1.smithi153.stdout:4/861: dwrite d4/d53/d7c/db3/fee [0,4194304] 0 2024-02-28T16:24:50.862 INFO:tasks.workunit.client.1.smithi153.stdout:3/927: dwrite d4/d8/d1e/f120 [0,4194304] 0 2024-02-28T16:24:50.862 INFO:tasks.workunit.client.1.smithi153.stdout:5/925: dwrite da/dd/d25/d41/f49 [0,4194304] 0 2024-02-28T16:24:50.867 INFO:tasks.workunit.client.1.smithi153.stdout:8/955: write d0/d25/d132/f13f [798982,73238] 0 2024-02-28T16:24:50.871 INFO:tasks.workunit.client.1.smithi153.stdout:0/901: truncate d4/f3e 934239 0 2024-02-28T16:24:50.872 INFO:tasks.workunit.client.1.smithi153.stdout:8/956: readlink d0/d12/d67/d30/d63/lc4 0 2024-02-28T16:24:50.884 INFO:tasks.workunit.client.1.smithi153.stdout:4/862: symlink d4/de/d13/d1b/l114 0 2024-02-28T16:24:50.885 INFO:tasks.workunit.client.1.smithi153.stdout:1/882: dwrite d0/d3d/f4f [0,4194304] 0 2024-02-28T16:24:50.885 INFO:tasks.workunit.client.1.smithi153.stdout:5/926: creat da/dd/d25/d8a/dac/dc7/d12b/f12d x:0 0 0 2024-02-28T16:24:50.887 INFO:tasks.workunit.client.1.smithi153.stdout:7/918: truncate d1/f8d 4230265 0 2024-02-28T16:24:50.891 INFO:tasks.workunit.client.1.smithi153.stdout:8/957: truncate d0/d12/d15/f6d 1593883 0 2024-02-28T16:24:50.898 INFO:tasks.workunit.client.1.smithi153.stdout:6/916: truncate d0/d1d/d33/db2/f104 5100572 0 2024-02-28T16:24:50.901 INFO:tasks.workunit.client.1.smithi153.stdout:5/927: stat da/d29/d43/d5a/d77/f10c 0 2024-02-28T16:24:50.902 INFO:tasks.workunit.client.1.smithi153.stdout:9/876: dwrite d1/d74/d80/da8/fc3 [4194304,4194304] 0 2024-02-28T16:24:50.903 INFO:tasks.workunit.client.1.smithi153.stdout:7/919: rmdir d1/d25/df/d26/d3a/d81 39 2024-02-28T16:24:50.906 INFO:tasks.workunit.client.1.smithi153.stdout:2/895: dwrite d2/d23/d48/df0/d3b/f71 [0,4194304] 0 2024-02-28T16:24:50.913 INFO:tasks.workunit.client.1.smithi153.stdout:2/896: chown d2/d23/d88/fd2 49564 1 2024-02-28T16:24:50.913 INFO:tasks.workunit.client.1.smithi153.stdout:5/928: unlink da/d29/d43/d5a/d77/f10c 0 2024-02-28T16:24:50.919 INFO:tasks.workunit.client.1.smithi153.stdout:8/958: mknod d0/d19/d2b/d2d/d3f/d9f/dcc/c15a 0 2024-02-28T16:24:50.920 INFO:tasks.workunit.client.1.smithi153.stdout:0/902: truncate d4/d32/d7f/d8a/dab/f39 3488988 0 2024-02-28T16:24:50.921 INFO:tasks.workunit.client.1.smithi153.stdout:2/897: readlink d2/d23/d88/d95/l105 0 2024-02-28T16:24:50.921 INFO:tasks.workunit.client.1.smithi153.stdout:9/877: mkdir d1/d119 0 2024-02-28T16:24:50.923 INFO:tasks.workunit.client.1.smithi153.stdout:1/883: dread d0/d62/d66/d8e/f97 [0,4194304] 0 2024-02-28T16:24:50.927 INFO:tasks.workunit.client.1.smithi153.stdout:7/920: fdatasync d1/d25/df/d26/d3a/f83 0 2024-02-28T16:24:50.928 INFO:tasks.workunit.client.1.smithi153.stdout:3/928: dread d4/d8/d1e/d2a/d35/f47 [0,4194304] 0 2024-02-28T16:24:50.929 INFO:tasks.workunit.client.1.smithi153.stdout:4/863: truncate d4/f38 4784764 0 2024-02-28T16:24:50.930 INFO:tasks.workunit.client.1.smithi153.stdout:6/917: dwrite d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/f130 [0,4194304] 0 2024-02-28T16:24:50.935 INFO:tasks.workunit.client.1.smithi153.stdout:0/903: write d4/d89/f92 [4974016,126568] 0 2024-02-28T16:24:50.939 INFO:tasks.workunit.client.1.smithi153.stdout:2/898: creat d2/d19/d3e/db0/f126 x:0 0 0 2024-02-28T16:24:50.939 INFO:tasks.workunit.client.1.smithi153.stdout:9/878: creat d1/d5/d11/d64/d85/d8c/f11a x:0 0 0 2024-02-28T16:24:50.942 INFO:tasks.workunit.client.1.smithi153.stdout:3/929: symlink d4/d8/d1e/dbb/l148 0 2024-02-28T16:24:50.944 INFO:tasks.workunit.client.1.smithi153.stdout:4/864: symlink d4/de/d23/d2b/d9b/l115 0 2024-02-28T16:24:50.947 INFO:tasks.workunit.client.1.smithi153.stdout:3/930: chown d4/dfc/f56 392316297 1 2024-02-28T16:24:50.951 INFO:tasks.workunit.client.1.smithi153.stdout:6/918: dwrite d0/d1d/d30/d71/d91/fb1 [0,4194304] 0 2024-02-28T16:24:50.951 INFO:tasks.workunit.client.1.smithi153.stdout:8/959: rename d0/d19/d2b/d2d/d3f/d9f/c102 to d0/d12/d15/dab/dd0/de9/d100/c15b 0 2024-02-28T16:24:50.953 INFO:tasks.workunit.client.1.smithi153.stdout:3/931: write d4/d8/d1e/d2a/d35/f5f [4394625,34219] 0 2024-02-28T16:24:50.958 INFO:tasks.workunit.client.1.smithi153.stdout:9/879: creat d1/d5/d11/d1f/d20/f11b x:0 0 0 2024-02-28T16:24:50.958 INFO:tasks.workunit.client.1.smithi153.stdout:5/929: creat da/dd/d25/d82/d8f/d11e/f12e x:0 0 0 2024-02-28T16:24:50.959 INFO:tasks.workunit.client.1.smithi153.stdout:4/865: creat d4/de/d23/d2b/d10a/f116 x:0 0 0 2024-02-28T16:24:50.960 INFO:tasks.workunit.client.1.smithi153.stdout:6/919: symlink d0/d1d/d5d/dfa/l13e 0 2024-02-28T16:24:50.967 INFO:tasks.workunit.client.1.smithi153.stdout:1/884: dread d0/dd/f37 [0,4194304] 0 2024-02-28T16:24:50.969 INFO:tasks.workunit.client.1.smithi153.stdout:9/880: mkdir d1/d74/d80/d11c 0 2024-02-28T16:24:50.970 INFO:tasks.workunit.client.1.smithi153.stdout:3/932: truncate d4/d13/d28/f118 850824 0 2024-02-28T16:24:50.973 INFO:tasks.workunit.client.1.smithi153.stdout:2/899: rename d2/f20 to d2/d25/d49/f127 0 2024-02-28T16:24:50.975 INFO:tasks.workunit.client.1.smithi153.stdout:1/885: truncate d0/d3d/f3e 1555490 0 2024-02-28T16:24:50.976 INFO:tasks.workunit.client.1.smithi153.stdout:3/933: write d4/f77 [3438536,17672] 0 2024-02-28T16:24:50.978 INFO:tasks.workunit.client.1.smithi153.stdout:1/886: dread - d0/dd/db2/d89/dc7/f110 zero size 2024-02-28T16:24:50.980 INFO:tasks.workunit.client.1.smithi153.stdout:8/960: rename d0/d25/d79 to d0/d12/d67/d88/df8/d15c 0 2024-02-28T16:24:50.981 INFO:tasks.workunit.client.1.smithi153.stdout:2/900: creat d2/d86/da0/dce/f128 x:0 0 0 2024-02-28T16:24:50.983 INFO:tasks.workunit.client.1.smithi153.stdout:7/921: dwrite d1/d25/f49 [0,4194304] 0 2024-02-28T16:24:50.984 INFO:tasks.workunit.client.1.smithi153.stdout:2/901: chown d2/d23/d88/cb7 0 1 2024-02-28T16:24:50.984 INFO:tasks.workunit.client.1.smithi153.stdout:7/922: chown d1/d25/df 0 1 2024-02-28T16:24:50.986 INFO:tasks.workunit.client.1.smithi153.stdout:1/887: symlink d0/dd/db2/d89/daa/df8/l134 0 2024-02-28T16:24:50.988 INFO:tasks.workunit.client.1.smithi153.stdout:6/920: rename d0/f20 to d0/d1d/d33/d9c/d48/d72/d128/f13f 0 2024-02-28T16:24:50.989 INFO:tasks.workunit.client.1.smithi153.stdout:9/881: link d1/d5/d11/d1f/d40/d97/fcd d1/d119/f11d 0 2024-02-28T16:24:50.993 INFO:tasks.workunit.client.1.smithi153.stdout:1/888: chown d0/dd/db2/d89/dad/c105 18475028 1 2024-02-28T16:24:50.994 INFO:tasks.workunit.client.1.smithi153.stdout:5/930: link da/f1e da/dd/d25/d8a/dac/f12f 0 2024-02-28T16:24:50.994 INFO:tasks.workunit.client.1.smithi153.stdout:9/882: chown d1/d5/d11/d1f/d20/d5d/c91 21272749 1 2024-02-28T16:24:50.995 INFO:tasks.workunit.client.1.smithi153.stdout:7/923: symlink d1/d25/df/d26/d3a/d5e/d72/d9c/l12f 0 2024-02-28T16:24:50.996 INFO:tasks.workunit.client.1.smithi153.stdout:2/902: dread d2/d23/d48/df0/d3b/d5e/fc8 [0,4194304] 0 2024-02-28T16:24:50.999 INFO:tasks.workunit.client.1.smithi153.stdout:5/931: read da/dd/d54/db0/fbc [280921,77475] 0 2024-02-28T16:24:51.001 INFO:tasks.workunit.client.1.smithi153.stdout:6/921: creat d0/d1d/d33/d9c/d2e/f140 x:0 0 0 2024-02-28T16:24:51.002 INFO:tasks.workunit.client.1.smithi153.stdout:4/866: dread d4/d53/fff [0,4194304] 0 2024-02-28T16:24:51.003 INFO:tasks.workunit.client.1.smithi153.stdout:6/922: write d0/d1d/d30/d71/f7f [4885095,130521] 0 2024-02-28T16:24:51.004 INFO:tasks.workunit.client.1.smithi153.stdout:7/924: creat d1/d25/dc/d50/d66/f130 x:0 0 0 2024-02-28T16:24:51.008 INFO:tasks.workunit.client.1.smithi153.stdout:9/883: creat d1/d74/f11e x:0 0 0 2024-02-28T16:24:51.011 INFO:tasks.workunit.client.1.smithi153.stdout:5/932: mknod da/d29/c130 0 2024-02-28T16:24:51.015 INFO:tasks.workunit.client.1.smithi153.stdout:9/884: creat d1/d5/d11/d1f/d20/f11f x:0 0 0 2024-02-28T16:24:51.015 INFO:tasks.workunit.client.1.smithi153.stdout:7/925: symlink d1/d25/df/d5a/l131 0 2024-02-28T16:24:51.017 INFO:tasks.workunit.client.1.smithi153.stdout:6/923: symlink d0/d1d/d33/d9c/d2e/d99/d129/l141 0 2024-02-28T16:24:51.019 INFO:tasks.workunit.client.1.smithi153.stdout:5/933: creat da/dd/d25/d8a/dac/dc6/f131 x:0 0 0 2024-02-28T16:24:51.020 INFO:tasks.workunit.client.1.smithi153.stdout:6/924: read d0/d1d/d33/d9c/d2e/d99/fb9 [954749,35442] 0 2024-02-28T16:24:51.020 INFO:tasks.workunit.client.1.smithi153.stdout:5/934: stat da/dd/d25/f105 0 2024-02-28T16:24:51.022 INFO:tasks.workunit.client.1.smithi153.stdout:7/926: dread - d1/d25/df/fb1 zero size 2024-02-28T16:24:51.023 INFO:tasks.workunit.client.1.smithi153.stdout:7/927: read d1/d25/df/f8f [517899,64203] 0 2024-02-28T16:24:51.025 INFO:tasks.workunit.client.1.smithi153.stdout:6/925: rmdir d0/d1d/d33/d9c/d2e/d99/dab 39 2024-02-28T16:24:51.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.036+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a9c000bf0 con 0x7f1aa006d660 2024-02-28T16:24:51.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.039+0000 7f1ab8c00700 1 -- 172.21.15.23:0/2109082616 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f1a9c000bf0 con 0x7f1aa006d660 2024-02-28T16:24:51.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.041+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1aa006d660 msgr2=0x7f1aa006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.041+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1aa006d660 0x7f1aa006fb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8005950 tx=0x7f1aa80058e0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.041+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 msgr2=0x7f1abc1938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.041+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc1938a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00bda0 tx=0x7f1aac00be80 comp rx=0 tx=0).stop 2024-02-28T16:24:51.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.042+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 shutdown_connections 2024-02-28T16:24:51.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.042+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1aa006d660 0x7f1aa006fb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.042+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1abc100d60 0x7f1abc1938a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.042+0000 7f1ac2c00700 1 --2- 172.21.15.23:0/2109082616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1abc103680 0x7f1abc193de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.042+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 >> 172.21.15.23:0/2109082616 conn(0x7f1abc0fa780 msgr2=0x7f1abc0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:51.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.042+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 shutdown_connections 2024-02-28T16:24:51.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.042+0000 7f1ac2c00700 1 -- 172.21.15.23:0/2109082616 wait complete. 2024-02-28T16:24:51.035 INFO:tasks.workunit.client.1.smithi153.stdout:1/889: dread d0/dd/f21 [0,4194304] 0 2024-02-28T16:24:51.037 INFO:tasks.workunit.client.1.smithi153.stdout:8/961: dwrite d0/d19/fc9 [0,4194304] 0 2024-02-28T16:24:51.037 INFO:tasks.workunit.client.1.smithi153.stdout:3/934: dwrite d4/d8/d1e/d23/fbf [0,4194304] 0 2024-02-28T16:24:51.040 INFO:tasks.workunit.client.1.smithi153.stdout:7/928: mkdir d1/d25/dc/d7e/d132 0 2024-02-28T16:24:51.049 INFO:tasks.workunit.client.1.smithi153.stdout:7/929: dread d1/d25/df/d60/da4/dee/f115 [4194304,4194304] 0 2024-02-28T16:24:51.055 INFO:tasks.workunit.client.1.smithi153.stdout:2/903: dwrite d2/d23/d48/df0/d3b/d5e/fd3 [0,4194304] 0 2024-02-28T16:24:51.056 INFO:tasks.workunit.client.1.smithi153.stdout:6/926: dread d0/d1d/d33/d9c/d48/d72/f76 [0,4194304] 0 2024-02-28T16:24:51.058 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:24:51.059 INFO:tasks.workunit.client.1.smithi153.stdout:2/904: chown d2/d86/l7b 30247054 1 2024-02-28T16:24:51.062 INFO:tasks.workunit.client.1.smithi153.stdout:4/867: dwrite d4/f6 [0,4194304] 0 2024-02-28T16:24:51.066 INFO:tasks.workunit.client.1.smithi153.stdout:5/935: creat da/d29/d43/d5a/f132 x:0 0 0 2024-02-28T16:24:51.066 INFO:tasks.workunit.client.1.smithi153.stdout:0/904: sync 2024-02-28T16:24:51.069 INFO:tasks.workunit.client.1.smithi153.stdout:7/930: fsync d1/d25/d27/f9b 0 2024-02-28T16:24:51.087 INFO:tasks.workunit.client.1.smithi153.stdout:5/936: creat da/dd/d54/f133 x:0 0 0 2024-02-28T16:24:51.087 INFO:tasks.workunit.client.1.smithi153.stdout:3/935: dread d4/d7d/f3d [0,4194304] 0 2024-02-28T16:24:51.087 INFO:tasks.workunit.client.1.smithi153.stdout:4/868: dwrite d4/de/d23/fcf [4194304,4194304] 0 2024-02-28T16:24:51.088 INFO:tasks.workunit.client.1.smithi153.stdout:0/905: mkdir d4/d89/d135 0 2024-02-28T16:24:51.088 INFO:tasks.workunit.client.1.smithi153.stdout:2/905: symlink d2/d19/d31/dd1/d10c/l129 0 2024-02-28T16:24:51.092 INFO:tasks.workunit.client.1.smithi153.stdout:6/927: mknod d0/d1d/d33/d9c/d2e/d99/ddf/da4/c142 0 2024-02-28T16:24:51.093 INFO:tasks.workunit.client.1.smithi153.stdout:5/937: write da/dd/d25/d8a/db3/fd4 [399589,92899] 0 2024-02-28T16:24:51.094 INFO:tasks.workunit.client.1.smithi153.stdout:8/962: write d0/d12/d67/d30/f3a [2009521,32990] 0 2024-02-28T16:24:51.097 INFO:tasks.workunit.client.1.smithi153.stdout:1/890: dread d0/dd/fda [0,4194304] 0 2024-02-28T16:24:51.102 INFO:tasks.workunit.client.1.smithi153.stdout:6/928: write d0/d1d/d30/d71/fe8 [1378293,67124] 0 2024-02-28T16:24:51.102 INFO:tasks.workunit.client.1.smithi153.stdout:5/938: write da/dd/d25/feb [959599,29152] 0 2024-02-28T16:24:51.105 INFO:tasks.workunit.client.1.smithi153.stdout:0/906: symlink d4/d32/d7f/d8a/dab/d8e/d94/df5/d11c/l136 0 2024-02-28T16:24:51.105 INFO:tasks.workunit.client.1.smithi153.stdout:9/885: sync 2024-02-28T16:24:51.108 INFO:tasks.workunit.client.1.smithi153.stdout:0/907: chown d4/d32/fba 0 1 2024-02-28T16:24:51.110 INFO:tasks.workunit.client.1.smithi153.stdout:4/869: rename d4/de/fea to d4/de/d13/f117 0 2024-02-28T16:24:51.113 INFO:tasks.workunit.client.1.smithi153.stdout:1/891: rmdir d0/dd/db2/de5 39 2024-02-28T16:24:51.115 INFO:tasks.workunit.client.1.smithi153.stdout:1/892: chown d0/d62/d66/f101 1 1 2024-02-28T16:24:51.117 INFO:tasks.workunit.client.1.smithi153.stdout:2/906: dwrite d2/d19/d3e/db0/f126 [0,4194304] 0 2024-02-28T16:24:51.117 INFO:tasks.workunit.client.1.smithi153.stdout:5/939: mkdir da/d29/d43/d113/d134 0 2024-02-28T16:24:51.125 INFO:tasks.workunit.client.1.smithi153.stdout:0/908: rename d4/d32/fd1 to d4/d27/d101/f137 0 2024-02-28T16:24:51.130 INFO:tasks.workunit.client.1.smithi153.stdout:4/870: fdatasync d4/de/d40/f49 0 2024-02-28T16:24:51.132 INFO:tasks.workunit.client.1.smithi153.stdout:1/893: mknod d0/d62/dd2/c135 0 2024-02-28T16:24:51.133 INFO:tasks.workunit.client.1.smithi153.stdout:2/907: creat d2/d19/d3e/da7/f12a x:0 0 0 2024-02-28T16:24:51.135 INFO:tasks.workunit.client.1.smithi153.stdout:1/894: read d0/d3d/f4e [87377,81536] 0 2024-02-28T16:24:51.139 INFO:tasks.workunit.client.1.smithi153.stdout:5/940: symlink da/d29/d43/d113/d134/l135 0 2024-02-28T16:24:51.140 INFO:tasks.workunit.client.1.smithi153.stdout:7/931: dread d1/d25/d27/d7c/dc4/f6e [0,4194304] 0 2024-02-28T16:24:51.141 INFO:tasks.workunit.client.1.smithi153.stdout:8/963: dread d0/d12/f28 [0,4194304] 0 2024-02-28T16:24:51.142 INFO:tasks.workunit.client.1.smithi153.stdout:4/871: rename d4/de/d47/d5e/d62/l66 to d4/de/d23/d2b/d10a/l118 0 2024-02-28T16:24:51.142 INFO:tasks.workunit.client.1.smithi153.stdout:5/941: write da/dd/d25/d8a/fd8 [597338,3147] 0 2024-02-28T16:24:51.142 INFO:tasks.workunit.client.1.smithi153.stdout:1/895: rmdir d0/dd/db2/d89/dad/dde/d114 39 2024-02-28T16:24:51.143 INFO:tasks.workunit.client.1.smithi153.stdout:2/908: mknod d2/d19/d3e/c12b 0 2024-02-28T16:24:51.144 INFO:tasks.workunit.client.1.smithi153.stdout:3/936: write d4/d7d/d41/fe6 [3396042,4415] 0 2024-02-28T16:24:51.150 INFO:tasks.workunit.client.1.smithi153.stdout:5/942: dread da/dd/d25/fab [0,4194304] 0 2024-02-28T16:24:51.150 INFO:tasks.workunit.client.1.smithi153.stdout:3/937: creat d4/dfc/f149 x:0 0 0 2024-02-28T16:24:51.152 INFO:tasks.workunit.client.1.smithi153.stdout:3/938: chown d4/d13/d28/dcd/dda/f121 16816 1 2024-02-28T16:24:51.162 INFO:tasks.workunit.client.1.smithi153.stdout:1/896: dread d0/dd/d111/d59/d9a/fcf [0,4194304] 0 2024-02-28T16:24:51.165 INFO:tasks.workunit.client.1.smithi153.stdout:6/929: write d0/d1d/d33/d9c/d68/dcb/fd3 [961670,38577] 0 2024-02-28T16:24:51.170 INFO:tasks.workunit.client.1.smithi153.stdout:1/897: creat d0/d62/d66/d7c/f136 x:0 0 0 2024-02-28T16:24:51.172 INFO:tasks.workunit.client.1.smithi153.stdout:0/909: rmdir d4/d32/df3/d126 39 2024-02-28T16:24:51.175 INFO:tasks.workunit.client.1.smithi153.stdout:5/943: dwrite da/d29/fe2 [0,4194304] 0 2024-02-28T16:24:51.179 INFO:tasks.workunit.client.1.smithi153.stdout:7/932: write d1/d25/df/f8f [1872444,81460] 0 2024-02-28T16:24:51.182 INFO:tasks.workunit.client.1.smithi153.stdout:0/910: write d4/d27/f47 [87263,45885] 0 2024-02-28T16:24:51.182 INFO:tasks.workunit.client.1.smithi153.stdout:8/964: write d0/d19/f76 [931123,110954] 0 2024-02-28T16:24:51.187 INFO:tasks.workunit.client.1.smithi153.stdout:9/886: dwrite d1/d5/d11/d1f/d52/fa1 [0,4194304] 0 2024-02-28T16:24:51.188 INFO:tasks.workunit.client.1.smithi153.stdout:6/930: symlink d0/d1d/d33/d9c/d68/da2/l143 0 2024-02-28T16:24:51.189 INFO:tasks.workunit.client.1.smithi153.stdout:1/898: chown d0/dd/db2/d89/dad/lb7 22350 1 2024-02-28T16:24:51.196 INFO:tasks.workunit.client.1.smithi153.stdout:6/931: chown d0/d1d/d30/d71/d91/dd2 9 1 2024-02-28T16:24:51.206 INFO:tasks.workunit.client.1.smithi153.stdout:6/932: chown d0/d1d/d33/d9c/d2e/f42 1 1 2024-02-28T16:24:51.206 INFO:tasks.workunit.client.1.smithi153.stdout:9/887: unlink d1/d5/ffa 0 2024-02-28T16:24:51.214 INFO:tasks.workunit.client.1.smithi153.stdout:3/939: dread d4/d8/d1e/d2a/d35/f51 [0,4194304] 0 2024-02-28T16:24:51.216 INFO:tasks.workunit.client.1.smithi153.stdout:2/909: dwrite d2/d23/d88/fd2 [0,4194304] 0 2024-02-28T16:24:51.218 INFO:tasks.workunit.client.1.smithi153.stdout:4/872: dwrite d4/de/d40/f5a [0,4194304] 0 2024-02-28T16:24:51.220 INFO:tasks.workunit.client.1.smithi153.stdout:8/965: rename d0/d19/d2b/d2d/d3f/d9f/dcc/c15a to d0/d19/d2b/d2d/d3f/d9f/dcc/c15d 0 2024-02-28T16:24:51.221 INFO:tasks.workunit.client.1.smithi153.stdout:5/944: link da/dd/f60 da/de1/de9/d107/f136 0 2024-02-28T16:24:51.224 INFO:tasks.workunit.client.1.smithi153.stdout:3/940: truncate d4/d2c/f7e 4926440 0 2024-02-28T16:24:51.225 INFO:tasks.workunit.client.1.smithi153.stdout:9/888: symlink d1/d5/d11/d1f/d20/d36/l120 0 2024-02-28T16:24:51.232 INFO:tasks.workunit.client.1.smithi153.stdout:9/889: chown d1/d5/d11/ff1 33 1 2024-02-28T16:24:51.232 INFO:tasks.workunit.client.1.smithi153.stdout:2/910: mkdir d2/d23/d48/df0/d99/d12c 0 2024-02-28T16:24:51.244 INFO:tasks.workunit.client.1.smithi153.stdout:5/945: mknod da/d29/d43/d5a/d77/c137 0 2024-02-28T16:24:51.245 INFO:tasks.workunit.client.1.smithi153.stdout:7/933: link d1/d25/dc/ddc/c107 d1/d25/df/d5a/de6/de8/d120/c133 0 2024-02-28T16:24:51.246 INFO:tasks.workunit.client.1.smithi153.stdout:6/933: rename d0/d1d/d33/d8d/fa8 to d0/d1d/d33/d9c/d48/f144 0 2024-02-28T16:24:51.247 INFO:tasks.workunit.client.1.smithi153.stdout:9/890: chown d1/d5/d11/d1f/d20/d99/dae/fd9 38 1 2024-02-28T16:24:51.248 INFO:tasks.workunit.client.1.smithi153.stdout:6/934: read d0/d1d/d5d/de9/ff7 [15353,81945] 0 2024-02-28T16:24:51.253 INFO:tasks.workunit.client.1.smithi153.stdout:4/873: dread d4/de/d13/f35 [0,4194304] 0 2024-02-28T16:24:51.255 INFO:tasks.workunit.client.1.smithi153.stdout:4/874: readlink d4/de/d13/d1b/l7d 0 2024-02-28T16:24:51.256 INFO:tasks.workunit.client.1.smithi153.stdout:1/899: write d0/dd/db2/d89/daa/fb9 [157001,111038] 0 2024-02-28T16:24:51.262 INFO:tasks.workunit.client.1.smithi153.stdout:4/875: dread d4/de/d40/d4d/f94 [0,4194304] 0 2024-02-28T16:24:51.264 INFO:tasks.workunit.client.1.smithi153.stdout:0/911: dwrite d4/f45 [0,4194304] 0 2024-02-28T16:24:51.267 INFO:tasks.workunit.client.1.smithi153.stdout:3/941: dwrite d4/d8/d1e/d2a/f83 [4194304,4194304] 0 2024-02-28T16:24:51.268 INFO:tasks.workunit.client.1.smithi153.stdout:8/966: write d0/d19/d2b/d2d/f8c [706922,57620] 0 2024-02-28T16:24:51.269 INFO:tasks.workunit.client.1.smithi153.stdout:3/942: chown d4/d7d/d41/cc2 6565 1 2024-02-28T16:24:51.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.288+0000 7f1f06000700 1 -- 172.21.15.23:0/3491021991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 msgr2=0x7f1f00101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.288+0000 7f1f06000700 1 --2- 172.21.15.23:0/3491021991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 0x7f1f00101730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009910 tx=0x7f1eec009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:51.278 INFO:tasks.workunit.client.1.smithi153.stdout:8/967: dread d0/d12/d67/d30/f58 [4194304,4194304] 0 2024-02-28T16:24:51.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.289+0000 7f1f06000700 1 -- 172.21.15.23:0/3491021991 shutdown_connections 2024-02-28T16:24:51.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.289+0000 7f1f06000700 1 --2- 172.21.15.23:0/3491021991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 0x7f1f00101730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.289+0000 7f1f06000700 1 --2- 172.21.15.23:0/3491021991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 0x7f1f00100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.289+0000 7f1f06000700 1 -- 172.21.15.23:0/3491021991 >> 172.21.15.23:0/3491021991 conn(0x7f1f000fb650 msgr2=0x7f1f000fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:51.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.289+0000 7f1f06000700 1 -- 172.21.15.23:0/3491021991 shutdown_connections 2024-02-28T16:24:51.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.289+0000 7f1f06000700 1 -- 172.21.15.23:0/3491021991 wait complete. 2024-02-28T16:24:51.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.291+0000 7f1f06000700 1 Processor -- start 2024-02-28T16:24:51.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.292+0000 7f1f06000700 1 -- start start 2024-02-28T16:24:51.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.292+0000 7f1f06000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 0x7f1f00074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.292+0000 7f1f06000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 0x7f1f00073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.292+0000 7f1f06000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f00073680 con 0x7f1f001012c0 2024-02-28T16:24:51.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.292+0000 7f1f06000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000737c0 con 0x7f1f00100020 2024-02-28T16:24:51.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.293+0000 7f1f04c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 0x7f1f00074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.293+0000 7f1effe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 0x7f1f00073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.293+0000 7f1f04c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 0x7f1f00074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:36514/0 (socket says 172.21.15.23:36514) 2024-02-28T16:24:51.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.293+0000 7f1f04c00700 1 -- 172.21.15.23:0/3074035574 learned_addr learned my addr 172.21.15.23:0/3074035574 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:51.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.294+0000 7f1f04c00700 1 -- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 msgr2=0x7f1f00073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.294+0000 7f1f04c00700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 0x7f1f00073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.294+0000 7f1f04c00700 1 -- 172.21.15.23:0/3074035574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0095f0 con 0x7f1f00100020 2024-02-28T16:24:51.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.295+0000 7f1f04c00700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 0x7f1f00074af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e920 tx=0x7f1ef400ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.295+0000 7f1efd600700 1 -- 172.21.15.23:0/3074035574 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef400c9d0 con 0x7f1f00100020 2024-02-28T16:24:51.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.295+0000 7f1efd600700 1 -- 172.21.15.23:0/3074035574 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ef4010430 con 0x7f1f00100020 2024-02-28T16:24:51.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.295+0000 7f1efd600700 1 -- 172.21.15.23:0/3074035574 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef4018650 con 0x7f1f00100020 2024-02-28T16:24:51.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.295+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f00073aa0 con 0x7f1f00100020 2024-02-28T16:24:51.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.296+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0019d860 con 0x7f1f00100020 2024-02-28T16:24:51.289 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.297+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f00108b00 con 0x7f1f00100020 2024-02-28T16:24:51.289 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.299+0000 7f1efd600700 1 -- 172.21.15.23:0/3074035574 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 30) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f1ef40105a0 con 0x7f1f00100020 2024-02-28T16:24:51.290 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.300+0000 7f1efd600700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1ee806d660 0x7f1ee806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.290 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.300+0000 7f1efd600700 1 -- 172.21.15.23:0/3074035574 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1ef4014070 con 0x7f1f00100020 2024-02-28T16:24:51.290 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.301+0000 7f1effe00700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1ee806d660 0x7f1ee806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.291 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.302+0000 7f1effe00700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1ee806d660 0x7f1ee806fb10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009fd0 tx=0x7f1eec005fd0 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.295 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.305+0000 7f1efd600700 1 -- 172.21.15.23:0/3074035574 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f1ef4052a50 con 0x7f1f00100020 2024-02-28T16:24:51.310 INFO:tasks.workunit.client.1.smithi153.stdout:5/946: fdatasync da/f2c 0 2024-02-28T16:24:51.311 INFO:tasks.workunit.client.1.smithi153.stdout:2/911: symlink d2/d25/d49/da3/l12d 0 2024-02-28T16:24:51.312 INFO:tasks.workunit.client.1.smithi153.stdout:7/934: mknod d1/d25/dc/d7e/c134 0 2024-02-28T16:24:51.312 INFO:tasks.workunit.client.1.smithi153.stdout:2/912: chown d2/d19/d3e/db0/le4 4491 1 2024-02-28T16:24:51.313 INFO:tasks.workunit.client.1.smithi153.stdout:5/947: read da/d29/d43/d5a/dbe/f129 [2002761,37441] 0 2024-02-28T16:24:51.313 INFO:tasks.workunit.client.1.smithi153.stdout:9/891: creat d1/d69/dbb/dbc/f121 x:0 0 0 2024-02-28T16:24:51.315 INFO:tasks.workunit.client.1.smithi153.stdout:1/900: unlink d0/dd/d111/d59/f8c 0 2024-02-28T16:24:51.317 INFO:tasks.workunit.client.1.smithi153.stdout:1/901: readlink d0/dd/d111/d59/d9a/lac 0 2024-02-28T16:24:51.318 INFO:tasks.workunit.client.1.smithi153.stdout:4/876: read d4/de/d23/d2b/d9b/f97 [30521,43850] 0 2024-02-28T16:24:51.319 INFO:tasks.workunit.client.1.smithi153.stdout:1/902: write d0/dd/db2/d89/dad/fcd [528487,24253] 0 2024-02-28T16:24:51.322 INFO:tasks.workunit.client.1.smithi153.stdout:4/877: dread d4/d53/d7c/fd1 [0,4194304] 0 2024-02-28T16:24:51.325 INFO:tasks.workunit.client.1.smithi153.stdout:8/968: fsync d0/d12/d67/d88/d85/db6/ff4 0 2024-02-28T16:24:51.329 INFO:tasks.workunit.client.1.smithi153.stdout:5/948: truncate da/f27 3606870 0 2024-02-28T16:24:51.330 INFO:tasks.workunit.client.1.smithi153.stdout:5/949: chown da/fc3 569643 1 2024-02-28T16:24:51.332 INFO:tasks.workunit.client.1.smithi153.stdout:4/878: dread d4/de/d23/f30 [0,4194304] 0 2024-02-28T16:24:51.335 INFO:tasks.workunit.client.1.smithi153.stdout:9/892: creat d1/d5/d11/d1f/d40/f122 x:0 0 0 2024-02-28T16:24:51.336 INFO:tasks.workunit.client.1.smithi153.stdout:9/893: dread - d1/d5/d11/d29/d79/fec zero size 2024-02-28T16:24:51.341 INFO:tasks.workunit.client.1.smithi153.stdout:8/969: symlink d0/d19/d2b/d2d/d3f/d9f/dcc/l15e 0 2024-02-28T16:24:51.348 INFO:tasks.workunit.client.1.smithi153.stdout:0/912: rename d4/d32/d7f/d8a/dab/la2 to d4/d32/df0/d108/l138 0 2024-02-28T16:24:51.350 INFO:tasks.workunit.client.1.smithi153.stdout:1/903: mkdir d0/d62/d66/d137 0 2024-02-28T16:24:51.356 INFO:tasks.workunit.client.1.smithi153.stdout:8/970: mknod d0/d19/c15f 0 2024-02-28T16:24:51.358 INFO:tasks.workunit.client.1.smithi153.stdout:1/904: dread - d0/dd/db2/d89/f92 zero size 2024-02-28T16:24:51.358 INFO:tasks.workunit.client.1.smithi153.stdout:6/935: link d0/d1d/d33/d9c/d2e/d99/dab/c10b d0/d66/d85/c145 0 2024-02-28T16:24:51.360 INFO:tasks.workunit.client.1.smithi153.stdout:1/905: write d0/d3d/f4f [4073279,43444] 0 2024-02-28T16:24:51.361 INFO:tasks.workunit.client.1.smithi153.stdout:9/894: dread d1/fb0 [0,4194304] 0 2024-02-28T16:24:51.362 INFO:tasks.workunit.client.1.smithi153.stdout:8/971: mkdir d0/d12/d67/d30/d63/d160 0 2024-02-28T16:24:51.365 INFO:tasks.workunit.client.1.smithi153.stdout:0/913: rename d4/d32/d7f/db3/dc2/lc7 to d4/d32/df3/d126/l139 0 2024-02-28T16:24:51.368 INFO:tasks.workunit.client.1.smithi153.stdout:9/895: creat d1/d69/f123 x:0 0 0 2024-02-28T16:24:51.370 INFO:tasks.workunit.client.1.smithi153.stdout:3/943: write d4/d13/fe0 [257867,77625] 0 2024-02-28T16:24:51.371 INFO:tasks.workunit.client.1.smithi153.stdout:1/906: creat d0/d62/dd2/d12f/f138 x:0 0 0 2024-02-28T16:24:51.375 INFO:tasks.workunit.client.1.smithi153.stdout:9/896: mkdir d1/d69/d124 0 2024-02-28T16:24:51.377 INFO:tasks.workunit.client.1.smithi153.stdout:6/936: link d0/d1d/d30/f36 d0/d1d/d30/dd0/f146 0 2024-02-28T16:24:51.383 INFO:tasks.workunit.client.1.smithi153.stdout:8/972: link d0/d34/l109 d0/d12/d67/d88/df8/l161 0 2024-02-28T16:24:51.386 INFO:tasks.workunit.client.1.smithi153.stdout:7/935: truncate d1/d25/d27/f5c 2693388 0 2024-02-28T16:24:51.386 INFO:tasks.workunit.client.1.smithi153.stdout:2/913: dwrite d2/d23/d48/df0/d3b/d5e/f6c [4194304,4194304] 0 2024-02-28T16:24:51.391 INFO:tasks.workunit.client.1.smithi153.stdout:6/937: unlink d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fc2 0 2024-02-28T16:24:51.394 INFO:tasks.workunit.client.1.smithi153.stdout:6/938: fsync d0/d1d/d33/d9c/d48/d63/f13c 0 2024-02-28T16:24:51.394 INFO:tasks.workunit.client.1.smithi153.stdout:2/914: read d2/d19/d31/dd1/fd8 [1028723,126154] 0 2024-02-28T16:24:51.394 INFO:tasks.workunit.client.1.smithi153.stdout:1/907: rename d0/c24 to d0/dd/db2/d89/daa/df8/c139 0 2024-02-28T16:24:51.396 INFO:tasks.workunit.client.1.smithi153.stdout:1/908: fsync d0/d3d/f7d 0 2024-02-28T16:24:51.398 INFO:tasks.workunit.client.1.smithi153.stdout:9/897: mkdir d1/d58/d125 0 2024-02-28T16:24:51.398 INFO:tasks.workunit.client.1.smithi153.stdout:5/950: dwrite da/f51 [4194304,4194304] 0 2024-02-28T16:24:51.398 INFO:tasks.workunit.client.1.smithi153.stdout:1/909: chown d0/d62/dd2/f128 3368494 1 2024-02-28T16:24:51.401 INFO:tasks.workunit.client.1.smithi153.stdout:8/973: symlink d0/d12/d67/d88/d8e/l162 0 2024-02-28T16:24:51.403 INFO:tasks.workunit.client.1.smithi153.stdout:0/914: getdents d4/d99/da5/ddf 0 2024-02-28T16:24:51.404 INFO:tasks.workunit.client.1.smithi153.stdout:8/974: stat d0/d19/d2b/f61 0 2024-02-28T16:24:51.406 INFO:tasks.workunit.client.1.smithi153.stdout:0/915: readlink d4/d32/d7f/d8a/dab/d8e/d94/lc8 0 2024-02-28T16:24:51.410 INFO:tasks.workunit.client.1.smithi153.stdout:2/915: mknod d2/d23/d48/df0/d3b/d5e/c12e 0 2024-02-28T16:24:51.413 INFO:tasks.workunit.client.1.smithi153.stdout:3/944: dwrite d4/d8/d1e/d2a/d55/da3/fba [0,4194304] 0 2024-02-28T16:24:51.414 INFO:tasks.workunit.client.1.smithi153.stdout:6/939: rename d0/d1d/d33/d9c/d2e/f53 to d0/d1d/d5d/de9/f147 0 2024-02-28T16:24:51.418 INFO:tasks.workunit.client.1.smithi153.stdout:5/951: creat da/d29/d43/d5a/d77/f138 x:0 0 0 2024-02-28T16:24:51.419 INFO:tasks.workunit.client.1.smithi153.stdout:1/910: mknod d0/dd/db2/d89/dc7/de6/c13a 0 2024-02-28T16:24:51.424 INFO:tasks.workunit.client.1.smithi153.stdout:7/936: mknod d1/d25/df/d26/d3a/d3f/c135 0 2024-02-28T16:24:51.430 INFO:tasks.workunit.client.1.smithi153.stdout:2/916: creat d2/d25/db4/dca/f12f x:0 0 0 2024-02-28T16:24:51.436 INFO:tasks.workunit.client.1.smithi153.stdout:3/945: truncate d4/d13/f1d 4795804 0 2024-02-28T16:24:51.436 INFO:tasks.workunit.client.1.smithi153.stdout:8/975: dread d0/d19/d2b/f54 [0,4194304] 0 2024-02-28T16:24:51.438 INFO:tasks.workunit.client.1.smithi153.stdout:5/952: write da/d29/d43/d5a/dbe/f129 [1393464,12181] 0 2024-02-28T16:24:51.441 INFO:tasks.workunit.client.1.smithi153.stdout:0/916: symlink d4/l13a 0 2024-02-28T16:24:51.442 INFO:tasks.workunit.client.1.smithi153.stdout:7/937: chown d1/d25/df/d26/d3a/d81 63470293 1 2024-02-28T16:24:51.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/917: write d4/d89/f92 [8161260,55882] 0 2024-02-28T16:24:51.444 INFO:tasks.workunit.client.1.smithi153.stdout:7/938: write d1/d25/df/f8f [1228979,96925] 0 2024-02-28T16:24:51.453 INFO:tasks.workunit.client.1.smithi153.stdout:9/898: dwrite d1/d74/d80/da8/fd3 [0,4194304] 0 2024-02-28T16:24:51.453 INFO:tasks.workunit.client.1.smithi153.stdout:8/976: rename d0/d19/d2b/d2d/d3f/d10a/f152 to d0/d19/d1e/df3/f163 0 2024-02-28T16:24:51.454 INFO:tasks.workunit.client.1.smithi153.stdout:3/946: write d4/d8/d1e/f58 [1481469,90929] 0 2024-02-28T16:24:51.455 INFO:tasks.workunit.client.1.smithi153.stdout:5/953: symlink da/d29/d43/d5a/d77/dd6/l139 0 2024-02-28T16:24:51.457 INFO:tasks.workunit.client.1.smithi153.stdout:3/947: chown d4/c8e 8105129 1 2024-02-28T16:24:51.458 INFO:tasks.workunit.client.1.smithi153.stdout:8/977: stat d0/d12/d67/d88/d96/dfc 0 2024-02-28T16:24:51.463 INFO:tasks.workunit.client.1.smithi153.stdout:5/954: chown da/dd/dd1/ddd/f111 68226 1 2024-02-28T16:24:51.463 INFO:tasks.workunit.client.1.smithi153.stdout:1/911: truncate d0/d3d/f7d 1791249 0 2024-02-28T16:24:51.463 INFO:tasks.workunit.client.1.smithi153.stdout:6/940: dwrite d0/d1d/d33/d9c/d68/da2/f11e [0,4194304] 0 2024-02-28T16:24:51.467 INFO:tasks.workunit.client.1.smithi153.stdout:9/899: creat d1/d5/d11/d1f/d43/d76/f126 x:0 0 0 2024-02-28T16:24:51.472 INFO:tasks.workunit.client.1.smithi153.stdout:8/978: mkdir d0/d12/d67/d88/df8/d15c/db3/d164 0 2024-02-28T16:24:51.475 INFO:tasks.workunit.client.1.smithi153.stdout:6/941: rmdir d0/d1d/d33/d9c/d2e/d99/dab 39 2024-02-28T16:24:51.477 INFO:tasks.workunit.client.1.smithi153.stdout:3/948: dwrite d4/d2c/f7e [0,4194304] 0 2024-02-28T16:24:51.478 INFO:tasks.workunit.client.1.smithi153.stdout:1/912: write d0/dd/db2/de5/f107 [878249,62771] 0 2024-02-28T16:24:51.478 INFO:tasks.workunit.client.1.smithi153.stdout:7/939: dread d1/d25/f16 [0,4194304] 0 2024-02-28T16:24:51.480 INFO:tasks.workunit.client.1.smithi153.stdout:5/955: creat da/d29/f13a x:0 0 0 2024-02-28T16:24:51.483 INFO:tasks.workunit.client.1.smithi153.stdout:2/917: truncate d2/d23/d48/df0/d3b/f4e 1849934 0 2024-02-28T16:24:51.484 INFO:tasks.workunit.client.1.smithi153.stdout:1/913: readlink d0/dd/db2/d89/dad/lb7 0 2024-02-28T16:24:51.486 INFO:tasks.workunit.client.1.smithi153.stdout:3/949: write d4/d8/f1c [1541571,11456] 0 2024-02-28T16:24:51.492 INFO:tasks.workunit.client.1.smithi153.stdout:8/979: creat d0/d19/d2b/d2d/d111/d13a/f165 x:0 0 0 2024-02-28T16:24:51.492 INFO:tasks.workunit.client.1.smithi153.stdout:0/918: dwrite d4/d32/dcf/df6/d10c/fc9 [0,4194304] 0 2024-02-28T16:24:51.492 INFO:tasks.workunit.client.1.smithi153.stdout:6/942: chown d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/le1 9 1 2024-02-28T16:24:51.493 INFO:tasks.workunit.client.1.smithi153.stdout:5/956: unlink da/dd/dd1/ddd/l100 0 2024-02-28T16:24:51.496 INFO:tasks.workunit.client.1.smithi153.stdout:6/943: fdatasync d0/d1d/d30/f58 0 2024-02-28T16:24:51.496 INFO:tasks.workunit.client.1.smithi153.stdout:3/950: read d4/d13/fe0 [201459,26832] 0 2024-02-28T16:24:51.497 INFO:tasks.workunit.client.1.smithi153.stdout:9/900: dwrite d1/d5/d11/d1f/d43/d76/f126 [0,4194304] 0 2024-02-28T16:24:51.498 INFO:tasks.workunit.client.1.smithi153.stdout:2/918: rename d2/d19/d31/f40 to d2/d19/d5d/f130 0 2024-02-28T16:24:51.498 INFO:tasks.workunit.client.1.smithi153.stdout:5/957: write da/dd/d25/feb [625372,12076] 0 2024-02-28T16:24:51.500 INFO:tasks.workunit.client.1.smithi153.stdout:4/879: sync 2024-02-28T16:24:51.505 INFO:tasks.workunit.client.1.smithi153.stdout:5/958: read da/d29/d43/d5a/d77/fba [235407,21944] 0 2024-02-28T16:24:51.508 INFO:tasks.workunit.client.1.smithi153.stdout:5/959: readlink da/d29/d43/d5a/d77/l7f 0 2024-02-28T16:24:51.509 INFO:tasks.workunit.client.1.smithi153.stdout:3/951: rmdir d4/d2c/de8 39 2024-02-28T16:24:51.519 INFO:tasks.workunit.client.1.smithi153.stdout:0/919: write d4/d27/d101/fbd [385706,20721] 0 2024-02-28T16:24:51.521 INFO:tasks.workunit.client.1.smithi153.stdout:0/920: stat d4/d32/df3 0 2024-02-28T16:24:51.523 INFO:tasks.workunit.client.1.smithi153.stdout:4/880: write d4/de/d23/d2b/d31/da2/fb1 [3233773,122837] 0 2024-02-28T16:24:51.524 INFO:tasks.workunit.client.1.smithi153.stdout:3/952: creat d4/d8/d1e/d87/f14a x:0 0 0 2024-02-28T16:24:51.526 INFO:tasks.workunit.client.1.smithi153.stdout:1/914: mkdir d0/dd/db2/d89/dad/dde/d114/d12c/d13b 0 2024-02-28T16:24:51.529 INFO:tasks.workunit.client.1.smithi153.stdout:1/915: write d0/dd/db2/d89/dad/fcd [1178565,4122] 0 2024-02-28T16:24:51.531 INFO:tasks.workunit.client.1.smithi153.stdout:8/980: write d0/d12/d67/d88/df8/d15c/db3/fdb [747123,6957] 0 2024-02-28T16:24:51.536 INFO:tasks.workunit.client.1.smithi153.stdout:3/953: unlink d4/d8/d1e/d2a/c13e 0 2024-02-28T16:24:51.537 INFO:tasks.workunit.client.1.smithi153.stdout:8/981: stat d0/d19/d2b/d2d/d3f/d9f/dcc/fec 0 2024-02-28T16:24:51.539 INFO:tasks.workunit.client.1.smithi153.stdout:1/916: mknod d0/dd/d111/d59/d9a/c13c 0 2024-02-28T16:24:51.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/919: getdents d2/d25/db4/dca 0 2024-02-28T16:24:51.544 INFO:tasks.workunit.client.1.smithi153.stdout:0/921: write d4/d32/d7f/d8a/dab/f30 [4578534,109853] 0 2024-02-28T16:24:51.544 INFO:tasks.workunit.client.1.smithi153.stdout:6/944: dread d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/d96/fbe [0,4194304] 0 2024-02-28T16:24:51.545 INFO:tasks.workunit.client.1.smithi153.stdout:1/917: write d0/dd/f29 [902857,65907] 0 2024-02-28T16:24:51.548 INFO:tasks.workunit.client.1.smithi153.stdout:6/945: stat d0/d1d/d5d/dfa 0 2024-02-28T16:24:51.552 INFO:tasks.workunit.client.1.smithi153.stdout:9/901: dwrite d1/d74/d80/da8/f25 [0,4194304] 0 2024-02-28T16:24:51.553 INFO:tasks.workunit.client.1.smithi153.stdout:1/918: creat d0/dc1/de4/d109/f13d x:0 0 0 2024-02-28T16:24:51.554 INFO:tasks.workunit.client.1.smithi153.stdout:4/881: dwrite d4/d53/d7c/da4/f112 [0,4194304] 0 2024-02-28T16:24:51.555 INFO:tasks.workunit.client.1.smithi153.stdout:5/960: dread da/f2c [0,4194304] 0 2024-02-28T16:24:51.558 INFO:tasks.workunit.client.1.smithi153.stdout:8/982: write d0/d19/d2b/d2d/d3f/d9f/dcc/fa2 [2352774,25898] 0 2024-02-28T16:24:51.558 INFO:tasks.workunit.client.1.smithi153.stdout:2/920: truncate d2/f6 1220690 0 2024-02-28T16:24:51.563 INFO:tasks.workunit.client.1.smithi153.stdout:5/961: stat da/dd/d25/d41/c6e 0 2024-02-28T16:24:51.563 INFO:tasks.workunit.client.1.smithi153.stdout:2/921: dread - d2/d23/d48/df0/d3b/d87/df8/dd0/f11a zero size 2024-02-28T16:24:51.569 INFO:tasks.workunit.client.1.smithi153.stdout:5/962: fsync da/f3a 0 2024-02-28T16:24:51.572 INFO:tasks.workunit.client.1.smithi153.stdout:3/954: dwrite d4/d7d/d70/faf [0,4194304] 0 2024-02-28T16:24:51.579 INFO:tasks.workunit.client.1.smithi153.stdout:5/963: chown da/dd/d25/d8a/dac/lf9 1 1 2024-02-28T16:24:51.580 INFO:tasks.workunit.client.1.smithi153.stdout:9/902: dwrite d1/d69/f123 [0,4194304] 0 2024-02-28T16:24:51.582 INFO:tasks.workunit.client.1.smithi153.stdout:4/882: write d4/de/d13/f2c [2899383,26135] 0 2024-02-28T16:24:51.583 INFO:tasks.workunit.client.1.smithi153.stdout:8/983: write d0/d25/f7e [903085,20523] 0 2024-02-28T16:24:51.584 INFO:tasks.workunit.client.1.smithi153.stdout:1/919: mknod d0/dd/db2/d89/dad/dde/d114/d12c/d13b/c13e 0 2024-02-28T16:24:51.585 INFO:tasks.workunit.client.1.smithi153.stdout:3/955: fsync d4/d8/d1e/d23/da0/dd9/f142 0 2024-02-28T16:24:51.588 INFO:tasks.workunit.client.1.smithi153.stdout:6/946: dwrite d0/d1d/d33/d9c/d48/d63/f9f [0,4194304] 0 2024-02-28T16:24:51.589 INFO:tasks.workunit.client.1.smithi153.stdout:1/920: stat d0/d62/d66/f101 0 2024-02-28T16:24:51.591 INFO:tasks.workunit.client.1.smithi153.stdout:3/956: stat d4/d8/d1e/d63 0 2024-02-28T16:24:51.592 INFO:tasks.workunit.client.1.smithi153.stdout:6/947: dread - d0/d1d/d33/d108/f11d zero size 2024-02-28T16:24:51.596 INFO:tasks.workunit.client.1.smithi153.stdout:5/964: dread - da/dd/d25/fe3 zero size 2024-02-28T16:24:51.597 INFO:tasks.workunit.client.1.smithi153.stdout:7/940: sync 2024-02-28T16:24:51.599 INFO:tasks.workunit.client.1.smithi153.stdout:8/984: mkdir d0/d19/d2b/d2d/d3f/d9f/d166 0 2024-02-28T16:24:51.600 INFO:tasks.workunit.client.1.smithi153.stdout:7/941: stat d1/d25/d27/d43/c46 0 2024-02-28T16:24:51.601 INFO:tasks.workunit.client.1.smithi153.stdout:4/883: rename d4/de/l1a to d4/de/d40/d4d/l119 0 2024-02-28T16:24:51.603 INFO:tasks.workunit.client.1.smithi153.stdout:7/942: stat d1/d25/d88/cc2 0 2024-02-28T16:24:51.610 INFO:tasks.workunit.client.1.smithi153.stdout:8/985: fsync d0/d12/d67/d30/f58 0 2024-02-28T16:24:51.613 INFO:tasks.workunit.client.1.smithi153.stdout:3/957: mkdir d4/d8/d1e/d14b 0 2024-02-28T16:24:51.613 INFO:tasks.workunit.client.1.smithi153.stdout:5/965: truncate da/dd/d25/fe3 449971 0 2024-02-28T16:24:51.615 INFO:tasks.workunit.client.1.smithi153.stdout:1/921: truncate d0/dd/db2/fb0 455064 0 2024-02-28T16:24:51.616 INFO:tasks.workunit.client.1.smithi153.stdout:0/922: dread d4/d32/d7f/d8a/dab/d8e/d90/faf [0,4194304] 0 2024-02-28T16:24:51.617 INFO:tasks.workunit.client.1.smithi153.stdout:9/903: getdents d1/d74/d80/da8 0 2024-02-28T16:24:51.618 INFO:tasks.workunit.client.1.smithi153.stdout:2/922: dread d2/d19/d31/dd1/fd8 [0,4194304] 0 2024-02-28T16:24:51.622 INFO:tasks.workunit.client.1.smithi153.stdout:5/966: creat da/de1/de9/f13b x:0 0 0 2024-02-28T16:24:51.625 INFO:tasks.workunit.client.1.smithi153.stdout:4/884: rename d4/de/d13/c1d to d4/de/d23/d2b/d4b/dbf/c11a 0 2024-02-28T16:24:51.627 INFO:tasks.workunit.client.1.smithi153.stdout:0/923: truncate d4/d27/f7c 1540916 0 2024-02-28T16:24:51.628 INFO:tasks.workunit.client.1.smithi153.stdout:8/986: dread d0/d12/d67/d88/d96/fef [0,4194304] 0 2024-02-28T16:24:51.628 INFO:tasks.workunit.client.1.smithi153.stdout:6/948: truncate d0/d1d/d33/d9c/f3e 2672928 0 2024-02-28T16:24:51.635 INFO:tasks.workunit.client.1.smithi153.stdout:7/943: dwrite d1/d25/df/d60/f67 [0,4194304] 0 2024-02-28T16:24:51.637 INFO:tasks.workunit.client.1.smithi153.stdout:9/904: dread d1/ff [0,4194304] 0 2024-02-28T16:24:51.638 INFO:tasks.workunit.client.1.smithi153.stdout:6/949: write d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/fdb [4343101,89124] 0 2024-02-28T16:24:51.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/958: dread d4/d8/d1e/d2a/f83 [4194304,4194304] 0 2024-02-28T16:24:51.642 INFO:tasks.workunit.client.1.smithi153.stdout:5/967: mknod da/dd/d25/d41/dda/c13c 0 2024-02-28T16:24:51.644 INFO:tasks.workunit.client.1.smithi153.stdout:4/885: mkdir d4/d11b 0 2024-02-28T16:24:51.646 INFO:tasks.workunit.client.1.smithi153.stdout:8/987: chown d0/d19/d2b/d2d/de8/f14b 938 1 2024-02-28T16:24:51.652 INFO:tasks.workunit.client.1.smithi153.stdout:7/944: creat d1/d25/df/d5a/de6/de8/d120/f136 x:0 0 0 2024-02-28T16:24:51.654 INFO:tasks.workunit.client.1.smithi153.stdout:3/959: creat d4/dfc/f14c x:0 0 0 2024-02-28T16:24:51.661 INFO:tasks.workunit.client.1.smithi153.stdout:2/923: dread d2/d19/d31/dd1/f10a [0,4194304] 0 2024-02-28T16:24:51.662 INFO:tasks.workunit.client.1.smithi153.stdout:0/924: dwrite d4/d32/d7f/dd6/dff/f12e [0,4194304] 0 2024-02-28T16:24:51.667 INFO:tasks.workunit.client.1.smithi153.stdout:3/960: truncate d4/d7d/d41/f12e 1041759 0 2024-02-28T16:24:51.668 INFO:tasks.workunit.client.1.smithi153.stdout:2/924: stat d2/d19/fc1 0 2024-02-28T16:24:51.668 INFO:tasks.workunit.client.1.smithi153.stdout:5/968: creat da/dd/d25/d82/d8f/d11e/f13d x:0 0 0 2024-02-28T16:24:51.671 INFO:tasks.workunit.client.1.smithi153.stdout:8/988: mknod d0/d12/d15/c167 0 2024-02-28T16:24:51.671 INFO:tasks.workunit.client.1.smithi153.stdout:1/922: dwrite d0/dd/db2/de5/de7/ffb [0,4194304] 0 2024-02-28T16:24:51.680 INFO:tasks.workunit.client.1.smithi153.stdout:3/961: mknod d4/dfc/c14d 0 2024-02-28T16:24:51.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.694+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f0019de10 con 0x7f1ee806d660 2024-02-28T16:24:51.684 INFO:tasks.workunit.client.1.smithi153.stdout:6/950: dwrite d0/d1d/d33/d9c/f103 [0,4194304] 0 2024-02-28T16:24:51.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/945: dwrite d1/d25/df/f8f [0,4194304] 0 2024-02-28T16:24:51.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.697+0000 7f1efd600700 1 -- 172.21.15.23:0/3074035574 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f1f0019de10 con 0x7f1ee806d660 2024-02-28T16:24:51.688 INFO:tasks.workunit.client.1.smithi153.stdout:0/925: mkdir d4/d32/d7f/d13b 0 2024-02-28T16:24:51.691 INFO:tasks.workunit.client.1.smithi153.stdout:0/926: chown d4/d32/d7f/d13b 467 1 2024-02-28T16:24:51.692 INFO:tasks.workunit.client.1.smithi153.stdout:1/923: write d0/f131 [2366665,108401] 0 2024-02-28T16:24:51.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.702+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1ee806d660 msgr2=0x7f1ee806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.702+0000 7f1f06000700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1ee806d660 0x7f1ee806fb10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009fd0 tx=0x7f1eec005fd0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.702+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 msgr2=0x7f1f00074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.702+0000 7f1f06000700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 0x7f1f00074af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e920 tx=0x7f1ef400ec30 comp rx=0 tx=0).stop 2024-02-28T16:24:51.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.703+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 shutdown_connections 2024-02-28T16:24:51.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.703+0000 7f1f06000700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1ee806d660 0x7f1ee806fb10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.703+0000 7f1f06000700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00100020 0x7f1f00074af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.703+0000 7f1f06000700 1 --2- 172.21.15.23:0/3074035574 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f001012c0 0x7f1f00073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.703+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 >> 172.21.15.23:0/3074035574 conn(0x7f1f000fb650 msgr2=0x7f1f001044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:51.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.704+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 shutdown_connections 2024-02-28T16:24:51.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.704+0000 7f1f06000700 1 -- 172.21.15.23:0/3074035574 wait complete. 2024-02-28T16:24:51.695 INFO:tasks.workunit.client.1.smithi153.stdout:8/989: truncate d0/d12/d15/dab/dd0/fdd 297042 0 2024-02-28T16:24:51.698 INFO:tasks.workunit.client.1.smithi153.stdout:0/927: dread - d4/d32/d7f/d8a/dab/d8e/d94/ffc zero size 2024-02-28T16:24:51.698 INFO:tasks.workunit.client.1.smithi153.stdout:9/905: dwrite d1/d5/d11/dd4/fad [0,4194304] 0 2024-02-28T16:24:51.701 INFO:tasks.workunit.client.1.smithi153.stdout:5/969: fsync da/f1e 0 2024-02-28T16:24:51.706 INFO:tasks.workunit.client.1.smithi153.stdout:2/925: link d2/d23/d48/df0/d3b/d87/df8/dd0/f11a d2/d25/d49/da3/f131 0 2024-02-28T16:24:51.708 INFO:tasks.workunit.client.1.smithi153.stdout:4/886: link d4/de/d23/d2b/d4b/dba/d50/f93 d4/de/f11c 0 2024-02-28T16:24:51.709 INFO:tasks.workunit.client.1.smithi153.stdout:0/928: creat d4/d32/d7f/dd6/dff/f13c x:0 0 0 2024-02-28T16:24:51.712 INFO:tasks.workunit.client.1.smithi153.stdout:5/970: truncate da/dd/d25/d41/fee 69941 0 2024-02-28T16:24:51.712 INFO:tasks.workunit.client.1.smithi153.stdout:4/887: write d4/de/d23/d2b/d31/ddf/f110 [19769,24931] 0 2024-02-28T16:24:51.715 INFO:tasks.workunit.client.1.smithi153.stdout:4/888: chown d4/de/d23/d2b 148 1 2024-02-28T16:24:51.719 INFO:tasks.workunit.client.1.smithi153.stdout:2/926: unlink d2/d23/d48/df0/d99/c10b 0 2024-02-28T16:24:51.730 INFO:tasks.workunit.client.1.smithi153.stdout:1/924: creat d0/dd/db2/de5/f13f x:0 0 0 2024-02-28T16:24:51.732 INFO:tasks.workunit.client.1.smithi153.stdout:9/906: rename d1/d5/f19 to d1/d5/d11/d1f/f127 0 2024-02-28T16:24:51.733 INFO:tasks.workunit.client.1.smithi153.stdout:8/990: getdents d0/d12/d67/d88 0 2024-02-28T16:24:51.734 INFO:tasks.workunit.client.1.smithi153.stdout:5/971: creat da/dd/d25/d41/d7c/f13e x:0 0 0 2024-02-28T16:24:51.736 INFO:tasks.workunit.client.1.smithi153.stdout:8/991: write d0/d12/d67/d88/d96/dfc/f130 [358949,119697] 0 2024-02-28T16:24:51.736 INFO:tasks.workunit.client.1.smithi153.stdout:5/972: dread - da/dd/d25/d8a/dac/f12f zero size 2024-02-28T16:24:51.738 INFO:tasks.workunit.client.1.smithi153.stdout:0/929: rename d4/d32/d7f/d8a/dab/f24 to d4/d32/dcf/f13d 0 2024-02-28T16:24:51.739 INFO:tasks.workunit.client.1.smithi153.stdout:6/951: write d0/d1d/d30/dd0/f146 [1181345,5390] 0 2024-02-28T16:24:51.740 INFO:tasks.workunit.client.1.smithi153.stdout:4/889: creat d4/f11d x:0 0 0 2024-02-28T16:24:51.740 INFO:tasks.workunit.client.1.smithi153.stdout:1/925: mkdir d0/d3d/def/d127/d140 0 2024-02-28T16:24:51.742 INFO:tasks.workunit.client.1.smithi153.stdout:6/952: chown d0/d1d/d5d/d106/f11c 61562886 1 2024-02-28T16:24:51.743 INFO:tasks.workunit.client.1.smithi153.stdout:9/907: mknod d1/d119/c128 0 2024-02-28T16:24:51.746 INFO:tasks.workunit.client.1.smithi153.stdout:2/927: rename d2/d86/da0/dce/d115 to d2/d86/d132 0 2024-02-28T16:24:51.748 INFO:tasks.workunit.client.1.smithi153.stdout:2/928: chown d2/d23/d48/df0/d3b/d5e/fd3 3567967 1 2024-02-28T16:24:51.751 INFO:tasks.workunit.client.1.smithi153.stdout:1/926: symlink d0/dd/d111/dd9/l141 0 2024-02-28T16:24:51.754 INFO:tasks.workunit.client.1.smithi153.stdout:6/953: mkdir d0/d66/db3/d148 0 2024-02-28T16:24:51.755 INFO:tasks.workunit.client.1.smithi153.stdout:9/908: mknod d1/d5/d11/dd4/dbe/c129 0 2024-02-28T16:24:51.755 INFO:tasks.workunit.client.1.smithi153.stdout:6/954: fdatasync d0/f10 0 2024-02-28T16:24:51.756 INFO:tasks.workunit.client.1.smithi153.stdout:0/930: symlink d4/d27/d9a/l13e 0 2024-02-28T16:24:51.756 INFO:tasks.workunit.client.1.smithi153.stdout:4/890: dwrite d4/d53/d7c/db3/fce [0,4194304] 0 2024-02-28T16:24:51.764 INFO:tasks.workunit.client.1.smithi153.stdout:5/973: dwrite da/d29/d43/d5a/fbd [0,4194304] 0 2024-02-28T16:24:51.767 INFO:tasks.workunit.client.1.smithi153.stdout:9/909: unlink d1/d5/cc7 0 2024-02-28T16:24:51.767 INFO:tasks.workunit.client.1.smithi153.stdout:2/929: write d2/d25/fb6 [1662318,99253] 0 2024-02-28T16:24:51.771 INFO:tasks.workunit.client.1.smithi153.stdout:7/946: sync 2024-02-28T16:24:51.771 INFO:tasks.workunit.client.1.smithi153.stdout:3/962: sync 2024-02-28T16:24:51.772 INFO:tasks.workunit.client.1.smithi153.stdout:1/927: dwrite d0/dd/fc5 [0,4194304] 0 2024-02-28T16:24:51.772 INFO:tasks.workunit.client.1.smithi153.stdout:8/992: getdents d0/d19/d1e 0 2024-02-28T16:24:51.772 INFO:tasks.workunit.client.1.smithi153.stdout:2/930: write d2/d23/d36/f77 [1727188,55446] 0 2024-02-28T16:24:51.783 INFO:tasks.workunit.client.1.smithi153.stdout:2/931: readlink d2/d19/d31/l89 0 2024-02-28T16:24:51.783 INFO:tasks.workunit.client.1.smithi153.stdout:9/910: mknod d1/d5/d11/d1f/d52/c12a 0 2024-02-28T16:24:51.784 INFO:tasks.workunit.client.1.smithi153.stdout:7/947: unlink d1/d25/dc/d50/d66/f130 0 2024-02-28T16:24:51.785 INFO:tasks.workunit.client.1.smithi153.stdout:8/993: symlink d0/d19/d2b/d2d/de8/l168 0 2024-02-28T16:24:51.789 INFO:tasks.workunit.client.1.smithi153.stdout:0/931: dread d4/d32/f82 [0,4194304] 0 2024-02-28T16:24:51.794 INFO:tasks.workunit.client.1.smithi153.stdout:3/963: unlink d4/d2c/de8/cec 0 2024-02-28T16:24:51.796 INFO:tasks.workunit.client.1.smithi153.stdout:0/932: dread d4/d9b/f12b [0,4194304] 0 2024-02-28T16:24:51.796 INFO:tasks.workunit.client.1.smithi153.stdout:6/955: truncate d0/d1d/d33/d9c/d48/f144 1371254 0 2024-02-28T16:24:51.802 INFO:tasks.workunit.client.1.smithi153.stdout:6/956: mkdir d0/d1d/d33/d108/d10d/d149 0 2024-02-28T16:24:51.804 INFO:tasks.workunit.client.1.smithi153.stdout:1/928: rename d0/dd/db2/de5/de7/cfe to d0/dd/db2/d89/c142 0 2024-02-28T16:24:51.807 INFO:tasks.workunit.client.1.smithi153.stdout:1/929: fsync d0/d62/dd2/d12f/f138 0 2024-02-28T16:24:51.808 INFO:tasks.workunit.client.1.smithi153.stdout:2/932: rename d2/l14 to d2/d19/d31/dd1/l133 0 2024-02-28T16:24:51.809 INFO:tasks.workunit.client.1.smithi153.stdout:6/957: mkdir d0/d1d/d33/d9c/d2e/d99/ddf/d12d/d14a 0 2024-02-28T16:24:51.813 INFO:tasks.workunit.client.1.smithi153.stdout:2/933: chown d2/cff 15 1 2024-02-28T16:24:51.813 INFO:tasks.workunit.client.1.smithi153.stdout:0/933: dwrite d4/d32/d7f/db3/f121 [0,4194304] 0 2024-02-28T16:24:51.815 INFO:tasks.workunit.client.1.smithi153.stdout:1/930: read d0/dd/db2/d89/fa8 [3880451,68473] 0 2024-02-28T16:24:51.817 INFO:tasks.workunit.client.1.smithi153.stdout:9/911: rename d1/d5/d11/d29/c57 to d1/d5/d11/d1f/d20/dc6/c12b 0 2024-02-28T16:24:51.820 INFO:tasks.workunit.client.1.smithi153.stdout:2/934: write d2/d23/d48/df0/d3b/f71 [3066978,111768] 0 2024-02-28T16:24:51.823 INFO:tasks.workunit.client.1.smithi153.stdout:1/931: mkdir d0/d62/dd2/d143 0 2024-02-28T16:24:51.824 INFO:tasks.workunit.client.1.smithi153.stdout:9/912: write d1/d5/d11/d1f/d43/d76/f126 [2197405,117914] 0 2024-02-28T16:24:51.824 INFO:tasks.workunit.client.1.smithi153.stdout:0/934: symlink d4/d89/d135/l13f 0 2024-02-28T16:24:51.828 INFO:tasks.workunit.client.1.smithi153.stdout:3/964: dread d4/f7 [0,4194304] 0 2024-02-28T16:24:51.831 INFO:tasks.workunit.client.1.smithi153.stdout:7/948: dwrite d1/d25/d27/d7c/ff7 [0,4194304] 0 2024-02-28T16:24:51.832 INFO:tasks.workunit.client.1.smithi153.stdout:3/965: stat d4/d8/d1e/d87/fb3 0 2024-02-28T16:24:51.832 INFO:tasks.workunit.client.1.smithi153.stdout:5/974: sync 2024-02-28T16:24:51.832 INFO:tasks.workunit.client.1.smithi153.stdout:4/891: sync 2024-02-28T16:24:51.834 INFO:tasks.workunit.client.1.smithi153.stdout:8/994: dwrite d0/d19/d2b/d2d/d3f/d9f/fb0 [0,4194304] 0 2024-02-28T16:24:51.845 INFO:tasks.workunit.client.1.smithi153.stdout:6/958: link d0/d1d/d33/d8d/ca3 d0/d1d/d33/d9c/d48/d63/d8c/dd7/de0/c14b 0 2024-02-28T16:24:51.847 INFO:tasks.workunit.client.1.smithi153.stdout:8/995: dread d0/d12/d67/d88/d96/dfc/f130 [0,4194304] 0 2024-02-28T16:24:51.849 INFO:tasks.workunit.client.1.smithi153.stdout:2/935: getdents d2/d25/d49/d123 0 2024-02-28T16:24:51.853 INFO:tasks.workunit.client.1.smithi153.stdout:5/975: dwrite da/dd/d25/f2e [0,4194304] 0 2024-02-28T16:24:51.857 INFO:tasks.workunit.client.1.smithi153.stdout:7/949: mknod d1/d25/df/d26/d3a/d5e/dc8/c137 0 2024-02-28T16:24:51.859 INFO:tasks.workunit.client.1.smithi153.stdout:6/959: unlink d0/d1d/cc6 0 2024-02-28T16:24:51.862 INFO:tasks.workunit.client.1.smithi153.stdout:6/960: read d0/d17/f28 [632694,33111] 0 2024-02-28T16:24:51.862 INFO:tasks.workunit.client.1.smithi153.stdout:2/936: unlink d2/f21 0 2024-02-28T16:24:51.865 INFO:tasks.workunit.client.1.smithi153.stdout:1/932: dwrite d0/dd/f5d [0,4194304] 0 2024-02-28T16:24:51.866 INFO:tasks.workunit.client.1.smithi153.stdout:8/996: rename d0/d12/d67/d88/df8/c101 to d0/d12/d67/d88/c169 0 2024-02-28T16:24:51.868 INFO:tasks.workunit.client.1.smithi153.stdout:0/935: dwrite d4/f53 [4194304,4194304] 0 2024-02-28T16:24:51.868 INFO:tasks.workunit.client.1.smithi153.stdout:4/892: mknod d4/de/d23/c11e 0 2024-02-28T16:24:51.876 INFO:tasks.workunit.client.1.smithi153.stdout:9/913: creat d1/d5/d11/d64/f12c x:0 0 0 2024-02-28T16:24:51.877 INFO:tasks.workunit.client.1.smithi153.stdout:7/950: creat d1/d25/d27/d7c/dc4/d63/d75/f138 x:0 0 0 2024-02-28T16:24:51.877 INFO:tasks.workunit.client.1.smithi153.stdout:2/937: fdatasync d2/d19/d5d/f7a 0 2024-02-28T16:24:51.879 INFO:tasks.workunit.client.1.smithi153.stdout:1/933: rmdir d0/dd/dd5 39 2024-02-28T16:24:51.883 INFO:tasks.workunit.client.1.smithi153.stdout:0/936: unlink d4/d27/d9a/l61 0 2024-02-28T16:24:51.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/914: write d1/d5/d11/d1f/d107/f115 [479462,2456] 0 2024-02-28T16:24:51.888 INFO:tasks.workunit.client.1.smithi153.stdout:5/976: dwrite da/dd/d25/d41/d7c/f13e [0,4194304] 0 2024-02-28T16:24:51.888 INFO:tasks.workunit.client.1.smithi153.stdout:7/951: mkdir d1/d25/dc/d50/d139 0 2024-02-28T16:24:51.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/915: write d1/d74/d80/da8/fd3 [424833,38877] 0 2024-02-28T16:24:51.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:51 smithi153 ceph-mon[35341]: pgmap v15: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 137 MiB/s wr, 322 op/s 2024-02-28T16:24:51.896 INFO:tasks.workunit.client.1.smithi153.stdout:6/961: dwrite d0/d1d/d30/d71/f87 [4194304,4194304] 0 2024-02-28T16:24:51.898 INFO:tasks.workunit.client.1.smithi153.stdout:3/966: truncate d4/d6a/ff3 365812 0 2024-02-28T16:24:51.901 INFO:tasks.workunit.client.1.smithi153.stdout:4/893: link d4/de/f60 d4/de/d23/f11f 0 2024-02-28T16:24:51.907 INFO:tasks.workunit.client.1.smithi153.stdout:9/916: creat d1/d5/d11/d1f/d52/f12d x:0 0 0 2024-02-28T16:24:51.907 INFO:tasks.workunit.client.1.smithi153.stdout:3/967: creat d4/dfc/f14e x:0 0 0 2024-02-28T16:24:51.912 INFO:tasks.workunit.client.1.smithi153.stdout:6/962: rename d0/d1d/d33/d9c/d48/d63/d8c/dd1 to d0/d66/db3/d148/d14c 0 2024-02-28T16:24:51.913 INFO:tasks.workunit.client.1.smithi153.stdout:9/917: chown d1/d74/d80/da8/f4f 110864 1 2024-02-28T16:24:51.914 INFO:tasks.workunit.client.1.smithi153.stdout:3/968: chown d4/d13/d28/d99/d11f 468 1 2024-02-28T16:24:51.915 INFO:tasks.workunit.client.1.smithi153.stdout:8/997: write d0/d12/d67/d88/df8/d15c/db3/fdc [1651926,103125] 0 2024-02-28T16:24:51.919 INFO:tasks.workunit.client.1.smithi153.stdout:4/894: creat d4/de/d23/d2b/d10a/f120 x:0 0 0 2024-02-28T16:24:51.919 INFO:tasks.workunit.client.1.smithi153.stdout:5/977: dwrite da/dd/d25/d8a/dac/dc7/fcc [0,4194304] 0 2024-02-28T16:24:51.920 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.930+0000 7fd9cae00700 1 -- 172.21.15.23:0/2753095066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4100da0 msgr2=0x7fd9c4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.920 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:51 smithi023 ceph-mon[29137]: pgmap v15: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 137 MiB/s wr, 322 op/s 2024-02-28T16:24:51.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.930+0000 7fd9cae00700 1 --2- 172.21.15.23:0/2753095066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4100da0 0x7fd9c4103180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009910 tx=0x7fd9b4009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:51.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.930+0000 7fd9cae00700 1 -- 172.21.15.23:0/2753095066 shutdown_connections 2024-02-28T16:24:51.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.930+0000 7fd9cae00700 1 --2- 172.21.15.23:0/2753095066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 0x7fd9c4105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.930+0000 7fd9cae00700 1 --2- 172.21.15.23:0/2753095066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4100da0 0x7fd9c4103180 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.930+0000 7fd9cae00700 1 -- 172.21.15.23:0/2753095066 >> 172.21.15.23:0/2753095066 conn(0x7fd9c40fa780 msgr2=0x7fd9c40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:51.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.931+0000 7fd9cae00700 1 -- 172.21.15.23:0/2753095066 shutdown_connections 2024-02-28T16:24:51.922 INFO:tasks.workunit.client.1.smithi153.stdout:2/938: write d2/d19/d5d/d10f/f110 [1578244,93572] 0 2024-02-28T16:24:51.922 INFO:tasks.workunit.client.1.smithi153.stdout:4/895: chown d4/f6 13007 1 2024-02-28T16:24:51.923 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.933+0000 7fd9cae00700 1 -- 172.21.15.23:0/2753095066 wait complete. 2024-02-28T16:24:51.924 INFO:tasks.workunit.client.1.smithi153.stdout:6/963: creat d0/d1d/d30/dd0/f14d x:0 0 0 2024-02-28T16:24:51.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.935+0000 7fd9cae00700 1 Processor -- start 2024-02-28T16:24:51.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.935+0000 7fd9cae00700 1 -- start start 2024-02-28T16:24:51.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.936+0000 7fd9cae00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 0x7fd9c4197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.936+0000 7fd9cae00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4198480 0x7fd9c419d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.936+0000 7fd9cae00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4198980 con 0x7fd9c4198480 2024-02-28T16:24:51.926 INFO:tasks.workunit.client.1.smithi153.stdout:9/918: unlink d1/d74/d80/da8/c21 0 2024-02-28T16:24:51.926 INFO:tasks.workunit.client.1.smithi153.stdout:1/934: write d0/dd/d111/f51 [2156999,11546] 0 2024-02-28T16:24:51.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.936+0000 7fd9cae00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4198af0 con 0x7fd9c41036c0 2024-02-28T16:24:51.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.936+0000 7fd9c3e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 0x7fd9c4197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.937+0000 7fd9c3e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 0x7fd9c4197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:36530/0 (socket says 172.21.15.23:36530) 2024-02-28T16:24:51.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.937+0000 7fd9c3e00700 1 -- 172.21.15.23:0/972065009 learned_addr learned my addr 172.21.15.23:0/972065009 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:51.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.937+0000 7fd9c3400700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4198480 0x7fd9c419d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.938+0000 7fd9c3e00700 1 -- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4198480 msgr2=0x7fd9c419d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.938+0000 7fd9c3e00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4198480 0x7fd9c419d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.928 INFO:tasks.workunit.client.1.smithi153.stdout:8/998: unlink d0/d12/d15/dab/l10b 0 2024-02-28T16:24:51.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.938+0000 7fd9c3e00700 1 -- 172.21.15.23:0/972065009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b40095f0 con 0x7fd9c41036c0 2024-02-28T16:24:51.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.938+0000 7fd9c3400700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4198480 0x7fd9c419d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:24:51.929 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.939+0000 7fd9c3e00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 0x7fd9c4197f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009910 tx=0x7fd9b400f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.929 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.939+0000 7fd9c0c00700 1 -- 172.21.15.23:0/972065009 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b40052a0 con 0x7fd9c41036c0 2024-02-28T16:24:51.929 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.940+0000 7fd9c0c00700 1 -- 172.21.15.23:0/972065009 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd9b4027070 con 0x7fd9c41036c0 2024-02-28T16:24:51.929 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.940+0000 7fd9c0c00700 1 -- 172.21.15.23:0/972065009 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b4023ea0 con 0x7fd9c41036c0 2024-02-28T16:24:51.930 INFO:tasks.workunit.client.1.smithi153.stdout:1/935: truncate d0/d3d/f4f 5153272 0 2024-02-28T16:24:51.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.941+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c4108880 con 0x7fd9c41036c0 2024-02-28T16:24:51.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.941+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c4108d40 con 0x7fd9c41036c0 2024-02-28T16:24:51.934 INFO:tasks.workunit.client.1.smithi153.stdout:5/978: write da/de1/f117 [846124,2284] 0 2024-02-28T16:24:51.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.944+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c40feff0 con 0x7fd9c41036c0 2024-02-28T16:24:51.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.946+0000 7fd9c0c00700 1 -- 172.21.15.23:0/972065009 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 30) v1 ==== 91440+0+0 (secure 0 0 0) 0x7fd9b4029020 con 0x7fd9c41036c0 2024-02-28T16:24:51.936 INFO:tasks.workunit.client.1.smithi153.stdout:0/937: write d4/f3e [71925,70042] 0 2024-02-28T16:24:51.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.947+0000 7fd9c0c00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fd9a806d6b0 0x7fd9a806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.948+0000 7fd9c0c00700 1 -- 172.21.15.23:0/972065009 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd9b40957c0 con 0x7fd9c41036c0 2024-02-28T16:24:51.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.948+0000 7fd9c3400700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fd9a806d6b0 0x7fd9a806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.938 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.949+0000 7fd9c3400700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fd9a806d6b0 0x7fd9a806fb60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009cb0 tx=0x7fd9b0009260 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.939 INFO:tasks.workunit.client.1.smithi153.stdout:5/979: write da/dd/d25/d8a/db3/f106 [957576,109003] 0 2024-02-28T16:24:51.942 INFO:tasks.workunit.client.1.smithi153.stdout:2/939: chown d2/d23/d48/df0/d3b/d87/df8/dd0/d104/dfb/f101 3628 1 2024-02-28T16:24:51.944 INFO:tasks.workunit.client.1.smithi153.stdout:8/999: dwrite d0/d12/f81 [0,4194304] 0 2024-02-28T16:24:51.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:51.955+0000 7fd9c0c00700 1 -- 172.21.15.23:0/972065009 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fd9b4062ea0 con 0x7fd9c41036c0 2024-02-28T16:24:51.947 INFO:tasks.workunit.client.1.smithi153.stdout:3/969: creat d4/d13/f14f x:0 0 0 2024-02-28T16:24:51.948 INFO:tasks.workunit.client.1.smithi153.stdout:1/936: dread d0/dd/d111/fcb [0,4194304] 0 2024-02-28T16:24:51.958 INFO:tasks.workunit.client.1.smithi153.stdout:9/919: mkdir d1/d5/d11/d1f/d43/d12e 0 2024-02-28T16:24:51.960 INFO:tasks.workunit.client.1.smithi153.stdout:9/920: chown d1/d5/d11/d64/d85/d8c/ldb 10924 1 2024-02-28T16:24:51.973 INFO:tasks.workunit.client.1.smithi153.stdout:6/964: rmdir d0/d1d/d30/d71/dfd 0 2024-02-28T16:24:51.974 INFO:tasks.workunit.client.1.smithi153.stdout:7/952: sync 2024-02-28T16:24:51.974 INFO:tasks.workunit.client.1.smithi153.stdout:4/896: sync 2024-02-28T16:24:51.975 INFO:tasks.workunit.client.1.smithi153.stdout:0/938: dwrite d4/d32/d7f/d8a/dab/d8e/d90/f18 [0,4194304] 0 2024-02-28T16:24:51.980 INFO:tasks.workunit.client.1.smithi153.stdout:2/940: dwrite d2/d23/d48/f75 [0,4194304] 0 2024-02-28T16:24:51.989 INFO:tasks.workunit.client.1.smithi153.stdout:9/921: write d1/d5/d11/d1f/d20/d5d/fe5 [2049779,127718] 0 2024-02-28T16:24:51.991 INFO:tasks.workunit.client.1.smithi153.stdout:3/970: mknod d4/d8/d1e/d2a/d55/da3/db1/c150 0 2024-02-28T16:24:51.992 INFO:tasks.workunit.client.1.smithi153.stdout:5/980: creat da/dd/d25/d8a/dac/f13f x:0 0 0 2024-02-28T16:24:51.994 INFO:tasks.workunit.client.1.smithi153.stdout:3/971: chown d4/d8/d1e 441 1 2024-02-28T16:24:51.998 INFO:tasks.workunit.client.1.smithi153.stdout:6/965: creat d0/d1d/d33/d9c/d2e/d99/ddf/da4/d6c/db4/f14e x:0 0 0 2024-02-28T16:24:51.999 INFO:tasks.workunit.client.1.smithi153.stdout:4/897: creat d4/de/d23/d2b/d4b/d80/d9e/def/f121 x:0 0 0 2024-02-28T16:24:52.001 INFO:tasks.workunit.client.1.smithi153.stdout:7/953: truncate d1/d25/df/f47 6550928 0 2024-02-28T16:24:52.005 INFO:tasks.workunit.client.1.smithi153.stdout:2/941: creat d2/d23/d48/f134 x:0 0 0 2024-02-28T16:24:52.005 INFO:tasks.workunit.client.1.smithi153.stdout:4/898: truncate d4/de/d23/d2b/d4b/d80/d9e/def/f121 643841 0 2024-02-28T16:24:52.006 INFO:tasks.workunit.client.1.smithi153.stdout:5/981: mknod da/dd/d25/d8a/c140 0 2024-02-28T16:24:52.009 INFO:tasks.workunit.client.1.smithi153.stdout:1/937: getdents d0/d62/d66 0 2024-02-28T16:24:52.009 INFO:tasks.workunit.client.1.smithi153.stdout:2/942: mkdir d2/d19/d31/dd1/d10c/d135 0 2024-02-28T16:24:52.010 INFO:tasks.workunit.client.1.smithi153.stdout:2/943: stat d2/d25/d49 0 2024-02-28T16:24:52.011 INFO:tasks.workunit.client.1.smithi153.stdout:0/939: rename d4/d32/d7f/d8a/dab/d8e/d94/dd7/ff1 to d4/d32/df3/f140 0 2024-02-28T16:24:52.013 INFO:tasks.workunit.client.1.smithi153.stdout:4/899: creat d4/de/d23/d2b/d31/db4/f122 x:0 0 0 2024-02-28T16:24:52.013 INFO:tasks.workunit.client.1.smithi153.stdout:0/940: fsync d4/d32/d7f/d8a/fb6 0 2024-02-28T16:24:52.015 INFO:tasks.workunit.client.1.smithi153.stdout:2/944: read d2/d23/d48/df0/d3b/f71 [3381312,59454] 0 2024-02-28T16:24:52.017 INFO:tasks.workunit.client.1.smithi153.stdout:9/922: rename d1/d5/d11/d1f/d43/d76/lfb to d1/d69/l12f 0 2024-02-28T16:24:52.018 INFO:tasks.workunit.client.1.smithi153.stdout:4/900: write d4/de/d23/d2b/d31/da2/da5/fc6 [2076879,83857] 0 2024-02-28T16:24:52.021 INFO:tasks.workunit.client.1.smithi153.stdout:4/901: chown d4/de/d47/d5e/d62/ld0 1575 1 2024-02-28T16:24:52.022 INFO:tasks.workunit.client.1.smithi153.stdout:3/972: dread d4/d8/d1e/d2a/d35/f47 [0,4194304] 0 2024-02-28T16:24:52.027 INFO:tasks.workunit.client.1.smithi153.stdout:6/966: write d0/d1d/d33/d9c/d2e/d99/ddf/da4/d60/f8b [7569496,19693] 0 2024-02-28T16:24:52.033 INFO:tasks.workunit.client.1.smithi153.stdout:7/954: rename d1/d25/fa5 to d1/d25/dc/d50/d66/f13a 0 2024-02-28T16:24:52.035 INFO:tasks.workunit.client.1.smithi153.stdout:9/923: creat d1/d119/f130 x:0 0 0 2024-02-28T16:24:52.036 INFO:tasks.workunit.client.1.smithi153.stdout:2/945: truncate d2/d25/f3d 1778247 0 2024-02-28T16:24:52.037 INFO:tasks.workunit.client.1.smithi153.stdout:2/946: chown d2/d86/l7b 127892 1 2024-02-28T16:24:52.045 INFO:tasks.workunit.client.1.smithi153.stdout:5/982: write da/d29/d43/f48 [3794169,113700] 0 2024-02-28T16:24:52.047 INFO:tasks.workunit.client.1.smithi153.stdout:3/973: creat d4/d6a/f151 x:0 0 0 2024-02-28T16:24:52.054 INFO:tasks.workunit.client.1.smithi153.stdout:7/955: symlink d1/d25/df/d60/l13b 0 2024-02-28T16:24:52.056 INFO:tasks.workunit.client.1.smithi153.stdout:0/941: dwrite d4/d32/f82 [0,4194304] 0 2024-02-28T16:24:52.059 INFO:tasks.workunit.client.1.smithi153.stdout:7/956: read d1/d25/d27/d43/fed [3077857,50467] 0 2024-02-28T16:24:52.060 INFO:tasks.workunit.client.1.smithi153.stdout:2/947: creat d2/d23/d88/f136 x:0 0 0 2024-02-28T16:24:52.066 INFO:tasks.workunit.client.1.smithi153.stdout:3/974: fsync d4/d13/d8f/fb9 0 2024-02-28T16:24:52.069 INFO:tasks.workunit.client.1.smithi153.stdout:3/975: write d4/d6a/f112 [103084,33434] 0 2024-02-28T16:24:52.071 INFO:tasks.workunit.client.1.smithi153.stdout:6/967: dwrite d0/d1d/d33/f73 [0,4194304] 0 2024-02-28T16:24:52.077 INFO:tasks.workunit.client.1.smithi153.stdout:4/902: creat d4/d53/d7c/f123 x:0 0 0 2024-02-28T16:24:52.082 INFO:tasks.workunit.client.1.smithi153.stdout:2/948: write d2/d19/d5d/f130 [3806049,14368] 0 2024-02-28T16:24:52.090 INFO:tasks.workunit.client.1.smithi153.stdout:3/976: rename d4/d13/d28/fdc to d4/d8/d1e/d2a/d55/da3/f152 0 2024-02-28T16:24:52.090 INFO:tasks.workunit.client.1.smithi153.stdout:6/968: write d0/d1d/d5d/de9/f147 [2033274,48569] 0 2024-02-28T16:24:52.093 INFO:tasks.workunit.client.1.smithi153.stdout:4/903: mknod d4/de/d23/d2b/c124 0 2024-02-28T16:24:52.095 INFO:tasks.workunit.client.1.smithi153.stdout:7/957: dwrite d1/d25/d27/d7c/dc4/f6e [0,4194304] 0 2024-02-28T16:24:52.095 INFO:tasks.workunit.client.1.smithi153.stdout:1/938: sync 2024-02-28T16:24:52.095 INFO:tasks.workunit.client.1.smithi153.stdout:6/969: creat d0/d66/f14f x:0 0 0 2024-02-28T16:24:52.096 INFO:tasks.workunit.client.1.smithi153.stdout:3/977: mkdir d4/d8/d1e/d153 0 2024-02-28T16:24:52.100 INFO:tasks.workunit.client.1.smithi153.stdout:2/949: dread d2/d19/d5d/d10f/f110 [0,4194304] 0 2024-02-28T16:24:52.103 INFO:tasks.workunit.client.1.smithi153.stdout:3/978: chown d4/d13/d28/d99/d115/f12c 135 1 2024-02-28T16:24:52.103 INFO:tasks.workunit.client.1.smithi153.stdout:7/958: fdatasync d1/d25/df/d26/d3a/d95/d97/f128 0 2024-02-28T16:24:52.107 INFO:tasks.workunit.client.1.smithi153.stdout:2/950: stat d2/d19/d3e/db0/le6 0 2024-02-28T16:24:52.109 INFO:tasks.workunit.client.1.smithi153.stdout:9/924: dread d1/d74/d80/da8/f18 [0,4194304] 0 2024-02-28T16:24:52.110 INFO:tasks.workunit.client.1.smithi153.stdout:5/983: dwrite da/dd/f15 [4194304,4194304] 0 2024-02-28T16:24:52.111 INFO:tasks.workunit.client.1.smithi153.stdout:6/970: creat d0/d1d/d33/d9c/d48/d63/d8c/dc3/f150 x:0 0 0 2024-02-28T16:24:52.111 INFO:tasks.workunit.client.1.smithi153.stdout:2/951: stat d2/d23/d48/df0/d3b/d87/df8/dd0/f11a 0 2024-02-28T16:24:52.111 INFO:tasks.workunit.client.1.smithi153.stdout:3/979: symlink d4/d8/d1e/d87/l154 0 2024-02-28T16:24:52.116 INFO:tasks.workunit.client.1.smithi153.stdout:2/952: write d2/d19/d3e/da7/db1/f113 [610631,71665] 0 2024-02-28T16:24:52.122 INFO:tasks.workunit.client.1.smithi153.stdout:5/984: creat da/d29/d43/d5a/dbe/f141 x:0 0 0 2024-02-28T16:24:52.127 INFO:tasks.workunit.client.1.smithi153.stdout:9/925: symlink d1/d5/d11/d1f/d43/l131 0 2024-02-28T16:24:52.128 INFO:tasks.workunit.client.1.smithi153.stdout:7/959: dread d1/d25/df/fda [0,4194304] 0 2024-02-28T16:24:52.131 INFO:tasks.workunit.client.1.smithi153.stdout:2/953: creat d2/d23/d48/df0/d3b/d87/df8/dd0/f137 x:0 0 0 2024-02-28T16:24:52.133 INFO:tasks.workunit.client.1.smithi153.stdout:3/980: link d4/d8/d1e/d2a/d91/ff9 d4/d2c/d137/f155 0 2024-02-28T16:24:52.135 INFO:tasks.workunit.client.1.smithi153.stdout:7/960: stat d1/d25/df/d60/da4/f109 0 2024-02-28T16:24:52.135 INFO:tasks.workunit.client.1.smithi153.stdout:0/942: dwrite d4/d32/d7f/d8a/dab/f39 [0,4194304] 0 2024-02-28T16:24:52.136 INFO:tasks.workunit.client.1.smithi153.stdout:2/954: stat d2/d19/d31/dd1 0 2024-02-28T16:24:52.140 INFO:tasks.workunit.client.1.smithi153.stdout:1/939: write d0/d3d/fa6 [3107842,106822] 0 2024-02-28T16:24:52.143 INFO:tasks.workunit.client.1.smithi153.stdout:9/926: getdents d1/d74/d80/d11c 0 2024-02-28T16:24:52.146 INFO:tasks.workunit.client.1.smithi153.stdout:6/971: dread d0/d1d/d33/d9c/d48/d72/fca [4194304,4194304] 0 2024-02-28T16:24:52.149 INFO:tasks.workunit.client.1.smithi153.stdout:0/943: truncate d4/d27/d101/fbd 1336083 0 2024-02-28T16:24:52.152 INFO:tasks.workunit.client.1.smithi153.stdout:2/955: mknod d2/d23/d48/df0/d93/c138 0 2024-02-28T16:24:52.154 INFO:tasks.workunit.client.1.smithi153.stdout:4/904: dread d4/de/d23/fcf [0,4194304] 0 2024-02-28T16:24:52.155 INFO:tasks.workunit.client.1.smithi153.stdout:0/944: read d4/d32/d7f/d8a/dab/d8e/d90/f5e [692923,119035] 0 2024-02-28T16:24:52.159 INFO:tasks.workunit.client.1.smithi153.stdout:3/981: rename d4/d7d/d41/d71/c138 to d4/d8/d1e/d23/da0/c156 0 2024-02-28T16:24:52.161 INFO:tasks.workunit.client.1.smithi153.stdout:6/972: unlink d0/d17/l1b 0 2024-02-28T16:24:52.165 INFO:tasks.workunit.client.1.smithi153.stdout:9/927: mknod d1/d5/d11/d1f/c132 0 2024-02-28T16:24:52.167 INFO:tasks.workunit.client.1.smithi153.stdout:9/928: readlink d1/l2c 0 2024-02-28T16:24:52.169 INFO:tasks.workunit.client.1.smithi153.stdout:2/956: truncate d2/d19/d5d/f84 33846 0 2024-02-28T16:24:52.172 INFO:tasks.workunit.client.1.smithi153.stdout:9/929: stat d1/d5/d11/d1f/d62/fd0 0 2024-02-28T16:24:52.173 INFO:tasks.workunit.client.1.smithi153.stdout:4/905: symlink d4/de/d23/d2b/d31/l125 0 2024-02-28T16:24:52.176 INFO:tasks.workunit.client.1.smithi153.stdout:5/985: dread da/d29/fe2 [0,4194304] 0 2024-02-28T16:24:52.182 INFO:tasks.workunit.client.1.smithi153.stdout:5/986: stat da/dd/d25/f105 0 2024-02-28T16:24:52.183 INFO:tasks.workunit.client.1.smithi153.stdout:6/973: mkdir d0/d1d/d33/d9c/d2e/d99/ddf/d12d/d151 0 2024-02-28T16:24:52.194 INFO:tasks.workunit.client.1.smithi153.stdout:1/940: dwrite d0/d62/dd2/f128 [0,4194304] 0 2024-02-28T16:24:52.194 INFO:tasks.workunit.client.1.smithi153.stdout:3/982: link d4/c105 d4/d7d/c157 0 2024-02-28T16:24:52.194 INFO:tasks.workunit.client.1.smithi153.stdout:2/957: creat d2/d19/f139 x:0 0 0 2024-02-28T16:24:52.195 INFO:tasks.workunit.client.1.smithi153.stdout:0/945: dwrite d4/d32/d7f/d8a/f124 [0,4194304] 0 2024-02-28T16:24:52.202 INFO:tasks.workunit.client.1.smithi153.stdout:3/983: creat d4/d13/d28/d100/f158 x:0 0 0 2024-02-28T16:24:52.202 INFO:tasks.workunit.client.1.smithi153.stdout:1/941: creat d0/dd/d111/dd9/de1/f144 x:0 0 0 2024-02-28T16:24:52.202 INFO:tasks.workunit.client.1.smithi153.stdout:3/984: fdatasync d4/f81 0 2024-02-28T16:24:52.202 INFO:tasks.workunit.client.1.smithi153.stdout:5/987: symlink da/dd/d25/d8a/dac/dc6/l142 0 2024-02-28T16:24:52.205 INFO:tasks.workunit.client.1.smithi153.stdout:7/961: dread d1/d25/d27/d7c/db5/ffa [0,4194304] 0 2024-02-28T16:24:52.211 INFO:tasks.workunit.client.1.smithi153.stdout:0/946: chown d4/d32/f36 391 1 2024-02-28T16:24:52.215 INFO:tasks.workunit.client.1.smithi153.stdout:7/962: chown d1/d25/d27/d7c/dc4/d63 1187820 1 2024-02-28T16:24:52.215 INFO:tasks.workunit.client.1.smithi153.stdout:3/985: creat d4/d13/d28/d99/f159 x:0 0 0 2024-02-28T16:24:52.218 INFO:tasks.workunit.client.1.smithi153.stdout:5/988: fdatasync da/dd/d54/d63/fa5 0 2024-02-28T16:24:52.221 INFO:tasks.workunit.client.1.smithi153.stdout:1/942: truncate d0/dd/d111/f56 5954402 0 2024-02-28T16:24:52.222 INFO:tasks.workunit.client.1.smithi153.stdout:9/930: dwrite d1/d5/d11/d1f/d52/f12d [0,4194304] 0 2024-02-28T16:24:52.227 INFO:tasks.workunit.client.1.smithi153.stdout:0/947: chown d4/d32/d7f/d8a/dab/d8e/d90/c7d 436659 1 2024-02-28T16:24:52.227 INFO:tasks.workunit.client.1.smithi153.stdout:4/906: dwrite d4/de/d23/d2b/d4b/fa0 [0,4194304] 0 2024-02-28T16:24:52.231 INFO:tasks.workunit.client.1.smithi153.stdout:2/958: dwrite d2/d19/d8b/dcf/f11d [0,4194304] 0 2024-02-28T16:24:52.254 INFO:tasks.workunit.client.1.smithi153.stdout:3/986: rename d4/d13/d8f/fb0 to d4/d8/dd5/f15a 0 2024-02-28T16:24:52.258 INFO:tasks.workunit.client.1.smithi153.stdout:6/974: sync 2024-02-28T16:24:52.259 INFO:tasks.workunit.client.1.smithi153.stdout:7/963: truncate d1/d25/df/d26/d3a/d5e/dc8/ff9 996623 0 2024-02-28T16:24:52.263 INFO:tasks.workunit.client.1.smithi153.stdout:7/964: read d1/d25/df/f110 [3411640,107853] 0 2024-02-28T16:24:52.272 INFO:tasks.workunit.client.1.smithi153.stdout:0/948: dwrite d4/d27/d9a/da1/fe8 [0,4194304] 0 2024-02-28T16:24:52.290 INFO:tasks.workunit.client.1.smithi153.stdout:2/959: dread d2/f7d [0,4194304] 0 2024-02-28T16:24:52.300 INFO:tasks.workunit.client.1.smithi153.stdout:7/965: dread d1/d25/fcd [0,4194304] 0 2024-02-28T16:24:52.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.336+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9c40fbbb0 con 0x7fd9a806d6b0 2024-02-28T16:24:52.335 INFO:tasks.workunit.client.1.smithi153.stdout:5/989: mknod da/dd/c143 0 2024-02-28T16:24:52.336 INFO:tasks.workunit.client.1.smithi153.stdout:1/943: creat d0/d62/d66/d137/f145 x:0 0 0 2024-02-28T16:24:52.338 INFO:tasks.workunit.client.1.smithi153.stdout:4/907: creat d4/db9/d10d/f126 x:0 0 0 2024-02-28T16:24:52.338 INFO:tasks.workunit.client.1.smithi153.stdout:5/990: chown da/dd/d25/d41/c6e 91 1 2024-02-28T16:24:52.339 INFO:tasks.workunit.client.1.smithi153.stdout:1/944: write d0/d3d/f4f [5489338,91617] 0 2024-02-28T16:24:52.340 INFO:tasks.workunit.client.1.smithi153.stdout:2/960: fsync d2/d19/d31/fec 0 2024-02-28T16:24:52.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.351+0000 7fd9c0c00700 1 -- 172.21.15.23:0/972065009 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd9c40fbbb0 con 0x7fd9a806d6b0 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (9m) 17s ago 11m 14.0M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (12m) 17s ago 12m 7822k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (10m) 14s ago 10m 7499k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (12m) 17s ago 12m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (10m) 14s ago 10m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (9m) 17s ago 11m 75.0M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (4m) 17s ago 4m 197M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (4m) 17s ago 4m 14.0M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (4m) 14s ago 4m 14.2M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (4m) 14s ago 4m 14.2M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (68s) 17s ago 13m 476M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (2m) 14s ago 10m 102M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1b0f874317ec 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (13m) 17s ago 13m 54.5M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (10m) 14s ago 10m 42.1M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (11m) 17s ago 11m 8522k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (10m) 14s ago 10m 7772k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (9m) 17s ago 9m 200M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (8m) 17s ago 8m 217M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (8m) 17s ago 8m 170M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (7m) 14s ago 7m 244M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (6m) 14s ago 6m 220M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (6m) 14s ago 6m 230M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (78s) 17s ago 11m 51.2M - 2.43.0 a07b618ecd1d aaf420dd79e3 2024-02-28T16:24:52.344 INFO:tasks.workunit.client.1.smithi153.stdout:4/908: chown d4/d53/d7c/db3/f42 111042070 1 2024-02-28T16:24:52.344 INFO:tasks.workunit.client.1.smithi153.stdout:7/966: rmdir d1/d25/dc/d50/d11a 39 2024-02-28T16:24:52.344 INFO:tasks.workunit.client.1.smithi153.stdout:7/967: chown d1/d25/dc/d50 32508 1 2024-02-28T16:24:52.344 INFO:tasks.workunit.client.1.smithi153.stdout:7/968: fdatasync d1/d25/d27/d7c/db5/ffa 0 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fd9a806d6b0 msgr2=0x7fd9a806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fd9a806d6b0 0x7fd9a806fb60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009cb0 tx=0x7fd9b0009260 comp rx=0 tx=0).stop 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 msgr2=0x7fd9c4197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 0x7fd9c4197f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009910 tx=0x7fd9b400f740 comp rx=0 tx=0).stop 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 shutdown_connections 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fd9a806d6b0 0x7fd9a806fb60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c41036c0 0x7fd9c4197f40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 --2- 172.21.15.23:0/972065009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd9c4198480 0x7fd9c419d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 >> 172.21.15.23:0/972065009 conn(0x7fd9c40fa780 msgr2=0x7fd9c4102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 shutdown_connections 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.355+0000 7fd9cae00700 1 -- 172.21.15.23:0/972065009 wait complete. 2024-02-28T16:24:52.351 INFO:tasks.workunit.client.1.smithi153.stdout:4/909: creat d4/d8d/da3/d105/f127 x:0 0 0 2024-02-28T16:24:52.355 INFO:tasks.workunit.client.1.smithi153.stdout:9/931: rename d1/d5/d11/d1f to d1/d58/d133 0 2024-02-28T16:24:52.357 INFO:tasks.workunit.client.1.smithi153.stdout:1/945: truncate d0/d62/d66/d7c/f82 1693186 0 2024-02-28T16:24:52.359 INFO:tasks.workunit.client.1.smithi153.stdout:7/969: symlink d1/d25/df/d60/da4/d12d/l13c 0 2024-02-28T16:24:52.361 INFO:tasks.workunit.client.1.smithi153.stdout:9/932: mkdir d1/d69/dbb/dcc/d134 0 2024-02-28T16:24:52.363 INFO:tasks.workunit.client.1.smithi153.stdout:4/910: symlink d4/de/d23/d2b/d31/dc3/d103/l128 0 2024-02-28T16:24:52.368 INFO:tasks.workunit.client.1.smithi153.stdout:6/975: truncate d0/d1d/d30/f36 1770634 0 2024-02-28T16:24:52.373 INFO:tasks.workunit.client.1.smithi153.stdout:5/991: getdents da/dd/d25/d82/d8f 0 2024-02-28T16:24:52.380 INFO:tasks.workunit.client.1.smithi153.stdout:1/946: symlink d0/dd/db2/d89/dc7/de6/l146 0 2024-02-28T16:24:52.382 INFO:tasks.workunit.client.1.smithi153.stdout:2/961: dwrite d2/d23/f42 [0,4194304] 0 2024-02-28T16:24:52.382 INFO:tasks.workunit.client.1.smithi153.stdout:3/987: rename d4/d109/c10c to d4/d2c/c15b 0 2024-02-28T16:24:52.385 INFO:tasks.workunit.client.1.smithi153.stdout:3/988: readlink d4/d7d/d41/l48 0 2024-02-28T16:24:52.387 INFO:tasks.workunit.client.1.smithi153.stdout:6/976: mkdir d0/d1d/d30/d152 0 2024-02-28T16:24:52.397 INFO:tasks.workunit.client.1.smithi153.stdout:4/911: symlink d4/de/d40/l129 0 2024-02-28T16:24:52.399 INFO:tasks.workunit.client.1.smithi153.stdout:1/947: mkdir d0/dd/d111/dd9/de1/d147 0 2024-02-28T16:24:52.401 INFO:tasks.workunit.client.1.smithi153.stdout:0/949: rename d4/d32/d7f/d8a/dab/d8e/d94/df5/d11c to d4/d99/da5/ddf/def/d141 0 2024-02-28T16:24:52.402 INFO:tasks.workunit.client.1.smithi153.stdout:4/912: write d4/de/d23/d2b/d31/da2/da5/db2/dc2/ff0 [149197,33356] 0 2024-02-28T16:24:52.403 INFO:tasks.workunit.client.1.smithi153.stdout:2/962: write d2/f7 [4035710,86138] 0 2024-02-28T16:24:52.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/989: chown d4/d13/dcc/c12b 13340872 1 2024-02-28T16:24:52.407 INFO:tasks.workunit.client.1.smithi153.stdout:0/950: stat d4/d32/d7f/d8a/dab/d8e/d94/ffc 0 2024-02-28T16:24:52.408 INFO:tasks.workunit.client.1.smithi153.stdout:0/951: stat d4/d27/f5a 0 2024-02-28T16:24:52.411 INFO:tasks.workunit.client.1.smithi153.stdout:5/992: symlink da/dd/d25/d41/l144 0 2024-02-28T16:24:52.414 INFO:tasks.workunit.client.1.smithi153.stdout:3/990: dread d4/d7d/d41/f12e [0,4194304] 0 2024-02-28T16:24:52.414 INFO:tasks.workunit.client.1.smithi153.stdout:7/970: link d1/d25/df/l17 d1/d25/df/d8a/l13d 0 2024-02-28T16:24:52.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/933: link d1/d58/d133/d20/d5d/c91 d1/d5/c135 0 2024-02-28T16:24:52.423 INFO:tasks.workunit.client.1.smithi153.stdout:2/963: dwrite d2/d25/fee [0,4194304] 0 2024-02-28T16:24:52.429 INFO:tasks.workunit.client.1.smithi153.stdout:5/993: creat da/dd/d25/d41/f145 x:0 0 0 2024-02-28T16:24:52.430 INFO:tasks.workunit.client.1.smithi153.stdout:9/934: mknod d1/d58/d133/d20/de3/c136 0 2024-02-28T16:24:52.432 INFO:tasks.workunit.client.1.smithi153.stdout:3/991: dwrite d4/d13/f67 [0,4194304] 0 2024-02-28T16:24:52.432 INFO:tasks.workunit.client.1.smithi153.stdout:0/952: creat d4/d27/d9a/f142 x:0 0 0 2024-02-28T16:24:52.437 INFO:tasks.workunit.client.1.smithi153.stdout:5/994: stat da/dd/d25/d41/c8c 0 2024-02-28T16:24:52.439 INFO:tasks.workunit.client.1.smithi153.stdout:9/935: dread - d1/d5/d11/d64/d85/d8c/f9c zero size 2024-02-28T16:24:52.446 INFO:tasks.workunit.client.1.smithi153.stdout:3/992: rename d4/d8/f10d to d4/d8/d1e/d64/f15c 0 2024-02-28T16:24:52.447 INFO:tasks.workunit.client.1.smithi153.stdout:5/995: creat da/de1/f146 x:0 0 0 2024-02-28T16:24:52.449 INFO:tasks.workunit.client.1.smithi153.stdout:9/936: fsync d1/fb0 0 2024-02-28T16:24:52.450 INFO:tasks.workunit.client.1.smithi153.stdout:6/977: write d0/d1d/d33/db2/f104 [518418,7831] 0 2024-02-28T16:24:52.451 INFO:tasks.workunit.client.1.smithi153.stdout:3/993: mkdir d4/d8/d1e/d23/da0/d15d 0 2024-02-28T16:24:52.452 INFO:tasks.workunit.client.1.smithi153.stdout:9/937: chown d1/d7e/dd1 1 1 2024-02-28T16:24:52.453 INFO:tasks.workunit.client.1.smithi153.stdout:1/948: dwrite d0/dd/fd0 [0,4194304] 0 2024-02-28T16:24:52.453 INFO:tasks.workunit.client.1.smithi153.stdout:7/971: truncate d1/d25/df/d60/da4/dee/f104 4128000 0 2024-02-28T16:24:52.457 INFO:tasks.workunit.client.1.smithi153.stdout:2/964: truncate d2/d23/d48/df0/d3b/d5e/f6c 6694173 0 2024-02-28T16:24:52.458 INFO:tasks.workunit.client.1.smithi153.stdout:9/938: chown d1/d58/d133/d43 22425 1 2024-02-28T16:24:52.459 INFO:tasks.workunit.client.1.smithi153.stdout:3/994: dread - d4/d13/d28/d99/d115/f12c zero size 2024-02-28T16:24:52.463 INFO:tasks.workunit.client.1.smithi153.stdout:4/913: dwrite d4/de/d13/f84 [0,4194304] 0 2024-02-28T16:24:52.465 INFO:tasks.workunit.client.1.smithi153.stdout:5/996: truncate da/d29/d43/d5a/d77/dd6/fec 359931 0 2024-02-28T16:24:52.476 INFO:tasks.workunit.client.1.smithi153.stdout:4/914: dread d4/de/d23/d2b/d4b/d80/d9e/def/fcb [0,4194304] 0 2024-02-28T16:24:52.479 INFO:tasks.workunit.client.1.smithi153.stdout:5/997: mknod da/de1/de9/c147 0 2024-02-28T16:24:52.480 INFO:tasks.workunit.client.1.smithi153.stdout:4/915: chown d4/de/d13/d1b/lb6 13 1 2024-02-28T16:24:52.483 INFO:tasks.workunit.client.1.smithi153.stdout:7/972: write d1/d25/df/d26/d3a/d81/fff [4576056,86595] 0 2024-02-28T16:24:52.483 INFO:tasks.workunit.client.1.smithi153.stdout:6/978: getdents d0/d1d/d33/d9c/d68/dcb 0 2024-02-28T16:24:52.484 INFO:tasks.workunit.client.1.smithi153.stdout:9/939: link d1/fb2 d1/d58/d133/d40/d97/f137 0 2024-02-28T16:24:52.487 INFO:tasks.workunit.client.1.smithi153.stdout:2/965: dwrite d2/d19/d3e/da7/f12a [0,4194304] 0 2024-02-28T16:24:52.488 INFO:tasks.workunit.client.1.smithi153.stdout:0/953: dread d4/d32/fad [0,4194304] 0 2024-02-28T16:24:52.489 INFO:tasks.workunit.client.1.smithi153.stdout:4/916: read d4/de/d13/f117 [3612444,71692] 0 2024-02-28T16:24:52.492 INFO:tasks.workunit.client.1.smithi153.stdout:5/998: dread - da/dd/d25/d8a/dac/dc7/fca zero size 2024-02-28T16:24:52.494 INFO:tasks.workunit.client.1.smithi153.stdout:2/966: creat d2/d19/d3e/db0/f13a x:0 0 0 2024-02-28T16:24:52.497 INFO:tasks.workunit.client.1.smithi153.stdout:3/995: getdents d4/d8/d1e/d2a/d55/da3/db5 0 2024-02-28T16:24:52.498 INFO:tasks.workunit.client.1.smithi153.stdout:4/917: dread d4/de/d23/d2b/d31/f96 [0,4194304] 0 2024-02-28T16:24:52.500 INFO:tasks.workunit.client.1.smithi153.stdout:0/954: rename d4/d32/db7 to d4/d89/d135/d143 0 2024-02-28T16:24:52.503 INFO:tasks.workunit.client.1.smithi153.stdout:6/979: truncate d0/d1d/d33/d9c/d2e/f4e 1137832 0 2024-02-28T16:24:52.504 INFO:tasks.workunit.client.1.smithi153.stdout:4/918: truncate d4/de/d40/d4d/f94 612224 0 2024-02-28T16:24:52.506 INFO:tasks.workunit.client.1.smithi153.stdout:9/940: dwrite d1/d5/d27/fb8 [0,4194304] 0 2024-02-28T16:24:52.507 INFO:tasks.workunit.client.1.smithi153.stdout:0/955: symlink d4/d27/d101/l144 0 2024-02-28T16:24:52.508 INFO:tasks.workunit.client.1.smithi153.stdout:6/980: write d0/d1d/d30/d71/f87 [8396423,45101] 0 2024-02-28T16:24:52.508 INFO:tasks.workunit.client.1.smithi153.stdout:2/967: truncate d2/d23/d48/f8d 3329837 0 2024-02-28T16:24:52.512 INFO:tasks.workunit.client.1.smithi153.stdout:4/919: mkdir d4/de/d23/d2b/d4b/d12a 0 2024-02-28T16:24:52.513 INFO:tasks.workunit.client.1.smithi153.stdout:7/973: write d1/d25/d88/fc1 [835961,97869] 0 2024-02-28T16:24:52.518 INFO:tasks.workunit.client.1.smithi153.stdout:6/981: truncate d0/d1d/d33/d9c/f12a 521727 0 2024-02-28T16:24:52.518 INFO:tasks.workunit.client.1.smithi153.stdout:5/999: dwrite da/de1/de9/f13b [0,4194304] 0 2024-02-28T16:24:52.523 INFO:tasks.workunit.client.1.smithi153.stdout:9/941: creat d1/d58/d133/d20/de3/f138 x:0 0 0 2024-02-28T16:24:52.531 INFO:tasks.workunit.client.1.smithi153.stdout:9/942: read d1/d5/d11/d29/f6e [3328925,122409] 0 2024-02-28T16:24:52.531 INFO:tasks.workunit.client.1.smithi153.stdout:4/920: unlink d4/de/d23/d2b/d9b/faa 0 2024-02-28T16:24:52.533 INFO:tasks.workunit.client.1.smithi153.stdout:6/982: chown d0/d1d/d33/d9c/d68/da2/dff/l118 49185800 1 2024-02-28T16:24:52.534 INFO:tasks.workunit.client.1.smithi153.stdout:2/968: creat d2/d19/d3e/dcb/f13b x:0 0 0 2024-02-28T16:24:52.536 INFO:tasks.workunit.client.1.smithi153.stdout:6/983: write d0/d1d/d33/d9c/d2e/f42 [5100150,89963] 0 2024-02-28T16:24:52.537 INFO:tasks.workunit.client.1.smithi153.stdout:0/956: chown d4/d32/d7f/d8a/dab/ce5 65771660 1 2024-02-28T16:24:52.543 INFO:tasks.workunit.client.1.smithi153.stdout:3/996: dread d4/d8/f65 [0,4194304] 0 2024-02-28T16:24:52.544 INFO:tasks.workunit.client.1.smithi153.stdout:3/997: stat d4/d8/d1e/d2a/d91/f133 0 2024-02-28T16:24:52.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/974: dread d1/d25/dc/d50/d66/da9/ffe [0,4194304] 0 2024-02-28T16:24:52.546 INFO:tasks.workunit.client.1.smithi153.stdout:3/998: stat d4/d8/d1e/d2a/d35/l6e 0 2024-02-28T16:24:52.547 INFO:tasks.workunit.client.1.smithi153.stdout:4/921: symlink d4/d53/d7c/l12b 0 2024-02-28T16:24:52.547 INFO:tasks.workunit.client.1.smithi153.stdout:9/943: link d1/d69/dbb/f10e d1/d69/dbb/dcc/f139 0 2024-02-28T16:24:52.549 INFO:tasks.workunit.client.1.smithi153.stdout:2/969: symlink d2/d23/d48/df0/d3b/d87/df8/d119/l13c 0 2024-02-28T16:24:52.549 INFO:tasks.workunit.client.1.smithi153.stdout:3/999: truncate d4/d2c/fc1 4584873 0 2024-02-28T16:24:52.549 INFO:tasks.workunit.client.1.smithi153.stdout:0/957: fsync d4/d32/f91 0 2024-02-28T16:24:52.549 INFO:tasks.workunit.client.1.smithi153.stdout:4/922: read d4/f29 [531455,55878] 0 2024-02-28T16:24:52.550 INFO:tasks.workunit.client.1.smithi153.stdout:6/984: mkdir d0/d1d/d33/d9c/d2e/d99/ddf/da4/d153 0 2024-02-28T16:24:52.552 INFO:tasks.workunit.client.1.smithi153.stdout:9/944: dread - d1/d58/d133/d40/fdd zero size 2024-02-28T16:24:52.554 INFO:tasks.workunit.client.1.smithi153.stdout:2/970: dread - d2/d23/d48/df0/d3b/fb3 zero size 2024-02-28T16:24:52.555 INFO:tasks.workunit.client.1.smithi153.stdout:6/985: mkdir d0/d1d/d33/d9c/d2e/d99/ddf/d154 0 2024-02-28T16:24:52.557 INFO:tasks.workunit.client.1.smithi153.stdout:2/971: fsync d2/d86/fac 0 2024-02-28T16:24:52.559 INFO:tasks.workunit.client.1.smithi153.stdout:6/986: fsync d0/d1d/d33/d9c/d2e/d99/ddf/da4/f125 0 2024-02-28T16:24:52.559 INFO:tasks.workunit.client.1.smithi153.stdout:9/945: mknod d1/d5/d11/d64/d85/d9a/c13a 0 2024-02-28T16:24:52.560 INFO:tasks.workunit.client.1.smithi153.stdout:7/975: dread d1/d25/d27/d7c/ff7 [0,4194304] 0 2024-02-28T16:24:52.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.572+0000 7fb4ab800700 1 -- 172.21.15.23:0/1688203126 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 msgr2=0x7fb4a4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.572+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1688203126 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 0x7fb4a4073c20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb490009910 tx=0x7fb490009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:52.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.573+0000 7fb4ab800700 1 -- 172.21.15.23:0/1688203126 shutdown_connections 2024-02-28T16:24:52.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.573+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1688203126 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 0x7fb4a4073c20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.573+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1688203126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 0x7fb4a40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.573+0000 7fb4ab800700 1 -- 172.21.15.23:0/1688203126 >> 172.21.15.23:0/1688203126 conn(0x7fb4a40fb7f0 msgr2=0x7fb4a40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:52.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.573+0000 7fb4ab800700 1 -- 172.21.15.23:0/1688203126 shutdown_connections 2024-02-28T16:24:52.563 INFO:tasks.workunit.client.1.smithi153.stdout:7/976: chown d1/d25/c77 8 1 2024-02-28T16:24:52.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.573+0000 7fb4ab800700 1 -- 172.21.15.23:0/1688203126 wait complete. 2024-02-28T16:24:52.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.574+0000 7fb4ab800700 1 Processor -- start 2024-02-28T16:24:52.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.574+0000 7fb4ab800700 1 -- start start 2024-02-28T16:24:52.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.574+0000 7fb4ab800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 0x7fb4a410b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.574+0000 7fb4ab800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 0x7fb4a410bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.574+0000 7fb4ab800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a410c1c0 con 0x7fb4a40737b0 2024-02-28T16:24:52.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.574+0000 7fb4ab800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a410c300 con 0x7fb4a4074d80 2024-02-28T16:24:52.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.575+0000 7fb4a3e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 0x7fb4a410bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.565 INFO:tasks.workunit.client.1.smithi153.stdout:2/972: unlink d2/c37 0 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.575+0000 7fb4a8e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 0x7fb4a410b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.575+0000 7fb4a3e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 0x7fb4a410bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:36548/0 (socket says 172.21.15.23:36548) 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.575+0000 7fb4a3e00700 1 -- 172.21.15.23:0/1370308611 learned_addr learned my addr 172.21.15.23:0/1370308611 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4a3e00700 1 -- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 msgr2=0x7fb4a410b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4a3e00700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 0x7fb4a410b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4a3e00700 1 -- 172.21.15.23:0/1370308611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4900095f0 con 0x7fb4a4074d80 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4a3e00700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 0x7fb4a410bba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb490005b40 tx=0x7fb49000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4a1600700 1 -- 172.21.15.23:0/1370308611 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb49001d070 con 0x7fb4a4074d80 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4a1600700 1 -- 172.21.15.23:0/1370308611 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb49000f460 con 0x7fb4a4074d80 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4a1600700 1 -- 172.21.15.23:0/1370308611 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb490021620 con 0x7fb4a4074d80 2024-02-28T16:24:52.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.576+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a41aa000 con 0x7fb4a4074d80 2024-02-28T16:24:52.567 INFO:tasks.workunit.client.1.smithi153.stdout:7/977: write d1/d25/df/d5a/de6/de8/d120/f118 [900311,79857] 0 2024-02-28T16:24:52.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.577+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a41aa4f0 con 0x7fb4a4074d80 2024-02-28T16:24:52.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.578+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a410f4d0 con 0x7fb4a4074d80 2024-02-28T16:24:52.569 INFO:tasks.workunit.client.1.smithi153.stdout:6/987: stat d0/d1d/d33/d9c/ca9 0 2024-02-28T16:24:52.569 INFO:tasks.workunit.client.1.smithi153.stdout:0/958: dwrite d4/d32/d7f/d8a/dab/d8e/d90/f18 [0,4194304] 0 2024-02-28T16:24:52.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.579+0000 7fb4a1600700 1 -- 172.21.15.23:0/1370308611 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 30) v1 ==== 91440+0+0 (secure 0 0 0) 0x7fb49000fa40 con 0x7fb4a4074d80 2024-02-28T16:24:52.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.580+0000 7fb4a1600700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb48c06d650 0x7fb48c06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.581+0000 7fb4a1600700 1 -- 172.21.15.23:0/1370308611 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb49008e440 con 0x7fb4a4074d80 2024-02-28T16:24:52.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.581+0000 7fb4a8e00700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb48c06d650 0x7fb48c06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.571 INFO:tasks.workunit.client.1.smithi153.stdout:6/988: stat d0/d1d/d33/d9c/d2e/d99/d129 0 2024-02-28T16:24:52.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.582+0000 7fb4a8e00700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb48c06d650 0x7fb48c06fb00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb498009550 tx=0x7fb4980091b0 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:52.574 INFO:tasks.workunit.client.1.smithi153.stdout:0/959: write d4/d32/d7f/d8a/dab/d8e/d94/df5/f109 [477956,68780] 0 2024-02-28T16:24:52.574 INFO:tasks.workunit.client.1.smithi153.stdout:2/973: mkdir d2/d23/d36/de2/d13d 0 2024-02-28T16:24:52.576 INFO:tasks.workunit.client.1.smithi153.stdout:4/923: dread d4/de/f11c [0,4194304] 0 2024-02-28T16:24:52.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:52.588+0000 7fb4a1600700 1 -- 172.21.15.23:0/1370308611 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb49005ba10 con 0x7fb4a4074d80 2024-02-28T16:24:52.578 INFO:tasks.workunit.client.1.smithi153.stdout:2/974: write d2/d19/d3e/da7/f12a [4202104,21608] 0 2024-02-28T16:24:52.579 INFO:tasks.workunit.client.1.smithi153.stdout:7/978: truncate d1/d25/df/d60/f89 876627 0 2024-02-28T16:24:52.583 INFO:tasks.workunit.client.1.smithi153.stdout:1/949: sync 2024-02-28T16:24:52.585 INFO:tasks.workunit.client.1.smithi153.stdout:9/946: link d1/d58/d133/d43/cf0 d1/d69/dbb/dcc/d134/c13b 0 2024-02-28T16:24:52.591 INFO:tasks.workunit.client.1.smithi153.stdout:4/924: dwrite d4/f7 [0,4194304] 0 2024-02-28T16:24:52.595 INFO:tasks.workunit.client.1.smithi153.stdout:6/989: creat d0/d1d/d33/d9c/d68/dcb/df2/d138/f155 x:0 0 0 2024-02-28T16:24:52.603 INFO:tasks.workunit.client.1.smithi153.stdout:7/979: link d1/d25/df/f61 d1/d25/df/d60/da4/f13e 0 2024-02-28T16:24:52.604 INFO:tasks.workunit.client.1.smithi153.stdout:1/950: mknod d0/dd/db2/d89/c148 0 2024-02-28T16:24:52.605 INFO:tasks.workunit.client.1.smithi153.stdout:9/947: dwrite d1/d5/d11/d64/fa6 [0,4194304] 0 2024-02-28T16:24:52.607 INFO:tasks.workunit.client.1.smithi153.stdout:9/948: chown d1/d5/d11/d29/d79/fb3 391 1 2024-02-28T16:24:52.608 INFO:tasks.workunit.client.1.smithi153.stdout:4/925: read d4/d53/d7c/db3/f43 [1848465,75777] 0 2024-02-28T16:24:52.609 INFO:tasks.workunit.client.1.smithi153.stdout:6/990: mkdir d0/d1d/d5d/d106/d156 0 2024-02-28T16:24:52.609 INFO:tasks.workunit.client.1.smithi153.stdout:9/949: dread - d1/d69/dbb/dbc/ff9 zero size 2024-02-28T16:24:52.612 INFO:tasks.workunit.client.1.smithi153.stdout:9/950: write d1/d69/dbb/dbc/ff9 [253864,12528] 0 2024-02-28T16:24:52.618 INFO:tasks.workunit.client.1.smithi153.stdout:9/951: write d1/d69/dbb/dbc/f113 [311508,101157] 0 2024-02-28T16:24:52.618 INFO:tasks.workunit.client.1.smithi153.stdout:1/951: creat d0/dd/db2/dcc/f149 x:0 0 0 2024-02-28T16:24:52.625 INFO:tasks.workunit.client.1.smithi153.stdout:0/960: write d4/d32/dd9/fe7 [87939,121474] 0 2024-02-28T16:24:52.632 INFO:tasks.workunit.client.1.smithi153.stdout:6/991: mknod d0/d135/c157 0 2024-02-28T16:24:52.633 INFO:tasks.workunit.client.1.smithi153.stdout:0/961: dread d4/d32/d7f/d8a/dab/d8e/d90/f6c [0,4194304] 0 2024-02-28T16:24:52.638 INFO:tasks.workunit.client.1.smithi153.stdout:2/975: dwrite d2/d23/d48/f8d [0,4194304] 0 2024-02-28T16:24:52.683 INFO:tasks.workunit.client.1.smithi153.stdout:9/952: rename d1/d74/d80/da8/l24 to d1/d58/d133/d20/dc6/l13c 0 2024-02-28T16:24:52.735 INFO:tasks.workunit.client.1.smithi153.stdout:1/952: unlink d0/c22 0 2024-02-28T16:24:52.755 INFO:tasks.workunit.client.1.smithi153.stdout:7/980: getdents d1/d25/df/d26 0 2024-02-28T16:24:52.756 INFO:tasks.workunit.client.1.smithi153.stdout:1/953: dread d0/dd/fda [0,4194304] 0 2024-02-28T16:24:52.760 INFO:tasks.workunit.client.1.smithi153.stdout:2/976: truncate d2/d23/d48/df0/d3b/d87/df8/fa9 1871330 0 2024-02-28T16:24:52.763 INFO:tasks.workunit.client.1.smithi153.stdout:2/977: dread - d2/d23/d48/df0/d3b/d87/df8/dd0/f137 zero size 2024-02-28T16:24:52.766 INFO:tasks.workunit.client.1.smithi153.stdout:6/992: rename d0/d1d/d33/d9c/c22 to d0/d66/d85/c158 0 2024-02-28T16:24:52.768 INFO:tasks.workunit.client.1.smithi153.stdout:7/981: creat d1/d25/df/d5a/de6/de8/d120/dd4/f13f x:0 0 0 2024-02-28T16:24:52.772 INFO:tasks.workunit.client.1.smithi153.stdout:2/978: creat d2/d19/d5d/f13e x:0 0 0 2024-02-28T16:24:52.774 INFO:tasks.workunit.client.1.smithi153.stdout:2/979: write d2/d23/fc4 [605754,128586] 0 2024-02-28T16:24:52.785 INFO:tasks.workunit.client.1.smithi153.stdout:6/993: dread d0/d1d/d33/db2/f77 [0,4194304] 0 2024-02-28T16:24:52.786 INFO:tasks.workunit.client.1.smithi153.stdout:7/982: dread d1/d25/dc/d50/f65 [0,4194304] 0 2024-02-28T16:24:52.788 INFO:tasks.workunit.client.1.smithi153.stdout:7/983: dread - d1/d25/df/d26/d3a/d81/f117 zero size 2024-02-28T16:24:52.789 INFO:tasks.workunit.client.1.smithi153.stdout:6/994: symlink d0/d66/d13b/l159 0 2024-02-28T16:24:52.790 INFO:tasks.workunit.client.1.smithi153.stdout:6/995: readlink d0/d17/la5 0 2024-02-28T16:24:52.804 INFO:tasks.workunit.client.1.smithi153.stdout:9/953: rename d1/d5/d11 to d1/d58/d133/d62/d13d 0 2024-02-28T16:24:52.806 INFO:tasks.workunit.client.1.smithi153.stdout:9/954: chown d1/d69/dbb/dcc 1725247 1 2024-02-28T16:24:52.811 INFO:tasks.workunit.client.1.smithi153.stdout:9/955: symlink d1/l13e 0 2024-02-28T16:24:52.813 INFO:tasks.workunit.client.1.smithi153.stdout:9/956: dread - d1/d74/f11e zero size 2024-02-28T16:24:52.817 INFO:tasks.workunit.client.1.smithi153.stdout:9/957: creat d1/d58/d133/d20/de3/f13f x:0 0 0 2024-02-28T16:24:52.820 INFO:tasks.workunit.client.1.smithi153.stdout:9/958: stat d1/d58/d133/d20/d99/dae/fd9 0 2024-02-28T16:24:52.822 INFO:tasks.workunit.client.1.smithi153.stdout:9/959: write d1/d58/d133/d62/d13d/d64/f12c [407507,8909] 0 2024-02-28T16:24:52.828 INFO:tasks.workunit.client.1.smithi153.stdout:4/926: truncate d4/de/d23/d2b/d31/da2/da5/db2/fd6 2175286 0 2024-02-28T16:24:52.835 INFO:tasks.workunit.client.1.smithi153.stdout:4/927: creat d4/d53/d7c/db3/f12c x:0 0 0 2024-02-28T16:24:52.845 INFO:tasks.workunit.client.1.smithi153.stdout:4/928: mkdir d4/de/d23/d2b/d31/da2/da5/db2/d12d 0 2024-02-28T16:24:52.846 INFO:tasks.workunit.client.1.smithi153.stdout:0/962: truncate d4/d32/d7f/d8a/dab/d8e/d90/f8f 248212 0 2024-02-28T16:24:52.853 INFO:tasks.workunit.client.1.smithi153.stdout:0/963: symlink d4/d99/da5/ddf/l145 0 2024-02-28T16:24:52.855 INFO:tasks.workunit.client.1.smithi153.stdout:1/954: write d0/f23 [3555669,7472] 0 2024-02-28T16:24:52.862 INFO:tasks.workunit.client.1.smithi153.stdout:1/955: mkdir d0/d14a 0 2024-02-28T16:24:52.864 INFO:tasks.workunit.client.1.smithi153.stdout:2/980: write d2/d23/d48/df0/d3b/fb3 [422794,58754] 0 2024-02-28T16:24:52.870 INFO:tasks.workunit.client.1.smithi153.stdout:1/956: mknod d0/dd/db2/d89/dad/dde/c14b 0 2024-02-28T16:24:52.874 INFO:tasks.workunit.client.1.smithi153.stdout:2/981: mkdir d2/d23/d48/df0/d3b/d87/df8/d13f 0 2024-02-28T16:24:52.875 INFO:tasks.workunit.client.1.smithi153.stdout:1/957: chown d0/d3d/f7d 5 1 2024-02-28T16:24:52.876 INFO:tasks.workunit.client.1.smithi153.stdout:7/984: rmdir d1/d25/dc/d50/d11a 39 2024-02-28T16:24:52.876 INFO:tasks.workunit.client.1.smithi153.stdout:0/964: dwrite d4/f53 [4194304,4194304] 0 2024-02-28T16:24:52.883 INFO:tasks.workunit.client.1.smithi153.stdout:0/965: symlink d4/d89/d135/l146 0 2024-02-28T16:24:52.884 INFO:tasks.workunit.client.1.smithi153.stdout:6/996: dwrite d0/d1d/d33/d9c/d68/da2/ff3 [0,4194304] 0 2024-02-28T16:24:52.892 INFO:tasks.workunit.client.1.smithi153.stdout:1/958: write d0/dd/db2/d89/daa/fb4 [1814028,45789] 0 2024-02-28T16:24:52.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/960: write d1/d5/d27/f30 [4554720,88332] 0 2024-02-28T16:24:52.894 INFO:tasks.workunit.client.1.smithi153.stdout:0/966: write d4/d32/d7f/f86 [930298,73297] 0 2024-02-28T16:24:52.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:52 smithi153 ceph-mon[35341]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:52.896 INFO:tasks.workunit.client.1.smithi153.stdout:7/985: dread d1/d25/fe [0,4194304] 0 2024-02-28T16:24:52.896 INFO:tasks.workunit.client.1.smithi153.stdout:2/982: mknod d2/d23/d48/df0/d99/d12c/c140 0 2024-02-28T16:24:52.897 INFO:tasks.workunit.client.1.smithi153.stdout:0/967: write d4/fa [2952976,97856] 0 2024-02-28T16:24:52.901 INFO:tasks.workunit.client.1.smithi153.stdout:0/968: write d4/d32/d7f/d8a/fb6 [4751054,88996] 0 2024-02-28T16:24:52.903 INFO:tasks.workunit.client.1.smithi153.stdout:0/969: write d4/f78 [2521126,10141] 0 2024-02-28T16:24:52.913 INFO:tasks.workunit.client.1.smithi153.stdout:4/929: write d4/f5 [1200118,92586] 0 2024-02-28T16:24:52.915 INFO:tasks.workunit.client.1.smithi153.stdout:4/930: readlink d4/de/d47/la1 0 2024-02-28T16:24:52.918 INFO:tasks.workunit.client.1.smithi153.stdout:2/983: chown d2/d23/d48/df0/d3b/d87/da5 7571772 1 2024-02-28T16:24:52.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:52 smithi023 ceph-mon[29137]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:52.928 INFO:tasks.workunit.client.1.smithi153.stdout:7/986: dread d1/d25/d88/fc1 [0,4194304] 0 2024-02-28T16:24:52.929 INFO:tasks.workunit.client.1.smithi153.stdout:1/959: mknod d0/dd/d111/d59/c14c 0 2024-02-28T16:24:52.938 INFO:tasks.workunit.client.1.smithi153.stdout:2/984: dwrite d2/d19/d3e/da7/db1/f113 [0,4194304] 0 2024-02-28T16:24:52.942 INFO:tasks.workunit.client.1.smithi153.stdout:6/997: write d0/d1d/d33/d9c/f3e [3197295,130271] 0 2024-02-28T16:24:52.944 INFO:tasks.workunit.client.1.smithi153.stdout:6/998: stat d0/d1d/d5d/de9/ff7 0 2024-02-28T16:24:52.946 INFO:tasks.workunit.client.1.smithi153.stdout:1/960: creat d0/dd/db2/de5/de7/f14d x:0 0 0 2024-02-28T16:24:52.948 INFO:tasks.workunit.client.1.smithi153.stdout:1/961: write d0/dd/db2/d89/dc7/f122 [13102,115889] 0 2024-02-28T16:24:52.956 INFO:tasks.workunit.client.1.smithi153.stdout:0/970: dwrite d4/d99/da5/fca [0,4194304] 0 2024-02-28T16:24:52.960 INFO:tasks.workunit.client.1.smithi153.stdout:6/999: dwrite d0/d66/f98 [0,4194304] 0 2024-02-28T16:24:52.960 INFO:tasks.workunit.client.1.smithi153.stdout:1/962: rmdir d0/dd/db2/d80 39 2024-02-28T16:24:52.960 INFO:tasks.workunit.client.1.smithi153.stdout:4/931: getdents d4/db9/d10d 0 2024-02-28T16:24:52.962 INFO:tasks.workunit.client.1.smithi153.stdout:1/963: read d0/dd/f58 [430798,117831] 0 2024-02-28T16:24:52.962 INFO:tasks.workunit.client.1.smithi153.stdout:2/985: dread d2/fd5 [0,4194304] 0 2024-02-28T16:24:52.965 INFO:tasks.workunit.client.1.smithi153.stdout:1/964: write d0/d3d/fa6 [2088263,44746] 0 2024-02-28T16:24:52.966 INFO:tasks.workunit.client.1.smithi153.stdout:9/961: dwrite d1/d5/f59 [0,4194304] 0 2024-02-28T16:24:52.967 INFO:tasks.workunit.client.1.smithi153.stdout:4/932: symlink d4/de/d40/l12e 0 2024-02-28T16:24:52.970 INFO:tasks.workunit.client.1.smithi153.stdout:0/971: mkdir d4/d32/d7f/d13b/d147 0 2024-02-28T16:24:52.970 INFO:tasks.workunit.client.1.smithi153.stdout:4/933: chown d4/de/d40/d4d/f94 108441 1 2024-02-28T16:24:52.975 INFO:tasks.workunit.client.1.smithi153.stdout:9/962: creat d1/d58/d133/d20/d99/dae/f140 x:0 0 0 2024-02-28T16:24:52.977 INFO:tasks.workunit.client.1.smithi153.stdout:9/963: chown d1/d58/d133/d43/l131 479984 1 2024-02-28T16:24:52.979 INFO:tasks.workunit.client.1.smithi153.stdout:9/964: dread - d1/d69/dbb/dbc/f121 zero size 2024-02-28T16:24:52.980 INFO:tasks.workunit.client.1.smithi153.stdout:0/972: symlink d4/l148 0 2024-02-28T16:24:52.983 INFO:tasks.workunit.client.1.smithi153.stdout:9/965: write d1/d58/d133/d20/d45/f10a [565685,43189] 0 2024-02-28T16:24:52.984 INFO:tasks.workunit.client.1.smithi153.stdout:1/965: link d0/dd/c117 d0/dd/d111/d59/c14e 0 2024-02-28T16:24:52.985 INFO:tasks.workunit.client.1.smithi153.stdout:2/986: write d2/d23/d48/df0/f47 [3494875,8329] 0 2024-02-28T16:24:52.986 INFO:tasks.workunit.client.1.smithi153.stdout:2/987: dread - d2/d19/f139 zero size 2024-02-28T16:24:52.992 INFO:tasks.workunit.client.1.smithi153.stdout:9/966: fsync d1/d5/fb 0 2024-02-28T16:24:52.992 INFO:tasks.workunit.client.1.smithi153.stdout:2/988: creat d2/d23/d88/d95/dbb/f141 x:0 0 0 2024-02-28T16:24:52.994 INFO:tasks.workunit.client.1.smithi153.stdout:0/973: rename d4/d32/d7f/d8a/dab/d8e/d90/c4e to d4/d32/ded/c149 0 2024-02-28T16:24:52.998 INFO:tasks.workunit.client.1.smithi153.stdout:9/967: mknod d1/d5/d27/c141 0 2024-02-28T16:24:52.999 INFO:tasks.workunit.client.1.smithi153.stdout:9/968: chown d1/d74/d80/f116 23663 1 2024-02-28T16:24:53.004 INFO:tasks.workunit.client.1.smithi153.stdout:0/974: link d4/d89/d135/d143/c100 d4/d32/d7f/d8a/dab/d8e/d94/dd7/c14a 0 2024-02-28T16:24:53.008 INFO:tasks.workunit.client.1.smithi153.stdout:2/989: dwrite d2/d23/d88/d95/fcc [0,4194304] 0 2024-02-28T16:24:53.011 INFO:tasks.workunit.client.1.smithi153.stdout:0/975: creat d4/d32/dcf/df6/f14b x:0 0 0 2024-02-28T16:24:53.011 INFO:tasks.workunit.client.1.smithi153.stdout:1/966: write d0/dd/f69 [252869,25115] 0 2024-02-28T16:24:53.014 INFO:tasks.workunit.client.1.smithi153.stdout:0/976: write d4/f6b [2674722,125064] 0 2024-02-28T16:24:53.015 INFO:tasks.workunit.client.1.smithi153.stdout:2/990: unlink d2/d23/d88/f9a 0 2024-02-28T16:24:53.021 INFO:tasks.workunit.client.1.smithi153.stdout:0/977: dread - d4/d27/d101/f137 zero size 2024-02-28T16:24:53.024 INFO:tasks.workunit.client.1.smithi153.stdout:2/991: write d2/d23/d48/df0/d3b/fa6 [5137856,130580] 0 2024-02-28T16:24:53.026 INFO:tasks.workunit.client.1.smithi153.stdout:1/967: truncate d0/dd/d111/f104 399281 0 2024-02-28T16:24:53.028 INFO:tasks.workunit.client.1.smithi153.stdout:1/968: stat d0/d3d/f7d 0 2024-02-28T16:24:53.028 INFO:tasks.workunit.client.1.smithi153.stdout:0/978: mkdir d4/d32/d7f/d13b/d14c 0 2024-02-28T16:24:53.031 INFO:tasks.workunit.client.1.smithi153.stdout:0/979: fdatasync d4/d32/dd9/d104/f127 0 2024-02-28T16:24:53.032 INFO:tasks.workunit.client.1.smithi153.stdout:4/934: dread d4/de/d13/f117 [0,4194304] 0 2024-02-28T16:24:53.034 INFO:tasks.workunit.client.1.smithi153.stdout:2/992: rename d2/d23/d48/df0/d3b/d87/df8 to d2/d23/d36/d142 0 2024-02-28T16:24:53.034 INFO:tasks.workunit.client.1.smithi153.stdout:9/969: dwrite d1/d69/dbb/f10e [0,4194304] 0 2024-02-28T16:24:53.035 INFO:tasks.workunit.client.1.smithi153.stdout:0/980: readlink d4/d32/d7f/d8a/dab/d8e/d90/l11 0 2024-02-28T16:24:53.036 INFO:tasks.workunit.client.1.smithi153.stdout:1/969: rmdir d0/d62 39 2024-02-28T16:24:53.047 INFO:tasks.workunit.client.1.smithi153.stdout:0/981: symlink d4/d32/dd9/l14d 0 2024-02-28T16:24:53.052 INFO:tasks.workunit.client.1.smithi153.stdout:2/993: mknod d2/d19/d3e/c143 0 2024-02-28T16:24:53.053 INFO:tasks.workunit.client.1.smithi153.stdout:4/935: creat d4/de/d23/d2b/d4b/d12a/f12f x:0 0 0 2024-02-28T16:24:53.055 INFO:tasks.workunit.client.1.smithi153.stdout:1/970: write d0/dd/db2/d89/faf [1143996,28113] 0 2024-02-28T16:24:53.055 INFO:tasks.workunit.client.1.smithi153.stdout:0/982: dread d4/d9b/f12b [0,4194304] 0 2024-02-28T16:24:53.057 INFO:tasks.workunit.client.1.smithi153.stdout:2/994: creat d2/d19/d5d/f144 x:0 0 0 2024-02-28T16:24:53.057 INFO:tasks.workunit.client.1.smithi153.stdout:4/936: symlink d4/d53/d7c/da4/l130 0 2024-02-28T16:24:53.058 INFO:tasks.workunit.client.1.smithi153.stdout:9/970: dwrite d1/d5/d27/dd6/fe7 [0,4194304] 0 2024-02-28T16:24:53.062 INFO:tasks.workunit.client.1.smithi153.stdout:1/971: creat d0/dd/db2/d89/dc7/f14f x:0 0 0 2024-02-28T16:24:53.065 INFO:tasks.workunit.client.1.smithi153.stdout:2/995: mknod d2/d19/d5d/c145 0 2024-02-28T16:24:53.065 INFO:tasks.workunit.client.1.smithi153.stdout:1/972: dread d0/dd/db2/d89/dc7/f122 [0,4194304] 0 2024-02-28T16:24:53.067 INFO:tasks.workunit.client.1.smithi153.stdout:1/973: chown d0/dd 1 1 2024-02-28T16:24:53.067 INFO:tasks.workunit.client.1.smithi153.stdout:2/996: dread - d2/d19/f139 zero size 2024-02-28T16:24:53.069 INFO:tasks.workunit.client.1.smithi153.stdout:1/974: chown d0/d3d/f88 3 1 2024-02-28T16:24:53.071 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.081+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4a41aae30 con 0x7fb4a4074d80 2024-02-28T16:24:53.071 INFO:tasks.workunit.client.1.smithi153.stdout:0/983: dread d4/d32/fad [0,4194304] 0 2024-02-28T16:24:53.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.083+0000 7fb4a1600700 1 -- 172.21.15.23:0/1370308611 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fb49005b5a0 con 0x7fb4a4074d80 2024-02-28T16:24:53.073 INFO:tasks.workunit.client.1.smithi153.stdout:4/937: dwrite d4/de/d23/f48 [0,4194304] 0 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:24:53.074 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:24:53.075 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:24:53.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.087+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb48c06d650 msgr2=0x7fb48c06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.087+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb48c06d650 0x7fb48c06fb00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb498009550 tx=0x7fb4980091b0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.087+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 msgr2=0x7fb4a410bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.087+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 0x7fb4a410bba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb490005b40 tx=0x7fb49000bd70 comp rx=0 tx=0).stop 2024-02-28T16:24:53.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.088+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 shutdown_connections 2024-02-28T16:24:53.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.088+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb48c06d650 0x7fb48c06fb00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.088+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb4a40737b0 0x7fb4a410b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.088+0000 7fb4ab800700 1 --2- 172.21.15.23:0/1370308611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4a4074d80 0x7fb4a410bba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.088+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 >> 172.21.15.23:0/1370308611 conn(0x7fb4a40fb7f0 msgr2=0x7fb4a4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:53.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.088+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 shutdown_connections 2024-02-28T16:24:53.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.088+0000 7fb4ab800700 1 -- 172.21.15.23:0/1370308611 wait complete. 2024-02-28T16:24:53.078 INFO:tasks.workunit.client.1.smithi153.stdout:2/997: mkdir d2/d25/db4/d146 0 2024-02-28T16:24:53.083 INFO:tasks.workunit.client.1.smithi153.stdout:1/975: dread - d0/dd/dd5/f10d zero size 2024-02-28T16:24:53.087 INFO:tasks.workunit.client.1.smithi153.stdout:4/938: symlink d4/de/d23/d2b/d4b/dba/d50/l131 0 2024-02-28T16:24:53.089 INFO:tasks.workunit.client.1.smithi153.stdout:9/971: write d1/d2a/f42 [522176,80562] 0 2024-02-28T16:24:53.092 INFO:tasks.workunit.client.1.smithi153.stdout:0/984: mkdir d4/d32/df0/d108/d14e 0 2024-02-28T16:24:53.095 INFO:tasks.workunit.client.1.smithi153.stdout:0/985: readlink d4/d27/l71 0 2024-02-28T16:24:53.095 INFO:tasks.workunit.client.1.smithi153.stdout:2/998: link d2/d19/d3e/db0/le6 d2/d23/d36/d142/dd0/d104/l147 0 2024-02-28T16:24:53.096 INFO:tasks.workunit.client.1.smithi153.stdout:2/999: chown d2/d23/d36/d142 52 1 2024-02-28T16:24:53.101 INFO:tasks.workunit.client.1.smithi153.stdout:4/939: dwrite d4/db9/d10d/f126 [0,4194304] 0 2024-02-28T16:24:53.107 INFO:tasks.workunit.client.1.smithi153.stdout:0/986: getdents d4/d32/dcf/df6 0 2024-02-28T16:24:53.120 INFO:tasks.workunit.client.1.smithi153.stdout:4/940: link d4/de/d23/f70 d4/de/d23/d2b/d4b/d12a/f132 0 2024-02-28T16:24:53.122 INFO:tasks.workunit.client.1.smithi153.stdout:4/941: dread - d4/de/d23/d2b/d31/dc3/feb zero size 2024-02-28T16:24:53.124 INFO:tasks.workunit.client.1.smithi153.stdout:4/942: write d4/de/d40/d4d/f5d [2054754,59235] 0 2024-02-28T16:24:53.128 INFO:tasks.workunit.client.1.smithi153.stdout:4/943: creat d4/de/d23/d2b/d31/da2/f133 x:0 0 0 2024-02-28T16:24:53.135 INFO:tasks.workunit.client.1.smithi153.stdout:4/944: fdatasync d4/de/d23/d2b/d9b/ff2 0 2024-02-28T16:24:53.135 INFO:tasks.workunit.client.1.smithi153.stdout:4/945: write d4/de/d40/f5a [5155501,28356] 0 2024-02-28T16:24:53.151 INFO:tasks.workunit.client.1.smithi153.stdout:7/987: sync 2024-02-28T16:24:53.152 INFO:tasks.workunit.client.1.smithi153.stdout:7/988: chown d1/d25/dc/l1a 4581394 1 2024-02-28T16:24:53.159 INFO:tasks.workunit.client.1.smithi153.stdout:7/989: rename d1/d25/dc/d50/fe7 to d1/d25/df/d26/d3a/d81/f140 0 2024-02-28T16:24:53.165 INFO:tasks.workunit.client.1.smithi153.stdout:7/990: creat d1/d25/df/d26/d3a/d81/f141 x:0 0 0 2024-02-28T16:24:53.167 INFO:tasks.workunit.client.1.smithi153.stdout:7/991: chown d1/d25/fe 0 1 2024-02-28T16:24:53.168 INFO:tasks.workunit.client.1.smithi153.stdout:7/992: fsync d1/d25/f119 0 2024-02-28T16:24:53.174 INFO:tasks.workunit.client.1.smithi153.stdout:7/993: creat d1/d25/df/d5a/f142 x:0 0 0 2024-02-28T16:24:53.178 INFO:tasks.workunit.client.1.smithi153.stdout:0/987: dread d4/d32/dd9/f116 [0,4194304] 0 2024-02-28T16:24:53.185 INFO:tasks.workunit.client.1.smithi153.stdout:0/988: stat d4/d32/d7f/d8a/dab/d8e/d90/f3f 0 2024-02-28T16:24:53.196 INFO:tasks.workunit.client.1.smithi153.stdout:0/989: getdents d4/d32/dd9/d104 0 2024-02-28T16:24:53.196 INFO:tasks.workunit.client.1.smithi153.stdout:7/994: dwrite d1/d25/df/d5a/f142 [0,4194304] 0 2024-02-28T16:24:53.198 INFO:tasks.workunit.client.1.smithi153.stdout:7/995: chown d1/d25/dc/d50/d66/c7a 34 1 2024-02-28T16:24:53.202 INFO:tasks.workunit.client.1.smithi153.stdout:7/996: creat d1/d25/df/d26/f143 x:0 0 0 2024-02-28T16:24:53.212 INFO:tasks.workunit.client.1.smithi153.stdout:0/990: dwrite d4/d32/d7f/dd6/dff/f13c [0,4194304] 0 2024-02-28T16:24:53.234 INFO:tasks.workunit.client.1.smithi153.stdout:7/997: dread d1/d25/dc/f64 [0,4194304] 0 2024-02-28T16:24:53.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.273+0000 7fb16c400700 1 -- 172.21.15.23:0/2453784380 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164101440 msgr2=0x7fb164101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.273+0000 7fb16c400700 1 --2- 172.21.15.23:0/2453784380 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164101440 0x7fb164101890 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb150009910 tx=0x7fb150009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:53.264 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.273+0000 7fb16c400700 1 -- 172.21.15.23:0/2453784380 shutdown_connections 2024-02-28T16:24:53.264 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.273+0000 7fb16c400700 1 --2- 172.21.15.23:0/2453784380 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164101440 0x7fb164101890 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.264 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.273+0000 7fb16c400700 1 --2- 172.21.15.23:0/2453784380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb164100240 0x7fb164100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.264 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.273+0000 7fb16c400700 1 -- 172.21.15.23:0/2453784380 >> 172.21.15.23:0/2453784380 conn(0x7fb1640fb7f0 msgr2=0x7fb1640fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:53.264 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.274+0000 7fb16c400700 1 -- 172.21.15.23:0/2453784380 shutdown_connections 2024-02-28T16:24:53.264 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.274+0000 7fb16c400700 1 -- 172.21.15.23:0/2453784380 wait complete. 2024-02-28T16:24:53.265 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.275+0000 7fb16c400700 1 Processor -- start 2024-02-28T16:24:53.265 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.275+0000 7fb16c400700 1 -- start start 2024-02-28T16:24:53.265 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.275+0000 7fb16c400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164100240 0x7fb164197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.265 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.275+0000 7fb16c400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb164101440 0x7fb1641981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.275+0000 7fb16c400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1641987d0 con 0x7fb164100240 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.275+0000 7fb16c400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164198940 con 0x7fb164101440 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164100240 0x7fb164197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164100240 0x7fb164197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48946/0 (socket says 172.21.15.23:48946) 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169a00700 1 -- 172.21.15.23:0/2890993805 learned_addr learned my addr 172.21.15.23:0/2890993805 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169000700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb164101440 0x7fb1641981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169a00700 1 -- 172.21.15.23:0/2890993805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb164101440 msgr2=0x7fb1641981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169a00700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb164101440 0x7fb1641981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169a00700 1 -- 172.21.15.23:0/2890993805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500095f0 con 0x7fb164100240 2024-02-28T16:24:53.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.276+0000 7fb169a00700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164100240 0x7fb164197c90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb15800d900 tx=0x7fb15800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:53.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.277+0000 7fb162000700 1 -- 172.21.15.23:0/2890993805 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1580041f0 con 0x7fb164100240 2024-02-28T16:24:53.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.277+0000 7fb162000700 1 -- 172.21.15.23:0/2890993805 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb158004350 con 0x7fb164100240 2024-02-28T16:24:53.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.277+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16419d3d0 con 0x7fb164100240 2024-02-28T16:24:53.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.277+0000 7fb162000700 1 -- 172.21.15.23:0/2890993805 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb158003d20 con 0x7fb164100240 2024-02-28T16:24:53.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.277+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16419d920 con 0x7fb164100240 2024-02-28T16:24:53.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.278+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164105520 con 0x7fb164100240 2024-02-28T16:24:53.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.279+0000 7fb162000700 1 -- 172.21.15.23:0/2890993805 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 30) v1 ==== 91440+0+0 (secure 0 0 0) 0x7fb158009730 con 0x7fb164100240 2024-02-28T16:24:53.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.280+0000 7fb162000700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb14c06d650 0x7fb14c06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.280+0000 7fb162000700 1 -- 172.21.15.23:0/2890993805 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb15808d080 con 0x7fb164100240 2024-02-28T16:24:53.269 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.280+0000 7fb169000700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb14c06d650 0x7fb14c06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.270 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.280+0000 7fb169000700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb14c06d650 0x7fb14c06fb00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb1641991a0 tx=0x7fb15000b560 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:53.273 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.284+0000 7fb162000700 1 -- 172.21.15.23:0/2890993805 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb158056bd0 con 0x7fb164100240 2024-02-28T16:24:53.276 INFO:tasks.workunit.client.1.smithi153.stdout:1/976: sync 2024-02-28T16:24:53.342 INFO:tasks.workunit.client.1.smithi153.stdout:9/972: sync 2024-02-28T16:24:53.342 INFO:tasks.workunit.client.1.smithi153.stdout:4/946: sync 2024-02-28T16:24:53.435 INFO:tasks.workunit.client.1.smithi153.stdout:9/973: sync 2024-02-28T16:24:53.470 INFO:tasks.workunit.client.1.smithi153.stdout:9/974: dwrite d1/d58/d133/d62/d13d/d64/f12c [0,4194304] 0 2024-02-28T16:24:53.471 INFO:tasks.workunit.client.1.smithi153.stdout:7/998: readlink d1/d25/df/d26/d3a/d5e/d72/lab 0 2024-02-28T16:24:53.494 INFO:tasks.workunit.client.1.smithi153.stdout:0/991: dwrite d4/d32/d7f/d8a/dab/d8e/d90/f6c [0,4194304] 0 2024-02-28T16:24:53.514 INFO:tasks.workunit.client.1.smithi153.stdout:4/947: mkdir d4/de/d23/d2b/d4b/dbf/d134 0 2024-02-28T16:24:53.514 INFO:tasks.workunit.client.1.smithi153.stdout:7/999: mkdir d1/d25/df/d60/da4/d144 0 2024-02-28T16:24:53.519 INFO:tasks.workunit.client.1.smithi153.stdout:1/977: write d0/d62/d66/d7c/f136 [543451,4808] 0 2024-02-28T16:24:53.520 INFO:tasks.workunit.client.1.smithi153.stdout:0/992: mkdir d4/d32/d7f/d13b/d14c/d14f 0 2024-02-28T16:24:53.526 INFO:tasks.workunit.client.1.smithi153.stdout:1/978: write d0/dd/db2/d89/daa/fb4 [2409663,33934] 0 2024-02-28T16:24:53.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/993: symlink d4/d27/d101/l150 0 2024-02-28T16:24:53.536 INFO:tasks.workunit.client.1.smithi153.stdout:1/979: rename d0/d3d/def to d0/d62/dd2/d143/d150 0 2024-02-28T16:24:53.541 INFO:tasks.workunit.client.1.smithi153.stdout:9/975: dread d1/d58/d133/d62/d13d/d29/d79/fb3 [0,4194304] 0 2024-02-28T16:24:53.545 INFO:tasks.workunit.client.1.smithi153.stdout:1/980: mknod d0/dd/db2/d89/dad/c151 0 2024-02-28T16:24:53.550 INFO:tasks.workunit.client.1.smithi153.stdout:9/976: mkdir d1/d58/d133/d62/d13d/d29/d79/d142 0 2024-02-28T16:24:53.552 INFO:tasks.workunit.client.1.smithi153.stdout:4/948: dwrite f1 [4194304,4194304] 0 2024-02-28T16:24:53.555 INFO:tasks.workunit.client.1.smithi153.stdout:1/981: creat d0/dd/db2/d89/dc7/f152 x:0 0 0 2024-02-28T16:24:53.562 INFO:tasks.workunit.client.1.smithi153.stdout:4/949: fdatasync d4/de/f60 0 2024-02-28T16:24:53.562 INFO:tasks.workunit.client.1.smithi153.stdout:1/982: chown d0/f74 13094 1 2024-02-28T16:24:53.567 INFO:tasks.workunit.client.1.smithi153.stdout:0/994: dwrite d4/d27/f42 [0,4194304] 0 2024-02-28T16:24:53.573 INFO:tasks.workunit.client.1.smithi153.stdout:9/977: rename d1/d5/d27/dd6/f95 to d1/d58/d133/d52/f143 0 2024-02-28T16:24:53.574 INFO:tasks.workunit.client.1.smithi153.stdout:1/983: truncate d0/dd/db2/d89/dc7/d103/f12e 4887145 0 2024-02-28T16:24:53.574 INFO:tasks.workunit.client.1.smithi153.stdout:0/995: creat d4/d27/d9a/dfb/f151 x:0 0 0 2024-02-28T16:24:53.578 INFO:tasks.workunit.client.1.smithi153.stdout:9/978: chown d1/d58/d133/d20/d36/c81 186725 1 2024-02-28T16:24:53.579 INFO:tasks.workunit.client.1.smithi153.stdout:1/984: write d0/dd/db2/dcc/f149 [967733,59278] 0 2024-02-28T16:24:53.584 INFO:tasks.workunit.client.1.smithi153.stdout:0/996: stat d4/d32/d7f/d8a/dab/d8e/d90/l10 0 2024-02-28T16:24:53.587 INFO:tasks.workunit.client.1.smithi153.stdout:1/985: creat d0/d62/dd2/f153 x:0 0 0 2024-02-28T16:24:53.589 INFO:tasks.workunit.client.1.smithi153.stdout:1/986: chown d0/d62/d66/fc3 141419 1 2024-02-28T16:24:53.592 INFO:tasks.workunit.client.1.smithi153.stdout:1/987: fdatasync d0/dd/db2/d89/dc7/d103/f130 0 2024-02-28T16:24:53.599 INFO:tasks.workunit.client.1.smithi153.stdout:1/988: truncate d0/dd/db2/d89/dc7/d103/f130 97049 0 2024-02-28T16:24:53.599 INFO:tasks.workunit.client.1.smithi153.stdout:9/979: dwrite d1/fe6 [0,4194304] 0 2024-02-28T16:24:53.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.614+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb16402ce50 con 0x7fb164100240 2024-02-28T16:24:53.605 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.615+0000 7fb162000700 1 -- 172.21.15.23:0/2890993805 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7fb15805a290 con 0x7fb164100240 2024-02-28T16:24:53.605 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:24:53.605 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:24:53.605 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:24:53.605 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:24:53.605 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:24:53.606 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:24:53.607 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:53.608 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:24:53.609 INFO:tasks.workunit.client.1.smithi153.stdout:9/980: fsync d1/d74/d80/da8/f18 0 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.620+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb14c06d650 msgr2=0x7fb14c06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.620+0000 7fb16c400700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb14c06d650 0x7fb14c06fb00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb1641991a0 tx=0x7fb15000b560 comp rx=0 tx=0).stop 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164100240 msgr2=0x7fb164197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164100240 0x7fb164197c90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb15800d900 tx=0x7fb15800dc10 comp rx=0 tx=0).stop 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 shutdown_connections 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fb14c06d650 0x7fb14c06fb00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb164100240 0x7fb164197c90 secure :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb15800d900 tx=0x7fb15800dc10 comp rx=0 tx=0).stop 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 --2- 172.21.15.23:0/2890993805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb164101440 0x7fb1641981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 >> 172.21.15.23:0/2890993805 conn(0x7fb1640fb7f0 msgr2=0x7fb164102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 shutdown_connections 2024-02-28T16:24:53.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.621+0000 7fb16c400700 1 -- 172.21.15.23:0/2890993805 wait complete. 2024-02-28T16:24:53.613 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:24:53.614 INFO:tasks.workunit.client.1.smithi153.stdout:4/950: dread d4/d53/d7c/da4/f112 [0,4194304] 0 2024-02-28T16:24:53.617 INFO:tasks.workunit.client.1.smithi153.stdout:1/989: write d0/dd/d111/d59/f5a [592986,116609] 0 2024-02-28T16:24:53.620 INFO:tasks.workunit.client.1.smithi153.stdout:0/997: dread d4/d27/f47 [0,4194304] 0 2024-02-28T16:24:53.621 INFO:tasks.workunit.client.1.smithi153.stdout:0/998: dread - d4/d9b/f12d zero size 2024-02-28T16:24:53.623 INFO:tasks.workunit.client.1.smithi153.stdout:0/999: write d4/d9b/f12d [423229,6624] 0 2024-02-28T16:24:53.630 INFO:tasks.workunit.client.1.smithi153.stdout:4/951: write d4/de/d23/f70 [805032,62071] 0 2024-02-28T16:24:53.632 INFO:tasks.workunit.client.1.smithi153.stdout:1/990: truncate d0/dd/db2/d89/dc7/d103/f12e 2127921 0 2024-02-28T16:24:53.634 INFO:tasks.workunit.client.1.smithi153.stdout:1/991: chown d0/c47 91926 1 2024-02-28T16:24:53.635 INFO:tasks.workunit.client.1.smithi153.stdout:4/952: dread d4/de/d23/d2b/d31/ddf/f110 [0,4194304] 0 2024-02-28T16:24:53.637 INFO:tasks.workunit.client.1.smithi153.stdout:4/953: chown d4/de/d23/d2b/d31/ddf/dec 2 1 2024-02-28T16:24:53.640 INFO:tasks.workunit.client.1.smithi153.stdout:4/954: creat d4/de/d23/d2b/d4b/dbf/d134/f135 x:0 0 0 2024-02-28T16:24:53.644 INFO:tasks.workunit.client.1.smithi153.stdout:4/955: dread - d4/de/d23/d2b/d4b/fc0 zero size 2024-02-28T16:24:53.647 INFO:tasks.workunit.client.1.smithi153.stdout:4/956: mkdir d4/de/d40/d4d/d136 0 2024-02-28T16:24:53.651 INFO:tasks.workunit.client.1.smithi153.stdout:4/957: write d4/de/d23/d2b/d31/db4/f122 [549833,126923] 0 2024-02-28T16:24:53.656 INFO:tasks.workunit.client.1.smithi153.stdout:4/958: creat d4/de/d23/d2b/f137 x:0 0 0 2024-02-28T16:24:53.664 INFO:tasks.workunit.client.1.smithi153.stdout:1/992: dread d0/dd/db2/d89/fa8 [0,4194304] 0 2024-02-28T16:24:53.670 INFO:tasks.workunit.client.1.smithi153.stdout:1/993: mkdir d0/dd/d154 0 2024-02-28T16:24:53.673 INFO:tasks.workunit.client.1.smithi153.stdout:4/959: write f0 [2598785,73073] 0 2024-02-28T16:24:53.675 INFO:tasks.workunit.client.1.smithi153.stdout:4/960: fsync d4/de/d13/f2c 0 2024-02-28T16:24:53.678 INFO:tasks.workunit.client.1.smithi153.stdout:4/961: chown d4/de/d23/d2b/d31/da2/da5/db2 463523 1 2024-02-28T16:24:53.683 INFO:tasks.workunit.client.1.smithi153.stdout:4/962: rename d4/db9/d10d to d4/d53/d7c/da4/d138 0 2024-02-28T16:24:53.684 INFO:tasks.workunit.client.1.smithi153.stdout:9/981: sync 2024-02-28T16:24:53.686 INFO:tasks.workunit.client.1.smithi153.stdout:4/963: stat d4/de/d23/d2b/d4b/d12a/f132 0 2024-02-28T16:24:53.689 INFO:tasks.workunit.client.1.smithi153.stdout:1/994: dwrite d0/dd/d111/f51 [0,4194304] 0 2024-02-28T16:24:53.689 INFO:tasks.workunit.client.1.smithi153.stdout:4/964: dread - d4/de/d23/d2b/d10a/f120 zero size 2024-02-28T16:24:53.692 INFO:tasks.workunit.client.1.smithi153.stdout:9/982: truncate d1/d58/d133/d20/f3e 1693682 0 2024-02-28T16:24:53.697 INFO:tasks.workunit.client.1.smithi153.stdout:4/965: rename d4/de/d40/f5a to d4/d53/d7c/db3/de2/f139 0 2024-02-28T16:24:53.699 INFO:tasks.workunit.client.1.smithi153.stdout:4/966: chown d4/de/d23/d2b/d4b/d12a 35788903 1 2024-02-28T16:24:53.707 INFO:tasks.workunit.client.1.smithi153.stdout:9/983: link d1/d58/d133/d62/d13d/d64/d85/d8c/l9e d1/d58/d133/d62/d13d/d29/l144 0 2024-02-28T16:24:53.710 INFO:tasks.workunit.client.1.smithi153.stdout:9/984: chown d1/d5/d27/dd6/f114 0 1 2024-02-28T16:24:53.715 INFO:tasks.workunit.client.1.smithi153.stdout:1/995: write d0/dd/f49 [1090469,19165] 0 2024-02-28T16:24:53.719 INFO:tasks.workunit.client.1.smithi153.stdout:9/985: creat d1/d58/d133/d43/d12e/f145 x:0 0 0 2024-02-28T16:24:53.722 INFO:tasks.workunit.client.1.smithi153.stdout:1/996: symlink d0/dd/db2/d89/dad/dde/d114/l155 0 2024-02-28T16:24:53.727 INFO:tasks.workunit.client.1.smithi153.stdout:1/997: mkdir d0/dd/db2/d80/d156 0 2024-02-28T16:24:53.731 INFO:tasks.workunit.client.1.smithi153.stdout:1/998: read d0/dd/fc5 [2214785,97154] 0 2024-02-28T16:24:53.735 INFO:tasks.workunit.client.1.smithi153.stdout:1/999: write d0/dd/db2/d89/faf [4827962,87018] 0 2024-02-28T16:24:53.758 INFO:tasks.workunit.client.1.smithi153.stdout:9/986: dread d1/d58/d133/d40/f8b [0,4194304] 0 2024-02-28T16:24:53.781 INFO:tasks.workunit.client.1.smithi153.stdout:9/987: write d1/d58/d133/d20/d99/dae/feb [382561,88983] 0 2024-02-28T16:24:53.789 INFO:tasks.workunit.client.1.smithi153.stdout:9/988: symlink d1/d69/dbb/dcc/d134/l146 0 2024-02-28T16:24:53.795 INFO:tasks.workunit.client.1.smithi153.stdout:9/989: mkdir d1/d7e/dd1/d147 0 2024-02-28T16:24:53.797 INFO:tasks.workunit.client.1.smithi153.stdout:9/990: stat d1/d5/fb 0 2024-02-28T16:24:53.804 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.814+0000 7f1d35200700 1 -- 172.21.15.23:0/3005168616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30100240 msgr2=0x7f1d30100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.804 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.814+0000 7f1d35200700 1 --2- 172.21.15.23:0/3005168616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30100240 0x7f1d30100650 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009910 tx=0x7f1d20009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:53.804 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:53 smithi023 ceph-mon[29137]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:53.804 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:53 smithi023 ceph-mon[29137]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:53.804 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:53 smithi023 ceph-mon[29137]: pgmap v16: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 137 MiB/s wr, 322 op/s 2024-02-28T16:24:53.804 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:53 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1370308611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:53.804 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:53 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/2890993805' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:24:53.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.814+0000 7f1d35200700 1 -- 172.21.15.23:0/3005168616 shutdown_connections 2024-02-28T16:24:53.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.814+0000 7f1d35200700 1 --2- 172.21.15.23:0/3005168616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d30101440 0x7f1d30101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.814+0000 7f1d35200700 1 --2- 172.21.15.23:0/3005168616 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30100240 0x7f1d30100650 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.814+0000 7f1d35200700 1 -- 172.21.15.23:0/3005168616 >> 172.21.15.23:0/3005168616 conn(0x7f1d300fb7f0 msgr2=0x7f1d300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:53.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.815+0000 7f1d35200700 1 -- 172.21.15.23:0/3005168616 shutdown_connections 2024-02-28T16:24:53.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.815+0000 7f1d35200700 1 -- 172.21.15.23:0/3005168616 wait complete. 2024-02-28T16:24:53.806 INFO:tasks.workunit.client.1.smithi153.stdout:9/991: truncate d1/d58/d133/d52/f12d 4580587 0 2024-02-28T16:24:53.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.816+0000 7f1d35200700 1 Processor -- start 2024-02-28T16:24:53.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.816+0000 7f1d35200700 1 -- start start 2024-02-28T16:24:53.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d35200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d30100240 0x7f1d30197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d35200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30101440 0x7f1d301982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d35200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301988c0 con 0x7f1d30101440 2024-02-28T16:24:53.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d35200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30198a00 con 0x7f1d30100240 2024-02-28T16:24:53.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d2d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30101440 0x7f1d301982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d2d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30101440 0x7f1d301982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48970/0 (socket says 172.21.15.23:48970) 2024-02-28T16:24:53.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d2d400700 1 -- 172.21.15.23:0/2691649415 learned_addr learned my addr 172.21.15.23:0/2691649415 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:53.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.817+0000 7f1d2de00700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d30100240 0x7f1d30197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d2d400700 1 -- 172.21.15.23:0/2691649415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d30100240 msgr2=0x7f1d30197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d2d400700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d30100240 0x7f1d30197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d2d400700 1 -- 172.21.15.23:0/2691649415 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200095f0 con 0x7f1d30101440 2024-02-28T16:24:53.809 INFO:tasks.workunit.client.1.smithi153.stdout:9/992: truncate d1/fb2 706491 0 2024-02-28T16:24:53.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d2d400700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30101440 0x7f1d301982a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00b4b0 tx=0x7f1d1c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:53.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d26a00700 1 -- 172.21.15.23:0/2691649415 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1c011800 con 0x7f1d30101440 2024-02-28T16:24:53.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d26a00700 1 -- 172.21.15.23:0/2691649415 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d1c011e10 con 0x7f1d30101440 2024-02-28T16:24:53.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d26a00700 1 -- 172.21.15.23:0/2691649415 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1c00f2e0 con 0x7f1d30101440 2024-02-28T16:24:53.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.818+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3019d4b0 con 0x7f1d30101440 2024-02-28T16:24:53.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.819+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3019da00 con 0x7f1d30101440 2024-02-28T16:24:53.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.820+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d30105520 con 0x7f1d30101440 2024-02-28T16:24:53.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.822+0000 7f1d26a00700 1 -- 172.21.15.23:0/2691649415 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 30) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f1d1c010380 con 0x7f1d30101440 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.823+0000 7f1d26a00700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1d1406d650 0x7f1d1406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.823+0000 7f1d26a00700 1 -- 172.21.15.23:0/2691649415 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1d1c08ccb0 con 0x7f1d30101440 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.823+0000 7f1d2de00700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1d1406d650 0x7f1d1406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.824+0000 7f1d2de00700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1d1406d650 0x7f1d1406fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d20006010 tx=0x7f1d2000b540 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:53.814 INFO:tasks.workunit.client.1.smithi153.stdout:9/993: truncate d1/d69/dbb/dbc/f121 649493 0 2024-02-28T16:24:53.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:53.828+0000 7f1d26a00700 1 -- 172.21.15.23:0/2691649415 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f1d1c05a390 con 0x7f1d30101440 2024-02-28T16:24:53.821 INFO:tasks.workunit.client.1.smithi153.stdout:9/994: rmdir d1/d7e/dd1/d147 0 2024-02-28T16:24:53.828 INFO:tasks.workunit.client.1.smithi153.stdout:9/995: mkdir d1/d58/d133/d62/d13d/d64/d85/d9a/d148 0 2024-02-28T16:24:53.830 INFO:tasks.workunit.client.1.smithi153.stdout:4/967: sync 2024-02-28T16:24:53.839 INFO:tasks.workunit.client.1.smithi153.stdout:4/968: mkdir d4/de/d23/d2b/d4b/dbf/d13a 0 2024-02-28T16:24:53.847 INFO:tasks.workunit.client.1.smithi153.stdout:9/996: rename d1/d58/d133/d20/d99/cc2 to d1/d58/d133/d62/d13d/c149 0 2024-02-28T16:24:53.854 INFO:tasks.workunit.client.1.smithi153.stdout:9/997: read d1/d69/dbb/dbc/f121 [449836,79811] 0 2024-02-28T16:24:53.858 INFO:tasks.workunit.client.1.smithi153.stdout:9/998: fsync d1/d58/d133/d43/d12e/f145 0 2024-02-28T16:24:53.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/969: write d4/de/d23/f11f [1509558,111191] 0 2024-02-28T16:24:53.871 INFO:tasks.workunit.client.1.smithi153.stdout:9/999: write d1/d58/d133/f127 [742743,126241] 0 2024-02-28T16:24:53.874 INFO:tasks.workunit.client.1.smithi153.stdout:4/970: mkdir d4/de/d23/d2b/d31/db4/d13b 0 2024-02-28T16:24:53.882 INFO:tasks.workunit.client.1.smithi153.stdout:4/971: mknod d4/de/d23/d2b/d4b/d80/d9e/def/c13c 0 2024-02-28T16:24:53.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:53 smithi153 ceph-mon[35341]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:53.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:53 smithi153 ceph-mon[35341]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:53.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:53 smithi153 ceph-mon[35341]: pgmap v16: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 137 MiB/s wr, 322 op/s 2024-02-28T16:24:53.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:53 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1370308611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:53.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:53 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/2890993805' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:24:53.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/972: write d4/d53/d7c/fe4 [519175,39906] 0 2024-02-28T16:24:53.911 INFO:tasks.workunit.client.1.smithi153.stdout:4/973: symlink d4/de/d40/d4d/d136/l13d 0 2024-02-28T16:24:53.918 INFO:tasks.workunit.client.1.smithi153.stdout:4/974: mkdir d4/de/d23/d2b/d4b/d80/d9e/d13e 0 2024-02-28T16:24:53.926 INFO:tasks.workunit.client.1.smithi153.stdout:4/975: symlink d4/de/d23/d2b/d4b/d80/l13f 0 2024-02-28T16:24:53.931 INFO:tasks.workunit.client.1.smithi153.stdout:4/976: unlink d4/de/d13/cd2 0 2024-02-28T16:24:53.935 INFO:tasks.workunit.client.1.smithi153.stdout:4/977: truncate d4/f10c 554993 0 2024-02-28T16:24:53.941 INFO:tasks.workunit.client.1.smithi153.stdout:4/978: chown d4/de/d23/d2b/d4b/da9/lc7 218042 1 2024-02-28T16:24:53.945 INFO:tasks.workunit.client.1.smithi153.stdout:4/979: stat d4/de/d23/d2b/d31/ddf/dec 0 2024-02-28T16:24:53.957 INFO:tasks.workunit.client.1.smithi153.stdout:4/980: link d4/de/d13/d1b/la8 d4/de/d47/d5e/d62/l140 0 2024-02-28T16:24:53.998 INFO:tasks.workunit.client.1.smithi153.stdout:4/981: dwrite d4/de/d23/f4a [0,4194304] 0 2024-02-28T16:24:54.003 INFO:tasks.workunit.client.1.smithi153.stdout:4/982: readlink d4/de/d23/d2b/d4b/dba/d50/l7a 0 2024-02-28T16:24:54.079 INFO:tasks.workunit.client.1.smithi153.stdout:4/983: sync 2024-02-28T16:24:54.083 INFO:tasks.workunit.client.1.smithi153.stdout:4/984: chown d4/de/d23/d2b/f63 4886 1 2024-02-28T16:24:54.096 INFO:tasks.workunit.client.1.smithi153.stdout:4/985: creat d4/de/d23/d2b/d4b/dba/f141 x:0 0 0 2024-02-28T16:24:54.101 INFO:tasks.workunit.client.1.smithi153.stdout:4/986: fsync d4/d53/f61 0 2024-02-28T16:24:54.106 INFO:tasks.workunit.client.1.smithi153.stdout:4/987: chown d4/d53/d7c/db3/f43 15430860 1 2024-02-28T16:24:54.149 INFO:tasks.workunit.client.1.smithi153.stdout:4/988: dwrite d4/f7 [0,4194304] 0 2024-02-28T16:24:54.150 INFO:tasks.workunit.client.1.smithi153.stdout:4/989: chown d4/d53 171828436 1 2024-02-28T16:24:54.153 INFO:tasks.workunit.client.1.smithi153.stdout:4/990: chown d4/de/d23/d2b/c4c 171960 1 2024-02-28T16:24:54.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.166+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d30061190 con 0x7f1d1406d650 2024-02-28T16:24:54.159 INFO:tasks.workunit.client.1.smithi153.stdout:4/991: rmdir d4/de/d23/d2b/d31/da2/da5/db2/dc2 39 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:24:54.160 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "2/23 daemons upgraded", 2024-02-28T16:24:54.161 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "", 2024-02-28T16:24:54.161 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:24:54.161 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:24:54.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.169+0000 7f1d26a00700 1 -- 172.21.15.23:0/2691649415 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f1d30061190 con 0x7f1d1406d650 2024-02-28T16:24:54.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1d1406d650 msgr2=0x7f1d1406fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1d1406d650 0x7f1d1406fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d20006010 tx=0x7f1d2000b540 comp rx=0 tx=0).stop 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30101440 msgr2=0x7f1d301982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30101440 0x7f1d301982a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00b4b0 tx=0x7f1d1c00b870 comp rx=0 tx=0).stop 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 shutdown_connections 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f1d1406d650 0x7f1d1406fb00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d30100240 0x7f1d30197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 --2- 172.21.15.23:0/2691649415 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1d30101440 0x7f1d301982a0 secure :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00b4b0 tx=0x7f1d1c00b870 comp rx=0 tx=0).stop 2024-02-28T16:24:54.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.174+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 >> 172.21.15.23:0/2691649415 conn(0x7f1d300fb7f0 msgr2=0x7f1d30102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:54.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.175+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 shutdown_connections 2024-02-28T16:24:54.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.175+0000 7f1d35200700 1 -- 172.21.15.23:0/2691649415 wait complete. 2024-02-28T16:24:54.167 INFO:tasks.workunit.client.1.smithi153.stdout:4/992: creat d4/de/d23/d2b/d31/da2/da5/f142 x:0 0 0 2024-02-28T16:24:54.173 INFO:tasks.workunit.client.1.smithi153.stdout:4/993: symlink d4/de/d23/d2b/l143 0 2024-02-28T16:24:54.202 INFO:tasks.workunit.client.1.smithi153.stdout:4/994: dread d4/de/d47/f8c [0,4194304] 0 2024-02-28T16:24:54.217 INFO:tasks.workunit.client.1.smithi153.stdout:4/995: dwrite d4/de/d23/d2b/d4b/da9/fe0 [0,4194304] 0 2024-02-28T16:24:54.219 INFO:tasks.workunit.client.1.smithi153.stdout:4/996: chown d4/de/d23/ffe 98396 1 2024-02-28T16:24:54.236 INFO:tasks.workunit.client.1.smithi153.stdout:4/997: dwrite d4/de/d23/d2b/d31/da2/f133 [0,4194304] 0 2024-02-28T16:24:54.243 INFO:tasks.workunit.client.1.smithi153.stdout:4/998: dread d4/f10c [0,4194304] 0 2024-02-28T16:24:54.266 INFO:tasks.workunit.client.1.smithi153.stdout:4/999: dwrite d4/f7 [4194304,4194304] 0 2024-02-28T16:24:54.278 INFO:tasks.workunit.client.1.smithi153.stderr:+ rm -rf -- ./tmp.a6iQeXmTmI 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.360+0000 7f3fa7400700 1 -- 172.21.15.23:0/2659869601 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 msgr2=0x7f3fa0073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.360+0000 7f3fa7400700 1 --2- 172.21.15.23:0/2659869601 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa0073c20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009910 tx=0x7f3f8c009c20 comp rx=0 tx=0).stop 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.361+0000 7f3fa7400700 1 -- 172.21.15.23:0/2659869601 shutdown_connections 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.361+0000 7f3fa7400700 1 --2- 172.21.15.23:0/2659869601 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa0073c20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.361+0000 7f3fa7400700 1 --2- 172.21.15.23:0/2659869601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa0074d80 0x7f3fa00731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.361+0000 7f3fa7400700 1 -- 172.21.15.23:0/2659869601 >> 172.21.15.23:0/2659869601 conn(0x7f3fa00fb7f0 msgr2=0x7f3fa00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.361+0000 7f3fa7400700 1 -- 172.21.15.23:0/2659869601 shutdown_connections 2024-02-28T16:24:54.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.361+0000 7f3fa7400700 1 -- 172.21.15.23:0/2659869601 wait complete. 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.362+0000 7f3fa7400700 1 Processor -- start 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.362+0000 7f3fa7400700 1 -- start start 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.363+0000 7f3fa7400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.363+0000 7f3fa7400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa0074d80 0x7f3fa019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.363+0000 7f3fa7400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019cb40 con 0x7f3fa00737b0 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.363+0000 7f3fa7400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019cc80 con 0x7f3fa0074d80 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.363+0000 7f3fa4a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.363+0000 7f3fa4a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48990/0 (socket says 172.21.15.23:48990) 2024-02-28T16:24:54.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.363+0000 7f3fa4a00700 1 -- 172.21.15.23:0/1876270310 learned_addr learned my addr 172.21.15.23:0/1876270310 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3f9fe00700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa0074d80 0x7f3fa019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3fa4a00700 1 -- 172.21.15.23:0/1876270310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa0074d80 msgr2=0x7f3fa019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3fa4a00700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa0074d80 0x7f3fa019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3fa4a00700 1 -- 172.21.15.23:0/1876270310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c0095f0 con 0x7f3fa00737b0 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3fa4a00700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa019c070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c930 tx=0x7f3f9400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3f9d600700 1 -- 172.21.15.23:0/1876270310 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f94007ad0 con 0x7f3fa00737b0 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa01a1740 con 0x7f3fa00737b0 2024-02-28T16:24:54.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.364+0000 7f3f9d600700 1 -- 172.21.15.23:0/1876270310 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f94007c30 con 0x7f3fa00737b0 2024-02-28T16:24:54.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.365+0000 7f3f9d600700 1 -- 172.21.15.23:0/1876270310 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f94018630 con 0x7f3fa00737b0 2024-02-28T16:24:54.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.365+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa01a1c60 con 0x7f3fa00737b0 2024-02-28T16:24:54.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.366+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa010f380 con 0x7f3fa00737b0 2024-02-28T16:24:54.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.367+0000 7f3f9d600700 1 -- 172.21.15.23:0/1876270310 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 30) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f3f9400f450 con 0x7f3fa00737b0 2024-02-28T16:24:54.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.368+0000 7f3f9d600700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f3f8806d650 0x7f3f8806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:54.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.368+0000 7f3f9d600700 1 -- 172.21.15.23:0/1876270310 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3f9408d3d0 con 0x7f3fa00737b0 2024-02-28T16:24:54.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.369+0000 7f3f9fe00700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f3f8806d650 0x7f3f8806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:54.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.369+0000 7f3f9fe00700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f3f8806d650 0x7f3f8806fb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c006010 tx=0x7f3f8c00b540 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:54.363 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.373+0000 7f3f9d600700 1 -- 172.21.15.23:0/1876270310 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f3f9405a9c0 con 0x7f3fa00737b0 2024-02-28T16:24:54.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.788+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3fa01a2300 con 0x7f3fa00737b0 2024-02-28T16:24:54.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.788+0000 7f3f9d600700 1 -- 172.21.15.23:0/1876270310 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3f9405a550 con 0x7f3fa00737b0 2024-02-28T16:24:54.779 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:24:54.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.791+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f3f8806d650 msgr2=0x7f3f8806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:54.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.791+0000 7f3fa7400700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f3f8806d650 0x7f3f8806fb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c006010 tx=0x7f3f8c00b540 comp rx=0 tx=0).stop 2024-02-28T16:24:54.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.791+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 msgr2=0x7f3fa019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:54.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.791+0000 7f3fa7400700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa019c070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c930 tx=0x7f3f9400ccf0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.792+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 shutdown_connections 2024-02-28T16:24:54.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.792+0000 7f3fa7400700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f3f8806d650 0x7f3f8806fb00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.792+0000 7f3fa7400700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3fa00737b0 0x7f3fa019c070 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.792+0000 7f3fa7400700 1 --2- 172.21.15.23:0/1876270310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa0074d80 0x7f3fa019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:54.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.792+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 >> 172.21.15.23:0/1876270310 conn(0x7f3fa00fb7f0 msgr2=0x7f3fa0101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:54.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.792+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 shutdown_connections 2024-02-28T16:24:54.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:24:54.792+0000 7f3fa7400700 1 -- 172.21.15.23:0/1876270310 wait complete. 2024-02-28T16:24:55.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:55 smithi153 ceph-mon[35341]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:55.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:55 smithi153 ceph-mon[35341]: pgmap v17: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 89 MiB/s rd, 203 MiB/s wr, 490 op/s 2024-02-28T16:24:55.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:55 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1876270310' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:24:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:55 smithi023 ceph-mon[29137]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:55 smithi023 ceph-mon[29137]: pgmap v17: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 89 MiB/s rd, 203 MiB/s wr, 490 op/s 2024-02-28T16:24:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:55 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1876270310' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:24:56.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:56 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:56.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:56 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:57.770 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:57 smithi023 ceph-mon[29137]: pgmap v18: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 135 MiB/s wr, 328 op/s 2024-02-28T16:24:57.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:57 smithi153 ceph-mon[35341]: pgmap v18: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 135 MiB/s wr, 328 op/s 2024-02-28T16:24:59.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:24:59 smithi023 ceph-mon[29137]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 147 MiB/s wr, 393 op/s 2024-02-28T16:24:59.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:24:59 smithi153 ceph-mon[35341]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 147 MiB/s wr, 393 op/s 2024-02-28T16:25:00.032 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T16:25:00.033 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-28T16:25:01.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:01 smithi153 ceph-mon[35341]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 78 MiB/s wr, 233 op/s 2024-02-28T16:25:01.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:01 smithi023 ceph-mon[29137]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 78 MiB/s wr, 233 op/s 2024-02-28T16:25:03.825 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:03 smithi023 ceph-mon[29137]: pgmap v21: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 78 MiB/s wr, 233 op/s 2024-02-28T16:25:03.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:03 smithi153 ceph-mon[35341]: pgmap v21: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 78 MiB/s wr, 233 op/s 2024-02-28T16:25:05.478 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:05 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:05.478 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:05 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:05.478 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:05 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:25:05.478 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:05 smithi153 ceph-mon[35341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:25:05.478 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:05 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:05.478 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:05 smithi153 ceph-mon[35341]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 36 MiB/s rd, 79 MiB/s wr, 293 op/s 2024-02-28T16:25:05.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:05 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:05.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:05 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:05.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:05 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:25:05.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:05 smithi023 ceph-mon[29137]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:25:05.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:05 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:05.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:05 smithi023 ceph-mon[29137]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 36 MiB/s rd, 79 MiB/s wr, 293 op/s 2024-02-28T16:25:07.716 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:07 smithi153 ceph-mon[35341]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 6.0 MiB/s rd, 13 MiB/s wr, 125 op/s 2024-02-28T16:25:07.716 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:07 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:25:07.716 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:07 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:25:07.716 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:07 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:07 smithi023 ceph-mon[29137]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 6.0 MiB/s rd, 13 MiB/s wr, 125 op/s 2024-02-28T16:25:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:07 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:25:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:07 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:25:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:07 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:08.773 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:08 smithi153 ceph-mon[35341]: Upgrade: Updating mgr.smithi153.qlkchp 2024-02-28T16:25:08.773 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:08 smithi153 ceph-mon[35341]: Deploying daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:25:08.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:08 smithi023 ceph-mon[29137]: Upgrade: Updating mgr.smithi153.qlkchp 2024-02-28T16:25:08.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:08 smithi023 ceph-mon[29137]: Deploying daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:25:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:09 smithi153 ceph-mon[35341]: pgmap v24: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 6.0 MiB/s rd, 13 MiB/s wr, 199 op/s 2024-02-28T16:25:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:09 smithi023 ceph-mon[29137]: pgmap v24: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 6.0 MiB/s rd, 13 MiB/s wr, 199 op/s 2024-02-28T16:25:11.875 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:11 smithi153 ceph-mon[35341]: pgmap v25: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 16 KiB/s rd, 808 KiB/s wr, 133 op/s 2024-02-28T16:25:11.875 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:11 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:11.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:11 smithi023 ceph-mon[29137]: pgmap v25: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 16 KiB/s rd, 808 KiB/s wr, 133 op/s 2024-02-28T16:25:11.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:11 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:13.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:13 smithi153 ceph-mon[35341]: pgmap v26: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 16 KiB/s rd, 808 KiB/s wr, 133 op/s 2024-02-28T16:25:13.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:13 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:13.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:13 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:13.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:13 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:13.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:13 smithi023 ceph-mon[29137]: pgmap v26: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 16 KiB/s rd, 808 KiB/s wr, 133 op/s 2024-02-28T16:25:13.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:13 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:13.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:13 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:13.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:13 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:15.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:15 smithi153 ceph-mon[35341]: pgmap v27: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 211 op/s 2024-02-28T16:25:15.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:15 smithi023 ceph-mon[29137]: pgmap v27: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 211 op/s 2024-02-28T16:25:17.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:17 smithi023 ceph-mon[29137]: pgmap v28: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 18 KiB/s rd, 735 KiB/s wr, 151 op/s 2024-02-28T16:25:17.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:17 smithi153 ceph-mon[35341]: pgmap v28: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 18 KiB/s rd, 735 KiB/s wr, 151 op/s 2024-02-28T16:25:18.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:18 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:18.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:18 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:18.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:18 smithi023 ceph-mon[29137]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 229 op/s 2024-02-28T16:25:19.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:18 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:18 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:18 smithi153 ceph-mon[35341]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 229 op/s 2024-02-28T16:25:20.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:20 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:20.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:20 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:20.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:20 smithi153 ceph-mon[35341]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 16 KiB/s rd, 716 KiB/s wr, 155 op/s 2024-02-28T16:25:21.004 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:20 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:21.004 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:20 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:21.005 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:20 smithi023 ceph-mon[29137]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 16 KiB/s rd, 716 KiB/s wr, 155 op/s 2024-02-28T16:25:23.628 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:23 smithi023 ceph-mon[29137]: pgmap v31: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 16 KiB/s rd, 716 KiB/s wr, 155 op/s 2024-02-28T16:25:23.628 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:23 smithi023 ceph-mon[29137]: Standby manager daemon smithi153.qlkchp restarted 2024-02-28T16:25:23.629 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:23 smithi023 ceph-mon[29137]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:25:23.629 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:23 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:25:23.629 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:23 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:23.629 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:23 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:25:23.629 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:23 smithi023 ceph-mon[29137]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:23.778 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:23 smithi153 ceph-mon[35341]: pgmap v31: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 16 KiB/s rd, 716 KiB/s wr, 155 op/s 2024-02-28T16:25:23.778 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:23 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp restarted 2024-02-28T16:25:23.778 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:23 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:25:23.778 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:23 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:25:23.778 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:23 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:23.778 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:23 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:25:23.778 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:23 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4202584638' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:24.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: mgrmap e31: smithi023.bbebnt(active, since 57s), standbys: smithi153.qlkchp 2024-02-28T16:25:24.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:24.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:25:24.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:24 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.927 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: mgrmap e31: smithi023.bbebnt(active, since 57s), standbys: smithi153.qlkchp 2024-02-28T16:25:24.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:24.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:24.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:25:24.928 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:24 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:25.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 -- 172.21.15.23:0/844078631 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc0737b0 msgr2=0x7f8bcc073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 --2- 172.21.15.23:0/844078631 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc0737b0 0x7f8bcc073c20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009910 tx=0x7f8bbc009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:25.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 -- 172.21.15.23:0/844078631 shutdown_connections 2024-02-28T16:25:25.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 --2- 172.21.15.23:0/844078631 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc0737b0 0x7f8bcc073c20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 --2- 172.21.15.23:0/844078631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bcc074d80 0x7f8bcc0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 -- 172.21.15.23:0/844078631 >> 172.21.15.23:0/844078631 conn(0x7f8bcc0fb7f0 msgr2=0x7f8bcc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:25.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 -- 172.21.15.23:0/844078631 shutdown_connections 2024-02-28T16:25:25.007 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.016+0000 7f8bd3600700 1 -- 172.21.15.23:0/844078631 wait complete. 2024-02-28T16:25:25.007 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.017+0000 7f8bd3600700 1 Processor -- start 2024-02-28T16:25:25.007 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.018+0000 7f8bd3600700 1 -- start start 2024-02-28T16:25:25.008 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.018+0000 7f8bd3600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bcc0737b0 0x7f8bcc071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.008 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.018+0000 7f8bd3600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc074d80 0x7f8bcc072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.008 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.018+0000 7f8bd3600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc072920 con 0x7f8bcc074d80 2024-02-28T16:25:25.008 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.018+0000 7f8bd3600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc072a60 con 0x7f8bcc0737b0 2024-02-28T16:25:25.008 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.019+0000 7f8bc3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc074d80 0x7f8bcc072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.008 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.019+0000 7f8bc3e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc074d80 0x7f8bcc072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43716/0 (socket says 172.21.15.23:43716) 2024-02-28T16:25:25.009 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.019+0000 7f8bc3e00700 1 -- 172.21.15.23:0/2435782607 learned_addr learned my addr 172.21.15.23:0/2435782607 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:25.009 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.019+0000 7f8bd0c00700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bcc0737b0 0x7f8bcc071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.009 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.019+0000 7f8bc3e00700 1 -- 172.21.15.23:0/2435782607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bcc0737b0 msgr2=0x7f8bcc071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.019+0000 7f8bc3e00700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bcc0737b0 0x7f8bcc071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.019+0000 7f8bc3e00700 1 -- 172.21.15.23:0/2435782607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0095f0 con 0x7f8bcc074d80 2024-02-28T16:25:25.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.020+0000 7f8bc3e00700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc074d80 0x7f8bcc072300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00bd70 tx=0x7f8bbc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.021+0000 7f8bca000700 1 -- 172.21.15.23:0/2435782607 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bbc01d070 con 0x7f8bcc074d80 2024-02-28T16:25:25.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.021+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc1aa000 con 0x7f8bcc074d80 2024-02-28T16:25:25.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.021+0000 7f8bca000700 1 -- 172.21.15.23:0/2435782607 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8bbc005dc0 con 0x7f8bcc074d80 2024-02-28T16:25:25.011 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.021+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc1aa4f0 con 0x7f8bcc074d80 2024-02-28T16:25:25.011 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.021+0000 7f8bca000700 1 -- 172.21.15.23:0/2435782607 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bbc021410 con 0x7f8bcc074d80 2024-02-28T16:25:25.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.022+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba8005320 con 0x7f8bcc074d80 2024-02-28T16:25:25.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.023+0000 7f8bca000700 1 -- 172.21.15.23:0/2435782607 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 31) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f8bbc02b440 con 0x7f8bcc074d80 2024-02-28T16:25:25.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.025+0000 7f8bca000700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f8bac06d660 0x7f8bac06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.025+0000 7f8bca000700 1 -- 172.21.15.23:0/2435782607 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8bbc08e320 con 0x7f8bcc074d80 2024-02-28T16:25:25.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.026+0000 7f8bd0c00700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f8bac06d660 0x7f8bac06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.027+0000 7f8bd0c00700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f8bac06d660 0x7f8bac06fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005950 tx=0x7f8bb400b410 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.032+0000 7f8bca000700 1 -- 172.21.15.23:0/2435782607 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f8bbc05b9f0 con 0x7f8bcc074d80 2024-02-28T16:25:25.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.383+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ba8000bf0 con 0x7f8bac06d660 2024-02-28T16:25:25.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.384+0000 7f8bca000700 1 -- 172.21.15.23:0/2435782607 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8ba8000bf0 con 0x7f8bac06d660 2024-02-28T16:25:25.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f8bac06d660 msgr2=0x7f8bac06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f8bac06d660 0x7f8bac06fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005950 tx=0x7f8bb400b410 comp rx=0 tx=0).stop 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc074d80 msgr2=0x7f8bcc072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc074d80 0x7f8bcc072300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00bd70 tx=0x7f8bbc00bda0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 shutdown_connections 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f8bac06d660 0x7f8bac06fb10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bcc0737b0 0x7f8bcc071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 --2- 172.21.15.23:0/2435782607 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8bcc074d80 0x7f8bcc072300 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.387+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 >> 172.21.15.23:0/2435782607 conn(0x7f8bcc0fb7f0 msgr2=0x7f8bcc101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.388+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 shutdown_connections 2024-02-28T16:25:25.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.388+0000 7f8bd3600700 1 -- 172.21.15.23:0/2435782607 wait complete. 2024-02-28T16:25:25.398 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: pgmap v32: 65 pgs: 65 active+clean; 808 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 231 op/s 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi023.bbebnt"}]: dispatch 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi023.bbebnt"}]': finished 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.qlkchp"}]: dispatch 2024-02-28T16:25:25.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.qlkchp"}]': finished 2024-02-28T16:25:25.574 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:25 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:25:25.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.582+0000 7f7db9a00700 1 -- 172.21.15.23:0/1282592058 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 msgr2=0x7f7db4105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.582+0000 7f7db9a00700 1 --2- 172.21.15.23:0/1282592058 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 0x7f7db4105a60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009910 tx=0x7f7da0009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:25.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.583+0000 7f7db9a00700 1 -- 172.21.15.23:0/1282592058 shutdown_connections 2024-02-28T16:25:25.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.583+0000 7f7db9a00700 1 --2- 172.21.15.23:0/1282592058 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 0x7f7db4105a60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.583+0000 7f7db9a00700 1 --2- 172.21.15.23:0/1282592058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db4100d60 0x7f7db4103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.583+0000 7f7db9a00700 1 -- 172.21.15.23:0/1282592058 >> 172.21.15.23:0/1282592058 conn(0x7f7db40fa780 msgr2=0x7f7db40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:25.574 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.583+0000 7f7db9a00700 1 -- 172.21.15.23:0/1282592058 shutdown_connections 2024-02-28T16:25:25.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.583+0000 7f7db9a00700 1 -- 172.21.15.23:0/1282592058 wait complete. 2024-02-28T16:25:25.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.586+0000 7f7db9a00700 1 Processor -- start 2024-02-28T16:25:25.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.586+0000 7f7db9a00700 1 -- start start 2024-02-28T16:25:25.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.587+0000 7f7db9a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db4100d60 0x7f7db4195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.587+0000 7f7db9a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 0x7f7db4196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.587+0000 7f7db9a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db41966a0 con 0x7f7db4103680 2024-02-28T16:25:25.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.587+0000 7f7db9a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db41967e0 con 0x7f7db4100d60 2024-02-28T16:25:25.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.587+0000 7f7db2000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 0x7f7db4196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.587+0000 7f7db2a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db4100d60 0x7f7db4195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.588+0000 7f7db2a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db4100d60 0x7f7db4195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:50866/0 (socket says 172.21.15.23:50866) 2024-02-28T16:25:25.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.588+0000 7f7db2a00700 1 -- 172.21.15.23:0/3642666595 learned_addr learned my addr 172.21.15.23:0/3642666595 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:25.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.589+0000 7f7db2000700 1 -- 172.21.15.23:0/3642666595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db4100d60 msgr2=0x7f7db4195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.589+0000 7f7db2000700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db4100d60 0x7f7db4195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.589+0000 7f7db2000700 1 -- 172.21.15.23:0/3642666595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da00095f0 con 0x7f7db4103680 2024-02-28T16:25:25.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.589+0000 7f7db2000700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 0x7f7db4196080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009910 tx=0x7f7da000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.579 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.589+0000 7f7dab400700 1 -- 172.21.15.23:0/3642666595 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da001d070 con 0x7f7db4103680 2024-02-28T16:25:25.579 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.590+0000 7f7dab400700 1 -- 172.21.15.23:0/3642666595 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7da000f460 con 0x7f7db4103680 2024-02-28T16:25:25.579 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.590+0000 7f7dab400700 1 -- 172.21.15.23:0/3642666595 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da0021620 con 0x7f7db4103680 2024-02-28T16:25:25.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.590+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db40fec90 con 0x7f7db4103680 2024-02-28T16:25:25.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.590+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db40ff180 con 0x7f7db4103680 2024-02-28T16:25:25.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.592+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db418fc60 con 0x7f7db4103680 2024-02-28T16:25:25.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.595+0000 7f7dab400700 1 -- 172.21.15.23:0/3642666595 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 31) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f7da000fa60 con 0x7f7db4103680 2024-02-28T16:25:25.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.597+0000 7f7dab400700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f7d9806d650 0x7f7d9806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.597+0000 7f7dab400700 1 -- 172.21.15.23:0/3642666595 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7da008e7c0 con 0x7f7db4103680 2024-02-28T16:25:25.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.597+0000 7f7db2a00700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f7d9806d650 0x7f7d9806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.587 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.598+0000 7f7db2a00700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f7d9806d650 0x7f7d9806fb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009aa0 tx=0x7f7da4009240 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.591 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.602+0000 7f7dab400700 1 -- 172.21.15.23:0/3642666595 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f7da005bff0 con 0x7f7db4103680 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: pgmap v32: 65 pgs: 65 active+clean; 808 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 231 op/s 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi023.bbebnt"}]: dispatch 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi023.bbebnt"}]': finished 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.qlkchp"}]: dispatch 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.qlkchp"}]': finished 2024-02-28T16:25:25.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:25 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:25:25.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.979+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7db4100650 con 0x7f7d9806d650 2024-02-28T16:25:25.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.981+0000 7f7dab400700 1 -- 172.21.15.23:0/3642666595 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7db4100650 con 0x7f7d9806d650 2024-02-28T16:25:25.973 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f7d9806d650 msgr2=0x7f7d9806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.973 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f7d9806d650 0x7f7d9806fb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009aa0 tx=0x7f7da4009240 comp rx=0 tx=0).stop 2024-02-28T16:25:25.973 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 msgr2=0x7f7db4196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.973 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 0x7f7db4196080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009910 tx=0x7f7da000bd70 comp rx=0 tx=0).stop 2024-02-28T16:25:25.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 shutdown_connections 2024-02-28T16:25:25.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f7d9806d650 0x7f7d9806fb00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db4100d60 0x7f7db4195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 --2- 172.21.15.23:0/3642666595 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7db4103680 0x7f7db4196080 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.984+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 >> 172.21.15.23:0/3642666595 conn(0x7f7db40fa780 msgr2=0x7f7db40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:25.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.985+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 shutdown_connections 2024-02-28T16:25:25.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:25.985+0000 7f7db9a00700 1 -- 172.21.15.23:0/3642666595 wait complete. 2024-02-28T16:25:26.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 -- 172.21.15.23:0/1305518293 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 msgr2=0x7f4a08100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 --2- 172.21.15.23:0/1305518293 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08100660 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009910 tx=0x7f49f8009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:26.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 -- 172.21.15.23:0/1305518293 shutdown_connections 2024-02-28T16:25:26.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 --2- 172.21.15.23:0/1305518293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a08101450 0x7f4a081018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 --2- 172.21.15.23:0/1305518293 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08100660 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 -- 172.21.15.23:0/1305518293 >> 172.21.15.23:0/1305518293 conn(0x7f4a080fb7e0 msgr2=0x7f4a080fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:26.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 -- 172.21.15.23:0/1305518293 shutdown_connections 2024-02-28T16:25:26.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.186+0000 7f4a0da00700 1 -- 172.21.15.23:0/1305518293 wait complete. 2024-02-28T16:25:26.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.187+0000 7f4a0da00700 1 Processor -- start 2024-02-28T16:25:26.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.187+0000 7f4a0da00700 1 -- start start 2024-02-28T16:25:26.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a0da00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a0da00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a08101450 0x7f4a08073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a0da00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08073680 con 0x7f4a08100250 2024-02-28T16:25:26.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a0da00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080737c0 con 0x7f4a08101450 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a06a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a06a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43762/0 (socket says 172.21.15.23:43762) 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a06a00700 1 -- 172.21.15.23:0/219292986 learned_addr learned my addr 172.21.15.23:0/219292986 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a06a00700 1 -- 172.21.15.23:0/219292986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a08101450 msgr2=0x7f4a08073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a06a00700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a08101450 0x7f4a08073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.188+0000 7f4a06a00700 1 -- 172.21.15.23:0/219292986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80095f0 con 0x7f4a08100250 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.189+0000 7f4a06a00700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08074af0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f49f800bd70 tx=0x7f49f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.189+0000 7f49ff400700 1 -- 172.21.15.23:0/219292986 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f801d070 con 0x7f4a08100250 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.189+0000 7f49ff400700 1 -- 172.21.15.23:0/219292986 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49f800f460 con 0x7f4a08100250 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.189+0000 7f49ff400700 1 -- 172.21.15.23:0/219292986 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f8021640 con 0x7f4a08100250 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.189+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a08073a40 con 0x7f4a08100250 2024-02-28T16:25:26.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.189+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a08073ee0 con 0x7f4a08100250 2024-02-28T16:25:26.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.190+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a08108e20 con 0x7f4a08100250 2024-02-28T16:25:26.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.193+0000 7f49ff400700 1 -- 172.21.15.23:0/219292986 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 31) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f49f800fab0 con 0x7f4a08100250 2024-02-28T16:25:26.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.194+0000 7f49ff400700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f49ec06d6a0 0x7f49ec06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.194+0000 7f49ff400700 1 -- 172.21.15.23:0/219292986 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f49f808ea50 con 0x7f4a08100250 2024-02-28T16:25:26.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.194+0000 7f4a06000700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f49ec06d6a0 0x7f49ec06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:26.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.195+0000 7f4a06000700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f49ec06d6a0 0x7f49ec06fb50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49f40097b0 tx=0x7f49f4006d20 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:26.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.200+0000 7f49ff400700 1 -- 172.21.15.23:0/219292986 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f49f805c0a0 con 0x7f4a08100250 2024-02-28T16:25:26.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.514+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a0819e050 con 0x7f49ec06d6a0 2024-02-28T16:25:26.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.539+0000 7f49ff400700 1 -- 172.21.15.23:0/219292986 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4a0819e050 con 0x7f49ec06d6a0 2024-02-28T16:25:26.529 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:25:26.529 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (10m) 2s ago 12m 14.1M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:25:26.529 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (12m) 2s ago 12m 7880k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:25:26.529 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (11m) 8s ago 11m 7562k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (12m) 2s ago 12m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (11m) 8s ago 11m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (10m) 2s ago 11m 75.5M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (5m) 2s ago 5m 210M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (5m) 2s ago 5m 14.3M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (5m) 8s ago 5m 14.5M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (5m) 8s ago 5m 14.5M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (102s) 2s ago 14m 492M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (14s) 8s ago 11m 64.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (14m) 2s ago 14m 55.5M 2048M 18.2.0 dc2bc1663786 f10b6843c8c2 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (10m) 8s ago 10m 43.9M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (12m) 2s ago 12m 8238k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (11m) 8s ago 11m 7772k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (9m) 2s ago 9m 209M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (9m) 2s ago 9m 225M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:25:26.530 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (8m) 2s ago 8m 182M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:25:26.531 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (8m) 8s ago 8m 252M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:25:26.531 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (7m) 8s ago 7m 221M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:25:26.531 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (6m) 8s ago 6m 224M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:25:26.531 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (22s) 2s ago 11m 45.3M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:25:26.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f49ec06d6a0 msgr2=0x7f49ec06fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f49ec06d6a0 0x7f49ec06fb50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49f40097b0 tx=0x7f49f4006d20 comp rx=0 tx=0).stop 2024-02-28T16:25:26.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 msgr2=0x7f4a08074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08074af0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f49f800bd70 tx=0x7f49f800be50 comp rx=0 tx=0).stop 2024-02-28T16:25:26.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 shutdown_connections 2024-02-28T16:25:26.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f49ec06d6a0 0x7f49ec06fb50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a08100250 0x7f4a08074af0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 --2- 172.21.15.23:0/219292986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a08101450 0x7f4a08073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.543+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 >> 172.21.15.23:0/219292986 conn(0x7f4a080fb7e0 msgr2=0x7f4a08104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:26.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.544+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 shutdown_connections 2024-02-28T16:25:26.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.544+0000 7f4a0da00700 1 -- 172.21.15.23:0/219292986 wait complete. 2024-02-28T16:25:26.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.765+0000 7f32ee800700 1 -- 172.21.15.23:0/3470842737 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f32e8069270 msgr2=0x7f32e81051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.755 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.765+0000 7f32ee800700 1 --2- 172.21.15.23:0/3470842737 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f32e8069270 0x7f32e81051d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009910 tx=0x7f32d8009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:26.755 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:26 smithi023 ceph-mon[29137]: Upgrade: Setting container_image for all mgr 2024-02-28T16:25:26.755 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:26 smithi023 ceph-mon[29137]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:26.755 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:26 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:26.756 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.766+0000 7f32ee800700 1 -- 172.21.15.23:0/3470842737 shutdown_connections 2024-02-28T16:25:26.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.766+0000 7f32ee800700 1 --2- 172.21.15.23:0/3470842737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 0x7f32e8107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.766+0000 7f32ee800700 1 --2- 172.21.15.23:0/3470842737 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f32e8069270 0x7f32e81051d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.766+0000 7f32ee800700 1 -- 172.21.15.23:0/3470842737 >> 172.21.15.23:0/3470842737 conn(0x7f32e80fa780 msgr2=0x7f32e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:26.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.767+0000 7f32ee800700 1 -- 172.21.15.23:0/3470842737 shutdown_connections 2024-02-28T16:25:26.757 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.767+0000 7f32ee800700 1 -- 172.21.15.23:0/3470842737 wait complete. 2024-02-28T16:25:26.758 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.769+0000 7f32ee800700 1 Processor -- start 2024-02-28T16:25:26.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.769+0000 7f32ee800700 1 -- start start 2024-02-28T16:25:26.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.770+0000 7f32ee800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 0x7f32e8104730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.759 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.770+0000 7f32ee800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f32e8104c70 0x7f32e8101190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.770+0000 7f32ee800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e81016d0 con 0x7f32e8104c70 2024-02-28T16:25:26.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.770+0000 7f32ee800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8101840 con 0x7f32e8105710 2024-02-28T16:25:26.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.771+0000 7f32e7400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 0x7f32e8104730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:26.760 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.771+0000 7f32e7400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 0x7f32e8104730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:50902/0 (socket says 172.21.15.23:50902) 2024-02-28T16:25:26.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.771+0000 7f32e7400700 1 -- 172.21.15.23:0/670788017 learned_addr learned my addr 172.21.15.23:0/670788017 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:26.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.771+0000 7f32e7400700 1 -- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f32e8104c70 msgr2=0x7f32e8101190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.771+0000 7f32e7400700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f32e8104c70 0x7f32e8101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.761 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.771+0000 7f32e7400700 1 -- 172.21.15.23:0/670788017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d80095f0 con 0x7f32e8105710 2024-02-28T16:25:26.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.772+0000 7f32e7400700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 0x7f32e8104730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32d8006010 tx=0x7f32d800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:26.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.772+0000 7f32dfe00700 1 -- 172.21.15.23:0/670788017 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d801d070 con 0x7f32e8105710 2024-02-28T16:25:26.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.772+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e8101a60 con 0x7f32e8105710 2024-02-28T16:25:26.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.773+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e81a2130 con 0x7f32e8105710 2024-02-28T16:25:26.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.773+0000 7f32dfe00700 1 -- 172.21.15.23:0/670788017 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32d800f460 con 0x7f32e8105710 2024-02-28T16:25:26.763 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.773+0000 7f32dfe00700 1 -- 172.21.15.23:0/670788017 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d8022630 con 0x7f32e8105710 2024-02-28T16:25:26.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.775+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e8191dd0 con 0x7f32e8105710 2024-02-28T16:25:26.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.776+0000 7f32dfe00700 1 -- 172.21.15.23:0/670788017 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 31) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f32d800fa40 con 0x7f32e8105710 2024-02-28T16:25:26.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.777+0000 7f32dfe00700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f32cc06d6f0 0x7f32cc06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.777+0000 7f32dfe00700 1 -- 172.21.15.23:0/670788017 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f32d808e4d0 con 0x7f32e8105710 2024-02-28T16:25:26.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.778+0000 7f32e6a00700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f32cc06d6f0 0x7f32cc06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:26.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.781+0000 7f32e6a00700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f32cc06d6f0 0x7f32cc06fba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32d0005950 tx=0x7f32d00058e0 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:26.774 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:26.785+0000 7f32dfe00700 1 -- 172.21.15.23:0/670788017 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f32d805baa0 con 0x7f32e8105710 2024-02-28T16:25:26.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:26 smithi153 ceph-mon[35341]: Upgrade: Setting container_image for all mgr 2024-02-28T16:25:26.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:26 smithi153 ceph-mon[35341]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:26.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:26 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:27.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.192+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f32e802cf70 con 0x7f32e8105710 2024-02-28T16:25:27.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.194+0000 7f32dfe00700 1 -- 172.21.15.23:0/670788017 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f32d805b630 con 0x7f32e8105710 2024-02-28T16:25:27.183 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:25:27.183 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:25:27.183 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-28T16:25:27.183 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:25:27.184 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:25:27.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f32cc06d6f0 msgr2=0x7f32cc06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:27.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f32cc06d6f0 0x7f32cc06fba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32d0005950 tx=0x7f32d00058e0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 msgr2=0x7f32e8104730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:27.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 0x7f32e8104730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32d8006010 tx=0x7f32d800be20 comp rx=0 tx=0).stop 2024-02-28T16:25:27.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 shutdown_connections 2024-02-28T16:25:27.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f32cc06d6f0 0x7f32cc06fba0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e8105710 0x7f32e8104730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 --2- 172.21.15.23:0/670788017 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f32e8104c70 0x7f32e8101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 >> 172.21.15.23:0/670788017 conn(0x7f32e80fa780 msgr2=0x7f32e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:27.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 shutdown_connections 2024-02-28T16:25:27.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.197+0000 7f32ee800700 1 -- 172.21.15.23:0/670788017 wait complete. 2024-02-28T16:25:27.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 -- 172.21.15.23:0/3523875336 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 msgr2=0x7f9b4c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:27.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 --2- 172.21.15.23:0/3523875336 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c100650 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009910 tx=0x7f9b3c009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:27.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 -- 172.21.15.23:0/3523875336 shutdown_connections 2024-02-28T16:25:27.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 --2- 172.21.15.23:0/3523875336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b4c101440 0x7f9b4c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 --2- 172.21.15.23:0/3523875336 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c100650 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 -- 172.21.15.23:0/3523875336 >> 172.21.15.23:0/3523875336 conn(0x7f9b4c0fb7f0 msgr2=0x7f9b4c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:27.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 -- 172.21.15.23:0/3523875336 shutdown_connections 2024-02-28T16:25:27.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.386+0000 7f9b52600700 1 -- 172.21.15.23:0/3523875336 wait complete. 2024-02-28T16:25:27.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.387+0000 7f9b52600700 1 Processor -- start 2024-02-28T16:25:27.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.388+0000 7f9b52600700 1 -- start start 2024-02-28T16:25:27.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.388+0000 7f9b52600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:27.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.388+0000 7f9b52600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b4c101440 0x7f9b4c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:27.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.388+0000 7f9b52600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1987f0 con 0x7f9b4c100240 2024-02-28T16:25:27.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.388+0000 7f9b52600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c198960 con 0x7f9b4c101440 2024-02-28T16:25:27.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.388+0000 7f9b4b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:27.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.389+0000 7f9b4b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43808/0 (socket says 172.21.15.23:43808) 2024-02-28T16:25:27.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.389+0000 7f9b4b400700 1 -- 172.21.15.23:0/1167642312 learned_addr learned my addr 172.21.15.23:0/1167642312 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:27.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.389+0000 7f9b4aa00700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b4c101440 0x7f9b4c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:27.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.389+0000 7f9b4b400700 1 -- 172.21.15.23:0/1167642312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b4c101440 msgr2=0x7f9b4c1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:27.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.389+0000 7f9b4b400700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b4c101440 0x7f9b4c1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.389+0000 7f9b4b400700 1 -- 172.21.15.23:0/1167642312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0095f0 con 0x7f9b4c100240 2024-02-28T16:25:27.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.390+0000 7f9b4b400700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c197cb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00bd70 tx=0x7f9b3c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:27.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.390+0000 7f9b43e00700 1 -- 172.21.15.23:0/1167642312 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b3c01d070 con 0x7f9b4c100240 2024-02-28T16:25:27.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.390+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c19d390 con 0x7f9b4c100240 2024-02-28T16:25:27.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.390+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c19d880 con 0x7f9b4c100240 2024-02-28T16:25:27.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.390+0000 7f9b43e00700 1 -- 172.21.15.23:0/1167642312 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b3c00f460 con 0x7f9b4c100240 2024-02-28T16:25:27.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.390+0000 7f9b43e00700 1 -- 172.21.15.23:0/1167642312 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b3c021620 con 0x7f9b4c100240 2024-02-28T16:25:27.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.392+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c005320 con 0x7f9b4c100240 2024-02-28T16:25:27.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.393+0000 7f9b43e00700 1 -- 172.21.15.23:0/1167642312 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 31) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f9b3c00f5d0 con 0x7f9b4c100240 2024-02-28T16:25:27.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.394+0000 7f9b43e00700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f9b3006d660 0x7f9b3006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:27.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.394+0000 7f9b43e00700 1 -- 172.21.15.23:0/1167642312 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9b3c08e430 con 0x7f9b4c100240 2024-02-28T16:25:27.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.395+0000 7f9b4aa00700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f9b3006d660 0x7f9b3006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:27.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.396+0000 7f9b4aa00700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f9b3006d660 0x7f9b3006fb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c1991c0 tx=0x7f9b3800a300 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:27.389 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.399+0000 7f9b43e00700 1 -- 172.21.15.23:0/1167642312 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f9b3c057ef0 con 0x7f9b4c100240 2024-02-28T16:25:27.824 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.834+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b2c005cc0 con 0x7f9b4c100240 2024-02-28T16:25:27.824 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:27.824 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: pgmap v33: 65 pgs: 65 active+clean; 808 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 17 KiB/s rd, 814 KiB/s wr, 154 op/s 2024-02-28T16:25:27.824 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:27.825 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/670788017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:25:27.825 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:27.825 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:25:27.825 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:25:27.825 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:27 smithi023 ceph-mon[29137]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:27.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.845+0000 7f9b43e00700 1 -- 172.21.15.23:0/1167642312 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7f9b3c05b5b0 con 0x7f9b4c100240 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:25:27.836 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:25:27.837 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:27.838 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:27.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.849+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f9b3006d660 msgr2=0x7f9b3006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.849+0000 7f9b52600700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f9b3006d660 0x7f9b3006fb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c1991c0 tx=0x7f9b3800a300 comp rx=0 tx=0).stop 2024-02-28T16:25:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.849+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 msgr2=0x7f9b4c197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:27.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.849+0000 7f9b52600700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c197cb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00bd70 tx=0x7f9b3c00bda0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.851+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 shutdown_connections 2024-02-28T16:25:27.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.851+0000 7f9b52600700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f9b3006d660 0x7f9b3006fb10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.851+0000 7f9b52600700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9b4c100240 0x7f9b4c197cb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.852+0000 7f9b52600700 1 --2- 172.21.15.23:0/1167642312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b4c101440 0x7f9b4c1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:27.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.852+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 >> 172.21.15.23:0/1167642312 conn(0x7f9b4c0fb7f0 msgr2=0x7f9b4c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:27.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.853+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 shutdown_connections 2024-02-28T16:25:27.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:27.853+0000 7f9b52600700 1 -- 172.21.15.23:0/1167642312 wait complete. 2024-02-28T16:25:27.848 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: pgmap v33: 65 pgs: 65 active+clean; 808 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 17 KiB/s rd, 814 KiB/s wr, 154 op/s 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/670788017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:25:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:27 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:28.065 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.076+0000 7fa37be00700 1 -- 172.21.15.23:0/2969533178 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 msgr2=0x7fa37c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:28.065 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.076+0000 7fa37be00700 1 --2- 172.21.15.23:0/2969533178 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c102ef0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009910 tx=0x7fa36c009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:28.066 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.076+0000 7fa37be00700 1 -- 172.21.15.23:0/2969533178 shutdown_connections 2024-02-28T16:25:28.066 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.076+0000 7fa37be00700 1 --2- 172.21.15.23:0/2969533178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c103430 0x7fa37c105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.066 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.076+0000 7fa37be00700 1 --2- 172.21.15.23:0/2969533178 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c102ef0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.066 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.076+0000 7fa37be00700 1 -- 172.21.15.23:0/2969533178 >> 172.21.15.23:0/2969533178 conn(0x7fa37c0fa4d0 msgr2=0x7fa37c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:28.066 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.076+0000 7fa37be00700 1 -- 172.21.15.23:0/2969533178 shutdown_connections 2024-02-28T16:25:28.066 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.077+0000 7fa37be00700 1 -- 172.21.15.23:0/2969533178 wait complete. 2024-02-28T16:25:28.067 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.078+0000 7fa37be00700 1 Processor -- start 2024-02-28T16:25:28.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.078+0000 7fa37be00700 1 -- start start 2024-02-28T16:25:28.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:28.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37be00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c103430 0x7fa37c0feac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:28.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37be00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0ff000 con 0x7fa37c100b10 2024-02-28T16:25:28.068 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37be00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0ff140 con 0x7fa37c103430 2024-02-28T16:25:28.069 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:28.069 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43824/0 (socket says 172.21.15.23:43824) 2024-02-28T16:25:28.069 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37aa00700 1 -- 172.21.15.23:0/3001003439 learned_addr learned my addr 172.21.15.23:0/3001003439 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:28.069 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.079+0000 7fa37a000700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c103430 0x7fa37c0feac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:28.070 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.080+0000 7fa37aa00700 1 -- 172.21.15.23:0/3001003439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c103430 msgr2=0x7fa37c0feac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:28.070 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.080+0000 7fa37aa00700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c103430 0x7fa37c0feac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.070 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.080+0000 7fa37aa00700 1 -- 172.21.15.23:0/3001003439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0095f0 con 0x7fa37c100b10 2024-02-28T16:25:28.070 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.080+0000 7fa37aa00700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c100470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa36c005b40 tx=0x7fa36c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:28.070 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.081+0000 7fa373400700 1 -- 172.21.15.23:0/3001003439 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36c01d070 con 0x7fa37c100b10 2024-02-28T16:25:28.070 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.081+0000 7fa373400700 1 -- 172.21.15.23:0/3001003439 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa36c00f460 con 0x7fa37c100b10 2024-02-28T16:25:28.070 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.081+0000 7fa373400700 1 -- 172.21.15.23:0/3001003439 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36c021620 con 0x7fa37c100b10 2024-02-28T16:25:28.071 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.081+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c0ff3c0 con 0x7fa37c100b10 2024-02-28T16:25:28.071 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.082+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c0ff8b0 con 0x7fa37c100b10 2024-02-28T16:25:28.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.083+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c18fa40 con 0x7fa37c100b10 2024-02-28T16:25:28.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.084+0000 7fa373400700 1 -- 172.21.15.23:0/3001003439 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 31) v1 ==== 91440+0+0 (secure 0 0 0) 0x7fa36c00fa40 con 0x7fa37c100b10 2024-02-28T16:25:28.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.086+0000 7fa373400700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fa36006d650 0x7fa36006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:28.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.086+0000 7fa373400700 1 -- 172.21.15.23:0/3001003439 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa36c08e4b0 con 0x7fa37c100b10 2024-02-28T16:25:28.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.086+0000 7fa37a000700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fa36006d650 0x7fa36006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:28.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.087+0000 7fa37a000700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fa36006d650 0x7fa36006fb00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa368005950 tx=0x7fa36800b410 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:28.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.091+0000 7fa373400700 1 -- 172.21.15.23:0/3001003439 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fa36c05ba80 con 0x7fa37c100b10 2024-02-28T16:25:28.190 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T16:25:28.190 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-28T16:25:28.408 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.416+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 --> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa37c061190 con 0x7fa36006d650 2024-02-28T16:25:28.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.418+0000 7fa373400700 1 -- 172.21.15.23:0/3001003439 <== mgr.24443 v2:172.21.15.23:6800/877826779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa37c061190 con 0x7fa36006d650 2024-02-28T16:25:28.422 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:25:28.422 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:25:28.422 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:25:28.422 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:25:28.422 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:25:28.423 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:25:28.423 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:25:28.423 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "2/23 daemons upgraded", 2024-02-28T16:25:28.423 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T16:25:28.423 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:25:28.423 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:25:28.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.421+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fa36006d650 msgr2=0x7fa36006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.421+0000 7fa37be00700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fa36006d650 0x7fa36006fb00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa368005950 tx=0x7fa36800b410 comp rx=0 tx=0).stop 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.421+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 msgr2=0x7fa37c100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.421+0000 7fa37be00700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c100470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa36c005b40 tx=0x7fa36c00bd70 comp rx=0 tx=0).stop 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.423+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 shutdown_connections 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.423+0000 7fa37be00700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7fa36006d650 0x7fa36006fb00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.423+0000 7fa37be00700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa37c100b10 0x7fa37c100470 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.423+0000 7fa37be00700 1 --2- 172.21.15.23:0/3001003439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c103430 0x7fa37c0feac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.423+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 >> 172.21.15.23:0/3001003439 conn(0x7fa37c0fa4d0 msgr2=0x7fa37c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.423+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 shutdown_connections 2024-02-28T16:25:28.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.423+0000 7fa37be00700 1 -- 172.21.15.23:0/3001003439 wait complete. 2024-02-28T16:25:28.607 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.617+0000 7f31b9c00700 1 -- 172.21.15.23:0/2807265063 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b41003d0 msgr2=0x7f31b4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:28.607 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.617+0000 7f31b9c00700 1 --2- 172.21.15.23:0/2807265063 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b41003d0 0x7f31b4100840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009910 tx=0x7f31a0009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:28.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.618+0000 7f31b9c00700 1 -- 172.21.15.23:0/2807265063 shutdown_connections 2024-02-28T16:25:28.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.618+0000 7f31b9c00700 1 --2- 172.21.15.23:0/2807265063 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b41003d0 0x7f31b4100840 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.618+0000 7f31b9c00700 1 --2- 172.21.15.23:0/2807265063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31b40ff130 0x7f31b40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.618+0000 7f31b9c00700 1 -- 172.21.15.23:0/2807265063 >> 172.21.15.23:0/2807265063 conn(0x7f31b40fa780 msgr2=0x7f31b40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:28.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.618+0000 7f31b9c00700 1 -- 172.21.15.23:0/2807265063 shutdown_connections 2024-02-28T16:25:28.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.618+0000 7f31b9c00700 1 -- 172.21.15.23:0/2807265063 wait complete. 2024-02-28T16:25:28.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.620+0000 7f31b9c00700 1 Processor -- start 2024-02-28T16:25:28.616 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.620+0000 7f31b9c00700 1 -- start start 2024-02-28T16:25:28.616 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.620+0000 7f31b9c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b40ff130 0x7f31b4197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.620+0000 7f31b9c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31b41003d0 0x7f31b4198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.620+0000 7f31b9c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b41987b0 con 0x7f31b40ff130 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.620+0000 7f31b9c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b419d1c0 con 0x7f31b41003d0 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.621+0000 7f31b2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b40ff130 0x7f31b4197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.621+0000 7f31b2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b40ff130 0x7f31b4197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43842/0 (socket says 172.21.15.23:43842) 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.621+0000 7f31b2000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31b41003d0 0x7f31b4198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.621+0000 7f31b2a00700 1 -- 172.21.15.23:0/270020298 learned_addr learned my addr 172.21.15.23:0/270020298 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:28.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.622+0000 7f31b2a00700 1 -- 172.21.15.23:0/270020298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31b41003d0 msgr2=0x7f31b4198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.622+0000 7f31b2a00700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31b41003d0 0x7f31b4198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.622+0000 7f31b2a00700 1 -- 172.21.15.23:0/270020298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a00095f0 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.622+0000 7f31b2a00700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b40ff130 0x7f31b4197c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c8a0 tx=0x7f31a400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.622+0000 7f31ab400700 1 -- 172.21.15.23:0/270020298 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31a40078e0 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.623+0000 7f31ab400700 1 -- 172.21.15.23:0/270020298 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31a400f450 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.623+0000 7f31ab400700 1 -- 172.21.15.23:0/270020298 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31a400e5e0 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.623+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b419d3c0 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.623+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b419d8e0 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.624+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b4106ae0 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.626+0000 7f31ab400700 1 -- 172.21.15.23:0/270020298 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 31) v1 ==== 91440+0+0 (secure 0 0 0) 0x7f31a400f5c0 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.627+0000 7f31ab400700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f319806d650 0x7f319806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.627+0000 7f31ab400700 1 -- 172.21.15.23:0/270020298 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f31a408d110 con 0x7f31b40ff130 2024-02-28T16:25:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.627+0000 7f31b2000700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f319806d650 0x7f319806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:28.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.628+0000 7f31b2000700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f319806d650 0x7f319806fb00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31a0006010 tx=0x7f31a000b560 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:28.625 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:28.635+0000 7f31ab400700 1 -- 172.21.15.23:0/270020298 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f31a4056bb0 con 0x7f31b40ff130 2024-02-28T16:25:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:28 smithi153 ceph-mon[35341]: Upgrade: Updating mon.smithi023 2024-02-28T16:25:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:28 smithi153 ceph-mon[35341]: Deploying daemon mon.smithi023 on smithi023 2024-02-28T16:25:28.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:28 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1167642312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:25:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:28 smithi023 ceph-mon[29137]: Upgrade: Updating mon.smithi023 2024-02-28T16:25:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:28 smithi023 ceph-mon[29137]: Deploying daemon mon.smithi023 on smithi023 2024-02-28T16:25:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:28 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/1167642312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:25:29.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.087+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f31b4106cd0 con 0x7f31b40ff130 2024-02-28T16:25:29.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.087+0000 7f31ab400700 1 -- 172.21.15.23:0/270020298 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f31b4106cd0 con 0x7f31b40ff130 2024-02-28T16:25:29.077 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f319806d650 msgr2=0x7f319806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f319806d650 0x7f319806fb00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31a0006010 tx=0x7f31a000b560 comp rx=0 tx=0).stop 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b40ff130 msgr2=0x7f31b4197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b40ff130 0x7f31b4197c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c8a0 tx=0x7f31a400cbb0 comp rx=0 tx=0).stop 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 shutdown_connections 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779] conn(0x7f319806d650 0x7f319806fb00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31b40ff130 0x7f31b4197c50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:29.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 --2- 172.21.15.23:0/270020298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31b41003d0 0x7f31b4198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:29.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 >> 172.21.15.23:0/270020298 conn(0x7f31b40fa780 msgr2=0x7f31b4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:29.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 shutdown_connections 2024-02-28T16:25:29.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:29.090+0000 7f31b9c00700 1 -- 172.21.15.23:0/270020298 wait complete. 2024-02-28T16:25:29.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:29 smithi153 ceph-mon[35341]: pgmap v34: 65 pgs: 65 active+clean; 561 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-02-28T16:25:29.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:29 smithi153 ceph-mon[35341]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:29.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:29 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/270020298' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:25:29.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:29 smithi023 ceph-mon[29137]: pgmap v34: 65 pgs: 65 active+clean; 561 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-02-28T16:25:29.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:29 smithi023 ceph-mon[29137]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:29.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:29 smithi023 ceph-mon[29137]: from='client.? 172.21.15.23:0/270020298' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:25:31.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:31 smithi153 ceph-mon[35341]: pgmap v35: 65 pgs: 65 active+clean; 561 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 819 KiB/s wr, 181 op/s 2024-02-28T16:25:31.900 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:31 smithi023 ceph-mon[29137]: pgmap v35: 65 pgs: 65 active+clean; 561 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 819 KiB/s wr, 181 op/s 2024-02-28T16:25:32.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:31 smithi023 systemd[1]: Stopping Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:25:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:32 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[29133]: 2024-02-28T16:25:32.365+0000 7fa61a200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi023 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:25:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:32 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[29133]: 2024-02-28T16:25:32.365+0000 7fa61a200700 -1 mon.smithi023@0(leader) e2 *** Got Signal Terminated *** 2024-02-28T16:25:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:32 smithi023 podman[78347]: 2024-02-28 16:25:32.407043366 +0000 UTC m=+0.197597296 container died f10b6843c8c22a8f758fa799c3540326e21ed6691b2ad773d4b04dd66757e533 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_CLEAN=True, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0) 2024-02-28T16:25:33.056 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:33 smithi023 podman[78347]: 2024-02-28 16:25:33.052543359 +0000 UTC m=+0.843097296 container cleanup f10b6843c8c22a8f758fa799c3540326e21ed6691b2ad773d4b04dd66757e533 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-28T16:25:33.057 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:33 smithi023 bash[78347]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023 2024-02-28T16:25:33.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:33 smithi023 podman[78366]: 2024-02-28 16:25:33.421562021 +0000 UTC m=+0.995668756 container remove f10b6843c8c22a8f758fa799c3540326e21ed6691b2ad773d4b04dd66757e533 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212) 2024-02-28T16:25:34.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:33 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service: Deactivated successfully. 2024-02-28T16:25:34.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:33 smithi023 systemd[1]: Stopped Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:25:34.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:33 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service: Consumed 26.827s CPU time. 2024-02-28T16:25:34.653 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:34 smithi023 systemd[1]: Starting Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:25:34.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:34 smithi023 podman[78491]: 2024-02-28 16:25:34.570207088 +0000 UTC m=+0.039085178 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:25:34.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:34 smithi023 podman[78491]: 2024-02-28 16:25:34.697700796 +0000 UTC m=+0.166578873 container create b383e5ebc0af2746e23b06806592ba3f44a6aebefcdfde2ff85c55d0d10a7ecd (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:25:37.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 podman[78491]: 2024-02-28 16:25:37.293552062 +0000 UTC m=+2.762430141 container init b383e5ebc0af2746e23b06806592ba3f44a6aebefcdfde2ff85c55d0d10a7ecd (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 podman[78491]: 2024-02-28 16:25:37.305962724 +0000 UTC m=+2.774840813 container start b383e5ebc0af2746e23b06806592ba3f44a6aebefcdfde2ff85c55d0d10a7ecd (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: pidfile_write: ignore empty --pid-file 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: load: jerasure load: lrc 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Git sha 0 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: DB SUMMARY 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: DB Session ID: PF3O3M2OV8T6PG0JPEQ8 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:25:37.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1489 Bytes 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi023/store.db dir, Total Num: 1, files: 000032.sst 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi023/store.db: 000030.log size: 3062398 ; 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.env: 0x555a02649b20 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.info_log: 0x555a045b17c0 2024-02-28T16:25:37.675 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:25:37.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.statistics: (nil) 2024-02-28T16:25:37.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.use_fsync: 0 2024-02-28T16:25:37.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:25:37.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:25:37.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:25:37.676 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.db_log_dir: 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.wal_dir: 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:25:37.677 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.write_buffer_manager: 0x555a04585400 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.unordered_write: 0 2024-02-28T16:25:37.678 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.row_cache: None 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.wal_filter: None 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.wal_compression: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:25:37.679 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:25:37.680 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_open_files: -1 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Compression algorithms supported: 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kZSTD supported: 0 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:25:37.681 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi023/store.db/MANIFEST-000015 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.merge_operator: 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_filter: None 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:25:37.682 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555a045b18e0) 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: index_type: 0 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: data_block_index_type: 0 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: index_shortening: 1 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: checksum: 4 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: no_block_cache: 0 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache: 0x555a045b5090 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache_options: 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: capacity : 536870912 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: num_shard_bits : 4 2024-02-28T16:25:37.683 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: strict_capacity_limit : 0 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_cache_compressed: (nil) 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: persistent_cache: (nil) 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_size: 4096 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_size_deviation: 10 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_restart_interval: 16 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: index_block_restart_interval: 1 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: metadata_block_size: 4096 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: partition_filters: 0 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: use_delta_encoding: 1 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: filter_policy: bloomfilter 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: whole_key_filtering: 1 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: verify_compression: 0 2024-02-28T16:25:37.684 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:25:37.685 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: format_version: 5 2024-02-28T16:25:37.685 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: enable_index_compression: 1 2024-02-28T16:25:37.685 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: block_align: 0 2024-02-28T16:25:37.685 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: max_auto_readahead_size: 262144 2024-02-28T16:25:37.685 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: prepopulate_block_cache: 0 2024-02-28T16:25:37.685 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:25:37.685 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression: NoCompression 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.num_levels: 7 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:25:37.686 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:25:37.687 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:25:37.688 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:25:37.689 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:25:37.690 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.ttl: 2592000 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:25:37.691 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi023/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12593, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3e23db10-4916-43d5-9148-5c0b796b1952 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137537380828, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137537399991, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2786662, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12594, "largest_seqno": 14633, "table_properties": {"data_size": 2778314, "index_size": 4895, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2437, "raw_key_size": 20094, "raw_average_key_size": 20, "raw_value_size": 2760005, "raw_average_value_size": 2878, "num_data_blocks": 224, "num_entries": 959, "num_filter_entries": 959, "num_deletions": 253, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709137537, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3e23db10-4916-43d5-9148-5c0b796b1952", "db_session_id": "PF3O3M2OV8T6PG0JPEQ8", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137537400691, "job": 1, "event": "recovery_finished"} 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi023/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:25:37.692 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555a046a4000 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: DB pointer 0x555a04690000 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** DB Stats ** 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** Compaction Stats [default] ** 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:25:37.693 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: L0 1/0 2.66 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 324.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: L6 1/0 5.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Sum 2/0 7.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 324.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 324.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** Compaction Stats [default] ** 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 324.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-02-28T16:25:37.694 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Cumulative compaction: 0.00 GB write, 84.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Interval compaction: 0.00 GB write, 84.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Block cache BinnedLRUCache@0x555a045b5090#2 capacity: 512.00 MB usage: 7.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.53 KB,0.000482798%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: starting mon.smithi023 rank 0 at public addrs [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] at bind addrs [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi023 fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???) e2 preinit fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).mds e16 new map 2024-02-28T16:25:37.695 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).mds e16 print_map 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: e16 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: legacy client fscid: 1 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Filesystem 'cephfs' (1) 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: fs_name cephfs 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: epoch 15 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: tableserver 0 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: root 0 2024-02-28T16:25:37.696 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: session_timeout 60 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: session_autoclose 300 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: max_file_size 1099511627776 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: max_xattr_size 65536 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: required_client_features {} 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: last_failure 0 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: last_failure_osd_epoch 47 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: max_mds 1 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: in 0 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: up {0=14476} 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: failed 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: damaged 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: stopped 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: data_pools [3] 2024-02-28T16:25:37.697 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: metadata_pool 2 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: inline_data disabled 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: balancer 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: bal_rank_mask -1 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: standby_count_wanted 1 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: [mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: Standby daemons: 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: [mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: [mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout: [mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:25:37.698 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:25:37.699 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:25:37.699 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-02-28T16:25:37.699 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).mgr e0 loading version 31 2024-02-28T16:25:37.699 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).mgr e31 active server: [v2:172.21.15.23:6800/877826779,v1:172.21.15.23:6801/877826779](24443) 2024-02-28T16:25:37.699 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 ceph-mon[78509]: mon.smithi023@-1(???).mgr e31 mkfs or daemon transitioned to available, loading commands 2024-02-28T16:25:37.699 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 bash[78491]: b383e5ebc0af2746e23b06806592ba3f44a6aebefcdfde2ff85c55d0d10a7ecd 2024-02-28T16:25:37.699 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:37 smithi023 systemd[1]: Started Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:25:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:25:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:25:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: pgmap v36: 65 pgs: 65 active+clean; 561 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 819 KiB/s wr, 181 op/s 2024-02-28T16:25:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: pgmap v37: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 269 op/s 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 784 KiB/s wr, 193 op/s 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 317 op/s 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: mon.smithi023 calling monitor election 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: mon.smithi023 is new leader, mons smithi023,smithi153 in quorum (ranks 0,1) 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: monmap e2: 2 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: mgrmap e31: smithi023.bbebnt(active, since 72s), standbys: smithi153.qlkchp 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: overall HEALTH_OK 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: from='mgr.24443 ' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:39.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:38 smithi023 ceph-mon[78509]: mgrmap e32: smithi023.bbebnt(active, since 72s), standbys: smithi153.qlkchp 2024-02-28T16:25:39.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: from='mgr.24443 172.21.15.23:0/1426240443' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: pgmap v36: 65 pgs: 65 active+clean; 561 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 819 KiB/s wr, 181 op/s 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: pgmap v37: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 269 op/s 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 784 KiB/s wr, 193 op/s 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 317 op/s 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: mon.smithi023 calling monitor election 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: mon.smithi023 is new leader, mons smithi023,smithi153 in quorum (ranks 0,1) 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: monmap e2: 2 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: mgrmap e31: smithi023.bbebnt(active, since 72s), standbys: smithi153.qlkchp 2024-02-28T16:25:39.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: overall HEALTH_OK 2024-02-28T16:25:39.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: from='mgr.24443 ' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:39.398 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:38 smithi153 ceph-mon[35341]: mgrmap e32: smithi023.bbebnt(active, since 72s), standbys: smithi153.qlkchp 2024-02-28T16:25:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:49 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp restarted 2024-02-28T16:25:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:49 smithi153 ceph-mon[35341]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:25:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:49 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:25:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:49 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:49 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:25:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:49 smithi153 ceph-mon[35341]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:49.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:49 smithi023 ceph-mon[78509]: Standby manager daemon smithi153.qlkchp restarted 2024-02-28T16:25:49.454 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:49 smithi023 ceph-mon[78509]: Standby manager daemon smithi153.qlkchp started 2024-02-28T16:25:49.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:49 smithi023 ceph-mon[78509]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/crt"}]: dispatch 2024-02-28T16:25:49.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:49 smithi023 ceph-mon[78509]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:49.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:49 smithi023 ceph-mon[78509]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.qlkchp/key"}]: dispatch 2024-02-28T16:25:49.455 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:49 smithi023 ceph-mon[78509]: from='mgr.? 172.21.15.153:0/4264679117' entity='mgr.smithi153.qlkchp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:50.485 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:50 smithi023 ceph-mon[78509]: mgrmap e33: smithi023.bbebnt(active, since 82s), standbys: smithi153.qlkchp 2024-02-28T16:25:50.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:50 smithi153 ceph-mon[35341]: mgrmap e33: smithi023.bbebnt(active, since 82s), standbys: smithi153.qlkchp 2024-02-28T16:25:51.400 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: Active manager daemon smithi023.bbebnt restarted 2024-02-28T16:25:51.400 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: Activating manager daemon smithi023.bbebnt 2024-02-28T16:25:51.400 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: osdmap e50: 6 total, 6 up, 6 in 2024-02-28T16:25:51.400 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: mgrmap e34: smithi023.bbebnt(active, starting, since 0.0140825s), standbys: smithi153.qlkchp 2024-02-28T16:25:51.400 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:25:51.400 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:25:51.401 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:25:51.402 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:25:51.402 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:25:51.402 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:51 smithi023 ceph-mon[78509]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: Active manager daemon smithi023.bbebnt restarted 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: Activating manager daemon smithi023.bbebnt 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: osdmap e50: 6 total, 6 up, 6 in 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: mgrmap e34: smithi023.bbebnt(active, starting, since 0.0140825s), standbys: smithi153.qlkchp 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:25:51.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi023.bbebnt", "id": "smithi023.bbebnt"}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr metadata", "who": "smithi153.qlkchp", "id": "smithi153.qlkchp"}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:25:51.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:51 smithi153 ceph-mon[35341]: Manager daemon smithi023.bbebnt is now available 2024-02-28T16:25:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:52 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:52 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:52 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:52 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:25:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:52 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:25:52.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:52 smithi153 ceph-mon[35341]: mgrmap e35: smithi023.bbebnt(active, since 1.02024s), standbys: smithi153.qlkchp 2024-02-28T16:25:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:25:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi023.bbebnt/trash_purge_schedule"}]: dispatch 2024-02-28T16:25:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:52 smithi023 ceph-mon[78509]: mgrmap e35: smithi023.bbebnt(active, since 1.02024s), standbys: smithi153.qlkchp 2024-02-28T16:25:53.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:53 smithi153 ceph-mon[35341]: [28/Feb/2024:16:25:52] ENGINE Bus STARTING 2024-02-28T16:25:53.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:53 smithi153 ceph-mon[35341]: [28/Feb/2024:16:25:52] ENGINE Serving on https://172.21.15.23:7150 2024-02-28T16:25:53.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:53 smithi153 ceph-mon[35341]: [28/Feb/2024:16:25:52] ENGINE Serving on http://172.21.15.23:8765 2024-02-28T16:25:53.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:53 smithi153 ceph-mon[35341]: [28/Feb/2024:16:25:52] ENGINE Bus STARTED 2024-02-28T16:25:53.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:53 smithi023 ceph-mon[78509]: [28/Feb/2024:16:25:52] ENGINE Bus STARTING 2024-02-28T16:25:53.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:53 smithi023 ceph-mon[78509]: [28/Feb/2024:16:25:52] ENGINE Serving on https://172.21.15.23:7150 2024-02-28T16:25:53.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:53 smithi023 ceph-mon[78509]: [28/Feb/2024:16:25:52] ENGINE Serving on http://172.21.15.23:8765 2024-02-28T16:25:53.541 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:53 smithi023 ceph-mon[78509]: [28/Feb/2024:16:25:52] ENGINE Bus STARTED 2024-02-28T16:25:54.568 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:54 smithi023 ceph-mon[78509]: pgmap v4: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:25:54.568 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:54 smithi023 ceph-mon[78509]: mgrmap e36: smithi023.bbebnt(active, since 2s), standbys: smithi153.qlkchp 2024-02-28T16:25:54.610 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:54 smithi153 ceph-mon[35341]: pgmap v4: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:25:54.610 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:54 smithi153 ceph-mon[35341]: mgrmap e36: smithi023.bbebnt(active, since 2s), standbys: smithi153.qlkchp 2024-02-28T16:25:56.532 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:56 smithi023 ceph-mon[78509]: pgmap v5: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:25:56.532 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:56 smithi023 ceph-mon[78509]: mgrmap e37: smithi023.bbebnt(active, since 4s), standbys: smithi153.qlkchp 2024-02-28T16:25:56.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:56 smithi153 ceph-mon[35341]: pgmap v5: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:25:56.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:56 smithi153 ceph-mon[35341]: mgrmap e37: smithi023.bbebnt(active, since 4s), standbys: smithi153.qlkchp 2024-02-28T16:25:58.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:58 smithi153 ceph-mon[35341]: pgmap v6: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 65 KiB/s rd, 1.1 MiB/s wr, 283 op/s 2024-02-28T16:25:58.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:58 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:58.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:25:58 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:58.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:58 smithi023 ceph-mon[78509]: pgmap v6: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 65 KiB/s rd, 1.1 MiB/s wr, 283 op/s 2024-02-28T16:25:58.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:58.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:25:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:25:59.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.283+0000 7f71b7200700 1 -- 172.21.15.23:0/4121532128 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 msgr2=0x7f71b8102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.283+0000 7f71b7200700 1 --2- 172.21.15.23:0/4121532128 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8102f10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009910 tx=0x7f71a8009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:59.274 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.283+0000 7f71b7200700 1 -- 172.21.15.23:0/4121532128 shutdown_connections 2024-02-28T16:25:59.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.284+0000 7f71b7200700 1 --2- 172.21.15.23:0/4121532128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b8103450 0x7f71b8105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.284+0000 7f71b7200700 1 --2- 172.21.15.23:0/4121532128 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8102f10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.284+0000 7f71b7200700 1 -- 172.21.15.23:0/4121532128 >> 172.21.15.23:0/4121532128 conn(0x7f71b80fa4d0 msgr2=0x7f71b80fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:59.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.284+0000 7f71b7200700 1 -- 172.21.15.23:0/4121532128 shutdown_connections 2024-02-28T16:25:59.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.284+0000 7f71b7200700 1 -- 172.21.15.23:0/4121532128 wait complete. 2024-02-28T16:25:59.275 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.285+0000 7f71b7200700 1 Processor -- start 2024-02-28T16:25:59.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.285+0000 7f71b7200700 1 -- start start 2024-02-28T16:25:59.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b7200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b7200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b8103450 0x7f71b8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b7200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81985a0 con 0x7f71b8100b30 2024-02-28T16:25:59.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b7200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81986e0 con 0x7f71b8103450 2024-02-28T16:25:59.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b5e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b5e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:36914/0 (socket says 172.21.15.23:36914) 2024-02-28T16:25:59.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b5e00700 1 -- 172.21.15.23:0/3060026282 learned_addr learned my addr 172.21.15.23:0/3060026282 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:59.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.286+0000 7f71b5400700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b8103450 0x7f71b8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.287+0000 7f71b5e00700 1 -- 172.21.15.23:0/3060026282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b8103450 msgr2=0x7f71b8197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.287+0000 7f71b5e00700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b8103450 0x7f71b8197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.287+0000 7f71b5e00700 1 -- 172.21.15.23:0/3060026282 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80095f0 con 0x7f71b8100b30 2024-02-28T16:25:59.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.287+0000 7f71b5e00700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8197a40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005b40 tx=0x7f71a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:59.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.288+0000 7f71aea00700 1 -- 172.21.15.23:0/3060026282 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71a801d070 con 0x7f71b8100b30 2024-02-28T16:25:59.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.288+0000 7f71aea00700 1 -- 172.21.15.23:0/3060026282 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f71a800f460 con 0x7f71b8100b30 2024-02-28T16:25:59.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.288+0000 7f71aea00700 1 -- 172.21.15.23:0/3060026282 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71a8021640 con 0x7f71b8100b30 2024-02-28T16:25:59.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.288+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b819d130 con 0x7f71b8100b30 2024-02-28T16:25:59.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.288+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b819d620 con 0x7f71b8100b30 2024-02-28T16:25:59.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.290+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80fc090 con 0x7f71b8100b30 2024-02-28T16:25:59.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.291+0000 7f71aea00700 1 -- 172.21.15.23:0/3060026282 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f71a800fa90 con 0x7f71b8100b30 2024-02-28T16:25:59.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.292+0000 7f71aea00700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f719c06da10 0x7f719c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.292+0000 7f71aea00700 1 -- 172.21.15.23:0/3060026282 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f71a808ea50 con 0x7f71b8100b30 2024-02-28T16:25:59.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.293+0000 7f71b5400700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f719c06da10 0x7f719c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.294+0000 7f71b5400700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f719c06da10 0x7f719c06fec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005950 tx=0x7f71a40058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:59.290 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.300+0000 7f71aea00700 1 -- 172.21.15.23:0/3060026282 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f71a805bbc0 con 0x7f71b8100b30 2024-02-28T16:25:59.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.710+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71b8061190 con 0x7f719c06da10 2024-02-28T16:25:59.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.713+0000 7f71aea00700 1 -- 172.21.15.23:0/3060026282 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f71b8061190 con 0x7f719c06da10 2024-02-28T16:25:59.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f719c06da10 msgr2=0x7f719c06fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f719c06da10 0x7f719c06fec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005950 tx=0x7f71a40058e0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 msgr2=0x7f71b8197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8197a40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005b40 tx=0x7f71a800be20 comp rx=0 tx=0).stop 2024-02-28T16:25:59.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 shutdown_connections 2024-02-28T16:25:59.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f719c06da10 0x7f719c06fec0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f71b8100b30 0x7f71b8197a40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 --2- 172.21.15.23:0/3060026282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b8103450 0x7f71b8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.717+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 >> 172.21.15.23:0/3060026282 conn(0x7f71b80fa4d0 msgr2=0x7f71b81040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:59.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.718+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 shutdown_connections 2024-02-28T16:25:59.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.718+0000 7f71b7200700 1 -- 172.21.15.23:0/3060026282 wait complete. 2024-02-28T16:25:59.730 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:25:59.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 -- 172.21.15.23:0/1594806009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20102490 msgr2=0x7f9d201028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1594806009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20102490 0x7f9d201028a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009910 tx=0x7f9d14009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:59.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 -- 172.21.15.23:0/1594806009 shutdown_connections 2024-02-28T16:25:59.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1594806009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d20103640 0x7f9d20103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1594806009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20102490 0x7f9d201028a0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009910 tx=0x7f9d14009c20 comp rx=0 tx=0).stop 2024-02-28T16:25:59.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 -- 172.21.15.23:0/1594806009 >> 172.21.15.23:0/1594806009 conn(0x7f9d200fda60 msgr2=0x7f9d200ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:59.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 -- 172.21.15.23:0/1594806009 shutdown_connections 2024-02-28T16:25:59.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.914+0000 7f9d27a00700 1 -- 172.21.15.23:0/1594806009 wait complete. 2024-02-28T16:25:59.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d27a00700 1 Processor -- start 2024-02-28T16:25:59.907 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d27a00700 1 -- start start 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d27a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d20103640 0x7f9d20197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d27a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20198460 0x7f9d2019d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d27a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201988d0 con 0x7f9d20198460 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d27a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20198a40 con 0x7f9d20103640 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d1fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20198460 0x7f9d2019d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d1fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20198460 0x7f9d2019d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:58944/0 (socket says 172.21.15.23:58944) 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.916+0000 7f9d1fe00700 1 -- 172.21.15.23:0/1638138055 learned_addr learned my addr 172.21.15.23:0/1638138055 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.917+0000 7f9d25000700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d20103640 0x7f9d20197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.917+0000 7f9d1fe00700 1 -- 172.21.15.23:0/1638138055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d20103640 msgr2=0x7f9d20197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.917+0000 7f9d1fe00700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d20103640 0x7f9d20197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.908 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.917+0000 7f9d1fe00700 1 -- 172.21.15.23:0/1638138055 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140095f0 con 0x7f9d20198460 2024-02-28T16:25:59.909 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.918+0000 7f9d1fe00700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20198460 0x7f9d2019d4d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c930 tx=0x7f9d0c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:59.909 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.918+0000 7f9d1d600700 1 -- 172.21.15.23:0/1638138055 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d0c007ad0 con 0x7f9d20198460 2024-02-28T16:25:59.909 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.918+0000 7f9d1d600700 1 -- 172.21.15.23:0/1638138055 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d0c007c30 con 0x7f9d20198460 2024-02-28T16:25:59.909 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.918+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2006a770 con 0x7f9d20198460 2024-02-28T16:25:59.909 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.918+0000 7f9d1d600700 1 -- 172.21.15.23:0/1638138055 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d0c018630 con 0x7f9d20198460 2024-02-28T16:25:59.909 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.919+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2006acc0 con 0x7f9d20198460 2024-02-28T16:25:59.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.920+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2010af90 con 0x7f9d20198460 2024-02-28T16:25:59.912 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.922+0000 7f9d1d600700 1 -- 172.21.15.23:0/1638138055 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f9d0c00f450 con 0x7f9d20198460 2024-02-28T16:25:59.913 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.923+0000 7f9d1d600700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d0806d9e0 0x7f9d0806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.913 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.923+0000 7f9d1d600700 1 -- 172.21.15.23:0/1638138055 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9d0c08da50 con 0x7f9d20198460 2024-02-28T16:25:59.914 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.923+0000 7f9d25000700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d0806d9e0 0x7f9d0806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.914 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.924+0000 7f9d25000700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d0806d9e0 0x7f9d0806fe90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9d14000c00 tx=0x7f9d1400b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:59.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:25:59.930+0000 7f9d1d600700 1 -- 172.21.15.23:0/1638138055 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9d0c05ad30 con 0x7f9d20198460 2024-02-28T16:26:00.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.289+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d20107f90 con 0x7f9d0806d9e0 2024-02-28T16:26:00.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.291+0000 7f9d1d600700 1 -- 172.21.15.23:0/1638138055 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9d20107f90 con 0x7f9d0806d9e0 2024-02-28T16:26:00.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d0806d9e0 msgr2=0x7f9d0806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d0806d9e0 0x7f9d0806fe90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9d14000c00 tx=0x7f9d1400b540 comp rx=0 tx=0).stop 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20198460 msgr2=0x7f9d2019d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20198460 0x7f9d2019d4d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c930 tx=0x7f9d0c00ccf0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 shutdown_connections 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d20103640 0x7f9d20197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d0806d9e0 0x7f9d0806fe90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 --2- 172.21.15.23:0/1638138055 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d20198460 0x7f9d2019d4d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.294+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 >> 172.21.15.23:0/1638138055 conn(0x7f9d200fda60 msgr2=0x7f9d20106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:00.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.295+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 shutdown_connections 2024-02-28T16:26:00.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.295+0000 7f9d27a00700 1 -- 172.21.15.23:0/1638138055 wait complete. 2024-02-28T16:26:00.514 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.522+0000 7fc70f200700 1 -- 172.21.15.23:0/1481790200 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710103410 msgr2=0x7fc7101057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:00.514 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.522+0000 7fc70f200700 1 --2- 172.21.15.23:0/1481790200 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710103410 0x7fc7101057f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009870 tx=0x7fc6fc009b80 comp rx=0 tx=0).stop 2024-02-28T16:26:00.514 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.523+0000 7fc70f200700 1 -- 172.21.15.23:0/1481790200 shutdown_connections 2024-02-28T16:26:00.515 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.523+0000 7fc70f200700 1 --2- 172.21.15.23:0/1481790200 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710103410 0x7fc7101057f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.515 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.523+0000 7fc70f200700 1 --2- 172.21.15.23:0/1481790200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710100af0 0x7fc710102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.515 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.523+0000 7fc70f200700 1 -- 172.21.15.23:0/1481790200 >> 172.21.15.23:0/1481790200 conn(0x7fc7100fa4d0 msgr2=0x7fc7100fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:00.515 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.523+0000 7fc70f200700 1 -- 172.21.15.23:0/1481790200 shutdown_connections 2024-02-28T16:26:00.515 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.523+0000 7fc70f200700 1 -- 172.21.15.23:0/1481790200 wait complete. 2024-02-28T16:26:00.519 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.525+0000 7fc70f200700 1 Processor -- start 2024-02-28T16:26:00.519 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.525+0000 7fc70f200700 1 -- start start 2024-02-28T16:26:00.519 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.525+0000 7fc70f200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710100af0 0x7fc710197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:00.519 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.525+0000 7fc70f200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710103410 0x7fc710197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.525+0000 7fc70f200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101985b0 con 0x7fc710100af0 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.525+0000 7fc70f200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101986f0 con 0x7fc710103410 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70d400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710103410 0x7fc710197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710100af0 0x7fc710197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70d400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710103410 0x7fc710197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:47778/0 (socket says 172.21.15.23:47778) 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70d400700 1 -- 172.21.15.23:0/2544304667 learned_addr learned my addr 172.21.15.23:0/2544304667 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70d400700 1 -- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710100af0 msgr2=0x7fc710197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:00.520 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70d400700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710100af0 0x7fc710197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70d400700 1 -- 172.21.15.23:0/2544304667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc009520 con 0x7fc710103410 2024-02-28T16:26:00.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.526+0000 7fc70d400700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710103410 0x7fc710197f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009f50 tx=0x7fc6fc00f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:00.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.527+0000 7fc706a00700 1 -- 172.21.15.23:0/2544304667 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6fc01c070 con 0x7fc710103410 2024-02-28T16:26:00.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.527+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71019d140 con 0x7fc710103410 2024-02-28T16:26:00.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.527+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71019d6b0 con 0x7fc710103410 2024-02-28T16:26:00.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.527+0000 7fc706a00700 1 -- 172.21.15.23:0/2544304667 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6fc00be80 con 0x7fc710103410 2024-02-28T16:26:00.521 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.527+0000 7fc706a00700 1 -- 172.21.15.23:0/2544304667 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6fc022de0 con 0x7fc710103410 2024-02-28T16:26:00.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.529+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0005320 con 0x7fc710103410 2024-02-28T16:26:00.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.531+0000 7fc706a00700 1 -- 172.21.15.23:0/2544304667 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 37) v1 ==== 91579+0+0 (secure 0 0 0) 0x7fc6fc020070 con 0x7fc710103410 2024-02-28T16:26:00.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.531+0000 7fc706a00700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc6f406d9d0 0x7fc6f406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:00.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.532+0000 7fc706a00700 1 -- 172.21.15.23:0/2544304667 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc6fc08e860 con 0x7fc710103410 2024-02-28T16:26:00.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.533+0000 7fc70de00700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc6f406d9d0 0x7fc6f406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:00.524 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.534+0000 7fc70de00700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc6f406d9d0 0x7fc6f406fe80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc700005fd0 tx=0x7fc700009310 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:00.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.538+0000 7fc706a00700 1 -- 172.21.15.23:0/2544304667 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc6fc05ba00 con 0x7fc710103410 2024-02-28T16:26:00.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.847+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6f0000bf0 con 0x7fc6f406d9d0 2024-02-28T16:26:00.838 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:00 smithi023 ceph-mon[78509]: pgmap v7: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 779 KiB/s wr, 202 op/s 2024-02-28T16:26:00.838 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:00 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:00.838 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:00 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:00.838 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:00 smithi023 ceph-mon[78509]: from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:00.839 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:00 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:00.839 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:00 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:00.855 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.863+0000 7fc706a00700 1 -- 172.21.15.23:0/2544304667 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc6f0000bf0 con 0x7fc6f406d9d0 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (10m) 0s ago 12m 14.1M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (13m) 0s ago 13m 7936k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (11m) 3s ago 11m 7608k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (13m) 0s ago 13m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (11m) 3s ago 11m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (10m) 0s ago 12m 73.0M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (5m) 0s ago 5m 207M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (5m) 0s ago 5m 15.2M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (5m) 3s ago 5m 15.0M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (5m) 3s ago 5m 14.9M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:26:00.856 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (2m) 0s ago 14m 477M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (48s) 3s ago 11m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (26s) 0s ago 14m 30.8M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (11m) 3s ago 11m 51.7M 2048M 18.2.0 dc2bc1663786 e8382734ae5b 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (13m) 0s ago 13m 8014k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (11m) 3s ago 11m 7646k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (10m) 0s ago 10m 209M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (9m) 0s ago 9m 217M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (9m) 0s ago 9m 174M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (8m) 3s ago 8m 242M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (8m) 3s ago 8m 230M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (7m) 3s ago 7m 203M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:26:00.857 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (57s) 0s ago 12m 47.0M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:26:00.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc6f406d9d0 msgr2=0x7fc6f406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:00.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc6f406d9d0 0x7fc6f406fe80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc700005fd0 tx=0x7fc700009310 comp rx=0 tx=0).stop 2024-02-28T16:26:00.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710103410 msgr2=0x7fc710197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:00.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710103410 0x7fc710197f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009f50 tx=0x7fc6fc00f740 comp rx=0 tx=0).stop 2024-02-28T16:26:00.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 shutdown_connections 2024-02-28T16:26:00.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc6f406d9d0 0x7fc6f406fe80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc710100af0 0x7fc710197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 --2- 172.21.15.23:0/2544304667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc710103410 0x7fc710197f90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:00.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 >> 172.21.15.23:0/2544304667 conn(0x7fc7100fa4d0 msgr2=0x7fc7100ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:00.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 shutdown_connections 2024-02-28T16:26:00.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:00.867+0000 7fc70f200700 1 -- 172.21.15.23:0/2544304667 wait complete. 2024-02-28T16:26:00.882 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:00 smithi153 ceph-mon[35341]: pgmap v7: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 779 KiB/s wr, 202 op/s 2024-02-28T16:26:00.882 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:00 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:00.882 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:00 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:00.882 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:00 smithi153 ceph-mon[35341]: from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:00.882 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:00 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:00.882 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:00 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:01.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.059+0000 7fab19c00700 1 -- 172.21.15.23:0/2763675674 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 msgr2=0x7fab141028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:01.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.059+0000 7fab19c00700 1 --2- 172.21.15.23:0/2763675674 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab141028a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab04009910 tx=0x7fab04009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:01.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.060+0000 7fab19c00700 1 -- 172.21.15.23:0/2763675674 shutdown_connections 2024-02-28T16:26:01.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.060+0000 7fab19c00700 1 --2- 172.21.15.23:0/2763675674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab14103640 0x7fab14103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.060+0000 7fab19c00700 1 --2- 172.21.15.23:0/2763675674 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab141028a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.060+0000 7fab19c00700 1 -- 172.21.15.23:0/2763675674 >> 172.21.15.23:0/2763675674 conn(0x7fab140fda60 msgr2=0x7fab140ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:01.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.060+0000 7fab19c00700 1 -- 172.21.15.23:0/2763675674 shutdown_connections 2024-02-28T16:26:01.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.060+0000 7fab19c00700 1 -- 172.21.15.23:0/2763675674 wait complete. 2024-02-28T16:26:01.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.061+0000 7fab19c00700 1 Processor -- start 2024-02-28T16:26:01.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.061+0000 7fab19c00700 1 -- start start 2024-02-28T16:26:01.052 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab19c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab14197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:01.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab19c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab14103640 0x7fab141981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:01.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab19c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab141987d0 con 0x7fab14102490 2024-02-28T16:26:01.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab19c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14198940 con 0x7fab14103640 2024-02-28T16:26:01.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab12a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab14197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:01.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab12a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab14197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:58986/0 (socket says 172.21.15.23:58986) 2024-02-28T16:26:01.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab12a00700 1 -- 172.21.15.23:0/1206270958 learned_addr learned my addr 172.21.15.23:0/1206270958 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:01.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.062+0000 7fab12000700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab14103640 0x7fab141981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:01.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.063+0000 7fab12a00700 1 -- 172.21.15.23:0/1206270958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab14103640 msgr2=0x7fab141981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:01.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.063+0000 7fab12a00700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab14103640 0x7fab141981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.063+0000 7fab12a00700 1 -- 172.21.15.23:0/1206270958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040095f0 con 0x7fab14102490 2024-02-28T16:26:01.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.063+0000 7fab12a00700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab14197c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fab0400bd70 tx=0x7fab0400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:01.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.064+0000 7fab0b400700 1 -- 172.21.15.23:0/1206270958 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0401d070 con 0x7fab14102490 2024-02-28T16:26:01.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.064+0000 7fab0b400700 1 -- 172.21.15.23:0/1206270958 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab04005a00 con 0x7fab14102490 2024-02-28T16:26:01.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.064+0000 7fab0b400700 1 -- 172.21.15.23:0/1206270958 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab04021410 con 0x7fab14102490 2024-02-28T16:26:01.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.064+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1419d370 con 0x7fab14102490 2024-02-28T16:26:01.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.064+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1419d860 con 0x7fab14102490 2024-02-28T16:26:01.056 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.065+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1410af90 con 0x7fab14102490 2024-02-28T16:26:01.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.068+0000 7fab0b400700 1 -- 172.21.15.23:0/1206270958 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fab0400f6f0 con 0x7fab14102490 2024-02-28T16:26:01.059 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.069+0000 7fab0b400700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7faaf806da20 0x7faaf806fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:01.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.070+0000 7fab0b400700 1 -- 172.21.15.23:0/1206270958 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fab0408eea0 con 0x7fab14102490 2024-02-28T16:26:01.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.070+0000 7fab12000700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7faaf806da20 0x7faaf806fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:01.061 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.071+0000 7fab12000700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7faaf806da20 0x7faaf806fed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab141991a0 tx=0x7fab0000b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:01.066 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.075+0000 7fab0b400700 1 -- 172.21.15.23:0/1206270958 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fab04058460 con 0x7fab14102490 2024-02-28T16:26:01.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.579+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fab1419df60 con 0x7fab14102490 2024-02-28T16:26:01.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.580+0000 7fab0b400700 1 -- 172.21.15.23:0/1206270958 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+779 (secure 0 0 0) 0x7fab0405bb20 con 0x7fab14102490 2024-02-28T16:26:01.571 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:26:01.571 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:26:01.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 11, 2024-02-28T16:26:01.573 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:26:01.573 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:26:01.573 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:26:01.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7faaf806da20 msgr2=0x7faaf806fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:01.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7faaf806da20 0x7faaf806fed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab141991a0 tx=0x7fab0000b410 comp rx=0 tx=0).stop 2024-02-28T16:26:01.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 msgr2=0x7fab14197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:01.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab14197c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fab0400bd70 tx=0x7fab0400bda0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 shutdown_connections 2024-02-28T16:26:01.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7faaf806da20 0x7faaf806fed0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab14102490 0x7fab14197c90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 --2- 172.21.15.23:0/1206270958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab14103640 0x7fab141981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 >> 172.21.15.23:0/1206270958 conn(0x7fab140fda60 msgr2=0x7fab14106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:01.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 shutdown_connections 2024-02-28T16:26:01.576 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.585+0000 7fab19c00700 1 -- 172.21.15.23:0/1206270958 wait complete. 2024-02-28T16:26:01.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.777+0000 7f46a8a00700 1 -- 172.21.15.23:0/2776349739 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 msgr2=0x7f46a41028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:01.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.777+0000 7f46a8a00700 1 --2- 172.21.15.23:0/2776349739 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 0x7f46a41028a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4694009910 tx=0x7f4694009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:01.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.777+0000 7f46a8a00700 1 -- 172.21.15.23:0/2776349739 shutdown_connections 2024-02-28T16:26:01.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.777+0000 7f46a8a00700 1 --2- 172.21.15.23:0/2776349739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 0x7f46a4103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.777+0000 7f46a8a00700 1 --2- 172.21.15.23:0/2776349739 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 0x7f46a41028a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.777+0000 7f46a8a00700 1 -- 172.21.15.23:0/2776349739 >> 172.21.15.23:0/2776349739 conn(0x7f46a40fda60 msgr2=0x7f46a40ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:01.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.778+0000 7f46a8a00700 1 -- 172.21.15.23:0/2776349739 shutdown_connections 2024-02-28T16:26:01.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.778+0000 7f46a8a00700 1 -- 172.21.15.23:0/2776349739 wait complete. 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.779+0000 7f46a8a00700 1 Processor -- start 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.779+0000 7f46a8a00700 1 -- start start 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.779+0000 7f46a8a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 0x7f46a4197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.779+0000 7f46a8a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 0x7f46a41981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.779+0000 7f46a8a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a41987d0 con 0x7f46a4102490 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.779+0000 7f46a8a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a4198940 con 0x7f46a4103640 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.780+0000 7f46a1400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 0x7f46a41981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.780+0000 7f46a1400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 0x7f46a41981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:47806/0 (socket says 172.21.15.23:47806) 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.780+0000 7f46a1400700 1 -- 172.21.15.23:0/1613904539 learned_addr learned my addr 172.21.15.23:0/1613904539 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:01.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.780+0000 7f46a1e00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 0x7f46a4197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:01.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.780+0000 7f46a1400700 1 -- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 msgr2=0x7f46a4197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:01.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.781+0000 7f46a1400700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 0x7f46a4197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:01.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.781+0000 7f46a1400700 1 -- 172.21.15.23:0/1613904539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940095f0 con 0x7f46a4103640 2024-02-28T16:26:01.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.781+0000 7f46a1e00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 0x7f46a4197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:26:01.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.781+0000 7f46a1400700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 0x7f46a41981d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f469000c8a0 tx=0x7f469000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:01.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.782+0000 7f469aa00700 1 -- 172.21.15.23:0/1613904539 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f469000cea0 con 0x7f46a4103640 2024-02-28T16:26:01.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.782+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a419d3d0 con 0x7f46a4103640 2024-02-28T16:26:01.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.782+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a419d920 con 0x7f46a4103640 2024-02-28T16:26:01.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.782+0000 7f469aa00700 1 -- 172.21.15.23:0/1613904539 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4690004830 con 0x7f46a4103640 2024-02-28T16:26:01.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.782+0000 7f469aa00700 1 -- 172.21.15.23:0/1613904539 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46900055d0 con 0x7f46a4103640 2024-02-28T16:26:01.775 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.784+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4684005320 con 0x7f46a4103640 2024-02-28T16:26:01.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.785+0000 7f469aa00700 1 -- 172.21.15.23:0/1613904539 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 37) v1 ==== 91579+0+0 (secure 0 0 0) 0x7f4690007ad0 con 0x7f46a4103640 2024-02-28T16:26:01.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.786+0000 7f469aa00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f468806da20 0x7f468806fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:01.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.786+0000 7f469aa00700 1 -- 172.21.15.23:0/1613904539 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f469008d370 con 0x7f46a4103640 2024-02-28T16:26:01.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.787+0000 7f46a1e00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f468806da20 0x7f468806fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:01.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.788+0000 7f46a1e00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f468806da20 0x7f468806fed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f46a4198b70 tx=0x7f4694005fb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:01.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:01.800+0000 7f469aa00700 1 -- 172.21.15.23:0/1613904539 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f46900569d0 con 0x7f46a4103640 2024-02-28T16:26:01.793 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:01 smithi153 ceph-mon[35341]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:01.793 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:01 smithi153 ceph-mon[35341]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:01.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:01 smithi023 ceph-mon[78509]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:01.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:01 smithi023 ceph-mon[78509]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:02.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.160+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4684005cc0 con 0x7f46a4103640 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.161+0000 7f469aa00700 1 -- 172.21.15.23:0/1613904539 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1827 (secure 0 0 0) 0x7f469001d740 con 0x7f46a4103640 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:26:02.153 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:26:02.154 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:02.155 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:02.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.164+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f468806da20 msgr2=0x7f468806fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:02.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.164+0000 7f46a8a00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f468806da20 0x7f468806fed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f46a4198b70 tx=0x7f4694005fb0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.164+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 msgr2=0x7f46a41981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:02.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.164+0000 7f46a8a00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 0x7f46a41981d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f469000c8a0 tx=0x7f469000cc60 comp rx=0 tx=0).stop 2024-02-28T16:26:02.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.165+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 shutdown_connections 2024-02-28T16:26:02.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.165+0000 7f46a8a00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f468806da20 0x7f468806fed0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.165+0000 7f46a8a00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f46a4102490 0x7f46a4197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.165+0000 7f46a8a00700 1 --2- 172.21.15.23:0/1613904539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a4103640 0x7f46a41981d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.165+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 >> 172.21.15.23:0/1613904539 conn(0x7f46a40fda60 msgr2=0x7f46a4106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:02.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.166+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 shutdown_connections 2024-02-28T16:26:02.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.166+0000 7f46a8a00700 1 -- 172.21.15.23:0/1613904539 wait complete. 2024-02-28T16:26:02.157 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:26:02.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.382+0000 7f040a800700 1 -- 172.21.15.23:0/271781898 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 msgr2=0x7f04040fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:02.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.382+0000 7f040a800700 1 --2- 172.21.15.23:0/271781898 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 0x7f04040fef60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009910 tx=0x7f03f4009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:02.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.383+0000 7f040a800700 1 -- 172.21.15.23:0/271781898 shutdown_connections 2024-02-28T16:26:02.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.383+0000 7f040a800700 1 --2- 172.21.15.23:0/271781898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 0x7f04040ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.383+0000 7f040a800700 1 --2- 172.21.15.23:0/271781898 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 0x7f04040fef60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.383+0000 7f040a800700 1 -- 172.21.15.23:0/271781898 >> 172.21.15.23:0/271781898 conn(0x7f04040fa780 msgr2=0x7f04040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:02.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.384+0000 7f040a800700 1 -- 172.21.15.23:0/271781898 shutdown_connections 2024-02-28T16:26:02.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.384+0000 7f040a800700 1 -- 172.21.15.23:0/271781898 wait complete. 2024-02-28T16:26:02.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.387+0000 7f040a800700 1 Processor -- start 2024-02-28T16:26:02.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.389+0000 7f040a800700 1 -- start start 2024-02-28T16:26:02.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.392+0000 7f040a800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 0x7f0404071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:02.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.392+0000 7f040a800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 0x7f0404072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:02.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.392+0000 7f040a800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0404072990 con 0x7f04040feb50 2024-02-28T16:26:02.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.392+0000 7f040a800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0404072ad0 con 0x7f04040ff4a0 2024-02-28T16:26:02.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.394+0000 7f0402a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 0x7f0404072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:02.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.394+0000 7f0402a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 0x7f0404072370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:47812/0 (socket says 172.21.15.23:47812) 2024-02-28T16:26:02.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.394+0000 7f0402a00700 1 -- 172.21.15.23:0/105257699 learned_addr learned my addr 172.21.15.23:0/105257699 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:02.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.394+0000 7f0403400700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 0x7f0404071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:02.386 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.395+0000 7f0402a00700 1 -- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 msgr2=0x7f0404071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:02.386 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.395+0000 7f0402a00700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 0x7f0404071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.386 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.395+0000 7f0402a00700 1 -- 172.21.15.23:0/105257699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40095f0 con 0x7f04040ff4a0 2024-02-28T16:26:02.388 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.398+0000 7f0402a00700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 0x7f0404072370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03f000b4b0 tx=0x7f03f000b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:02.389 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.398+0000 7f03fbe00700 1 -- 172.21.15.23:0/105257699 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f0011800 con 0x7f04040ff4a0 2024-02-28T16:26:02.389 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.399+0000 7f03fbe00700 1 -- 172.21.15.23:0/105257699 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03f0011e10 con 0x7f04040ff4a0 2024-02-28T16:26:02.389 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.399+0000 7f03fbe00700 1 -- 172.21.15.23:0/105257699 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f000f2e0 con 0x7f04040ff4a0 2024-02-28T16:26:02.389 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.399+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0404103350 con 0x7f04040ff4a0 2024-02-28T16:26:02.390 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.399+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04041038a0 con 0x7f04040ff4a0 2024-02-28T16:26:02.392 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.402+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040410af70 con 0x7f04040ff4a0 2024-02-28T16:26:02.394 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.404+0000 7f03fbe00700 1 -- 172.21.15.23:0/105257699 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 37) v1 ==== 91579+0+0 (secure 0 0 0) 0x7f03f0010380 con 0x7f04040ff4a0 2024-02-28T16:26:02.396 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.405+0000 7f03fbe00700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03e806dae0 0x7f03e806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:02.396 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.405+0000 7f03fbe00700 1 -- 172.21.15.23:0/105257699 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f03f008d120 con 0x7f04040ff4a0 2024-02-28T16:26:02.398 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.408+0000 7f0403400700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03e806dae0 0x7f03e806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:02.399 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.409+0000 7f0403400700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03e806dae0 0x7f03e806ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03f4006010 tx=0x7f03f400b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:02.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.415+0000 7f03fbe00700 1 -- 172.21.15.23:0/105257699 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f03f005a3a0 con 0x7f04040ff4a0 2024-02-28T16:26:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:02 smithi153 ceph-mon[35341]: pgmap v8: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 606 KiB/s wr, 157 op/s 2024-02-28T16:26:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:02 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1206270958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:02 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1613904539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:26:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:02 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:02.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:02 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:02 smithi023 ceph-mon[78509]: pgmap v8: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 606 KiB/s wr, 157 op/s 2024-02-28T16:26:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:02 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1206270958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:02 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1613904539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:26:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:02 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:02 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:02.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.776+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04041034e0 con 0x7f03e806dae0 2024-02-28T16:26:02.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.778+0000 7f03fbe00700 1 -- 172.21.15.23:0/105257699 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f04041034e0 con 0x7f03e806dae0 2024-02-28T16:26:02.768 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "3/23 daemons upgraded", 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "", 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:26:02.769 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:26:02.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03e806dae0 msgr2=0x7f03e806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:02.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03e806dae0 0x7f03e806ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03f4006010 tx=0x7f03f400b560 comp rx=0 tx=0).stop 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 msgr2=0x7f0404072370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 0x7f0404072370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03f000b4b0 tx=0x7f03f000b7c0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 shutdown_connections 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03e806dae0 0x7f03e806ff90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04040feb50 0x7f0404071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 --2- 172.21.15.23:0/105257699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04040ff4a0 0x7f0404072370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 >> 172.21.15.23:0/105257699 conn(0x7f04040fa780 msgr2=0x7f0404107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:02.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.781+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 shutdown_connections 2024-02-28T16:26:02.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:02.782+0000 7f040a800700 1 -- 172.21.15.23:0/105257699 wait complete. 2024-02-28T16:26:03.011 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.021+0000 7f7f33e00700 1 -- 172.21.15.23:0/915370636 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7f34101200 msgr2=0x7f7f34103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:03.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.021+0000 7f7f33e00700 1 --2- 172.21.15.23:0/915370636 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7f34101200 0x7f7f34103680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009910 tx=0x7f7f1c009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:03.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.021+0000 7f7f33e00700 1 -- 172.21.15.23:0/915370636 shutdown_connections 2024-02-28T16:26:03.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.021+0000 7f7f33e00700 1 --2- 172.21.15.23:0/915370636 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7f34101200 0x7f7f34103680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:03.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.021+0000 7f7f33e00700 1 --2- 172.21.15.23:0/915370636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f340fe8a0 0x7f7f34100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:03.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.021+0000 7f7f33e00700 1 -- 172.21.15.23:0/915370636 >> 172.21.15.23:0/915370636 conn(0x7f7f340fa4d0 msgr2=0x7f7f340fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:03.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.022+0000 7f7f33e00700 1 -- 172.21.15.23:0/915370636 shutdown_connections 2024-02-28T16:26:03.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.022+0000 7f7f33e00700 1 -- 172.21.15.23:0/915370636 wait complete. 2024-02-28T16:26:03.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.023+0000 7f7f33e00700 1 Processor -- start 2024-02-28T16:26:03.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.024+0000 7f7f33e00700 1 -- start start 2024-02-28T16:26:03.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.024+0000 7f7f33e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7f340fe8a0 0x7f7f3419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:03.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.024+0000 7f7f33e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f34101200 0x7f7f3419c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:03.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.024+0000 7f7f33e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3419c970 con 0x7f7f340fe8a0 2024-02-28T16:26:03.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.024+0000 7f7f33e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3419cab0 con 0x7f7f34101200 2024-02-28T16:26:03.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.025+0000 7f7f2a000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f34101200 0x7f7f3419c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:03.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.025+0000 7f7f2a000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f34101200 0x7f7f3419c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:47822/0 (socket says 172.21.15.23:47822) 2024-02-28T16:26:03.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.025+0000 7f7f2a000700 1 -- 172.21.15.23:0/1336310272 learned_addr learned my addr 172.21.15.23:0/1336310272 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:03.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.025+0000 7f7f2a000700 1 -- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7f340fe8a0 msgr2=0x7f7f3419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:03.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.025+0000 7f7f2a000700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7f340fe8a0 0x7f7f3419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:03.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.025+0000 7f7f2a000700 1 -- 172.21.15.23:0/1336310272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0095f0 con 0x7f7f34101200 2024-02-28T16:26:03.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.026+0000 7f7f2a000700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f34101200 0x7f7f3419c350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0092e0 tx=0x7f7f1c00f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:03.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.026+0000 7f7f38a00700 1 -- 172.21.15.23:0/1336310272 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1c01d070 con 0x7f7f34101200 2024-02-28T16:26:03.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.026+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3406a8b0 con 0x7f7f34101200 2024-02-28T16:26:03.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.026+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3406ada0 con 0x7f7f34101200 2024-02-28T16:26:03.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.027+0000 7f7f38a00700 1 -- 172.21.15.23:0/1336310272 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f1c0052a0 con 0x7f7f34101200 2024-02-28T16:26:03.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.027+0000 7f7f38a00700 1 -- 172.21.15.23:0/1336310272 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1c017630 con 0x7f7f34101200 2024-02-28T16:26:03.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.028+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f10005320 con 0x7f7f34101200 2024-02-28T16:26:03.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.029+0000 7f7f38a00700 1 -- 172.21.15.23:0/1336310272 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 37) v1 ==== 91579+0+0 (secure 0 0 0) 0x7f7f1c00fba0 con 0x7f7f34101200 2024-02-28T16:26:03.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.031+0000 7f7f38a00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f7f1806d9d0 0x7f7f1806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:03.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.031+0000 7f7f38a00700 1 -- 172.21.15.23:0/1336310272 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7f1c08ecb0 con 0x7f7f34101200 2024-02-28T16:26:03.022 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.031+0000 7f7f32a00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f7f1806d9d0 0x7f7f1806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:03.022 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.032+0000 7f7f32a00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f7f1806d9d0 0x7f7f1806fe80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400e350 tx=0x7f7f2400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:03.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.035+0000 7f7f38a00700 1 -- 172.21.15.23:0/1336310272 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7f1c05bda0 con 0x7f7f34101200 2024-02-28T16:26:03.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.507+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f10005190 con 0x7f7f34101200 2024-02-28T16:26:03.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.507+0000 7f7f38a00700 1 -- 172.21.15.23:0/1336310272 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7f1c05b930 con 0x7f7f34101200 2024-02-28T16:26:03.498 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:26:03.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f7f1806d9d0 msgr2=0x7f7f1806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:03.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f7f1806d9d0 0x7f7f1806fe80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400e350 tx=0x7f7f2400b040 comp rx=0 tx=0).stop 2024-02-28T16:26:03.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f34101200 msgr2=0x7f7f3419c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:03.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f34101200 0x7f7f3419c350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0092e0 tx=0x7f7f1c00f740 comp rx=0 tx=0).stop 2024-02-28T16:26:03.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 shutdown_connections 2024-02-28T16:26:03.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f7f1806d9d0 0x7f7f1806fe80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:03.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7f340fe8a0 0x7f7f3419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:03.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 --2- 172.21.15.23:0/1336310272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f34101200 0x7f7f3419c350 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:03.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 >> 172.21.15.23:0/1336310272 conn(0x7f7f340fa4d0 msgr2=0x7f7f340fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:03.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 shutdown_connections 2024-02-28T16:26:03.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:03.510+0000 7f7f33e00700 1 -- 172.21.15.23:0/1336310272 wait complete. 2024-02-28T16:26:03.827 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:03 smithi153 ceph-mon[35341]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:03.827 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:03 smithi153 ceph-mon[35341]: from='client.? 172.21.15.23:0/1336310272' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:26:03.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:03 smithi023 ceph-mon[78509]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:03.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:03 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1336310272' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:26:04.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:04 smithi153 ceph-mon[35341]: pgmap v9: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 949 KiB/s wr, 280 op/s 2024-02-28T16:26:04.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:04 smithi023 ceph-mon[78509]: pgmap v9: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 949 KiB/s wr, 280 op/s 2024-02-28T16:26:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:05 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:05 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:05 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:05 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:26:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:05 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:26:06.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:05 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:26:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:26:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:05 smithi023 ceph-mon[78509]: Updating smithi023:/etc/ceph/ceph.conf 2024-02-28T16:26:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:05 smithi023 ceph-mon[78509]: Updating smithi153:/etc/ceph/ceph.conf 2024-02-28T16:26:06.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:06 smithi023 ceph-mon[78509]: pgmap v10: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 871 KiB/s wr, 257 op/s 2024-02-28T16:26:06.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:06 smithi023 ceph-mon[78509]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:26:06.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:06 smithi023 ceph-mon[78509]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:26:06.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:07.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:06 smithi153 ceph-mon[35341]: pgmap v10: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 871 KiB/s wr, 257 op/s 2024-02-28T16:26:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:06 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:26:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:06 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:26:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:06 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:07 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: Updating smithi023:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: Updating smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: Updating smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:09.116 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:08 smithi153 ceph-mon[35341]: pgmap v11: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 1.3 MiB/s wr, 469 op/s 2024-02-28T16:26:09.116 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:08 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:26:09.117 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:08 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:09.117 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:08 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:26:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:08 smithi023 ceph-mon[78509]: pgmap v11: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 1.3 MiB/s wr, 469 op/s 2024-02-28T16:26:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:26:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:26:11.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:10 smithi153 ceph-mon[35341]: pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 351 op/s 2024-02-28T16:26:11.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:10 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:11.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:10 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:26:11.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:10 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:26:11.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:10 smithi153 ceph-mon[35341]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:11.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:10 smithi023 ceph-mon[78509]: pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 351 op/s 2024-02-28T16:26:11.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:11.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:26:11.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:26:11.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:11.990 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:11 smithi153 ceph-mon[35341]: Upgrade: Updating mon.smithi153 2024-02-28T16:26:11.991 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:11 smithi153 ceph-mon[35341]: Deploying daemon mon.smithi153 on smithi153 2024-02-28T16:26:12.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:11 smithi023 ceph-mon[78509]: Upgrade: Updating mon.smithi153 2024-02-28T16:26:12.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:11 smithi023 ceph-mon[78509]: Deploying daemon mon.smithi153 on smithi153 2024-02-28T16:26:13.003 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:12 smithi153 ceph-mon[35341]: pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 351 op/s 2024-02-28T16:26:13.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:12 smithi023 ceph-mon[78509]: pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 351 op/s 2024-02-28T16:26:13.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:13 smithi153 systemd[1]: Stopping Ceph mon.smithi153 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:26:14.043 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:13 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153[35335]: 2024-02-28T16:26:13.666+0000 7efe98400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi153 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:26:14.044 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:13 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153[35335]: 2024-02-28T16:26:13.666+0000 7efe98400700 -1 mon.smithi153@1(peon) e2 *** Got Signal Terminated *** 2024-02-28T16:26:14.044 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:13 smithi153 podman[66177]: 2024-02-28 16:26:13.701859194 +0000 UTC m=+0.193554563 container stop e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=HEAD) 2024-02-28T16:26:14.044 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:13 smithi153 podman[66177]: 2024-02-28 16:26:13.728067681 +0000 UTC m=+0.219763047 container died e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20231212) 2024-02-28T16:26:14.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:14 smithi153 podman[66177]: 2024-02-28 16:26:14.194383433 +0000 UTC m=+0.686078824 container cleanup e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0) 2024-02-28T16:26:14.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:14 smithi153 bash[66177]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153 2024-02-28T16:26:14.886 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:14 smithi153 podman[66191]: 2024-02-28 16:26:14.462638539 +0000 UTC m=+0.739522369 container remove e8382734ae5b8c2f2075a002ceb356326c453d6c68d6619257db53b4c2094b64 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-28T16:26:15.294 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:14 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi153.service: Deactivated successfully. 2024-02-28T16:26:15.294 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:14 smithi153 systemd[1]: Stopped Ceph mon.smithi153 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:26:15.294 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:14 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi153.service: Consumed 16.297s CPU time. 2024-02-28T16:26:15.640 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:15 smithi153 systemd[1]: Starting Ceph mon.smithi153 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:26:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:15 smithi153 podman[66320]: 2024-02-28 16:26:15.55774667 +0000 UTC m=+0.034125512 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:26:15.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:15 smithi153 podman[66320]: 2024-02-28 16:26:15.672163872 +0000 UTC m=+0.148542737 container create 7b3873f5f7b3d142a33e26b60af04d9a2f7f7ffff2732df9cb859a1006d244b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-28T16:26:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 podman[66320]: 2024-02-28 16:26:16.218260056 +0000 UTC m=+0.694638984 container init 7b3873f5f7b3d142a33e26b60af04d9a2f7f7ffff2732df9cb859a1006d244b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:26:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 podman[66320]: 2024-02-28 16:26:16.229050499 +0000 UTC m=+0.705429334 container start 7b3873f5f7b3d142a33e26b60af04d9a2f7f7ffff2732df9cb859a1006d244b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:26:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: pidfile_write: ignore empty --pid-file 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: load: jerasure load: lrc 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Git sha 0 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: DB SUMMARY 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: DB Session ID: 1IVF57JFGUXZR3VE6K5G 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1383 Bytes 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi153/store.db dir, Total Num: 1, files: 000027.sst 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi153/store.db: 000025.log size: 7531647 ; 2024-02-28T16:26:16.648 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.env: 0x55fc358d5b20 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.info_log: 0x55fc3732f7c0 2024-02-28T16:26:16.649 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.statistics: (nil) 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.use_fsync: 0 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:26:16.650 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.db_log_dir: 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.wal_dir: 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.write_buffer_manager: 0x55fc37303400 2024-02-28T16:26:16.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.unordered_write: 0 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.row_cache: None 2024-02-28T16:26:16.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.wal_filter: None 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.wal_compression: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:26:16.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_open_files: -1 2024-02-28T16:26:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Compression algorithms supported: 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kZSTD supported: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:26:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000010 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.merge_operator: 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_filter: None 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fc3732f8e0) 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:26:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_type: 0 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_index_type: 0 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_shortening: 1 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: checksum: 4 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: no_block_cache: 0 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache: 0x55fc37333090 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_options: 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: capacity : 536870912 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: num_shard_bits : 4 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: strict_capacity_limit : 0 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_compressed: (nil) 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: persistent_cache: (nil) 2024-02-28T16:26:16.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size: 4096 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size_deviation: 10 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_restart_interval: 16 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_block_restart_interval: 1 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: metadata_block_size: 4096 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: partition_filters: 0 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: use_delta_encoding: 1 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: filter_policy: bloomfilter 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: whole_key_filtering: 1 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: verify_compression: 0 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: format_version: 5 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_index_compression: 1 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_align: 0 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_auto_readahead_size: 262144 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: prepopulate_block_cache: 0 2024-02-28T16:26:16.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:26:16.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression: NoCompression 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.num_levels: 7 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:26:16.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:26:16.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:26:16.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:26:16.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.ttl: 2592000 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:26:16.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12524, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-28T16:26:16.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 41ba2316-185e-431d-b6d1-b56e38d07cfa 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137576288388, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137576317120, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4537546, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12529, "largest_seqno": 15348, "table_properties": {"data_size": 4526922, "index_size": 6595, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3013, "raw_key_size": 25386, "raw_average_key_size": 21, "raw_value_size": 4503682, "raw_average_value_size": 3781, "num_data_blocks": 299, "num_entries": 1191, "num_filter_entries": 1191, "num_deletions": 253, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709137576, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "41ba2316-185e-431d-b6d1-b56e38d07cfa", "db_session_id": "1IVF57JFGUXZR3VE6K5G", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137576317488, "job": 1, "event": "recovery_finished"} 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi153/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fc37422000 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: DB pointer 0x55fc3740e000 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** DB Stats ** 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:26:16.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: L0 1/0 4.33 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 470.8 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: L6 1/0 5.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Sum 2/0 9.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 470.8 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 470.8 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:26:16.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 470.8 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative compaction: 0.00 GB write, 123.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:26:16.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval compaction: 0.00 GB write, 123.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Block cache BinnedLRUCache@0x55fc37333090#2 capacity: 512.00 MB usage: 9.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.8e-05 secs_since: 0 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.03 KB,0.000578165%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: starting mon.smithi153 rank 1 at public addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] at bind addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi153 fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???) e2 preinit fsid dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???).mds e16 new map 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???).mds e16 print_map 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: e16 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: legacy client fscid: 1 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Filesystem 'cephfs' (1) 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: fs_name cephfs 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: epoch 15 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: tableserver 0 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: root 0 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: session_timeout 60 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: session_autoclose 300 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_file_size 1099511627776 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_xattr_size 65536 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: required_client_features {} 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: last_failure 0 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: last_failure_osd_epoch 47 2024-02-28T16:26:16.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_mds 1 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: in 0 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: up {0=14476} 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: failed 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: damaged 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: stopped 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_pools [3] 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: metadata_pool 2 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: inline_data disabled 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: balancer 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: bal_rank_mask -1 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: standby_count_wanted 1 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Standby daemons: 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 ceph-mon[66339]: mon.smithi153@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 bash[66320]: 7b3873f5f7b3d142a33e26b60af04d9a2f7f7ffff2732df9cb859a1006d244b5 2024-02-28T16:26:16.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:16 smithi153 systemd[1]: Started Ceph mon.smithi153 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:26:18.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: mon.smithi153 calling monitor election 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: mon.smithi023 calling monitor election 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: mon.smithi023 is new leader, mons smithi023,smithi153 in quorum (ranks 0,1) 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: monmap e3: 2 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: osdmap e50: 6 total, 6 up, 6 in 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: mgrmap e37: smithi023.bbebnt(active, since 25s), standbys: smithi153.qlkchp 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: overall HEALTH_OK 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:18.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi023"}]: dispatch 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: mon.smithi153 calling monitor election 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: mon.smithi023 calling monitor election 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: mon.smithi023 is new leader, mons smithi023,smithi153 in quorum (ranks 0,1) 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: monmap e3: 2 mons at {smithi023=[v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:26:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: osdmap e50: 6 total, 6 up, 6 in 2024-02-28T16:26:18.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: mgrmap e37: smithi023.bbebnt(active, since 25s), standbys: smithi153.qlkchp 2024-02-28T16:26:18.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: overall HEALTH_OK 2024-02-28T16:26:18.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:18.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:18.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:26:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:18 smithi153 ceph-mon[66339]: pgmap v16: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 655 op/s 2024-02-28T16:26:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:18 smithi023 ceph-mon[78509]: pgmap v16: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 655 op/s 2024-02-28T16:26:21.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:20 smithi153 ceph-mon[66339]: pgmap v17: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 442 op/s 2024-02-28T16:26:21.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:20 smithi023 ceph-mon[78509]: pgmap v17: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 442 op/s 2024-02-28T16:26:22.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:22.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:22.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:23.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:22 smithi153 ceph-mon[66339]: pgmap v18: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 442 op/s 2024-02-28T16:26:23.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:22 smithi023 ceph-mon[78509]: pgmap v18: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 870 KiB/s wr, 442 op/s 2024-02-28T16:26:25.050 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:24 smithi153 ceph-mon[66339]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 635 op/s 2024-02-28T16:26:25.050 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:25.050 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:25.150 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:24 smithi023 ceph-mon[78509]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 635 op/s 2024-02-28T16:26:25.151 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:25.151 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:26.775 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:26 smithi153 ceph-mon[66339]: pgmap v20: 65 pgs: 65 active+clean; 252 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 788 KiB/s wr, 364 op/s 2024-02-28T16:26:26.981 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:26 smithi023 ceph-mon[78509]: pgmap v20: 65 pgs: 65 active+clean; 252 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 788 KiB/s wr, 364 op/s 2024-02-28T16:26:29.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: pgmap v21: 65 pgs: 65 active+clean; 248 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 461 op/s 2024-02-28T16:26:29.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:29.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:29.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:29.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:26:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:26:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:26:29.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:29.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: pgmap v21: 65 pgs: 65 active+clean; 248 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 461 op/s 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:26:29.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:30.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:29 smithi153 ceph-mon[66339]: Reconfiguring mon.smithi023 (monmap changed)... 2024-02-28T16:26:30.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:29 smithi153 ceph-mon[66339]: Reconfiguring daemon mon.smithi023 on smithi023 2024-02-28T16:26:30.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:29 smithi023 ceph-mon[78509]: Reconfiguring mon.smithi023 (monmap changed)... 2024-02-28T16:26:30.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:29 smithi023 ceph-mon[78509]: Reconfiguring daemon mon.smithi023 on smithi023 2024-02-28T16:26:31.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:30 smithi153 ceph-mon[66339]: pgmap v22: 65 pgs: 65 active+clean; 248 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 685 KiB/s wr, 289 op/s 2024-02-28T16:26:31.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:30 smithi023 ceph-mon[78509]: pgmap v22: 65 pgs: 65 active+clean; 248 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 685 KiB/s wr, 289 op/s 2024-02-28T16:26:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: pgmap v23: 65 pgs: 65 active+clean; 248 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 686 KiB/s wr, 289 op/s 2024-02-28T16:26:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: Reconfiguring mgr.smithi023.bbebnt (monmap changed)... 2024-02-28T16:26:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:26:32.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:26:32.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:32.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:32 smithi153 ceph-mon[66339]: Reconfiguring daemon mgr.smithi023.bbebnt on smithi023 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: pgmap v23: 65 pgs: 65 active+clean; 248 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 686 KiB/s wr, 289 op/s 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: Reconfiguring mgr.smithi023.bbebnt (monmap changed)... 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi023.bbebnt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:32 smithi023 ceph-mon[78509]: Reconfiguring daemon mgr.smithi023.bbebnt on smithi023 2024-02-28T16:26:33.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.708+0000 7f2ebe600700 1 -- 172.21.15.23:0/241339517 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 msgr2=0x7f2eb8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:33.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.708+0000 7f2ebe600700 1 --2- 172.21.15.23:0/241339517 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8101890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009910 tx=0x7f2ea4009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:33.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.709+0000 7f2ebe600700 1 -- 172.21.15.23:0/241339517 shutdown_connections 2024-02-28T16:26:33.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.709+0000 7f2ebe600700 1 --2- 172.21.15.23:0/241339517 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8101890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:33.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.709+0000 7f2ebe600700 1 --2- 172.21.15.23:0/241339517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eb8100240 0x7f2eb8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:33.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.709+0000 7f2ebe600700 1 -- 172.21.15.23:0/241339517 >> 172.21.15.23:0/241339517 conn(0x7f2eb80fb7f0 msgr2=0x7f2eb80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:33.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.709+0000 7f2ebe600700 1 -- 172.21.15.23:0/241339517 shutdown_connections 2024-02-28T16:26:33.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.709+0000 7f2ebe600700 1 -- 172.21.15.23:0/241339517 wait complete. 2024-02-28T16:26:33.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.710+0000 7f2ebe600700 1 Processor -- start 2024-02-28T16:26:33.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.711+0000 7f2ebe600700 1 -- start start 2024-02-28T16:26:33.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.711+0000 7f2ebe600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eb8100240 0x7f2eb8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:33.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.711+0000 7f2ebe600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:33.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.711+0000 7f2ebe600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8073680 con 0x7f2eb8101440 2024-02-28T16:26:33.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.711+0000 7f2ebe600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb80737c0 con 0x7f2eb8100240 2024-02-28T16:26:33.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.712+0000 7f2eb6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:33.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.712+0000 7f2eb7400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eb8100240 0x7f2eb8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:33.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.712+0000 7f2eb6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39122/0 (socket says 172.21.15.23:39122) 2024-02-28T16:26:33.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.712+0000 7f2eb6a00700 1 -- 172.21.15.23:0/4128975818 learned_addr learned my addr 172.21.15.23:0/4128975818 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:33.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.712+0000 7f2eb6a00700 1 -- 172.21.15.23:0/4128975818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eb8100240 msgr2=0x7f2eb8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:33.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.712+0000 7f2eb6a00700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eb8100240 0x7f2eb8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:33.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.712+0000 7f2eb6a00700 1 -- 172.21.15.23:0/4128975818 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea40095f0 con 0x7f2eb8101440 2024-02-28T16:26:33.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.713+0000 7f2eb6a00700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8073140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005b40 tx=0x7f2ea400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:33.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.713+0000 7f2eafe00700 1 -- 172.21.15.23:0/4128975818 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea401d070 con 0x7f2eb8101440 2024-02-28T16:26:33.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.713+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb8073a40 con 0x7f2eb8101440 2024-02-28T16:26:33.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.714+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8073f30 con 0x7f2eb8101440 2024-02-28T16:26:33.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.714+0000 7f2eafe00700 1 -- 172.21.15.23:0/4128975818 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ea400f460 con 0x7f2eb8101440 2024-02-28T16:26:33.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.714+0000 7f2eafe00700 1 -- 172.21.15.23:0/4128975818 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea4021620 con 0x7f2eb8101440 2024-02-28T16:26:33.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.716+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e98005320 con 0x7f2eb8101440 2024-02-28T16:26:33.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.717+0000 7f2eafe00700 1 -- 172.21.15.23:0/4128975818 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f2ea402b440 con 0x7f2eb8101440 2024-02-28T16:26:33.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.719+0000 7f2eafe00700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2e9c06d9d0 0x7f2e9c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:33.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.720+0000 7f2eafe00700 1 -- 172.21.15.23:0/4128975818 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2ea408e8c0 con 0x7f2eb8101440 2024-02-28T16:26:33.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.720+0000 7f2eb7400700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2e9c06d9d0 0x7f2e9c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:33.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.721+0000 7f2eb7400700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2e9c06d9d0 0x7f2e9c06fe80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2eb81012a0 tx=0x7f2ea800b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:33.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:33.726+0000 7f2eafe00700 1 -- 172.21.15.23:0/4128975818 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2ea405b9b0 con 0x7f2eb8101440 2024-02-28T16:26:34.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.151+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e98000bf0 con 0x7f2e9c06d9d0 2024-02-28T16:26:34.142 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.153+0000 7f2eafe00700 1 -- 172.21.15.23:0/4128975818 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f2e98000bf0 con 0x7f2e9c06d9d0 2024-02-28T16:26:34.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2e9c06d9d0 msgr2=0x7f2e9c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2e9c06d9d0 0x7f2e9c06fe80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2eb81012a0 tx=0x7f2ea800b410 comp rx=0 tx=0).stop 2024-02-28T16:26:34.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 msgr2=0x7f2eb8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8073140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005b40 tx=0x7f2ea400bd70 comp rx=0 tx=0).stop 2024-02-28T16:26:34.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 shutdown_connections 2024-02-28T16:26:34.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2eb8100240 0x7f2eb8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2e9c06d9d0 0x7f2e9c06fe80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 --2- 172.21.15.23:0/4128975818 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2eb8101440 0x7f2eb8073140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.156+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 >> 172.21.15.23:0/4128975818 conn(0x7f2eb80fb7f0 msgr2=0x7f2eb8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:34.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.157+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 shutdown_connections 2024-02-28T16:26:34.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.157+0000 7f2ebe600700 1 -- 172.21.15.23:0/4128975818 wait complete. 2024-02-28T16:26:34.166 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:26:34.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 -- 172.21.15.23:0/1481222396 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10100240 msgr2=0x7f0e10100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 --2- 172.21.15.23:0/1481222396 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10100240 0x7f0e10100650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e00009910 tx=0x7f0e00009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:34.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 -- 172.21.15.23:0/1481222396 shutdown_connections 2024-02-28T16:26:34.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 --2- 172.21.15.23:0/1481222396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e10101440 0x7f0e10101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 --2- 172.21.15.23:0/1481222396 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10100240 0x7f0e10100650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 -- 172.21.15.23:0/1481222396 >> 172.21.15.23:0/1481222396 conn(0x7f0e100fb7f0 msgr2=0x7f0e100fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:34.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 -- 172.21.15.23:0/1481222396 shutdown_connections 2024-02-28T16:26:34.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.361+0000 7f0e14c00700 1 -- 172.21.15.23:0/1481222396 wait complete. 2024-02-28T16:26:34.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.362+0000 7f0e14c00700 1 Processor -- start 2024-02-28T16:26:34.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.362+0000 7f0e14c00700 1 -- start start 2024-02-28T16:26:34.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.363+0000 7f0e14c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e10100240 0x7f0e10197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:34.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.363+0000 7f0e14c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10101440 0x7f0e101981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:34.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.363+0000 7f0e14c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e101987f0 con 0x7f0e10101440 2024-02-28T16:26:34.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.363+0000 7f0e14c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e10198960 con 0x7f0e10100240 2024-02-28T16:26:34.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.363+0000 7f0e0d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10101440 0x7f0e101981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:34.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.363+0000 7f0e0d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10101440 0x7f0e101981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39142/0 (socket says 172.21.15.23:39142) 2024-02-28T16:26:34.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.363+0000 7f0e0d400700 1 -- 172.21.15.23:0/2038412761 learned_addr learned my addr 172.21.15.23:0/2038412761 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:34.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.364+0000 7f0e0de00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e10100240 0x7f0e10197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:34.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.364+0000 7f0e0d400700 1 -- 172.21.15.23:0/2038412761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e10100240 msgr2=0x7f0e10197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.364+0000 7f0e0d400700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e10100240 0x7f0e10197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.364+0000 7f0e0d400700 1 -- 172.21.15.23:0/2038412761 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e000095f0 con 0x7f0e10101440 2024-02-28T16:26:34.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.364+0000 7f0e0d400700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10101440 0x7f0e101981f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00d8d0 tx=0x7f0dfc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:34.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.365+0000 7f0e06a00700 1 -- 172.21.15.23:0/2038412761 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dfc009940 con 0x7f0e10101440 2024-02-28T16:26:34.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.365+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1006a910 con 0x7f0e10101440 2024-02-28T16:26:34.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.365+0000 7f0e06a00700 1 -- 172.21.15.23:0/2038412761 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc010460 con 0x7f0e10101440 2024-02-28T16:26:34.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.365+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1006ae60 con 0x7f0e10101440 2024-02-28T16:26:34.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.366+0000 7f0e06a00700 1 -- 172.21.15.23:0/2038412761 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dfc009c70 con 0x7f0e10101440 2024-02-28T16:26:34.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.367+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e10105520 con 0x7f0e10101440 2024-02-28T16:26:34.360 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.370+0000 7f0e06a00700 1 -- 172.21.15.23:0/2038412761 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f0dfc010940 con 0x7f0e10101440 2024-02-28T16:26:34.360 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.371+0000 7f0e06a00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0df406d9d0 0x7f0df406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:34.361 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.371+0000 7f0e06a00700 1 -- 172.21.15.23:0/2038412761 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0dfc08d2c0 con 0x7f0e10101440 2024-02-28T16:26:34.361 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.372+0000 7f0e0de00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0df406d9d0 0x7f0df406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:34.362 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.373+0000 7f0e0de00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0df406d9d0 0x7f0df406fe80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e00005090 tx=0x7f0e0000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:34.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.377+0000 7f0e06a00700 1 -- 172.21.15.23:0/2038412761 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0dfc0569b0 con 0x7f0e10101440 2024-02-28T16:26:34.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.736+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e10061190 con 0x7f0df406d9d0 2024-02-28T16:26:34.728 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.739+0000 7f0e06a00700 1 -- 172.21.15.23:0/2038412761 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f0e10061190 con 0x7f0df406d9d0 2024-02-28T16:26:34.731 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.742+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0df406d9d0 msgr2=0x7f0df406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.742+0000 7f0e14c00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0df406d9d0 0x7f0df406fe80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e00005090 tx=0x7f0e0000b540 comp rx=0 tx=0).stop 2024-02-28T16:26:34.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.742+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10101440 msgr2=0x7f0e101981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.742+0000 7f0e14c00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10101440 0x7f0e101981f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00d8d0 tx=0x7f0dfc00dc90 comp rx=0 tx=0).stop 2024-02-28T16:26:34.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.743+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 shutdown_connections 2024-02-28T16:26:34.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.743+0000 7f0e14c00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e10100240 0x7f0e10197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.743+0000 7f0e14c00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0df406d9d0 0x7f0df406fe80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.743+0000 7f0e14c00700 1 --2- 172.21.15.23:0/2038412761 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0e10101440 0x7f0e101981f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.743+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 >> 172.21.15.23:0/2038412761 conn(0x7f0e100fb7f0 msgr2=0x7f0e10102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:34.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.743+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 shutdown_connections 2024-02-28T16:26:34.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.743+0000 7f0e14c00700 1 -- 172.21.15.23:0/2038412761 wait complete. 2024-02-28T16:26:34.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 -- 172.21.15.23:0/323072889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0100240 msgr2=0x7f9ce0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/323072889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0100240 0x7f9ce0100650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400fae0 tx=0x7f9cd400fdf0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 -- 172.21.15.23:0/323072889 shutdown_connections 2024-02-28T16:26:34.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/323072889 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ce0101440 0x7f9ce0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/323072889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0100240 0x7f9ce0100650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 -- 172.21.15.23:0/323072889 >> 172.21.15.23:0/323072889 conn(0x7f9ce00fb7f0 msgr2=0x7f9ce00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:34.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 -- 172.21.15.23:0/323072889 shutdown_connections 2024-02-28T16:26:34.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.951+0000 7f9ce7e00700 1 -- 172.21.15.23:0/323072889 wait complete. 2024-02-28T16:26:34.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.952+0000 7f9ce7e00700 1 Processor -- start 2024-02-28T16:26:34.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.953+0000 7f9ce7e00700 1 -- start start 2024-02-28T16:26:34.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.953+0000 7f9ce7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ce0100240 0x7f9ce01938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.953+0000 7f9ce7e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0101440 0x7f9ce0193de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.953+0000 7f9ce7e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce0194400 con 0x7f9ce0100240 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.953+0000 7f9ce7e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce0194540 con 0x7f9ce0101440 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.954+0000 7f9ce5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ce0100240 0x7f9ce01938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.954+0000 7f9ce5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ce0100240 0x7f9ce01938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39154/0 (socket says 172.21.15.23:39154) 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.954+0000 7f9ce5400700 1 -- 172.21.15.23:0/1877146729 learned_addr learned my addr 172.21.15.23:0/1877146729 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.954+0000 7f9ce4a00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0101440 0x7f9ce0193de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.955+0000 7f9ce4a00700 1 -- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ce0100240 msgr2=0x7f9ce01938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.955+0000 7f9ce4a00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ce0100240 0x7f9ce01938a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.955+0000 7f9ce4a00700 1 -- 172.21.15.23:0/1877146729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd400f790 con 0x7f9ce0101440 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.955+0000 7f9ce4a00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0101440 0x7f9ce0193de0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00e940 tx=0x7f9ccc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:34.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.956+0000 7f9cde000700 1 -- 172.21.15.23:0/1877146729 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc00c990 con 0x7f9ce0101440 2024-02-28T16:26:34.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.956+0000 7f9cde000700 1 -- 172.21.15.23:0/1877146729 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ccc010430 con 0x7f9ce0101440 2024-02-28T16:26:34.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.956+0000 7f9cde000700 1 -- 172.21.15.23:0/1877146729 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc018610 con 0x7f9ce0101440 2024-02-28T16:26:34.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.957+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce0198ff0 con 0x7f9ce0101440 2024-02-28T16:26:34.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.957+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce0199510 con 0x7f9ce0101440 2024-02-28T16:26:34.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.959+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce0106bc0 con 0x7f9ce0101440 2024-02-28T16:26:34.953 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.962+0000 7f9cde000700 1 -- 172.21.15.23:0/1877146729 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f9ccc0105a0 con 0x7f9ce0101440 2024-02-28T16:26:34.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.966+0000 7f9cde000700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9cc806da10 0x7f9cc806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:34.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.966+0000 7f9cde000700 1 -- 172.21.15.23:0/1877146729 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9ccc014070 con 0x7f9ce0101440 2024-02-28T16:26:34.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.967+0000 7f9ce5400700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9cc806da10 0x7f9cc806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:34.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.968+0000 7f9ce5400700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9cc806da10 0x7f9cc806fec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f760 tx=0x7f9cd40096e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:34.962 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:34.973+0000 7f9cde000700 1 -- 172.21.15.23:0/1877146729 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ccc05aad0 con 0x7f9ce0101440 2024-02-28T16:26:35.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.322+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ce0105d90 con 0x7f9cc806da10 2024-02-28T16:26:35.312 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: pgmap v24: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 395 op/s 2024-02-28T16:26:35.312 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:35.312 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:35.312 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:35.313 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:35.313 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T16:26:35.313 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi023"}]: dispatch 2024-02-28T16:26:35.313 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:35.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.340+0000 7f9cde000700 1 -- 172.21.15.23:0/1877146729 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9ce0105d90 con 0x7f9cc806da10 2024-02-28T16:26:35.330 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:26:35.330 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (11m) 35s ago 13m 14.1M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:26:35.330 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (13m) 35s ago 13m 7936k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (12m) 13s ago 12m 7642k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (13m) 35s ago 13m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (12m) 13s ago 12m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (11m) 35s ago 13m 73.0M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (6m) 35s ago 6m 207M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (6m) 35s ago 6m 15.2M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (6m) 13s ago 6m 15.2M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (6m) 13s ago 6m 15.5M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (2m) 35s ago 15m 477M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (83s) 13s ago 12m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (60s) 35s ago 15m 30.8M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:26:35.331 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (19s) 13s ago 12m 23.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (13m) 35s ago 13m 8014k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (12m) 13s ago 12m 7910k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (11m) 35s ago 11m 209M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (10m) 35s ago 10m 217M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (9m) 35s ago 9m 174M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (9m) 13s ago 9m 257M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (8m) 13s ago 8m 240M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (8m) 13s ago 8m 217M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:26:35.332 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (91s) 35s ago 12m 47.0M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:26:35.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.343+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9cc806da10 msgr2=0x7f9cc806fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:35.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.343+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9cc806da10 0x7f9cc806fec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f760 tx=0x7f9cd40096e0 comp rx=0 tx=0).stop 2024-02-28T16:26:35.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.343+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0101440 msgr2=0x7f9ce0193de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:35.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.343+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0101440 0x7f9ce0193de0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00e940 tx=0x7f9ccc00ec50 comp rx=0 tx=0).stop 2024-02-28T16:26:35.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.344+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 shutdown_connections 2024-02-28T16:26:35.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.344+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9cc806da10 0x7f9cc806fec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:35.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.344+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ce0100240 0x7f9ce01938a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:35.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.344+0000 7f9ce7e00700 1 --2- 172.21.15.23:0/1877146729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce0101440 0x7f9ce0193de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:35.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.344+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 >> 172.21.15.23:0/1877146729 conn(0x7f9ce00fb7f0 msgr2=0x7f9ce0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:35.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.344+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 shutdown_connections 2024-02-28T16:26:35.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.344+0000 7f9ce7e00700 1 -- 172.21.15.23:0/1877146729 wait complete. 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: pgmap v24: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 395 op/s 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi023"}]: dispatch 2024-02-28T16:26:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:35.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.518+0000 7f38d1400700 1 -- 172.21.15.23:0/984231080 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 msgr2=0x7f38cc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:35.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.518+0000 7f38d1400700 1 --2- 172.21.15.23:0/984231080 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc101890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009910 tx=0x7f38b8009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:35.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.519+0000 7f38d1400700 1 -- 172.21.15.23:0/984231080 shutdown_connections 2024-02-28T16:26:35.509 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.519+0000 7f38d1400700 1 --2- 172.21.15.23:0/984231080 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc101890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:35.509 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.519+0000 7f38d1400700 1 --2- 172.21.15.23:0/984231080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38cc100240 0x7f38cc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:35.509 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.519+0000 7f38d1400700 1 -- 172.21.15.23:0/984231080 >> 172.21.15.23:0/984231080 conn(0x7f38cc0fb7f0 msgr2=0x7f38cc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:35.509 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.519+0000 7f38d1400700 1 -- 172.21.15.23:0/984231080 shutdown_connections 2024-02-28T16:26:35.509 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.519+0000 7f38d1400700 1 -- 172.21.15.23:0/984231080 wait complete. 2024-02-28T16:26:35.509 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.520+0000 7f38d1400700 1 Processor -- start 2024-02-28T16:26:35.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.520+0000 7f38d1400700 1 -- start start 2024-02-28T16:26:35.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38d1400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38cc100240 0x7f38cc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:35.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38d1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:35.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38d1400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc199700 con 0x7f38cc101440 2024-02-28T16:26:35.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38d1400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc199840 con 0x7f38cc100240 2024-02-28T16:26:35.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38c9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:35.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38c9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39184/0 (socket says 172.21.15.23:39184) 2024-02-28T16:26:35.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38c9e00700 1 -- 172.21.15.23:0/2112448950 learned_addr learned my addr 172.21.15.23:0/2112448950 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:35.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.521+0000 7f38ca800700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38cc100240 0x7f38cc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:35.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38c9e00700 1 -- 172.21.15.23:0/2112448950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38cc100240 msgr2=0x7f38cc074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:35.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38c9e00700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38cc100240 0x7f38cc074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:35.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38c9e00700 1 -- 172.21.15.23:0/2112448950 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b80095f0 con 0x7f38cc101440 2024-02-28T16:26:35.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38ca800700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38cc100240 0x7f38cc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:26:35.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38c9e00700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc073140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f38b800b5c0 tx=0x7f38b800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:35.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38c3400700 1 -- 172.21.15.23:0/2112448950 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b801d070 con 0x7f38cc101440 2024-02-28T16:26:35.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38c3400700 1 -- 172.21.15.23:0/2112448950 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f38b800f460 con 0x7f38cc101440 2024-02-28T16:26:35.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.522+0000 7f38c3400700 1 -- 172.21.15.23:0/2112448950 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b8021640 con 0x7f38cc101440 2024-02-28T16:26:35.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.523+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc199ac0 con 0x7f38cc101440 2024-02-28T16:26:35.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.523+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc199f80 con 0x7f38cc101440 2024-02-28T16:26:35.514 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.524+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc108d90 con 0x7f38cc101440 2024-02-28T16:26:35.515 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.526+0000 7f38c3400700 1 -- 172.21.15.23:0/2112448950 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f38b800f5d0 con 0x7f38cc101440 2024-02-28T16:26:35.516 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.527+0000 7f38c3400700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f38b006d9d0 0x7f38b006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:35.517 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.528+0000 7f38ca800700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f38b006d9d0 0x7f38b006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:35.517 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.528+0000 7f38c3400700 1 -- 172.21.15.23:0/2112448950 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f38b808e670 con 0x7f38cc101440 2024-02-28T16:26:35.518 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.529+0000 7f38ca800700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f38b006d9d0 0x7f38b006fe80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38bc005950 tx=0x7f38bc0058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:35.522 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:35.533+0000 7f38c3400700 1 -- 172.21.15.23:0/2112448950 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f38b805b760 con 0x7f38cc101440 2024-02-28T16:26:36.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.037+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f38cc108fb0 con 0x7f38cc101440 2024-02-28T16:26:36.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.039+0000 7f38c3400700 1 -- 172.21.15.23:0/2112448950 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f38b805b2f0 con 0x7f38cc101440 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:26:36.029 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:26:36.030 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.043+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f38b006d9d0 msgr2=0x7f38b006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.043+0000 7f38d1400700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f38b006d9d0 0x7f38b006fe80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38bc005950 tx=0x7f38bc0058e0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.043+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 msgr2=0x7f38cc073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.043+0000 7f38d1400700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc073140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f38b800b5c0 tx=0x7f38b800be20 comp rx=0 tx=0).stop 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.044+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 shutdown_connections 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.044+0000 7f38d1400700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38cc100240 0x7f38cc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.044+0000 7f38d1400700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f38b006d9d0 0x7f38b006fe80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.044+0000 7f38d1400700 1 --2- 172.21.15.23:0/2112448950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f38cc101440 0x7f38cc073140 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.044+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 >> 172.21.15.23:0/2112448950 conn(0x7f38cc0fb7f0 msgr2=0x7f38cc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:36.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.044+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 shutdown_connections 2024-02-28T16:26:36.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.044+0000 7f38d1400700 1 -- 172.21.15.23:0/2112448950 wait complete. 2024-02-28T16:26:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:36 smithi023 ceph-mon[78509]: Reconfiguring ceph-exporter.smithi023 (monmap changed)... 2024-02-28T16:26:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:36 smithi023 ceph-mon[78509]: Unable to update caps for client.ceph-exporter.smithi023 2024-02-28T16:26:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:36 smithi023 ceph-mon[78509]: Reconfiguring daemon ceph-exporter.smithi023 on smithi023 2024-02-28T16:26:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:36 smithi023 ceph-mon[78509]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:36 smithi023 ceph-mon[78509]: from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:36 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2112448950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.251+0000 7f8ed7600700 1 -- 172.21.15.23:0/3800984226 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 msgr2=0x7f8ed0107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.251+0000 7f8ed7600700 1 --2- 172.21.15.23:0/3800984226 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed0107d50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009910 tx=0x7f8eb8009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.251+0000 7f8ed7600700 1 -- 172.21.15.23:0/3800984226 shutdown_connections 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.251+0000 7f8ed7600700 1 --2- 172.21.15.23:0/3800984226 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed0107d50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.251+0000 7f8ed7600700 1 --2- 172.21.15.23:0/3800984226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed0071e00 0x7f8ed0072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.251+0000 7f8ed7600700 1 -- 172.21.15.23:0/3800984226 >> 172.21.15.23:0/3800984226 conn(0x7f8ed006d110 msgr2=0x7f8ed006f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.252+0000 7f8ed7600700 1 -- 172.21.15.23:0/3800984226 shutdown_connections 2024-02-28T16:26:36.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.252+0000 7f8ed7600700 1 -- 172.21.15.23:0/3800984226 wait complete. 2024-02-28T16:26:36.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.253+0000 7f8ed7600700 1 Processor -- start 2024-02-28T16:26:36.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.253+0000 7f8ed7600700 1 -- start start 2024-02-28T16:26:36.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ed7600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed0071e00 0x7f8ed019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:36.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ed7600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:36.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ed7600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed019cc30 con 0x7f8ed0072750 2024-02-28T16:26:36.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ed7600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed019cd70 con 0x7f8ed0071e00 2024-02-28T16:26:36.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ec7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:36.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ec7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39194/0 (socket says 172.21.15.23:39194) 2024-02-28T16:26:36.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ec7e00700 1 -- 172.21.15.23:0/1026825805 learned_addr learned my addr 172.21.15.23:0/1026825805 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:36.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.254+0000 7f8ed4c00700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed0071e00 0x7f8ed019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.255+0000 7f8ec7e00700 1 -- 172.21.15.23:0/1026825805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed0071e00 msgr2=0x7f8ed019c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.255+0000 7f8ec7e00700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed0071e00 0x7f8ed019c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.255+0000 7f8ec7e00700 1 -- 172.21.15.23:0/1026825805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80095f0 con 0x7f8ed0072750 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.255+0000 7f8ec7e00700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed019c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8000c00 tx=0x7f8eb800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.255+0000 7f8ece000700 1 -- 172.21.15.23:0/1026825805 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb801d070 con 0x7f8ed0072750 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.255+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed01a17c0 con 0x7f8ed0072750 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.255+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed01a1cb0 con 0x7f8ed0072750 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.256+0000 7f8ece000700 1 -- 172.21.15.23:0/1026825805 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8eb8005dc0 con 0x7f8ed0072750 2024-02-28T16:26:36.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.256+0000 7f8ece000700 1 -- 172.21.15.23:0/1026825805 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb8022470 con 0x7f8ed0072750 2024-02-28T16:26:36.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.257+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac005320 con 0x7f8ed0072750 2024-02-28T16:26:36.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.258+0000 7f8ece000700 1 -- 172.21.15.23:0/1026825805 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f8eb8003680 con 0x7f8ed0072750 2024-02-28T16:26:36.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.259+0000 7f8ece000700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f8eb4071dd0 0x7f8eb4074280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:36.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.260+0000 7f8ece000700 1 -- 172.21.15.23:0/1026825805 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8eb808ee70 con 0x7f8ed0072750 2024-02-28T16:26:36.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.260+0000 7f8ed4c00700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f8eb4071dd0 0x7f8eb4074280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:36.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.261+0000 7f8ed4c00700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f8eb4071dd0 0x7f8eb4074280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009300 tx=0x7f8ec000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:36.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.269+0000 7f8ece000700 1 -- 172.21.15.23:0/1026825805 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8eb805c0a0 con 0x7f8ed0072750 2024-02-28T16:26:36.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:36 smithi153 ceph-mon[66339]: Reconfiguring ceph-exporter.smithi023 (monmap changed)... 2024-02-28T16:26:36.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:36 smithi153 ceph-mon[66339]: Unable to update caps for client.ceph-exporter.smithi023 2024-02-28T16:26:36.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:36 smithi153 ceph-mon[66339]: Reconfiguring daemon ceph-exporter.smithi023 on smithi023 2024-02-28T16:26:36.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:36 smithi153 ceph-mon[66339]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:36.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:36 smithi153 ceph-mon[66339]: from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:36.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:36 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2112448950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:36.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.639+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8eac005cc0 con 0x7f8ed0072750 2024-02-28T16:26:36.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.640+0000 7f8ece000700 1 -- 172.21.15.23:0/1026825805 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f8eb805bc30 con 0x7f8ed0072750 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:26:36.630 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:26:36.631 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:36.632 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:36.633 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:26:36.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.643+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f8eb4071dd0 msgr2=0x7f8eb4074280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.643+0000 7f8ed7600700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f8eb4071dd0 0x7f8eb4074280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009300 tx=0x7f8ec000b040 comp rx=0 tx=0).stop 2024-02-28T16:26:36.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.643+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 msgr2=0x7f8ed019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.643+0000 7f8ed7600700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed019c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8000c00 tx=0x7f8eb800f740 comp rx=0 tx=0).stop 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.644+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 shutdown_connections 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.644+0000 7f8ed7600700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed0071e00 0x7f8ed019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.644+0000 7f8ed7600700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f8eb4071dd0 0x7f8eb4074280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.644+0000 7f8ed7600700 1 --2- 172.21.15.23:0/1026825805 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8ed0072750 0x7f8ed019c610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.644+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 >> 172.21.15.23:0/1026825805 conn(0x7f8ed006d110 msgr2=0x7f8ed010d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.644+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 shutdown_connections 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.644+0000 7f8ed7600700 1 -- 172.21.15.23:0/1026825805 wait complete. 2024-02-28T16:26:36.634 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:26:36.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.811+0000 7f08e5000700 1 -- 172.21.15.23:0/3441693758 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e0103310 msgr2=0x7f08e0105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.811+0000 7f08e5000700 1 --2- 172.21.15.23:0/3441693758 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e0103310 0x7f08e0105790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009910 tx=0x7f08cc009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:36.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.811+0000 7f08e5000700 1 -- 172.21.15.23:0/3441693758 shutdown_connections 2024-02-28T16:26:36.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.811+0000 7f08e5000700 1 --2- 172.21.15.23:0/3441693758 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e0103310 0x7f08e0105790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.811+0000 7f08e5000700 1 --2- 172.21.15.23:0/3441693758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08e0069270 0x7f08e0102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.801 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.811+0000 7f08e5000700 1 -- 172.21.15.23:0/3441693758 >> 172.21.15.23:0/3441693758 conn(0x7f08e00fa780 msgr2=0x7f08e00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:36.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.812+0000 7f08e5000700 1 -- 172.21.15.23:0/3441693758 shutdown_connections 2024-02-28T16:26:36.802 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.812+0000 7f08e5000700 1 -- 172.21.15.23:0/3441693758 wait complete. 2024-02-28T16:26:36.804 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.814+0000 7f08e5000700 1 Processor -- start 2024-02-28T16:26:36.804 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.815+0000 7f08e5000700 1 -- start start 2024-02-28T16:26:36.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.815+0000 7f08e5000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08e0103310 0x7f08e019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:36.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.815+0000 7f08e5000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e019c620 0x7f08e01a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:36.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.815+0000 7f08e5000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e019cb20 con 0x7f08e019c620 2024-02-28T16:26:36.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.815+0000 7f08e5000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e019cc90 con 0x7f08e0103310 2024-02-28T16:26:36.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.815+0000 7f08dd400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e019c620 0x7f08e01a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:36.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.816+0000 7f08dd400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e019c620 0x7f08e01a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39204/0 (socket says 172.21.15.23:39204) 2024-02-28T16:26:36.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.816+0000 7f08dd400700 1 -- 172.21.15.23:0/3004359850 learned_addr learned my addr 172.21.15.23:0/3004359850 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:36.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.816+0000 7f08dde00700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08e0103310 0x7f08e019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:36.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.816+0000 7f08dd400700 1 -- 172.21.15.23:0/3004359850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08e0103310 msgr2=0x7f08e019c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:36.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.816+0000 7f08dd400700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08e0103310 0x7f08e019c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:36.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.816+0000 7f08dd400700 1 -- 172.21.15.23:0/3004359850 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0095f0 con 0x7f08e019c620 2024-02-28T16:26:36.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.817+0000 7f08dd400700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e019c620 0x7f08e01a1690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00b5c0 tx=0x7f08cc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:36.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.817+0000 7f08d6a00700 1 -- 172.21.15.23:0/3004359850 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08cc01d070 con 0x7f08e019c620 2024-02-28T16:26:36.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.817+0000 7f08d6a00700 1 -- 172.21.15.23:0/3004359850 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08cc00f460 con 0x7f08e019c620 2024-02-28T16:26:36.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.817+0000 7f08d6a00700 1 -- 172.21.15.23:0/3004359850 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08cc021640 con 0x7f08e019c620 2024-02-28T16:26:36.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.818+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e01a1bd0 con 0x7f08e019c620 2024-02-28T16:26:36.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.818+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e01a2090 con 0x7f08e019c620 2024-02-28T16:26:36.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.820+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e00fc340 con 0x7f08e019c620 2024-02-28T16:26:36.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.822+0000 7f08d6a00700 1 -- 172.21.15.23:0/3004359850 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f08cc00fa60 con 0x7f08e019c620 2024-02-28T16:26:36.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.823+0000 7f08d6a00700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f08c406da10 0x7f08c406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:36.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.823+0000 7f08d6a00700 1 -- 172.21.15.23:0/3004359850 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f08cc08e570 con 0x7f08e019c620 2024-02-28T16:26:36.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.824+0000 7f08dde00700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f08c406da10 0x7f08c406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:36.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.824+0000 7f08dde00700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f08c406da10 0x7f08c406fec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08d0005950 tx=0x7f08d000b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:36.821 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:36.832+0000 7f08d6a00700 1 -- 172.21.15.23:0/3004359850 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f08cc05b6e0 con 0x7f08e019c620 2024-02-28T16:26:37.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.225+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08e002ce90 con 0x7f08c406da10 2024-02-28T16:26:37.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.226+0000 7f08d6a00700 1 -- 172.21.15.23:0/3004359850 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f08e002ce90 con 0x7f08c406da10 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "4/23 daemons upgraded", 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T16:26:37.216 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:26:37.217 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:26:37.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f08c406da10 msgr2=0x7f08c406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:37.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f08c406da10 0x7f08c406fec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08d0005950 tx=0x7f08d000b410 comp rx=0 tx=0).stop 2024-02-28T16:26:37.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e019c620 msgr2=0x7f08e01a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:37.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e019c620 0x7f08e01a1690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00b5c0 tx=0x7f08cc00bd70 comp rx=0 tx=0).stop 2024-02-28T16:26:37.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 shutdown_connections 2024-02-28T16:26:37.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08e0103310 0x7f08e019c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f08c406da10 0x7f08c406fec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 --2- 172.21.15.23:0/3004359850 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f08e019c620 0x7f08e01a1690 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.229+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 >> 172.21.15.23:0/3004359850 conn(0x7f08e00fa780 msgr2=0x7f08e0103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:37.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.230+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 shutdown_connections 2024-02-28T16:26:37.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.230+0000 7f08e5000700 1 -- 172.21.15.23:0/3004359850 wait complete. 2024-02-28T16:26:37.252 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-28T16:26:37.253 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-28T16:26:37.358 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:37 smithi023 ceph-mon[78509]: pgmap v25: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 652 KiB/s wr, 203 op/s 2024-02-28T16:26:37.358 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:37 smithi023 ceph-mon[78509]: from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:37.358 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:37.358 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:37 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1026825805' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 -- 172.21.15.23:0/3713520382 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 msgr2=0x7f6f08073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 --2- 172.21.15.23:0/3713520382 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08073ba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009910 tx=0x7f6ef4009c20 comp rx=0 tx=0).stop 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 -- 172.21.15.23:0/3713520382 shutdown_connections 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 --2- 172.21.15.23:0/3713520382 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08073ba0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 --2- 172.21.15.23:0/3713520382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f08074d00 0x7f6f08073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 -- 172.21.15.23:0/3713520382 >> 172.21.15.23:0/3713520382 conn(0x7f6f080fb7f0 msgr2=0x7f6f080fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 -- 172.21.15.23:0/3713520382 shutdown_connections 2024-02-28T16:26:37.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.390+0000 7f6f10600700 1 -- 172.21.15.23:0/3713520382 wait complete. 2024-02-28T16:26:37.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.391+0000 7f6f10600700 1 Processor -- start 2024-02-28T16:26:37.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.391+0000 7f6f10600700 1 -- start start 2024-02-28T16:26:37.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.391+0000 7f6f10600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:37.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f10600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f08074d00 0x7f6f08198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:37.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f10600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08198890 con 0x7f6f08073730 2024-02-28T16:26:37.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f10600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f081989d0 con 0x7f6f08074d00 2024-02-28T16:26:37.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f0dc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:37.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f0dc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39228/0 (socket says 172.21.15.23:39228) 2024-02-28T16:26:37.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f0dc00700 1 -- 172.21.15.23:0/1989404931 learned_addr learned my addr 172.21.15.23:0/1989404931 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:26:37.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f0d200700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f08074d00 0x7f6f08198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:37.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f0dc00700 1 -- 172.21.15.23:0/1989404931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f08074d00 msgr2=0x7f6f08198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:37.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f0dc00700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f08074d00 0x7f6f08198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.392+0000 7f6f0dc00700 1 -- 172.21.15.23:0/1989404931 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef40095f0 con 0x7f6f08073730 2024-02-28T16:26:37.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.393+0000 7f6f0dc00700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08197d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00b4b0 tx=0x7f6efc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:37.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.393+0000 7f6f06000700 1 -- 172.21.15.23:0/1989404931 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6efc011800 con 0x7f6f08073730 2024-02-28T16:26:37.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.393+0000 7f6f06000700 1 -- 172.21.15.23:0/1989404931 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6efc011e10 con 0x7f6f08073730 2024-02-28T16:26:37.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.393+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0819d480 con 0x7f6f08073730 2024-02-28T16:26:37.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.393+0000 7f6f06000700 1 -- 172.21.15.23:0/1989404931 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6efc00f2e0 con 0x7f6f08073730 2024-02-28T16:26:37.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.393+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0819d9d0 con 0x7f6f08073730 2024-02-28T16:26:37.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.394+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0810aff0 con 0x7f6f08073730 2024-02-28T16:26:37.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.395+0000 7f6f06000700 1 -- 172.21.15.23:0/1989404931 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f6efc010380 con 0x7f6f08073730 2024-02-28T16:26:37.386 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.396+0000 7f6f06000700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ef006da10 0x7f6ef006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:37.386 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.397+0000 7f6f06000700 1 -- 172.21.15.23:0/1989404931 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6efc08d180 con 0x7f6f08073730 2024-02-28T16:26:37.386 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.397+0000 7f6f0d200700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ef006da10 0x7f6ef006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:37.388 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.398+0000 7f6f0d200700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ef006da10 0x7f6ef006fec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4000c00 tx=0x7f6ef4005fb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:37.391 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.401+0000 7f6f06000700 1 -- 172.21.15.23:0/1989404931 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6efc05a400 con 0x7f6f08073730 2024-02-28T16:26:37.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:37 smithi153 ceph-mon[66339]: pgmap v25: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 652 KiB/s wr, 203 op/s 2024-02-28T16:26:37.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:37 smithi153 ceph-mon[66339]: from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:37.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:37.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:37 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1026825805' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:26:37.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.806+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6f0819e0d0 con 0x7f6f08073730 2024-02-28T16:26:37.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.807+0000 7f6f06000700 1 -- 172.21.15.23:0/1989404931 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6efc059f90 con 0x7f6f08073730 2024-02-28T16:26:37.797 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ef006da10 msgr2=0x7f6ef006fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ef006da10 0x7f6ef006fec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4000c00 tx=0x7f6ef4005fb0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 msgr2=0x7f6f08197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08197d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00b4b0 tx=0x7f6efc00b870 comp rx=0 tx=0).stop 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 shutdown_connections 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ef006da10 0x7f6ef006fec0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f08073730 0x7f6f08197d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 --2- 172.21.15.23:0/1989404931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f08074d00 0x7f6f08198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 >> 172.21.15.23:0/1989404931 conn(0x7f6f080fb7f0 msgr2=0x7f6f081060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 shutdown_connections 2024-02-28T16:26:37.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:26:37.810+0000 7f6f10600700 1 -- 172.21.15.23:0/1989404931 wait complete. 2024-02-28T16:26:38.512 DEBUG:teuthology.parallel:result is None 2024-02-28T16:26:38.793 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: pgmap v26: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 307 op/s 2024-02-28T16:26:38.793 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:38.793 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:38.793 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:38.794 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: Reconfiguring crash.smithi023 (monmap changed)... 2024-02-28T16:26:38.794 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:26:38.794 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:38.794 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: Reconfiguring daemon crash.smithi023 on smithi023 2024-02-28T16:26:38.794 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:38 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1989404931' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: pgmap v26: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 307 op/s 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: Reconfiguring crash.smithi023 (monmap changed)... 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: Reconfiguring daemon crash.smithi023 on smithi023 2024-02-28T16:26:38.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:38 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1989404931' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:26:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:40 smithi023 ceph-mon[78509]: pgmap v27: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 744 KiB/s wr, 210 op/s 2024-02-28T16:26:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:26:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:40 smithi153 ceph-mon[66339]: pgmap v27: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 744 KiB/s wr, 210 op/s 2024-02-28T16:26:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:26:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:41.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:41 smithi023 ceph-mon[78509]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T16:26:41.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:41 smithi023 ceph-mon[78509]: Reconfiguring daemon osd.0 on smithi023 2024-02-28T16:26:41.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:41 smithi153 ceph-mon[66339]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T16:26:41.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:41 smithi153 ceph-mon[66339]: Reconfiguring daemon osd.0 on smithi023 2024-02-28T16:26:42.813 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:42 smithi153 ceph-mon[66339]: pgmap v28: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 744 KiB/s wr, 210 op/s 2024-02-28T16:26:42.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:42 smithi023 ceph-mon[78509]: pgmap v28: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 744 KiB/s wr, 210 op/s 2024-02-28T16:26:44.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:44 smithi153 ceph-mon[66339]: pgmap v29: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 961 KiB/s wr, 300 op/s 2024-02-28T16:26:44.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:44.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:44.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:44 smithi153 ceph-mon[66339]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T16:26:44.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:26:44.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:44.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:44 smithi153 ceph-mon[66339]: Reconfiguring daemon osd.1 on smithi023 2024-02-28T16:26:45.014 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:44 smithi023 ceph-mon[78509]: pgmap v29: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 961 KiB/s wr, 300 op/s 2024-02-28T16:26:45.014 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:45.014 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:45.014 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:44 smithi023 ceph-mon[78509]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T16:26:45.014 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:26:45.014 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:45.014 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:44 smithi023 ceph-mon[78509]: Reconfiguring daemon osd.1 on smithi023 2024-02-28T16:26:47.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:46 smithi153 ceph-mon[66339]: pgmap v30: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 619 KiB/s wr, 193 op/s 2024-02-28T16:26:47.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:47.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:47.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:26:47.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:47.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:46 smithi023 ceph-mon[78509]: pgmap v30: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 619 KiB/s wr, 193 op/s 2024-02-28T16:26:47.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:47.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:47.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:26:47.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:47 smithi023 ceph-mon[78509]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T16:26:47.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:47 smithi023 ceph-mon[78509]: Reconfiguring daemon osd.2 on smithi023 2024-02-28T16:26:48.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:47 smithi153 ceph-mon[66339]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T16:26:48.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:47 smithi153 ceph-mon[66339]: Reconfiguring daemon osd.2 on smithi023 2024-02-28T16:26:48.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:48 smithi023 ceph-mon[78509]: pgmap v31: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 798 KiB/s wr, 241 op/s 2024-02-28T16:26:49.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:48 smithi153 ceph-mon[66339]: pgmap v31: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 798 KiB/s wr, 241 op/s 2024-02-28T16:26:50.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:50.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:50.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:49 smithi023 ceph-mon[78509]: Reconfiguring mds.cephfs.smithi023.pplvdo (monmap changed)... 2024-02-28T16:26:50.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:26:50.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:50.101 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:49 smithi023 ceph-mon[78509]: Reconfiguring daemon mds.cephfs.smithi023.pplvdo on smithi023 2024-02-28T16:26:50.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:50.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:50.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:49 smithi153 ceph-mon[66339]: Reconfiguring mds.cephfs.smithi023.pplvdo (monmap changed)... 2024-02-28T16:26:50.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:26:50.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:50.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:49 smithi153 ceph-mon[66339]: Reconfiguring daemon mds.cephfs.smithi023.pplvdo on smithi023 2024-02-28T16:26:51.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:50 smithi023 ceph-mon[78509]: pgmap v32: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 396 KiB/s wr, 136 op/s 2024-02-28T16:26:51.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:50 smithi153 ceph-mon[66339]: pgmap v32: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 396 KiB/s wr, 136 op/s 2024-02-28T16:26:52.200 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:52.200 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:52.200 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:52.200 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:26:52.200 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:52.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:52.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:52.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:52.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:26:52.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:53.246 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:52 smithi023 ceph-mon[78509]: pgmap v33: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 396 KiB/s wr, 136 op/s 2024-02-28T16:26:53.246 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:52 smithi023 ceph-mon[78509]: Reconfiguring mds.cephfs.smithi023.klbbrl (monmap changed)... 2024-02-28T16:26:53.246 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:52 smithi023 ceph-mon[78509]: Reconfiguring daemon mds.cephfs.smithi023.klbbrl on smithi023 2024-02-28T16:26:53.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:52 smithi153 ceph-mon[66339]: pgmap v33: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 396 KiB/s wr, 136 op/s 2024-02-28T16:26:53.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:52 smithi153 ceph-mon[66339]: Reconfiguring mds.cephfs.smithi023.klbbrl (monmap changed)... 2024-02-28T16:26:53.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:52 smithi153 ceph-mon[66339]: Reconfiguring daemon mds.cephfs.smithi023.klbbrl on smithi023 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: pgmap v34: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 573 KiB/s wr, 184 op/s 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: Reconfiguring ceph-exporter.smithi153 (monmap changed)... 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: Unable to update caps for client.ceph-exporter.smithi153 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi153"}]: dispatch 2024-02-28T16:26:55.006 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:55.007 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:54 smithi153 ceph-mon[66339]: Reconfiguring daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: pgmap v34: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 573 KiB/s wr, 184 op/s 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: Reconfiguring ceph-exporter.smithi153 (monmap changed)... 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: Unable to update caps for client.ceph-exporter.smithi153 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi153"}]: dispatch 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:55.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:54 smithi023 ceph-mon[78509]: Reconfiguring daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:26:56.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:56 smithi023 ceph-mon[78509]: pgmap v35: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 357 KiB/s wr, 95 op/s 2024-02-28T16:26:56.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:56.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:56.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:26:56.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:57.131 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:56 smithi153 ceph-mon[66339]: pgmap v35: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 357 KiB/s wr, 95 op/s 2024-02-28T16:26:57.131 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:57.131 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:57.131 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:26:57.131 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:58.078 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:57 smithi153 ceph-mon[66339]: Reconfiguring crash.smithi153 (monmap changed)... 2024-02-28T16:26:58.079 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:57 smithi153 ceph-mon[66339]: Reconfiguring daemon crash.smithi153 on smithi153 2024-02-28T16:26:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:57 smithi023 ceph-mon[78509]: Reconfiguring crash.smithi153 (monmap changed)... 2024-02-28T16:26:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:57 smithi023 ceph-mon[78509]: Reconfiguring daemon crash.smithi153 on smithi153 2024-02-28T16:26:59.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:58 smithi153 ceph-mon[66339]: pgmap v36: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 525 KiB/s wr, 148 op/s 2024-02-28T16:26:59.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:58 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:59.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:58 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:59.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:58 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:26:59.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:58 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:26:59.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:58 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:26:59.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:58 smithi023 ceph-mon[78509]: pgmap v36: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 525 KiB/s wr, 148 op/s 2024-02-28T16:26:59.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:59.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:26:59.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.qlkchp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:26:59.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:26:59.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:00.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:59 smithi153 ceph-mon[66339]: Reconfiguring mgr.smithi153.qlkchp (monmap changed)... 2024-02-28T16:27:00.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:26:59 smithi153 ceph-mon[66339]: Reconfiguring daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:27:00.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:59 smithi023 ceph-mon[78509]: Reconfiguring mgr.smithi153.qlkchp (monmap changed)... 2024-02-28T16:27:00.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:26:59 smithi023 ceph-mon[78509]: Reconfiguring daemon mgr.smithi153.qlkchp on smithi153 2024-02-28T16:27:00.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:00 smithi153 ceph-mon[66339]: pgmap v37: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 346 KiB/s wr, 100 op/s 2024-02-28T16:27:01.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:00 smithi023 ceph-mon[78509]: pgmap v37: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 346 KiB/s wr, 100 op/s 2024-02-28T16:27:01.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:01 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:01.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:01 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:01.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:01 smithi023 ceph-mon[78509]: Reconfiguring mon.smithi153 (monmap changed)... 2024-02-28T16:27:01.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:01 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:27:01.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:01 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:27:01.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:01 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:01.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:01 smithi023 ceph-mon[78509]: Reconfiguring daemon mon.smithi153 on smithi153 2024-02-28T16:27:02.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:01 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:02.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:01 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:02.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:01 smithi153 ceph-mon[66339]: Reconfiguring mon.smithi153 (monmap changed)... 2024-02-28T16:27:02.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:01 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:27:02.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:01 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:27:02.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:01 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:02.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:01 smithi153 ceph-mon[66339]: Reconfiguring daemon mon.smithi153 on smithi153 2024-02-28T16:27:03.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:02 smithi153 ceph-mon[66339]: pgmap v38: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 346 KiB/s wr, 100 op/s 2024-02-28T16:27:03.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:02 smithi023 ceph-mon[78509]: pgmap v38: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 346 KiB/s wr, 100 op/s 2024-02-28T16:27:04.637 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:04 smithi153 ceph-mon[66339]: pgmap v39: 65 pgs: 65 active+clean; 217 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 498 KiB/s wr, 149 op/s 2024-02-28T16:27:04.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:04.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:04.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:04 smithi153 ceph-mon[66339]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T16:27:04.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:27:04.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:04.638 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:04 smithi153 ceph-mon[66339]: Reconfiguring daemon osd.3 on smithi153 2024-02-28T16:27:04.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:04 smithi023 ceph-mon[78509]: pgmap v39: 65 pgs: 65 active+clean; 217 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 498 KiB/s wr, 149 op/s 2024-02-28T16:27:04.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:04.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:04.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:04 smithi023 ceph-mon[78509]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T16:27:04.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:27:04.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:04.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:04 smithi023 ceph-mon[78509]: Reconfiguring daemon osd.3 on smithi153 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: pgmap v40: 65 pgs: 65 active+clean; 217 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.4 KiB/s rd, 321 KiB/s wr, 101 op/s 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: Reconfiguring daemon osd.4 on smithi153 2024-02-28T16:27:07.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:07.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: pgmap v40: 65 pgs: 65 active+clean; 217 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.4 KiB/s rd, 321 KiB/s wr, 101 op/s 2024-02-28T16:27:07.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:07.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:07.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T16:27:07.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:27:07.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:07.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: Reconfiguring daemon osd.4 on smithi153 2024-02-28T16:27:07.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:07.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.007+0000 7fe626e00700 1 -- 172.21.15.23:0/4250129357 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620100080 msgr2=0x7fe620100490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:07.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.007+0000 7fe626e00700 1 --2- 172.21.15.23:0/4250129357 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620100080 0x7fe620100490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe614009910 tx=0x7fe614009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:07.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.007+0000 7fe626e00700 1 -- 172.21.15.23:0/4250129357 shutdown_connections 2024-02-28T16:27:07.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.008+0000 7fe626e00700 1 --2- 172.21.15.23:0/4250129357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620101280 0x7fe6201016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:07.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.008+0000 7fe626e00700 1 --2- 172.21.15.23:0/4250129357 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620100080 0x7fe620100490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:07.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.008+0000 7fe626e00700 1 -- 172.21.15.23:0/4250129357 >> 172.21.15.23:0/4250129357 conn(0x7fe6200fb610 msgr2=0x7fe6200fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:07.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.008+0000 7fe626e00700 1 -- 172.21.15.23:0/4250129357 shutdown_connections 2024-02-28T16:27:07.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.008+0000 7fe626e00700 1 -- 172.21.15.23:0/4250129357 wait complete. 2024-02-28T16:27:07.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.009+0000 7fe626e00700 1 Processor -- start 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.009+0000 7fe626e00700 1 -- start start 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.010+0000 7fe626e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620100080 0x7fe620195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.010+0000 7fe626e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620101280 0x7fe620195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.010+0000 7fe626e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6201963b0 con 0x7fe620101280 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.010+0000 7fe626e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6201964f0 con 0x7fe620100080 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.010+0000 7fe625000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620101280 0x7fe620195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.010+0000 7fe625000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620101280 0x7fe620195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48924/0 (socket says 172.21.15.23:48924) 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.010+0000 7fe625000700 1 -- 172.21.15.23:0/165075449 learned_addr learned my addr 172.21.15.23:0/165075449 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:08.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.011+0000 7fe625a00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620100080 0x7fe620195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:08.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.011+0000 7fe625000700 1 -- 172.21.15.23:0/165075449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620100080 msgr2=0x7fe620195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:08.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.011+0000 7fe625000700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620100080 0x7fe620195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.011+0000 7fe625000700 1 -- 172.21.15.23:0/165075449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140095f0 con 0x7fe620101280 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.011+0000 7fe625a00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620100080 0x7fe620195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.011+0000 7fe625000700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620101280 0x7fe620195d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00d8d0 tx=0x7fe60c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.012+0000 7fe61e000700 1 -- 172.21.15.23:0/165075449 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe60c009940 con 0x7fe620101280 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.012+0000 7fe61e000700 1 -- 172.21.15.23:0/165075449 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe60c010460 con 0x7fe620101280 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.012+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62019afa0 con 0x7fe620101280 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.012+0000 7fe61e000700 1 -- 172.21.15.23:0/165075449 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe60c00f5f0 con 0x7fe620101280 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.012+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62019b4c0 con 0x7fe620101280 2024-02-28T16:27:08.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.013+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe620108bd0 con 0x7fe620101280 2024-02-28T16:27:08.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.014+0000 7fe61e000700 1 -- 172.21.15.23:0/165075449 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fe60c0105d0 con 0x7fe620101280 2024-02-28T16:27:08.004 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.015+0000 7fe61e000700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe60806d9d0 0x7fe60806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:08.004 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.015+0000 7fe61e000700 1 -- 172.21.15.23:0/165075449 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe60c08d720 con 0x7fe620101280 2024-02-28T16:27:08.004 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.015+0000 7fe625a00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe60806d9d0 0x7fe60806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:08.005 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.016+0000 7fe625a00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe60806d9d0 0x7fe60806fe80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe614006010 tx=0x7fe61400b580 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:08.011 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.022+0000 7fe61e000700 1 -- 172.21.15.23:0/165075449 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe60c05a830 con 0x7fe620101280 2024-02-28T16:27:08.291 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.302+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe620105bd0 con 0x7fe60806d9d0 2024-02-28T16:27:08.293 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.304+0000 7fe61e000700 1 -- 172.21.15.23:0/165075449 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe620105bd0 con 0x7fe60806d9d0 2024-02-28T16:27:08.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.307+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe60806d9d0 msgr2=0x7fe60806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:08.296 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.307+0000 7fe626e00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe60806d9d0 0x7fe60806fe80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe614006010 tx=0x7fe61400b580 comp rx=0 tx=0).stop 2024-02-28T16:27:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.307+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620101280 msgr2=0x7fe620195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.307+0000 7fe626e00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620101280 0x7fe620195d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00d8d0 tx=0x7fe60c00dc90 comp rx=0 tx=0).stop 2024-02-28T16:27:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.308+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 shutdown_connections 2024-02-28T16:27:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.308+0000 7fe626e00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620100080 0x7fe620195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.308+0000 7fe626e00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe60806d9d0 0x7fe60806fe80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.297 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.308+0000 7fe626e00700 1 --2- 172.21.15.23:0/165075449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe620101280 0x7fe620195d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.308+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 >> 172.21.15.23:0/165075449 conn(0x7fe6200fb610 msgr2=0x7fe6201044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:08.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.308+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 shutdown_connections 2024-02-28T16:27:08.298 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.308+0000 7fe626e00700 1 -- 172.21.15.23:0/165075449 wait complete. 2024-02-28T16:27:08.315 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:27:08.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.513+0000 7f84cf800700 1 -- 172.21.15.23:0/4130436246 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8100240 msgr2=0x7f84c8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:08.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.513+0000 7f84cf800700 1 --2- 172.21.15.23:0/4130436246 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8100240 0x7f84c8100650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009910 tx=0x7f84bc009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:08.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.513+0000 7f84cf800700 1 -- 172.21.15.23:0/4130436246 shutdown_connections 2024-02-28T16:27:08.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.513+0000 7f84cf800700 1 --2- 172.21.15.23:0/4130436246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84c8101440 0x7f84c8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.513+0000 7f84cf800700 1 --2- 172.21.15.23:0/4130436246 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8100240 0x7f84c8100650 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.513+0000 7f84cf800700 1 -- 172.21.15.23:0/4130436246 >> 172.21.15.23:0/4130436246 conn(0x7f84c80fb7f0 msgr2=0x7f84c80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:08.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.514+0000 7f84cf800700 1 -- 172.21.15.23:0/4130436246 shutdown_connections 2024-02-28T16:27:08.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.514+0000 7f84cf800700 1 -- 172.21.15.23:0/4130436246 wait complete. 2024-02-28T16:27:08.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.515+0000 7f84cf800700 1 Processor -- start 2024-02-28T16:27:08.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cf800700 1 -- start start 2024-02-28T16:27:08.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cf800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8101440 0x7f84c8197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:08.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cf800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84c8198470 0x7f84c819d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:08.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cf800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8198970 con 0x7f84c8101440 2024-02-28T16:27:08.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cf800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8198ae0 con 0x7f84c8198470 2024-02-28T16:27:08.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8101440 0x7f84c8197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:08.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84c7e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84c8198470 0x7f84c819d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:08.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8101440 0x7f84c8197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48944/0 (socket says 172.21.15.23:48944) 2024-02-28T16:27:08.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.516+0000 7f84cce00700 1 -- 172.21.15.23:0/853860250 learned_addr learned my addr 172.21.15.23:0/853860250 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:08.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.517+0000 7f84cce00700 1 -- 172.21.15.23:0/853860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84c8198470 msgr2=0x7f84c819d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:08.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.517+0000 7f84cce00700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84c8198470 0x7f84c819d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.517+0000 7f84cce00700 1 -- 172.21.15.23:0/853860250 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0095f0 con 0x7f84c8101440 2024-02-28T16:27:08.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.517+0000 7f84c7e00700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84c8198470 0x7f84c819d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:27:08.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.517+0000 7f84cce00700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8101440 0x7f84c8197f30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000c00 tx=0x7f84bc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:08.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.518+0000 7f84c5600700 1 -- 172.21.15.23:0/853860250 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84bc01d070 con 0x7f84c8101440 2024-02-28T16:27:08.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.518+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c819da20 con 0x7f84c8101440 2024-02-28T16:27:08.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.518+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c819dee0 con 0x7f84c8101440 2024-02-28T16:27:08.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.518+0000 7f84c5600700 1 -- 172.21.15.23:0/853860250 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84bc005640 con 0x7f84c8101440 2024-02-28T16:27:08.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.518+0000 7f84c5600700 1 -- 172.21.15.23:0/853860250 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84bc02b440 con 0x7f84c8101440 2024-02-28T16:27:08.509 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.519+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a8005320 con 0x7f84c8101440 2024-02-28T16:27:08.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.520+0000 7f84c5600700 1 -- 172.21.15.23:0/853860250 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f84bc003680 con 0x7f84c8101440 2024-02-28T16:27:08.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.521+0000 7f84c5600700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f84b006da20 0x7f84b006fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:08.510 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.521+0000 7f84c5600700 1 -- 172.21.15.23:0/853860250 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f84bc08e9f0 con 0x7f84c8101440 2024-02-28T16:27:08.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.522+0000 7f84c7e00700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f84b006da20 0x7f84b006fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:08.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.523+0000 7f84c7e00700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f84b006da20 0x7f84b006fed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f84b4011490 tx=0x7f84b4009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:08.516 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.527+0000 7f84c5600700 1 -- 172.21.15.23:0/853860250 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f84bc090e60 con 0x7f84c8101440 2024-02-28T16:27:08.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.845+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84a8000bf0 con 0x7f84b006da20 2024-02-28T16:27:08.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.848+0000 7f84c5600700 1 -- 172.21.15.23:0/853860250 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f84a8000bf0 con 0x7f84b006da20 2024-02-28T16:27:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f84b006da20 msgr2=0x7f84b006fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f84b006da20 0x7f84b006fed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f84b4011490 tx=0x7f84b4009260 comp rx=0 tx=0).stop 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8101440 msgr2=0x7f84c8197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8101440 0x7f84c8197f30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000c00 tx=0x7f84bc00fa00 comp rx=0 tx=0).stop 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 shutdown_connections 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f84b006da20 0x7f84b006fed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f84c8101440 0x7f84c8197f30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 --2- 172.21.15.23:0/853860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84c8198470 0x7f84c819d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 >> 172.21.15.23:0/853860250 conn(0x7f84c80fb7f0 msgr2=0x7f84c8102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 shutdown_connections 2024-02-28T16:27:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:08.851+0000 7f84cf800700 1 -- 172.21.15.23:0/853860250 wait complete. 2024-02-28T16:27:09.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 -- 172.21.15.23:0/1610610053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0ff4a0 msgr2=0x7f64dc0ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 --2- 172.21.15.23:0/1610610053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0ff4a0 0x7f64dc0ff910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009910 tx=0x7f64c8009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 -- 172.21.15.23:0/1610610053 shutdown_connections 2024-02-28T16:27:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 --2- 172.21.15.23:0/1610610053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0ff4a0 0x7f64dc0ff910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 --2- 172.21.15.23:0/1610610053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64dc0feb50 0x7f64dc0fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 -- 172.21.15.23:0/1610610053 >> 172.21.15.23:0/1610610053 conn(0x7f64dc0fa700 msgr2=0x7f64dc0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 -- 172.21.15.23:0/1610610053 shutdown_connections 2024-02-28T16:27:09.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.038+0000 7f64e2000700 1 -- 172.21.15.23:0/1610610053 wait complete. 2024-02-28T16:27:09.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.039+0000 7f64e2000700 1 Processor -- start 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64e2000700 1 -- start start 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64e2000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0feb50 0x7f64dc197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64e2000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64dc0ff4a0 0x7f64dc1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64e2000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1987c0 con 0x7f64dc0feb50 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64e2000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc198930 con 0x7f64dc0ff4a0 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64db400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0feb50 0x7f64dc197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64db400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0feb50 0x7f64dc197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48964/0 (socket says 172.21.15.23:48964) 2024-02-28T16:27:09.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.040+0000 7f64db400700 1 -- 172.21.15.23:0/1012691712 learned_addr learned my addr 172.21.15.23:0/1012691712 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:09.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.041+0000 7f64daa00700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64dc0ff4a0 0x7f64dc1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:09.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.041+0000 7f64db400700 1 -- 172.21.15.23:0/1012691712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64dc0ff4a0 msgr2=0x7f64dc1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.041+0000 7f64db400700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64dc0ff4a0 0x7f64dc1981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.041+0000 7f64db400700 1 -- 172.21.15.23:0/1012691712 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80095f0 con 0x7f64dc0feb50 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.041+0000 7f64db400700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0feb50 0x7f64dc197c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00ef10 tx=0x7f64cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.041+0000 7f64d3e00700 1 -- 172.21.15.23:0/1012691712 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64cc00ca50 con 0x7f64dc0feb50 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.042+0000 7f64d3e00700 1 -- 172.21.15.23:0/1012691712 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64cc00f040 con 0x7f64dc0feb50 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.042+0000 7f64d3e00700 1 -- 172.21.15.23:0/1012691712 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64cc0146b0 con 0x7f64dc0feb50 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.042+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc19d360 con 0x7f64dc0feb50 2024-02-28T16:27:09.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.042+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc19d8b0 con 0x7f64dc0feb50 2024-02-28T16:27:09.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.043+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc10af80 con 0x7f64dc0feb50 2024-02-28T16:27:09.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.044+0000 7f64d3e00700 1 -- 172.21.15.23:0/1012691712 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f64cc00cbb0 con 0x7f64dc0feb50 2024-02-28T16:27:09.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.045+0000 7f64d3e00700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f64c006d9e0 0x7f64c006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:09.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.045+0000 7f64d3e00700 1 -- 172.21.15.23:0/1012691712 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f64cc08daa0 con 0x7f64dc0feb50 2024-02-28T16:27:09.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.045+0000 7f64daa00700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f64c006d9e0 0x7f64c006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:09.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.046+0000 7f64daa00700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f64c006d9e0 0x7f64c006fe90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64c8006010 tx=0x7f64c8005940 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:09.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.050+0000 7f64d3e00700 1 -- 172.21.15.23:0/1012691712 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f64cc057100 con 0x7f64dc0feb50 2024-02-28T16:27:09.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:08 smithi153 ceph-mon[66339]: pgmap v41: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 481 KiB/s wr, 150 op/s 2024-02-28T16:27:09.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:08 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:09.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:08 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:09.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:08 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:27:09.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:08 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:08 smithi023 ceph-mon[78509]: pgmap v41: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 481 KiB/s wr, 150 op/s 2024-02-28T16:27:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:27:09.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:09.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.328+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64dc1088a0 con 0x7f64c006d9e0 2024-02-28T16:27:09.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.344+0000 7f64d3e00700 1 -- 172.21.15.23:0/1012691712 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f64dc1088a0 con 0x7f64c006d9e0 2024-02-28T16:27:09.334 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:27:09.334 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (12m) 69s ago 13m 14.1M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:27:09.334 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (14m) 69s ago 14m 7936k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:27:09.334 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (12m) 47s ago 12m 7642k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:27:09.334 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (14m) 69s ago 14m 6665k - 18.2.0 dc2bc1663786 f0d43c235798 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (12m) 47s ago 12m 6660k - 18.2.0 dc2bc1663786 3c650e819575 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (11m) 69s ago 13m 73.0M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (6m) 69s ago 6m 207M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (6m) 69s ago 6m 15.2M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (6m) 47s ago 6m 15.2M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (6m) 47s ago 6m 15.5M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (3m) 69s ago 15m 477M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (117s) 47s ago 12m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (94s) 69s ago 15m 30.8M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (53s) 47s ago 12m 23.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (14m) 69s ago 14m 8014k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (12m) 47s ago 12m 7910k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:27:09.335 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (11m) 69s ago 11m 209M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:27:09.336 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (11m) 69s ago 11m 217M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:27:09.336 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (10m) 69s ago 10m 174M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:27:09.336 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (9m) 47s ago 9m 257M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:27:09.336 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (9m) 47s ago 9m 240M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:27:09.336 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (8m) 47s ago 8m 217M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:27:09.336 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (2m) 69s ago 13m 47.0M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:27:09.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.347+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f64c006d9e0 msgr2=0x7f64c006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.347+0000 7f64e2000700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f64c006d9e0 0x7f64c006fe90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64c8006010 tx=0x7f64c8005940 comp rx=0 tx=0).stop 2024-02-28T16:27:09.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.347+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0feb50 msgr2=0x7f64dc197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.347+0000 7f64e2000700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0feb50 0x7f64dc197c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00ef10 tx=0x7f64cc00c3a0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.348+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 shutdown_connections 2024-02-28T16:27:09.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.348+0000 7f64e2000700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f64c006d9e0 0x7f64c006fe90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.348+0000 7f64e2000700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f64dc0feb50 0x7f64dc197c80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.348+0000 7f64e2000700 1 --2- 172.21.15.23:0/1012691712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64dc0ff4a0 0x7f64dc1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.348+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 >> 172.21.15.23:0/1012691712 conn(0x7f64dc0fa700 msgr2=0x7f64dc107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:09.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.348+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 shutdown_connections 2024-02-28T16:27:09.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.348+0000 7f64e2000700 1 -- 172.21.15.23:0/1012691712 wait complete. 2024-02-28T16:27:09.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.542+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1112179058 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 msgr2=0x7fc3c0073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.542+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1112179058 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c0073c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009910 tx=0x7fc3ac009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:09.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.543+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1112179058 shutdown_connections 2024-02-28T16:27:09.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.543+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1112179058 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c0073c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.543+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1112179058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3c0074d80 0x7fc3c00731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.543+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1112179058 >> 172.21.15.23:0/1112179058 conn(0x7fc3c00fb7f0 msgr2=0x7fc3c00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:09.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.543+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1112179058 shutdown_connections 2024-02-28T16:27:09.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.543+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1112179058 wait complete. 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.544+0000 7fc3c6c00700 1 Processor -- start 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.544+0000 7fc3c6c00700 1 -- start start 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.544+0000 7fc3c6c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.544+0000 7fc3c6c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3c0074d80 0x7fc3c019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.544+0000 7fc3c6c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c019cbd0 con 0x7fc3c00737b0 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.544+0000 7fc3c6c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c019cd10 con 0x7fc3c0074d80 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.545+0000 7fc3bfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:09.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.545+0000 7fc3bfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50264/0 (socket says 172.21.15.23:50264) 2024-02-28T16:27:09.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.545+0000 7fc3bfe00700 1 -- 172.21.15.23:0/1509795305 learned_addr learned my addr 172.21.15.23:0/1509795305 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:09.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.545+0000 7fc3bf400700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3c0074d80 0x7fc3c019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:09.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.545+0000 7fc3bfe00700 1 -- 172.21.15.23:0/1509795305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3c0074d80 msgr2=0x7fc3c019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.545+0000 7fc3bfe00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3c0074d80 0x7fc3c019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.545+0000 7fc3bfe00700 1 -- 172.21.15.23:0/1509795305 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac0095f0 con 0x7fc3c00737b0 2024-02-28T16:27:09.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.546+0000 7fc3bfe00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c019c070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c8a0 tx=0x7fc3b000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:09.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.546+0000 7fc3bcc00700 1 -- 172.21.15.23:0/1509795305 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b00078e0 con 0x7fc3c00737b0 2024-02-28T16:27:09.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.546+0000 7fc3bcc00700 1 -- 172.21.15.23:0/1509795305 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3b000f450 con 0x7fc3c00737b0 2024-02-28T16:27:09.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.546+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c01a17c0 con 0x7fc3c00737b0 2024-02-28T16:27:09.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.546+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c01a1d10 con 0x7fc3c00737b0 2024-02-28T16:27:09.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.546+0000 7fc3bcc00700 1 -- 172.21.15.23:0/1509795305 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b000e5e0 con 0x7fc3c00737b0 2024-02-28T16:27:09.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.548+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a0005320 con 0x7fc3c00737b0 2024-02-28T16:27:09.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.550+0000 7fc3bcc00700 1 -- 172.21.15.23:0/1509795305 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fc3b000e740 con 0x7fc3c00737b0 2024-02-28T16:27:09.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.551+0000 7fc3bcc00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc3a406d9d0 0x7fc3a406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:09.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.551+0000 7fc3bcc00700 1 -- 172.21.15.23:0/1509795305 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc3b008d6a0 con 0x7fc3c00737b0 2024-02-28T16:27:09.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.551+0000 7fc3bf400700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc3a406d9d0 0x7fc3a406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:09.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.552+0000 7fc3bf400700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc3a406d9d0 0x7fc3a406fe80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006010 tx=0x7fc3ac00b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:09.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.557+0000 7fc3bcc00700 1 -- 172.21.15.23:0/1509795305 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc3b005a790 con 0x7fc3c00737b0 2024-02-28T16:27:09.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:09 smithi153 ceph-mon[66339]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:09 smithi153 ceph-mon[66339]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T16:27:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:09 smithi153 ceph-mon[66339]: Reconfiguring daemon osd.5 on smithi153 2024-02-28T16:27:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:09 smithi153 ceph-mon[66339]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:09.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.988+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3a0005cc0 con 0x7fc3c00737b0 2024-02-28T16:27:09.978 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.989+0000 7fc3bcc00700 1 -- 172.21.15.23:0/1509795305 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7fc3b005a320 con 0x7fc3c00737b0 2024-02-28T16:27:09.978 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:27:09.978 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:27:09.978 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:27:09.978 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:27:09.979 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:27:09.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.992+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc3a406d9d0 msgr2=0x7fc3a406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.992+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc3a406d9d0 0x7fc3a406fe80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006010 tx=0x7fc3ac00b560 comp rx=0 tx=0).stop 2024-02-28T16:27:09.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.992+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 msgr2=0x7fc3c019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:09.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.992+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c019c070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c8a0 tx=0x7fc3b000cbb0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.993+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 shutdown_connections 2024-02-28T16:27:09.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.993+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc3a406d9d0 0x7fc3a406fe80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.993+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc3c00737b0 0x7fc3c019c070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.993+0000 7fc3c6c00700 1 --2- 172.21.15.23:0/1509795305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3c0074d80 0x7fc3c019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:09.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.993+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 >> 172.21.15.23:0/1509795305 conn(0x7fc3c00fb7f0 msgr2=0x7fc3c0101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:09.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.993+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 shutdown_connections 2024-02-28T16:27:09.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:09.993+0000 7fc3c6c00700 1 -- 172.21.15.23:0/1509795305 wait complete. 2024-02-28T16:27:10.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 -- 172.21.15.23:0/2797941021 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688073720 msgr2=0x7f1688073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:10.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 --2- 172.21.15.23:0/2797941021 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688073720 0x7f1688073b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1674009910 tx=0x7f1674009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:10.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 -- 172.21.15.23:0/2797941021 shutdown_connections 2024-02-28T16:27:10.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 --2- 172.21.15.23:0/2797941021 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688073720 0x7f1688073b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 --2- 172.21.15.23:0/2797941021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1688074ce0 0x7f16880731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:09 smithi023 ceph-mon[78509]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:10.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:09 smithi023 ceph-mon[78509]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T16:27:10.157 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:09 smithi023 ceph-mon[78509]: Reconfiguring daemon osd.5 on smithi153 2024-02-28T16:27:10.158 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:09 smithi023 ceph-mon[78509]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:10.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 -- 172.21.15.23:0/2797941021 >> 172.21.15.23:0/2797941021 conn(0x7f16880fb890 msgr2=0x7f16880fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:10.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 -- 172.21.15.23:0/2797941021 shutdown_connections 2024-02-28T16:27:10.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.167+0000 7f168f200700 1 -- 172.21.15.23:0/2797941021 wait complete. 2024-02-28T16:27:10.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.168+0000 7f168f200700 1 Processor -- start 2024-02-28T16:27:10.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.169+0000 7f168f200700 1 -- start start 2024-02-28T16:27:10.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.169+0000 7f168f200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1688073720 0x7f168819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:10.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.169+0000 7f168f200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688074ce0 0x7f168819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:10.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.169+0000 7f168f200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168819cc20 con 0x7f1688074ce0 2024-02-28T16:27:10.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.169+0000 7f168f200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168819cd60 con 0x7f1688073720 2024-02-28T16:27:10.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.170+0000 7f1687400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688074ce0 0x7f168819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:10.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.170+0000 7f1687400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688074ce0 0x7f168819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50280/0 (socket says 172.21.15.23:50280) 2024-02-28T16:27:10.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.170+0000 7f1687400700 1 -- 172.21.15.23:0/1011429346 learned_addr learned my addr 172.21.15.23:0/1011429346 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.170+0000 7f1687e00700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1688073720 0x7f168819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.170+0000 7f1687400700 1 -- 172.21.15.23:0/1011429346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1688073720 msgr2=0x7f168819c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.170+0000 7f1687400700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1688073720 0x7f168819c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.170+0000 7f1687400700 1 -- 172.21.15.23:0/1011429346 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740095f0 con 0x7f1688074ce0 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.171+0000 7f1687400700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688074ce0 0x7f168819c600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1674005b40 tx=0x7f167400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.171+0000 7f1684c00700 1 -- 172.21.15.23:0/1011429346 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167401d070 con 0x7f1688074ce0 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.171+0000 7f1684c00700 1 -- 172.21.15.23:0/1011429346 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f167400f460 con 0x7f1688074ce0 2024-02-28T16:27:10.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.171+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16881a17b0 con 0x7f1688074ce0 2024-02-28T16:27:10.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.171+0000 7f1684c00700 1 -- 172.21.15.23:0/1011429346 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1674021640 con 0x7f1688074ce0 2024-02-28T16:27:10.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.171+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16881a1ca0 con 0x7f1688074ce0 2024-02-28T16:27:10.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.173+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168810f300 con 0x7f1688074ce0 2024-02-28T16:27:10.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.174+0000 7f1684c00700 1 -- 172.21.15.23:0/1011429346 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f167400fa90 con 0x7f1688074ce0 2024-02-28T16:27:10.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.175+0000 7f1684c00700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166c06d9d0 0x7f166c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:10.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.175+0000 7f1684c00700 1 -- 172.21.15.23:0/1011429346 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f167408ea90 con 0x7f1688074ce0 2024-02-28T16:27:10.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.175+0000 7f1687e00700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166c06d9d0 0x7f166c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:10.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.176+0000 7f1687e00700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166c06d9d0 0x7f166c06fe80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1678005950 tx=0x7f16780058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:10.169 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.180+0000 7f1684c00700 1 -- 172.21.15.23:0/1011429346 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f167405bba0 con 0x7f1688074ce0 2024-02-28T16:27:10.507 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.517+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f168810f4f0 con 0x7f1688074ce0 2024-02-28T16:27:10.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.518+0000 7f1684c00700 1 -- 172.21.15.23:0/1011429346 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f167405b730 con 0x7f1688074ce0 2024-02-28T16:27:10.508 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:27:10.508 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:27:10.508 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:27:10.508 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:27:10.508 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:10.508 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:27:10.509 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:10.510 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:27:10.511 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:10.511 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:10.511 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:10.511 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:10.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.522+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166c06d9d0 msgr2=0x7f166c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:10.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.522+0000 7f168f200700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166c06d9d0 0x7f166c06fe80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1678005950 tx=0x7f16780058e0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.522+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688074ce0 msgr2=0x7f168819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:10.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.522+0000 7f168f200700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688074ce0 0x7f168819c600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1674005b40 tx=0x7f167400be20 comp rx=0 tx=0).stop 2024-02-28T16:27:10.513 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.523+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 shutdown_connections 2024-02-28T16:27:10.513 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.523+0000 7f168f200700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1688073720 0x7f168819c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.513 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.523+0000 7f168f200700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166c06d9d0 0x7f166c06fe80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.513 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.523+0000 7f168f200700 1 --2- 172.21.15.23:0/1011429346 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1688074ce0 0x7f168819c600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.513 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.523+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 >> 172.21.15.23:0/1011429346 conn(0x7f16880fb890 msgr2=0x7f1688101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:10.513 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.524+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 shutdown_connections 2024-02-28T16:27:10.514 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.524+0000 7f168f200700 1 -- 172.21.15.23:0/1011429346 wait complete. 2024-02-28T16:27:10.516 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 -- 172.21.15.23:0/3747863154 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c101440 msgr2=0x7f527c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 --2- 172.21.15.23:0/3747863154 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c101440 0x7f527c101890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5268009910 tx=0x7f5268009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 -- 172.21.15.23:0/3747863154 shutdown_connections 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 --2- 172.21.15.23:0/3747863154 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c101440 0x7f527c101890 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 --2- 172.21.15.23:0/3747863154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f527c100240 0x7f527c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 -- 172.21.15.23:0/3747863154 >> 172.21.15.23:0/3747863154 conn(0x7f527c0fb7f0 msgr2=0x7f527c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 -- 172.21.15.23:0/3747863154 shutdown_connections 2024-02-28T16:27:10.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.697+0000 7f5282400700 1 -- 172.21.15.23:0/3747863154 wait complete. 2024-02-28T16:27:10.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.699+0000 7f5282400700 1 Processor -- start 2024-02-28T16:27:10.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.699+0000 7f5282400700 1 -- start start 2024-02-28T16:27:10.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.699+0000 7f5282400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c100240 0x7f527c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:10.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.699+0000 7f5282400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f527c101440 0x7f527c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:10.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.699+0000 7f5282400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c196610 con 0x7f527c100240 2024-02-28T16:27:10.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.699+0000 7f5282400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c196750 con 0x7f527c101440 2024-02-28T16:27:10.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.700+0000 7f527b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c100240 0x7f527c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:10.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.700+0000 7f527b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c100240 0x7f527c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50292/0 (socket says 172.21.15.23:50292) 2024-02-28T16:27:10.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.700+0000 7f527b400700 1 -- 172.21.15.23:0/2000119626 learned_addr learned my addr 172.21.15.23:0/2000119626 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:10.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.700+0000 7f527aa00700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f527c101440 0x7f527c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:10.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.700+0000 7f527b400700 1 -- 172.21.15.23:0/2000119626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f527c101440 msgr2=0x7f527c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:10.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.700+0000 7f527b400700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f527c101440 0x7f527c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:10.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.700+0000 7f527b400700 1 -- 172.21.15.23:0/2000119626 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680095f0 con 0x7f527c100240 2024-02-28T16:27:10.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.701+0000 7f527b400700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c100240 0x7f527c195ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f526c00d900 tx=0x7f526c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:10.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.701+0000 7f5273e00700 1 -- 172.21.15.23:0/2000119626 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526c0041f0 con 0x7f527c100240 2024-02-28T16:27:10.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.701+0000 7f5273e00700 1 -- 172.21.15.23:0/2000119626 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f526c004350 con 0x7f527c100240 2024-02-28T16:27:10.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.701+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c19b200 con 0x7f527c100240 2024-02-28T16:27:10.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.702+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c19b750 con 0x7f527c100240 2024-02-28T16:27:10.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.702+0000 7f5273e00700 1 -- 172.21.15.23:0/2000119626 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526c003d20 con 0x7f527c100240 2024-02-28T16:27:10.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.703+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c005320 con 0x7f527c100240 2024-02-28T16:27:10.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.704+0000 7f5273e00700 1 -- 172.21.15.23:0/2000119626 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f526c009730 con 0x7f527c100240 2024-02-28T16:27:10.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.705+0000 7f5273e00700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f526006d9d0 0x7f526006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:10.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.705+0000 7f5273e00700 1 -- 172.21.15.23:0/2000119626 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f526c08d530 con 0x7f527c100240 2024-02-28T16:27:10.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.706+0000 7f527aa00700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f526006d9d0 0x7f526006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:10.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.707+0000 7f527aa00700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f526006d9d0 0x7f526006fe80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5268006010 tx=0x7f526800b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:10.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:10.710+0000 7f5273e00700 1 -- 172.21.15.23:0/2000119626 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f526c05a6c0 con 0x7f527c100240 2024-02-28T16:27:10.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.008+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f525c000bf0 con 0x7f526006d9d0 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.010+0000 7f5273e00700 1 -- 172.21.15.23:0/2000119626 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f525c000bf0 con 0x7f526006d9d0 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "4/23 daemons upgraded", 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T16:27:11.000 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:27:11.001 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f526006d9d0 msgr2=0x7f526006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f526006d9d0 0x7f526006fe80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5268006010 tx=0x7f526800b560 comp rx=0 tx=0).stop 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c100240 msgr2=0x7f527c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c100240 0x7f527c195ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f526c00d900 tx=0x7f526c00dc10 comp rx=0 tx=0).stop 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 shutdown_connections 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f526006d9d0 0x7f526006fe80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f527c100240 0x7f527c195ab0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 --2- 172.21.15.23:0/2000119626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f527c101440 0x7f527c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 >> 172.21.15.23:0/2000119626 conn(0x7f527c0fb7f0 msgr2=0x7f527c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.013+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 shutdown_connections 2024-02-28T16:27:11.003 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.014+0000 7f5282400700 1 -- 172.21.15.23:0/2000119626 wait complete. 2024-02-28T16:27:11.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:10 smithi153 ceph-mon[66339]: pgmap v42: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 312 KiB/s wr, 96 op/s 2024-02-28T16:27:11.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:10 smithi153 ceph-mon[66339]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:11.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:10 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1509795305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:11.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:10 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1011429346' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:27:11.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 -- 172.21.15.23:0/2568957446 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 msgr2=0x7f9ba0103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:11.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 --2- 172.21.15.23:0/2568957446 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba0103a90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009910 tx=0x7f9b90009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:11.161 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:10 smithi023 ceph-mon[78509]: pgmap v42: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 312 KiB/s wr, 96 op/s 2024-02-28T16:27:11.161 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:10 smithi023 ceph-mon[78509]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:11.161 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:10 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1509795305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:11.162 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:10 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1011429346' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:27:11.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 -- 172.21.15.23:0/2568957446 shutdown_connections 2024-02-28T16:27:11.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 --2- 172.21.15.23:0/2568957446 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba0103a90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 --2- 172.21.15.23:0/2568957446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba0102440 0x7f9ba0102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 -- 172.21.15.23:0/2568957446 >> 172.21.15.23:0/2568957446 conn(0x7f9ba00fd9f0 msgr2=0x7f9ba00ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:11.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 -- 172.21.15.23:0/2568957446 shutdown_connections 2024-02-28T16:27:11.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.172+0000 7f9ba8800700 1 -- 172.21.15.23:0/2568957446 wait complete. 2024-02-28T16:27:11.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.173+0000 7f9ba8800700 1 Processor -- start 2024-02-28T16:27:11.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.174+0000 7f9ba8800700 1 -- start start 2024-02-28T16:27:11.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.174+0000 7f9ba8800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba0102440 0x7f9ba0197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:11.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.174+0000 7f9ba8800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba01981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:11.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.174+0000 7f9ba8800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba01987d0 con 0x7f9ba0103640 2024-02-28T16:27:11.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.174+0000 7f9ba8800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0198940 con 0x7f9ba0102440 2024-02-28T16:27:11.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba01981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:11.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba0102440 0x7f9ba0197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:11.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba01981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50308/0 (socket says 172.21.15.23:50308) 2024-02-28T16:27:11.164 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba0102440 0x7f9ba0197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:43756/0 (socket says 172.21.15.23:43756) 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5400700 1 -- 172.21.15.23:0/1337658573 learned_addr learned my addr 172.21.15.23:0/1337658573 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5400700 1 -- 172.21.15.23:0/1337658573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba0102440 msgr2=0x7f9ba0197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5400700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba0102440 0x7f9ba0197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5400700 1 -- 172.21.15.23:0/1337658573 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900095f0 con 0x7f9ba0103640 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.175+0000 7f9ba5400700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba01981d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b90000c00 tx=0x7f9b9000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.176+0000 7f9b9aa00700 1 -- 172.21.15.23:0/1337658573 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b9001d070 con 0x7f9ba0103640 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.176+0000 7f9b9aa00700 1 -- 172.21.15.23:0/1337658573 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b90005dc0 con 0x7f9ba0103640 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.176+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba019d370 con 0x7f9ba0103640 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.176+0000 7f9b9aa00700 1 -- 172.21.15.23:0/1337658573 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b900226a0 con 0x7f9ba0103640 2024-02-28T16:27:11.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.176+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba019d860 con 0x7f9ba0103640 2024-02-28T16:27:11.166 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.177+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba010af90 con 0x7f9ba0103640 2024-02-28T16:27:11.167 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.178+0000 7f9b9aa00700 1 -- 172.21.15.23:0/1337658573 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 37) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f9b900038f0 con 0x7f9ba0103640 2024-02-28T16:27:11.169 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.180+0000 7f9b9aa00700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9b8806d9d0 0x7f9b8806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:11.169 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.180+0000 7f9b9aa00700 1 -- 172.21.15.23:0/1337658573 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9b9008eca0 con 0x7f9ba0103640 2024-02-28T16:27:11.169 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.180+0000 7f9ba5e00700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9b8806d9d0 0x7f9b8806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:11.171 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.181+0000 7f9ba5e00700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9b8806d9d0 0x7f9b8806fe80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0198b70 tx=0x7f9b94009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:11.175 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.186+0000 7f9b9aa00700 1 -- 172.21.15.23:0/1337658573 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9b90093070 con 0x7f9ba0103640 2024-02-28T16:27:11.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.595+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9ba019df60 con 0x7f9ba0103640 2024-02-28T16:27:11.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.596+0000 7f9b9aa00700 1 -- 172.21.15.23:0/1337658573 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9b90058280 con 0x7f9ba0103640 2024-02-28T16:27:11.586 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:27:11.588 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9b8806d9d0 msgr2=0x7f9b8806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:11.588 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9b8806d9d0 0x7f9b8806fe80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0198b70 tx=0x7f9b94009260 comp rx=0 tx=0).stop 2024-02-28T16:27:11.588 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 msgr2=0x7f9ba01981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:11.588 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba01981d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b90000c00 tx=0x7f9b9000f690 comp rx=0 tx=0).stop 2024-02-28T16:27:11.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 shutdown_connections 2024-02-28T16:27:11.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba0102440 0x7f9ba0197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9b8806d9d0 0x7f9b8806fe80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 --2- 172.21.15.23:0/1337658573 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9ba0103640 0x7f9ba01981d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:11.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.599+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 >> 172.21.15.23:0/1337658573 conn(0x7f9ba00fd9f0 msgr2=0x7f9ba0106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:11.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.600+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 shutdown_connections 2024-02-28T16:27:11.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:11.600+0000 7f9ba8800700 1 -- 172.21.15.23:0/1337658573 wait complete. 2024-02-28T16:27:12.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:12.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: Reconfiguring mds.cephfs.smithi153.senzwp (monmap changed)... 2024-02-28T16:27:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:27:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: Reconfiguring daemon mds.cephfs.smithi153.senzwp on smithi153 2024-02-28T16:27:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:11 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1337658573' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:27:12.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:12.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:12.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: Reconfiguring mds.cephfs.smithi153.senzwp (monmap changed)... 2024-02-28T16:27:12.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:27:12.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:12.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: Reconfiguring daemon mds.cephfs.smithi153.senzwp on smithi153 2024-02-28T16:27:12.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:12.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:11 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1337658573' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:27:13.136 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:12 smithi153 ceph-mon[66339]: pgmap v43: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 312 KiB/s wr, 96 op/s 2024-02-28T16:27:13.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:12 smithi023 ceph-mon[78509]: pgmap v43: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 312 KiB/s wr, 96 op/s 2024-02-28T16:27:14.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:14 smithi153 ceph-mon[66339]: pgmap v44: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 494 KiB/s wr, 147 op/s 2024-02-28T16:27:14.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:14.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:14.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:14 smithi153 ceph-mon[66339]: Reconfiguring mds.cephfs.smithi153.dhwpyj (monmap changed)... 2024-02-28T16:27:14.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:27:14.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:14.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:14 smithi153 ceph-mon[66339]: Reconfiguring daemon mds.cephfs.smithi153.dhwpyj on smithi153 2024-02-28T16:27:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:14 smithi023 ceph-mon[78509]: pgmap v44: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 494 KiB/s wr, 147 op/s 2024-02-28T16:27:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:14 smithi023 ceph-mon[78509]: Reconfiguring mds.cephfs.smithi153.dhwpyj (monmap changed)... 2024-02-28T16:27:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:27:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:14.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:14 smithi023 ceph-mon[78509]: Reconfiguring daemon mds.cephfs.smithi153.dhwpyj on smithi153 2024-02-28T16:27:16.099 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-28T16:27:16.099 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-28T16:27:16.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: pgmap v45: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9.1 KiB/s rd, 342 KiB/s wr, 98 op/s 2024-02-28T16:27:16.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:16.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all mon 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi023"}]: dispatch 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi023"}]': finished 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]: dispatch 2024-02-28T16:27:16.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]': finished 2024-02-28T16:27:16.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: pgmap v45: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9.1 KiB/s rd, 342 KiB/s wr, 98 op/s 2024-02-28T16:27:16.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all mon 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi023"}]: dispatch 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi023"}]': finished 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]: dispatch 2024-02-28T16:27:16.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]': finished 2024-02-28T16:27:17.133 DEBUG:teuthology.parallel:result is None 2024-02-28T16:27:17.134 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T16:27:17.224 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T16:27:17.225 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T16:27:17.350 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T16:27:17.350 DEBUG:teuthology.parallel:result is None 2024-02-28T16:27:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:19 smithi023 ceph-mon[78509]: pgmap v46: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 505 KiB/s wr, 153 op/s 2024-02-28T16:27:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:19 smithi023 ceph-mon[78509]: Upgrade: Updating crash.smithi023 (1/2) 2024-02-28T16:27:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:27:19.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:19.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:19 smithi023 ceph-mon[78509]: Deploying daemon crash.smithi023 on smithi023 2024-02-28T16:27:19.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:19 smithi153 ceph-mon[66339]: pgmap v46: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 505 KiB/s wr, 153 op/s 2024-02-28T16:27:19.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:19 smithi153 ceph-mon[66339]: Upgrade: Updating crash.smithi023 (1/2) 2024-02-28T16:27:19.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:19.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi023", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:27:19.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:19.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:19 smithi153 ceph-mon[66339]: Deploying daemon crash.smithi023 on smithi023 2024-02-28T16:27:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:21 smithi153 ceph-mon[66339]: pgmap v47: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 345 KiB/s wr, 104 op/s 2024-02-28T16:27:21.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:21 smithi023 ceph-mon[78509]: pgmap v47: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 345 KiB/s wr, 104 op/s 2024-02-28T16:27:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:22.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:23.156 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:23 smithi023 ceph-mon[78509]: pgmap v48: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 345 KiB/s wr, 104 op/s 2024-02-28T16:27:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:23 smithi153 ceph-mon[66339]: pgmap v48: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 345 KiB/s wr, 104 op/s 2024-02-28T16:27:24.930 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:24 smithi153 ceph-mon[66339]: pgmap v49: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 361 KiB/s wr, 116 op/s 2024-02-28T16:27:24.930 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:24.930 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:24.930 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:24 smithi153 ceph-mon[66339]: mgrmap e38: smithi023.bbebnt(active, since 93s), standbys: smithi153.qlkchp 2024-02-28T16:27:25.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:24 smithi023 ceph-mon[78509]: pgmap v49: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 361 KiB/s wr, 116 op/s 2024-02-28T16:27:25.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:25.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:25.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:24 smithi023 ceph-mon[78509]: mgrmap e38: smithi023.bbebnt(active, since 93s), standbys: smithi153.qlkchp 2024-02-28T16:27:27.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:26 smithi153 ceph-mon[66339]: pgmap v50: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 180 KiB/s wr, 65 op/s 2024-02-28T16:27:27.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:26 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:27.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:26 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:27:27.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:26 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:26 smithi023 ceph-mon[78509]: pgmap v50: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 180 KiB/s wr, 65 op/s 2024-02-28T16:27:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:26 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:26 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:27:27.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:26 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:27 smithi153 ceph-mon[66339]: Upgrade: Updating crash.smithi153 (2/2) 2024-02-28T16:27:27.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:27 smithi153 ceph-mon[66339]: Deploying daemon crash.smithi153 on smithi153 2024-02-28T16:27:28.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:27 smithi023 ceph-mon[78509]: Upgrade: Updating crash.smithi153 (2/2) 2024-02-28T16:27:28.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:27 smithi023 ceph-mon[78509]: Deploying daemon crash.smithi153 on smithi153 2024-02-28T16:27:29.066 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:28 smithi153 ceph-mon[66339]: pgmap v51: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 180 KiB/s wr, 66 op/s 2024-02-28T16:27:29.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:28 smithi023 ceph-mon[78509]: pgmap v51: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 180 KiB/s wr, 66 op/s 2024-02-28T16:27:31.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:30 smithi153 ceph-mon[66339]: pgmap v52: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-02-28T16:27:31.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:30 smithi023 ceph-mon[78509]: pgmap v52: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-02-28T16:27:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:32 smithi153 ceph-mon[66339]: pgmap v53: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-02-28T16:27:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:32 smithi023 ceph-mon[78509]: pgmap v53: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-02-28T16:27:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:35.119 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:34 smithi153 ceph-mon[66339]: pgmap v54: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-02-28T16:27:35.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:34 smithi023 ceph-mon[78509]: pgmap v54: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-02-28T16:27:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:36 smithi153 ceph-mon[66339]: pgmap v55: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:27:37.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:37.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:37.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:36 smithi023 ceph-mon[78509]: pgmap v55: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:27:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:38 smithi153 ceph-mon[66339]: pgmap v56: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:27:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:39.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:38 smithi023 ceph-mon[78509]: pgmap v56: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:27:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:40.625 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:40 smithi153 ceph-mon[66339]: pgmap v57: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:40.625 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:40.625 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:40.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:40 smithi023 ceph-mon[78509]: pgmap v57: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:40.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:40.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:41.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.774+0000 7fd566c00700 1 -- 172.21.15.23:0/1017934843 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd5600737b0 msgr2=0x7fd560073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:41.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.774+0000 7fd566c00700 1 --2- 172.21.15.23:0/1017934843 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd5600737b0 0x7fd560073c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009910 tx=0x7fd54c009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.774+0000 7fd566c00700 1 -- 172.21.15.23:0/1017934843 shutdown_connections 2024-02-28T16:27:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.774+0000 7fd566c00700 1 --2- 172.21.15.23:0/1017934843 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd5600737b0 0x7fd560073c20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.774+0000 7fd566c00700 1 --2- 172.21.15.23:0/1017934843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd560074d80 0x7fd5600731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.774+0000 7fd566c00700 1 -- 172.21.15.23:0/1017934843 >> 172.21.15.23:0/1017934843 conn(0x7fd5600fb7f0 msgr2=0x7fd5600fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.774+0000 7fd566c00700 1 -- 172.21.15.23:0/1017934843 shutdown_connections 2024-02-28T16:27:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.775+0000 7fd566c00700 1 -- 172.21.15.23:0/1017934843 wait complete. 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.776+0000 7fd566c00700 1 Processor -- start 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.776+0000 7fd566c00700 1 -- start start 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.776+0000 7fd566c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5600737b0 0x7fd56019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.776+0000 7fd566c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd560074d80 0x7fd56019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.776+0000 7fd566c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56019cbd0 con 0x7fd560074d80 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.776+0000 7fd566c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56019cd10 con 0x7fd5600737b0 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.777+0000 7fd55f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd560074d80 0x7fd56019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.777+0000 7fd55f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd560074d80 0x7fd56019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48112/0 (socket says 172.21.15.23:48112) 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.777+0000 7fd55f400700 1 -- 172.21.15.23:0/468404131 learned_addr learned my addr 172.21.15.23:0/468404131 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:41.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.777+0000 7fd55fe00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5600737b0 0x7fd56019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:41.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.777+0000 7fd55f400700 1 -- 172.21.15.23:0/468404131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5600737b0 msgr2=0x7fd56019c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:41.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.777+0000 7fd55f400700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5600737b0 0x7fd56019c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:41.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.777+0000 7fd55f400700 1 -- 172.21.15.23:0/468404131 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0095f0 con 0x7fd560074d80 2024-02-28T16:27:41.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.778+0000 7fd55f400700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd560074d80 0x7fd56019c5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd54c006010 tx=0x7fd54c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:41.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.778+0000 7fd55cc00700 1 -- 172.21.15.23:0/468404131 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd54c01d070 con 0x7fd560074d80 2024-02-28T16:27:41.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.778+0000 7fd55cc00700 1 -- 172.21.15.23:0/468404131 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd54c00f460 con 0x7fd560074d80 2024-02-28T16:27:41.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.778+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5601a1760 con 0x7fd560074d80 2024-02-28T16:27:41.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.778+0000 7fd55cc00700 1 -- 172.21.15.23:0/468404131 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd54c021640 con 0x7fd560074d80 2024-02-28T16:27:41.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.778+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601a1c50 con 0x7fd560074d80 2024-02-28T16:27:41.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.779+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56010f380 con 0x7fd560074d80 2024-02-28T16:27:41.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.780+0000 7fd55cc00700 1 -- 172.21.15.23:0/468404131 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd54c00fab0 con 0x7fd560074d80 2024-02-28T16:27:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.781+0000 7fd55cc00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd54406d8a0 0x7fd54406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.781+0000 7fd55cc00700 1 -- 172.21.15.23:0/468404131 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd54c08e760 con 0x7fd560074d80 2024-02-28T16:27:41.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.782+0000 7fd55fe00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd54406d8a0 0x7fd54406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:41.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.783+0000 7fd55fe00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd54406d8a0 0x7fd54406fd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd550005950 tx=0x7fd55000b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:41.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:41.787+0000 7fd55cc00700 1 -- 172.21.15.23:0/468404131 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd54c05ba90 con 0x7fd560074d80 2024-02-28T16:27:42.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.039+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5601a2290 con 0x7fd54406d8a0 2024-02-28T16:27:42.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.041+0000 7fd55cc00700 1 -- 172.21.15.23:0/468404131 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fd5601a2290 con 0x7fd54406d8a0 2024-02-28T16:27:42.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.044+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd54406d8a0 msgr2=0x7fd54406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.044+0000 7fd566c00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd54406d8a0 0x7fd54406fd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd550005950 tx=0x7fd55000b410 comp rx=0 tx=0).stop 2024-02-28T16:27:42.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.044+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd560074d80 msgr2=0x7fd56019c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.044+0000 7fd566c00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd560074d80 0x7fd56019c5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd54c006010 tx=0x7fd54c00bd70 comp rx=0 tx=0).stop 2024-02-28T16:27:42.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.045+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 shutdown_connections 2024-02-28T16:27:42.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.045+0000 7fd566c00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5600737b0 0x7fd56019c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.045+0000 7fd566c00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd54406d8a0 0x7fd54406fd50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.045+0000 7fd566c00700 1 --2- 172.21.15.23:0/468404131 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd560074d80 0x7fd56019c5b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.045+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 >> 172.21.15.23:0/468404131 conn(0x7fd5600fb7f0 msgr2=0x7fd560101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:42.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.045+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 shutdown_connections 2024-02-28T16:27:42.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.045+0000 7fd566c00700 1 -- 172.21.15.23:0/468404131 wait complete. 2024-02-28T16:27:42.051 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:27:42.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.213+0000 7f1403400700 1 -- 172.21.15.23:0/2096756883 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 msgr2=0x7f13fc105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.213+0000 7f1403400700 1 --2- 172.21.15.23:0/2096756883 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc105790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009910 tx=0x7f13e8009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:42.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.214+0000 7f1403400700 1 -- 172.21.15.23:0/2096756883 shutdown_connections 2024-02-28T16:27:42.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.214+0000 7f1403400700 1 --2- 172.21.15.23:0/2096756883 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc105790 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.214+0000 7f1403400700 1 --2- 172.21.15.23:0/2096756883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc069270 0x7f13fc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.214+0000 7f1403400700 1 -- 172.21.15.23:0/2096756883 >> 172.21.15.23:0/2096756883 conn(0x7f13fc0fa780 msgr2=0x7f13fc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:42.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.214+0000 7f1403400700 1 -- 172.21.15.23:0/2096756883 shutdown_connections 2024-02-28T16:27:42.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.214+0000 7f1403400700 1 -- 172.21.15.23:0/2096756883 wait complete. 2024-02-28T16:27:42.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.215+0000 7f1403400700 1 Processor -- start 2024-02-28T16:27:42.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.215+0000 7f1403400700 1 -- start start 2024-02-28T16:27:42.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.215+0000 7f1403400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:42.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.215+0000 7f1403400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0fed70 0x7f13fc0ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:42.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.215+0000 7f1403400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0ff720 con 0x7f13fc103310 2024-02-28T16:27:42.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.215+0000 7f1403400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0ff890 con 0x7f13fc0fed70 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f1400a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f1400a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48130/0 (socket says 172.21.15.23:48130) 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f1400a00700 1 -- 172.21.15.23:0/4046412169 learned_addr learned my addr 172.21.15.23:0/4046412169 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f13fbe00700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0fed70 0x7f13fc0ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f1400a00700 1 -- 172.21.15.23:0/4046412169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0fed70 msgr2=0x7f13fc0ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f1400a00700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0fed70 0x7f13fc0ff1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f1400a00700 1 -- 172.21.15.23:0/4046412169 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e80095f0 con 0x7f13fc103310 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f13fbe00700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0fed70 0x7f13fc0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.216+0000 7f1400a00700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc100720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13f000b480 tx=0x7f13f000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:42.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.217+0000 7f13f9600700 1 -- 172.21.15.23:0/4046412169 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f00118c0 con 0x7f13fc103310 2024-02-28T16:27:42.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.217+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc0ffb70 con 0x7f13fc103310 2024-02-28T16:27:42.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.217+0000 7f13f9600700 1 -- 172.21.15.23:0/4046412169 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f13f0010380 con 0x7f13fc103310 2024-02-28T16:27:42.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.217+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc19dde0 con 0x7f13fc103310 2024-02-28T16:27:42.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.217+0000 7f13f9600700 1 -- 172.21.15.23:0/4046412169 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f001a5d0 con 0x7f13fc103310 2024-02-28T16:27:42.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.218+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc18fc70 con 0x7f13fc103310 2024-02-28T16:27:42.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.219+0000 7f13f9600700 1 -- 172.21.15.23:0/4046412169 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f13f00104f0 con 0x7f13fc103310 2024-02-28T16:27:42.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.220+0000 7f13f9600700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f13e406d8a0 0x7f13e406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:42.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.220+0000 7f13f9600700 1 -- 172.21.15.23:0/4046412169 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f13f008d0b0 con 0x7f13fc103310 2024-02-28T16:27:42.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.220+0000 7f13fbe00700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f13e406d8a0 0x7f13e406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:42.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.221+0000 7f13fbe00700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f13e406d8a0 0x7f13e406fd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13e8006010 tx=0x7f13e800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:42.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.225+0000 7f13f9600700 1 -- 172.21.15.23:0/4046412169 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f13f005a3e0 con 0x7f13fc103310 2024-02-28T16:27:42.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.501+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13fc0694e0 con 0x7f13e406d8a0 2024-02-28T16:27:42.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.502+0000 7f13f9600700 1 -- 172.21.15.23:0/4046412169 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f13fc0694e0 con 0x7f13e406d8a0 2024-02-28T16:27:42.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f13e406d8a0 msgr2=0x7f13e406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f13e406d8a0 0x7f13e406fd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13e8006010 tx=0x7f13e800b540 comp rx=0 tx=0).stop 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 msgr2=0x7f13fc100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc100720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13f000b480 tx=0x7f13f000b840 comp rx=0 tx=0).stop 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 shutdown_connections 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f13e406d8a0 0x7f13e406fd50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13fc103310 0x7f13fc100720 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 --2- 172.21.15.23:0/4046412169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0fed70 0x7f13fc0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 >> 172.21.15.23:0/4046412169 conn(0x7f13fc0fa780 msgr2=0x7f13fc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 shutdown_connections 2024-02-28T16:27:42.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.505+0000 7f1403400700 1 -- 172.21.15.23:0/4046412169 wait complete. 2024-02-28T16:27:42.652 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:42 smithi023 ceph-mon[78509]: pgmap v58: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:42.653 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:42 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:42.653 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:42 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:42.653 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:42 smithi023 ceph-mon[78509]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:42.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 -- 172.21.15.23:0/2676473444 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4107a40 msgr2=0x7f44b4107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 --2- 172.21.15.23:0/2676473444 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4107a40 0x7f44b4107e90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009910 tx=0x7f44a0009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:42.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 -- 172.21.15.23:0/2676473444 shutdown_connections 2024-02-28T16:27:42.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 --2- 172.21.15.23:0/2676473444 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4107a40 0x7f44b4107e90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 --2- 172.21.15.23:0/2676473444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4106840 0x7f44b4106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 -- 172.21.15.23:0/2676473444 >> 172.21.15.23:0/2676473444 conn(0x7f44b4075970 msgr2=0x7f44b4077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:42.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 -- 172.21.15.23:0/2676473444 shutdown_connections 2024-02-28T16:27:42.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.663+0000 7f44b9e00700 1 -- 172.21.15.23:0/2676473444 wait complete. 2024-02-28T16:27:42.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.664+0000 7f44b9e00700 1 Processor -- start 2024-02-28T16:27:42.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b9e00700 1 -- start start 2024-02-28T16:27:42.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4106840 0x7f44b419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:42.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b9e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4107a40 0x7f44b419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:42.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b9e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b419cc40 con 0x7f44b4106840 2024-02-28T16:27:42.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b9e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b419cd80 con 0x7f44b4107a40 2024-02-28T16:27:42.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4106840 0x7f44b419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:42.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4106840 0x7f44b419c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48144/0 (socket says 172.21.15.23:48144) 2024-02-28T16:27:42.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.665+0000 7f44b2a00700 1 -- 172.21.15.23:0/3052853551 learned_addr learned my addr 172.21.15.23:0/3052853551 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:42.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b2000700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4107a40 0x7f44b419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:42.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b2a00700 1 -- 172.21.15.23:0/3052853551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4107a40 msgr2=0x7f44b419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b2a00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4107a40 0x7f44b419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b2a00700 1 -- 172.21.15.23:0/3052853551 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00095f0 con 0x7f44b4106840 2024-02-28T16:27:42.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b2a00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4106840 0x7f44b419c0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f44a400d900 tx=0x7f44a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:42.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b8a00700 1 -- 172.21.15.23:0/3052853551 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a40041f0 con 0x7f44b4106840 2024-02-28T16:27:42.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b8a00700 1 -- 172.21.15.23:0/3052853551 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44a4004350 con 0x7f44b4106840 2024-02-28T16:27:42.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b41a1830 con 0x7f44b4106840 2024-02-28T16:27:42.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.666+0000 7f44b8a00700 1 -- 172.21.15.23:0/3052853551 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a4003da0 con 0x7f44b4106840 2024-02-28T16:27:42.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.667+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b41a1d80 con 0x7f44b4106840 2024-02-28T16:27:42.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.668+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b410f390 con 0x7f44b4106840 2024-02-28T16:27:42.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.669+0000 7f44b8a00700 1 -- 172.21.15.23:0/3052853551 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f44a4009730 con 0x7f44b4106840 2024-02-28T16:27:42.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.670+0000 7f44b8a00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f449806d8a0 0x7f449806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:42.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.670+0000 7f44b8a00700 1 -- 172.21.15.23:0/3052853551 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f44a408d3a0 con 0x7f44b4106840 2024-02-28T16:27:42.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.670+0000 7f44b2000700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f449806d8a0 0x7f449806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:42.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.671+0000 7f44b2000700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f449806d8a0 0x7f449806fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005b40 tx=0x7f44a0005a90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:42.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.675+0000 7f44b8a00700 1 -- 172.21.15.23:0/3052853551 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f44a405a750 con 0x7f44b4106840 2024-02-28T16:27:42.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:42 smithi153 ceph-mon[66339]: pgmap v58: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:42.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:42 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:42.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:42 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:42.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:42 smithi153 ceph-mon[66339]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:42.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.921+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44b41a24d0 con 0x7f449806d8a0 2024-02-28T16:27:42.924 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.935+0000 7f44b8a00700 1 -- 172.21.15.23:0/3052853551 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f44b41a24d0 con 0x7f449806d8a0 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (12m) 3s ago 14m 14.1M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (14m) 3s ago 14m 8094k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (13m) 6s ago 13m 7742k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (19s) 3s ago 14m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (11s) 6s ago 13m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (12m) 3s ago 14m 74.1M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (7m) 3s ago 7m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (7m) 3s ago 7m 15.9M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (7m) 6s ago 7m 15.7M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:27:42.925 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (7m) 6s ago 7m 16.0M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (3m) 3s ago 16m 496M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (2m) 6s ago 13m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (2m) 3s ago 16m 42.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (87s) 6s ago 13m 37.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (14m) 3s ago 14m 7843k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (13m) 6s ago 13m 8208k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (12m) 3s ago 12m 232M 1217M 18.2.0 dc2bc1663786 b725c2825496 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (11m) 3s ago 11m 241M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (10m) 3s ago 10m 201M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (10m) 6s ago 10m 277M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (9m) 6s ago 9m 255M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (9m) 6s ago 9m 228M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:27:42.926 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (2m) 3s ago 13m 54.2M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:27:42.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f449806d8a0 msgr2=0x7f449806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f449806d8a0 0x7f449806fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005b40 tx=0x7f44a0005a90 comp rx=0 tx=0).stop 2024-02-28T16:27:42.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4106840 msgr2=0x7f44b419c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:42.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4106840 0x7f44b419c0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f44a400d900 tx=0x7f44a400dcc0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 shutdown_connections 2024-02-28T16:27:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f449806d8a0 0x7f449806fd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f44b4106840 0x7f44b419c0e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 --2- 172.21.15.23:0/3052853551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4107a40 0x7f44b419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.938+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 >> 172.21.15.23:0/3052853551 conn(0x7f44b4075970 msgr2=0x7f44b410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.939+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 shutdown_connections 2024-02-28T16:27:42.928 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:42.939+0000 7f44b9e00700 1 -- 172.21.15.23:0/3052853551 wait complete. 2024-02-28T16:27:43.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.085+0000 7f2dbec00700 1 -- 172.21.15.23:0/837868978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8102300 msgr2=0x7f2db8102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.085+0000 7f2dbec00700 1 --2- 172.21.15.23:0/837868978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8102300 0x7f2db8102710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009910 tx=0x7f2dac009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:43.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.085+0000 7f2dbec00700 1 -- 172.21.15.23:0/837868978 shutdown_connections 2024-02-28T16:27:43.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.085+0000 7f2dbec00700 1 --2- 172.21.15.23:0/837868978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db8103500 0x7f2db8103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.085+0000 7f2dbec00700 1 --2- 172.21.15.23:0/837868978 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8102300 0x7f2db8102710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.085+0000 7f2dbec00700 1 -- 172.21.15.23:0/837868978 >> 172.21.15.23:0/837868978 conn(0x7f2db80fd8d0 msgr2=0x7f2db80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:43.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.086+0000 7f2dbec00700 1 -- 172.21.15.23:0/837868978 shutdown_connections 2024-02-28T16:27:43.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.086+0000 7f2dbec00700 1 -- 172.21.15.23:0/837868978 wait complete. 2024-02-28T16:27:43.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.087+0000 7f2dbec00700 1 Processor -- start 2024-02-28T16:27:43.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.087+0000 7f2dbec00700 1 -- start start 2024-02-28T16:27:43.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.087+0000 7f2dbec00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db8102300 0x7f2db8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:43.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.087+0000 7f2dbec00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8103500 0x7f2db8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:43.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.087+0000 7f2dbec00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81985e0 con 0x7f2db8103500 2024-02-28T16:27:43.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.087+0000 7f2dbec00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8198720 con 0x7f2db8102300 2024-02-28T16:27:43.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.087+0000 7f2dbce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8103500 0x7f2db8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:43.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbce00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8103500 0x7f2db8197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48160/0 (socket says 172.21.15.23:48160) 2024-02-28T16:27:43.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbce00700 1 -- 172.21.15.23:0/3747001140 learned_addr learned my addr 172.21.15.23:0/3747001140 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:43.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbd800700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db8102300 0x7f2db8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:43.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbce00700 1 -- 172.21.15.23:0/3747001140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db8102300 msgr2=0x7f2db8197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbce00700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db8102300 0x7f2db8197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbce00700 1 -- 172.21.15.23:0/3747001140 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0095f0 con 0x7f2db8103500 2024-02-28T16:27:43.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbd800700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db8102300 0x7f2db8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:27:43.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.088+0000 7f2dbce00700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8103500 0x7f2db8197fc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c8a0 tx=0x7f2da400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:43.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.089+0000 7f2db6000700 1 -- 172.21.15.23:0/3747001140 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da400cea0 con 0x7f2db8103500 2024-02-28T16:27:43.083 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.089+0000 7f2db6000700 1 -- 172.21.15.23:0/3747001140 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2da4004830 con 0x7f2db8103500 2024-02-28T16:27:43.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.089+0000 7f2db6000700 1 -- 172.21.15.23:0/3747001140 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da40055b0 con 0x7f2db8103500 2024-02-28T16:27:43.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.089+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db819d1d0 con 0x7f2db8103500 2024-02-28T16:27:43.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.089+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db819d720 con 0x7f2db8103500 2024-02-28T16:27:43.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.090+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db810ae50 con 0x7f2db8103500 2024-02-28T16:27:43.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.091+0000 7f2db6000700 1 -- 172.21.15.23:0/3747001140 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2da4007ad0 con 0x7f2db8103500 2024-02-28T16:27:43.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.092+0000 7f2db6000700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2da006d8a0 0x7f2da006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:43.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.093+0000 7f2db6000700 1 -- 172.21.15.23:0/3747001140 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2da408d1c0 con 0x7f2db8103500 2024-02-28T16:27:43.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.093+0000 7f2dbd800700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2da006d8a0 0x7f2da006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:43.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.093+0000 7f2dbd800700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2da006d8a0 0x7f2da006fd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006010 tx=0x7f2dac00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:43.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.097+0000 7f2db6000700 1 -- 172.21.15.23:0/3747001140 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2da405a4d0 con 0x7f2db8103500 2024-02-28T16:27:43.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.411+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2db810b040 con 0x7f2db8103500 2024-02-28T16:27:43.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.413+0000 7f2db6000700 1 -- 172.21.15.23:0/3747001140 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f2da401d2c0 con 0x7f2db8103500 2024-02-28T16:27:43.402 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:27:43.402 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:27:43.402 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:27:43.402 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:43.402 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:27:43.403 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:27:43.406 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.416+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2da006d8a0 msgr2=0x7f2da006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.406 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.416+0000 7f2dbec00700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2da006d8a0 0x7f2da006fd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006010 tx=0x7f2dac00b540 comp rx=0 tx=0).stop 2024-02-28T16:27:43.406 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8103500 msgr2=0x7f2db8197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.406 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8103500 0x7f2db8197fc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c8a0 tx=0x7f2da400cc60 comp rx=0 tx=0).stop 2024-02-28T16:27:43.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 shutdown_connections 2024-02-28T16:27:43.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db8102300 0x7f2db8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2da006d8a0 0x7f2da006fd50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 --2- 172.21.15.23:0/3747001140 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2db8103500 0x7f2db8197fc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 >> 172.21.15.23:0/3747001140 conn(0x7f2db80fd8d0 msgr2=0x7f2db8106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:43.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 shutdown_connections 2024-02-28T16:27:43.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.417+0000 7f2dbec00700 1 -- 172.21.15.23:0/3747001140 wait complete. 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 -- 172.21.15.23:0/99483134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f45480737b0 msgr2=0x7f4548073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 --2- 172.21.15.23:0/99483134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f45480737b0 0x7f4548073c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4538009940 tx=0x7f4538009c50 comp rx=0 tx=0).stop 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 -- 172.21.15.23:0/99483134 shutdown_connections 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 --2- 172.21.15.23:0/99483134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f45480737b0 0x7f4548073c20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 --2- 172.21.15.23:0/99483134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4548074d80 0x7f45480731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 -- 172.21.15.23:0/99483134 >> 172.21.15.23:0/99483134 conn(0x7f45480fb7f0 msgr2=0x7f45480fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 -- 172.21.15.23:0/99483134 shutdown_connections 2024-02-28T16:27:43.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.568+0000 7f4550800700 1 -- 172.21.15.23:0/99483134 wait complete. 2024-02-28T16:27:43.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.570+0000 7f4550800700 1 Processor -- start 2024-02-28T16:27:43.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.570+0000 7f4550800700 1 -- start start 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.570+0000 7f4550800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45480737b0 0x7f4548197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.570+0000 7f4550800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4548074d80 0x7f45481981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.570+0000 7f4550800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45481987e0 con 0x7f4548074d80 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.570+0000 7f4550800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4548198950 con 0x7f45480737b0 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.571+0000 7f454d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4548074d80 0x7f45481981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.571+0000 7f454d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4548074d80 0x7f45481981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48188/0 (socket says 172.21.15.23:48188) 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.571+0000 7f454d400700 1 -- 172.21.15.23:0/1495019009 learned_addr learned my addr 172.21.15.23:0/1495019009 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:43.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.571+0000 7f454de00700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45480737b0 0x7f4548197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:43.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.571+0000 7f454d400700 1 -- 172.21.15.23:0/1495019009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45480737b0 msgr2=0x7f4548197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.571+0000 7f454d400700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45480737b0 0x7f4548197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.571+0000 7f454d400700 1 -- 172.21.15.23:0/1495019009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45380095f0 con 0x7f4548074d80 2024-02-28T16:27:43.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.572+0000 7f454d400700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4548074d80 0x7f45481981e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45380055f0 tx=0x7f45380056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:43.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.572+0000 7f4542a00700 1 -- 172.21.15.23:0/1495019009 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453801d070 con 0x7f4548074d80 2024-02-28T16:27:43.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.572+0000 7f4542a00700 1 -- 172.21.15.23:0/1495019009 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4538003ba0 con 0x7f4548074d80 2024-02-28T16:27:43.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.572+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454819d380 con 0x7f4548074d80 2024-02-28T16:27:43.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.572+0000 7f4542a00700 1 -- 172.21.15.23:0/1495019009 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4538021710 con 0x7f4548074d80 2024-02-28T16:27:43.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.572+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454819d870 con 0x7f4548074d80 2024-02-28T16:27:43.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.573+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454810af80 con 0x7f4548074d80 2024-02-28T16:27:43.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.574+0000 7f4542a00700 1 -- 172.21.15.23:0/1495019009 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f453800faa0 con 0x7f4548074d80 2024-02-28T16:27:43.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.575+0000 7f4542a00700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f453006d8a0 0x7f453006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:43.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.575+0000 7f4542a00700 1 -- 172.21.15.23:0/1495019009 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f453808e7f0 con 0x7f4548074d80 2024-02-28T16:27:43.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.575+0000 7f454de00700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f453006d8a0 0x7f453006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:43.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.576+0000 7f454de00700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f453006d8a0 0x7f453006fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f453c005950 tx=0x7f453c005ed0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:43.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.580+0000 7f4542a00700 1 -- 172.21.15.23:0/1495019009 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4538058070 con 0x7f4548074d80 2024-02-28T16:27:43.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.886+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f454819dfc0 con 0x7f4548074d80 2024-02-28T16:27:43.876 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.887+0000 7f4542a00700 1 -- 172.21.15.23:0/1495019009 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f453805b730 con 0x7f4548074d80 2024-02-28T16:27:43.876 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:27:43.877 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:27:43.878 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:43.879 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.889+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f453006d8a0 msgr2=0x7f453006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.889+0000 7f4550800700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f453006d8a0 0x7f453006fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f453c005950 tx=0x7f453c005ed0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.889+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4548074d80 msgr2=0x7f45481981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.889+0000 7f4550800700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4548074d80 0x7f45481981e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45380055f0 tx=0x7f45380056d0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.890+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 shutdown_connections 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.890+0000 7f4550800700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45480737b0 0x7f4548197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.890+0000 7f4550800700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f453006d8a0 0x7f453006fd50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.890+0000 7f4550800700 1 --2- 172.21.15.23:0/1495019009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4548074d80 0x7f45481981e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.890+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 >> 172.21.15.23:0/1495019009 conn(0x7f45480fb7f0 msgr2=0x7f4548106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.890+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 shutdown_connections 2024-02-28T16:27:43.880 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:43.890+0000 7f4550800700 1 -- 172.21.15.23:0/1495019009 wait complete. 2024-02-28T16:27:43.881 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:27:43.959 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:43 smithi153 ceph-mon[66339]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:43.960 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:43 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:43.960 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:43 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:43.960 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:43 smithi153 ceph-mon[66339]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:43.960 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:43 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3747001140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:44.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 -- 172.21.15.23:0/3382586037 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 msgr2=0x7fca780731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 --2- 172.21.15.23:0/3382586037 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 0x7fca780731e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b0a0 tx=0x7fca6800b3b0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 -- 172.21.15.23:0/3382586037 shutdown_connections 2024-02-28T16:27:44.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 --2- 172.21.15.23:0/3382586037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca780737b0 0x7fca78073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 --2- 172.21.15.23:0/3382586037 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 0x7fca780731e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 -- 172.21.15.23:0/3382586037 >> 172.21.15.23:0/3382586037 conn(0x7fca780fb7f0 msgr2=0x7fca780fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:44.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 -- 172.21.15.23:0/3382586037 shutdown_connections 2024-02-28T16:27:44.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.054+0000 7fca7ec00700 1 -- 172.21.15.23:0/3382586037 wait complete. 2024-02-28T16:27:44.044 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:43 smithi023 ceph-mon[78509]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:44.044 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:43 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:44.045 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:43 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:44.045 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:43 smithi023 ceph-mon[78509]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:44.045 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:43 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3747001140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.055+0000 7fca7ec00700 1 Processor -- start 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.055+0000 7fca7ec00700 1 -- start start 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.055+0000 7fca7ec00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca780737b0 0x7fca7819c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.055+0000 7fca7ec00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 0x7fca7819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.055+0000 7fca7ec00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7819cbb0 con 0x7fca78074d80 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.055+0000 7fca7ec00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7819ccf0 con 0x7fca780737b0 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.056+0000 7fca6f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 0x7fca7819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.056+0000 7fca77e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca780737b0 0x7fca7819c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.056+0000 7fca77e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca780737b0 0x7fca7819c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:34124/0 (socket says 172.21.15.23:34124) 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.056+0000 7fca77e00700 1 -- 172.21.15.23:0/585278885 learned_addr learned my addr 172.21.15.23:0/585278885 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca6f400700 1 -- 172.21.15.23:0/585278885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca780737b0 msgr2=0x7fca7819c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca6f400700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca780737b0 0x7fca7819c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca6f400700 1 -- 172.21.15.23:0/585278885 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009d00 con 0x7fca78074d80 2024-02-28T16:27:44.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca6f400700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 0x7fca7819c620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c8f0 tx=0x7fca6000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:44.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca75600700 1 -- 172.21.15.23:0/585278885 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca60004410 con 0x7fca78074d80 2024-02-28T16:27:44.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca75600700 1 -- 172.21.15.23:0/585278885 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca60004570 con 0x7fca78074d80 2024-02-28T16:27:44.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca75600700 1 -- 172.21.15.23:0/585278885 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca600038b0 con 0x7fca78074d80 2024-02-28T16:27:44.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca781a17b0 con 0x7fca78074d80 2024-02-28T16:27:44.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.057+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca781a1cd0 con 0x7fca78074d80 2024-02-28T16:27:44.048 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.059+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7810f370 con 0x7fca78074d80 2024-02-28T16:27:44.048 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.060+0000 7fca75600700 1 -- 172.21.15.23:0/585278885 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fca60003a10 con 0x7fca78074d80 2024-02-28T16:27:44.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.060+0000 7fca75600700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fca5c06d8a0 0x7fca5c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:44.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.061+0000 7fca75600700 1 -- 172.21.15.23:0/585278885 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fca6008cda0 con 0x7fca78074d80 2024-02-28T16:27:44.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.061+0000 7fca77e00700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fca5c06d8a0 0x7fca5c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:44.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.061+0000 7fca77e00700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fca5c06d8a0 0x7fca5c06fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b830 tx=0x7fca68009360 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:44.054 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.065+0000 7fca75600700 1 -- 172.21.15.23:0/585278885 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fca6005a150 con 0x7fca78074d80 2024-02-28T16:27:44.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.325+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca781032f0 con 0x7fca5c06d8a0 2024-02-28T16:27:44.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.328+0000 7fca75600700 1 -- 172.21.15.23:0/585278885 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fca781032f0 con 0x7fca5c06d8a0 2024-02-28T16:27:44.317 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:27:44.317 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:27:44.317 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:27:44.317 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:27:44.317 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "6/23 daemons upgraded", 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading crash daemons", 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:27:44.318 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fca5c06d8a0 msgr2=0x7fca5c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fca5c06d8a0 0x7fca5c06fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b830 tx=0x7fca68009360 comp rx=0 tx=0).stop 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 msgr2=0x7fca7819c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 0x7fca7819c620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c8f0 tx=0x7fca6000cc00 comp rx=0 tx=0).stop 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 shutdown_connections 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca780737b0 0x7fca7819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fca5c06d8a0 0x7fca5c06fd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 --2- 172.21.15.23:0/585278885 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca78074d80 0x7fca7819c620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.330+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 >> 172.21.15.23:0/585278885 conn(0x7fca780fb7f0 msgr2=0x7fca78101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:44.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.331+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 shutdown_connections 2024-02-28T16:27:44.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.331+0000 7fca7ec00700 1 -- 172.21.15.23:0/585278885 wait complete. 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.498+0000 7f0665800700 1 -- 172.21.15.23:0/3723318206 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 msgr2=0x7f0660101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.498+0000 7f0665800700 1 --2- 172.21.15.23:0/3723318206 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660101890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f064c009910 tx=0x7f064c009c20 comp rx=0 tx=0).stop 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.498+0000 7f0665800700 1 -- 172.21.15.23:0/3723318206 shutdown_connections 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.498+0000 7f0665800700 1 --2- 172.21.15.23:0/3723318206 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660101890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.498+0000 7f0665800700 1 --2- 172.21.15.23:0/3723318206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0660100240 0x7f0660100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.498+0000 7f0665800700 1 -- 172.21.15.23:0/3723318206 >> 172.21.15.23:0/3723318206 conn(0x7f06600fb7f0 msgr2=0x7f06600fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.499+0000 7f0665800700 1 -- 172.21.15.23:0/3723318206 shutdown_connections 2024-02-28T16:27:44.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.499+0000 7f0665800700 1 -- 172.21.15.23:0/3723318206 wait complete. 2024-02-28T16:27:44.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.500+0000 7f0665800700 1 Processor -- start 2024-02-28T16:27:44.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.500+0000 7f0665800700 1 -- start start 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.500+0000 7f0665800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0660100240 0x7f0660195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.500+0000 7f0665800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.500+0000 7f0665800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0660196610 con 0x7f0660101440 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.500+0000 7f0665800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0660196750 con 0x7f0660100240 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.501+0000 7f065e000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.501+0000 7f065e000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:48216/0 (socket says 172.21.15.23:48216) 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.501+0000 7f065e000700 1 -- 172.21.15.23:0/1266108997 learned_addr learned my addr 172.21.15.23:0/1266108997 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:27:44.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.501+0000 7f065ea00700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0660100240 0x7f0660195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.501+0000 7f065e000700 1 -- 172.21.15.23:0/1266108997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0660100240 msgr2=0x7f0660195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.501+0000 7f065e000700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0660100240 0x7f0660195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.501+0000 7f065e000700 1 -- 172.21.15.23:0/1266108997 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0095f0 con 0x7f0660101440 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.502+0000 7f065e000700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660195ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f064c005b40 tx=0x7f064c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.502+0000 7f0657400700 1 -- 172.21.15.23:0/1266108997 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f064c01d070 con 0x7f0660101440 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.502+0000 7f0657400700 1 -- 172.21.15.23:0/1266108997 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f064c00f460 con 0x7f0660101440 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.502+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066019b1a0 con 0x7f0660101440 2024-02-28T16:27:44.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.502+0000 7f0657400700 1 -- 172.21.15.23:0/1266108997 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f064c021640 con 0x7f0660101440 2024-02-28T16:27:44.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.502+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066019b690 con 0x7f0660101440 2024-02-28T16:27:44.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.504+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0660108d90 con 0x7f0660101440 2024-02-28T16:27:44.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.504+0000 7f0657400700 1 -- 172.21.15.23:0/1266108997 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f064c00fa90 con 0x7f0660101440 2024-02-28T16:27:44.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.505+0000 7f0657400700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f064406d8a0 0x7f064406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:44.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.505+0000 7f0657400700 1 -- 172.21.15.23:0/1266108997 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f064c08e7c0 con 0x7f0660101440 2024-02-28T16:27:44.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.506+0000 7f065ea00700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f064406d8a0 0x7f064406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:44.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.506+0000 7f065ea00700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f064406d8a0 0x7f064406fd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06601012a0 tx=0x7f065000bef0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:44.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.510+0000 7f0657400700 1 -- 172.21.15.23:0/1266108997 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f064c05bad0 con 0x7f0660101440 2024-02-28T16:27:44.828 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.838+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0660108f50 con 0x7f0660101440 2024-02-28T16:27:44.828 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.838+0000 7f0657400700 1 -- 172.21.15.23:0/1266108997 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f064c05b660 con 0x7f0660101440 2024-02-28T16:27:44.828 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:27:44.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f064406d8a0 msgr2=0x7f064406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f064406d8a0 0x7f064406fd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06601012a0 tx=0x7f065000bef0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 msgr2=0x7f0660195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660195ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f064c005b40 tx=0x7f064c00be20 comp rx=0 tx=0).stop 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 shutdown_connections 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0660100240 0x7f0660195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f064406d8a0 0x7f064406fd50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 --2- 172.21.15.23:0/1266108997 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0660101440 0x7f0660195ff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.841+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 >> 172.21.15.23:0/1266108997 conn(0x7f06600fb7f0 msgr2=0x7f0660104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:44.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.842+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 shutdown_connections 2024-02-28T16:27:44.832 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:27:44.842+0000 7f0665800700 1 -- 172.21.15.23:0/1266108997 wait complete. 2024-02-28T16:27:45.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:44 smithi153 ceph-mon[66339]: pgmap v59: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:45.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:44 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1495019009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:27:45.151 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:44 smithi023 ceph-mon[78509]: pgmap v59: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:45.151 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:44 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1495019009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:27:45.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:45 smithi023 ceph-mon[78509]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:45.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:45 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1266108997' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:27:46.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:45 smithi153 ceph-mon[66339]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:46.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:45 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1266108997' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:27:47.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: pgmap v60: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:47.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:47.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:27:47.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi023"}]: dispatch 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi023"}]': finished 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]: dispatch 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]': finished 2024-02-28T16:27:47.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:27:47.416 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: pgmap v60: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:47.416 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.416 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.416 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi023"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi023"}]': finished 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]: dispatch 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]': finished 2024-02-28T16:27:47.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:27:48.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:48 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all crash 2024-02-28T16:27:48.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:48 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:27:48.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:48 smithi153 ceph-mon[66339]: Upgrade: osd.0 is safe to restart 2024-02-28T16:27:48.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:48 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all crash 2024-02-28T16:27:48.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:48 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:27:48.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:48 smithi023 ceph-mon[78509]: Upgrade: osd.0 is safe to restart 2024-02-28T16:27:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:49 smithi153 ceph-mon[66339]: pgmap v61: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:27:49.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:49.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:49 smithi023 ceph-mon[78509]: pgmap v61: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:49.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:27:49.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:27:49.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:50 smithi153 ceph-mon[66339]: Upgrade: Updating osd.0 2024-02-28T16:27:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:50 smithi153 ceph-mon[66339]: Deploying daemon osd.0 on smithi023 2024-02-28T16:27:50.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:50 smithi023 ceph-mon[78509]: Upgrade: Updating osd.0 2024-02-28T16:27:50.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:50 smithi023 ceph-mon[78509]: Deploying daemon osd.0 on smithi023 2024-02-28T16:27:51.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:51 smithi153 ceph-mon[66339]: pgmap v62: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:51.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:51 smithi023 ceph-mon[78509]: pgmap v62: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:52.314 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:52 smithi023 ceph-mon[78509]: pgmap v63: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:52.314 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:52.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:52 smithi153 ceph-mon[66339]: pgmap v63: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:52.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:53.673 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:53 smithi023 systemd[1]: Stopping Ceph osd.0 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:27:54.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:53 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[43906]: 2024-02-28T16:27:53.913+0000 7f7504400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:27:54.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:53 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[43906]: 2024-02-28T16:27:53.913+0000 7f7504400700 -1 osd.0 50 *** Got signal Terminated *** 2024-02-28T16:27:54.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:53 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[43906]: 2024-02-28T16:27:53.913+0000 7f7504400700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:27:54.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:54 smithi153 ceph-mon[66339]: pgmap v64: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:54.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:54 smithi153 ceph-mon[66339]: osd.0 marked itself down and dead 2024-02-28T16:27:54.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:54 smithi023 ceph-mon[78509]: pgmap v64: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:54.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:54 smithi023 ceph-mon[78509]: osd.0 marked itself down and dead 2024-02-28T16:27:55.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:54 smithi023 podman[84698]: 2024-02-28 16:27:54.901363739 +0000 UTC m=+1.171304837 container died b725c282549624248ada638ee119fe9e3b795485f9122a160e9d3de25245c9a8 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-02-28T16:27:55.506 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:55 smithi023 ceph-mon[78509]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:27:55.506 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:55 smithi023 ceph-mon[78509]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T16:27:55.507 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:55 smithi023 podman[84698]: 2024-02-28 16:27:55.3414936 +0000 UTC m=+1.611434737 container cleanup b725c282549624248ada638ee119fe9e3b795485f9122a160e9d3de25245c9a8 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0) 2024-02-28T16:27:55.507 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:55 smithi023 bash[84698]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0 2024-02-28T16:27:55.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:55 smithi153 ceph-mon[66339]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:27:55.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:55 smithi153 ceph-mon[66339]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T16:27:55.923 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:55 smithi023 podman[84717]: 2024-02-28 16:27:55.517371141 +0000 UTC m=+0.593146803 container remove b725c282549624248ada638ee119fe9e3b795485f9122a160e9d3de25245c9a8 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-28T16:27:56.507 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:56 smithi023 ceph-mon[78509]: pgmap v66: 65 pgs: 9 stale+active+clean, 56 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:56.507 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:56 smithi023 ceph-mon[78509]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T16:27:56.507 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:56 smithi023 podman[84807]: 2024-02-28 16:27:56.248219339 +0000 UTC m=+0.038129501 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:27:56.507 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:56 smithi023 podman[84807]: 2024-02-28 16:27:56.351719172 +0000 UTC m=+0.141629365 container create 22f6261ba30042880ec5b927758b447946cfbc8699bbcf720d581ee3428397e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:27:56.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:56 smithi153 ceph-mon[66339]: pgmap v66: 65 pgs: 9 stale+active+clean, 56 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:27:56.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:56 smithi153 ceph-mon[66339]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T16:27:56.768 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:56 smithi023 podman[84807]: 2024-02-28 16:27:56.633548902 +0000 UTC m=+0.423459145 container init 22f6261ba30042880ec5b927758b447946cfbc8699bbcf720d581ee3428397e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True) 2024-02-28T16:27:56.768 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:56 smithi023 podman[84807]: 2024-02-28 16:27:56.645189716 +0000 UTC m=+0.435099876 container start 22f6261ba30042880ec5b927758b447946cfbc8699bbcf720d581ee3428397e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True) 2024-02-28T16:27:56.768 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:56 smithi023 podman[84807]: 2024-02-28 16:27:56.779372578 +0000 UTC m=+0.569282814 container attach 22f6261ba30042880ec5b927758b447946cfbc8699bbcf720d581ee3428397e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:27:57.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:57 smithi023 ceph-mon[78509]: Health check failed: Degraded data redundancy: 41/228 objects degraded (17.982%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:27:57.423 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:57 smithi023 podman[84807]: 2024-02-28 16:27:57.097894696 +0000 UTC m=+0.887804933 container died 22f6261ba30042880ec5b927758b447946cfbc8699bbcf720d581ee3428397e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, ceph=True) 2024-02-28T16:27:57.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:57 smithi153 ceph-mon[66339]: Health check failed: Degraded data redundancy: 41/228 objects degraded (17.982%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:27:58.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:57 smithi023 podman[84833]: 2024-02-28 16:27:57.858322596 +0000 UTC m=+0.739912612 container remove 22f6261ba30042880ec5b927758b447946cfbc8699bbcf720d581ee3428397e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-28T16:27:58.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:57 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-28T16:27:58.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:57 smithi023 systemd[1]: Stopped Ceph osd.0 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:27:58.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:57 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.0.service: Consumed 1min 43.458s CPU time. 2024-02-28T16:27:58.597 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:27:58 smithi023 ceph-mon[78509]: pgmap v68: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:27:58.598 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:58 smithi023 systemd[1]: Starting Ceph osd.0 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:27:58.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:27:58 smithi153 ceph-mon[66339]: pgmap v68: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:27:58.910 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:58 smithi023 podman[84934]: 2024-02-28 16:27:58.515230627 +0000 UTC m=+0.037346916 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:27:58.911 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:58 smithi023 podman[84934]: 2024-02-28 16:27:58.636048007 +0000 UTC m=+0.158164337 container create 5102f7c9c208cbfbc25b60f4a835c484975be16f3f6b6e15c9f500663ca34d1c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-28T16:27:58.911 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:58 smithi023 podman[84934]: 2024-02-28 16:27:58.921522472 +0000 UTC m=+0.443638848 container init 5102f7c9c208cbfbc25b60f4a835c484975be16f3f6b6e15c9f500663ca34d1c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:27:59.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:58 smithi023 podman[84934]: 2024-02-28 16:27:58.933009822 +0000 UTC m=+0.455126118 container start 5102f7c9c208cbfbc25b60f4a835c484975be16f3f6b6e15c9f500663ca34d1c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:27:59.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 podman[84934]: 2024-02-28 16:27:59.019628051 +0000 UTC m=+0.541744417 container attach 5102f7c9c208cbfbc25b60f4a835c484975be16f3f6b6e15c9f500663ca34d1c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate[84948]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate[84948]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 bash[84934]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 bash[84934]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 bash[84934]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 bash[84934]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 bash[84934]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 bash[84934]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:28:00.174 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 bash[84934]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T16:28:00.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate[84948]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:28:00.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate[84948]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:28:00.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate[84948]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T16:28:00.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate[84948]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:28:00.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate[84948]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T16:28:00.175 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:27:59 smithi023 podman[84934]: 2024-02-28 16:27:59.889295076 +0000 UTC m=+1.411411408 container died 5102f7c9c208cbfbc25b60f4a835c484975be16f3f6b6e15c9f500663ca34d1c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:28:00.547 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:00 smithi023 ceph-mon[78509]: pgmap v69: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:00.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:00 smithi153 ceph-mon[66339]: pgmap v69: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:00.913 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:00 smithi023 podman[85077]: 2024-02-28 16:28:00.55849866 +0000 UTC m=+0.648247693 container remove 5102f7c9c208cbfbc25b60f4a835c484975be16f3f6b6e15c9f500663ca34d1c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-02-28T16:28:01.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:00 smithi023 podman[85137]: 2024-02-28 16:28:00.829164084 +0000 UTC m=+0.034686989 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:28:01.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:00 smithi023 podman[85137]: 2024-02-28 16:28:00.951247485 +0000 UTC m=+0.156770426 container create f272a8c2473365141feca85bc4a5b50b5b77fb59d9af1ee9f122a5104791fba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-28T16:28:01.673 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:01 smithi023 podman[85137]: 2024-02-28 16:28:01.246299099 +0000 UTC m=+0.451822086 container init f272a8c2473365141feca85bc4a5b50b5b77fb59d9af1ee9f122a5104791fba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-02-28T16:28:01.673 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:01 smithi023 podman[85137]: 2024-02-28 16:28:01.258309483 +0000 UTC m=+0.463832430 container start f272a8c2473365141feca85bc4a5b50b5b77fb59d9af1ee9f122a5104791fba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-02-28T16:28:01.673 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:01 smithi023 ceph-osd[85156]: -- 172.21.15.23:0/2863444480 <== mon.0 v2:172.21.15.23:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x565059ccb680 con 0x565059c95000 2024-02-28T16:28:01.673 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:01 smithi023 bash[85137]: f272a8c2473365141feca85bc4a5b50b5b77fb59d9af1ee9f122a5104791fba8 2024-02-28T16:28:01.673 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:01 smithi023 systemd[1]: Started Ceph osd.0 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:28:02.173 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:01 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[85152]: 2024-02-28T16:28:01.838+0000 7f8d350f27c0 -1 Falling back to public interface 2024-02-28T16:28:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:02 smithi023 ceph-mon[78509]: pgmap v70: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:02 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:02 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:02 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:02.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:02 smithi153 ceph-mon[66339]: pgmap v70: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:02.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:02 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:02.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:02 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:02.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:02 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:04.823 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:04 smithi023 ceph-mon[78509]: pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:04.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:04 smithi153 ceph-mon[66339]: pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:06.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:06 smithi153 ceph-mon[66339]: pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:06.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:06.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:06.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:06 smithi023 ceph-mon[78509]: pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:06.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:06.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:07.423 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:06 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[85152]: 2024-02-28T16:28:06.957+0000 7f8d350f27c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-28T16:28:07.923 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:07 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[85152]: 2024-02-28T16:28:07.563+0000 7f8d350f27c0 -1 osd.0 50 log_to_monitors true 2024-02-28T16:28:08.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:08 smithi153 ceph-mon[66339]: pgmap v73: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:08.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:08 smithi153 ceph-mon[66339]: from='osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:28:08.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:08 smithi023 ceph-mon[78509]: pgmap v73: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:08.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:08 smithi023 ceph-mon[78509]: from='osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:28:08.923 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:28:08 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[85152]: 2024-02-28T16:28:08.587+0000 7f8d24400700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:28:09.568 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:09 smithi023 ceph-mon[78509]: from='osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:28:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:09 smithi153 ceph-mon[66339]: from='osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:28:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:09 smithi153 ceph-mon[66339]: osdmap e53: 6 total, 5 up, 6 in 2024-02-28T16:28:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:09 smithi153 ceph-mon[66339]: from='osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:28:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:09 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:09.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:09 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:09 smithi023 ceph-mon[78509]: osdmap e53: 6 total, 5 up, 6 in 2024-02-28T16:28:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:09 smithi023 ceph-mon[78509]: from='osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:28:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:09 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:09 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:10.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:10 smithi153 ceph-mon[66339]: pgmap v75: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:10.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:10 smithi153 ceph-mon[66339]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:28:10.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:10 smithi153 ceph-mon[66339]: osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307] boot 2024-02-28T16:28:10.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:10 smithi153 ceph-mon[66339]: osdmap e54: 6 total, 6 up, 6 in 2024-02-28T16:28:10.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:28:10.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:10 smithi153 ceph-mon[66339]: osdmap e55: 6 total, 6 up, 6 in 2024-02-28T16:28:10.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:10 smithi023 ceph-mon[78509]: pgmap v75: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:10.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:10 smithi023 ceph-mon[78509]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:28:10.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:10 smithi023 ceph-mon[78509]: osd.0 [v2:172.21.15.23:6802/4096152307,v1:172.21.15.23:6803/4096152307] boot 2024-02-28T16:28:10.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:10 smithi023 ceph-mon[78509]: osdmap e54: 6 total, 6 up, 6 in 2024-02-28T16:28:10.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:28:10.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:10 smithi023 ceph-mon[78509]: osdmap e55: 6 total, 6 up, 6 in 2024-02-28T16:28:12.087 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:12.088 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:12.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:13.047 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:12 smithi153 ceph-mon[66339]: pgmap v78: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:13.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:12 smithi023 ceph-mon[78509]: pgmap v78: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:28:13.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:13 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:14.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:13 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 -- 172.21.15.23:0/2227543423 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be8074d80 msgr2=0x7f5be80731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 --2- 172.21.15.23:0/2227543423 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be8074d80 0x7f5be80731e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009910 tx=0x7f5bd8009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 -- 172.21.15.23:0/2227543423 shutdown_connections 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 --2- 172.21.15.23:0/2227543423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be80737b0 0x7f5be8073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 --2- 172.21.15.23:0/2227543423 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be8074d80 0x7f5be80731e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 -- 172.21.15.23:0/2227543423 >> 172.21.15.23:0/2227543423 conn(0x7f5be80fb7f0 msgr2=0x7f5be80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 -- 172.21.15.23:0/2227543423 shutdown_connections 2024-02-28T16:28:15.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.019+0000 7f5bee400700 1 -- 172.21.15.23:0/2227543423 wait complete. 2024-02-28T16:28:15.011 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.020+0000 7f5bee400700 1 Processor -- start 2024-02-28T16:28:15.011 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5bee400700 1 -- start start 2024-02-28T16:28:15.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5bee400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be80737b0 0x7f5be819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5bee400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be8074d80 0x7f5be819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5bee400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be819cbd0 con 0x7f5be80737b0 2024-02-28T16:28:15.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5bee400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be819cd10 con 0x7f5be8074d80 2024-02-28T16:28:15.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5be7400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be80737b0 0x7f5be819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5be7400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be80737b0 0x7f5be819c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51000/0 (socket says 172.21.15.23:51000) 2024-02-28T16:28:15.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.021+0000 7f5be7400700 1 -- 172.21.15.23:0/3232526300 learned_addr learned my addr 172.21.15.23:0/3232526300 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.022+0000 7f5be6a00700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be8074d80 0x7f5be819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.022+0000 7f5be7400700 1 -- 172.21.15.23:0/3232526300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be8074d80 msgr2=0x7f5be819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.022+0000 7f5be7400700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be8074d80 0x7f5be819c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.022+0000 7f5be7400700 1 -- 172.21.15.23:0/3232526300 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80095f0 con 0x7f5be80737b0 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.022+0000 7f5be7400700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be80737b0 0x7f5be819c070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800b5c0 tx=0x7f5bd800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.022+0000 7f5bdfe00700 1 -- 172.21.15.23:0/3232526300 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bd801d070 con 0x7f5be80737b0 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.022+0000 7f5bdfe00700 1 -- 172.21.15.23:0/3232526300 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5bd800f460 con 0x7f5be80737b0 2024-02-28T16:28:15.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.023+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be81a1760 con 0x7f5be80737b0 2024-02-28T16:28:15.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.023+0000 7f5bdfe00700 1 -- 172.21.15.23:0/3232526300 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bd8021640 con 0x7f5be80737b0 2024-02-28T16:28:15.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.023+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be81a1c50 con 0x7f5be80737b0 2024-02-28T16:28:15.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.024+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be810f370 con 0x7f5be80737b0 2024-02-28T16:28:15.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.025+0000 7f5bdfe00700 1 -- 172.21.15.23:0/3232526300 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f5bd800f5d0 con 0x7f5be80737b0 2024-02-28T16:28:15.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.026+0000 7f5bdfe00700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5bcc06d8a0 0x7f5bcc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.026+0000 7f5bdfe00700 1 -- 172.21.15.23:0/3232526300 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5bd808e7e0 con 0x7f5be80737b0 2024-02-28T16:28:15.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.026+0000 7f5be6a00700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5bcc06d8a0 0x7f5bcc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.027+0000 7f5be6a00700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5bcc06d8a0 0x7f5bcc06fd50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005950 tx=0x7f5bd40058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:15.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.031+0000 7f5bdfe00700 1 -- 172.21.15.23:0/3232526300 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5bd805baf0 con 0x7f5be80737b0 2024-02-28T16:28:15.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:14 smithi153 ceph-mon[66339]: pgmap v79: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/228 objects degraded (3.070%) 2024-02-28T16:28:15.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:14 smithi023 ceph-mon[78509]: pgmap v79: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/228 objects degraded (3.070%) 2024-02-28T16:28:15.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.287+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5be81032f0 con 0x7f5bcc06d8a0 2024-02-28T16:28:15.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.290+0000 7f5bdfe00700 1 -- 172.21.15.23:0/3232526300 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5be81032f0 con 0x7f5bcc06d8a0 2024-02-28T16:28:15.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.292+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5bcc06d8a0 msgr2=0x7f5bcc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.292+0000 7f5bee400700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5bcc06d8a0 0x7f5bcc06fd50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005950 tx=0x7f5bd40058e0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be80737b0 msgr2=0x7f5be819c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be80737b0 0x7f5be819c070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800b5c0 tx=0x7f5bd800be20 comp rx=0 tx=0).stop 2024-02-28T16:28:15.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 shutdown_connections 2024-02-28T16:28:15.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5bcc06d8a0 0x7f5bcc06fd50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5be80737b0 0x7f5be819c070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 --2- 172.21.15.23:0/3232526300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be8074d80 0x7f5be819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 >> 172.21.15.23:0/3232526300 conn(0x7f5be80fb7f0 msgr2=0x7f5be8101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:15.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 shutdown_connections 2024-02-28T16:28:15.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.293+0000 7f5bee400700 1 -- 172.21.15.23:0/3232526300 wait complete. 2024-02-28T16:28:15.299 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:28:15.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.457+0000 7fa8f2600700 1 -- 172.21.15.23:0/2001254912 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec074d80 msgr2=0x7fa8ec0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.457+0000 7fa8f2600700 1 --2- 172.21.15.23:0/2001254912 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec074d80 0x7fa8ec0731e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009910 tx=0x7fa8dc009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:15.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.457+0000 7fa8f2600700 1 -- 172.21.15.23:0/2001254912 shutdown_connections 2024-02-28T16:28:15.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.457+0000 7fa8f2600700 1 --2- 172.21.15.23:0/2001254912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8ec0737b0 0x7fa8ec073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.457+0000 7fa8f2600700 1 --2- 172.21.15.23:0/2001254912 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec074d80 0x7fa8ec0731e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.457+0000 7fa8f2600700 1 -- 172.21.15.23:0/2001254912 >> 172.21.15.23:0/2001254912 conn(0x7fa8ec0fb7f0 msgr2=0x7fa8ec0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:15.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.457+0000 7fa8f2600700 1 -- 172.21.15.23:0/2001254912 shutdown_connections 2024-02-28T16:28:15.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.458+0000 7fa8f2600700 1 -- 172.21.15.23:0/2001254912 wait complete. 2024-02-28T16:28:15.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.458+0000 7fa8f2600700 1 Processor -- start 2024-02-28T16:28:15.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8f2600700 1 -- start start 2024-02-28T16:28:15.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8f2600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec0737b0 0x7fa8ec19c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8f2600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8ec074d80 0x7fa8ec19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8f2600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec19cc50 con 0x7fa8ec0737b0 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8f2600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec19cd90 con 0x7fa8ec074d80 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8eb400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec0737b0 0x7fa8ec19c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8eb400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec0737b0 0x7fa8ec19c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51020/0 (socket says 172.21.15.23:51020) 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.459+0000 7fa8eb400700 1 -- 172.21.15.23:0/4289981611 learned_addr learned my addr 172.21.15.23:0/4289981611 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8e3e00700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8ec074d80 0x7fa8ec19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8eb400700 1 -- 172.21.15.23:0/4289981611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8ec074d80 msgr2=0x7fa8ec19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8eb400700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8ec074d80 0x7fa8ec19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8eb400700 1 -- 172.21.15.23:0/4289981611 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0095f0 con 0x7fa8ec0737b0 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8eb400700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec0737b0 0x7fa8ec19c0f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00b5c0 tx=0x7fa8dc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:15.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8e8c00700 1 -- 172.21.15.23:0/4289981611 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8dc01d070 con 0x7fa8ec0737b0 2024-02-28T16:28:15.452 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec1a17e0 con 0x7fa8ec0737b0 2024-02-28T16:28:15.452 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8e8c00700 1 -- 172.21.15.23:0/4289981611 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8dc022470 con 0x7fa8ec0737b0 2024-02-28T16:28:15.452 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.460+0000 7fa8e8c00700 1 -- 172.21.15.23:0/4289981611 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8dc00f690 con 0x7fa8ec0737b0 2024-02-28T16:28:15.452 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.461+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec1a1cd0 con 0x7fa8ec0737b0 2024-02-28T16:28:15.452 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.462+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec10f3f0 con 0x7fa8ec0737b0 2024-02-28T16:28:15.453 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.463+0000 7fa8e8c00700 1 -- 172.21.15.23:0/4289981611 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa8dc004b70 con 0x7fa8ec0737b0 2024-02-28T16:28:15.454 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.463+0000 7fa8e8c00700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8d006d8a0 0x7fa8d006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.454 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.464+0000 7fa8e8c00700 1 -- 172.21.15.23:0/4289981611 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa8dc08ed30 con 0x7fa8ec0737b0 2024-02-28T16:28:15.454 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.464+0000 7fa8e3e00700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8d006d8a0 0x7fa8d006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.454 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.465+0000 7fa8e3e00700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8d006d8a0 0x7fa8d006fd50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4006fd0 tx=0x7fa8d4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:15.459 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.469+0000 7fa8e8c00700 1 -- 172.21.15.23:0/4289981611 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa8dc05c210 con 0x7fa8ec0737b0 2024-02-28T16:28:15.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.728+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8ec1a2420 con 0x7fa8d006d8a0 2024-02-28T16:28:15.719 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.729+0000 7fa8e8c00700 1 -- 172.21.15.23:0/4289981611 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa8ec1a2420 con 0x7fa8d006d8a0 2024-02-28T16:28:15.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8d006d8a0 msgr2=0x7fa8d006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8d006d8a0 0x7fa8d006fd50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4006fd0 tx=0x7fa8d4008040 comp rx=0 tx=0).stop 2024-02-28T16:28:15.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec0737b0 msgr2=0x7fa8ec19c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec0737b0 0x7fa8ec19c0f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00b5c0 tx=0x7fa8dc00be20 comp rx=0 tx=0).stop 2024-02-28T16:28:15.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 shutdown_connections 2024-02-28T16:28:15.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8d006d8a0 0x7fa8d006fd50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8ec0737b0 0x7fa8ec19c0f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 --2- 172.21.15.23:0/4289981611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8ec074d80 0x7fa8ec19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 >> 172.21.15.23:0/4289981611 conn(0x7fa8ec0fb7f0 msgr2=0x7fa8ec101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:15.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 shutdown_connections 2024-02-28T16:28:15.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.733+0000 7fa8f2600700 1 -- 172.21.15.23:0/4289981611 wait complete. 2024-02-28T16:28:15.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 -- 172.21.15.23:0/2230173471 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 msgr2=0x7ff9b8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 --2- 172.21.15.23:0/2230173471 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8100650 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009910 tx=0x7ff9ac009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:15.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 -- 172.21.15.23:0/2230173471 shutdown_connections 2024-02-28T16:28:15.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 --2- 172.21.15.23:0/2230173471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9b8101440 0x7ff9b8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 --2- 172.21.15.23:0/2230173471 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8100650 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 -- 172.21.15.23:0/2230173471 >> 172.21.15.23:0/2230173471 conn(0x7ff9b80fb7f0 msgr2=0x7ff9b80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:15.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 -- 172.21.15.23:0/2230173471 shutdown_connections 2024-02-28T16:28:15.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.897+0000 7ff9c0800700 1 -- 172.21.15.23:0/2230173471 wait complete. 2024-02-28T16:28:15.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.899+0000 7ff9c0800700 1 Processor -- start 2024-02-28T16:28:15.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.899+0000 7ff9c0800700 1 -- start start 2024-02-28T16:28:15.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.899+0000 7ff9c0800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.899+0000 7ff9c0800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9b8101440 0x7ff9b8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.899+0000 7ff9c0800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8073680 con 0x7ff9b8100240 2024-02-28T16:28:15.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.899+0000 7ff9c0800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80737c0 con 0x7ff9b8101440 2024-02-28T16:28:15.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.900+0000 7ff9bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.900+0000 7ff9bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51038/0 (socket says 172.21.15.23:51038) 2024-02-28T16:28:15.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.900+0000 7ff9bde00700 1 -- 172.21.15.23:0/221340993 learned_addr learned my addr 172.21.15.23:0/221340993 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:15.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.900+0000 7ff9bd400700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9b8101440 0x7ff9b8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.900+0000 7ff9bde00700 1 -- 172.21.15.23:0/221340993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9b8101440 msgr2=0x7ff9b8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:15.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.900+0000 7ff9bde00700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9b8101440 0x7ff9b8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:15.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.900+0000 7ff9bde00700 1 -- 172.21.15.23:0/221340993 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0095f0 con 0x7ff9b8100240 2024-02-28T16:28:15.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.901+0000 7ff9bde00700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8074af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00bd70 tx=0x7ff9ac00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:15.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.901+0000 7ff9b2a00700 1 -- 172.21.15.23:0/221340993 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9ac01d070 con 0x7ff9b8100240 2024-02-28T16:28:15.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.901+0000 7ff9b2a00700 1 -- 172.21.15.23:0/221340993 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9ac00f460 con 0x7ff9b8100240 2024-02-28T16:28:15.893 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.901+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b8073a40 con 0x7ff9b8100240 2024-02-28T16:28:15.893 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.901+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b8073f30 con 0x7ff9b8100240 2024-02-28T16:28:15.893 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.901+0000 7ff9b2a00700 1 -- 172.21.15.23:0/221340993 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9ac021640 con 0x7ff9b8100240 2024-02-28T16:28:15.893 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.902+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c005320 con 0x7ff9b8100240 2024-02-28T16:28:15.894 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.904+0000 7ff9b2a00700 1 -- 172.21.15.23:0/221340993 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff9ac004b20 con 0x7ff9b8100240 2024-02-28T16:28:15.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.905+0000 7ff9b2a00700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff9a006d8a0 0x7ff9a006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:15.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.905+0000 7ff9b2a00700 1 -- 172.21.15.23:0/221340993 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff9ac08e7c0 con 0x7ff9b8100240 2024-02-28T16:28:15.896 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.906+0000 7ff9bd400700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff9a006d8a0 0x7ff9a006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:15.896 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.907+0000 7ff9bd400700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff9a006d8a0 0x7ff9a006fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8005950 tx=0x7ff9a8005cf0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:15.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:15.911+0000 7ff9b2a00700 1 -- 172.21.15.23:0/221340993 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff9ac05bb70 con 0x7ff9b8100240 2024-02-28T16:28:16.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.153+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff99c000bf0 con 0x7ff9a006d8a0 2024-02-28T16:28:16.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.166+0000 7ff9b2a00700 1 -- 172.21.15.23:0/221340993 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff99c000bf0 con 0x7ff9a006d8a0 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (13m) 7s ago 15m 14.1M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (15m) 7s ago 15m 8132k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (14m) 39s ago 14m 7742k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (52s) 7s ago 15m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (45s) 39s ago 14m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (13m) 7s ago 14m 74.1M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (7m) 7s ago 7m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (8m) 7s ago 8m 16.1M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (7m) 39s ago 7m 15.7M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (7m) 39s ago 7m 16.0M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:28:16.157 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (4m) 7s ago 16m 499M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (3m) 39s ago 13m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (2m) 7s ago 17m 44.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (2m) 39s ago 13m 37.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (15m) 7s ago 15m 8002k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (13m) 39s ago 13m 8208k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (15s) 7s ago 12m 11.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (12m) 7s ago 12m 241M 1217M 18.2.0 dc2bc1663786 aced9958d1b1 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (11m) 7s ago 11m 201M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (10m) 39s ago 10m 277M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (10m) 39s ago 10m 255M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (9m) 39s ago 9m 228M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:28:16.158 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (3m) 7s ago 14m 55.6M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff9a006d8a0 msgr2=0x7ff9a006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff9a006d8a0 0x7ff9a006fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8005950 tx=0x7ff9a8005cf0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 msgr2=0x7ff9b8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8074af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00bd70 tx=0x7ff9ac00be50 comp rx=0 tx=0).stop 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 shutdown_connections 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff9a006d8a0 0x7ff9a006fd50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff9b8100240 0x7ff9b8074af0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 --2- 172.21.15.23:0/221340993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9b8101440 0x7ff9b8073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.169+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 >> 172.21.15.23:0/221340993 conn(0x7ff9b80fb7f0 msgr2=0x7ff9b8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:16.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.170+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 shutdown_connections 2024-02-28T16:28:16.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.170+0000 7ff9c0800700 1 -- 172.21.15.23:0/221340993 wait complete. 2024-02-28T16:28:16.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 -- 172.21.15.23:0/2038961837 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 msgr2=0x7f71000731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 --2- 172.21.15.23:0/2038961837 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f71000731e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009910 tx=0x7f70f0009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:16.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 -- 172.21.15.23:0/2038961837 shutdown_connections 2024-02-28T16:28:16.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 --2- 172.21.15.23:0/2038961837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71000737b0 0x7f7100073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 --2- 172.21.15.23:0/2038961837 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f71000731e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 -- 172.21.15.23:0/2038961837 >> 172.21.15.23:0/2038961837 conn(0x7f71000fb7f0 msgr2=0x7f71000fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:16.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 -- 172.21.15.23:0/2038961837 shutdown_connections 2024-02-28T16:28:16.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.337+0000 7f7104a00700 1 -- 172.21.15.23:0/2038961837 wait complete. 2024-02-28T16:28:16.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.338+0000 7f7104a00700 1 Processor -- start 2024-02-28T16:28:16.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.339+0000 7f7104a00700 1 -- start start 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.339+0000 7f7104a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71000737b0 0x7f710019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.339+0000 7f7104a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f710019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.339+0000 7f7104a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710019cc50 con 0x7f7100074d80 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.339+0000 7f7104a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710019cd90 con 0x7f71000737b0 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.339+0000 7f70fd400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f710019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.340+0000 7f70fd400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f710019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51054/0 (socket says 172.21.15.23:51054) 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.340+0000 7f70fd400700 1 -- 172.21.15.23:0/550034748 learned_addr learned my addr 172.21.15.23:0/550034748 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:16.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.340+0000 7f70fde00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71000737b0 0x7f710019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:16.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.340+0000 7f70fd400700 1 -- 172.21.15.23:0/550034748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71000737b0 msgr2=0x7f710019c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.340+0000 7f70fd400700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71000737b0 0x7f710019c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.340+0000 7f70fd400700 1 -- 172.21.15.23:0/550034748 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f00095f0 con 0x7f7100074d80 2024-02-28T16:28:16.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.341+0000 7f70fd400700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f710019c630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00b4b0 tx=0x7f70ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:16.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.341+0000 7f70f6a00700 1 -- 172.21.15.23:0/550034748 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70ec011800 con 0x7f7100074d80 2024-02-28T16:28:16.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.341+0000 7f70f6a00700 1 -- 172.21.15.23:0/550034748 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f70ec011e10 con 0x7f7100074d80 2024-02-28T16:28:16.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.341+0000 7f70f6a00700 1 -- 172.21.15.23:0/550034748 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70ec00f2e0 con 0x7f7100074d80 2024-02-28T16:28:16.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.341+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71001a1840 con 0x7f7100074d80 2024-02-28T16:28:16.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.341+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71001a1d90 con 0x7f7100074d80 2024-02-28T16:28:16.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.343+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710010f3f0 con 0x7f7100074d80 2024-02-28T16:28:16.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.344+0000 7f70f6a00700 1 -- 172.21.15.23:0/550034748 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f70ec010380 con 0x7f7100074d80 2024-02-28T16:28:16.335 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.345+0000 7f70f6a00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f70e406d8f0 0x7f70e406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:16.335 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.345+0000 7f70f6a00700 1 -- 172.21.15.23:0/550034748 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f70ec08cf40 con 0x7f7100074d80 2024-02-28T16:28:16.335 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.345+0000 7f70fde00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f70e406d8f0 0x7f70e406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:16.336 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.346+0000 7f70fde00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f70e406d8f0 0x7f70e406fda0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70f0006010 tx=0x7f70f000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:16.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.354+0000 7f70f6a00700 1 -- 172.21.15.23:0/550034748 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f70ec0c0d20 con 0x7f7100074d80 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: pgmap v80: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:16.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:16.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:16.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:28:16.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:28:16.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: Upgrade: osd.1 is safe to restart 2024-02-28T16:28:16.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:16.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded) 2024-02-28T16:28:16.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:16 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:28:16.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: pgmap v80: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:16.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:16.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:16.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:16.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:16.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:16.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: Upgrade: osd.1 is safe to restart 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded) 2024-02-28T16:28:16.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:16 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:28:16.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.697+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f710010f5b0 con 0x7f7100074d80 2024-02-28T16:28:16.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.699+0000 7f70f6a00700 1 -- 172.21.15.23:0/550034748 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f70ec015330 con 0x7f7100074d80 2024-02-28T16:28:16.689 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:28:16.689 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:28:16.689 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:16.689 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:16.689 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:28:16.689 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:28:16.690 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:28:16.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f70e406d8f0 msgr2=0x7f70e406fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f70e406d8f0 0x7f70e406fda0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70f0006010 tx=0x7f70f000b540 comp rx=0 tx=0).stop 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 msgr2=0x7f710019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f710019c630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00b4b0 tx=0x7f70ec00b870 comp rx=0 tx=0).stop 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 shutdown_connections 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71000737b0 0x7f710019c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f70e406d8f0 0x7f70e406fda0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 --2- 172.21.15.23:0/550034748 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7100074d80 0x7f710019c630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 >> 172.21.15.23:0/550034748 conn(0x7f71000fb7f0 msgr2=0x7f7100101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 shutdown_connections 2024-02-28T16:28:16.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.702+0000 7f7104a00700 1 -- 172.21.15.23:0/550034748 wait complete. 2024-02-28T16:28:16.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.866+0000 7f9a60a00700 1 -- 172.21.15.23:0/4149639182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c100240 msgr2=0x7f9a5c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.866+0000 7f9a60a00700 1 --2- 172.21.15.23:0/4149639182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c100240 0x7f9a5c100650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009910 tx=0x7f9a4c009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:16.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.867+0000 7f9a60a00700 1 -- 172.21.15.23:0/4149639182 shutdown_connections 2024-02-28T16:28:16.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.867+0000 7f9a60a00700 1 --2- 172.21.15.23:0/4149639182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a5c101440 0x7f9a5c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.867+0000 7f9a60a00700 1 --2- 172.21.15.23:0/4149639182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c100240 0x7f9a5c100650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.867+0000 7f9a60a00700 1 -- 172.21.15.23:0/4149639182 >> 172.21.15.23:0/4149639182 conn(0x7f9a5c0fb7f0 msgr2=0x7f9a5c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:16.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.867+0000 7f9a60a00700 1 -- 172.21.15.23:0/4149639182 shutdown_connections 2024-02-28T16:28:16.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.867+0000 7f9a60a00700 1 -- 172.21.15.23:0/4149639182 wait complete. 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.868+0000 7f9a60a00700 1 Processor -- start 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.868+0000 7f9a60a00700 1 -- start start 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.868+0000 7f9a60a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a5c100240 0x7f9a5c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.868+0000 7f9a60a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c101440 0x7f9a5c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.868+0000 7f9a60a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c1987f0 con 0x7f9a5c101440 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.868+0000 7f9a60a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c198960 con 0x7f9a5c100240 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c101440 0x7f9a5c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c101440 0x7f9a5c1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51080/0 (socket says 172.21.15.23:51080) 2024-02-28T16:28:16.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59400700 1 -- 172.21.15.23:0/1282119647 learned_addr learned my addr 172.21.15.23:0/1282119647 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:16.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59e00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a5c100240 0x7f9a5c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:16.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59400700 1 -- 172.21.15.23:0/1282119647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a5c100240 msgr2=0x7f9a5c197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:16.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59400700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a5c100240 0x7f9a5c197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59400700 1 -- 172.21.15.23:0/1282119647 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c0095f0 con 0x7f9a5c101440 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.869+0000 7f9a59e00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a5c100240 0x7f9a5c197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.870+0000 7f9a59400700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c101440 0x7f9a5c1981f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800d8d0 tx=0x7f9a4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.870+0000 7f9a52a00700 1 -- 172.21.15.23:0/1282119647 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a48009940 con 0x7f9a5c101440 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.870+0000 7f9a52a00700 1 -- 172.21.15.23:0/1282119647 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a48010460 con 0x7f9a5c101440 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.870+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c19d3f0 con 0x7f9a5c101440 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.870+0000 7f9a52a00700 1 -- 172.21.15.23:0/1282119647 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4800f5f0 con 0x7f9a5c101440 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.870+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c19d940 con 0x7f9a5c101440 2024-02-28T16:28:16.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.872+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c105520 con 0x7f9a5c101440 2024-02-28T16:28:16.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.873+0000 7f9a52a00700 1 -- 172.21.15.23:0/1282119647 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9a480105d0 con 0x7f9a5c101440 2024-02-28T16:28:16.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.874+0000 7f9a52a00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9a4006d8a0 0x7f9a4006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:16.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.874+0000 7f9a52a00700 1 -- 172.21.15.23:0/1282119647 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9a4808d470 con 0x7f9a5c101440 2024-02-28T16:28:16.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.874+0000 7f9a59e00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9a4006d8a0 0x7f9a4006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:16.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.875+0000 7f9a59e00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9a4006d8a0 0x7f9a4006fd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009fd0 tx=0x7f9a4c00b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:16.869 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:16.879+0000 7f9a52a00700 1 -- 172.21.15.23:0/1282119647 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9a48056c50 con 0x7f9a5c101440 2024-02-28T16:28:17.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.161+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a5c02cc30 con 0x7f9a5c101440 2024-02-28T16:28:17.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.162+0000 7f9a52a00700 1 -- 172.21.15.23:0/1282119647 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f9a48016750 con 0x7f9a5c101440 2024-02-28T16:28:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:28:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:28:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:28:17.152 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:28:17.152 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:28:17.153 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:28:17.154 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:17.155 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9a4006d8a0 msgr2=0x7f9a4006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9a4006d8a0 0x7f9a4006fd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009fd0 tx=0x7f9a4c00b560 comp rx=0 tx=0).stop 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c101440 msgr2=0x7f9a5c1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c101440 0x7f9a5c1981f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800d8d0 tx=0x7f9a4800dc90 comp rx=0 tx=0).stop 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 shutdown_connections 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a5c100240 0x7f9a5c197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9a4006d8a0 0x7f9a4006fd50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 --2- 172.21.15.23:0/1282119647 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9a5c101440 0x7f9a5c1981f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.164+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 >> 172.21.15.23:0/1282119647 conn(0x7f9a5c0fb7f0 msgr2=0x7f9a5c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.165+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 shutdown_connections 2024-02-28T16:28:17.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.165+0000 7f9a60a00700 1 -- 172.21.15.23:0/1282119647 wait complete. 2024-02-28T16:28:17.157 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:28:17.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 -- 172.21.15.23:0/1924798454 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808101440 msgr2=0x7f6808101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 --2- 172.21.15.23:0/1924798454 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808101440 0x7f6808101890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009910 tx=0x7f67f4009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:17.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 -- 172.21.15.23:0/1924798454 shutdown_connections 2024-02-28T16:28:17.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 --2- 172.21.15.23:0/1924798454 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808101440 0x7f6808101890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 --2- 172.21.15.23:0/1924798454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6808100240 0x7f6808100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 -- 172.21.15.23:0/1924798454 >> 172.21.15.23:0/1924798454 conn(0x7f68080fb7f0 msgr2=0x7f68080fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:17.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 -- 172.21.15.23:0/1924798454 shutdown_connections 2024-02-28T16:28:17.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.314+0000 7f680f400700 1 -- 172.21.15.23:0/1924798454 wait complete. 2024-02-28T16:28:17.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.315+0000 7f680f400700 1 Processor -- start 2024-02-28T16:28:17.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.315+0000 7f680f400700 1 -- start start 2024-02-28T16:28:17.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808100240 0x7f6808074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:17.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680f400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6808101440 0x7f6808073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:17.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680f400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6808073680 con 0x7f6808100240 2024-02-28T16:28:17.306 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680f400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68080737c0 con 0x7f6808101440 2024-02-28T16:28:17.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808100240 0x7f6808074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:17.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808100240 0x7f6808074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51110/0 (socket says 172.21.15.23:51110) 2024-02-28T16:28:17.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680ca00700 1 -- 172.21.15.23:0/1039298759 learned_addr learned my addr 172.21.15.23:0/1039298759 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:17.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f6807e00700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6808101440 0x7f6808073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:17.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.316+0000 7f680ca00700 1 -- 172.21.15.23:0/1039298759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6808101440 msgr2=0x7f6808073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f680ca00700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6808101440 0x7f6808073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f680ca00700 1 -- 172.21.15.23:0/1039298759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40095f0 con 0x7f6808100240 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f680ca00700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808100240 0x7f6808074af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00c910 tx=0x7f67fc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f6805600700 1 -- 172.21.15.23:0/1039298759 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67fc0041f0 con 0x7f6808100240 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f6805600700 1 -- 172.21.15.23:0/1039298759 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f67fc007db0 con 0x7f6808100240 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6808073aa0 con 0x7f6808100240 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f6805600700 1 -- 172.21.15.23:0/1039298759 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67fc003d60 con 0x7f6808100240 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.317+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680819daf0 con 0x7f6808100240 2024-02-28T16:28:17.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.318+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6808108d90 con 0x7f6808100240 2024-02-28T16:28:17.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.319+0000 7f6805600700 1 -- 172.21.15.23:0/1039298759 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f67fc007900 con 0x7f6808100240 2024-02-28T16:28:17.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.320+0000 7f6805600700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f67f006d8f0 0x7f67f006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:17.311 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.320+0000 7f6805600700 1 -- 172.21.15.23:0/1039298759 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f67fc08d120 con 0x7f6808100240 2024-02-28T16:28:17.311 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.321+0000 7f6807e00700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f67f006d8f0 0x7f67f006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:17.311 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.321+0000 7f6807e00700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f67f006d8f0 0x7f67f006fda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f67f4006010 tx=0x7f67f400b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:17.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.325+0000 7f6805600700 1 -- 172.21.15.23:0/1039298759 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f67fc05a4b0 con 0x7f6808100240 2024-02-28T16:28:17.573 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.583+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6808105d90 con 0x7f67f006d8f0 2024-02-28T16:28:17.574 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:17 smithi023 ceph-mon[78509]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:17.574 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:17 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/550034748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:17.574 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:17 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1282119647' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.585+0000 7f6805600700 1 -- 172.21.15.23:0/1039298759 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6808105d90 con 0x7f67f006d8f0 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:28:17.575 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:28:17.576 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:28:17.576 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "7/23 daemons upgraded", 2024-02-28T16:28:17.576 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:28:17.576 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:28:17.576 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.587+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f67f006d8f0 msgr2=0x7f67f006fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.587+0000 7f680f400700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f67f006d8f0 0x7f67f006fda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f67f4006010 tx=0x7f67f400b540 comp rx=0 tx=0).stop 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.587+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808100240 msgr2=0x7f6808074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.587+0000 7f680f400700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808100240 0x7f6808074af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00c910 tx=0x7f67fc00ccd0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.588+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 shutdown_connections 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.588+0000 7f680f400700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f67f006d8f0 0x7f67f006fda0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.588+0000 7f680f400700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6808100240 0x7f6808074af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.588+0000 7f680f400700 1 --2- 172.21.15.23:0/1039298759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6808101440 0x7f6808073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.588+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 >> 172.21.15.23:0/1039298759 conn(0x7f68080fb7f0 msgr2=0x7f6808104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:17.578 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.588+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 shutdown_connections 2024-02-28T16:28:17.579 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.588+0000 7f680f400700 1 -- 172.21.15.23:0/1039298759 wait complete. 2024-02-28T16:28:17.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:17 smithi153 ceph-mon[66339]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:17.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:17 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/550034748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:17.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:17 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1282119647' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.744+0000 7f66aec00700 1 -- 172.21.15.23:0/2279210752 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8100240 msgr2=0x7f66a8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.744+0000 7f66aec00700 1 --2- 172.21.15.23:0/2279210752 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8100240 0x7f66a8100650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6698009910 tx=0x7f6698009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.744+0000 7f66aec00700 1 -- 172.21.15.23:0/2279210752 shutdown_connections 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.744+0000 7f66aec00700 1 --2- 172.21.15.23:0/2279210752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a8101440 0x7f66a8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.744+0000 7f66aec00700 1 --2- 172.21.15.23:0/2279210752 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8100240 0x7f66a8100650 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.744+0000 7f66aec00700 1 -- 172.21.15.23:0/2279210752 >> 172.21.15.23:0/2279210752 conn(0x7f66a80fb7f0 msgr2=0x7f66a80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.745+0000 7f66aec00700 1 -- 172.21.15.23:0/2279210752 shutdown_connections 2024-02-28T16:28:17.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.745+0000 7f66aec00700 1 -- 172.21.15.23:0/2279210752 wait complete. 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66aec00700 1 Processor -- start 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66aec00700 1 -- start start 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66aec00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a8100240 0x7f66a8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66aec00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8101440 0x7f66a8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66aec00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8073680 con 0x7f66a8101440 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66aec00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80737c0 con 0x7f66a8100240 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66a7400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8101440 0x7f66a8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:17.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66a7400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8101440 0x7f66a8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51126/0 (socket says 172.21.15.23:51126) 2024-02-28T16:28:17.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.746+0000 7f66a7400700 1 -- 172.21.15.23:0/700308856 learned_addr learned my addr 172.21.15.23:0/700308856 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:17.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a7e00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a8100240 0x7f66a8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:17.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a7400700 1 -- 172.21.15.23:0/700308856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a8100240 msgr2=0x7f66a8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:17.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a7400700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a8100240 0x7f66a8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:17.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a7400700 1 -- 172.21.15.23:0/700308856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66980095f0 con 0x7f66a8101440 2024-02-28T16:28:17.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a7e00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a8100240 0x7f66a8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:28:17.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a7400700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8101440 0x7f66a8073140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f669400c8a0 tx=0x7f669400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:17.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a4c00700 1 -- 172.21.15.23:0/700308856 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669400cea0 con 0x7f66a8101440 2024-02-28T16:28:17.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66a4c00700 1 -- 172.21.15.23:0/700308856 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6694004830 con 0x7f66a8101440 2024-02-28T16:28:17.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.747+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a8073aa0 con 0x7f66a8101440 2024-02-28T16:28:17.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.748+0000 7f66a4c00700 1 -- 172.21.15.23:0/700308856 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66940055b0 con 0x7f66a8101440 2024-02-28T16:28:17.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.748+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a819db30 con 0x7f66a8101440 2024-02-28T16:28:17.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.749+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a8108d90 con 0x7f66a8101440 2024-02-28T16:28:17.740 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.750+0000 7f66a4c00700 1 -- 172.21.15.23:0/700308856 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6694007ad0 con 0x7f66a8101440 2024-02-28T16:28:17.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.751+0000 7f66a4c00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f668c06d8a0 0x7f668c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:17.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.751+0000 7f66a4c00700 1 -- 172.21.15.23:0/700308856 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f669408d150 con 0x7f66a8101440 2024-02-28T16:28:17.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.751+0000 7f66a7e00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f668c06d8a0 0x7f668c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:17.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.751+0000 7f66a7e00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f668c06d8a0 0x7f668c06fd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6698006010 tx=0x7f669800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:17.746 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:17.756+0000 7f66a4c00700 1 -- 172.21.15.23:0/700308856 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f669405a500 con 0x7f66a8101440 2024-02-28T16:28:18.057 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.066+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f66a819e3e0 con 0x7f66a8101440 2024-02-28T16:28:18.057 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.067+0000 7f66a4c00700 1 -- 172.21.15.23:0/700308856 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f669401d020 con 0x7f66a8101440 2024-02-28T16:28:18.057 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.069+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f668c06d8a0 msgr2=0x7f668c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.069+0000 7f66aec00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f668c06d8a0 0x7f668c06fd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6698006010 tx=0x7f669800b540 comp rx=0 tx=0).stop 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.069+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8101440 msgr2=0x7f66a8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.069+0000 7f66aec00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8101440 0x7f66a8073140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f669400c8a0 tx=0x7f669400cc60 comp rx=0 tx=0).stop 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.070+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 shutdown_connections 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.070+0000 7f66aec00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a8100240 0x7f66a8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.070+0000 7f66aec00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f668c06d8a0 0x7f668c06fd50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.070+0000 7f66aec00700 1 --2- 172.21.15.23:0/700308856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f66a8101440 0x7f66a8073140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.070+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 >> 172.21.15.23:0/700308856 conn(0x7f66a80fb7f0 msgr2=0x7f66a8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.070+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 shutdown_connections 2024-02-28T16:28:18.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:18.070+0000 7f66aec00700 1 -- 172.21.15.23:0/700308856 wait complete. 2024-02-28T16:28:19.072 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: pgmap v81: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:19.072 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:19.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: Upgrade: Updating osd.1 2024-02-28T16:28:19.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:19.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:28:19.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:19.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: Deploying daemon osd.1 on smithi023 2024-02-28T16:28:19.073 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:18 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/700308856' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:28:19.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: pgmap v81: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: Upgrade: Updating osd.1 2024-02-28T16:28:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:28:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: Deploying daemon osd.1 on smithi023 2024-02-28T16:28:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:18 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/700308856' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:28:20.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:20 smithi023 ceph-mon[78509]: pgmap v82: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:20 smithi153 ceph-mon[66339]: pgmap v82: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:22.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:22 smithi023 ceph-mon[78509]: pgmap v83: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:22.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:22.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:22.387 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:22 smithi153 ceph-mon[66339]: pgmap v83: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:23.328 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:22 smithi023 systemd[1]: Stopping Ceph osd.1 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:28:23.673 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:23 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[49473]: 2024-02-28T16:28:23.338+0000 7f9c7ea00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:28:23.674 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:23 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[49473]: 2024-02-28T16:28:23.338+0000 7f9c7ea00700 -1 osd.1 55 *** Got signal Terminated *** 2024-02-28T16:28:23.674 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:23 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[49473]: 2024-02-28T16:28:23.338+0000 7f9c7ea00700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:28:24.606 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:24 smithi023 ceph-mon[78509]: pgmap v84: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:24.607 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:24 smithi023 ceph-mon[78509]: osd.1 marked itself down and dead 2024-02-28T16:28:24.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:24 smithi153 ceph-mon[66339]: pgmap v84: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:24.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:24 smithi153 ceph-mon[66339]: osd.1 marked itself down and dead 2024-02-28T16:28:24.923 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:24 smithi023 podman[88061]: 2024-02-28 16:28:24.859436764 +0000 UTC m=+1.639027366 container died aced9958d1b1c5247a225083608332744b9251d10d979dec917c75b511491aee (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True) 2024-02-28T16:28:25.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:25 smithi023 ceph-mon[78509]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:28:25.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:25 smithi023 ceph-mon[78509]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T16:28:25.423 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:25 smithi023 podman[88061]: 2024-02-28 16:28:25.280772258 +0000 UTC m=+2.060362901 container cleanup aced9958d1b1c5247a225083608332744b9251d10d979dec917c75b511491aee (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:28:25.423 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:25 smithi023 bash[88061]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1 2024-02-28T16:28:25.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:25 smithi153 ceph-mon[66339]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:28:25.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:25 smithi153 ceph-mon[66339]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T16:28:25.923 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:25 smithi023 podman[88080]: 2024-02-28 16:28:25.599163051 +0000 UTC m=+0.720618176 container remove aced9958d1b1c5247a225083608332744b9251d10d979dec917c75b511491aee (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20231212) 2024-02-28T16:28:26.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:26 smithi153 ceph-mon[66339]: pgmap v86: 65 pgs: 12 stale+active+clean, 53 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:26.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:26 smithi153 ceph-mon[66339]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T16:28:26.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:26 smithi023 ceph-mon[78509]: pgmap v86: 65 pgs: 12 stale+active+clean, 53 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:26.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:26 smithi023 ceph-mon[78509]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T16:28:26.674 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:26 smithi023 podman[88167]: 2024-02-28 16:28:26.287025802 +0000 UTC m=+0.040418734 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:28:26.674 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:26 smithi023 podman[88167]: 2024-02-28 16:28:26.416764266 +0000 UTC m=+0.170157228 container create 70cd8dadecb186ab8c2c1973b3a40e826a29c77ff29ec16430db46500c077c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-28T16:28:27.173 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:26 smithi023 podman[88167]: 2024-02-28 16:28:26.723597625 +0000 UTC m=+0.476990591 container init 70cd8dadecb186ab8c2c1973b3a40e826a29c77ff29ec16430db46500c077c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-28T16:28:27.173 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:26 smithi023 podman[88167]: 2024-02-28 16:28:26.735902214 +0000 UTC m=+0.489295156 container start 70cd8dadecb186ab8c2c1973b3a40e826a29c77ff29ec16430db46500c077c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222) 2024-02-28T16:28:27.173 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:26 smithi023 podman[88167]: 2024-02-28 16:28:26.827350841 +0000 UTC m=+0.580743826 container attach 70cd8dadecb186ab8c2c1973b3a40e826a29c77ff29ec16430db46500c077c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222) 2024-02-28T16:28:27.511 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:27 smithi023 ceph-mon[78509]: Health check failed: Degraded data redundancy: 27/228 objects degraded (11.842%), 11 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:27.511 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:27 smithi023 podman[88167]: 2024-02-28 16:28:27.192972019 +0000 UTC m=+0.946365015 container died 70cd8dadecb186ab8c2c1973b3a40e826a29c77ff29ec16430db46500c077c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-28T16:28:27.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:27 smithi153 ceph-mon[66339]: Health check failed: Degraded data redundancy: 27/228 objects degraded (11.842%), 11 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:28.173 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:27 smithi023 podman[88193]: 2024-02-28 16:28:27.88071581 +0000 UTC m=+0.663261467 container remove 70cd8dadecb186ab8c2c1973b3a40e826a29c77ff29ec16430db46500c077c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-28T16:28:28.173 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:27 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-28T16:28:28.173 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:27 smithi023 systemd[1]: Stopped Ceph osd.1 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:28:28.173 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:27 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.1.service: Consumed 1min 53.833s CPU time. 2024-02-28T16:28:28.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:28 smithi023 ceph-mon[78509]: pgmap v88: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-02-28T16:28:28.673 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:28 smithi023 systemd[1]: Starting Ceph osd.1 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:28:28.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:28 smithi153 ceph-mon[66339]: pgmap v88: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-02-28T16:28:29.075 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:28 smithi023 podman[88292]: 2024-02-28 16:28:28.649339581 +0000 UTC m=+0.036670749 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:28:29.075 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:28 smithi023 podman[88292]: 2024-02-28 16:28:28.798777236 +0000 UTC m=+0.186108478 container create 3a9e07ae5c299714aff6744651d6a5c4dbfb37d6f06fa21cb97d3a0d5b7960be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:28:29.075 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 podman[88292]: 2024-02-28 16:28:29.085803928 +0000 UTC m=+0.473135146 container init 3a9e07ae5c299714aff6744651d6a5c4dbfb37d6f06fa21cb97d3a0d5b7960be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:28:29.423 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 podman[88292]: 2024-02-28 16:28:29.09862866 +0000 UTC m=+0.485959828 container start 3a9e07ae5c299714aff6744651d6a5c4dbfb37d6f06fa21cb97d3a0d5b7960be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-02-28T16:28:29.423 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 podman[88292]: 2024-02-28 16:28:29.184293168 +0000 UTC m=+0.571624367 container attach 3a9e07ae5c299714aff6744651d6a5c4dbfb37d6f06fa21cb97d3a0d5b7960be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:28:30.174 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate[88307]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate[88307]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 bash[88292]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 bash[88292]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 bash[88292]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 bash[88292]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 bash[88292]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 bash[88292]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 bash[88292]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate[88307]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:28:30.175 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate[88307]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:28:30.176 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate[88307]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T16:28:30.176 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate[88307]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:28:30.176 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:29 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate[88307]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T16:28:30.176 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:30 smithi023 podman[88292]: 2024-02-28 16:28:30.000691494 +0000 UTC m=+1.388022772 container died 3a9e07ae5c299714aff6744651d6a5c4dbfb37d6f06fa21cb97d3a0d5b7960be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T16:28:30.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:30 smithi023 ceph-mon[78509]: pgmap v89: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:30.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:30 smithi153 ceph-mon[66339]: pgmap v89: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:31.106 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:30 smithi023 podman[88437]: 2024-02-28 16:28:30.771336995 +0000 UTC m=+0.749286882 container remove 3a9e07ae5c299714aff6744651d6a5c4dbfb37d6f06fa21cb97d3a0d5b7960be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-28T16:28:31.423 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:31 smithi023 podman[88501]: 2024-02-28 16:28:31.024128724 +0000 UTC m=+0.034433171 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:28:31.423 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:31 smithi023 podman[88501]: 2024-02-28 16:28:31.147242726 +0000 UTC m=+0.157547228 container create e3ca8579a9f9f9853e2f39411fa1268f28585ff5cd89f23858e7dac0ff5be941 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10) 2024-02-28T16:28:31.424 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:31 smithi023 podman[88501]: 2024-02-28 16:28:31.434516556 +0000 UTC m=+0.444821025 container init e3ca8579a9f9f9853e2f39411fa1268f28585ff5cd89f23858e7dac0ff5be941 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:28:31.923 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:31 smithi023 podman[88501]: 2024-02-28 16:28:31.445850925 +0000 UTC m=+0.456155414 container start e3ca8579a9f9f9853e2f39411fa1268f28585ff5cd89f23858e7dac0ff5be941 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-28T16:28:31.923 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:31 smithi023 ceph-osd[88520]: -- 172.21.15.23:0/823065518 <== mon.0 v2:172.21.15.23:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56360e4cf680 con 0x56360e499000 2024-02-28T16:28:31.923 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:31 smithi023 bash[88501]: e3ca8579a9f9f9853e2f39411fa1268f28585ff5cd89f23858e7dac0ff5be941 2024-02-28T16:28:31.923 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:31 smithi023 systemd[1]: Started Ceph osd.1 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:28:32.384 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:32 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[88516]: 2024-02-28T16:28:32.034+0000 7f903dd857c0 -1 Falling back to public interface 2024-02-28T16:28:32.998 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:32 smithi023 ceph-mon[78509]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:32.999 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:32.999 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:32.999 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:32.999 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:32 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:33.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:32 smithi153 ceph-mon[66339]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:33.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:32 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:35.079 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:34 smithi023 ceph-mon[78509]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:35.108 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:34 smithi153 ceph-mon[66339]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:36.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:36 smithi023 ceph-mon[78509]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:36.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:36.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:36 smithi153 ceph-mon[66339]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:37.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:37.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:37.804 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:37 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[88516]: 2024-02-28T16:28:37.495+0000 7f903dd857c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-28T16:28:38.423 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:38 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[88516]: 2024-02-28T16:28:38.115+0000 7f903dd857c0 -1 osd.1 55 log_to_monitors true 2024-02-28T16:28:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:38 smithi153 ceph-mon[66339]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:38 smithi153 ceph-mon[66339]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:28:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:38 smithi023 ceph-mon[78509]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:38 smithi023 ceph-mon[78509]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:28:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:39.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:39.977 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:28:39 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[88516]: 2024-02-28T16:28:39.879+0000 7f9028200700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:28:39.978 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:39 smithi023 ceph-mon[78509]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:28:39.978 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:39 smithi023 ceph-mon[78509]: osdmap e58: 6 total, 5 up, 6 in 2024-02-28T16:28:39.978 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:39 smithi023 ceph-mon[78509]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:28:40.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:39 smithi153 ceph-mon[66339]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:28:40.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:39 smithi153 ceph-mon[66339]: osdmap e58: 6 total, 5 up, 6 in 2024-02-28T16:28:40.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:39 smithi153 ceph-mon[66339]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:28:41.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:40 smithi153 ceph-mon[66339]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:41.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:40 smithi153 ceph-mon[66339]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' 2024-02-28T16:28:41.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:41.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:41.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:40 smithi023 ceph-mon[78509]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:41.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:40 smithi023 ceph-mon[78509]: from='osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655]' entity='osd.1' 2024-02-28T16:28:41.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:41.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:42.113 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:41 smithi023 ceph-mon[78509]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:28:42.113 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:41 smithi023 ceph-mon[78509]: osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655] boot 2024-02-28T16:28:42.113 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:41 smithi023 ceph-mon[78509]: osdmap e59: 6 total, 6 up, 6 in 2024-02-28T16:28:42.113 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:41 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:28:42.113 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:41 smithi023 ceph-mon[78509]: osdmap e60: 6 total, 6 up, 6 in 2024-02-28T16:28:42.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:41 smithi153 ceph-mon[66339]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:28:42.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:41 smithi153 ceph-mon[66339]: osd.1 [v2:172.21.15.23:6810/1249689655,v1:172.21.15.23:6811/1249689655] boot 2024-02-28T16:28:42.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:41 smithi153 ceph-mon[66339]: osdmap e59: 6 total, 6 up, 6 in 2024-02-28T16:28:42.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:41 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:28:42.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:41 smithi153 ceph-mon[66339]: osdmap e60: 6 total, 6 up, 6 in 2024-02-28T16:28:43.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:42 smithi023 ceph-mon[78509]: pgmap v97: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:43.297 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:42 smithi153 ceph-mon[66339]: pgmap v97: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T16:28:44.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:43 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:44.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:43 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:44 smithi023 ceph-mon[78509]: pgmap v99: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/228 objects degraded (6.579%) 2024-02-28T16:28:45.369 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:44 smithi153 ceph-mon[66339]: pgmap v99: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/228 objects degraded (6.579%) 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: pgmap v100: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:46.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:28:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:28:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: Upgrade: osd.2 is safe to restart 2024-02-28T16:28:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded) 2024-02-28T16:28:46.647 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:46 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:28:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: pgmap v100: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:46.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: Upgrade: osd.2 is safe to restart 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded) 2024-02-28T16:28:46.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:46 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:28:48.237 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.247+0000 7fab5e400700 1 -- 172.21.15.23:0/749795233 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 msgr2=0x7fab58100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.247+0000 7fab5e400700 1 --2- 172.21.15.23:0/749795233 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58100650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab48009910 tx=0x7fab48009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:48.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.247+0000 7fab5e400700 1 -- 172.21.15.23:0/749795233 shutdown_connections 2024-02-28T16:28:48.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.248+0000 7fab5e400700 1 --2- 172.21.15.23:0/749795233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab58101440 0x7fab58101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.248+0000 7fab5e400700 1 --2- 172.21.15.23:0/749795233 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58100650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.248+0000 7fab5e400700 1 -- 172.21.15.23:0/749795233 >> 172.21.15.23:0/749795233 conn(0x7fab580fb7f0 msgr2=0x7fab580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:48.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.248+0000 7fab5e400700 1 -- 172.21.15.23:0/749795233 shutdown_connections 2024-02-28T16:28:48.238 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.248+0000 7fab5e400700 1 -- 172.21.15.23:0/749795233 wait complete. 2024-02-28T16:28:48.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.249+0000 7fab5e400700 1 Processor -- start 2024-02-28T16:28:48.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.249+0000 7fab5e400700 1 -- start start 2024-02-28T16:28:48.239 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.249+0000 7fab5e400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.249+0000 7fab5e400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab58101440 0x7fab58195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.249+0000 7fab5e400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58196610 con 0x7fab58100240 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.249+0000 7fab5e400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58196750 con 0x7fab58101440 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.250+0000 7fab57400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.250+0000 7fab57400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50180/0 (socket says 172.21.15.23:50180) 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.250+0000 7fab57400700 1 -- 172.21.15.23:0/2217900714 learned_addr learned my addr 172.21.15.23:0/2217900714 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.250+0000 7fab56a00700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab58101440 0x7fab58195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.250+0000 7fab57400700 1 -- 172.21.15.23:0/2217900714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab58101440 msgr2=0x7fab58195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.250+0000 7fab57400700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab58101440 0x7fab58195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.250+0000 7fab57400700 1 -- 172.21.15.23:0/2217900714 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480095f0 con 0x7fab58100240 2024-02-28T16:28:48.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.251+0000 7fab57400700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58195ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab4800bd70 tx=0x7fab4800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:48.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.251+0000 7fab4fe00700 1 -- 172.21.15.23:0/2217900714 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab4801d070 con 0x7fab58100240 2024-02-28T16:28:48.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.251+0000 7fab4fe00700 1 -- 172.21.15.23:0/2217900714 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab48005dc0 con 0x7fab58100240 2024-02-28T16:28:48.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.251+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5819b1a0 con 0x7fab58100240 2024-02-28T16:28:48.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.251+0000 7fab4fe00700 1 -- 172.21.15.23:0/2217900714 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab48021410 con 0x7fab58100240 2024-02-28T16:28:48.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.252+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5819b690 con 0x7fab58100240 2024-02-28T16:28:48.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.253+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab58108d90 con 0x7fab58100240 2024-02-28T16:28:48.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.254+0000 7fab4fe00700 1 -- 172.21.15.23:0/2217900714 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fab4800f7f0 con 0x7fab58100240 2024-02-28T16:28:48.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.255+0000 7fab4fe00700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab3c06d8a0 0x7fab3c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:48.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.255+0000 7fab4fe00700 1 -- 172.21.15.23:0/2217900714 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fab4808e7a0 con 0x7fab58100240 2024-02-28T16:28:48.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.256+0000 7fab56a00700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab3c06d8a0 0x7fab3c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:48.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.256+0000 7fab56a00700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab3c06d8a0 0x7fab3c06fd50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab44005950 tx=0x7fab4400b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:48.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.261+0000 7fab4fe00700 1 -- 172.21.15.23:0/2217900714 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fab4805bad0 con 0x7fab58100240 2024-02-28T16:28:48.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.515+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab5819bcd0 con 0x7fab3c06d8a0 2024-02-28T16:28:48.505 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:48 smithi023 ceph-mon[78509]: pgmap v101: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:48.505 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:48 smithi023 ceph-mon[78509]: Upgrade: Updating osd.2 2024-02-28T16:28:48.505 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:48 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:48.505 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:48 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:28:48.505 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:48 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:48.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.517+0000 7fab4fe00700 1 -- 172.21.15.23:0/2217900714 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fab5819bcd0 con 0x7fab3c06d8a0 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.521+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab3c06d8a0 msgr2=0x7fab3c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.521+0000 7fab5e400700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab3c06d8a0 0x7fab3c06fd50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab44005950 tx=0x7fab4400b410 comp rx=0 tx=0).stop 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.521+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 msgr2=0x7fab58195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.521+0000 7fab5e400700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58195ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab4800bd70 tx=0x7fab4800bda0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.522+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 shutdown_connections 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.522+0000 7fab5e400700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab3c06d8a0 0x7fab3c06fd50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.522+0000 7fab5e400700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab58100240 0x7fab58195ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.522+0000 7fab5e400700 1 --2- 172.21.15.23:0/2217900714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab58101440 0x7fab58195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.522+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 >> 172.21.15.23:0/2217900714 conn(0x7fab580fb7f0 msgr2=0x7fab58104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:48.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.522+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 shutdown_connections 2024-02-28T16:28:48.512 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.523+0000 7fab5e400700 1 -- 172.21.15.23:0/2217900714 wait complete. 2024-02-28T16:28:48.538 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:28:48.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:48 smithi153 ceph-mon[66339]: pgmap v101: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:48.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:48 smithi153 ceph-mon[66339]: Upgrade: Updating osd.2 2024-02-28T16:28:48.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:48 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:48.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:48 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:28:48.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:48 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:48.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 -- 172.21.15.23:0/525612144 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 msgr2=0x7f19f0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 --2- 172.21.15.23:0/525612144 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0101890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009910 tx=0x7f19dc009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:48.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 -- 172.21.15.23:0/525612144 shutdown_connections 2024-02-28T16:28:48.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 --2- 172.21.15.23:0/525612144 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0101890 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 --2- 172.21.15.23:0/525612144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f0100240 0x7f19f0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 -- 172.21.15.23:0/525612144 >> 172.21.15.23:0/525612144 conn(0x7f19f00fb7f0 msgr2=0x7f19f00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:48.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 -- 172.21.15.23:0/525612144 shutdown_connections 2024-02-28T16:28:48.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.701+0000 7f19f5200700 1 -- 172.21.15.23:0/525612144 wait complete. 2024-02-28T16:28:48.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.702+0000 7f19f5200700 1 Processor -- start 2024-02-28T16:28:48.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.703+0000 7f19f5200700 1 -- start start 2024-02-28T16:28:48.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.703+0000 7f19f5200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f0100240 0x7f19f0195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:48.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.703+0000 7f19f5200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:48.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.703+0000 7f19f5200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f01966b0 con 0x7f19f0101440 2024-02-28T16:28:48.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.703+0000 7f19f5200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f01967f0 con 0x7f19f0100240 2024-02-28T16:28:48.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.704+0000 7f19ed400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:48.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.704+0000 7f19ed400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50202/0 (socket says 172.21.15.23:50202) 2024-02-28T16:28:48.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.704+0000 7f19ed400700 1 -- 172.21.15.23:0/1848315510 learned_addr learned my addr 172.21.15.23:0/1848315510 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:48.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.704+0000 7f19ede00700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f0100240 0x7f19f0195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.704+0000 7f19ed400700 1 -- 172.21.15.23:0/1848315510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f0100240 msgr2=0x7f19f0195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.704+0000 7f19ed400700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f0100240 0x7f19f0195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.704+0000 7f19ed400700 1 -- 172.21.15.23:0/1848315510 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0095f0 con 0x7f19f0101440 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.705+0000 7f19ed400700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0196090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005b40 tx=0x7f19dc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.705+0000 7f19e6a00700 1 -- 172.21.15.23:0/1848315510 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc01d070 con 0x7f19f0101440 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.705+0000 7f19e6a00700 1 -- 172.21.15.23:0/1848315510 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19dc022470 con 0x7f19f0101440 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.705+0000 7f19e6a00700 1 -- 172.21.15.23:0/1848315510 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc00f690 con 0x7f19f0101440 2024-02-28T16:28:48.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.705+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f019b240 con 0x7f19f0101440 2024-02-28T16:28:48.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.705+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f019b730 con 0x7f19f0101440 2024-02-28T16:28:48.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.706+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f0108e30 con 0x7f19f0101440 2024-02-28T16:28:48.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.707+0000 7f19e6a00700 1 -- 172.21.15.23:0/1848315510 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f19dc022a10 con 0x7f19f0101440 2024-02-28T16:28:48.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.708+0000 7f19e6a00700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19d406d8a0 0x7f19d406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:48.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.708+0000 7f19e6a00700 1 -- 172.21.15.23:0/1848315510 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f19dc08edb0 con 0x7f19f0101440 2024-02-28T16:28:48.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.709+0000 7f19ede00700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19d406d8a0 0x7f19d406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:48.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.709+0000 7f19ede00700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19d406d8a0 0x7f19d406fd50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19f01012a0 tx=0x7f19e0009190 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:48.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.713+0000 7f19e6a00700 1 -- 172.21.15.23:0/1848315510 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f19dc05c330 con 0x7f19f0101440 2024-02-28T16:28:48.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.966+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f019bdc0 con 0x7f19d406d8a0 2024-02-28T16:28:48.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.968+0000 7f19e6a00700 1 -- 172.21.15.23:0/1848315510 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f19f019bdc0 con 0x7f19d406d8a0 2024-02-28T16:28:48.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.971+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19d406d8a0 msgr2=0x7f19d406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.971+0000 7f19f5200700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19d406d8a0 0x7f19d406fd50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19f01012a0 tx=0x7f19e0009190 comp rx=0 tx=0).stop 2024-02-28T16:28:48.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.971+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 msgr2=0x7f19f0196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:48.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.971+0000 7f19f5200700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0196090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005b40 tx=0x7f19dc00bd70 comp rx=0 tx=0).stop 2024-02-28T16:28:48.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.972+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 shutdown_connections 2024-02-28T16:28:48.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.972+0000 7f19f5200700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f0100240 0x7f19f0195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.972+0000 7f19f5200700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19d406d8a0 0x7f19d406fd50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.962 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.972+0000 7f19f5200700 1 --2- 172.21.15.23:0/1848315510 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f19f0101440 0x7f19f0196090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:48.962 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.972+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 >> 172.21.15.23:0/1848315510 conn(0x7f19f00fb7f0 msgr2=0x7f19f0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:48.962 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.972+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 shutdown_connections 2024-02-28T16:28:48.962 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:48.972+0000 7f19f5200700 1 -- 172.21.15.23:0/1848315510 wait complete. 2024-02-28T16:28:49.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 -- 172.21.15.23:0/1895317728 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d40737b0 msgr2=0x7f03d4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 --2- 172.21.15.23:0/1895317728 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d40737b0 0x7f03d4073c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009940 tx=0x7f03c0009c50 comp rx=0 tx=0).stop 2024-02-28T16:28:49.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 -- 172.21.15.23:0/1895317728 shutdown_connections 2024-02-28T16:28:49.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 --2- 172.21.15.23:0/1895317728 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d40737b0 0x7f03d4073c20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 --2- 172.21.15.23:0/1895317728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d4074d80 0x7f03d40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 -- 172.21.15.23:0/1895317728 >> 172.21.15.23:0/1895317728 conn(0x7f03d40fb7f0 msgr2=0x7f03d40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:49.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 -- 172.21.15.23:0/1895317728 shutdown_connections 2024-02-28T16:28:49.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.129+0000 7f03dbe00700 1 -- 172.21.15.23:0/1895317728 wait complete. 2024-02-28T16:28:49.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.130+0000 7f03dbe00700 1 Processor -- start 2024-02-28T16:28:49.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.130+0000 7f03dbe00700 1 -- start start 2024-02-28T16:28:49.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03dbe00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40737b0 0x7f03d4197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:49.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03dbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d4074d80 0x7f03d41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03dbe00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d41987e0 con 0x7f03d4074d80 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03dbe00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4198950 con 0x7f03d40737b0 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03d8a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d4074d80 0x7f03d41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03d8a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d4074d80 0x7f03d41981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:50220/0 (socket says 172.21.15.23:50220) 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03d8a00700 1 -- 172.21.15.23:0/2085947791 learned_addr learned my addr 172.21.15.23:0/2085947791 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03d9400700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40737b0 0x7f03d4197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03d8a00700 1 -- 172.21.15.23:0/2085947791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40737b0 msgr2=0x7f03d4197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03d8a00700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40737b0 0x7f03d4197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.131+0000 7f03d8a00700 1 -- 172.21.15.23:0/2085947791 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00095f0 con 0x7f03d4074d80 2024-02-28T16:28:49.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.132+0000 7f03d8a00700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d4074d80 0x7f03d41981e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03c00055f0 tx=0x7f03c00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:49.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.132+0000 7f03d2000700 1 -- 172.21.15.23:0/2085947791 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c001d070 con 0x7f03d4074d80 2024-02-28T16:28:49.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.132+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d419d380 con 0x7f03d4074d80 2024-02-28T16:28:49.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.132+0000 7f03d2000700 1 -- 172.21.15.23:0/2085947791 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03c000f460 con 0x7f03d4074d80 2024-02-28T16:28:49.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.132+0000 7f03d2000700 1 -- 172.21.15.23:0/2085947791 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c0021620 con 0x7f03d4074d80 2024-02-28T16:28:49.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.132+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d419d870 con 0x7f03d4074d80 2024-02-28T16:28:49.123 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.133+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d410af80 con 0x7f03d4074d80 2024-02-28T16:28:49.123 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.134+0000 7f03d2000700 1 -- 172.21.15.23:0/2085947791 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f03c000fa50 con 0x7f03d4074d80 2024-02-28T16:28:49.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.135+0000 7f03d2000700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03bc06d8a0 0x7f03bc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:49.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.135+0000 7f03d2000700 1 -- 172.21.15.23:0/2085947791 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f03c008e810 con 0x7f03d4074d80 2024-02-28T16:28:49.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.135+0000 7f03d9400700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03bc06d8a0 0x7f03bc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:49.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.136+0000 7f03d9400700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03bc06d8a0 0x7f03bc06fd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03c8005950 tx=0x7f03c80058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:49.129 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.140+0000 7f03d2000700 1 -- 172.21.15.23:0/2085947791 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f03c0057f70 con 0x7f03d4074d80 2024-02-28T16:28:49.368 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.379+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03d4107740 con 0x7f03bc06d8a0 2024-02-28T16:28:49.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.410+0000 7f03d2000700 1 -- 172.21.15.23:0/2085947791 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f03d4107740 con 0x7f03bc06d8a0 2024-02-28T16:28:49.400 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:28:49.400 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (13m) 10s ago 15m 14.1M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:28:49.400 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (16m) 10s ago 16m 8438k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:28:49.400 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (14m) 73s ago 14m 7742k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:28:49.400 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (86s) 10s ago 15m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (78s) 73s ago 14m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (13m) 10s ago 15m 72.4M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (8m) 10s ago 8m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (8m) 10s ago 8m 16.3M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (8m) 73s ago 8m 15.7M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (8m) 73s ago 8m 16.0M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (5m) 10s ago 17m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (3m) 73s ago 14m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (3m) 10s ago 17m 45.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (2m) 73s ago 14m 37.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (15m) 10s ago 15m 8426k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (14m) 73s ago 14m 8208k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:28:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (48s) 10s ago 13m 87.4M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:28:49.402 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (18s) 10s ago 12m 11.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:28:49.402 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (12m) 10s ago 12m 200M 1217M 18.2.0 dc2bc1663786 a6f10f32dd17 2024-02-28T16:28:49.402 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (11m) 73s ago 11m 277M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:28:49.402 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (10m) 73s ago 10m 255M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:28:49.402 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (10m) 73s ago 10m 228M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:28:49.402 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (3m) 10s ago 15m 58.1M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:28:49.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03bc06d8a0 msgr2=0x7f03bc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03bc06d8a0 0x7f03bc06fd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03c8005950 tx=0x7f03c80058e0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d4074d80 msgr2=0x7f03d41981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d4074d80 0x7f03d41981e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03c00055f0 tx=0x7f03c00056d0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 shutdown_connections 2024-02-28T16:28:49.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03d40737b0 0x7f03d4197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f03bc06d8a0 0x7f03bc06fd50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 --2- 172.21.15.23:0/2085947791 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f03d4074d80 0x7f03d41981e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 >> 172.21.15.23:0/2085947791 conn(0x7f03d40fb7f0 msgr2=0x7f03d4106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:49.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 shutdown_connections 2024-02-28T16:28:49.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.414+0000 7f03dbe00700 1 -- 172.21.15.23:0/2085947791 wait complete. 2024-02-28T16:28:49.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.561+0000 7f04b4e00700 1 -- 172.21.15.23:0/2012082858 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b0074d80 msgr2=0x7f04b00731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.561+0000 7f04b4e00700 1 --2- 172.21.15.23:0/2012082858 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b0074d80 0x7f04b00731e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009910 tx=0x7f04a0009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:49.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.561+0000 7f04b4e00700 1 -- 172.21.15.23:0/2012082858 shutdown_connections 2024-02-28T16:28:49.551 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:49 smithi023 ceph-mon[78509]: Deploying daemon osd.2 on smithi023 2024-02-28T16:28:49.551 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:49 smithi023 ceph-mon[78509]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:49.551 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:49 smithi023 ceph-mon[78509]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:49.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.561+0000 7f04b4e00700 1 --2- 172.21.15.23:0/2012082858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b00737b0 0x7f04b0073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.561+0000 7f04b4e00700 1 --2- 172.21.15.23:0/2012082858 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b0074d80 0x7f04b00731e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.561+0000 7f04b4e00700 1 -- 172.21.15.23:0/2012082858 >> 172.21.15.23:0/2012082858 conn(0x7f04b00fb7f0 msgr2=0x7f04b00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:49.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.562+0000 7f04b4e00700 1 -- 172.21.15.23:0/2012082858 shutdown_connections 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.562+0000 7f04b4e00700 1 -- 172.21.15.23:0/2012082858 wait complete. 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.563+0000 7f04b4e00700 1 Processor -- start 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.563+0000 7f04b4e00700 1 -- start start 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.563+0000 7f04b4e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b00737b0 0x7f04b019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.563+0000 7f04b4e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0074d80 0x7f04b019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.563+0000 7f04b4e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019cc50 con 0x7f04b00737b0 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.563+0000 7f04b4e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019cd90 con 0x7f04b0074d80 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ade00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b00737b0 0x7f04b019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ade00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b00737b0 0x7f04b019c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39300/0 (socket says 172.21.15.23:39300) 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ade00700 1 -- 172.21.15.23:0/1864259457 learned_addr learned my addr 172.21.15.23:0/1864259457 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ade00700 1 -- 172.21.15.23:0/1864259457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0074d80 msgr2=0x7f04b019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ad400700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0074d80 0x7f04b019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ade00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0074d80 0x7f04b019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ade00700 1 -- 172.21.15.23:0/1864259457 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00095f0 con 0x7f04b00737b0 2024-02-28T16:28:49.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ad400700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0074d80 0x7f04b019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:28:49.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.564+0000 7f04ade00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b00737b0 0x7f04b019c0f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04a0005b40 tx=0x7f04a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:49.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.565+0000 7f04a6a00700 1 -- 172.21.15.23:0/1864259457 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a001d070 con 0x7f04b00737b0 2024-02-28T16:28:49.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.565+0000 7f04a6a00700 1 -- 172.21.15.23:0/1864259457 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f04a0022470 con 0x7f04b00737b0 2024-02-28T16:28:49.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.565+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b01a17e0 con 0x7f04b00737b0 2024-02-28T16:28:49.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.565+0000 7f04a6a00700 1 -- 172.21.15.23:0/1864259457 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a000f690 con 0x7f04b00737b0 2024-02-28T16:28:49.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.565+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b01a1cd0 con 0x7f04b00737b0 2024-02-28T16:28:49.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.566+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b010f3f0 con 0x7f04b00737b0 2024-02-28T16:28:49.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.567+0000 7f04a6a00700 1 -- 172.21.15.23:0/1864259457 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f04a00225e0 con 0x7f04b00737b0 2024-02-28T16:28:49.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.568+0000 7f04a6a00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f049406d8a0 0x7f049406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:49.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.568+0000 7f04a6a00700 1 -- 172.21.15.23:0/1864259457 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f04a008ed60 con 0x7f04b00737b0 2024-02-28T16:28:49.557 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.568+0000 7f04ad400700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f049406d8a0 0x7f049406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:49.558 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.569+0000 7f04ad400700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f049406d8a0 0x7f049406fd50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f049c007900 tx=0x7f049c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:49.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.573+0000 7f04a6a00700 1 -- 172.21.15.23:0/1864259457 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f04a005c110 con 0x7f04b00737b0 2024-02-28T16:28:49.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:49 smithi153 ceph-mon[66339]: Deploying daemon osd.2 on smithi023 2024-02-28T16:28:49.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:49 smithi153 ceph-mon[66339]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:49.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:49 smithi153 ceph-mon[66339]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:49.871 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.881+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f04b01a23d0 con 0x7f04b00737b0 2024-02-28T16:28:49.871 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.883+0000 7f04a6a00700 1 -- 172.21.15.23:0/1864259457 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f04a0027330 con 0x7f04b00737b0 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:49.872 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:28:49.873 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:28:49.873 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:28:49.873 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:28:49.873 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-02-28T16:28:49.873 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:28:49.873 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:28:49.873 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:28:49.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f049406d8a0 msgr2=0x7f049406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f049406d8a0 0x7f049406fd50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f049c007900 tx=0x7f049c008040 comp rx=0 tx=0).stop 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b00737b0 msgr2=0x7f04b019c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b00737b0 0x7f04b019c0f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04a0005b40 tx=0x7f04a000be20 comp rx=0 tx=0).stop 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 shutdown_connections 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f049406d8a0 0x7f049406fd50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04b00737b0 0x7f04b019c0f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 --2- 172.21.15.23:0/1864259457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0074d80 0x7f04b019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.885+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 >> 172.21.15.23:0/1864259457 conn(0x7f04b00fb7f0 msgr2=0x7f04b0101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.886+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 shutdown_connections 2024-02-28T16:28:49.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:49.886+0000 7f04b4e00700 1 -- 172.21.15.23:0/1864259457 wait complete. 2024-02-28T16:28:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.047+0000 7f88a1c00700 1 -- 172.21.15.23:0/1443417013 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c1036d0 msgr2=0x7f889c103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.047+0000 7f88a1c00700 1 --2- 172.21.15.23:0/1443417013 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c1036d0 0x7f889c103b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f888400b0a0 tx=0x7f888400b3b0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.047+0000 7f88a1c00700 1 -- 172.21.15.23:0/1443417013 shutdown_connections 2024-02-28T16:28:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.047+0000 7f88a1c00700 1 --2- 172.21.15.23:0/1443417013 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c1036d0 0x7f889c103b40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.047+0000 7f88a1c00700 1 --2- 172.21.15.23:0/1443417013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c102430 0x7f889c102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.048+0000 7f88a1c00700 1 -- 172.21.15.23:0/1443417013 >> 172.21.15.23:0/1443417013 conn(0x7f889c0fda80 msgr2=0x7f889c0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.048+0000 7f88a1c00700 1 -- 172.21.15.23:0/1443417013 shutdown_connections 2024-02-28T16:28:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.048+0000 7f88a1c00700 1 -- 172.21.15.23:0/1443417013 wait complete. 2024-02-28T16:28:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.049+0000 7f88a1c00700 1 Processor -- start 2024-02-28T16:28:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.049+0000 7f88a1c00700 1 -- start start 2024-02-28T16:28:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.049+0000 7f88a1c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c102430 0x7f889c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.049+0000 7f88a1c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c1036d0 0x7f889c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.049+0000 7f88a1c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c198740 con 0x7f889c102430 2024-02-28T16:28:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.049+0000 7f88a1c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1988b0 con 0x7f889c1036d0 2024-02-28T16:28:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f889aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c102430 0x7f889c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f889aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c102430 0x7f889c197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39316/0 (socket says 172.21.15.23:39316) 2024-02-28T16:28:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f889aa00700 1 -- 172.21.15.23:0/4086321009 learned_addr learned my addr 172.21.15.23:0/4086321009 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f8892000700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c1036d0 0x7f889c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f889aa00700 1 -- 172.21.15.23:0/4086321009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c1036d0 msgr2=0x7f889c1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f889aa00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c1036d0 0x7f889c1981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f889aa00700 1 -- 172.21.15.23:0/4086321009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8884009d00 con 0x7f889c102430 2024-02-28T16:28:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.050+0000 7f8892000700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c1036d0 0x7f889c1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:28:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.051+0000 7f889aa00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c102430 0x7f889c197c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c930 tx=0x7f888c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.051+0000 7f8893e00700 1 -- 172.21.15.23:0/4086321009 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f888c007ad0 con 0x7f889c102430 2024-02-28T16:28:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.051+0000 7f8893e00700 1 -- 172.21.15.23:0/4086321009 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f888c007c30 con 0x7f889c102430 2024-02-28T16:28:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.051+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c19d350 con 0x7f889c102430 2024-02-28T16:28:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.051+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c19d8a0 con 0x7f889c102430 2024-02-28T16:28:50.042 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.051+0000 7f8893e00700 1 -- 172.21.15.23:0/4086321009 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f888c018630 con 0x7f889c102430 2024-02-28T16:28:50.042 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.052+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8878005320 con 0x7f889c102430 2024-02-28T16:28:50.042 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.053+0000 7f8893e00700 1 -- 172.21.15.23:0/4086321009 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f888c0188e0 con 0x7f889c102430 2024-02-28T16:28:50.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.054+0000 7f8893e00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f888006d8a0 0x7f888006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.054+0000 7f8893e00700 1 -- 172.21.15.23:0/4086321009 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f888c08d6e0 con 0x7f889c102430 2024-02-28T16:28:50.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.054+0000 7f8892000700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f888006d8a0 0x7f888006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.055+0000 7f8892000700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f888006d8a0 0x7f888006fd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f80 tx=0x7f8884006000 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:50.048 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.059+0000 7f8893e00700 1 -- 172.21.15.23:0/4086321009 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f888c056e40 con 0x7f889c102430 2024-02-28T16:28:50.319 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.330+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8878006200 con 0x7f889c102430 2024-02-28T16:28:50.319 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.330+0000 7f8893e00700 1 -- 172.21.15.23:0/4086321009 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f888c05a500 con 0x7f889c102430 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:28:50.320 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:28:50.321 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:50.322 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:28:50.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f888006d8a0 msgr2=0x7f888006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f888006d8a0 0x7f888006fd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f80 tx=0x7f8884006000 comp rx=0 tx=0).stop 2024-02-28T16:28:50.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c102430 msgr2=0x7f889c197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c102430 0x7f889c197c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c930 tx=0x7f888c00ccf0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 shutdown_connections 2024-02-28T16:28:50.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f888006d8a0 0x7f888006fd50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f889c102430 0x7f889c197c90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 --2- 172.21.15.23:0/4086321009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c1036d0 0x7f889c1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 >> 172.21.15.23:0/4086321009 conn(0x7f889c0fda80 msgr2=0x7f889c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:50.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 shutdown_connections 2024-02-28T16:28:50.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.335+0000 7f88a1c00700 1 -- 172.21.15.23:0/4086321009 wait complete. 2024-02-28T16:28:50.326 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:28:50.478 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 -- 172.21.15.23:0/3490063950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4106860 msgr2=0x7f68d4106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.478 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 --2- 172.21.15.23:0/3490063950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4106860 0x7f68d4106c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009910 tx=0x7f68c4009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:50.478 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 -- 172.21.15.23:0/3490063950 shutdown_connections 2024-02-28T16:28:50.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 --2- 172.21.15.23:0/3490063950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4107a60 0x7f68d4107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 --2- 172.21.15.23:0/3490063950 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4106860 0x7f68d4106c70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 -- 172.21.15.23:0/3490063950 >> 172.21.15.23:0/3490063950 conn(0x7f68d40758b0 msgr2=0x7f68d4077d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:50.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 -- 172.21.15.23:0/3490063950 shutdown_connections 2024-02-28T16:28:50.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.489+0000 7f68dae00700 1 -- 172.21.15.23:0/3490063950 wait complete. 2024-02-28T16:28:50.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.490+0000 7f68dae00700 1 Processor -- start 2024-02-28T16:28:50.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.490+0000 7f68dae00700 1 -- start start 2024-02-28T16:28:50.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.490+0000 7f68dae00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4106860 0x7f68d419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.490+0000 7f68dae00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4107a60 0x7f68d419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68dae00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d419cc50 con 0x7f68d4107a60 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68dae00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d419cd90 con 0x7f68d4106860 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4107a60 0x7f68d419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4107a60 0x7f68d419c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39330/0 (socket says 172.21.15.23:39330) 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3400700 1 -- 172.21.15.23:0/1905652088 learned_addr learned my addr 172.21.15.23:0/1905652088 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3e00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4106860 0x7f68d419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3400700 1 -- 172.21.15.23:0/1905652088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4106860 msgr2=0x7f68d419c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3400700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4106860 0x7f68d419c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3400700 1 -- 172.21.15.23:0/1905652088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40095f0 con 0x7f68d4107a60 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.491+0000 7f68d3e00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4106860 0x7f68d419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:28:50.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.492+0000 7f68d3400700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4107a60 0x7f68d419c630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00d8d0 tx=0x7f68bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:50.483 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.492+0000 7f68d0c00700 1 -- 172.21.15.23:0/1905652088 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68bc009940 con 0x7f68d4107a60 2024-02-28T16:28:50.483 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.492+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d41a1840 con 0x7f68d4107a60 2024-02-28T16:28:50.483 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.492+0000 7f68d0c00700 1 -- 172.21.15.23:0/1905652088 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f68bc010460 con 0x7f68d4107a60 2024-02-28T16:28:50.483 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.492+0000 7f68d0c00700 1 -- 172.21.15.23:0/1905652088 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68bc00f5f0 con 0x7f68d4107a60 2024-02-28T16:28:50.483 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.492+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d41a1d90 con 0x7f68d4107a60 2024-02-28T16:28:50.483 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.493+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d410f3b0 con 0x7f68d4107a60 2024-02-28T16:28:50.483 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.494+0000 7f68d0c00700 1 -- 172.21.15.23:0/1905652088 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f68bc0105d0 con 0x7f68d4107a60 2024-02-28T16:28:50.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.495+0000 7f68d0c00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f68b806d8a0 0x7f68b806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.495+0000 7f68d0c00700 1 -- 172.21.15.23:0/1905652088 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f68bc08d4c0 con 0x7f68d4107a60 2024-02-28T16:28:50.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.495+0000 7f68d3e00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f68b806d8a0 0x7f68b806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.496+0000 7f68d3e00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f68b806d8a0 0x7f68b806fd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68c400b5c0 tx=0x7f68c4005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:50.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.500+0000 7f68d0c00700 1 -- 172.21.15.23:0/1905652088 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f68bc05a7f0 con 0x7f68d4107a60 2024-02-28T16:28:50.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:50 smithi153 ceph-mon[66339]: pgmap v102: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:50.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:50 smithi153 ceph-mon[66339]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:50.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:50 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1864259457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:50.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:50 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/4086321009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:28:50.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:50 smithi023 ceph-mon[78509]: pgmap v102: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:50.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:50 smithi023 ceph-mon[78509]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:50.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:50 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1864259457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:50.665 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:50 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/4086321009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:28:50.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.756+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d41a2490 con 0x7f68b806d8a0 2024-02-28T16:28:50.746 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.757+0000 7f68d0c00700 1 -- 172.21.15.23:0/1905652088 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f68d41a2490 con 0x7f68b806d8a0 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:28:50.747 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "8/23 daemons upgraded", 2024-02-28T16:28:50.748 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:28:50.748 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:28:50.748 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:28:50.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.760+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f68b806d8a0 msgr2=0x7f68b806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.760+0000 7f68dae00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f68b806d8a0 0x7f68b806fd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68c400b5c0 tx=0x7f68c4005e20 comp rx=0 tx=0).stop 2024-02-28T16:28:50.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.760+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4107a60 msgr2=0x7f68d419c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.760+0000 7f68dae00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4107a60 0x7f68d419c630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00d8d0 tx=0x7f68bc00dc90 comp rx=0 tx=0).stop 2024-02-28T16:28:50.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.761+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 shutdown_connections 2024-02-28T16:28:50.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.761+0000 7f68dae00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4106860 0x7f68d419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.761+0000 7f68dae00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f68b806d8a0 0x7f68b806fd50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.761+0000 7f68dae00700 1 --2- 172.21.15.23:0/1905652088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f68d4107a60 0x7f68d419c630 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.761+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 >> 172.21.15.23:0/1905652088 conn(0x7f68d40758b0 msgr2=0x7f68d410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:50.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.761+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 shutdown_connections 2024-02-28T16:28:50.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.761+0000 7f68dae00700 1 -- 172.21.15.23:0/1905652088 wait complete. 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 -- 172.21.15.23:0/1810086647 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 msgr2=0x7fcdd8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 --2- 172.21.15.23:0/1810086647 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd8101890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009910 tx=0x7fcdc4009c20 comp rx=0 tx=0).stop 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 -- 172.21.15.23:0/1810086647 shutdown_connections 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 --2- 172.21.15.23:0/1810086647 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd8101890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 --2- 172.21.15.23:0/1810086647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdd8100240 0x7fcdd8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 -- 172.21.15.23:0/1810086647 >> 172.21.15.23:0/1810086647 conn(0x7fcdd80fb7f0 msgr2=0x7fcdd80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 -- 172.21.15.23:0/1810086647 shutdown_connections 2024-02-28T16:28:50.918 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.928+0000 7fcddca00700 1 -- 172.21.15.23:0/1810086647 wait complete. 2024-02-28T16:28:50.919 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.930+0000 7fcddca00700 1 Processor -- start 2024-02-28T16:28:50.919 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.930+0000 7fcddca00700 1 -- start start 2024-02-28T16:28:50.919 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.930+0000 7fcddca00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdd8100240 0x7fcdd8197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.920 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.930+0000 7fcddca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.920 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.930+0000 7fcddca00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd81987f0 con 0x7fcdd8101440 2024-02-28T16:28:50.920 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.930+0000 7fcddca00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd8198960 con 0x7fcdd8100240 2024-02-28T16:28:50.920 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.930+0000 7fcdd5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.920 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.931+0000 7fcdd5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd81981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:39348/0 (socket says 172.21.15.23:39348) 2024-02-28T16:28:50.920 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.931+0000 7fcdd5400700 1 -- 172.21.15.23:0/3904393964 learned_addr learned my addr 172.21.15.23:0/3904393964 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:28:50.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.931+0000 7fcdd5e00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdd8100240 0x7fcdd8197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.931+0000 7fcdd5400700 1 -- 172.21.15.23:0/3904393964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdd8100240 msgr2=0x7fcdd8197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:50.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.931+0000 7fcdd5400700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdd8100240 0x7fcdd8197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:50.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.931+0000 7fcdd5400700 1 -- 172.21.15.23:0/3904393964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc40095f0 con 0x7fcdd8101440 2024-02-28T16:28:50.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.931+0000 7fcdd5400700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd81981f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400bd70 tx=0x7fcdc400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:50.921 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.932+0000 7fcdcea00700 1 -- 172.21.15.23:0/3904393964 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc401d070 con 0x7fcdd8101440 2024-02-28T16:28:50.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.932+0000 7fcdcea00700 1 -- 172.21.15.23:0/3904393964 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcdc4022470 con 0x7fcdd8101440 2024-02-28T16:28:50.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.932+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd819d390 con 0x7fcdd8101440 2024-02-28T16:28:50.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.932+0000 7fcdcea00700 1 -- 172.21.15.23:0/3904393964 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc400f670 con 0x7fcdd8101440 2024-02-28T16:28:50.922 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.932+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd819d880 con 0x7fcdd8101440 2024-02-28T16:28:50.923 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.934+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb8005320 con 0x7fcdd8101440 2024-02-28T16:28:50.923 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.934+0000 7fcdcea00700 1 -- 172.21.15.23:0/3904393964 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fcdc4004af0 con 0x7fcdd8101440 2024-02-28T16:28:50.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.936+0000 7fcdcea00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcdbc06d8a0 0x7fcdbc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:50.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.936+0000 7fcdcea00700 1 -- 172.21.15.23:0/3904393964 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcdc408e910 con 0x7fcdd8101440 2024-02-28T16:28:50.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.936+0000 7fcdd5e00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcdbc06d8a0 0x7fcdbc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:50.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.937+0000 7fcdd5e00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcdbc06d8a0 0x7fcdbc06fd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8005950 tx=0x7fcdc80058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:50.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:50.941+0000 7fcdcea00700 1 -- 172.21.15.23:0/3904393964 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcdc4058360 con 0x7fcdd8101440 2024-02-28T16:28:51.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.273+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcdb8005190 con 0x7fcdd8101440 2024-02-28T16:28:51.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.274+0000 7fcdcea00700 1 -- 172.21.15.23:0/3904393964 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcdc4027020 con 0x7fcdd8101440 2024-02-28T16:28:51.263 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:28:51.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcdbc06d8a0 msgr2=0x7fcdbc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:51.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcdbc06d8a0 0x7fcdbc06fd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8005950 tx=0x7fcdc80058e0 comp rx=0 tx=0).stop 2024-02-28T16:28:51.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 msgr2=0x7fcdd81981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:51.266 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd81981f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400bd70 tx=0x7fcdc400be50 comp rx=0 tx=0).stop 2024-02-28T16:28:51.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 shutdown_connections 2024-02-28T16:28:51.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdd8100240 0x7fcdd8197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:51.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcdbc06d8a0 0x7fcdbc06fd50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:51.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 --2- 172.21.15.23:0/3904393964 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcdd8101440 0x7fcdd81981f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:51.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 >> 172.21.15.23:0/3904393964 conn(0x7fcdd80fb7f0 msgr2=0x7fcdd8102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:51.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 shutdown_connections 2024-02-28T16:28:51.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:28:51.277+0000 7fcddca00700 1 -- 172.21.15.23:0/3904393964 wait complete. 2024-02-28T16:28:51.481 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:51 smithi023 ceph-mon[78509]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:51.481 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:51 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3904393964' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:28:51.481 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:51.481 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:51.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:51 smithi153 ceph-mon[66339]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:51.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:51 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3904393964' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:28:51.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:51.646 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:52.571 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:52 smithi023 ceph-mon[78509]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:52.571 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:52 smithi153 ceph-mon[66339]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:28:52.922 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:52 smithi023 systemd[1]: Stopping Ceph osd.2 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:28:53.393 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:53 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[54966]: 2024-02-28T16:28:53.024+0000 7ff3eb600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:28:53.393 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:53 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[54966]: 2024-02-28T16:28:53.024+0000 7ff3eb600700 -1 osd.2 60 *** Got signal Terminated *** 2024-02-28T16:28:53.393 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:53 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[54966]: 2024-02-28T16:28:53.024+0000 7ff3eb600700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:28:53.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:53 smithi153 ceph-mon[66339]: osd.2 marked itself down and dead 2024-02-28T16:28:53.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:53 smithi023 ceph-mon[78509]: osd.2 marked itself down and dead 2024-02-28T16:28:54.173 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:53 smithi023 podman[91340]: 2024-02-28 16:28:53.919094829 +0000 UTC m=+1.027611352 container died a6f10f32dd17e516054a420f0fa63cf8585bc24936fcbd890011c4559175bb11 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, io.buildah.version=1.29.1, ceph=True, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-28T16:28:54.572 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:54 smithi023 ceph-mon[78509]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:54.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:54 smithi023 ceph-mon[78509]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:28:54.573 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:54 smithi023 ceph-mon[78509]: osdmap e61: 6 total, 5 up, 6 in 2024-02-28T16:28:54.573 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:54 smithi023 podman[91340]: 2024-02-28 16:28:54.37511634 +0000 UTC m=+1.483632856 container cleanup a6f10f32dd17e516054a420f0fa63cf8585bc24936fcbd890011c4559175bb11 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T16:28:54.573 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:54 smithi023 bash[91340]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2 2024-02-28T16:28:54.573 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:54 smithi023 podman[91360]: 2024-02-28 16:28:54.58436624 +0000 UTC m=+0.656529918 container remove a6f10f32dd17e516054a420f0fa63cf8585bc24936fcbd890011c4559175bb11 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0) 2024-02-28T16:28:54.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:54 smithi153 ceph-mon[66339]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:54.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:54 smithi153 ceph-mon[66339]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:28:54.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:54 smithi153 ceph-mon[66339]: osdmap e61: 6 total, 5 up, 6 in 2024-02-28T16:28:55.457 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:55 smithi023 ceph-mon[78509]: osdmap e62: 6 total, 5 up, 6 in 2024-02-28T16:28:55.457 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:55 smithi023 podman[91458]: 2024-02-28 16:28:55.211533985 +0000 UTC m=+0.032349886 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:28:55.457 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:55 smithi023 podman[91458]: 2024-02-28 16:28:55.327180887 +0000 UTC m=+0.147996829 container create 71a935abcebdf1fd6872ebb2e0efaaa045cbc8de05b6eb2a14874ea750f4e09b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-28T16:28:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:55 smithi153 ceph-mon[66339]: osdmap e62: 6 total, 5 up, 6 in 2024-02-28T16:28:55.923 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:55 smithi023 podman[91458]: 2024-02-28 16:28:55.57289126 +0000 UTC m=+0.393707246 container init 71a935abcebdf1fd6872ebb2e0efaaa045cbc8de05b6eb2a14874ea750f4e09b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-02-28T16:28:55.923 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:55 smithi023 podman[91458]: 2024-02-28 16:28:55.585246283 +0000 UTC m=+0.406062192 container start 71a935abcebdf1fd6872ebb2e0efaaa045cbc8de05b6eb2a14874ea750f4e09b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-28T16:28:55.923 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:55 smithi023 podman[91458]: 2024-02-28 16:28:55.696564501 +0000 UTC m=+0.517380496 container attach 71a935abcebdf1fd6872ebb2e0efaaa045cbc8de05b6eb2a14874ea750f4e09b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-28T16:28:56.380 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:56 smithi023 podman[91458]: 2024-02-28 16:28:56.041633521 +0000 UTC m=+0.862449467 container died 71a935abcebdf1fd6872ebb2e0efaaa045cbc8de05b6eb2a14874ea750f4e09b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:28:56.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:56 smithi023 ceph-mon[78509]: pgmap v107: 65 pgs: 15 peering, 2 stale+active+clean, 48 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:56.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:56 smithi023 ceph-mon[78509]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-02-28T16:28:56.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:56 smithi153 ceph-mon[66339]: pgmap v107: 65 pgs: 15 peering, 2 stale+active+clean, 48 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:28:56.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:56 smithi153 ceph-mon[66339]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-02-28T16:28:57.175 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:56 smithi023 podman[91485]: 2024-02-28 16:28:56.767398534 +0000 UTC m=+0.707974276 container remove 71a935abcebdf1fd6872ebb2e0efaaa045cbc8de05b6eb2a14874ea750f4e09b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:28:57.176 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:56 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-28T16:28:57.176 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:56 smithi023 systemd[1]: Stopped Ceph osd.2 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:28:57.176 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:56 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.2.service: Consumed 1min 34.208s CPU time. 2024-02-28T16:28:57.476 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:57 smithi023 systemd[1]: Starting Ceph osd.2 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:28:57.728 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:57 smithi023 ceph-mon[78509]: Health check failed: Degraded data redundancy: 10/228 objects degraded (4.386%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:57.729 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:57 smithi023 podman[91587]: 2024-02-28 16:28:57.484721931 +0000 UTC m=+0.036103156 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:28:57.729 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:57 smithi023 podman[91587]: 2024-02-28 16:28:57.592914265 +0000 UTC m=+0.144295515 container create 0b09cc237dd106381111b1dd1026e008713a73d4bdf6f227eae4f612977dcb82 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-28T16:28:57.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:57 smithi153 ceph-mon[66339]: Health check failed: Degraded data redundancy: 10/228 objects degraded (4.386%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T16:28:58.173 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:57 smithi023 podman[91587]: 2024-02-28 16:28:57.846552738 +0000 UTC m=+0.397934035 container init 0b09cc237dd106381111b1dd1026e008713a73d4bdf6f227eae4f612977dcb82 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:28:58.173 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:57 smithi023 podman[91587]: 2024-02-28 16:28:57.858810127 +0000 UTC m=+0.410191411 container start 0b09cc237dd106381111b1dd1026e008713a73d4bdf6f227eae4f612977dcb82 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:28:58.173 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:57 smithi023 podman[91587]: 2024-02-28 16:28:57.986855618 +0000 UTC m=+0.538236875 container attach 0b09cc237dd106381111b1dd1026e008713a73d4bdf6f227eae4f612977dcb82 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-28T16:28:58.766 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-mon[78509]: pgmap v108: 65 pgs: 5 active+undersized+degraded, 15 peering, 7 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 10/228 objects degraded (4.386%) 2024-02-28T16:28:58.768 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate[91601]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:28:58.768 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate[91601]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:28:58.768 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 bash[91587]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:28:58.768 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 bash[91587]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:28:58.768 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 bash[91587]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:28:58.768 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 bash[91587]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:28:58.768 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 bash[91587]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 bash[91587]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 bash[91587]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate[91601]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate[91601]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate[91601]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate[91601]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate[91601]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T16:28:58.769 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:58 smithi023 podman[91587]: 2024-02-28 16:28:58.779354761 +0000 UTC m=+1.330736081 container died 0b09cc237dd106381111b1dd1026e008713a73d4bdf6f227eae4f612977dcb82 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2) 2024-02-28T16:28:58.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:58 smithi153 ceph-mon[66339]: pgmap v108: 65 pgs: 5 active+undersized+degraded, 15 peering, 7 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 10/228 objects degraded (4.386%) 2024-02-28T16:28:59.833 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:28:59 smithi023 ceph-mon[78509]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-02-28T16:28:59.834 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:59 smithi023 podman[91736]: 2024-02-28 16:28:59.476366249 +0000 UTC m=+0.677814184 container remove 0b09cc237dd106381111b1dd1026e008713a73d4bdf6f227eae4f612977dcb82 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0) 2024-02-28T16:28:59.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:28:59 smithi153 ceph-mon[66339]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-02-28T16:29:00.108 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:59 smithi023 podman[91800]: 2024-02-28 16:28:59.753678128 +0000 UTC m=+0.038904552 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:29:00.108 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:28:59 smithi023 podman[91800]: 2024-02-28 16:28:59.874767985 +0000 UTC m=+0.159994444 container create 04b8de84daf761d643cb513c1eacfff905065509187c0d3af152cbe457fa26df (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-28T16:29:00.109 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:00 smithi023 podman[91800]: 2024-02-28 16:29:00.119726873 +0000 UTC m=+0.404953335 container init 04b8de84daf761d643cb513c1eacfff905065509187c0d3af152cbe457fa26df (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-28T16:29:00.423 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:00 smithi023 podman[91800]: 2024-02-28 16:29:00.130445069 +0000 UTC m=+0.415671493 container start 04b8de84daf761d643cb513c1eacfff905065509187c0d3af152cbe457fa26df (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:29:00.423 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:00 smithi023 ceph-osd[91818]: -- 172.21.15.23:0/4189040627 <== mon.0 v2:172.21.15.23:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557827e5f680 con 0x557827e29000 2024-02-28T16:29:00.423 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:00 smithi023 bash[91800]: 04b8de84daf761d643cb513c1eacfff905065509187c0d3af152cbe457fa26df 2024-02-28T16:29:00.423 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:00 smithi023 systemd[1]: Started Ceph osd.2 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:29:00.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:00 smithi153 ceph-mon[66339]: pgmap v109: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:00.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:00 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:00.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:00 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:00.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:00 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:00.922 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:00 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[91814]: 2024-02-28T16:29:00.719+0000 7f4da16f17c0 -1 Falling back to public interface 2024-02-28T16:29:00.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:00 smithi023 ceph-mon[78509]: pgmap v109: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:00.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:00 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:00.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:00 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:00.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:00 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:02 smithi023 ceph-mon[78509]: pgmap v110: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:02.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:02 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 30/228 objects degraded (13.158%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:02.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:02 smithi153 ceph-mon[66339]: pgmap v110: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:02.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:02 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 30/228 objects degraded (13.158%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:04.746 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:04 smithi023 ceph-mon[78509]: pgmap v111: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:04.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:04 smithi153 ceph-mon[66339]: pgmap v111: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:05.622 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:05 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[91814]: 2024-02-28T16:29:05.349+0000 7f4da16f17c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-28T16:29:06.173 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:05 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[91814]: 2024-02-28T16:29:05.919+0000 7f4da16f17c0 -1 osd.2 60 log_to_monitors true 2024-02-28T16:29:06.646 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:06 smithi023 ceph-mon[78509]: pgmap v112: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:06.646 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:06 smithi023 ceph-mon[78509]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:29:06.646 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:06.646 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:06.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:06 smithi153 ceph-mon[66339]: pgmap v112: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:06.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:06 smithi153 ceph-mon[66339]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:29:06.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:06.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:07.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:07 smithi153 ceph-mon[66339]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:29:07.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:07 smithi153 ceph-mon[66339]: osdmap e63: 6 total, 5 up, 6 in 2024-02-28T16:29:07.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:07 smithi153 ceph-mon[66339]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:29:07.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:07.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:07.923 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:29:07 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[91814]: 2024-02-28T16:29:07.670+0000 7f4d8ba00700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:29:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:07 smithi023 ceph-mon[78509]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:29:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:07 smithi023 ceph-mon[78509]: osdmap e63: 6 total, 5 up, 6 in 2024-02-28T16:29:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:07 smithi023 ceph-mon[78509]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi023", "root=default"]}]: dispatch 2024-02-28T16:29:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:07.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:08.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:08 smithi023 ceph-mon[78509]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:08.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:08 smithi023 ceph-mon[78509]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' 2024-02-28T16:29:09.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:08 smithi153 ceph-mon[66339]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-02-28T16:29:09.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:08 smithi153 ceph-mon[66339]: from='osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877]' entity='osd.2' 2024-02-28T16:29:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:09 smithi023 ceph-mon[78509]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:29:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:09 smithi023 ceph-mon[78509]: osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877] boot 2024-02-28T16:29:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:09 smithi023 ceph-mon[78509]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T16:29:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:09 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:29:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:09 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:09.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:09 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:10.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:09 smithi153 ceph-mon[66339]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:29:10.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:09 smithi153 ceph-mon[66339]: osd.2 [v2:172.21.15.23:6818/779926877,v1:172.21.15.23:6819/779926877] boot 2024-02-28T16:29:10.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:09 smithi153 ceph-mon[66339]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T16:29:10.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:09 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:29:10.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:09 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:10.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:09 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:10.834 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:10 smithi023 ceph-mon[78509]: pgmap v116: 65 pgs: 3 peering, 11 active+undersized+degraded, 13 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-02-28T16:29:10.834 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:10 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 27/228 objects degraded (11.842%), 11 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:10.834 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:10 smithi023 ceph-mon[78509]: osdmap e65: 6 total, 6 up, 6 in 2024-02-28T16:29:11.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:10 smithi153 ceph-mon[66339]: pgmap v116: 65 pgs: 3 peering, 11 active+undersized+degraded, 13 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-02-28T16:29:11.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:10 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 27/228 objects degraded (11.842%), 11 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:11.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:10 smithi153 ceph-mon[66339]: osdmap e65: 6 total, 6 up, 6 in 2024-02-28T16:29:12.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:12 smithi023 ceph-mon[78509]: pgmap v118: 65 pgs: 3 peering, 11 active+undersized+degraded, 13 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-02-28T16:29:13.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:12 smithi153 ceph-mon[66339]: pgmap v118: 65 pgs: 3 peering, 11 active+undersized+degraded, 13 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-02-28T16:29:15.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: pgmap v119: 65 pgs: 3 peering, 2 active+undersized+degraded, 3 active+undersized, 57 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4/228 objects degraded (1.754%) 2024-02-28T16:29:15.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:15.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:15.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:15.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:15.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:15.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:15.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:15.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:15.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:15.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: pgmap v119: 65 pgs: 3 peering, 2 active+undersized+degraded, 3 active+undersized, 57 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4/228 objects degraded (1.754%) 2024-02-28T16:29:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:15.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:15.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:15.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:15.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:15.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:15.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:16.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:15 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:16.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:15 smithi023 ceph-mon[78509]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-28T16:29:16.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:15 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:16.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:15 smithi153 ceph-mon[66339]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-28T16:29:17.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:16 smithi153 ceph-mon[66339]: pgmap v120: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:17.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:16 smithi153 ceph-mon[66339]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/228 objects degraded (1.754%), 2 pgs degraded) 2024-02-28T16:29:17.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:16 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:29:17.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:16 smithi023 ceph-mon[78509]: pgmap v120: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:17.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:16 smithi023 ceph-mon[78509]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/228 objects degraded (1.754%), 2 pgs degraded) 2024-02-28T16:29:17.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:16 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:29:19.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:18 smithi153 ceph-mon[66339]: pgmap v121: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:19.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:18 smithi023 ceph-mon[78509]: pgmap v121: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:21.301 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:20 smithi153 ceph-mon[66339]: pgmap v122: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:21.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:20 smithi023 ceph-mon[78509]: pgmap v122: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:21.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 -- 172.21.15.23:0/869267074 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 msgr2=0x7fbc34106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:21.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 --2- 172.21.15.23:0/869267074 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc34106c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009910 tx=0x7fbc24009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:21.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 -- 172.21.15.23:0/869267074 shutdown_connections 2024-02-28T16:29:21.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 --2- 172.21.15.23:0/869267074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc34107a40 0x7fbc34107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 --2- 172.21.15.23:0/869267074 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc34106c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 -- 172.21.15.23:0/869267074 >> 172.21.15.23:0/869267074 conn(0x7fbc34075970 msgr2=0x7fbc34077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:21.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 -- 172.21.15.23:0/869267074 shutdown_connections 2024-02-28T16:29:21.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.458+0000 7fbc3a400700 1 -- 172.21.15.23:0/869267074 wait complete. 2024-02-28T16:29:21.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.459+0000 7fbc3a400700 1 Processor -- start 2024-02-28T16:29:21.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.459+0000 7fbc3a400700 1 -- start start 2024-02-28T16:29:21.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc3a400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc3419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:21.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc3a400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc34107a40 0x7fbc3419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:21.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc3a400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3419cc60 con 0x7fbc34106840 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc3a400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3419cda0 con 0x7fbc34107a40 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc33400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc3419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc33400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc3419c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44148/0 (socket says 172.21.15.23:44148) 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc33400700 1 -- 172.21.15.23:0/1696791434 learned_addr learned my addr 172.21.15.23:0/1696791434 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc32a00700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc34107a40 0x7fbc3419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.460+0000 7fbc33400700 1 -- 172.21.15.23:0/1696791434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc34107a40 msgr2=0x7fbc3419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc33400700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc34107a40 0x7fbc3419c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc33400700 1 -- 172.21.15.23:0/1696791434 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240095f0 con 0x7fbc34106840 2024-02-28T16:29:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc33400700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc3419c100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400bda0 tx=0x7fbc2400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc2be00700 1 -- 172.21.15.23:0/1696791434 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc2401d070 con 0x7fbc34106840 2024-02-28T16:29:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc2be00700 1 -- 172.21.15.23:0/1696791434 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc2400f460 con 0x7fbc34106840 2024-02-28T16:29:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc341a17f0 con 0x7fbc34106840 2024-02-28T16:29:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc2be00700 1 -- 172.21.15.23:0/1696791434 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc24021640 con 0x7fbc34106840 2024-02-28T16:29:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.461+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc341a1ce0 con 0x7fbc34106840 2024-02-28T16:29:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.462+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3410f390 con 0x7fbc34106840 2024-02-28T16:29:21.452 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.463+0000 7fbc2be00700 1 -- 172.21.15.23:0/1696791434 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbc2400fa00 con 0x7fbc34106840 2024-02-28T16:29:21.453 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.464+0000 7fbc2be00700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbc1806d8a0 0x7fbc1806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:21.453 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.464+0000 7fbc2be00700 1 -- 172.21.15.23:0/1696791434 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbc2408e6f0 con 0x7fbc34106840 2024-02-28T16:29:21.454 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.465+0000 7fbc32a00700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbc1806d8a0 0x7fbc1806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:21.454 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.465+0000 7fbc32a00700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbc1806d8a0 0x7fbc1806fd50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005950 tx=0x7fbc200058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:21.459 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.470+0000 7fbc2be00700 1 -- 172.21.15.23:0/1696791434 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbc2405ba20 con 0x7fbc34106840 2024-02-28T16:29:21.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.720+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc3410c390 con 0x7fbc1806d8a0 2024-02-28T16:29:21.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.722+0000 7fbc2be00700 1 -- 172.21.15.23:0/1696791434 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbc3410c390 con 0x7fbc1806d8a0 2024-02-28T16:29:21.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbc1806d8a0 msgr2=0x7fbc1806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:21.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbc1806d8a0 0x7fbc1806fd50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005950 tx=0x7fbc200058e0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 msgr2=0x7fbc3419c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:21.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc3419c100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400bda0 tx=0x7fbc2400be80 comp rx=0 tx=0).stop 2024-02-28T16:29:21.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 shutdown_connections 2024-02-28T16:29:21.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbc1806d8a0 0x7fbc1806fd50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbc34106840 0x7fbc3419c100 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 --2- 172.21.15.23:0/1696791434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc34107a40 0x7fbc3419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 >> 172.21.15.23:0/1696791434 conn(0x7fbc34075970 msgr2=0x7fbc3410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:21.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 shutdown_connections 2024-02-28T16:29:21.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.726+0000 7fbc3a400700 1 -- 172.21.15.23:0/1696791434 wait complete. 2024-02-28T16:29:21.732 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:29:21.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.894+0000 7f4a1b000700 1 -- 172.21.15.23:0/233687631 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 msgr2=0x7f4a14073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:21.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.894+0000 7f4a1b000700 1 --2- 172.21.15.23:0/233687631 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14073bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009910 tx=0x7f4a00009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:21.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.894+0000 7f4a1b000700 1 -- 172.21.15.23:0/233687631 shutdown_connections 2024-02-28T16:29:21.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.894+0000 7f4a1b000700 1 --2- 172.21.15.23:0/233687631 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14073bc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.894+0000 7f4a1b000700 1 --2- 172.21.15.23:0/233687631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a14074d20 0x7f4a14073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.894+0000 7f4a1b000700 1 -- 172.21.15.23:0/233687631 >> 172.21.15.23:0/233687631 conn(0x7f4a140fb7f0 msgr2=0x7f4a140fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:21.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.894+0000 7f4a1b000700 1 -- 172.21.15.23:0/233687631 shutdown_connections 2024-02-28T16:29:21.884 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.895+0000 7f4a1b000700 1 -- 172.21.15.23:0/233687631 wait complete. 2024-02-28T16:29:21.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.896+0000 7f4a1b000700 1 Processor -- start 2024-02-28T16:29:21.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.896+0000 7f4a1b000700 1 -- start start 2024-02-28T16:29:21.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.896+0000 7f4a1b000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:21.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.896+0000 7f4a1b000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a14074d20 0x7f4a141981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:21.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.896+0000 7f4a1b000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a141987b0 con 0x7f4a14073750 2024-02-28T16:29:21.885 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.896+0000 7f4a1b000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14198920 con 0x7f4a14074d20 2024-02-28T16:29:21.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.896+0000 7f4a13e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:21.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.897+0000 7f4a13e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44152/0 (socket says 172.21.15.23:44152) 2024-02-28T16:29:21.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.897+0000 7f4a13e00700 1 -- 172.21.15.23:0/388946023 learned_addr learned my addr 172.21.15.23:0/388946023 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:21.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.897+0000 7f4a13400700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a14074d20 0x7f4a141981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:21.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.897+0000 7f4a13e00700 1 -- 172.21.15.23:0/388946023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a14074d20 msgr2=0x7f4a141981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:21.886 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.897+0000 7f4a13e00700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a14074d20 0x7f4a141981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:21.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.897+0000 7f4a13e00700 1 -- 172.21.15.23:0/388946023 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a000095f0 con 0x7f4a14073750 2024-02-28T16:29:21.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.897+0000 7f4a13e00700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14197c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c8a0 tx=0x7f4a0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:21.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.898+0000 7f4a10c00700 1 -- 172.21.15.23:0/388946023 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0400cea0 con 0x7f4a14073750 2024-02-28T16:29:21.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.898+0000 7f4a10c00700 1 -- 172.21.15.23:0/388946023 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4a04004830 con 0x7f4a14073750 2024-02-28T16:29:21.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.898+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1419d3b0 con 0x7f4a14073750 2024-02-28T16:29:21.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.898+0000 7f4a10c00700 1 -- 172.21.15.23:0/388946023 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a040055b0 con 0x7f4a14073750 2024-02-28T16:29:21.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.898+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1419d900 con 0x7f4a14073750 2024-02-28T16:29:21.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.899+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1410af80 con 0x7f4a14073750 2024-02-28T16:29:21.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.900+0000 7f4a10c00700 1 -- 172.21.15.23:0/388946023 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f4a04007ad0 con 0x7f4a14073750 2024-02-28T16:29:21.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.901+0000 7f4a10c00700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49f806d8a0 0x7f49f806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:21.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.901+0000 7f4a10c00700 1 -- 172.21.15.23:0/388946023 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4a0408d120 con 0x7f4a14073750 2024-02-28T16:29:21.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.901+0000 7f4a13400700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49f806d8a0 0x7f49f806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:21.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.902+0000 7f4a13400700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49f806d8a0 0x7f49f806fd50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a14199180 tx=0x7f4a0000b580 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:21.906+0000 7f4a10c00700 1 -- 172.21.15.23:0/388946023 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4a040569a0 con 0x7f4a14073750 2024-02-28T16:29:22.155 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.166+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a141077a0 con 0x7f49f806d8a0 2024-02-28T16:29:22.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.168+0000 7f4a10c00700 1 -- 172.21.15.23:0/388946023 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4a141077a0 con 0x7f49f806d8a0 2024-02-28T16:29:22.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49f806d8a0 msgr2=0x7f49f806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49f806d8a0 0x7f49f806fd50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a14199180 tx=0x7f4a0000b580 comp rx=0 tx=0).stop 2024-02-28T16:29:22.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 msgr2=0x7f4a14197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14197c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c8a0 tx=0x7f4a0400cc60 comp rx=0 tx=0).stop 2024-02-28T16:29:22.162 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 shutdown_connections 2024-02-28T16:29:22.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49f806d8a0 0x7f49f806fd50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4a14073750 0x7f4a14197c70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 --2- 172.21.15.23:0/388946023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a14074d20 0x7f4a141981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 >> 172.21.15.23:0/388946023 conn(0x7f4a140fb7f0 msgr2=0x7f4a14106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:22.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 shutdown_connections 2024-02-28T16:29:22.163 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.173+0000 7f4a1b000700 1 -- 172.21.15.23:0/388946023 wait complete. 2024-02-28T16:29:22.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 -- 172.21.15.23:0/3076199452 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78074d00 msgr2=0x7f2d78073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 --2- 172.21.15.23:0/3076199452 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78074d00 0x7f2d78073160 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009910 tx=0x7f2d6c009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:22.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 -- 172.21.15.23:0/3076199452 shutdown_connections 2024-02-28T16:29:22.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 --2- 172.21.15.23:0/3076199452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d78073730 0x7f2d78073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 --2- 172.21.15.23:0/3076199452 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78074d00 0x7f2d78073160 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 -- 172.21.15.23:0/3076199452 >> 172.21.15.23:0/3076199452 conn(0x7f2d780fb7e0 msgr2=0x7f2d780fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:22.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 -- 172.21.15.23:0/3076199452 shutdown_connections 2024-02-28T16:29:22.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.337+0000 7f2d80000700 1 -- 172.21.15.23:0/3076199452 wait complete. 2024-02-28T16:29:22.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.338+0000 7f2d80000700 1 Processor -- start 2024-02-28T16:29:22.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.338+0000 7f2d80000700 1 -- start start 2024-02-28T16:29:22.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d80000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78073730 0x7f2d78197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:22.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d80000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d78074d00 0x7f2d781981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:22.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d80000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781987e0 con 0x7f2d78073730 2024-02-28T16:29:22.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d80000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d78198950 con 0x7f2d78074d00 2024-02-28T16:29:22.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d7d600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78073730 0x7f2d78197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:22.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d7d600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78073730 0x7f2d78197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44168/0 (socket says 172.21.15.23:44168) 2024-02-28T16:29:22.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d7d600700 1 -- 172.21.15.23:0/3716359660 learned_addr learned my addr 172.21.15.23:0/3716359660 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:22.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.339+0000 7f2d7cc00700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d78074d00 0x7f2d781981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d7d600700 1 -- 172.21.15.23:0/3716359660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d78074d00 msgr2=0x7f2d781981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d7d600700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d78074d00 0x7f2d781981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d7d600700 1 -- 172.21.15.23:0/3716359660 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c0095f0 con 0x7f2d78073730 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d7d600700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78073730 0x7f2d78197ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00b5c0 tx=0x7f2d6c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d76000700 1 -- 172.21.15.23:0/3716359660 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d6c01d070 con 0x7f2d78073730 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d76000700 1 -- 172.21.15.23:0/3716359660 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c00f460 con 0x7f2d78073730 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d76000700 1 -- 172.21.15.23:0/3716359660 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d6c021640 con 0x7f2d78073730 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7819d380 con 0x7f2d78073730 2024-02-28T16:29:22.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.340+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7819d870 con 0x7f2d78073730 2024-02-28T16:29:22.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.342+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7810af80 con 0x7f2d78073730 2024-02-28T16:29:22.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.343+0000 7f2d76000700 1 -- 172.21.15.23:0/3716359660 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2d6c00f5d0 con 0x7f2d78073730 2024-02-28T16:29:22.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.343+0000 7f2d76000700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2d6006d8a0 0x7f2d6006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:22.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.344+0000 7f2d76000700 1 -- 172.21.15.23:0/3716359660 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2d6c08e7e0 con 0x7f2d78073730 2024-02-28T16:29:22.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.344+0000 7f2d7cc00700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2d6006d8a0 0x7f2d6006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:22.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.344+0000 7f2d7cc00700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2d6006d8a0 0x7f2d6006fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d64005950 tx=0x7f2d640058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:22.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.348+0000 7f2d76000700 1 -- 172.21.15.23:0/3716359660 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2d6c057fc0 con 0x7f2d78073730 2024-02-28T16:29:22.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:22 smithi023 ceph-mon[78509]: pgmap v123: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:22.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:22.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:22.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:22.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:22 smithi023 ceph-mon[78509]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:22.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.591+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d781077d0 con 0x7f2d6006d8a0 2024-02-28T16:29:22.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.609+0000 7f2d76000700 1 -- 172.21.15.23:0/3716359660 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f2d781077d0 con 0x7f2d6006d8a0 2024-02-28T16:29:22.599 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:29:22.599 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (14m) 15s ago 16m 14.2M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:29:22.599 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (16m) 15s ago 16m 8610k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:29:22.599 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (15m) 106s ago 15m 7742k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (119s) 15s ago 16m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (111s) 106s ago 15m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (14m) 15s ago 15m 74.5M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (9m) 15s ago 8m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (9m) 15s ago 9m 16.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (8m) 106s ago 8m 15.7M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (9m) 106s ago 9m 16.0M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (5m) 15s ago 18m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (4m) 106s ago 14m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (3m) 15s ago 18m 46.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (3m) 106s ago 14m 37.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (16m) 15s ago 16m 8010k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (15m) 106s ago 15m 8208k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (81s) 15s ago 13m 89.3M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (51s) 15s ago 13m 98.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:29:22.600 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (22s) 15s ago 12m 11.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:29:22.601 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (12m) 106s ago 12m 277M 2241M 18.2.0 dc2bc1663786 893a3ab66c27 2024-02-28T16:29:22.601 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (11m) 106s ago 11m 255M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:29:22.601 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (10m) 106s ago 10m 228M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:29:22.601 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (4m) 15s ago 15m 58.5M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:29:22.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2d6006d8a0 msgr2=0x7f2d6006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2d6006d8a0 0x7f2d6006fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d64005950 tx=0x7f2d640058e0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78073730 msgr2=0x7f2d78197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78073730 0x7f2d78197ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00b5c0 tx=0x7f2d6c00be20 comp rx=0 tx=0).stop 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 shutdown_connections 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2d6006d8a0 0x7f2d6006fd50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2d78073730 0x7f2d78197ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 --2- 172.21.15.23:0/3716359660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d78074d00 0x7f2d781981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.612+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 >> 172.21.15.23:0/3716359660 conn(0x7f2d780fb7e0 msgr2=0x7f2d781060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.613+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 shutdown_connections 2024-02-28T16:29:22.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.613+0000 7f2d80000700 1 -- 172.21.15.23:0/3716359660 wait complete. 2024-02-28T16:29:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:22 smithi153 ceph-mon[66339]: pgmap v123: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:22 smithi153 ceph-mon[66339]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:22.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 -- 172.21.15.23:0/841918899 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 msgr2=0x7fca08073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 --2- 172.21.15.23:0/841918899 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08073c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009940 tx=0x7fc9f4009c50 comp rx=0 tx=0).stop 2024-02-28T16:29:22.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 -- 172.21.15.23:0/841918899 shutdown_connections 2024-02-28T16:29:22.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 --2- 172.21.15.23:0/841918899 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08073c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 --2- 172.21.15.23:0/841918899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08074d80 0x7fca080731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 -- 172.21.15.23:0/841918899 >> 172.21.15.23:0/841918899 conn(0x7fca080fb7f0 msgr2=0x7fca080fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:22.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 -- 172.21.15.23:0/841918899 shutdown_connections 2024-02-28T16:29:22.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.775+0000 7fca0d400700 1 -- 172.21.15.23:0/841918899 wait complete. 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.776+0000 7fca0d400700 1 Processor -- start 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.776+0000 7fca0d400700 1 -- start start 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca0d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca0d400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08074d80 0x7fca081981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca0d400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca081987c0 con 0x7fca080737b0 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca0d400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08198930 con 0x7fca08074d80 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca06800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca06800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44188/0 (socket says 172.21.15.23:44188) 2024-02-28T16:29:22.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca06800700 1 -- 172.21.15.23:0/826629636 learned_addr learned my addr 172.21.15.23:0/826629636 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:22.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca05e00700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08074d80 0x7fca081981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:22.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca06800700 1 -- 172.21.15.23:0/826629636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08074d80 msgr2=0x7fca081981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:22.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca06800700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08074d80 0x7fca081981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:22.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.777+0000 7fca06800700 1 -- 172.21.15.23:0/826629636 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40095f0 con 0x7fca080737b0 2024-02-28T16:29:22.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.778+0000 7fca06800700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08197c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d8d0 tx=0x7fc9f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:22.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.778+0000 7fc9ff400700 1 -- 172.21.15.23:0/826629636 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f8009940 con 0x7fca080737b0 2024-02-28T16:29:22.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.778+0000 7fc9ff400700 1 -- 172.21.15.23:0/826629636 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc9f8010460 con 0x7fca080737b0 2024-02-28T16:29:22.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.778+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0819d3c0 con 0x7fca080737b0 2024-02-28T16:29:22.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.778+0000 7fc9ff400700 1 -- 172.21.15.23:0/826629636 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f800f5f0 con 0x7fca080737b0 2024-02-28T16:29:22.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.778+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0819d910 con 0x7fca080737b0 2024-02-28T16:29:22.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.779+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0810af80 con 0x7fca080737b0 2024-02-28T16:29:22.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.781+0000 7fc9ff400700 1 -- 172.21.15.23:0/826629636 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc9f80105d0 con 0x7fca080737b0 2024-02-28T16:29:22.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.781+0000 7fc9ff400700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc9ec06d8a0 0x7fc9ec06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:22.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.782+0000 7fc9ff400700 1 -- 172.21.15.23:0/826629636 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc9f808d560 con 0x7fca080737b0 2024-02-28T16:29:22.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.782+0000 7fca05e00700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc9ec06d8a0 0x7fc9ec06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:22.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.783+0000 7fca05e00700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc9ec06d8a0 0x7fc9ec06fd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca08199190 tx=0x7fc9f4005fb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:22.776 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:22.787+0000 7fc9ff400700 1 -- 172.21.15.23:0/826629636 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc9f8056cc0 con 0x7fca080737b0 2024-02-28T16:29:23.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.095+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca0819df50 con 0x7fca080737b0 2024-02-28T16:29:23.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.096+0000 7fc9ff400700 1 -- 172.21.15.23:0/826629636 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fc9f805a380 con 0x7fca080737b0 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-28T16:29:23.086 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 7 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:29:23.087 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:29:23.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.099+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc9ec06d8a0 msgr2=0x7fc9ec06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.099+0000 7fca0d400700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc9ec06d8a0 0x7fc9ec06fd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca08199190 tx=0x7fc9f4005fb0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.099+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 msgr2=0x7fca08197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.099+0000 7fca0d400700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08197c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d8d0 tx=0x7fc9f800dc90 comp rx=0 tx=0).stop 2024-02-28T16:29:23.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.099+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 shutdown_connections 2024-02-28T16:29:23.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.099+0000 7fca0d400700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc9ec06d8a0 0x7fc9ec06fd50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.099+0000 7fca0d400700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fca080737b0 0x7fca08197c80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.100+0000 7fca0d400700 1 --2- 172.21.15.23:0/826629636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08074d80 0x7fca081981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.100+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 >> 172.21.15.23:0/826629636 conn(0x7fca080fb7f0 msgr2=0x7fca08106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:23.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.100+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 shutdown_connections 2024-02-28T16:29:23.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.100+0000 7fca0d400700 1 -- 172.21.15.23:0/826629636 wait complete. 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.259+0000 7f054f000700 1 -- 172.21.15.23:0/4189745435 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548103330 msgr2=0x7f0548105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.259+0000 7f054f000700 1 --2- 172.21.15.23:0/4189745435 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548103330 0x7f0548105790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0534009910 tx=0x7f0534009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.260+0000 7f054f000700 1 -- 172.21.15.23:0/4189745435 shutdown_connections 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.260+0000 7f054f000700 1 --2- 172.21.15.23:0/4189745435 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548103330 0x7f0548105790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.260+0000 7f054f000700 1 --2- 172.21.15.23:0/4189745435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0548069250 0x7f0548102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.260+0000 7f054f000700 1 -- 172.21.15.23:0/4189745435 >> 172.21.15.23:0/4189745435 conn(0x7f05480fa780 msgr2=0x7f05480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.260+0000 7f054f000700 1 -- 172.21.15.23:0/4189745435 shutdown_connections 2024-02-28T16:29:23.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.260+0000 7f054f000700 1 -- 172.21.15.23:0/4189745435 wait complete. 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.261+0000 7f054f000700 1 Processor -- start 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.261+0000 7f054f000700 1 -- start start 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.261+0000 7f054f000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548069250 0x7f0548197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.261+0000 7f054f000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0548103330 0x7f0548198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f054f000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548198870 con 0x7f0548069250 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f054f000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054819d280 con 0x7f0548103330 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f0547e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548069250 0x7f0548197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f0547e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548069250 0x7f0548197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44216/0 (socket says 172.21.15.23:44216) 2024-02-28T16:29:23.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f0547e00700 1 -- 172.21.15.23:0/35833134 learned_addr learned my addr 172.21.15.23:0/35833134 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:23.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f0547400700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0548103330 0x7f0548198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:23.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f0547e00700 1 -- 172.21.15.23:0/35833134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0548103330 msgr2=0x7f0548198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f0547e00700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0548103330 0x7f0548198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.262+0000 7f0547e00700 1 -- 172.21.15.23:0/35833134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340095f0 con 0x7f0548069250 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.263+0000 7f0547e00700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548069250 0x7f0548197d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f053800e8c0 tx=0x7f053800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.263+0000 7f0544c00700 1 -- 172.21.15.23:0/35833134 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053800cba0 con 0x7f0548069250 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.263+0000 7f0544c00700 1 -- 172.21.15.23:0/35833134 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f053800eec0 con 0x7f0548069250 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.263+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054819d480 con 0x7f0548069250 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.263+0000 7f0544c00700 1 -- 172.21.15.23:0/35833134 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0538018650 con 0x7f0548069250 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.263+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054819d9a0 con 0x7f0548069250 2024-02-28T16:29:23.253 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.264+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05480fc340 con 0x7f0548069250 2024-02-28T16:29:23.254 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.266+0000 7f0544c00700 1 -- 172.21.15.23:0/35833134 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f053800cd00 con 0x7f0548069250 2024-02-28T16:29:23.256 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.267+0000 7f0544c00700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f052c06d8a0 0x7f052c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:23.256 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.267+0000 7f0544c00700 1 -- 172.21.15.23:0/35833134 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0538014070 con 0x7f0548069250 2024-02-28T16:29:23.256 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.267+0000 7f0547400700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f052c06d8a0 0x7f052c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:23.256 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.268+0000 7f0547400700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f052c06d8a0 0x7f052c06fd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0534009fd0 tx=0x7f0534005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:23.260 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.272+0000 7f0544c00700 1 -- 172.21.15.23:0/35833134 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0538052d20 con 0x7f0548069250 2024-02-28T16:29:23.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:23 smithi023 ceph-mon[78509]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:23.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:23 smithi023 ceph-mon[78509]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:23.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:23 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/826629636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:23.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.555+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0548061a00 con 0x7f0548069250 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.556+0000 7f0544c00700 1 -- 172.21.15.23:0/35833134 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f053805ab40 con 0x7f0548069250 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:29:23.545 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:29:23.546 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:23.547 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:23.548 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:29:23.548 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:23.548 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:23.548 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:23.548 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f052c06d8a0 msgr2=0x7f052c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f052c06d8a0 0x7f052c06fd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0534009fd0 tx=0x7f0534005fd0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548069250 msgr2=0x7f0548197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548069250 0x7f0548197d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f053800e8c0 tx=0x7f053800ec80 comp rx=0 tx=0).stop 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 shutdown_connections 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f052c06d8a0 0x7f052c06fd50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0548069250 0x7f0548197d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 --2- 172.21.15.23:0/35833134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0548103330 0x7f0548198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 >> 172.21.15.23:0/35833134 conn(0x7f05480fa780 msgr2=0x7f05481006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 shutdown_connections 2024-02-28T16:29:23.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.559+0000 7f054f000700 1 -- 172.21.15.23:0/35833134 wait complete. 2024-02-28T16:29:23.550 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:29:23.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:23 smithi153 ceph-mon[66339]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:23.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:23 smithi153 ceph-mon[66339]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:23.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:23 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/826629636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 -- 172.21.15.23:0/4068845827 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c94100040 msgr2=0x7f0c94100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 --2- 172.21.15.23:0/4068845827 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c94100040 0x7f0c94100450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009910 tx=0x7f0c88009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 -- 172.21.15.23:0/4068845827 shutdown_connections 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 --2- 172.21.15.23:0/4068845827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c941012e0 0x7f0c94101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 --2- 172.21.15.23:0/4068845827 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c94100040 0x7f0c94100450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 -- 172.21.15.23:0/4068845827 >> 172.21.15.23:0/4068845827 conn(0x7f0c940fb6b0 msgr2=0x7f0c940fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 -- 172.21.15.23:0/4068845827 shutdown_connections 2024-02-28T16:29:23.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.728+0000 7f0c99e00700 1 -- 172.21.15.23:0/4068845827 wait complete. 2024-02-28T16:29:23.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.729+0000 7f0c99e00700 1 Processor -- start 2024-02-28T16:29:23.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.729+0000 7f0c99e00700 1 -- start start 2024-02-28T16:29:23.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c99e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c94100040 0x7f0c94197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:23.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c99e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c941012e0 0x7f0c94197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:23.719 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c99e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94198560 con 0x7f0c941012e0 2024-02-28T16:29:23.719 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c99e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941986a0 con 0x7f0c94100040 2024-02-28T16:29:23.719 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c93e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c941012e0 0x7f0c94197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:23.719 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c93e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c941012e0 0x7f0c94197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44234/0 (socket says 172.21.15.23:44234) 2024-02-28T16:29:23.719 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c93e00700 1 -- 172.21.15.23:0/1585211428 learned_addr learned my addr 172.21.15.23:0/1585211428 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:23.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c98a00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c94100040 0x7f0c94197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:23.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c93e00700 1 -- 172.21.15.23:0/1585211428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c94100040 msgr2=0x7f0c94197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.730+0000 7f0c93e00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c94100040 0x7f0c94197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.731+0000 7f0c93e00700 1 -- 172.21.15.23:0/1585211428 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c880095f0 con 0x7f0c941012e0 2024-02-28T16:29:23.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.731+0000 7f0c93e00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c941012e0 0x7f0c94197f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400d8d0 tx=0x7f0c8400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:23.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.731+0000 7f0c91600700 1 -- 172.21.15.23:0/1585211428 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c84009940 con 0x7f0c941012e0 2024-02-28T16:29:23.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.731+0000 7f0c91600700 1 -- 172.21.15.23:0/1585211428 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0c84010460 con 0x7f0c941012e0 2024-02-28T16:29:23.721 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.731+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9419d150 con 0x7f0c941012e0 2024-02-28T16:29:23.721 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.731+0000 7f0c91600700 1 -- 172.21.15.23:0/1585211428 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c8400f5f0 con 0x7f0c941012e0 2024-02-28T16:29:23.721 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.731+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9419d6a0 con 0x7f0c941012e0 2024-02-28T16:29:23.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.733+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c94108b20 con 0x7f0c941012e0 2024-02-28T16:29:23.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.734+0000 7f0c91600700 1 -- 172.21.15.23:0/1585211428 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0c840105d0 con 0x7f0c941012e0 2024-02-28T16:29:23.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.735+0000 7f0c91600700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0c7c06d8a0 0x7f0c7c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:23.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.736+0000 7f0c91600700 1 -- 172.21.15.23:0/1585211428 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0c8408d3d0 con 0x7f0c941012e0 2024-02-28T16:29:23.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.736+0000 7f0c98a00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0c7c06d8a0 0x7f0c7c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:23.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.737+0000 7f0c98a00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0c7c06d8a0 0x7f0c7c06fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c88005b40 tx=0x7f0c88005a90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:23.729 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.740+0000 7f0c91600700 1 -- 172.21.15.23:0/1585211428 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0c8405a780 con 0x7f0c941012e0 2024-02-28T16:29:23.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.988+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c94074470 con 0x7f0c7c06d8a0 2024-02-28T16:29:23.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.990+0000 7f0c91600700 1 -- 172.21.15.23:0/1585211428 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0c94074470 con 0x7f0c7c06d8a0 2024-02-28T16:29:23.979 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "9/23 daemons upgraded", 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:29:23.980 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0c7c06d8a0 msgr2=0x7f0c7c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0c7c06d8a0 0x7f0c7c06fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c88005b40 tx=0x7f0c88005a90 comp rx=0 tx=0).stop 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c941012e0 msgr2=0x7f0c94197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c941012e0 0x7f0c94197f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400d8d0 tx=0x7f0c8400dc90 comp rx=0 tx=0).stop 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 shutdown_connections 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c94100040 0x7f0c94197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0c7c06d8a0 0x7f0c7c06fd50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 --2- 172.21.15.23:0/1585211428 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0c941012e0 0x7f0c94197f40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.993+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 >> 172.21.15.23:0/1585211428 conn(0x7f0c940fb6b0 msgr2=0x7f0c940fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.994+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 shutdown_connections 2024-02-28T16:29:23.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:23.994+0000 7f0c99e00700 1 -- 172.21.15.23:0/1585211428 wait complete. 2024-02-28T16:29:24.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 -- 172.21.15.23:0/3099551256 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c106840 msgr2=0x7f902c106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:24.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 --2- 172.21.15.23:0/3099551256 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c106840 0x7f902c106c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f901c009910 tx=0x7f901c009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:24.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 -- 172.21.15.23:0/3099551256 shutdown_connections 2024-02-28T16:29:24.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 --2- 172.21.15.23:0/3099551256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c107a40 0x7f902c107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:24.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 --2- 172.21.15.23:0/3099551256 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c106840 0x7f902c106c50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:24.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 -- 172.21.15.23:0/3099551256 >> 172.21.15.23:0/3099551256 conn(0x7f902c075970 msgr2=0x7f902c077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:24.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 -- 172.21.15.23:0/3099551256 shutdown_connections 2024-02-28T16:29:24.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.159+0000 7f9030c00700 1 -- 172.21.15.23:0/3099551256 wait complete. 2024-02-28T16:29:24.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.160+0000 7f9030c00700 1 Processor -- start 2024-02-28T16:29:24.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.161+0000 7f9030c00700 1 -- start start 2024-02-28T16:29:24.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.161+0000 7f9030c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c106840 0x7f902c19c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:24.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.161+0000 7f9030c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c107a40 0x7f902c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:24.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.161+0000 7f9030c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c19cd10 con 0x7f902c107a40 2024-02-28T16:29:24.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.161+0000 7f9030c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c19ce50 con 0x7f902c106840 2024-02-28T16:29:24.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9021400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c107a40 0x7f902c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:24.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9021400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c107a40 0x7f902c19c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:44258/0 (socket says 172.21.15.23:44258) 2024-02-28T16:29:24.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9021400700 1 -- 172.21.15.23:0/393169802 learned_addr learned my addr 172.21.15.23:0/393169802 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:24.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9029e00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c106840 0x7f902c19c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:24.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9021400700 1 -- 172.21.15.23:0/393169802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c106840 msgr2=0x7f902c19c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:24.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9021400700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c106840 0x7f902c19c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:24.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9021400700 1 -- 172.21.15.23:0/393169802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0095f0 con 0x7f902c107a40 2024-02-28T16:29:24.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.162+0000 7f9021400700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c107a40 0x7f902c19c6f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f901400b4b0 tx=0x7f901400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:24.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.163+0000 7f9023400700 1 -- 172.21.15.23:0/393169802 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9014011800 con 0x7f902c107a40 2024-02-28T16:29:24.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.163+0000 7f9023400700 1 -- 172.21.15.23:0/393169802 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9014011e10 con 0x7f902c107a40 2024-02-28T16:29:24.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.163+0000 7f9023400700 1 -- 172.21.15.23:0/393169802 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901400f2e0 con 0x7f902c107a40 2024-02-28T16:29:24.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.163+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c1a1900 con 0x7f902c107a40 2024-02-28T16:29:24.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.163+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c1a1e50 con 0x7f902c107a40 2024-02-28T16:29:24.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.164+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c10f410 con 0x7f902c107a40 2024-02-28T16:29:24.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.165+0000 7f9023400700 1 -- 172.21.15.23:0/393169802 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9014010380 con 0x7f902c107a40 2024-02-28T16:29:24.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.167+0000 7f9023400700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f900c06d8a0 0x7f900c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:24.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.167+0000 7f9023400700 1 -- 172.21.15.23:0/393169802 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f901408d0c0 con 0x7f902c107a40 2024-02-28T16:29:24.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.167+0000 7f9029e00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f900c06d8a0 0x7f900c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:24.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.168+0000 7f9029e00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f900c06d8a0 0x7f900c06fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f901c006010 tx=0x7f901c00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:24.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.172+0000 7f9023400700 1 -- 172.21.15.23:0/393169802 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f901405a3d0 con 0x7f902c107a40 2024-02-28T16:29:24.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.492+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f902c10f5d0 con 0x7f902c107a40 2024-02-28T16:29:24.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.493+0000 7f9023400700 1 -- 172.21.15.23:0/393169802 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9014056030 con 0x7f902c107a40 2024-02-28T16:29:24.482 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:29:24.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.495+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f900c06d8a0 msgr2=0x7f900c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:24.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.495+0000 7f9030c00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f900c06d8a0 0x7f900c06fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f901c006010 tx=0x7f901c00b540 comp rx=0 tx=0).stop 2024-02-28T16:29:24.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.495+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c107a40 msgr2=0x7f902c19c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:24.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.495+0000 7f9030c00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c107a40 0x7f902c19c6f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f901400b4b0 tx=0x7f901400b870 comp rx=0 tx=0).stop 2024-02-28T16:29:24.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.496+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 shutdown_connections 2024-02-28T16:29:24.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.496+0000 7f9030c00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c106840 0x7f902c19c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:24.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.496+0000 7f9030c00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f900c06d8a0 0x7f900c06fd50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:24.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.496+0000 7f9030c00700 1 --2- 172.21.15.23:0/393169802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f902c107a40 0x7f902c19c6f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:24.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.496+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 >> 172.21.15.23:0/393169802 conn(0x7f902c075970 msgr2=0x7f902c10ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:24.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.496+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 shutdown_connections 2024-02-28T16:29:24.485 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:24.496+0000 7f9030c00700 1 -- 172.21.15.23:0/393169802 wait complete. 2024-02-28T16:29:24.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:24 smithi153 ceph-mon[66339]: pgmap v124: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:24.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:24 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/35833134' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:29:24.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:24 smithi153 ceph-mon[66339]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:24.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:24 smithi023 ceph-mon[78509]: pgmap v124: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:24.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:24 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/35833134' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:29:24.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:24 smithi023 ceph-mon[78509]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:25.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:25 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/393169802' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:29:25.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:25 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/393169802' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:29:26.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:26 smithi153 ceph-mon[66339]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:26.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:26 smithi023 ceph-mon[78509]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:28.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:28 smithi153 ceph-mon[66339]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:28.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:28 smithi023 ceph-mon[78509]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:29.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:29 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:29.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:29 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:30.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:30 smithi153 ceph-mon[66339]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:30.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:30 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:30.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:30 smithi153 ceph-mon[66339]: Upgrade: osd.3 is safe to restart 2024-02-28T16:29:30.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:30 smithi023 ceph-mon[78509]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:30.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:30 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:29:30.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:30 smithi023 ceph-mon[78509]: Upgrade: osd.3 is safe to restart 2024-02-28T16:29:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:32 smithi023 ceph-mon[78509]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:32 smithi023 ceph-mon[78509]: Upgrade: Updating osd.3 2024-02-28T16:29:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:32.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:29:32.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:32.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:32 smithi023 ceph-mon[78509]: Deploying daemon osd.3 on smithi153 2024-02-28T16:29:32.890 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:32 smithi153 ceph-mon[66339]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:32.890 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:32 smithi153 ceph-mon[66339]: Upgrade: Updating osd.3 2024-02-28T16:29:32.890 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:32.890 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:29:32.890 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:32.890 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:32 smithi153 ceph-mon[66339]: Deploying daemon osd.3 on smithi153 2024-02-28T16:29:34.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:34 smithi153 ceph-mon[66339]: pgmap v129: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:34.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:34 smithi023 ceph-mon[78509]: pgmap v129: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:36.645 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:36 smithi153 systemd[1]: Stopping Ceph osd.3 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:29:36.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:36 smithi153 ceph-mon[66339]: pgmap v130: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:36.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:36.896 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:36 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[41301]: 2024-02-28T16:29:36.655+0000 7fe57b200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:29:36.896 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:36 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[41301]: 2024-02-28T16:29:36.655+0000 7fe57b200700 -1 osd.3 65 *** Got signal Terminated *** 2024-02-28T16:29:36.896 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:36 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[41301]: 2024-02-28T16:29:36.655+0000 7fe57b200700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:29:36.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:36 smithi023 ceph-mon[78509]: pgmap v130: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:36.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:37.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:37 smithi023 ceph-mon[78509]: osd.3 marked itself down and dead 2024-02-28T16:29:38.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:37 smithi153 ceph-mon[66339]: osd.3 marked itself down and dead 2024-02-28T16:29:38.624 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:38 smithi153 podman[71002]: 2024-02-28 16:29:38.291958741 +0000 UTC m=+1.764313850 container died 893a3ab66c2778b198ed2b85c8651fc6742fc3b913e35dc79e972f0fddf17880 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-28T16:29:38.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:38 smithi153 ceph-mon[66339]: pgmap v131: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:38.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:38 smithi153 ceph-mon[66339]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:29:38.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:38 smithi153 ceph-mon[66339]: osdmap e66: 6 total, 5 up, 6 in 2024-02-28T16:29:38.895 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:38 smithi153 podman[71002]: 2024-02-28 16:29:38.815702292 +0000 UTC m=+2.288057431 container cleanup 893a3ab66c2778b198ed2b85c8651fc6742fc3b913e35dc79e972f0fddf17880 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=HEAD) 2024-02-28T16:29:38.895 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:38 smithi153 bash[71002]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3 2024-02-28T16:29:38.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:38 smithi023 ceph-mon[78509]: pgmap v131: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:29:38.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:38 smithi023 ceph-mon[78509]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:29:38.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:38 smithi023 ceph-mon[78509]: osdmap e66: 6 total, 5 up, 6 in 2024-02-28T16:29:39.395 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:39 smithi153 podman[71022]: 2024-02-28 16:29:39.0750293 +0000 UTC m=+0.763382239 container remove 893a3ab66c2778b198ed2b85c8651fc6742fc3b913e35dc79e972f0fddf17880 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2) 2024-02-28T16:29:39.934 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:39 smithi153 ceph-mon[66339]: osdmap e67: 6 total, 5 up, 6 in 2024-02-28T16:29:40.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:39 smithi023 ceph-mon[78509]: osdmap e67: 6 total, 5 up, 6 in 2024-02-28T16:29:40.198 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:39 smithi153 podman[71110]: 2024-02-28 16:29:39.850684783 +0000 UTC m=+0.033359667 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:29:40.198 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:39 smithi153 podman[71110]: 2024-02-28 16:29:39.951053736 +0000 UTC m=+0.133728677 container create 19aedd77f4f6efef05a696769eea26dd6141aaa8d6213fe613b5416d593f980d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:29:40.198 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:40 smithi153 podman[71110]: 2024-02-28 16:29:40.196188469 +0000 UTC m=+0.378863396 container init 19aedd77f4f6efef05a696769eea26dd6141aaa8d6213fe613b5416d593f980d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:29:40.198 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:40 smithi153 podman[71110]: 2024-02-28 16:29:40.207717135 +0000 UTC m=+0.390392063 container start 19aedd77f4f6efef05a696769eea26dd6141aaa8d6213fe613b5416d593f980d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-28T16:29:40.630 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:40 smithi153 podman[71110]: 2024-02-28 16:29:40.320186566 +0000 UTC m=+0.502861540 container attach 19aedd77f4f6efef05a696769eea26dd6141aaa8d6213fe613b5416d593f980d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-02-28T16:29:40.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:40 smithi153 ceph-mon[66339]: pgmap v134: 65 pgs: 5 active+undersized+degraded, 7 peering, 11 stale+active+clean, 4 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/228 objects degraded (6.140%) 2024-02-28T16:29:40.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:40 smithi153 ceph-mon[66339]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:29:40.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:40 smithi153 ceph-mon[66339]: Health check failed: Degraded data redundancy: 14/228 objects degraded (6.140%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:40.896 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:40 smithi153 podman[71110]: 2024-02-28 16:29:40.642047723 +0000 UTC m=+0.824722674 container died 19aedd77f4f6efef05a696769eea26dd6141aaa8d6213fe613b5416d593f980d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:29:41.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:40 smithi023 ceph-mon[78509]: pgmap v134: 65 pgs: 5 active+undersized+degraded, 7 peering, 11 stale+active+clean, 4 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/228 objects degraded (6.140%) 2024-02-28T16:29:41.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:40 smithi023 ceph-mon[78509]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:29:41.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:40 smithi023 ceph-mon[78509]: Health check failed: Degraded data redundancy: 14/228 objects degraded (6.140%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:41.895 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:41 smithi153 podman[71135]: 2024-02-28 16:29:41.615222664 +0000 UTC m=+0.955769763 container remove 19aedd77f4f6efef05a696769eea26dd6141aaa8d6213fe613b5416d593f980d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:29:41.895 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:41 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-28T16:29:41.896 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:41 smithi153 systemd[1]: Stopped Ceph osd.3 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:29:41.896 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:41 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.3.service: Consumed 2min 33.475s CPU time. 2024-02-28T16:29:42.349 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:42 smithi153 systemd[1]: Starting Ceph osd.3 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:29:42.617 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:42 smithi153 podman[71236]: 2024-02-28 16:29:42.267029049 +0000 UTC m=+0.035656278 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:29:42.617 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:42 smithi153 podman[71236]: 2024-02-28 16:29:42.382774994 +0000 UTC m=+0.151402259 container create 3728c6f3077ebf57407ae6b623e4d47886fbd0b4f879be679905441c146988e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-02-28T16:29:42.618 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:42 smithi153 podman[71236]: 2024-02-28 16:29:42.628618925 +0000 UTC m=+0.397246214 container init 3728c6f3077ebf57407ae6b623e4d47886fbd0b4f879be679905441c146988e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:29:42.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:42 smithi153 ceph-mon[66339]: pgmap v135: 65 pgs: 5 active+undersized+degraded, 7 peering, 11 stale+active+clean, 4 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/228 objects degraded (6.140%) 2024-02-28T16:29:42.895 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:42 smithi153 podman[71236]: 2024-02-28 16:29:42.641452288 +0000 UTC m=+0.410079540 container start 3728c6f3077ebf57407ae6b623e4d47886fbd0b4f879be679905441c146988e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-02-28T16:29:42.895 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:42 smithi153 podman[71236]: 2024-02-28 16:29:42.743772139 +0000 UTC m=+0.512399427 container attach 3728c6f3077ebf57407ae6b623e4d47886fbd0b4f879be679905441c146988e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-28T16:29:43.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:42 smithi023 ceph-mon[78509]: pgmap v135: 65 pgs: 5 active+undersized+degraded, 7 peering, 11 stale+active+clean, 4 active+undersized, 38 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/228 objects degraded (6.140%) 2024-02-28T16:29:43.758 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate[71251]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:29:43.758 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate[71251]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:29:43.758 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 bash[71236]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:29:43.758 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 bash[71236]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:29:43.758 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 bash[71236]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 bash[71236]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 bash[71236]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 bash[71236]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 bash[71236]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate[71251]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate[71251]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate[71251]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate[71251]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate[71251]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T16:29:43.759 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:43 smithi153 podman[71236]: 2024-02-28 16:29:43.580368738 +0000 UTC m=+1.348996030 container died 3728c6f3077ebf57407ae6b623e4d47886fbd0b4f879be679905441c146988e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-28T16:29:44.615 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:44 smithi153 podman[71381]: 2024-02-28 16:29:44.263963231 +0000 UTC m=+0.663092492 container remove 3728c6f3077ebf57407ae6b623e4d47886fbd0b4f879be679905441c146988e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-activate, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:29:44.889 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:44 smithi153 ceph-mon[66339]: pgmap v136: 65 pgs: 15 active+undersized+degraded, 7 peering, 16 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/228 objects degraded (20.614%) 2024-02-28T16:29:44.890 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:44 smithi153 podman[71441]: 2024-02-28 16:29:44.532745147 +0000 UTC m=+0.034918005 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:29:44.890 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:44 smithi153 podman[71441]: 2024-02-28 16:29:44.656513891 +0000 UTC m=+0.158686786 container create 96b9690273293a345980dbf2f87929404380ddae10a4071f69485a5ccab58d31 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-28T16:29:44.890 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:44 smithi153 podman[71441]: 2024-02-28 16:29:44.901534365 +0000 UTC m=+0.403707304 container init 96b9690273293a345980dbf2f87929404380ddae10a4071f69485a5ccab58d31 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:29:45.145 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:44 smithi153 podman[71441]: 2024-02-28 16:29:44.913631002 +0000 UTC m=+0.415803870 container start 96b9690273293a345980dbf2f87929404380ddae10a4071f69485a5ccab58d31 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-28T16:29:45.145 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:44 smithi153 ceph-osd[71460]: -- 172.21.15.153:0/2192152232 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5624a64fd680 con 0x5624a64c6c00 2024-02-28T16:29:45.145 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:44 smithi153 bash[71441]: 96b9690273293a345980dbf2f87929404380ddae10a4071f69485a5ccab58d31 2024-02-28T16:29:45.146 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:45 smithi153 systemd[1]: Started Ceph osd.3 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:29:45.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:44 smithi023 ceph-mon[78509]: pgmap v136: 65 pgs: 15 active+undersized+degraded, 7 peering, 16 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/228 objects degraded (20.614%) 2024-02-28T16:29:45.645 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:45 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:29:45.499+0000 7f7c066247c0 -1 Falling back to public interface 2024-02-28T16:29:46.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:46.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:46.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:46.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:46 smithi153 ceph-mon[66339]: pgmap v137: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:46.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:46.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:46.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:46.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:46 smithi023 ceph-mon[78509]: pgmap v137: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:47.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:47 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:47.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:47 smithi153 ceph-mon[66339]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:29:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:47 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:47 smithi023 ceph-mon[78509]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:29:48.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:48 smithi023 ceph-mon[78509]: pgmap v138: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:48.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:48 smithi153 ceph-mon[66339]: pgmap v138: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:50.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:50 smithi153 ceph-mon[66339]: pgmap v139: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:50.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:50.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:50 smithi023 ceph-mon[78509]: pgmap v139: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:51.645 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:51 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:29:51.280+0000 7f7c066247c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-28T16:29:52.317 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:51 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:29:51.949+0000 7f7c066247c0 -1 osd.3 65 log_to_monitors true 2024-02-28T16:29:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:52 smithi153 ceph-mon[66339]: pgmap v140: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:52 smithi153 ceph-mon[66339]: from='osd.3 [v2:172.21.15.153:6800/487138192,v1:172.21.15.153:6801/487138192]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:29:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:52 smithi153 ceph-mon[66339]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:29:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:52 smithi023 ceph-mon[78509]: pgmap v140: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:52 smithi023 ceph-mon[78509]: from='osd.3 [v2:172.21.15.153:6800/487138192,v1:172.21.15.153:6801/487138192]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:29:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:52 smithi023 ceph-mon[78509]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:29:54.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:53 smithi153 ceph-mon[66339]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:29:54.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:53 smithi153 ceph-mon[66339]: osdmap e68: 6 total, 5 up, 6 in 2024-02-28T16:29:54.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:53 smithi153 ceph-mon[66339]: from='osd.3 [v2:172.21.15.153:6800/487138192,v1:172.21.15.153:6801/487138192]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:29:54.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:53 smithi153 ceph-mon[66339]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:29:54.146 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:29:53 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:29:53.890+0000 7f7bf0a00700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:29:54.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:53 smithi023 ceph-mon[78509]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:29:54.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:53 smithi023 ceph-mon[78509]: osdmap e68: 6 total, 5 up, 6 in 2024-02-28T16:29:54.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:53 smithi023 ceph-mon[78509]: from='osd.3 [v2:172.21.15.153:6800/487138192,v1:172.21.15.153:6801/487138192]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:29:54.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:53 smithi023 ceph-mon[78509]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:29:54.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.669+0000 7f465e000700 1 -- 172.21.15.23:0/1109315559 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658101440 msgr2=0x7f4658101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:54.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.669+0000 7f465e000700 1 --2- 172.21.15.23:0/1109315559 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658101440 0x7f4658101890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4640009910 tx=0x7f4640009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:54.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.669+0000 7f465e000700 1 -- 172.21.15.23:0/1109315559 shutdown_connections 2024-02-28T16:29:54.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.669+0000 7f465e000700 1 --2- 172.21.15.23:0/1109315559 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658101440 0x7f4658101890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:54.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.669+0000 7f465e000700 1 --2- 172.21.15.23:0/1109315559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4658100240 0x7f4658100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:54.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.669+0000 7f465e000700 1 -- 172.21.15.23:0/1109315559 >> 172.21.15.23:0/1109315559 conn(0x7f46580fb7f0 msgr2=0x7f46580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:54.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.669+0000 7f465e000700 1 -- 172.21.15.23:0/1109315559 shutdown_connections 2024-02-28T16:29:54.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.670+0000 7f465e000700 1 -- 172.21.15.23:0/1109315559 wait complete. 2024-02-28T16:29:54.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.671+0000 7f465e000700 1 Processor -- start 2024-02-28T16:29:54.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.671+0000 7f465e000700 1 -- start start 2024-02-28T16:29:54.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.671+0000 7f465e000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658100240 0x7f4658197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:54.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.671+0000 7f465e000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4658101440 0x7f46581981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:54.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.671+0000 7f465e000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46581987b0 con 0x7f4658100240 2024-02-28T16:29:54.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.671+0000 7f465e000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4658198920 con 0x7f4658101440 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f4657400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658100240 0x7f4658197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f4657400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658100240 0x7f4658197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59778/0 (socket says 172.21.15.23:59778) 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f4657400700 1 -- 172.21.15.23:0/1756867474 learned_addr learned my addr 172.21.15.23:0/1756867474 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f464ea00700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4658101440 0x7f46581981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f4657400700 1 -- 172.21.15.23:0/1756867474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4658101440 msgr2=0x7f46581981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f4657400700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4658101440 0x7f46581981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f4657400700 1 -- 172.21.15.23:0/1756867474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400095f0 con 0x7f4658100240 2024-02-28T16:29:54.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.672+0000 7f464ea00700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4658101440 0x7f46581981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:29:54.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.673+0000 7f4657400700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658100240 0x7f4658197c70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f464800d900 tx=0x7f464800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:54.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.673+0000 7f4654c00700 1 -- 172.21.15.23:0/1756867474 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46480041f0 con 0x7f4658100240 2024-02-28T16:29:54.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.673+0000 7f4654c00700 1 -- 172.21.15.23:0/1756867474 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4648004350 con 0x7f4658100240 2024-02-28T16:29:54.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.673+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465819d3b0 con 0x7f4658100240 2024-02-28T16:29:54.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.673+0000 7f4654c00700 1 -- 172.21.15.23:0/1756867474 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4648003da0 con 0x7f4658100240 2024-02-28T16:29:54.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.673+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465819d900 con 0x7f4658100240 2024-02-28T16:29:54.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.675+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4658105520 con 0x7f4658100240 2024-02-28T16:29:54.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.675+0000 7f4654c00700 1 -- 172.21.15.23:0/1756867474 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f4648009730 con 0x7f4658100240 2024-02-28T16:29:54.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.676+0000 7f4654c00700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f463c06d8a0 0x7f463c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:54.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.676+0000 7f4654c00700 1 -- 172.21.15.23:0/1756867474 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f464808d630 con 0x7f4658100240 2024-02-28T16:29:54.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.677+0000 7f464ea00700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f463c06d8a0 0x7f463c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:54.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.677+0000 7f464ea00700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f463c06d8a0 0x7f463c06fd50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4658199180 tx=0x7f464000b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:54.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.682+0000 7f4654c00700 1 -- 172.21.15.23:0/1756867474 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4648056e30 con 0x7f4658100240 2024-02-28T16:29:54.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:54 smithi023 ceph-mon[78509]: pgmap v142: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:54.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:54 smithi023 ceph-mon[78509]: from='osd.3 ' entity='osd.3' 2024-02-28T16:29:54.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.957+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4658061190 con 0x7f463c06d8a0 2024-02-28T16:29:54.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.959+0000 7f4654c00700 1 -- 172.21.15.23:0/1756867474 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4658061190 con 0x7f463c06d8a0 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.961+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f463c06d8a0 msgr2=0x7f463c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.961+0000 7f465e000700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f463c06d8a0 0x7f463c06fd50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4658199180 tx=0x7f464000b560 comp rx=0 tx=0).stop 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.961+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658100240 msgr2=0x7f4658197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.961+0000 7f465e000700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658100240 0x7f4658197c70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f464800d900 tx=0x7f464800dcc0 comp rx=0 tx=0).stop 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.962+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 shutdown_connections 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.962+0000 7f465e000700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f463c06d8a0 0x7f463c06fd50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.962+0000 7f465e000700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4658100240 0x7f4658197c70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.962+0000 7f465e000700 1 --2- 172.21.15.23:0/1756867474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4658101440 0x7f46581981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.962+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 >> 172.21.15.23:0/1756867474 conn(0x7f46580fb7f0 msgr2=0x7f4658102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.962+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 shutdown_connections 2024-02-28T16:29:54.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:54.962+0000 7f465e000700 1 -- 172.21.15.23:0/1756867474 wait complete. 2024-02-28T16:29:54.967 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:29:55.112 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 -- 172.21.15.23:0/84638529 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 msgr2=0x7fb654100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 --2- 172.21.15.23:0/84638529 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654100650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb64400b0a0 tx=0x7fb64400b3b0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 -- 172.21.15.23:0/84638529 shutdown_connections 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 --2- 172.21.15.23:0/84638529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654101440 0x7fb654101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 --2- 172.21.15.23:0/84638529 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654100650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 -- 172.21.15.23:0/84638529 >> 172.21.15.23:0/84638529 conn(0x7fb6540fb7f0 msgr2=0x7fb6540fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 -- 172.21.15.23:0/84638529 shutdown_connections 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.123+0000 7fb659a00700 1 -- 172.21.15.23:0/84638529 wait complete. 2024-02-28T16:29:55.113 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.125+0000 7fb659a00700 1 Processor -- start 2024-02-28T16:29:55.114 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.125+0000 7fb659a00700 1 -- start start 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.125+0000 7fb659a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.125+0000 7fb659a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654101440 0x7fb654198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.125+0000 7fb659a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541987f0 con 0x7fb654100240 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.125+0000 7fb659a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb654198960 con 0x7fb654101440 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.125+0000 7fb652a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb652a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59796/0 (socket says 172.21.15.23:59796) 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb652a00700 1 -- 172.21.15.23:0/3668638016 learned_addr learned my addr 172.21.15.23:0/3668638016 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb643e00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654101440 0x7fb654198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb652a00700 1 -- 172.21.15.23:0/3668638016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654101440 msgr2=0x7fb654198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb652a00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654101440 0x7fb654198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb652a00700 1 -- 172.21.15.23:0/3668638016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644009d00 con 0x7fb654100240 2024-02-28T16:29:55.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb643e00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654101440 0x7fb654198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:29:55.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.126+0000 7fb652a00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654197d20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb644015040 tx=0x7fb644003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:55.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.127+0000 7fb64be00700 1 -- 172.21.15.23:0/3668638016 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb64400e040 con 0x7fb654100240 2024-02-28T16:29:55.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.127+0000 7fb64be00700 1 -- 172.21.15.23:0/3668638016 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb64400ce60 con 0x7fb654100240 2024-02-28T16:29:55.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.127+0000 7fb64be00700 1 -- 172.21.15.23:0/3668638016 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb64401da20 con 0x7fb654100240 2024-02-28T16:29:55.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.127+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65419d350 con 0x7fb654100240 2024-02-28T16:29:55.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.127+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65419d840 con 0x7fb654100240 2024-02-28T16:29:55.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.128+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb654105520 con 0x7fb654100240 2024-02-28T16:29:55.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.129+0000 7fb64be00700 1 -- 172.21.15.23:0/3668638016 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb644004250 con 0x7fb654100240 2024-02-28T16:29:55.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.130+0000 7fb64be00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb63406d8a0 0x7fb63406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.131+0000 7fb64be00700 1 -- 172.21.15.23:0/3668638016 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb64408f1b0 con 0x7fb654100240 2024-02-28T16:29:55.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.131+0000 7fb643e00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb63406d8a0 0x7fb63406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.131+0000 7fb643e00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb63406d8a0 0x7fb63406fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005fd0 tx=0x7fb63c005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:55.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.135+0000 7fb64be00700 1 -- 172.21.15.23:0/3668638016 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb644058990 con 0x7fb654100240 2024-02-28T16:29:55.319 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:54 smithi153 ceph-mon[66339]: pgmap v142: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:55.319 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:54 smithi153 ceph-mon[66339]: from='osd.3 ' entity='osd.3' 2024-02-28T16:29:55.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.385+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb654061190 con 0x7fb63406d8a0 2024-02-28T16:29:55.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.387+0000 7fb64be00700 1 -- 172.21.15.23:0/3668638016 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb654061190 con 0x7fb63406d8a0 2024-02-28T16:29:55.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb63406d8a0 msgr2=0x7fb63406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb63406d8a0 0x7fb63406fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005fd0 tx=0x7fb63c005e20 comp rx=0 tx=0).stop 2024-02-28T16:29:55.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 msgr2=0x7fb654197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654197d20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb644015040 tx=0x7fb644003ce0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 shutdown_connections 2024-02-28T16:29:55.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb63406d8a0 0x7fb63406fd50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb654100240 0x7fb654197d20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 --2- 172.21.15.23:0/3668638016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654101440 0x7fb654198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 >> 172.21.15.23:0/3668638016 conn(0x7fb6540fb7f0 msgr2=0x7fb654102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:55.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.390+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 shutdown_connections 2024-02-28T16:29:55.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.391+0000 7fb659a00700 1 -- 172.21.15.23:0/3668638016 wait complete. 2024-02-28T16:29:55.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 -- 172.21.15.23:0/3758297367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0107a40 msgr2=0x7fa3e0107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/3758297367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0107a40 0x7fa3e0107e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009910 tx=0x7fa3cc009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:55.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 -- 172.21.15.23:0/3758297367 shutdown_connections 2024-02-28T16:29:55.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/3758297367 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0107a40 0x7fa3e0107e90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/3758297367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e0106840 0x7fa3e0106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 -- 172.21.15.23:0/3758297367 >> 172.21.15.23:0/3758297367 conn(0x7fa3e0075970 msgr2=0x7fa3e0077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:55.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 -- 172.21.15.23:0/3758297367 shutdown_connections 2024-02-28T16:29:55.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.555+0000 7fa3e6c00700 1 -- 172.21.15.23:0/3758297367 wait complete. 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.556+0000 7fa3e6c00700 1 Processor -- start 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.556+0000 7fa3e6c00700 1 -- start start 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.557+0000 7fa3e6c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0106840 0x7fa3e019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.557+0000 7fa3e6c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e0107a40 0x7fa3e019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.557+0000 7fa3e6c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e019cc40 con 0x7fa3e0106840 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.557+0000 7fa3e6c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e019cd80 con 0x7fa3e0107a40 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.557+0000 7fa3dfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0106840 0x7fa3e019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.557+0000 7fa3dfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0106840 0x7fa3e019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59816/0 (socket says 172.21.15.23:59816) 2024-02-28T16:29:55.547 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.557+0000 7fa3dfe00700 1 -- 172.21.15.23:0/1733223069 learned_addr learned my addr 172.21.15.23:0/1733223069 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3df400700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e0107a40 0x7fa3e019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3dfe00700 1 -- 172.21.15.23:0/1733223069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e0107a40 msgr2=0x7fa3e019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3dfe00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e0107a40 0x7fa3e019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3dfe00700 1 -- 172.21.15.23:0/1733223069 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0095f0 con 0x7fa3e0106840 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3dfe00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0106840 0x7fa3e019c0e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000c8f0 tx=0x7fa3d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3dcc00700 1 -- 172.21.15.23:0/1733223069 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d0007a70 con 0x7fa3e0106840 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3dcc00700 1 -- 172.21.15.23:0/1733223069 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3d0007bd0 con 0x7fa3e0106840 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e01a1830 con 0x7fa3e0106840 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.558+0000 7fa3dcc00700 1 -- 172.21.15.23:0/1733223069 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d0018630 con 0x7fa3e0106840 2024-02-28T16:29:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.559+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e01a1d80 con 0x7fa3e0106840 2024-02-28T16:29:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.560+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e010f390 con 0x7fa3e0106840 2024-02-28T16:29:55.550 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.561+0000 7fa3dcc00700 1 -- 172.21.15.23:0/1733223069 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa3d000f450 con 0x7fa3e0106840 2024-02-28T16:29:55.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.562+0000 7fa3dcc00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa3c406d8a0 0x7fa3c406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.562+0000 7fa3dcc00700 1 -- 172.21.15.23:0/1733223069 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa3d008d5a0 con 0x7fa3e0106840 2024-02-28T16:29:55.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.563+0000 7fa3df400700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa3c406d8a0 0x7fa3c406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.563+0000 7fa3df400700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa3c406d8a0 0x7fa3c406fd50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc006010 tx=0x7fa3cc00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:55.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.566+0000 7fa3dcc00700 1 -- 172.21.15.23:0/1733223069 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa3d005a930 con 0x7fa3e0106840 2024-02-28T16:29:55.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.807+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3e010c390 con 0x7fa3c406d8a0 2024-02-28T16:29:55.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.824+0000 7fa3dcc00700 1 -- 172.21.15.23:0/1733223069 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa3e010c390 con 0x7fa3c406d8a0 2024-02-28T16:29:55.813 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:29:55.813 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (14m) 48s ago 16m 14.2M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:29:55.813 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (17m) 48s ago 17m 8610k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:29:55.813 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (15m) 6s ago 15m 7926k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:29:55.813 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (2m) 48s ago 17m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (2m) 6s ago 15m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (14m) 48s ago 16m 74.5M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (9m) 48s ago 9m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (9m) 48s ago 9m 16.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (9m) 6s ago 9m 16.7M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (9m) 6s ago 9m 16.9M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (6m) 48s ago 18m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (4m) 6s ago 15m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (4m) 48s ago 18m 46.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (3m) 6s ago 15m 38.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (16m) 48s ago 16m 8010k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (15m) 6s ago 15m 8136k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (114s) 48s ago 14m 89.3M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (84s) 48s ago 13m 98.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:29:55.814 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (56s) 48s ago 13m 11.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:29:55.815 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (11s) 6s ago 12m 11.1M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:29:55.815 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (12m) 6s ago 12m 256M 2241M 18.2.0 dc2bc1663786 6f0332165ee3 2024-02-28T16:29:55.815 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (11m) 6s ago 11m 225M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:29:55.815 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (4m) 48s ago 16m 58.5M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:29:55.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.827+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa3c406d8a0 msgr2=0x7fa3c406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.827+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa3c406d8a0 0x7fa3c406fd50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc006010 tx=0x7fa3cc00b540 comp rx=0 tx=0).stop 2024-02-28T16:29:55.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.827+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0106840 msgr2=0x7fa3e019c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.827+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0106840 0x7fa3e019c0e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000c8f0 tx=0x7fa3d000ccb0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.828+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 shutdown_connections 2024-02-28T16:29:55.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.828+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa3c406d8a0 0x7fa3c406fd50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.828+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa3e0106840 0x7fa3e019c0e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.828+0000 7fa3e6c00700 1 --2- 172.21.15.23:0/1733223069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3e0107a40 0x7fa3e019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.828+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 >> 172.21.15.23:0/1733223069 conn(0x7fa3e0075970 msgr2=0x7fa3e010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:55.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.828+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 shutdown_connections 2024-02-28T16:29:55.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:55.828+0000 7fa3e6c00700 1 -- 172.21.15.23:0/1733223069 wait complete. 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.005+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1053232270 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 msgr2=0x7fd99c102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.005+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1053232270 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c102860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009910 tx=0x7fd98c009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.006+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1053232270 shutdown_connections 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.006+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1053232270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd99c103650 0x7fd99c103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.006+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1053232270 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c102860 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.006+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1053232270 >> 172.21.15.23:0/1053232270 conn(0x7fd99c0fda20 msgr2=0x7fd99c0ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.006+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1053232270 shutdown_connections 2024-02-28T16:29:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.006+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1053232270 wait complete. 2024-02-28T16:29:55.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.007+0000 7fd9a1a00700 1 Processor -- start 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.007+0000 7fd9a1a00700 1 -- start start 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.007+0000 7fd9a1a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.007+0000 7fd9a1a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd99c103650 0x7fd99c198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.007+0000 7fd9a1a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c198840 con 0x7fd99c102450 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.007+0000 7fd9a1a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c19d250 con 0x7fd99c103650 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59838/0 (socket says 172.21.15.23:59838) 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99aa00700 1 -- 172.21.15.23:0/1384363513 learned_addr learned my addr 172.21.15.23:0/1384363513 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:55.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99a000700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd99c103650 0x7fd99c198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99aa00700 1 -- 172.21.15.23:0/1384363513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd99c103650 msgr2=0x7fd99c198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99aa00700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd99c103650 0x7fd99c198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99aa00700 1 -- 172.21.15.23:0/1384363513 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c0095f0 con 0x7fd99c102450 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.008+0000 7fd99aa00700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c197ce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd98c00bd70 tx=0x7fd98c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.009+0000 7fd993400700 1 -- 172.21.15.23:0/1384363513 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd98c01d070 con 0x7fd99c102450 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.009+0000 7fd993400700 1 -- 172.21.15.23:0/1384363513 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd98c00f460 con 0x7fd99c102450 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.009+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99c19d3f0 con 0x7fd99c102450 2024-02-28T16:29:55.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.009+0000 7fd993400700 1 -- 172.21.15.23:0/1384363513 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd98c021620 con 0x7fd99c102450 2024-02-28T16:29:55.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.009+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99c19d8b0 con 0x7fd99c102450 2024-02-28T16:29:55.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.010+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99c10afa0 con 0x7fd99c102450 2024-02-28T16:29:56.000 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.011+0000 7fd993400700 1 -- 172.21.15.23:0/1384363513 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd98c00fa40 con 0x7fd99c102450 2024-02-28T16:29:56.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.012+0000 7fd993400700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd98006d8a0 0x7fd98006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:56.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.012+0000 7fd993400700 1 -- 172.21.15.23:0/1384363513 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd98c08e770 con 0x7fd99c102450 2024-02-28T16:29:56.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.012+0000 7fd99a000700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd98006d8a0 0x7fd98006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:56.002 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.013+0000 7fd99a000700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd98006d8a0 0x7fd98006fd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd988005950 tx=0x7fd9880058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:56.005 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.017+0000 7fd993400700 1 -- 172.21.15.23:0/1384363513 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd98c057f70 con 0x7fd99c102450 2024-02-28T16:29:56.049 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:55 smithi153 ceph-mon[66339]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:29:56.049 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:55 smithi153 ceph-mon[66339]: osd.3 [v2:172.21.15.153:6800/487138192,v1:172.21.15.153:6801/487138192] boot 2024-02-28T16:29:56.049 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:55 smithi153 ceph-mon[66339]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T16:29:56.049 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:55 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:29:56.049 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:55 smithi153 ceph-mon[66339]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:56.049 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:55 smithi153 ceph-mon[66339]: osdmap e70: 6 total, 6 up, 6 in 2024-02-28T16:29:56.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:55 smithi023 ceph-mon[78509]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:29:56.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:55 smithi023 ceph-mon[78509]: osd.3 [v2:172.21.15.153:6800/487138192,v1:172.21.15.153:6801/487138192] boot 2024-02-28T16:29:56.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:55 smithi023 ceph-mon[78509]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T16:29:56.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:55 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:29:56.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:55 smithi023 ceph-mon[78509]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:56.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:55 smithi023 ceph-mon[78509]: osdmap e70: 6 total, 6 up, 6 in 2024-02-28T16:29:56.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.335+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd99c19e2c0 con 0x7fd99c102450 2024-02-28T16:29:56.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.337+0000 7fd993400700 1 -- 172.21.15.23:0/1384363513 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fd98c05b630 con 0x7fd99c102450 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:29:56.326 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 8 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:29:56.327 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:29:56.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd98006d8a0 msgr2=0x7fd98006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd98006d8a0 0x7fd98006fd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd988005950 tx=0x7fd9880058e0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 msgr2=0x7fd99c197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c197ce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd98c00bd70 tx=0x7fd98c00be50 comp rx=0 tx=0).stop 2024-02-28T16:29:56.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 shutdown_connections 2024-02-28T16:29:56.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd98006d8a0 0x7fd98006fd50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd99c102450 0x7fd99c197ce0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 --2- 172.21.15.23:0/1384363513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd99c103650 0x7fd99c198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.339+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 >> 172.21.15.23:0/1384363513 conn(0x7fd99c0fda20 msgr2=0x7fd99c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:56.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.340+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 shutdown_connections 2024-02-28T16:29:56.332 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.340+0000 7fd9a1a00700 1 -- 172.21.15.23:0/1384363513 wait complete. 2024-02-28T16:29:56.487 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 -- 172.21.15.23:0/507893944 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f51641036d0 msgr2=0x7f5164103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.487 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 --2- 172.21.15.23:0/507893944 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f51641036d0 0x7f5164103b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5154009910 tx=0x7f5154009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:56.487 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 -- 172.21.15.23:0/507893944 shutdown_connections 2024-02-28T16:29:56.487 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 --2- 172.21.15.23:0/507893944 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f51641036d0 0x7f5164103b40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.487 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 --2- 172.21.15.23:0/507893944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5164102430 0x7f5164102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 -- 172.21.15.23:0/507893944 >> 172.21.15.23:0/507893944 conn(0x7f51640fda80 msgr2=0x7f51640ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 -- 172.21.15.23:0/507893944 shutdown_connections 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.495+0000 7f516c600700 1 -- 172.21.15.23:0/507893944 wait complete. 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.496+0000 7f516c600700 1 Processor -- start 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.496+0000 7f516c600700 1 -- start start 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.496+0000 7f516c600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5164102430 0x7f5164197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.496+0000 7f516c600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51641036d0 0x7f51641981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:56.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.496+0000 7f516c600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164198740 con 0x7f5164102430 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.496+0000 7f516c600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51641988b0 con 0x7f51641036d0 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5164102430 0x7f5164197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5164102430 0x7f5164197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59858/0 (socket says 172.21.15.23:59858) 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169c00700 1 -- 172.21.15.23:0/3620261260 learned_addr learned my addr 172.21.15.23:0/3620261260 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169200700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51641036d0 0x7f51641981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169c00700 1 -- 172.21.15.23:0/3620261260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51641036d0 msgr2=0x7f51641981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169c00700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51641036d0 0x7f51641981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169c00700 1 -- 172.21.15.23:0/3620261260 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540095f0 con 0x7f5164102430 2024-02-28T16:29:56.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.497+0000 7f5169c00700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5164102430 0x7f5164197c90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f515800c930 tx=0x7f515800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:56.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.498+0000 7f5162000700 1 -- 172.21.15.23:0/3620261260 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5158007ad0 con 0x7f5164102430 2024-02-28T16:29:56.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.498+0000 7f5162000700 1 -- 172.21.15.23:0/3620261260 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5158007c30 con 0x7f5164102430 2024-02-28T16:29:56.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.498+0000 7f5162000700 1 -- 172.21.15.23:0/3620261260 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5158018630 con 0x7f5164102430 2024-02-28T16:29:56.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.498+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516419d350 con 0x7f5164102430 2024-02-28T16:29:56.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.498+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516419d8a0 con 0x7f5164102430 2024-02-28T16:29:56.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.499+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516410af10 con 0x7f5164102430 2024-02-28T16:29:56.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.500+0000 7f5162000700 1 -- 172.21.15.23:0/3620261260 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f515800f450 con 0x7f5164102430 2024-02-28T16:29:56.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.501+0000 7f5162000700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f514c06d8a0 0x7f514c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:56.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.501+0000 7f5162000700 1 -- 172.21.15.23:0/3620261260 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f515808d6c0 con 0x7f5164102430 2024-02-28T16:29:56.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.501+0000 7f5169200700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f514c06d8a0 0x7f514c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:56.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.502+0000 7f5169200700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f514c06d8a0 0x7f514c06fd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51641991a0 tx=0x7f515400b580 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:56.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.506+0000 7f5162000700 1 -- 172.21.15.23:0/3620261260 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5158056ea0 con 0x7f5164102430 2024-02-28T16:29:56.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.783+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f516419e360 con 0x7f5164102430 2024-02-28T16:29:56.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.783+0000 7f5162000700 1 -- 172.21.15.23:0/3620261260 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f515805a560 con 0x7f5164102430 2024-02-28T16:29:56.774 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:29:56.774 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:29:56.774 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:29:56.774 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:29:56.774 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:29:56.775 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:29:56.776 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:56.777 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:56.777 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:56.777 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:29:56.777 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:29:56.777 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:56.777 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:56.777 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f514c06d8a0 msgr2=0x7f514c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f514c06d8a0 0x7f514c06fd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51641991a0 tx=0x7f515400b580 comp rx=0 tx=0).stop 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5164102430 msgr2=0x7f5164197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5164102430 0x7f5164197c90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f515800c930 tx=0x7f515800ccf0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 shutdown_connections 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f514c06d8a0 0x7f514c06fd50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5164102430 0x7f5164197c90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 --2- 172.21.15.23:0/3620261260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51641036d0 0x7f51641981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 >> 172.21.15.23:0/3620261260 conn(0x7f51640fda80 msgr2=0x7f5164106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 shutdown_connections 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.786+0000 7f516c600700 1 -- 172.21.15.23:0/3620261260 wait complete. 2024-02-28T16:29:56.778 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:29:56.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 -- 172.21.15.23:0/1843005529 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 msgr2=0x7fa180100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 --2- 172.21.15.23:0/1843005529 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180100650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa170009910 tx=0x7fa170009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:56.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 -- 172.21.15.23:0/1843005529 shutdown_connections 2024-02-28T16:29:56.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 --2- 172.21.15.23:0/1843005529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa180101440 0x7fa180101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 --2- 172.21.15.23:0/1843005529 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180100650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 -- 172.21.15.23:0/1843005529 >> 172.21.15.23:0/1843005529 conn(0x7fa1800fb7f0 msgr2=0x7fa1800fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:56.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 -- 172.21.15.23:0/1843005529 shutdown_connections 2024-02-28T16:29:56.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.955+0000 7fa184a00700 1 -- 172.21.15.23:0/1843005529 wait complete. 2024-02-28T16:29:56.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.956+0000 7fa184a00700 1 Processor -- start 2024-02-28T16:29:56.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.956+0000 7fa184a00700 1 -- start start 2024-02-28T16:29:56.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa184a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:56.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa184a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa180101440 0x7fa1801960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa184a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1801966c0 con 0x7fa180100240 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa184a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa180196800 con 0x7fa180101440 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa17de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa17de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59864/0 (socket says 172.21.15.23:59864) 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa17de00700 1 -- 172.21.15.23:0/2749759808 learned_addr learned my addr 172.21.15.23:0/2749759808 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.957+0000 7fa17d400700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa180101440 0x7fa1801960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa17de00700 1 -- 172.21.15.23:0/2749759808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa180101440 msgr2=0x7fa1801960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa17de00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa180101440 0x7fa1801960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:56.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa17de00700 1 -- 172.21.15.23:0/2749759808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700095f0 con 0x7fa180100240 2024-02-28T16:29:56.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa17de00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180195b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa17000bd70 tx=0x7fa17000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:56.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa176a00700 1 -- 172.21.15.23:0/2749759808 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa17001d070 con 0x7fa180100240 2024-02-28T16:29:56.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa176a00700 1 -- 172.21.15.23:0/2749759808 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa17000f460 con 0x7fa180100240 2024-02-28T16:29:56.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18019b250 con 0x7fa180100240 2024-02-28T16:29:56.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa176a00700 1 -- 172.21.15.23:0/2749759808 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa170021640 con 0x7fa180100240 2024-02-28T16:29:56.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.958+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18019b740 con 0x7fa180100240 2024-02-28T16:29:56.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.960+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa180108e10 con 0x7fa180100240 2024-02-28T16:29:56.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.961+0000 7fa176a00700 1 -- 172.21.15.23:0/2749759808 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa17000fab0 con 0x7fa180100240 2024-02-28T16:29:56.950 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.961+0000 7fa176a00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa16406d8a0 0x7fa16406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:56.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.962+0000 7fa176a00700 1 -- 172.21.15.23:0/2749759808 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa17008e8e0 con 0x7fa180100240 2024-02-28T16:29:56.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.962+0000 7fa17d400700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa16406d8a0 0x7fa16406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:56.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.962+0000 7fa17d400700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa16406d8a0 0x7fa16406fd50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa16c006fd0 tx=0x7fa16c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:56.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:56.966+0000 7fa176a00700 1 -- 172.21.15.23:0/2749759808 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa17005bbf0 con 0x7fa180100240 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: pgmap v144: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:57.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1384363513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:29:57.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:56 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3620261260' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:29:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: pgmap v144: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-02-28T16:29:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:57.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1384363513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:29:57.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:56 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3620261260' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:29:57.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.216+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa180105d90 con 0x7fa16406d8a0 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.219+0000 7fa176a00700 1 -- 172.21.15.23:0/2749759808 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa180105d90 con 0x7fa16406d8a0 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:29:57.208 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:29:57.209 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:29:57.209 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:29:57.209 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "10/23 daemons upgraded", 2024-02-28T16:29:57.209 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:29:57.209 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:29:57.209 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:29:57.211 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa16406d8a0 msgr2=0x7fa16406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:57.212 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa16406d8a0 0x7fa16406fd50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa16c006fd0 tx=0x7fa16c008040 comp rx=0 tx=0).stop 2024-02-28T16:29:57.212 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 msgr2=0x7fa180195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:57.212 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180195b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa17000bd70 tx=0x7fa17000be50 comp rx=0 tx=0).stop 2024-02-28T16:29:57.212 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 shutdown_connections 2024-02-28T16:29:57.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa16406d8a0 0x7fa16406fd50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa180100240 0x7fa180195b60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 --2- 172.21.15.23:0/2749759808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa180101440 0x7fa1801960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 >> 172.21.15.23:0/2749759808 conn(0x7fa1800fb7f0 msgr2=0x7fa180104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:57.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 shutdown_connections 2024-02-28T16:29:57.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.223+0000 7fa184a00700 1 -- 172.21.15.23:0/2749759808 wait complete. 2024-02-28T16:29:57.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.383+0000 7f042fa00700 1 -- 172.21.15.23:0/4224134138 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0428074d80 msgr2=0x7f04280731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:57.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.383+0000 7f042fa00700 1 --2- 172.21.15.23:0/4224134138 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0428074d80 0x7f04280731e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f041c009910 tx=0x7f041c009c20 comp rx=0 tx=0).stop 2024-02-28T16:29:57.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.384+0000 7f042fa00700 1 -- 172.21.15.23:0/4224134138 shutdown_connections 2024-02-28T16:29:57.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.384+0000 7f042fa00700 1 --2- 172.21.15.23:0/4224134138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04280737b0 0x7f0428073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.384+0000 7f042fa00700 1 --2- 172.21.15.23:0/4224134138 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0428074d80 0x7f04280731e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.384+0000 7f042fa00700 1 -- 172.21.15.23:0/4224134138 >> 172.21.15.23:0/4224134138 conn(0x7f04280fb7f0 msgr2=0x7f04280fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:57.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.384+0000 7f042fa00700 1 -- 172.21.15.23:0/4224134138 shutdown_connections 2024-02-28T16:29:57.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.384+0000 7f042fa00700 1 -- 172.21.15.23:0/4224134138 wait complete. 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.385+0000 7f042fa00700 1 Processor -- start 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.385+0000 7f042fa00700 1 -- start start 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042fa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04280737b0 0x7f042819c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042fa00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0428074d80 0x7f042819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042fa00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042819cc50 con 0x7f04280737b0 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042fa00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042819cd90 con 0x7f0428074d80 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04280737b0 0x7f042819c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04280737b0 0x7f042819c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:59882/0 (socket says 172.21.15.23:59882) 2024-02-28T16:29:57.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042d000700 1 -- 172.21.15.23:0/3795651439 learned_addr learned my addr 172.21.15.23:0/3795651439 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:29:57.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f0427e00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0428074d80 0x7f042819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042d000700 1 -- 172.21.15.23:0/3795651439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0428074d80 msgr2=0x7f042819c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042d000700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0428074d80 0x7f042819c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f042d000700 1 -- 172.21.15.23:0/3795651439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0095f0 con 0x7f04280737b0 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.386+0000 7f0427e00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0428074d80 0x7f042819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.387+0000 7f042d000700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04280737b0 0x7f042819c0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f041c005b40 tx=0x7f041c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.387+0000 7f0425600700 1 -- 172.21.15.23:0/3795651439 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041c01d070 con 0x7f04280737b0 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.387+0000 7f0425600700 1 -- 172.21.15.23:0/3795651439 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f041c022470 con 0x7f04280737b0 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.387+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04281a17e0 con 0x7f04280737b0 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.387+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04281a1cd0 con 0x7f04280737b0 2024-02-28T16:29:57.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.388+0000 7f0425600700 1 -- 172.21.15.23:0/3795651439 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041c00f630 con 0x7f04280737b0 2024-02-28T16:29:57.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.388+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042810f3f0 con 0x7f04280737b0 2024-02-28T16:29:57.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.390+0000 7f0425600700 1 -- 172.21.15.23:0/3795651439 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f041c0225e0 con 0x7f04280737b0 2024-02-28T16:29:57.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.390+0000 7f0425600700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f041006d8a0 0x7f041006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:57.379 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.391+0000 7f0425600700 1 -- 172.21.15.23:0/3795651439 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f041c08ed20 con 0x7f04280737b0 2024-02-28T16:29:57.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.391+0000 7f0427e00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f041006d8a0 0x7f041006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:57.380 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.391+0000 7f0427e00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f041006d8a0 0x7f041006fd50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0414007900 tx=0x7f0414008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:57.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.395+0000 7f0425600700 1 -- 172.21.15.23:0/3795651439 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f041c05c180 con 0x7f04280737b0 2024-02-28T16:29:57.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.726+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f04281a2360 con 0x7f04280737b0 2024-02-28T16:29:57.716 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.727+0000 7f0425600700 1 -- 172.21.15.23:0/3795651439 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1182 (secure 0 0 0) 0x7f041c027090 con 0x7f04280737b0 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_WARN Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-02-28T16:29:57.717 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-02-28T16:29:57.718 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.730+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f041006d8a0 msgr2=0x7f041006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.730+0000 7f042fa00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f041006d8a0 0x7f041006fd50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0414007900 tx=0x7f0414008040 comp rx=0 tx=0).stop 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.730+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04280737b0 msgr2=0x7f042819c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.730+0000 7f042fa00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04280737b0 0x7f042819c0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f041c005b40 tx=0x7f041c00be20 comp rx=0 tx=0).stop 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.731+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 shutdown_connections 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.731+0000 7f042fa00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f041006d8a0 0x7f041006fd50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.731+0000 7f042fa00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f04280737b0 0x7f042819c0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.731+0000 7f042fa00700 1 --2- 172.21.15.23:0/3795651439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0428074d80 0x7f042819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.731+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 >> 172.21.15.23:0/3795651439 conn(0x7f04280fb7f0 msgr2=0x7f0428101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.731+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 shutdown_connections 2024-02-28T16:29:57.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:29:57.731+0000 7f042fa00700 1 -- 172.21.15.23:0/3795651439 wait complete. 2024-02-28T16:29:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:57 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:29:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:57 smithi023 ceph-mon[78509]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-28T16:29:58.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:57 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3795651439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:29:58.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:57 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:29:58.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:57 smithi153 ceph-mon[66339]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-28T16:29:58.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:57 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3795651439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:29:59.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:58 smithi153 ceph-mon[66339]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:59.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:58 smithi153 ceph-mon[66339]: pgmap v146: 65 pgs: 14 active+undersized+degraded, 13 active+undersized, 38 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:29:59.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:58 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 41/228 objects degraded (17.982%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:29:59.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:58 smithi023 ceph-mon[78509]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:59.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:58 smithi023 ceph-mon[78509]: pgmap v146: 65 pgs: 14 active+undersized+degraded, 13 active+undersized, 38 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/228 objects degraded (17.982%) 2024-02-28T16:29:59.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:58 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 41/228 objects degraded (17.982%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:30:00.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:59 smithi153 ceph-mon[66339]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/228 objects degraded (17.982%), 14 pgs degraded) 2024-02-28T16:30:00.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:29:59 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:30:00.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:59 smithi023 ceph-mon[78509]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/228 objects degraded (17.982%), 14 pgs degraded) 2024-02-28T16:30:00.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:29:59 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:30:01.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:01 smithi153 ceph-mon[66339]: pgmap v147: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:01.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:01 smithi153 ceph-mon[66339]: overall HEALTH_OK 2024-02-28T16:30:01.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:00 smithi023 ceph-mon[78509]: pgmap v147: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:01.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:00 smithi023 ceph-mon[78509]: overall HEALTH_OK 2024-02-28T16:30:03.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:03 smithi153 ceph-mon[66339]: pgmap v148: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:03.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:03 smithi023 ceph-mon[78509]: pgmap v148: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:05 smithi153 ceph-mon[66339]: pgmap v149: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:05 smithi023 ceph-mon[78509]: pgmap v149: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:07 smithi153 ceph-mon[66339]: pgmap v150: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:07.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:07 smithi023 ceph-mon[78509]: pgmap v150: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:07.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:07.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:07.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:09.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:09 smithi153 ceph-mon[66339]: pgmap v151: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:09.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:09 smithi023 ceph-mon[78509]: pgmap v151: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:11.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:11 smithi153 ceph-mon[66339]: pgmap v152: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:11.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:11 smithi023 ceph-mon[78509]: pgmap v152: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:12.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:12 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:30:12.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:12 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:30:13.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:13 smithi153 ceph-mon[66339]: pgmap v153: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:13.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:13 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:30:13.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:13 smithi153 ceph-mon[66339]: Upgrade: osd.4 is safe to restart 2024-02-28T16:30:13.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:13 smithi023 ceph-mon[78509]: pgmap v153: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:13.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:13 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:30:13.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:13 smithi023 ceph-mon[78509]: Upgrade: osd.4 is safe to restart 2024-02-28T16:30:15.228 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:15 smithi153 ceph-mon[66339]: pgmap v154: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:15.228 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:15 smithi153 ceph-mon[66339]: Upgrade: Updating osd.4 2024-02-28T16:30:15.228 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:15.228 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:30:15.228 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:15.228 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:15 smithi153 ceph-mon[66339]: Deploying daemon osd.4 on smithi153 2024-02-28T16:30:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:15 smithi023 ceph-mon[78509]: pgmap v154: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:15 smithi023 ceph-mon[78509]: Upgrade: Updating osd.4 2024-02-28T16:30:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:30:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:15.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:15 smithi023 ceph-mon[78509]: Deploying daemon osd.4 on smithi153 2024-02-28T16:30:17.292 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:17 smithi153 ceph-mon[66339]: pgmap v155: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:17.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:17 smithi023 ceph-mon[78509]: pgmap v155: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:19.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:19 smithi153 ceph-mon[66339]: pgmap v156: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:19.146 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:18 smithi153 systemd[1]: Stopping Ceph osd.4 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:30:19.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:19 smithi023 ceph-mon[78509]: pgmap v156: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:19.646 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:19 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[45941]: 2024-02-28T16:30:19.307+0000 7f7f16200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:30:19.646 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:19 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[45941]: 2024-02-28T16:30:19.307+0000 7f7f16200700 -1 osd.4 70 *** Got signal Terminated *** 2024-02-28T16:30:19.646 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:19 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[45941]: 2024-02-28T16:30:19.307+0000 7f7f16200700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:30:20.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:20 smithi153 ceph-mon[66339]: osd.4 marked itself down and dead 2024-02-28T16:30:20.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:20 smithi023 ceph-mon[78509]: osd.4 marked itself down and dead 2024-02-28T16:30:21.022 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:20 smithi153 podman[73967]: 2024-02-28 16:30:20.718027866 +0000 UTC m=+1.537797780 container died 6f0332165ee339c325066d9096f8925e0388b2326c719996426871a5656d5cdd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.build-date=20231212) 2024-02-28T16:30:21.331 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:21 smithi153 ceph-mon[66339]: pgmap v157: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:21.331 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:21 smithi153 ceph-mon[66339]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:30:21.331 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:21 smithi153 ceph-mon[66339]: osdmap e71: 6 total, 5 up, 6 in 2024-02-28T16:30:21.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:21 smithi023 ceph-mon[78509]: pgmap v157: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:21.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:21 smithi023 ceph-mon[78509]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:30:21.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:21 smithi023 ceph-mon[78509]: osdmap e71: 6 total, 5 up, 6 in 2024-02-28T16:30:21.645 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:21 smithi153 podman[73967]: 2024-02-28 16:30:21.343366063 +0000 UTC m=+2.163136011 container cleanup 6f0332165ee339c325066d9096f8925e0388b2326c719996426871a5656d5cdd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.license=GPLv2) 2024-02-28T16:30:21.645 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:21 smithi153 bash[73967]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4 2024-02-28T16:30:21.645 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:21 smithi153 podman[73988]: 2024-02-28 16:30:21.5862063 +0000 UTC m=+0.856276096 container remove 6f0332165ee339c325066d9096f8925e0388b2326c719996426871a5656d5cdd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:30:22.376 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:22 smithi153 ceph-mon[66339]: osdmap e72: 6 total, 5 up, 6 in 2024-02-28T16:30:22.377 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:22.377 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:22.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:22 smithi023 ceph-mon[78509]: osdmap e72: 6 total, 5 up, 6 in 2024-02-28T16:30:22.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:22.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:22.645 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:22 smithi153 podman[74081]: 2024-02-28 16:30:22.296474021 +0000 UTC m=+0.038849524 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:30:22.645 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:22 smithi153 podman[74081]: 2024-02-28 16:30:22.40374329 +0000 UTC m=+0.146118857 container create e5395823e29e9b23de2a3dd5333f30d7222953a515a5b488f7c1bb315e4ea834 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:30:23.095 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:22 smithi153 podman[74081]: 2024-02-28 16:30:22.701640527 +0000 UTC m=+0.444016071 container init e5395823e29e9b23de2a3dd5333f30d7222953a515a5b488f7c1bb315e4ea834 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , ceph=True) 2024-02-28T16:30:23.095 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:22 smithi153 podman[74081]: 2024-02-28 16:30:22.714101693 +0000 UTC m=+0.456477270 container start e5395823e29e9b23de2a3dd5333f30d7222953a515a5b488f7c1bb315e4ea834 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:30:23.095 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:22 smithi153 podman[74081]: 2024-02-28 16:30:22.822871029 +0000 UTC m=+0.565246643 container attach e5395823e29e9b23de2a3dd5333f30d7222953a515a5b488f7c1bb315e4ea834 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-02-28T16:30:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:23 smithi153 ceph-mon[66339]: pgmap v160: 65 pgs: 6 stale+active+clean, 59 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:23.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:23 smithi153 podman[74081]: 2024-02-28 16:30:23.150944496 +0000 UTC m=+0.893320039 container died e5395823e29e9b23de2a3dd5333f30d7222953a515a5b488f7c1bb315e4ea834 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-02-28T16:30:23.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:23 smithi023 ceph-mon[78509]: pgmap v160: 65 pgs: 6 stale+active+clean, 59 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:24.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:23 smithi153 podman[74107]: 2024-02-28 16:30:23.968466064 +0000 UTC m=+0.797692141 container remove e5395823e29e9b23de2a3dd5333f30d7222953a515a5b488f7c1bb315e4ea834 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-28T16:30:24.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:24 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-28T16:30:24.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:24 smithi153 systemd[1]: Stopped Ceph osd.4 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:30:24.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:24 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.4.service: Consumed 2min 7.719s CPU time. 2024-02-28T16:30:24.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:24 smithi153 ceph-mon[66339]: pgmap v161: 65 pgs: 7 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 44 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/228 objects degraded (10.965%) 2024-02-28T16:30:24.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:24 smithi153 ceph-mon[66339]: Health check failed: Degraded data redundancy: 25/228 objects degraded (10.965%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:30:24.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:24 smithi023 ceph-mon[78509]: pgmap v161: 65 pgs: 7 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 44 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/228 objects degraded (10.965%) 2024-02-28T16:30:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:24 smithi023 ceph-mon[78509]: Health check failed: Degraded data redundancy: 25/228 objects degraded (10.965%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:30:24.781 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:24 smithi153 systemd[1]: Starting Ceph osd.4 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:30:25.111 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:24 smithi153 podman[74209]: 2024-02-28 16:30:24.697904706 +0000 UTC m=+0.032234452 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:30:25.111 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:24 smithi153 podman[74209]: 2024-02-28 16:30:24.861250934 +0000 UTC m=+0.195580706 container create efc8a59283f4261d009d51c4c7ddde87fa3596e519dc65c5506bccbf702ca620 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-28T16:30:25.111 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:25 smithi153 podman[74209]: 2024-02-28 16:30:25.122900032 +0000 UTC m=+0.457229848 container init efc8a59283f4261d009d51c4c7ddde87fa3596e519dc65c5506bccbf702ca620 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS) 2024-02-28T16:30:25.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:25 smithi153 podman[74209]: 2024-02-28 16:30:25.133786964 +0000 UTC m=+0.468116725 container start efc8a59283f4261d009d51c4c7ddde87fa3596e519dc65c5506bccbf702ca620 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-28T16:30:25.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:25 smithi153 podman[74209]: 2024-02-28 16:30:25.221791511 +0000 UTC m=+0.556121270 container attach efc8a59283f4261d009d51c4c7ddde87fa3596e519dc65c5506bccbf702ca620 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux ) 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate[74224]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate[74224]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 bash[74209]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 bash[74209]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 bash[74209]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 bash[74209]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 bash[74209]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 bash[74209]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 bash[74209]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate[74224]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate[74224]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate[74224]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T16:30:26.260 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate[74224]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:30:26.261 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate[74224]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T16:30:26.261 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 podman[74209]: 2024-02-28 16:30:26.062730264 +0000 UTC m=+1.397060056 container died efc8a59283f4261d009d51c4c7ddde87fa3596e519dc65c5506bccbf702ca620 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=) 2024-02-28T16:30:26.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:26 smithi153 ceph-mon[66339]: pgmap v162: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:26.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:26 smithi023 ceph-mon[78509]: pgmap v162: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:27.142 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:26 smithi153 podman[74344]: 2024-02-28 16:30:26.791901328 +0000 UTC m=+0.707560292 container remove efc8a59283f4261d009d51c4c7ddde87fa3596e519dc65c5506bccbf702ca620 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:30:27.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:27 smithi153 podman[74409]: 2024-02-28 16:30:27.05842111 +0000 UTC m=+0.032512184 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:30:27.395 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:27 smithi153 podman[74409]: 2024-02-28 16:30:27.167878584 +0000 UTC m=+0.141969696 container create 79f6584de78330cdcf16b4c93ca1a8e9aaad705ae7f7149c3f89c9236f883067 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-28T16:30:27.887 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.898+0000 7f4425600700 1 -- 172.21.15.23:0/3142851229 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420101440 msgr2=0x7f4420101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:27.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.898+0000 7f4425600700 1 --2- 172.21.15.23:0/3142851229 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420101440 0x7f4420101890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f440c009910 tx=0x7f440c009c20 comp rx=0 tx=0).stop 2024-02-28T16:30:27.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.898+0000 7f4425600700 1 -- 172.21.15.23:0/3142851229 shutdown_connections 2024-02-28T16:30:27.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.898+0000 7f4425600700 1 --2- 172.21.15.23:0/3142851229 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420101440 0x7f4420101890 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:27.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.898+0000 7f4425600700 1 --2- 172.21.15.23:0/3142851229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4420100240 0x7f4420100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:27.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.898+0000 7f4425600700 1 -- 172.21.15.23:0/3142851229 >> 172.21.15.23:0/3142851229 conn(0x7f44200fb7f0 msgr2=0x7f44200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:27.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.898+0000 7f4425600700 1 -- 172.21.15.23:0/3142851229 shutdown_connections 2024-02-28T16:30:27.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.899+0000 7f4425600700 1 -- 172.21.15.23:0/3142851229 wait complete. 2024-02-28T16:30:27.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.900+0000 7f4425600700 1 Processor -- start 2024-02-28T16:30:27.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.900+0000 7f4425600700 1 -- start start 2024-02-28T16:30:27.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.900+0000 7f4425600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420100240 0x7f4420197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:27.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.900+0000 7f4425600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4420101440 0x7f44201981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:27.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.900+0000 7f4425600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201987d0 con 0x7f4420100240 2024-02-28T16:30:27.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.900+0000 7f4425600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420198940 con 0x7f4420101440 2024-02-28T16:30:27.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.900+0000 7f441ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420100240 0x7f4420197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:27.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.901+0000 7f441ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420100240 0x7f4420197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35856/0 (socket says 172.21.15.23:35856) 2024-02-28T16:30:27.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.901+0000 7f441ea00700 1 -- 172.21.15.23:0/1024735971 learned_addr learned my addr 172.21.15.23:0/1024735971 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:30:27.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.901+0000 7f441e000700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4420101440 0x7f44201981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:27.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.901+0000 7f441ea00700 1 -- 172.21.15.23:0/1024735971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4420101440 msgr2=0x7f44201981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:27.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.901+0000 7f441ea00700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4420101440 0x7f44201981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:27.890 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.901+0000 7f441ea00700 1 -- 172.21.15.23:0/1024735971 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c0095f0 con 0x7f4420100240 2024-02-28T16:30:27.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.901+0000 7f441ea00700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420100240 0x7f4420197c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f441000d900 tx=0x7f441000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:27.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.902+0000 7f4417400700 1 -- 172.21.15.23:0/1024735971 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f441000b920 con 0x7f4420100240 2024-02-28T16:30:27.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.902+0000 7f4417400700 1 -- 172.21.15.23:0/1024735971 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4410010460 con 0x7f4420100240 2024-02-28T16:30:27.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.902+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442019d3d0 con 0x7f4420100240 2024-02-28T16:30:27.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.902+0000 7f4417400700 1 -- 172.21.15.23:0/1024735971 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f441000f590 con 0x7f4420100240 2024-02-28T16:30:27.891 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.902+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442019d920 con 0x7f4420100240 2024-02-28T16:30:27.892 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.903+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4420105520 con 0x7f4420100240 2024-02-28T16:30:27.893 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.904+0000 7f4417400700 1 -- 172.21.15.23:0/1024735971 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f44100105d0 con 0x7f4420100240 2024-02-28T16:30:27.894 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.905+0000 7f4417400700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f440406d8a0 0x7f440406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:27.894 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.905+0000 7f4417400700 1 -- 172.21.15.23:0/1024735971 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f441008d1b0 con 0x7f4420100240 2024-02-28T16:30:27.894 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.906+0000 7f441e000700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f440406d8a0 0x7f440406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:27.895 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:27 smithi153 podman[74409]: 2024-02-28 16:30:27.446441719 +0000 UTC m=+0.420532878 container init 79f6584de78330cdcf16b4c93ca1a8e9aaad705ae7f7149c3f89c9236f883067 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-28T16:30:27.895 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:27 smithi153 podman[74409]: 2024-02-28 16:30:27.457532161 +0000 UTC m=+0.431623242 container start 79f6584de78330cdcf16b4c93ca1a8e9aaad705ae7f7149c3f89c9236f883067 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-1fb5d10) 2024-02-28T16:30:27.895 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:27 smithi153 ceph-osd[74428]: -- 172.21.15.153:0/4026489300 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55772974d680 con 0x557729717000 2024-02-28T16:30:27.895 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:27 smithi153 bash[74409]: 79f6584de78330cdcf16b4c93ca1a8e9aaad705ae7f7149c3f89c9236f883067 2024-02-28T16:30:27.895 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:27 smithi153 systemd[1]: Started Ceph osd.4 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:30:27.896 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.906+0000 7f441e000700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f440406d8a0 0x7f440406fd50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44201991a0 tx=0x7f440c00b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:27.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:27.911+0000 7f4417400700 1 -- 172.21.15.23:0/1024735971 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4410056910 con 0x7f4420100240 2024-02-28T16:30:28.155 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.166+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4420061190 con 0x7f440406d8a0 2024-02-28T16:30:28.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.168+0000 7f4417400700 1 -- 172.21.15.23:0/1024735971 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4420061190 con 0x7f440406d8a0 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f440406d8a0 msgr2=0x7f440406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f440406d8a0 0x7f440406fd50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44201991a0 tx=0x7f440c00b560 comp rx=0 tx=0).stop 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420100240 msgr2=0x7f4420197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420100240 0x7f4420197c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f441000d900 tx=0x7f441000dc10 comp rx=0 tx=0).stop 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 shutdown_connections 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f440406d8a0 0x7f440406fd50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4420100240 0x7f4420197c90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 --2- 172.21.15.23:0/1024735971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4420101440 0x7f44201981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 >> 172.21.15.23:0/1024735971 conn(0x7f44200fb7f0 msgr2=0x7f4420102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:28.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 shutdown_connections 2024-02-28T16:30:28.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.171+0000 7f4425600700 1 -- 172.21.15.23:0/1024735971 wait complete. 2024-02-28T16:30:28.178 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:30:28.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 -- 172.21.15.23:0/3425642129 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b4100d80 msgr2=0x7f24b4103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3425642129 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b4100d80 0x7f24b4103160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009910 tx=0x7f24a4009c20 comp rx=0 tx=0).stop 2024-02-28T16:30:28.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 -- 172.21.15.23:0/3425642129 shutdown_connections 2024-02-28T16:30:28.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3425642129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b41036a0 0x7f24b4105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3425642129 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b4100d80 0x7f24b4103160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 -- 172.21.15.23:0/3425642129 >> 172.21.15.23:0/3425642129 conn(0x7f24b40fa7a0 msgr2=0x7f24b40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:28.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 -- 172.21.15.23:0/3425642129 shutdown_connections 2024-02-28T16:30:28.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.352+0000 7f24b9c00700 1 -- 172.21.15.23:0/3425642129 wait complete. 2024-02-28T16:30:28.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.354+0000 7f24b9c00700 1 Processor -- start 2024-02-28T16:30:28.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.354+0000 7f24b9c00700 1 -- start start 2024-02-28T16:30:28.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.354+0000 7f24b9c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b4100d80 0x7f24b41006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:28.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.354+0000 7f24b9c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b41036a0 0x7f24b40fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:28.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.354+0000 7f24b9c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4199a40 con 0x7f24b41036a0 2024-02-28T16:30:28.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.354+0000 7f24b9c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4199b80 con 0x7f24b4100d80 2024-02-28T16:30:28.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.355+0000 7f24b2a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b4100d80 0x7f24b41006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:28.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.355+0000 7f24b2a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b4100d80 0x7f24b41006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:58772/0 (socket says 172.21.15.23:58772) 2024-02-28T16:30:28.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.355+0000 7f24b2a00700 1 -- 172.21.15.23:0/3404842392 learned_addr learned my addr 172.21.15.23:0/3404842392 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:30:28.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.355+0000 7f24b2000700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b41036a0 0x7f24b40fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:28.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.355+0000 7f24b2a00700 1 -- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b41036a0 msgr2=0x7f24b40fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.355+0000 7f24b2a00700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b41036a0 0x7f24b40fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.356+0000 7f24b2a00700 1 -- 172.21.15.23:0/3404842392 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40095f0 con 0x7f24b4100d80 2024-02-28T16:30:28.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.356+0000 7f24b2a00700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b4100d80 0x7f24b41006e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24a4005b40 tx=0x7f24a400fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:28.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.357+0000 7f24ab400700 1 -- 172.21.15.23:0/3404842392 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a401d070 con 0x7f24b4100d80 2024-02-28T16:30:28.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.357+0000 7f24ab400700 1 -- 172.21.15.23:0/3404842392 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24a4005dc0 con 0x7f24b4100d80 2024-02-28T16:30:28.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.357+0000 7f24ab400700 1 -- 172.21.15.23:0/3404842392 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a40226a0 con 0x7f24b4100d80 2024-02-28T16:30:28.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.357+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b40ff270 con 0x7f24b4100d80 2024-02-28T16:30:28.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.358+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b40ff730 con 0x7f24b4100d80 2024-02-28T16:30:28.348 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.359+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b418fbe0 con 0x7f24b4100d80 2024-02-28T16:30:28.349 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.360+0000 7f24ab400700 1 -- 172.21.15.23:0/3404842392 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f24a4003680 con 0x7f24b4100d80 2024-02-28T16:30:28.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.361+0000 7f24ab400700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f249806d8a0 0x7f249806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:28.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.361+0000 7f24ab400700 1 -- 172.21.15.23:0/3404842392 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f24a408ea30 con 0x7f24b4100d80 2024-02-28T16:30:28.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.361+0000 7f24b2000700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f249806d8a0 0x7f249806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:28.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.362+0000 7f24b2000700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f249806d8a0 0x7f249806fd50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009bf0 tx=0x7f24a0009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:28.363 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.375+0000 7f24ab400700 1 -- 172.21.15.23:0/3404842392 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f24a405bd80 con 0x7f24b4100d80 2024-02-28T16:30:28.394 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:28 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:30:28.029+0000 7fcfefa5d7c0 -1 Falling back to public interface 2024-02-28T16:30:28.613 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.624+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24b4061190 con 0x7f249806d8a0 2024-02-28T16:30:28.615 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.626+0000 7f24ab400700 1 -- 172.21.15.23:0/3404842392 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f24b4061190 con 0x7f249806d8a0 2024-02-28T16:30:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f249806d8a0 msgr2=0x7f249806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f249806d8a0 0x7f249806fd50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009bf0 tx=0x7f24a0009260 comp rx=0 tx=0).stop 2024-02-28T16:30:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b4100d80 msgr2=0x7f24b41006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b4100d80 0x7f24b41006e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24a4005b40 tx=0x7f24a400fab0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 shutdown_connections 2024-02-28T16:30:28.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24b4100d80 0x7f24b41006e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f249806d8a0 0x7f249806fd50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 --2- 172.21.15.23:0/3404842392 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f24b41036a0 0x7f24b40fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 >> 172.21.15.23:0/3404842392 conn(0x7f24b40fa7a0 msgr2=0x7f24b40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:28.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.630+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 shutdown_connections 2024-02-28T16:30:28.620 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.631+0000 7f24b9c00700 1 -- 172.21.15.23:0/3404842392 wait complete. 2024-02-28T16:30:28.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 -- 172.21.15.23:0/3544507897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 msgr2=0x7f8118103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 --2- 172.21.15.23:0/3544507897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118103140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8108009910 tx=0x7f8108009c20 comp rx=0 tx=0).stop 2024-02-28T16:30:28.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 -- 172.21.15.23:0/3544507897 shutdown_connections 2024-02-28T16:30:28.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 --2- 172.21.15.23:0/3544507897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8118103680 0x7f8118105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 --2- 172.21.15.23:0/3544507897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118103140 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 -- 172.21.15.23:0/3544507897 >> 172.21.15.23:0/3544507897 conn(0x7f81180fa780 msgr2=0x7f81180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:28.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 -- 172.21.15.23:0/3544507897 shutdown_connections 2024-02-28T16:30:28.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.792+0000 7f811d800700 1 -- 172.21.15.23:0/3544507897 wait complete. 2024-02-28T16:30:28.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.793+0000 7f811d800700 1 Processor -- start 2024-02-28T16:30:28.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.794+0000 7f811d800700 1 -- start start 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.794+0000 7f811d800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.794+0000 7f811d800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8118103680 0x7f8118198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.794+0000 7f811d800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8118198840 con 0x7f8118100d60 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.794+0000 7f811d800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811819d250 con 0x7f8118103680 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.794+0000 7f8116a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.795+0000 7f8116a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35882/0 (socket says 172.21.15.23:35882) 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.795+0000 7f8116a00700 1 -- 172.21.15.23:0/4250882524 learned_addr learned my addr 172.21.15.23:0/4250882524 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:30:28.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.795+0000 7f8116000700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8118103680 0x7f8118198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.795+0000 7f8116a00700 1 -- 172.21.15.23:0/4250882524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8118103680 msgr2=0x7f8118198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.795+0000 7f8116a00700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8118103680 0x7f8118198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.795+0000 7f8116a00700 1 -- 172.21.15.23:0/4250882524 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080095f0 con 0x7f8118100d60 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.795+0000 7f8116a00700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118197ce0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f810800bd70 tx=0x7f810800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.796+0000 7f810f400700 1 -- 172.21.15.23:0/4250882524 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810801d070 con 0x7f8118100d60 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.796+0000 7f810f400700 1 -- 172.21.15.23:0/4250882524 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f810800f460 con 0x7f8118100d60 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.796+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811819d3f0 con 0x7f8118100d60 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.796+0000 7f810f400700 1 -- 172.21.15.23:0/4250882524 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8108021620 con 0x7f8118100d60 2024-02-28T16:30:28.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.796+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811819d8b0 con 0x7f8118100d60 2024-02-28T16:30:28.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.797+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81180fc340 con 0x7f8118100d60 2024-02-28T16:30:28.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.799+0000 7f810f400700 1 -- 172.21.15.23:0/4250882524 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f810800fa40 con 0x7f8118100d60 2024-02-28T16:30:28.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.800+0000 7f810f400700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f80fc06d8a0 0x7f80fc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:28.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.800+0000 7f810f400700 1 -- 172.21.15.23:0/4250882524 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f810808e750 con 0x7f8118100d60 2024-02-28T16:30:28.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.801+0000 7f8116000700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f80fc06d8a0 0x7f80fc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:28.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.802+0000 7f8116000700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f80fc06d8a0 0x7f80fc06fd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8104005950 tx=0x7f81040058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:28.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:28.806+0000 7f810f400700 1 -- 172.21.15.23:0/4250882524 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8108057f30 con 0x7f8118100d60 2024-02-28T16:30:28.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:28 smithi153 ceph-mon[66339]: pgmap v163: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:28.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:28.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:28.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:28 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:28.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:28 smithi023 ceph-mon[78509]: pgmap v163: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:28.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:28.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:28.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:28 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:29.056 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.067+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8118061190 con 0x7f80fc06d8a0 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.079+0000 7f810f400700 1 -- 172.21.15.23:0/4250882524 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f8118061190 con 0x7f80fc06d8a0 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (15m) 81s ago 17m 14.2M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (17m) 81s ago 17m 8610k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (16m) 39s ago 16m 7926k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (3m) 81s ago 17m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (2m) 39s ago 16m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (15m) 81s ago 16m 74.5M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (10m) 81s ago 10m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (10m) 81s ago 10m 16.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (10m) 39s ago 10m 16.7M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (10m) 39s ago 10m 16.9M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:30:29.069 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (6m) 81s ago 19m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (5m) 39s ago 16m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (4m) 81s ago 19m 46.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (4m) 39s ago 15m 38.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (17m) 81s ago 17m 8010k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (16m) 39s ago 16m 8136k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (2m) 81s ago 14m 89.3M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (118s) 81s ago 14m 98.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (89s) 81s ago 13m 11.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (44s) 39s ago 13m 11.1M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 starting - - - 2241M 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (12m) 39s ago 11m 225M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:30:29.070 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (5m) 81s ago 16m 58.5M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.083+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f80fc06d8a0 msgr2=0x7f80fc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f80fc06d8a0 0x7f80fc06fd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8104005950 tx=0x7f81040058e0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 msgr2=0x7f8118197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118197ce0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f810800bd70 tx=0x7f810800be50 comp rx=0 tx=0).stop 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 shutdown_connections 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f80fc06d8a0 0x7f80fc06fd50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8118100d60 0x7f8118197ce0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 --2- 172.21.15.23:0/4250882524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8118103680 0x7f8118198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 >> 172.21.15.23:0/4250882524 conn(0x7f81180fa780 msgr2=0x7f81181042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 shutdown_connections 2024-02-28T16:30:29.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.084+0000 7f811d800700 1 -- 172.21.15.23:0/4250882524 wait complete. 2024-02-28T16:30:29.240 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.251+0000 7fac79600700 1 -- 172.21.15.23:0/2788088973 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74101440 msgr2=0x7fac74101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.251+0000 7fac79600700 1 --2- 172.21.15.23:0/2788088973 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74101440 0x7fac74101890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009910 tx=0x7fac5c009c20 comp rx=0 tx=0).stop 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.251+0000 7fac79600700 1 -- 172.21.15.23:0/2788088973 shutdown_connections 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.251+0000 7fac79600700 1 --2- 172.21.15.23:0/2788088973 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74101440 0x7fac74101890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.251+0000 7fac79600700 1 --2- 172.21.15.23:0/2788088973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac74100240 0x7fac74100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.251+0000 7fac79600700 1 -- 172.21.15.23:0/2788088973 >> 172.21.15.23:0/2788088973 conn(0x7fac740fb7f0 msgr2=0x7fac740fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.252+0000 7fac79600700 1 -- 172.21.15.23:0/2788088973 shutdown_connections 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.252+0000 7fac79600700 1 -- 172.21.15.23:0/2788088973 wait complete. 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.253+0000 7fac79600700 1 Processor -- start 2024-02-28T16:30:29.241 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.253+0000 7fac79600700 1 -- start start 2024-02-28T16:30:29.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.253+0000 7fac79600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74100240 0x7fac74197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:29.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.253+0000 7fac79600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac74101440 0x7fac74198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:29.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.253+0000 7fac79600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac74198820 con 0x7fac74100240 2024-02-28T16:30:29.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.253+0000 7fac79600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac74198990 con 0x7fac74101440 2024-02-28T16:30:29.242 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.253+0000 7fac72a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74100240 0x7fac74197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:29.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac72a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74100240 0x7fac74197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:35892/0 (socket says 172.21.15.23:35892) 2024-02-28T16:30:29.243 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac72a00700 1 -- 172.21.15.23:0/161429354 learned_addr learned my addr 172.21.15.23:0/161429354 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac6be00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac74101440 0x7fac74198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac72a00700 1 -- 172.21.15.23:0/161429354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac74101440 msgr2=0x7fac74198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac72a00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac74101440 0x7fac74198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac72a00700 1 -- 172.21.15.23:0/161429354 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0095f0 con 0x7fac74100240 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac6be00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac74101440 0x7fac74198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.254+0000 7fac72a00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74100240 0x7fac74197ce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac6400d900 tx=0x7fac6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.255+0000 7fac6b400700 1 -- 172.21.15.23:0/161429354 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac640041f0 con 0x7fac74100240 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.255+0000 7fac6b400700 1 -- 172.21.15.23:0/161429354 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fac64004350 con 0x7fac74100240 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.255+0000 7fac6b400700 1 -- 172.21.15.23:0/161429354 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac64003da0 con 0x7fac74100240 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.255+0000 7fac79600700 1 -- 172.21.15.23:0/161429354 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7419d3d0 con 0x7fac74100240 2024-02-28T16:30:29.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.255+0000 7fac79600700 1 -- 172.21.15.23:0/161429354 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7419d8d0 con 0x7fac74100240 2024-02-28T16:30:29.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.256+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac74108d90 con 0x7fac74100240 2024-02-28T16:30:29.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.257+0000 7fac6b400700 1 -- 172.21.15.23:0/161429354 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fac64009730 con 0x7fac74100240 2024-02-28T16:30:29.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.258+0000 7fac6b400700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fac5806d8a0 0x7fac5806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:29.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.258+0000 7fac6b400700 1 -- 172.21.15.23:0/161429354 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fac6408d030 con 0x7fac74100240 2024-02-28T16:30:29.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.259+0000 7fac6be00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fac5806d8a0 0x7fac5806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:29.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.259+0000 7fac6be00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fac5806d8a0 0x7fac5806fd50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac5c006010 tx=0x7fac5c005960 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:29.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.263+0000 7fac6b400700 1 -- 172.21.15.23:0/161429354 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fac640568b0 con 0x7fac74100240 2024-02-28T16:30:29.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.580+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fac74108f20 con 0x7fac74100240 2024-02-28T16:30:29.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.582+0000 7fac6b400700 1 -- 172.21.15.23:0/161429354 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fac64059f70 con 0x7fac74100240 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:30:29.571 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 8 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:30:29.572 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fac5806d8a0 msgr2=0x7fac5806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fac5806d8a0 0x7fac5806fd50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac5c006010 tx=0x7fac5c005960 comp rx=0 tx=0).stop 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74100240 msgr2=0x7fac74197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74100240 0x7fac74197ce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac6400d900 tx=0x7fac6400dcc0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 shutdown_connections 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fac5806d8a0 0x7fac5806fd50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fac74100240 0x7fac74197ce0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 --2- 172.21.15.23:0/161429354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac74101440 0x7fac74198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.585+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 >> 172.21.15.23:0/161429354 conn(0x7fac740fb7f0 msgr2=0x7fac74102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.586+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 shutdown_connections 2024-02-28T16:30:29.575 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.586+0000 7fac68c00700 1 -- 172.21.15.23:0/161429354 wait complete. 2024-02-28T16:30:29.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 -- 172.21.15.23:0/3748648394 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 msgr2=0x7f20c8101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 --2- 172.21.15.23:0/3748648394 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8101730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009910 tx=0x7f20b4009c20 comp rx=0 tx=0).stop 2024-02-28T16:30:29.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 -- 172.21.15.23:0/3748648394 shutdown_connections 2024-02-28T16:30:29.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 --2- 172.21.15.23:0/3748648394 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8101730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 --2- 172.21.15.23:0/3748648394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c8100020 0x7f20c8100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 -- 172.21.15.23:0/3748648394 >> 172.21.15.23:0/3748648394 conn(0x7f20c80fb650 msgr2=0x7f20c80fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:29.741 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 -- 172.21.15.23:0/3748648394 shutdown_connections 2024-02-28T16:30:29.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.752+0000 7f20cdc00700 1 -- 172.21.15.23:0/3748648394 wait complete. 2024-02-28T16:30:29.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.753+0000 7f20cdc00700 1 Processor -- start 2024-02-28T16:30:29.742 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20cdc00700 1 -- start start 2024-02-28T16:30:29.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20cdc00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c8100020 0x7f20c8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:29.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20cdc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:29.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20cdc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8073680 con 0x7f20c81012c0 2024-02-28T16:30:29.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20cdc00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80737c0 con 0x7f20c8100020 2024-02-28T16:30:29.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20c7400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:29.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20c7400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:60942/0 (socket says 172.21.15.23:60942) 2024-02-28T16:30:29.743 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.754+0000 7f20c7400700 1 -- 172.21.15.23:0/2218464897 learned_addr learned my addr 172.21.15.23:0/2218464897 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:30:29.744 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c7e00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c8100020 0x7f20c8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:29.744 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c7400700 1 -- 172.21.15.23:0/2218464897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c8100020 msgr2=0x7f20c8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:29.744 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c7400700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c8100020 0x7f20c8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:29.744 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c7400700 1 -- 172.21.15.23:0/2218464897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b40095f0 con 0x7f20c81012c0 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c7e00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c8100020 0x7f20c8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c7400700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8073140 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20b4005b40 tx=0x7f20b400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c4c00700 1 -- 172.21.15.23:0/2218464897 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b401d070 con 0x7f20c81012c0 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20c4c00700 1 -- 172.21.15.23:0/2218464897 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f20b4022470 con 0x7f20c81012c0 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.755+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c8073a40 con 0x7f20c81012c0 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.756+0000 7f20c4c00700 1 -- 172.21.15.23:0/2218464897 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b400f690 con 0x7f20c81012c0 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.756+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c8073f30 con 0x7f20c81012c0 2024-02-28T16:30:29.745 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.757+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c8108b80 con 0x7f20c81012c0 2024-02-28T16:30:29.746 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.758+0000 7f20c4c00700 1 -- 172.21.15.23:0/2218464897 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f20b40225e0 con 0x7f20c81012c0 2024-02-28T16:30:29.748 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.759+0000 7f20c4c00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20ac06d8a0 0x7f20ac06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:29.748 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.759+0000 7f20c4c00700 1 -- 172.21.15.23:0/2218464897 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f20b408ed60 con 0x7f20c81012c0 2024-02-28T16:30:29.748 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.759+0000 7f20c7e00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20ac06d8a0 0x7f20ac06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:29.748 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.760+0000 7f20c7e00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20ac06d8a0 0x7f20ac06fd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20b8007900 tx=0x7f20b8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:29.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:29.764+0000 7f20c4c00700 1 -- 172.21.15.23:0/2218464897 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f20b405c110 con 0x7f20c81012c0 2024-02-28T16:30:29.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:29 smithi153 ceph-mon[66339]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:29.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:29 smithi153 ceph-mon[66339]: from='client.44247 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:29.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:29 smithi153 ceph-mon[66339]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:29.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:29 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/161429354' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:29.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:29 smithi023 ceph-mon[78509]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:29.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:29 smithi023 ceph-mon[78509]: from='client.44247 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:29.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:29 smithi023 ceph-mon[78509]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:29.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:29 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/161429354' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:30.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.040+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20c819dde0 con 0x7f20c81012c0 2024-02-28T16:30:30.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.041+0000 7f20c4c00700 1 -- 172.21.15.23:0/2218464897 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f20b4027070 con 0x7f20c81012c0 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:30:30.031 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:30:30.032 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:30:30.033 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:30:30.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20ac06d8a0 msgr2=0x7f20ac06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20ac06d8a0 0x7f20ac06fd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20b8007900 tx=0x7f20b8008040 comp rx=0 tx=0).stop 2024-02-28T16:30:30.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 msgr2=0x7f20c8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8073140 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20b4005b40 tx=0x7f20b400be20 comp rx=0 tx=0).stop 2024-02-28T16:30:30.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 shutdown_connections 2024-02-28T16:30:30.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c8100020 0x7f20c8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20ac06d8a0 0x7f20ac06fd50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 --2- 172.21.15.23:0/2218464897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c81012c0 0x7f20c8073140 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 >> 172.21.15.23:0/2218464897 conn(0x7f20c80fb650 msgr2=0x7f20c81044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:30.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.044+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 shutdown_connections 2024-02-28T16:30:30.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.045+0000 7f20cdc00700 1 -- 172.21.15.23:0/2218464897 wait complete. 2024-02-28T16:30:30.035 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.196+0000 7f666da00700 1 -- 172.21.15.23:0/1270602743 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 msgr2=0x7f6668101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.196+0000 7f666da00700 1 --2- 172.21.15.23:0/1270602743 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f6668101890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6654009910 tx=0x7f6654009c20 comp rx=0 tx=0).stop 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.197+0000 7f666da00700 1 -- 172.21.15.23:0/1270602743 shutdown_connections 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.197+0000 7f666da00700 1 --2- 172.21.15.23:0/1270602743 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f6668101890 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.197+0000 7f666da00700 1 --2- 172.21.15.23:0/1270602743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6668100240 0x7f6668100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.197+0000 7f666da00700 1 -- 172.21.15.23:0/1270602743 >> 172.21.15.23:0/1270602743 conn(0x7f66680fb7f0 msgr2=0x7f66680fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.197+0000 7f666da00700 1 -- 172.21.15.23:0/1270602743 shutdown_connections 2024-02-28T16:30:30.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.197+0000 7f666da00700 1 -- 172.21.15.23:0/1270602743 wait complete. 2024-02-28T16:30:30.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.198+0000 7f666da00700 1 Processor -- start 2024-02-28T16:30:30.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.198+0000 7f666da00700 1 -- start start 2024-02-28T16:30:30.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f666da00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6668100240 0x7f6668197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:30.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f666da00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f66681981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:30.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f666da00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66681987d0 con 0x7f6668101440 2024-02-28T16:30:30.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f666da00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668198940 con 0x7f6668100240 2024-02-28T16:30:30.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f66681981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:30.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f66681981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:60960/0 (socket says 172.21.15.23:60960) 2024-02-28T16:30:30.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666000700 1 -- 172.21.15.23:0/1063428229 learned_addr learned my addr 172.21.15.23:0/1063428229 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:30:30.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666a00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6668100240 0x7f6668197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:30.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666000700 1 -- 172.21.15.23:0/1063428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6668100240 msgr2=0x7f6668197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666000700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6668100240 0x7f6668197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666000700 1 -- 172.21.15.23:0/1063428229 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66540095f0 con 0x7f6668101440 2024-02-28T16:30:30.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.199+0000 7f6666a00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6668100240 0x7f6668197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:30:30.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.200+0000 7f6666000700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f66681981d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6654000c00 tx=0x7f665400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:30.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.200+0000 7f665f400700 1 -- 172.21.15.23:0/1063428229 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f665401d070 con 0x7f6668101440 2024-02-28T16:30:30.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.200+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666819d370 con 0x7f6668101440 2024-02-28T16:30:30.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.200+0000 7f665f400700 1 -- 172.21.15.23:0/1063428229 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6654005dc0 con 0x7f6668101440 2024-02-28T16:30:30.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.200+0000 7f665f400700 1 -- 172.21.15.23:0/1063428229 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66540226a0 con 0x7f6668101440 2024-02-28T16:30:30.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.200+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666819d860 con 0x7f6668101440 2024-02-28T16:30:30.194 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.201+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6668105520 con 0x7f6668101440 2024-02-28T16:30:30.194 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.205+0000 7f665f400700 1 -- 172.21.15.23:0/1063428229 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6654003680 con 0x7f6668101440 2024-02-28T16:30:30.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.206+0000 7f665f400700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f664c06d8a0 0x7f664c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:30.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.206+0000 7f665f400700 1 -- 172.21.15.23:0/1063428229 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f665408ea50 con 0x7f6668101440 2024-02-28T16:30:30.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.208+0000 7f6666a00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f664c06d8a0 0x7f664c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:30.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.208+0000 7f6666a00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f664c06d8a0 0x7f664c06fd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6668198b70 tx=0x7f6658009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:30.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.212+0000 7f665f400700 1 -- 172.21.15.23:0/1063428229 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6654058250 con 0x7f6668101440 2024-02-28T16:30:30.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.454+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6668061190 con 0x7f664c06d8a0 2024-02-28T16:30:30.445 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.456+0000 7f665f400700 1 -- 172.21.15.23:0/1063428229 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6668061190 con 0x7f664c06d8a0 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "10/23 daemons upgraded", 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:30:30.446 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:30:30.448 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.459+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f664c06d8a0 msgr2=0x7f664c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.459+0000 7f666da00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f664c06d8a0 0x7f664c06fd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6668198b70 tx=0x7f6658009260 comp rx=0 tx=0).stop 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.459+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 msgr2=0x7f66681981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.459+0000 7f666da00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f66681981d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6654000c00 tx=0x7f665400f740 comp rx=0 tx=0).stop 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.459+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 shutdown_connections 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.460+0000 7f666da00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6668100240 0x7f6668197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.460+0000 7f666da00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f664c06d8a0 0x7f664c06fd50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.460+0000 7f666da00700 1 --2- 172.21.15.23:0/1063428229 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6668101440 0x7f66681981d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.460+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 >> 172.21.15.23:0/1063428229 conn(0x7f66680fb7f0 msgr2=0x7f6668102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.460+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 shutdown_connections 2024-02-28T16:30:30.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.460+0000 7f666da00700 1 -- 172.21.15.23:0/1063428229 wait complete. 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 -- 172.21.15.23:0/1409787655 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018106840 msgr2=0x7f3018106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 --2- 172.21.15.23:0/1409787655 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018106840 0x7f3018106c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3008009910 tx=0x7f3008009c20 comp rx=0 tx=0).stop 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 -- 172.21.15.23:0/1409787655 shutdown_connections 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 --2- 172.21.15.23:0/1409787655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3018107a40 0x7f3018107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 --2- 172.21.15.23:0/1409787655 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018106840 0x7f3018106c50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 -- 172.21.15.23:0/1409787655 >> 172.21.15.23:0/1409787655 conn(0x7f3018075970 msgr2=0x7f3018077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 -- 172.21.15.23:0/1409787655 shutdown_connections 2024-02-28T16:30:30.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.608+0000 7f301f000700 1 -- 172.21.15.23:0/1409787655 wait complete. 2024-02-28T16:30:30.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.609+0000 7f301f000700 1 Processor -- start 2024-02-28T16:30:30.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.609+0000 7f301f000700 1 -- start start 2024-02-28T16:30:30.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.609+0000 7f301f000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3018106840 0x7f301819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:30.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.609+0000 7f301f000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018107a40 0x7f301819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:30.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.609+0000 7f301f000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301819cc60 con 0x7f3018107a40 2024-02-28T16:30:30.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.609+0000 7f301f000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301819cda0 con 0x7f3018106840 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.610+0000 7f3017400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018107a40 0x7f301819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.610+0000 7f3017400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018107a40 0x7f301819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:60988/0 (socket says 172.21.15.23:60988) 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.610+0000 7f3017400700 1 -- 172.21.15.23:0/3660129975 learned_addr learned my addr 172.21.15.23:0/3660129975 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.610+0000 7f3017e00700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3018106840 0x7f301819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.610+0000 7f3017400700 1 -- 172.21.15.23:0/3660129975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3018106840 msgr2=0x7f301819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.610+0000 7f3017400700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3018106840 0x7f301819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.610+0000 7f3017400700 1 -- 172.21.15.23:0/3660129975 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30080095f0 con 0x7f3018107a40 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.611+0000 7f3017400700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018107a40 0x7f301819c640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f300400d8d0 tx=0x7f300400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.611+0000 7f3014c00700 1 -- 172.21.15.23:0/3660129975 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3004009940 con 0x7f3018107a40 2024-02-28T16:30:30.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.611+0000 7f3014c00700 1 -- 172.21.15.23:0/3660129975 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3004010460 con 0x7f3018107a40 2024-02-28T16:30:30.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.611+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30181a1850 con 0x7f3018107a40 2024-02-28T16:30:30.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.611+0000 7f3014c00700 1 -- 172.21.15.23:0/3660129975 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300400f5f0 con 0x7f3018107a40 2024-02-28T16:30:30.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.611+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30181a1da0 con 0x7f3018107a40 2024-02-28T16:30:30.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.612+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301810f390 con 0x7f3018107a40 2024-02-28T16:30:30.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.613+0000 7f3014c00700 1 -- 172.21.15.23:0/3660129975 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f30040105d0 con 0x7f3018107a40 2024-02-28T16:30:30.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.614+0000 7f3014c00700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ffc06d8a0 0x7f2ffc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:30.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.614+0000 7f3014c00700 1 -- 172.21.15.23:0/3660129975 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f300408d560 con 0x7f3018107a40 2024-02-28T16:30:30.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.614+0000 7f3017e00700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ffc06d8a0 0x7f2ffc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:30.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.615+0000 7f3017e00700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ffc06d8a0 0x7f2ffc06fd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3008006010 tx=0x7f300800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:30.607 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.619+0000 7f3014c00700 1 -- 172.21.15.23:0/3660129975 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f300405a7f0 con 0x7f3018107a40 2024-02-28T16:30:30.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:30 smithi153 ceph-mon[66339]: pgmap v164: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:30.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:30 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2218464897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:30:30.912 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.923+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f301810f580 con 0x7f3018107a40 2024-02-28T16:30:30.912 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:30 smithi023 ceph-mon[78509]: pgmap v164: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:30.912 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:30 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2218464897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:30:30.912 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.924+0000 7f3014c00700 1 -- 172.21.15.23:0/3660129975 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1106 (secure 0 0 0) 0x7f300405a380 con 0x7f3018107a40 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: osd.4 (root=default,host=smithi153) is down 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-28T16:30:30.913 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-28T16:30:30.914 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ffc06d8a0 msgr2=0x7f2ffc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ffc06d8a0 0x7f2ffc06fd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3008006010 tx=0x7f300800b540 comp rx=0 tx=0).stop 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018107a40 msgr2=0x7f301819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018107a40 0x7f301819c640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f300400d8d0 tx=0x7f300400dc90 comp rx=0 tx=0).stop 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 shutdown_connections 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3018106840 0x7f301819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ffc06d8a0 0x7f2ffc06fd50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 --2- 172.21.15.23:0/3660129975 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3018107a40 0x7f301819c640 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:30.916 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 >> 172.21.15.23:0/3660129975 conn(0x7f3018075970 msgr2=0x7f301810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:30.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 shutdown_connections 2024-02-28T16:30:30.917 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:30:30.927+0000 7f301f000700 1 -- 172.21.15.23:0/3660129975 wait complete. 2024-02-28T16:30:31.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:31 smithi153 ceph-mon[66339]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:31.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:31 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3660129975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:30:31.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:31 smithi023 ceph-mon[78509]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:31.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:31 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3660129975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:30:33.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:32 smithi153 ceph-mon[66339]: pgmap v165: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:33.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:33.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:33.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:32 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T16:30:33.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:32 smithi023 ceph-mon[78509]: pgmap v165: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:33.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:32 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T16:30:33.644 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:33 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:30:33.205+0000 7fcfefa5d7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-28T16:30:34.145 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:33 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:30:33.880+0000 7fcfefa5d7c0 -1 osd.4 70 log_to_monitors true 2024-02-28T16:30:35.145 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:30:34 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:30:34.918+0000 7fcfdee00700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:30:35.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:34 smithi153 ceph-mon[66339]: pgmap v166: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:35.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:35.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:35.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:34 smithi153 ceph-mon[66339]: from='osd.4 [v2:172.21.15.153:6808/1758644183,v1:172.21.15.153:6809/1758644183]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:30:35.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:34 smithi153 ceph-mon[66339]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:30:35.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:34 smithi023 ceph-mon[78509]: pgmap v166: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:35.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:35.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:35.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:34 smithi023 ceph-mon[78509]: from='osd.4 [v2:172.21.15.153:6808/1758644183,v1:172.21.15.153:6809/1758644183]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:30:35.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:34 smithi023 ceph-mon[78509]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:30:36.008 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:35 smithi153 ceph-mon[66339]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:30:36.008 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:35 smithi153 ceph-mon[66339]: osdmap e73: 6 total, 5 up, 6 in 2024-02-28T16:30:36.008 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:35 smithi153 ceph-mon[66339]: from='osd.4 [v2:172.21.15.153:6808/1758644183,v1:172.21.15.153:6809/1758644183]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:30:36.008 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:35 smithi153 ceph-mon[66339]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:30:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:35 smithi023 ceph-mon[78509]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:30:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:35 smithi023 ceph-mon[78509]: osdmap e73: 6 total, 5 up, 6 in 2024-02-28T16:30:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:35 smithi023 ceph-mon[78509]: from='osd.4 [v2:172.21.15.153:6808/1758644183,v1:172.21.15.153:6809/1758644183]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:30:36.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:35 smithi023 ceph-mon[78509]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:30:36.915 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: pgmap v168: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 937 MiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: pgmap v168: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 937 MiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: osd.4 [v2:172.21.15.153:6808/1758644183,v1:172.21.15.153:6809/1758644183] boot 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: osdmap e74: 6 total, 6 up, 6 in 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:37.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:36 smithi023 ceph-mon[78509]: osdmap e75: 6 total, 6 up, 6 in 2024-02-28T16:30:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:30:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: osd.4 [v2:172.21.15.153:6808/1758644183,v1:172.21.15.153:6809/1758644183] boot 2024-02-28T16:30:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: osdmap e74: 6 total, 6 up, 6 in 2024-02-28T16:30:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:30:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:37.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:36 smithi153 ceph-mon[66339]: osdmap e75: 6 total, 6 up, 6 in 2024-02-28T16:30:38.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:37 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:30:38.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:37 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:30:39.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: pgmap v171: 65 pgs: 1 peering, 14 active+undersized+degraded, 15 active+undersized, 35 active+clean; 209 MiB data, 937 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:30:39.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:39.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:39.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:39.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:39.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:39.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:39.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:39.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:39.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:39.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: pgmap v171: 65 pgs: 1 peering, 14 active+undersized+degraded, 15 active+undersized, 35 active+clean; 209 MiB data, 937 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:39.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:40.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:39 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:40.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:39 smithi153 ceph-mon[66339]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-02-28T16:30:40.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:39 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:40.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:39 smithi023 ceph-mon[78509]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-02-28T16:30:41.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:41 smithi153 ceph-mon[66339]: pgmap v172: 65 pgs: 1 peering, 2 active+undersized+degraded, 4 active+undersized, 58 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 4/228 objects degraded (1.754%) 2024-02-28T16:30:41.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:41 smithi023 ceph-mon[78509]: pgmap v172: 65 pgs: 1 peering, 2 active+undersized+degraded, 4 active+undersized, 58 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 4/228 objects degraded (1.754%) 2024-02-28T16:30:42.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:42 smithi023 ceph-mon[78509]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/228 objects degraded (1.754%), 2 pgs degraded) 2024-02-28T16:30:42.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:42 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:30:42.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:42 smithi153 ceph-mon[66339]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/228 objects degraded (1.754%), 2 pgs degraded) 2024-02-28T16:30:42.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:42 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:30:43.312 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:43 smithi153 ceph-mon[66339]: pgmap v173: 65 pgs: 1 peering, 64 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:43.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:43 smithi023 ceph-mon[78509]: pgmap v173: 65 pgs: 1 peering, 64 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:45.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:45 smithi153 ceph-mon[66339]: pgmap v174: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:45.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:45 smithi023 ceph-mon[78509]: pgmap v174: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:47.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:47 smithi153 ceph-mon[66339]: pgmap v175: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:47 smithi023 ceph-mon[78509]: pgmap v175: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:49.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:49 smithi023 ceph-mon[78509]: pgmap v176: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:49 smithi153 ceph-mon[66339]: pgmap v176: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:51.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:51 smithi153 ceph-mon[66339]: pgmap v177: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:51.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:51 smithi023 ceph-mon[78509]: pgmap v177: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:52 smithi153 ceph-mon[66339]: pgmap v178: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:52.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:52 smithi023 ceph-mon[78509]: pgmap v178: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:54.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:54 smithi153 ceph-mon[66339]: pgmap v179: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:54.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:54 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:54.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:54 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:54.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:54 smithi153 ceph-mon[66339]: Upgrade: osd.5 is safe to restart 2024-02-28T16:30:54.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:54 smithi023 ceph-mon[78509]: pgmap v179: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:54.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:54 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:54.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:54 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:30:54.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:54 smithi023 ceph-mon[78509]: Upgrade: osd.5 is safe to restart 2024-02-28T16:30:57.209 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:57 smithi153 ceph-mon[66339]: pgmap v180: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:57.209 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:57 smithi153 ceph-mon[66339]: Upgrade: Updating osd.5 2024-02-28T16:30:57.209 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:57.209 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:30:57.209 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:57.209 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:57 smithi153 ceph-mon[66339]: Deploying daemon osd.5 on smithi153 2024-02-28T16:30:57.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:57 smithi023 ceph-mon[78509]: pgmap v180: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:57.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:57 smithi023 ceph-mon[78509]: Upgrade: Updating osd.5 2024-02-28T16:30:57.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:30:57.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:30:57.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:57.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:57 smithi023 ceph-mon[78509]: Deploying daemon osd.5 on smithi153 2024-02-28T16:30:59.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:30:59 smithi153 ceph-mon[66339]: pgmap v181: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:30:59.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:30:59 smithi023 ceph-mon[78509]: pgmap v181: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:31:01.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.105+0000 7f0f47600700 1 -- 172.21.15.23:0/1532019484 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f40100240 msgr2=0x7f0f40100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.105+0000 7f0f47600700 1 --2- 172.21.15.23:0/1532019484 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f40100240 0x7f0f40100650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000b0a0 tx=0x7f0f3000b3b0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.106+0000 7f0f47600700 1 -- 172.21.15.23:0/1532019484 shutdown_connections 2024-02-28T16:31:01.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.106+0000 7f0f47600700 1 --2- 172.21.15.23:0/1532019484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f401014e0 0x7f0f40101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.106+0000 7f0f47600700 1 --2- 172.21.15.23:0/1532019484 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f40100240 0x7f0f40100650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.106+0000 7f0f47600700 1 -- 172.21.15.23:0/1532019484 >> 172.21.15.23:0/1532019484 conn(0x7f0f400fb890 msgr2=0x7f0f400fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:01.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.106+0000 7f0f47600700 1 -- 172.21.15.23:0/1532019484 shutdown_connections 2024-02-28T16:31:01.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.106+0000 7f0f47600700 1 -- 172.21.15.23:0/1532019484 wait complete. 2024-02-28T16:31:01.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.107+0000 7f0f47600700 1 Processor -- start 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.107+0000 7f0f47600700 1 -- start start 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f47600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f40100240 0x7f0f40197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f47600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f401014e0 0x7f0f40198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f47600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40198860 con 0x7f0f401014e0 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f47600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4019d270 con 0x7f0f40100240 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f37e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f401014e0 0x7f0f40198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f37e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f401014e0 0x7f0f40198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56500/0 (socket says 172.21.15.23:56500) 2024-02-28T16:31:01.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f37e00700 1 -- 172.21.15.23:0/511990257 learned_addr learned my addr 172.21.15.23:0/511990257 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f37e00700 1 -- 172.21.15.23:0/511990257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f40100240 msgr2=0x7f0f40197d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f37e00700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f40100240 0x7f0f40197d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.108+0000 7f0f37e00700 1 -- 172.21.15.23:0/511990257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f30009d00 con 0x7f0f401014e0 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.109+0000 7f0f37e00700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f401014e0 0x7f0f40198240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00d8d0 tx=0x7f0f2c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.109+0000 7f0f3e000700 1 -- 172.21.15.23:0/511990257 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f2c009940 con 0x7f0f401014e0 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.109+0000 7f0f3e000700 1 -- 172.21.15.23:0/511990257 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f2c010460 con 0x7f0f401014e0 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.109+0000 7f0f3e000700 1 -- 172.21.15.23:0/511990257 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f2c00f5f0 con 0x7f0f401014e0 2024-02-28T16:31:01.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.109+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4019d470 con 0x7f0f401014e0 2024-02-28T16:31:01.099 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.109+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4019d990 con 0x7f0f401014e0 2024-02-28T16:31:01.099 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.111+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f401055c0 con 0x7f0f401014e0 2024-02-28T16:31:01.100 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.112+0000 7f0f3e000700 1 -- 172.21.15.23:0/511990257 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0f2c0105d0 con 0x7f0f401014e0 2024-02-28T16:31:01.102 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.113+0000 7f0f3e000700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f2406d8a0 0x7f0f2406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.102 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.113+0000 7f0f3e000700 1 -- 172.21.15.23:0/511990257 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0f2c08d470 con 0x7f0f401014e0 2024-02-28T16:31:01.102 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.113+0000 7f0f44c00700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f2406d8a0 0x7f0f2406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.102 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.114+0000 7f0f44c00700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f2406d8a0 0x7f0f2406fd50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009480 tx=0x7f0f30000f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:01.107 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.118+0000 7f0f3e000700 1 -- 172.21.15.23:0/511990257 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0f2c056c50 con 0x7f0f401014e0 2024-02-28T16:31:01.360 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.370+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f40061190 con 0x7f0f2406d8a0 2024-02-28T16:31:01.360 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:01 smithi023 ceph-mon[78509]: pgmap v182: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:31:01.362 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.373+0000 7f0f3e000700 1 -- 172.21.15.23:0/511990257 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0f40061190 con 0x7f0f2406d8a0 2024-02-28T16:31:01.365 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f2406d8a0 msgr2=0x7f0f2406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.365 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f2406d8a0 0x7f0f2406fd50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009480 tx=0x7f0f30000f40 comp rx=0 tx=0).stop 2024-02-28T16:31:01.365 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f401014e0 msgr2=0x7f0f40198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.365 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f401014e0 0x7f0f40198240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00d8d0 tx=0x7f0f2c00dc90 comp rx=0 tx=0).stop 2024-02-28T16:31:01.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 shutdown_connections 2024-02-28T16:31:01.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f40100240 0x7f0f40197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f2406d8a0 0x7f0f2406fd50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 --2- 172.21.15.23:0/511990257 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f401014e0 0x7f0f40198240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.376+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 >> 172.21.15.23:0/511990257 conn(0x7f0f400fb890 msgr2=0x7f0f40102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:01.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.377+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 shutdown_connections 2024-02-28T16:31:01.366 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.377+0000 7f0f47600700 1 -- 172.21.15.23:0/511990257 wait complete. 2024-02-28T16:31:01.382 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:31:01.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:01 smithi153 ceph-mon[66339]: pgmap v182: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:31:01.395 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:01 smithi153 systemd[1]: Stopping Ceph osd.5 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.536+0000 7f29c8e00700 1 -- 172.21.15.23:0/3112741882 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 msgr2=0x7f29c40ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.536+0000 7f29c8e00700 1 --2- 172.21.15.23:0/3112741882 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c40ff910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009910 tx=0x7f29b0009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.537+0000 7f29c8e00700 1 -- 172.21.15.23:0/3112741882 shutdown_connections 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.537+0000 7f29c8e00700 1 --2- 172.21.15.23:0/3112741882 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c40ff910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.537+0000 7f29c8e00700 1 --2- 172.21.15.23:0/3112741882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c40feb50 0x7f29c40fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.537+0000 7f29c8e00700 1 -- 172.21.15.23:0/3112741882 >> 172.21.15.23:0/3112741882 conn(0x7f29c40fa780 msgr2=0x7f29c40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.537+0000 7f29c8e00700 1 -- 172.21.15.23:0/3112741882 shutdown_connections 2024-02-28T16:31:01.526 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.537+0000 7f29c8e00700 1 -- 172.21.15.23:0/3112741882 wait complete. 2024-02-28T16:31:01.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.538+0000 7f29c8e00700 1 Processor -- start 2024-02-28T16:31:01.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.538+0000 7f29c8e00700 1 -- start start 2024-02-28T16:31:01.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.538+0000 7f29c8e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c40feb50 0x7f29c4197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.538+0000 7f29c8e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.538+0000 7f29c8e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c41988f0 con 0x7f29c40ff4a0 2024-02-28T16:31:01.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.538+0000 7f29c8e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c419d300 con 0x7f29c40feb50 2024-02-28T16:31:01.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c41982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56528/0 (socket says 172.21.15.23:56528) 2024-02-28T16:31:01.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1400700 1 -- 172.21.15.23:0/316482093 learned_addr learned my addr 172.21.15.23:0/316482093 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c40feb50 0x7f29c4197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1400700 1 -- 172.21.15.23:0/316482093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c40feb50 msgr2=0x7f29c4197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1400700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c40feb50 0x7f29c4197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1400700 1 -- 172.21.15.23:0/316482093 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00095f0 con 0x7f29c40ff4a0 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.539+0000 7f29c1400700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c41982d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f29b0005b40 tx=0x7f29b000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.540+0000 7f29baa00700 1 -- 172.21.15.23:0/316482093 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b001d070 con 0x7f29c40ff4a0 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.540+0000 7f29baa00700 1 -- 172.21.15.23:0/316482093 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29b0022470 con 0x7f29c40ff4a0 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.540+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c419d4a0 con 0x7f29c40ff4a0 2024-02-28T16:31:01.529 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.540+0000 7f29baa00700 1 -- 172.21.15.23:0/316482093 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b000f690 con 0x7f29c40ff4a0 2024-02-28T16:31:01.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.540+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c419d960 con 0x7f29c40ff4a0 2024-02-28T16:31:01.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.541+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c410af90 con 0x7f29c40ff4a0 2024-02-28T16:31:01.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.542+0000 7f29baa00700 1 -- 172.21.15.23:0/316482093 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f29b00225e0 con 0x7f29c40ff4a0 2024-02-28T16:31:01.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.543+0000 7f29baa00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f29a806d8a0 0x7f29a806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.543+0000 7f29baa00700 1 -- 172.21.15.23:0/316482093 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f29b008ed20 con 0x7f29c40ff4a0 2024-02-28T16:31:01.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.543+0000 7f29c1e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f29a806d8a0 0x7f29a806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.544+0000 7f29c1e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f29a806d8a0 0x7f29a806fd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006fd0 tx=0x7f29b4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:01.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.548+0000 7f29baa00700 1 -- 172.21.15.23:0/316482093 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f29b0058580 con 0x7f29c40ff4a0 2024-02-28T16:31:01.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.802+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29c41088a0 con 0x7f29a806d8a0 2024-02-28T16:31:01.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.804+0000 7f29baa00700 1 -- 172.21.15.23:0/316482093 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f29c41088a0 con 0x7f29a806d8a0 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f29a806d8a0 msgr2=0x7f29a806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f29a806d8a0 0x7f29a806fd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006fd0 tx=0x7f29b4008040 comp rx=0 tx=0).stop 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 msgr2=0x7f29c41982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c41982d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f29b0005b40 tx=0x7f29b000be20 comp rx=0 tx=0).stop 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 shutdown_connections 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c40feb50 0x7f29c4197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f29a806d8a0 0x7f29a806fd50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 --2- 172.21.15.23:0/316482093 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f29c40ff4a0 0x7f29c41982d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.807+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 >> 172.21.15.23:0/316482093 conn(0x7f29c40fa780 msgr2=0x7f29c4107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.808+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 shutdown_connections 2024-02-28T16:31:01.797 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.808+0000 7f29c8e00700 1 -- 172.21.15.23:0/316482093 wait complete. 2024-02-28T16:31:01.896 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:01 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[50752]: 2024-02-28T16:31:01.506+0000 7f24b8800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:31:01.896 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:01 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[50752]: 2024-02-28T16:31:01.506+0000 7f24b8800700 -1 osd.5 75 *** Got signal Terminated *** 2024-02-28T16:31:01.896 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:01 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[50752]: 2024-02-28T16:31:01.506+0000 7f24b8800700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 -- 172.21.15.23:0/316389470 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 msgr2=0x7f9e300731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 --2- 172.21.15.23:0/316389470 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e300731e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009910 tx=0x7f9e20009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 -- 172.21.15.23:0/316389470 shutdown_connections 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 --2- 172.21.15.23:0/316389470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e300737b0 0x7f9e30073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 --2- 172.21.15.23:0/316389470 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e300731e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 -- 172.21.15.23:0/316389470 >> 172.21.15.23:0/316389470 conn(0x7f9e300fb7f0 msgr2=0x7f9e300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 -- 172.21.15.23:0/316389470 shutdown_connections 2024-02-28T16:31:01.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.976+0000 7f9e35a00700 1 -- 172.21.15.23:0/316389470 wait complete. 2024-02-28T16:31:01.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.977+0000 7f9e35a00700 1 Processor -- start 2024-02-28T16:31:01.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.977+0000 7f9e35a00700 1 -- start start 2024-02-28T16:31:01.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e35a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e300737b0 0x7f9e3019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e35a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e3019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.966 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e35a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3019cbc0 con 0x7f9e30074d80 2024-02-28T16:31:01.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e35a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3019cd00 con 0x7f9e300737b0 2024-02-28T16:31:01.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e2e000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e3019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e2e000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e3019c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56546/0 (socket says 172.21.15.23:56546) 2024-02-28T16:31:01.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e2e000700 1 -- 172.21.15.23:0/3474666987 learned_addr learned my addr 172.21.15.23:0/3474666987 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:01.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.978+0000 7f9e2ea00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e300737b0 0x7f9e3019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.967 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e2e000700 1 -- 172.21.15.23:0/3474666987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e300737b0 msgr2=0x7f9e3019c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:01.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e2e000700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e300737b0 0x7f9e3019c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:01.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e2e000700 1 -- 172.21.15.23:0/3474666987 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200095f0 con 0x7f9e30074d80 2024-02-28T16:31:01.968 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e2e000700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e3019c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d8d0 tx=0x7f9e1c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:01.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e27400700 1 -- 172.21.15.23:0/3474666987 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1c009940 con 0x7f9e30074d80 2024-02-28T16:31:01.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e301a17b0 con 0x7f9e30074d80 2024-02-28T16:31:01.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e27400700 1 -- 172.21.15.23:0/3474666987 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e1c010460 con 0x7f9e30074d80 2024-02-28T16:31:01.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e27400700 1 -- 172.21.15.23:0/3474666987 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1c00f5f0 con 0x7f9e30074d80 2024-02-28T16:31:01.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.979+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e301a1d00 con 0x7f9e30074d80 2024-02-28T16:31:01.969 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.981+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3010f370 con 0x7f9e30074d80 2024-02-28T16:31:01.970 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.982+0000 7f9e27400700 1 -- 172.21.15.23:0/3474666987 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9e1c0105d0 con 0x7f9e30074d80 2024-02-28T16:31:01.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.982+0000 7f9e27400700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9e1406d8a0 0x7f9e1406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:01.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.983+0000 7f9e27400700 1 -- 172.21.15.23:0/3474666987 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9e1c08d3d0 con 0x7f9e30074d80 2024-02-28T16:31:01.971 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.983+0000 7f9e2ea00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9e1406d8a0 0x7f9e1406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:01.972 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.984+0000 7f9e2ea00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9e1406d8a0 0x7f9e1406fd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006010 tx=0x7f9e2000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:01.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:01.987+0000 7f9e27400700 1 -- 172.21.15.23:0/3474666987 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9e1c05a780 con 0x7f9e30074d80 2024-02-28T16:31:02.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.243+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e301032f0 con 0x7f9e1406d8a0 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.275+0000 7f9e27400700 1 -- 172.21.15.23:0/3474666987 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9e301032f0 con 0x7f9e1406d8a0 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (16m) 114s ago 17m 14.2M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (18m) 114s ago 18m 8610k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (16m) 30s ago 16m 8238k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (3m) 114s ago 18m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (3m) 30s ago 16m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:31:02.264 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (15m) 114s ago 17m 74.5M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (10m) 114s ago 10m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (10m) 114s ago 10m 16.5M - 18.2.0 dc2bc1663786 9da59b899234 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (10m) 30s ago 10m 17.0M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (10m) 30s ago 10m 17.2M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (7m) 114s ago 19m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (5m) 30s ago 16m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (5m) 114s ago 19m 46.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (4m) 30s ago 16m 40.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (18m) 114s ago 18m 8010k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (16m) 30s ago 16m 8102k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (3m) 114s ago 15m 89.3M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (2m) 114s ago 14m 98.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (2m) 114s ago 14m 11.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:31:02.265 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (77s) 30s ago 13m 106M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:31:02.266 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (35s) 30s ago 13m 12.6M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:31:02.266 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (12m) 30s ago 12m 227M 2241M 18.2.0 dc2bc1663786 29c6d839f44e 2024-02-28T16:31:02.266 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (5m) 114s ago 17m 58.5M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:31:02.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9e1406d8a0 msgr2=0x7f9e1406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9e1406d8a0 0x7f9e1406fd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006010 tx=0x7f9e2000b540 comp rx=0 tx=0).stop 2024-02-28T16:31:02.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 msgr2=0x7f9e3019c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e3019c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d8d0 tx=0x7f9e1c00dc90 comp rx=0 tx=0).stop 2024-02-28T16:31:02.267 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 shutdown_connections 2024-02-28T16:31:02.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e300737b0 0x7f9e3019c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9e1406d8a0 0x7f9e1406fd50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 --2- 172.21.15.23:0/3474666987 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9e30074d80 0x7f9e3019c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 >> 172.21.15.23:0/3474666987 conn(0x7f9e300fb7f0 msgr2=0x7f9e30101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:02.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 shutdown_connections 2024-02-28T16:31:02.268 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.278+0000 7f9e35a00700 1 -- 172.21.15.23:0/3474666987 wait complete. 2024-02-28T16:31:02.384 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:02 smithi023 ceph-mon[78509]: osd.5 marked itself down and dead 2024-02-28T16:31:02.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:02 smithi153 ceph-mon[66339]: osd.5 marked itself down and dead 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 -- 172.21.15.23:0/2303065916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234106840 msgr2=0x7f2234106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 --2- 172.21.15.23:0/2303065916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234106840 0x7f2234106c50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2228009910 tx=0x7f2228009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 -- 172.21.15.23:0/2303065916 shutdown_connections 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 --2- 172.21.15.23:0/2303065916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2234107a40 0x7f2234107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 --2- 172.21.15.23:0/2303065916 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234106840 0x7f2234106c50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 -- 172.21.15.23:0/2303065916 >> 172.21.15.23:0/2303065916 conn(0x7f2234075970 msgr2=0x7f2234077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 -- 172.21.15.23:0/2303065916 shutdown_connections 2024-02-28T16:31:02.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.425+0000 7f223c000700 1 -- 172.21.15.23:0/2303065916 wait complete. 2024-02-28T16:31:02.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.426+0000 7f223c000700 1 Processor -- start 2024-02-28T16:31:02.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.426+0000 7f223c000700 1 -- start start 2024-02-28T16:31:02.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.426+0000 7f223c000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2234106840 0x7f223419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:02.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.426+0000 7f223c000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234107a40 0x7f223419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:02.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.426+0000 7f223c000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223419cd10 con 0x7f2234107a40 2024-02-28T16:31:02.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.426+0000 7f223c000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223419ce50 con 0x7f2234106840 2024-02-28T16:31:02.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2238c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234107a40 0x7f223419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:02.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2238c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234107a40 0x7f223419c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56564/0 (socket says 172.21.15.23:56564) 2024-02-28T16:31:02.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2238c00700 1 -- 172.21.15.23:0/2065766310 learned_addr learned my addr 172.21.15.23:0/2065766310 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2238c00700 1 -- 172.21.15.23:0/2065766310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2234106840 msgr2=0x7f223419c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2238c00700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2234106840 0x7f223419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2238c00700 1 -- 172.21.15.23:0/2065766310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280095f0 con 0x7f2234107a40 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2238c00700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234107a40 0x7f223419c6f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f222000b4b0 tx=0x7f222000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.427+0000 7f2232000700 1 -- 172.21.15.23:0/2065766310 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2220011800 con 0x7f2234107a40 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.428+0000 7f2232000700 1 -- 172.21.15.23:0/2065766310 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2220011e10 con 0x7f2234107a40 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.428+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22341a1900 con 0x7f2234107a40 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.428+0000 7f2232000700 1 -- 172.21.15.23:0/2065766310 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222000f2e0 con 0x7f2234107a40 2024-02-28T16:31:02.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.428+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22341a1e50 con 0x7f2234107a40 2024-02-28T16:31:02.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.429+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223410f410 con 0x7f2234107a40 2024-02-28T16:31:02.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.430+0000 7f2232000700 1 -- 172.21.15.23:0/2065766310 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2220010380 con 0x7f2234107a40 2024-02-28T16:31:02.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.431+0000 7f2232000700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f221c06d8a0 0x7f221c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:02.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.431+0000 7f2232000700 1 -- 172.21.15.23:0/2065766310 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f222008d0c0 con 0x7f2234107a40 2024-02-28T16:31:02.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.431+0000 7f2239600700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f221c06d8a0 0x7f221c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:02.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.432+0000 7f2239600700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f221c06d8a0 0x7f221c06fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2228005090 tx=0x7f2228005fb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:02.424 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.435+0000 7f2232000700 1 -- 172.21.15.23:0/2065766310 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f222005a3d0 con 0x7f2234107a40 2024-02-28T16:31:02.734 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.745+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f223410f5d0 con 0x7f2234107a40 2024-02-28T16:31:02.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.746+0000 7f2232000700 1 -- 172.21.15.23:0/2065766310 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+700 (secure 0 0 0) 0x7f2220056070 con 0x7f2234107a40 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:02.736 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:31:02.737 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-02-28T16:31:02.737 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 9 2024-02-28T16:31:02.737 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:31:02.737 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:31:02.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f221c06d8a0 msgr2=0x7f221c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f221c06d8a0 0x7f221c06fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2228005090 tx=0x7f2228005fb0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234107a40 msgr2=0x7f223419c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234107a40 0x7f223419c6f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f222000b4b0 tx=0x7f222000b870 comp rx=0 tx=0).stop 2024-02-28T16:31:02.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 shutdown_connections 2024-02-28T16:31:02.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2234106840 0x7f223419c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f221c06d8a0 0x7f221c06fd50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 --2- 172.21.15.23:0/2065766310 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2234107a40 0x7f223419c6f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 >> 172.21.15.23:0/2065766310 conn(0x7f2234075970 msgr2=0x7f223410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:02.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 shutdown_connections 2024-02-28T16:31:02.739 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.749+0000 7f223c000700 1 -- 172.21.15.23:0/2065766310 wait complete. 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.908+0000 7f4ff5a00700 1 -- 172.21.15.23:0/3035857657 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0103680 msgr2=0x7f4ff0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.908+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/3035857657 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0103680 0x7f4ff0105a60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009910 tx=0x7f4fdc009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.909+0000 7f4ff5a00700 1 -- 172.21.15.23:0/3035857657 shutdown_connections 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.909+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/3035857657 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0103680 0x7f4ff0105a60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.909+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/3035857657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ff0100d60 0x7f4ff0103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.909+0000 7f4ff5a00700 1 -- 172.21.15.23:0/3035857657 >> 172.21.15.23:0/3035857657 conn(0x7f4ff00fa780 msgr2=0x7f4ff00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.909+0000 7f4ff5a00700 1 -- 172.21.15.23:0/3035857657 shutdown_connections 2024-02-28T16:31:02.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.909+0000 7f4ff5a00700 1 -- 172.21.15.23:0/3035857657 wait complete. 2024-02-28T16:31:02.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.910+0000 7f4ff5a00700 1 Processor -- start 2024-02-28T16:31:02.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4ff5a00700 1 -- start start 2024-02-28T16:31:02.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4ff5a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0100d60 0x7f4ff0197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:02.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4ff5a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ff0103680 0x7f4ff0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:02.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4ff5a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff0198850 con 0x7f4ff0100d60 2024-02-28T16:31:02.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4ff5a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff019d260 con 0x7f4ff0103680 2024-02-28T16:31:02.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4feea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0100d60 0x7f4ff0197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:02.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4feea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0100d60 0x7f4ff0197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56586/0 (socket says 172.21.15.23:56586) 2024-02-28T16:31:02.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.911+0000 7f4feea00700 1 -- 172.21.15.23:0/2073184683 learned_addr learned my addr 172.21.15.23:0/2073184683 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:02.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.912+0000 7f4fee000700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ff0103680 0x7f4ff0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:02.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.912+0000 7f4feea00700 1 -- 172.21.15.23:0/2073184683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ff0103680 msgr2=0x7f4ff0198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:02.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.912+0000 7f4feea00700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ff0103680 0x7f4ff0198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:02.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.912+0000 7f4feea00700 1 -- 172.21.15.23:0/2073184683 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc0095f0 con 0x7f4ff0100d60 2024-02-28T16:31:02.901 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.912+0000 7f4fee000700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ff0103680 0x7f4ff0198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:31:02.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.912+0000 7f4feea00700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0100d60 0x7f4ff0197cf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000d900 tx=0x7f4fe000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:02.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.912+0000 7f4fe7400700 1 -- 172.21.15.23:0/2073184683 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe0009900 con 0x7f4ff0100d60 2024-02-28T16:31:02.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.913+0000 7f4fe7400700 1 -- 172.21.15.23:0/2073184683 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fe0010460 con 0x7f4ff0100d60 2024-02-28T16:31:02.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.913+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff019d460 con 0x7f4ff0100d60 2024-02-28T16:31:02.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.913+0000 7f4fe7400700 1 -- 172.21.15.23:0/2073184683 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe000f5f0 con 0x7f4ff0100d60 2024-02-28T16:31:02.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.913+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff019d980 con 0x7f4ff0100d60 2024-02-28T16:31:02.903 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.914+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff00fc340 con 0x7f4ff0100d60 2024-02-28T16:31:02.904 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.915+0000 7f4fe7400700 1 -- 172.21.15.23:0/2073184683 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f4fe00105d0 con 0x7f4ff0100d60 2024-02-28T16:31:02.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.916+0000 7f4fe7400700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4fd406d8a0 0x7f4fd406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:02.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.916+0000 7f4fe7400700 1 -- 172.21.15.23:0/2073184683 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4fe008d320 con 0x7f4ff0100d60 2024-02-28T16:31:02.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.916+0000 7f4fee000700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4fd406d8a0 0x7f4fd406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:02.905 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.917+0000 7f4fee000700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4fd406d8a0 0x7f4fd406fd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc006010 tx=0x7f4fdc00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:02.910 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:02.921+0000 7f4fe7400700 1 -- 172.21.15.23:0/2073184683 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4fe0056b20 con 0x7f4ff0100d60 2024-02-28T16:31:03.069 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:02 smithi153 podman[76895]: 2024-02-28 16:31:02.734235503 +0000 UTC m=+1.345981199 container died 29c6d839f44e9721a543a31258cb5401ba994df16515000bf633c8cfef057641 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0) 2024-02-28T16:31:03.211 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.222+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ff0061a00 con 0x7f4ff0100d60 2024-02-28T16:31:03.211 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.223+0000 7f4fe7400700 1 -- 172.21.15.23:0/2073184683 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f4fe005a1e0 con 0x7f4ff0100d60 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:e16 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:31:03.212 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:31:03.213 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2195483511,v1:172.21.15.23:6827/2195483511] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:03.214 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:03.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4fd406d8a0 msgr2=0x7f4fd406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4fd406d8a0 0x7f4fd406fd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc006010 tx=0x7f4fdc00b540 comp rx=0 tx=0).stop 2024-02-28T16:31:03.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0100d60 msgr2=0x7f4ff0197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0100d60 0x7f4ff0197cf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000d900 tx=0x7f4fe000dcc0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 shutdown_connections 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4fd406d8a0 0x7f4fd406fd50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4ff0100d60 0x7f4ff0197cf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 --2- 172.21.15.23:0/2073184683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ff0103680 0x7f4ff0198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 >> 172.21.15.23:0/2073184683 conn(0x7f4ff00fa780 msgr2=0x7f4ff00ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 shutdown_connections 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.226+0000 7f4ff5a00700 1 -- 172.21.15.23:0/2073184683 wait complete. 2024-02-28T16:31:03.216 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:31:03.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.380+0000 7fea29a00700 1 -- 172.21.15.23:0/981714 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea24100d80 msgr2=0x7fea24103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.380+0000 7fea29a00700 1 --2- 172.21.15.23:0/981714 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea24100d80 0x7fea24103160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea1400b0a0 tx=0x7fea1400b3b0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.381+0000 7fea29a00700 1 -- 172.21.15.23:0/981714 shutdown_connections 2024-02-28T16:31:03.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:03 smithi023 ceph-mon[78509]: pgmap v183: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:31:03.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:03 smithi023 ceph-mon[78509]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:03.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:03 smithi023 ceph-mon[78509]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:03.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:03 smithi023 ceph-mon[78509]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:31:03.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:03 smithi023 ceph-mon[78509]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T16:31:03.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:03 smithi023 ceph-mon[78509]: osdmap e76: 6 total, 5 up, 6 in 2024-02-28T16:31:03.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:03 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2065766310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.381+0000 7fea29a00700 1 --2- 172.21.15.23:0/981714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea241036a0 0x7fea24105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.381+0000 7fea29a00700 1 --2- 172.21.15.23:0/981714 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea24100d80 0x7fea24103160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.381+0000 7fea29a00700 1 -- 172.21.15.23:0/981714 >> 172.21.15.23:0/981714 conn(0x7fea240fa7a0 msgr2=0x7fea240fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.381+0000 7fea29a00700 1 -- 172.21.15.23:0/981714 shutdown_connections 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.381+0000 7fea29a00700 1 -- 172.21.15.23:0/981714 wait complete. 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.382+0000 7fea29a00700 1 Processor -- start 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.382+0000 7fea29a00700 1 -- start start 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea29a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea24100d80 0x7fea241006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea29a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea241036a0 0x7fea240fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea29a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240ff270 con 0x7fea241036a0 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea29a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240ff3b0 con 0x7fea24100d80 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea1a000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea241036a0 0x7fea240fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea1a000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea241036a0 0x7fea240fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56596/0 (socket says 172.21.15.23:56596) 2024-02-28T16:31:03.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea1a000700 1 -- 172.21.15.23:0/3318392163 learned_addr learned my addr 172.21.15.23:0/3318392163 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:03.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.383+0000 7fea22a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea24100d80 0x7fea241006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea1a000700 1 -- 172.21.15.23:0/3318392163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea24100d80 msgr2=0x7fea241006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea1a000700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea24100d80 0x7fea241006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea1a000700 1 -- 172.21.15.23:0/3318392163 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009d00 con 0x7fea241036a0 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea1a000700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea241036a0 0x7fea240fed30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c8a0 tx=0x7fea0c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea1be00700 1 -- 172.21.15.23:0/3318392163 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c0078e0 con 0x7fea241036a0 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea1be00700 1 -- 172.21.15.23:0/3318392163 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea0c00f450 con 0x7fea241036a0 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea1be00700 1 -- 172.21.15.23:0/3318392163 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c00e5e0 con 0x7fea241036a0 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.384+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea240ff690 con 0x7fea241036a0 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.385+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2419de80 con 0x7fea241036a0 2024-02-28T16:31:03.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.386+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2418fbe0 con 0x7fea241036a0 2024-02-28T16:31:03.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.388+0000 7fea1be00700 1 -- 172.21.15.23:0/3318392163 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fea0c00f5c0 con 0x7fea241036a0 2024-02-28T16:31:03.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.389+0000 7fea1be00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fea0806d8a0 0x7fea0806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.389+0000 7fea1be00700 1 -- 172.21.15.23:0/3318392163 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fea0c08d550 con 0x7fea241036a0 2024-02-28T16:31:03.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.389+0000 7fea22a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fea0806d8a0 0x7fea0806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.390+0000 7fea22a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fea0806d8a0 0x7fea0806fd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea14009fd0 tx=0x7fea14000f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:03.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.394+0000 7fea1be00700 1 -- 172.21.15.23:0/3318392163 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fea0c05a7e0 con 0x7fea241036a0 2024-02-28T16:31:03.395 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:03 smithi153 podman[76895]: 2024-02-28 16:31:03.292993117 +0000 UTC m=+1.904738854 container cleanup 29c6d839f44e9721a543a31258cb5401ba994df16515000bf633c8cfef057641 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0) 2024-02-28T16:31:03.395 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:03 smithi153 bash[76895]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5 2024-02-28T16:31:03.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:03 smithi153 ceph-mon[66339]: pgmap v183: 65 pgs: 65 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:31:03.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:03 smithi153 ceph-mon[66339]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:03.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:03 smithi153 ceph-mon[66339]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:03.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:03 smithi153 ceph-mon[66339]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:31:03.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:03 smithi153 ceph-mon[66339]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T16:31:03.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:03 smithi153 ceph-mon[66339]: osdmap e76: 6 total, 5 up, 6 in 2024-02-28T16:31:03.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:03 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2065766310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:03.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.641+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea2402cfb0 con 0x7fea0806d8a0 2024-02-28T16:31:03.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.644+0000 7fea1be00700 1 -- 172.21.15.23:0/3318392163 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fea2402cfb0 con 0x7fea0806d8a0 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr" 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "11/23 daemons upgraded", 2024-02-28T16:31:03.633 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:31:03.634 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:31:03.634 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:31:03.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fea0806d8a0 msgr2=0x7fea0806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fea0806d8a0 0x7fea0806fd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea14009fd0 tx=0x7fea14000f40 comp rx=0 tx=0).stop 2024-02-28T16:31:03.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea241036a0 msgr2=0x7fea240fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea241036a0 0x7fea240fed30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c8a0 tx=0x7fea0c00cbb0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 shutdown_connections 2024-02-28T16:31:03.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea24100d80 0x7fea241006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fea0806d8a0 0x7fea0806fd50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 --2- 172.21.15.23:0/3318392163 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fea241036a0 0x7fea240fed30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 >> 172.21.15.23:0/3318392163 conn(0x7fea240fa7a0 msgr2=0x7fea240fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:03.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 shutdown_connections 2024-02-28T16:31:03.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.647+0000 7fea29a00700 1 -- 172.21.15.23:0/3318392163 wait complete. 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.815+0000 7fa560a00700 1 -- 172.21.15.23:0/2722974884 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c074ce0 msgr2=0x7fa55c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.815+0000 7fa560a00700 1 --2- 172.21.15.23:0/2722974884 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c074ce0 0x7fa55c0731e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009940 tx=0x7fa54c009c50 comp rx=0 tx=0).stop 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.816+0000 7fa560a00700 1 -- 172.21.15.23:0/2722974884 shutdown_connections 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.816+0000 7fa560a00700 1 --2- 172.21.15.23:0/2722974884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa55c073720 0x7fa55c073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.816+0000 7fa560a00700 1 --2- 172.21.15.23:0/2722974884 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c074ce0 0x7fa55c0731e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.816+0000 7fa560a00700 1 -- 172.21.15.23:0/2722974884 >> 172.21.15.23:0/2722974884 conn(0x7fa55c0fb650 msgr2=0x7fa55c0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.816+0000 7fa560a00700 1 -- 172.21.15.23:0/2722974884 shutdown_connections 2024-02-28T16:31:03.805 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.816+0000 7fa560a00700 1 -- 172.21.15.23:0/2722974884 wait complete. 2024-02-28T16:31:03.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.817+0000 7fa560a00700 1 Processor -- start 2024-02-28T16:31:03.806 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.817+0000 7fa560a00700 1 -- start start 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.817+0000 7fa560a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c073720 0x7fa55c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.817+0000 7fa560a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa55c074ce0 0x7fa55c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.817+0000 7fa560a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c198590 con 0x7fa55c073720 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa560a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c1986d0 con 0x7fa55c074ce0 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c073720 0x7fa55c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c073720 0x7fa55c197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:56612/0 (socket says 172.21.15.23:56612) 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55b400700 1 -- 172.21.15.23:0/43317533 learned_addr learned my addr 172.21.15.23:0/43317533 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55aa00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa55c074ce0 0x7fa55c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55b400700 1 -- 172.21.15.23:0/43317533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa55c074ce0 msgr2=0x7fa55c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55b400700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa55c074ce0 0x7fa55c197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.807 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55b400700 1 -- 172.21.15.23:0/43317533 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0095f0 con 0x7fa55c073720 2024-02-28T16:31:03.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.818+0000 7fa55aa00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa55c074ce0 0x7fa55c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:31:03.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.819+0000 7fa55b400700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c073720 0x7fa55c197a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00be80 tx=0x7fa54c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:03.808 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.819+0000 7fa553e00700 1 -- 172.21.15.23:0/43317533 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa54c01d070 con 0x7fa55c073720 2024-02-28T16:31:03.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.819+0000 7fa553e00700 1 -- 172.21.15.23:0/43317533 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa54c00f460 con 0x7fa55c073720 2024-02-28T16:31:03.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.819+0000 7fa553e00700 1 -- 172.21.15.23:0/43317533 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa54c021640 con 0x7fa55c073720 2024-02-28T16:31:03.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.819+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c19d120 con 0x7fa55c073720 2024-02-28T16:31:03.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.819+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c19d5c0 con 0x7fa55c073720 2024-02-28T16:31:03.809 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.820+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c10ace0 con 0x7fa55c073720 2024-02-28T16:31:03.810 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.821+0000 7fa553e00700 1 -- 172.21.15.23:0/43317533 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa54c00fa00 con 0x7fa55c073720 2024-02-28T16:31:03.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.822+0000 7fa553e00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa54006d8a0 0x7fa54006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.822+0000 7fa553e00700 1 -- 172.21.15.23:0/43317533 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa54c08e850 con 0x7fa55c073720 2024-02-28T16:31:03.811 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.822+0000 7fa55aa00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa54006d8a0 0x7fa54006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.823+0000 7fa55aa00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa54006d8a0 0x7fa54006fd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa548009cb0 tx=0x7fa548009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:03.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:03.827+0000 7fa553e00700 1 -- 172.21.15.23:0/43317533 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa54c05bae0 con 0x7fa55c073720 2024-02-28T16:31:03.887 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:03 smithi153 podman[76914]: 2024-02-28 16:31:03.544696447 +0000 UTC m=+0.797727306 container remove 29c6d839f44e9721a543a31258cb5401ba994df16515000bf633c8cfef057641 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212) 2024-02-28T16:31:04.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.151+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa55c19dfb0 con 0x7fa55c073720 2024-02-28T16:31:04.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.152+0000 7fa553e00700 1 -- 172.21.15.23:0/43317533 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+676 (secure 0 0 0) 0x7fa54c05b670 con 0x7fa55c073720 2024-02-28T16:31:04.140 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 3 pgs peering 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout: osd.5 (root=default,host=smithi153) is down 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout: pg 2.16 is stuck peering for 4m, current state peering, last acting [3,2] 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout: pg 3.f is stuck peering for 3m, current state peering, last acting [3,0] 2024-02-28T16:31:04.141 INFO:teuthology.orchestra.run.smithi023.stdout: pg 3.16 is stuck peering for 3m, current state peering, last acting [3,1] 2024-02-28T16:31:04.143 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa54006d8a0 msgr2=0x7fa54006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:04.143 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa54006d8a0 0x7fa54006fd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa548009cb0 tx=0x7fa548009260 comp rx=0 tx=0).stop 2024-02-28T16:31:04.143 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c073720 msgr2=0x7fa55c197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:04.143 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c073720 0x7fa55c197a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00be80 tx=0x7fa54c00bf60 comp rx=0 tx=0).stop 2024-02-28T16:31:04.143 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 shutdown_connections 2024-02-28T16:31:04.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa54006d8a0 0x7fa54006fd50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:04.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa55c073720 0x7fa55c197a30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:04.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 --2- 172.21.15.23:0/43317533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa55c074ce0 0x7fa55c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:04.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.154+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 >> 172.21.15.23:0/43317533 conn(0x7fa55c0fb650 msgr2=0x7fa55c105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:04.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.155+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 shutdown_connections 2024-02-28T16:31:04.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:04.155+0000 7fa560a00700 1 -- 172.21.15.23:0/43317533 wait complete. 2024-02-28T16:31:04.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:04 smithi153 ceph-mon[66339]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:04.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:04 smithi153 ceph-mon[66339]: osdmap e77: 6 total, 5 up, 6 in 2024-02-28T16:31:04.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:04 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2073184683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:31:04.390 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:04 smithi023 ceph-mon[78509]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:04.390 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:04 smithi023 ceph-mon[78509]: osdmap e77: 6 total, 5 up, 6 in 2024-02-28T16:31:04.390 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:04 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2073184683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:31:04.597 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:04 smithi153 podman[76998]: 2024-02-28 16:31:04.203611744 +0000 UTC m=+0.033793991 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:31:04.598 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:04 smithi153 podman[76998]: 2024-02-28 16:31:04.303824761 +0000 UTC m=+0.134007038 container create 78a9de8cece07ea4a51f269e1d14bc71a040c26513600f6d1dd4488bb14bad72 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:31:04.598 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:04 smithi153 podman[76998]: 2024-02-28 16:31:04.607400707 +0000 UTC m=+0.437582990 container init 78a9de8cece07ea4a51f269e1d14bc71a040c26513600f6d1dd4488bb14bad72 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-28T16:31:04.895 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:04 smithi153 podman[76998]: 2024-02-28 16:31:04.619280978 +0000 UTC m=+0.449463233 container start 78a9de8cece07ea4a51f269e1d14bc71a040c26513600f6d1dd4488bb14bad72 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-02-28T16:31:04.895 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:04 smithi153 podman[76998]: 2024-02-28 16:31:04.715111113 +0000 UTC m=+0.545293460 container attach 78a9de8cece07ea4a51f269e1d14bc71a040c26513600f6d1dd4488bb14bad72 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:31:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:05 smithi153 ceph-mon[66339]: pgmap v186: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:31:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:05 smithi153 ceph-mon[66339]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:05 smithi153 ceph-mon[66339]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:31:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:05 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/43317533' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:31:05.396 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:05 smithi153 podman[76998]: 2024-02-28 16:31:05.054469288 +0000 UTC m=+0.884651615 container died 78a9de8cece07ea4a51f269e1d14bc71a040c26513600f6d1dd4488bb14bad72 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-02-28T16:31:05.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:05 smithi023 ceph-mon[78509]: pgmap v186: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:31:05.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:05 smithi023 ceph-mon[78509]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:05.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:05 smithi023 ceph-mon[78509]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:31:05.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:05 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/43317533' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:31:06.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:05 smithi153 podman[77024]: 2024-02-28 16:31:05.759273165 +0000 UTC m=+0.685079823 container remove 78a9de8cece07ea4a51f269e1d14bc71a040c26513600f6d1dd4488bb14bad72 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-28T16:31:06.128 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:05 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-28T16:31:06.128 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:05 smithi153 systemd[1]: Stopped Ceph osd.5 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:31:06.128 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:05 smithi153 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.5.service: Consumed 2min 10.057s CPU time. 2024-02-28T16:31:06.395 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:06 smithi153 systemd[1]: Starting Ceph osd.5 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:31:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:06 smithi153 ceph-mon[66339]: pgmap v187: 65 pgs: 4 active+undersized+degraded, 10 peering, 3 stale+active+clean, 9 active+undersized, 39 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 10/228 objects degraded (4.386%) 2024-02-28T16:31:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:06 smithi153 ceph-mon[66339]: Health check failed: Degraded data redundancy: 10/228 objects degraded (4.386%), 4 pgs degraded (PG_DEGRADED) 2024-02-28T16:31:06.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:06 smithi023 ceph-mon[78509]: pgmap v187: 65 pgs: 4 active+undersized+degraded, 10 peering, 3 stale+active+clean, 9 active+undersized, 39 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 10/228 objects degraded (4.386%) 2024-02-28T16:31:06.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:06 smithi023 ceph-mon[78509]: Health check failed: Degraded data redundancy: 10/228 objects degraded (4.386%), 4 pgs degraded (PG_DEGRADED) 2024-02-28T16:31:06.861 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:06 smithi153 podman[77123]: 2024-02-28 16:31:06.412501756 +0000 UTC m=+0.035490477 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:31:06.861 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:06 smithi153 podman[77123]: 2024-02-28 16:31:06.527069443 +0000 UTC m=+0.150058201 container create a74fa9cdcde13c2f510c5fa3f9a810e684b8ca58c4ad7a3c811695dfaef4643a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_CLEAN=True) 2024-02-28T16:31:06.861 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:06 smithi153 podman[77123]: 2024-02-28 16:31:06.872270789 +0000 UTC m=+0.495259554 container init a74fa9cdcde13c2f510c5fa3f9a810e684b8ca58c4ad7a3c811695dfaef4643a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:31:07.145 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:06 smithi153 podman[77123]: 2024-02-28 16:31:06.88347239 +0000 UTC m=+0.506461181 container start a74fa9cdcde13c2f510c5fa3f9a810e684b8ca58c4ad7a3c811695dfaef4643a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:31:07.145 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:06 smithi153 podman[77123]: 2024-02-28 16:31:06.987852758 +0000 UTC m=+0.610841563 container attach a74fa9cdcde13c2f510c5fa3f9a810e684b8ca58c4ad7a3c811695dfaef4643a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:31:07.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:07.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:07.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:07.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:08.126 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate[77137]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate[77137]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 bash[77123]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 bash[77123]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 bash[77123]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 bash[77123]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 bash[77123]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 bash[77123]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 bash[77123]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate[77137]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate[77137]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate[77137]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate[77137]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate[77137]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T16:31:08.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:07 smithi153 podman[77123]: 2024-02-28 16:31:07.798559767 +0000 UTC m=+1.421548535 container died a74fa9cdcde13c2f510c5fa3f9a810e684b8ca58c4ad7a3c811695dfaef4643a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-02-28T16:31:08.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:08 smithi153 ceph-mon[66339]: pgmap v188: 65 pgs: 6 active+undersized+degraded, 10 peering, 12 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 13/228 objects degraded (5.702%) 2024-02-28T16:31:08.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:08 smithi023 ceph-mon[78509]: pgmap v188: 65 pgs: 6 active+undersized+degraded, 10 peering, 12 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 13/228 objects degraded (5.702%) 2024-02-28T16:31:08.793 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:08 smithi153 podman[77258]: 2024-02-28 16:31:08.457734598 +0000 UTC m=+0.638881127 container remove a74fa9cdcde13c2f510c5fa3f9a810e684b8ca58c4ad7a3c811695dfaef4643a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-activate, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-28T16:31:09.145 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:08 smithi153 podman[77318]: 2024-02-28 16:31:08.712308274 +0000 UTC m=+0.037244552 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:31:09.145 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:08 smithi153 podman[77318]: 2024-02-28 16:31:08.850253905 +0000 UTC m=+0.175190223 container create ac551516eb383632eccecdfc1f935e27ebcd647c959704656f580ee5352a942f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, org.label-schema.build-date=20240222, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10) 2024-02-28T16:31:09.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:09 smithi153 ceph-mon[66339]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:31:09.645 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:09 smithi153 podman[77318]: 2024-02-28 16:31:09.170713385 +0000 UTC m=+0.495649717 container init ac551516eb383632eccecdfc1f935e27ebcd647c959704656f580ee5352a942f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10) 2024-02-28T16:31:09.645 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:09 smithi153 podman[77318]: 2024-02-28 16:31:09.181147294 +0000 UTC m=+0.506083596 container start ac551516eb383632eccecdfc1f935e27ebcd647c959704656f580ee5352a942f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, RELEASE=main-1fb5d10, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-28T16:31:09.645 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:09 smithi153 ceph-osd[77337]: -- 172.21.15.153:0/4164285623 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581bbe5d680 con 0x5581bbe27000 2024-02-28T16:31:09.645 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:09 smithi153 bash[77318]: ac551516eb383632eccecdfc1f935e27ebcd647c959704656f580ee5352a942f 2024-02-28T16:31:09.645 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:09 smithi153 systemd[1]: Started Ceph osd.5 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:31:09.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:09 smithi023 ceph-mon[78509]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:31:10.145 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:09 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:31:09.747+0000 7fa13116c7c0 -1 Falling back to public interface 2024-02-28T16:31:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:10 smithi023 ceph-mon[78509]: pgmap v189: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:10.723 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:10 smithi153 ceph-mon[66339]: pgmap v189: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:10.723 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:10.723 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:10.723 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:12.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:12 smithi023 ceph-mon[78509]: pgmap v190: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:12.701 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:12 smithi153 ceph-mon[66339]: pgmap v190: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:13.820 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:13 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:31:13.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:13 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:31:15.144 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:14 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:31:14.867+0000 7fa13116c7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-28T16:31:15.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:14 smithi153 ceph-mon[66339]: pgmap v191: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:15.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:15.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:15.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:14 smithi023 ceph-mon[78509]: pgmap v191: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:15.644 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:15 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:31:15.391+0000 7fa13116c7c0 -1 osd.5 75 log_to_monitors true 2024-02-28T16:31:16.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:15 smithi153 ceph-mon[66339]: from='osd.5 [v2:172.21.15.153:6816/3414117647,v1:172.21.15.153:6817/3414117647]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:31:16.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:15 smithi153 ceph-mon[66339]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:31:16.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:16.145 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:31:15 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:31:15.848+0000 7fa120400700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:31:16.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:15 smithi023 ceph-mon[78509]: from='osd.5 [v2:172.21.15.153:6816/3414117647,v1:172.21.15.153:6817/3414117647]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:31:16.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:15 smithi023 ceph-mon[78509]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:31:16.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:17.021 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:16 smithi153 ceph-mon[66339]: pgmap v192: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:17.021 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:16 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:17.021 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:16 smithi153 ceph-mon[66339]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:31:17.021 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:16 smithi153 ceph-mon[66339]: from='osd.5 [v2:172.21.15.153:6816/3414117647,v1:172.21.15.153:6817/3414117647]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:31:17.021 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:16 smithi153 ceph-mon[66339]: osdmap e78: 6 total, 5 up, 6 in 2024-02-28T16:31:17.021 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:16 smithi153 ceph-mon[66339]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:31:17.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:16 smithi023 ceph-mon[78509]: pgmap v192: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 941 MiB used, 535 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:17.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:16 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:17.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:16 smithi023 ceph-mon[78509]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:31:17.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:16 smithi023 ceph-mon[78509]: from='osd.5 [v2:172.21.15.153:6816/3414117647,v1:172.21.15.153:6817/3414117647]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:31:17.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:16 smithi023 ceph-mon[78509]: osdmap e78: 6 total, 5 up, 6 in 2024-02-28T16:31:17.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:16 smithi023 ceph-mon[78509]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-02-28T16:31:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:17 smithi153 ceph-mon[66339]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:31:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:17 smithi153 ceph-mon[66339]: osd.5 [v2:172.21.15.153:6816/3414117647,v1:172.21.15.153:6817/3414117647] boot 2024-02-28T16:31:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:17 smithi153 ceph-mon[66339]: osdmap e79: 6 total, 6 up, 6 in 2024-02-28T16:31:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:31:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:17 smithi153 ceph-mon[66339]: osdmap e80: 6 total, 6 up, 6 in 2024-02-28T16:31:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:17 smithi023 ceph-mon[78509]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:31:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:17 smithi023 ceph-mon[78509]: osd.5 [v2:172.21.15.153:6816/3414117647,v1:172.21.15.153:6817/3414117647] boot 2024-02-28T16:31:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:17 smithi023 ceph-mon[78509]: osdmap e79: 6 total, 6 up, 6 in 2024-02-28T16:31:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:31:18.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:17 smithi023 ceph-mon[78509]: osdmap e80: 6 total, 6 up, 6 in 2024-02-28T16:31:19.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:18 smithi153 ceph-mon[66339]: pgmap v195: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:19.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:18 smithi023 ceph-mon[78509]: pgmap v195: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 35/228 objects degraded (15.351%) 2024-02-28T16:31:20.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:19 smithi023 ceph-mon[78509]: Health check update: Degraded data redundancy: 17/228 objects degraded (7.456%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:31:20.331 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:19 smithi153 ceph-mon[66339]: Health check update: Degraded data redundancy: 17/228 objects degraded (7.456%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:31:21.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: pgmap v197: 65 pgs: 7 active+undersized+degraded, 11 active+undersized, 47 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 17/228 objects degraded (7.456%) 2024-02-28T16:31:21.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:21.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:20 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T16:31:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: pgmap v197: 65 pgs: 7 active+undersized+degraded, 11 active+undersized, 47 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 17/228 objects degraded (7.456%) 2024-02-28T16:31:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:21.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:21.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:21.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:20 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T16:31:22.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all osd 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T16:31:22.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T16:31:22.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:22.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:22.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all osd 2024-02-28T16:31:22.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T16:31:22.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T16:31:22.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:22.397 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:23.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:22 smithi023 ceph-mon[78509]: pgmap v198: 65 pgs: 1 active+undersized+degraded, 1 active+undersized, 63 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2/228 objects degraded (0.877%) 2024-02-28T16:31:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:22 smithi023 ceph-mon[78509]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T16:31:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T16:31:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:22 smithi023 ceph-mon[78509]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T16:31:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi023.pplvdo"]}]: dispatch 2024-02-28T16:31:23.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:22 smithi023 ceph-mon[78509]: Upgrade: It appears safe to stop mds.cephfs.smithi023.pplvdo 2024-02-28T16:31:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:22 smithi153 ceph-mon[66339]: pgmap v198: 65 pgs: 1 active+undersized+degraded, 1 active+undersized, 63 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2/228 objects degraded (0.877%) 2024-02-28T16:31:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:22 smithi153 ceph-mon[66339]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T16:31:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T16:31:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:22 smithi153 ceph-mon[66339]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T16:31:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi023.pplvdo"]}]: dispatch 2024-02-28T16:31:23.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:22 smithi153 ceph-mon[66339]: Upgrade: It appears safe to stop mds.cephfs.smithi023.pplvdo 2024-02-28T16:31:24.261 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:23 smithi153 ceph-mon[66339]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/228 objects degraded (0.877%), 1 pg degraded) 2024-02-28T16:31:24.261 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:23 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:31:24.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:23 smithi023 ceph-mon[78509]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/228 objects degraded (0.877%), 1 pg degraded) 2024-02-28T16:31:24.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:23 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:31:25.303 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:24 smithi023 ceph-mon[78509]: pgmap v200: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:25.303 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:25.303 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:31:25.303 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:25.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:24 smithi153 ceph-mon[66339]: pgmap v200: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:25.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:25.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.pplvdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:31:25.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:26.148 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:26 smithi023 ceph-mon[78509]: Upgrade: Updating mds.cephfs.smithi023.pplvdo 2024-02-28T16:31:26.148 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:26 smithi023 ceph-mon[78509]: Deploying daemon mds.cephfs.smithi023.pplvdo on smithi023 2024-02-28T16:31:26.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:26 smithi153 ceph-mon[66339]: Upgrade: Updating mds.cephfs.smithi023.pplvdo 2024-02-28T16:31:26.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:26 smithi153 ceph-mon[66339]: Deploying daemon mds.cephfs.smithi023.pplvdo on smithi023 2024-02-28T16:31:27.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:27 smithi153 ceph-mon[66339]: pgmap v201: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:27.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:27 smithi023 ceph-mon[78509]: pgmap v201: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:29.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:29 smithi153 ceph-mon[66339]: pgmap v202: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:29.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:29 smithi153 ceph-mon[66339]: osdmap e82: 6 total, 6 up, 6 in 2024-02-28T16:31:29.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:29 smithi153 ceph-mon[66339]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 2 up:standby 2024-02-28T16:31:29.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:29 smithi023 ceph-mon[78509]: pgmap v202: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:29.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:29 smithi023 ceph-mon[78509]: osdmap e82: 6 total, 6 up, 6 in 2024-02-28T16:31:29.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:29 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 2 up:standby 2024-02-28T16:31:31.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:31 smithi153 ceph-mon[66339]: pgmap v204: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:31.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:31 smithi023 ceph-mon[78509]: pgmap v204: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:32.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:32 smithi023 ceph-mon[78509]: pgmap v205: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:32.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:32.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:32 smithi153 ceph-mon[66339]: pgmap v205: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:32.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:34.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 -- 172.21.15.23:0/2610738900 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 msgr2=0x7f6e70073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 --2- 172.21.15.23:0/2610738900 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e70073c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009910 tx=0x7f6e5c009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 -- 172.21.15.23:0/2610738900 shutdown_connections 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 --2- 172.21.15.23:0/2610738900 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e70073c20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 --2- 172.21.15.23:0/2610738900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e70074d80 0x7f6e700731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 -- 172.21.15.23:0/2610738900 >> 172.21.15.23:0/2610738900 conn(0x7f6e700fb7f0 msgr2=0x7f6e700fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 -- 172.21.15.23:0/2610738900 shutdown_connections 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.330+0000 7f6e77000700 1 -- 172.21.15.23:0/2610738900 wait complete. 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.331+0000 7f6e77000700 1 Processor -- start 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.331+0000 7f6e77000700 1 -- start start 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.331+0000 7f6e77000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e7019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e77000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e70074d80 0x7f6e7019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e77000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7019cb40 con 0x7f6e700737b0 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e77000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7019cc80 con 0x7f6e70074d80 2024-02-28T16:31:34.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e6fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e7019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e6fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e7019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:51994/0 (socket says 172.21.15.23:51994) 2024-02-28T16:31:34.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e6fe00700 1 -- 172.21.15.23:0/408872278 learned_addr learned my addr 172.21.15.23:0/408872278 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:34.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e6f400700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e70074d80 0x7f6e7019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e6fe00700 1 -- 172.21.15.23:0/408872278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e70074d80 msgr2=0x7f6e7019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.332+0000 7f6e6fe00700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e70074d80 0x7f6e7019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.333+0000 7f6e6fe00700 1 -- 172.21.15.23:0/408872278 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0095f0 con 0x7f6e700737b0 2024-02-28T16:31:34.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.333+0000 7f6e6fe00700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e7019c070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000c930 tx=0x7f6e6000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:34.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.333+0000 7f6e6cc00700 1 -- 172.21.15.23:0/408872278 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e60007ad0 con 0x7f6e700737b0 2024-02-28T16:31:34.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.333+0000 7f6e6cc00700 1 -- 172.21.15.23:0/408872278 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e60007c30 con 0x7f6e700737b0 2024-02-28T16:31:34.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.333+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e701a1740 con 0x7f6e700737b0 2024-02-28T16:31:34.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.333+0000 7f6e6cc00700 1 -- 172.21.15.23:0/408872278 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e60018630 con 0x7f6e700737b0 2024-02-28T16:31:34.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.333+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e701a1c60 con 0x7f6e700737b0 2024-02-28T16:31:34.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.335+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7010f380 con 0x7f6e700737b0 2024-02-28T16:31:34.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.336+0000 7f6e6cc00700 1 -- 172.21.15.23:0/408872278 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6e6000f450 con 0x7f6e700737b0 2024-02-28T16:31:34.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.337+0000 7f6e6cc00700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e5406d8a0 0x7f6e5406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.337+0000 7f6e6cc00700 1 -- 172.21.15.23:0/408872278 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6e6008d770 con 0x7f6e700737b0 2024-02-28T16:31:34.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.338+0000 7f6e6f400700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e5406d8a0 0x7f6e5406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.338+0000 7f6e6f400700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e5406d8a0 0x7f6e5406fd50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c006010 tx=0x7f6e5c00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:34.331 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.342+0000 7f6e6cc00700 1 -- 172.21.15.23:0/408872278 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e6005aa00 con 0x7f6e700737b0 2024-02-28T16:31:34.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.608+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e701a2300 con 0x7f6e5406d8a0 2024-02-28T16:31:34.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.610+0000 7f6e6cc00700 1 -- 172.21.15.23:0/408872278 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6e701a2300 con 0x7f6e5406d8a0 2024-02-28T16:31:34.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.614+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e5406d8a0 msgr2=0x7f6e5406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.614+0000 7f6e77000700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e5406d8a0 0x7f6e5406fd50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c006010 tx=0x7f6e5c00b540 comp rx=0 tx=0).stop 2024-02-28T16:31:34.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.614+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 msgr2=0x7f6e7019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.614+0000 7f6e77000700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e7019c070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000c930 tx=0x7f6e6000ccf0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.615+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 shutdown_connections 2024-02-28T16:31:34.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.615+0000 7f6e77000700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e5406d8a0 0x7f6e5406fd50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.615+0000 7f6e77000700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e700737b0 0x7f6e7019c070 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.615+0000 7f6e77000700 1 --2- 172.21.15.23:0/408872278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e70074d80 0x7f6e7019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.615+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 >> 172.21.15.23:0/408872278 conn(0x7f6e700fb7f0 msgr2=0x7f6e70101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:34.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.615+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 shutdown_connections 2024-02-28T16:31:34.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.615+0000 7f6e77000700 1 -- 172.21.15.23:0/408872278 wait complete. 2024-02-28T16:31:34.623 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.788+0000 7f1a0f400700 1 -- 172.21.15.23:0/4219891591 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 msgr2=0x7f1a08102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.788+0000 7f1a0f400700 1 --2- 172.21.15.23:0/4219891591 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08102e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009910 tx=0x7f19fc009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.788+0000 7f1a0f400700 1 -- 172.21.15.23:0/4219891591 shutdown_connections 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.788+0000 7f1a0f400700 1 --2- 172.21.15.23:0/4219891591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a08103350 0x7f1a08105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.788+0000 7f1a0f400700 1 --2- 172.21.15.23:0/4219891591 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08102e10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.788+0000 7f1a0f400700 1 -- 172.21.15.23:0/4219891591 >> 172.21.15.23:0/4219891591 conn(0x7f1a080fa780 msgr2=0x7f1a080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.788+0000 7f1a0f400700 1 -- 172.21.15.23:0/4219891591 shutdown_connections 2024-02-28T16:31:34.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.789+0000 7f1a0f400700 1 -- 172.21.15.23:0/4219891591 wait complete. 2024-02-28T16:31:34.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.790+0000 7f1a0f400700 1 Processor -- start 2024-02-28T16:31:34.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.790+0000 7f1a0f400700 1 -- start start 2024-02-28T16:31:34.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.791+0000 7f1a0f400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.791+0000 7f1a0f400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a08103350 0x7f1a081982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.791+0000 7f1a0f400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08198900 con 0x7f1a08069230 2024-02-28T16:31:34.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.791+0000 7f1a0f400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0819d310 con 0x7f1a08103350 2024-02-28T16:31:34.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.791+0000 7f1a0ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.791+0000 7f1a0ca00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52012/0 (socket says 172.21.15.23:52012) 2024-02-28T16:31:34.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.791+0000 7f1a0ca00700 1 -- 172.21.15.23:0/2053915906 learned_addr learned my addr 172.21.15.23:0/2053915906 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.792+0000 7f1a07e00700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a08103350 0x7f1a081982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.792+0000 7f1a0ca00700 1 -- 172.21.15.23:0/2053915906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a08103350 msgr2=0x7f1a081982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.792+0000 7f1a0ca00700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a08103350 0x7f1a081982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.792+0000 7f1a0ca00700 1 -- 172.21.15.23:0/2053915906 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0095f0 con 0x7f1a08069230 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.792+0000 7f1a0ca00700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08197da0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00bd70 tx=0x7f19fc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.793+0000 7f1a05600700 1 -- 172.21.15.23:0/2053915906 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19fc01d070 con 0x7f1a08069230 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.793+0000 7f1a05600700 1 -- 172.21.15.23:0/2053915906 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19fc022470 con 0x7f1a08069230 2024-02-28T16:31:34.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.793+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0819d4b0 con 0x7f1a08069230 2024-02-28T16:31:34.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.793+0000 7f1a05600700 1 -- 172.21.15.23:0/2053915906 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19fc00f670 con 0x7f1a08069230 2024-02-28T16:31:34.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.793+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0819d970 con 0x7f1a08069230 2024-02-28T16:31:34.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.794+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a080fc340 con 0x7f1a08069230 2024-02-28T16:31:34.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.796+0000 7f1a05600700 1 -- 172.21.15.23:0/2053915906 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f19fc004af0 con 0x7f1a08069230 2024-02-28T16:31:34.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.797+0000 7f1a05600700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19f006d8f0 0x7f19f006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.797+0000 7f1a05600700 1 -- 172.21.15.23:0/2053915906 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f19fc08eb40 con 0x7f1a08069230 2024-02-28T16:31:34.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.797+0000 7f1a07e00700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19f006d8f0 0x7f19f006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.798+0000 7f1a07e00700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19f006d8f0 0x7f19f006fda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19f4006fd0 tx=0x7f19f4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:34.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:34.802+0000 7f1a05600700 1 -- 172.21.15.23:0/2053915906 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f19fc058450 con 0x7f1a08069230 2024-02-28T16:31:34.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:34 smithi153 ceph-mon[66339]: pgmap v206: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:34.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:34.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:34.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:34.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:34 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:boot 2024-02-28T16:31:34.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:34 smithi153 ceph-mon[66339]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:31:34.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:31:34.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:34 smithi023 ceph-mon[78509]: pgmap v206: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:34.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:34.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:34.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:34.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:34 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:boot 2024-02-28T16:31:34.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:34 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi023.klbbrl=up:active} 3 up:standby 2024-02-28T16:31:34.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:31:35.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.061+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a08061190 con 0x7f19f006d8f0 2024-02-28T16:31:35.051 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.063+0000 7f1a05600700 1 -- 172.21.15.23:0/2053915906 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1a08061190 con 0x7f19f006d8f0 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.065+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19f006d8f0 msgr2=0x7f19f006fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.065+0000 7f1a0f400700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19f006d8f0 0x7f19f006fda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19f4006fd0 tx=0x7f19f4008040 comp rx=0 tx=0).stop 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.065+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 msgr2=0x7f1a08197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.065+0000 7f1a0f400700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08197da0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00bd70 tx=0x7f19fc00be50 comp rx=0 tx=0).stop 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.066+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 shutdown_connections 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.066+0000 7f1a0f400700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f19f006d8f0 0x7f19f006fda0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.066+0000 7f1a0f400700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1a08069230 0x7f1a08197da0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.066+0000 7f1a0f400700 1 --2- 172.21.15.23:0/2053915906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a08103350 0x7f1a081982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.066+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 >> 172.21.15.23:0/2053915906 conn(0x7f1a080fa780 msgr2=0x7f1a081006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.066+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 shutdown_connections 2024-02-28T16:31:35.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.066+0000 7f1a0f400700 1 -- 172.21.15.23:0/2053915906 wait complete. 2024-02-28T16:31:35.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 -- 172.21.15.23:0/3484504734 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 msgr2=0x7f59e0103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 --2- 172.21.15.23:0/3484504734 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0103140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009910 tx=0x7f59d0009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:35.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 -- 172.21.15.23:0/3484504734 shutdown_connections 2024-02-28T16:31:35.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 --2- 172.21.15.23:0/3484504734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e0103680 0x7f59e0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 --2- 172.21.15.23:0/3484504734 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0103140 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 -- 172.21.15.23:0/3484504734 >> 172.21.15.23:0/3484504734 conn(0x7f59e00fa780 msgr2=0x7f59e00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:35.217 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 -- 172.21.15.23:0/3484504734 shutdown_connections 2024-02-28T16:31:35.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.228+0000 7f59e6a00700 1 -- 172.21.15.23:0/3484504734 wait complete. 2024-02-28T16:31:35.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.229+0000 7f59e6a00700 1 Processor -- start 2024-02-28T16:31:35.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.229+0000 7f59e6a00700 1 -- start start 2024-02-28T16:31:35.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.230+0000 7f59e6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:35.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.230+0000 7f59e6a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e0103680 0x7f59e0198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:35.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.230+0000 7f59e6a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01987d0 con 0x7f59e0100d60 2024-02-28T16:31:35.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.230+0000 7f59e6a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0198940 con 0x7f59e0103680 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.230+0000 7f59dfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.230+0000 7f59dfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52024/0 (socket says 172.21.15.23:52024) 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.230+0000 7f59dfe00700 1 -- 172.21.15.23:0/1959643279 learned_addr learned my addr 172.21.15.23:0/1959643279 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59df400700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e0103680 0x7f59e0198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59dfe00700 1 -- 172.21.15.23:0/1959643279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e0103680 msgr2=0x7f59e0198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59dfe00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e0103680 0x7f59e0198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59dfe00700 1 -- 172.21.15.23:0/1959643279 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00095f0 con 0x7f59e0100d60 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59df400700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e0103680 0x7f59e0198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:31:35.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59dfe00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0197d00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f59d000bda0 tx=0x7f59d000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:35.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59dcc00700 1 -- 172.21.15.23:0/1959643279 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59d001d070 con 0x7f59e0100d60 2024-02-28T16:31:35.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59dcc00700 1 -- 172.21.15.23:0/1959643279 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59d0004c50 con 0x7f59e0100d60 2024-02-28T16:31:35.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.231+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e019d330 con 0x7f59e0100d60 2024-02-28T16:31:35.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.232+0000 7f59dcc00700 1 -- 172.21.15.23:0/1959643279 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59d0021640 con 0x7f59e0100d60 2024-02-28T16:31:35.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.232+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e019d820 con 0x7f59e0100d60 2024-02-28T16:31:35.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.233+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e00fc340 con 0x7f59e0100d60 2024-02-28T16:31:35.223 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.234+0000 7f59dcc00700 1 -- 172.21.15.23:0/1959643279 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f59d000fa10 con 0x7f59e0100d60 2024-02-28T16:31:35.224 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.235+0000 7f59dcc00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f59c406d8a0 0x7f59c406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:35.224 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.235+0000 7f59dcc00700 1 -- 172.21.15.23:0/1959643279 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f59d008e890 con 0x7f59e0100d60 2024-02-28T16:31:35.224 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.235+0000 7f59df400700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f59c406d8a0 0x7f59c406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:35.225 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.236+0000 7f59df400700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f59c406d8a0 0x7f59c406fd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:35.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.240+0000 7f59dcc00700 1 -- 172.21.15.23:0/1959643279 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f59d0058090 con 0x7f59e0100d60 2024-02-28T16:31:35.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.485+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f59e0061190 con 0x7f59c406d8a0 2024-02-28T16:31:35.488 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.500+0000 7f59dcc00700 1 -- 172.21.15.23:0/1959643279 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f59e0061190 con 0x7f59c406d8a0 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (16m) 2m ago 18m 14.2M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (18m) 2m ago 18m 8610k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (17m) 21s ago 17m 8476k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (4m) 2m ago 18m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (4m) 21s ago 17m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (16m) 2m ago 18m 74.5M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:31:35.489 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (11m) 2m ago 11m 137M - 18.2.0 dc2bc1663786 c4c794849604 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 starting - - - - 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (11m) 21s ago 11m 17.3M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (11m) 21s ago 11m 17.5M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (7m) 2m ago 20m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (6m) 21s ago 17m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (6m) 2m ago 20m 46.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (5m) 21s ago 17m 39.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (18m) 2m ago 18m 8010k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (17m) 21s ago 17m 8250k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (3m) 2m ago 16m 89.3M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (3m) 2m ago 15m 98.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (2m) 2m ago 14m 11.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (110s) 21s ago 14m 107M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (68s) 21s ago 13m 98.9M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:31:35.490 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (26s) 21s ago 13m 11.2M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:31:35.491 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (6m) 2m ago 17m 58.5M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:31:35.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f59c406d8a0 msgr2=0x7f59c406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f59c406d8a0 0x7f59c406fd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc005e20 comp rx=0 tx=0).stop 2024-02-28T16:31:35.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 msgr2=0x7f59e0197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0197d00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f59d000bda0 tx=0x7f59d000be80 comp rx=0 tx=0).stop 2024-02-28T16:31:35.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 shutdown_connections 2024-02-28T16:31:35.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f59c406d8a0 0x7f59c406fd50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f59e0100d60 0x7f59e0197d00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 --2- 172.21.15.23:0/1959643279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e0103680 0x7f59e0198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 >> 172.21.15.23:0/1959643279 conn(0x7f59e00fa780 msgr2=0x7f59e0100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:35.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 shutdown_connections 2024-02-28T16:31:35.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.503+0000 7f59e6a00700 1 -- 172.21.15.23:0/1959643279 wait complete. 2024-02-28T16:31:35.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.661+0000 7fd5a2c00700 1 -- 172.21.15.23:0/2848172144 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c0737b0 msgr2=0x7fd59c073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.661+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/2848172144 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c0737b0 0x7fd59c073c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd588009910 tx=0x7fd588009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:35.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.661+0000 7fd5a2c00700 1 -- 172.21.15.23:0/2848172144 shutdown_connections 2024-02-28T16:31:35.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.661+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/2848172144 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c0737b0 0x7fd59c073c20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.661+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/2848172144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c074d80 0x7fd59c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.661+0000 7fd5a2c00700 1 -- 172.21.15.23:0/2848172144 >> 172.21.15.23:0/2848172144 conn(0x7fd59c0fb7f0 msgr2=0x7fd59c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:35.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.662+0000 7fd5a2c00700 1 -- 172.21.15.23:0/2848172144 shutdown_connections 2024-02-28T16:31:35.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.662+0000 7fd5a2c00700 1 -- 172.21.15.23:0/2848172144 wait complete. 2024-02-28T16:31:35.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.663+0000 7fd5a2c00700 1 Processor -- start 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.663+0000 7fd5a2c00700 1 -- start start 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.663+0000 7fd5a2c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c0737b0 0x7fd59c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.663+0000 7fd5a2c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c074d80 0x7fd59c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.663+0000 7fd5a2c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c19cbd0 con 0x7fd59c074d80 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.663+0000 7fd5a2c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c19cd10 con 0x7fd59c0737b0 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c074d80 0x7fd59c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c074d80 0x7fd59c19c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52040/0 (socket says 172.21.15.23:52040) 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59b400700 1 -- 172.21.15.23:0/3246173404 learned_addr learned my addr 172.21.15.23:0/3246173404 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59be00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c0737b0 0x7fd59c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59b400700 1 -- 172.21.15.23:0/3246173404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c0737b0 msgr2=0x7fd59c19c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59b400700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c0737b0 0x7fd59c19c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59b400700 1 -- 172.21.15.23:0/3246173404 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880095f0 con 0x7fd59c074d80 2024-02-28T16:31:35.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59be00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c0737b0 0x7fd59c19c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:31:35.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.664+0000 7fd59b400700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c074d80 0x7fd59c19c5b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd588005b40 tx=0x7fd58800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:35.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.665+0000 7fd598c00700 1 -- 172.21.15.23:0/3246173404 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd58801d070 con 0x7fd59c074d80 2024-02-28T16:31:35.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.665+0000 7fd598c00700 1 -- 172.21.15.23:0/3246173404 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd588022470 con 0x7fd59c074d80 2024-02-28T16:31:35.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.665+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c1a1760 con 0x7fd59c074d80 2024-02-28T16:31:35.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.665+0000 7fd598c00700 1 -- 172.21.15.23:0/3246173404 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd58800f690 con 0x7fd59c074d80 2024-02-28T16:31:35.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.665+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c1a1c50 con 0x7fd59c074d80 2024-02-28T16:31:35.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.666+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c10f380 con 0x7fd59c074d80 2024-02-28T16:31:35.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.667+0000 7fd598c00700 1 -- 172.21.15.23:0/3246173404 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd5880225e0 con 0x7fd59c074d80 2024-02-28T16:31:35.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.668+0000 7fd598c00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd58006d8f0 0x7fd58006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:35.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.668+0000 7fd598c00700 1 -- 172.21.15.23:0/3246173404 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd58808ebd0 con 0x7fd59c074d80 2024-02-28T16:31:35.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.668+0000 7fd59be00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd58006d8f0 0x7fd58006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:35.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.669+0000 7fd59be00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd58006d8f0 0x7fd58006fda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd58c005fd0 tx=0x7fd58c005dc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:35.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:35.673+0000 7fd598c00700 1 -- 172.21.15.23:0/3246173404 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd58805c020 con 0x7fd59c074d80 2024-02-28T16:31:35.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:35 smithi023 ceph-mon[78509]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:35.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:35 smithi023 ceph-mon[78509]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:35.989 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.000+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd59c10f540 con 0x7fd59c074d80 2024-02-28T16:31:35.990 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.001+0000 7fd598c00700 1 -- 172.21.15.23:0/3246173404 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fd58805bbb0 con 0x7fd59c074d80 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:31:35.991 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:31:35.992 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:31:35.992 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-28T16:31:35.992 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 11 2024-02-28T16:31:35.992 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:31:35.992 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:31:35.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd58006d8f0 msgr2=0x7fd58006fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd58006d8f0 0x7fd58006fda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd58c005fd0 tx=0x7fd58c005dc0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c074d80 msgr2=0x7fd59c19c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:35.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c074d80 0x7fd59c19c5b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd588005b40 tx=0x7fd58800be20 comp rx=0 tx=0).stop 2024-02-28T16:31:35.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 shutdown_connections 2024-02-28T16:31:35.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c0737b0 0x7fd59c19c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd58006d8f0 0x7fd58006fda0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 --2- 172.21.15.23:0/3246173404 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd59c074d80 0x7fd59c19c5b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:35.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.004+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 >> 172.21.15.23:0/3246173404 conn(0x7fd59c0fb7f0 msgr2=0x7fd59c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:35.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.005+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 shutdown_connections 2024-02-28T16:31:35.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.005+0000 7fd5a2c00700 1 -- 172.21.15.23:0/3246173404 wait complete. 2024-02-28T16:31:36.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:35 smithi153 ceph-mon[66339]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:36.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:35 smithi153 ceph-mon[66339]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:36.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 -- 172.21.15.23:0/2154412280 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 msgr2=0x7f20c0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 --2- 172.21.15.23:0/2154412280 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0100650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009910 tx=0x7f20b0009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:36.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 -- 172.21.15.23:0/2154412280 shutdown_connections 2024-02-28T16:31:36.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 --2- 172.21.15.23:0/2154412280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c0101440 0x7f20c0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 --2- 172.21.15.23:0/2154412280 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0100650 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.150 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 -- 172.21.15.23:0/2154412280 >> 172.21.15.23:0/2154412280 conn(0x7f20c00fb7f0 msgr2=0x7f20c00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:36.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 -- 172.21.15.23:0/2154412280 shutdown_connections 2024-02-28T16:31:36.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.157+0000 7f20c4c00700 1 -- 172.21.15.23:0/2154412280 wait complete. 2024-02-28T16:31:36.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.158+0000 7f20c4c00700 1 Processor -- start 2024-02-28T16:31:36.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.158+0000 7f20c4c00700 1 -- start start 2024-02-28T16:31:36.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20c4c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:36.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20c4c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c0101440 0x7f20c0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:36.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20c4c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c0073680 con 0x7f20c0100240 2024-02-28T16:31:36.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20c4c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c00737c0 con 0x7f20c0101440 2024-02-28T16:31:36.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:36.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bde00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52062/0 (socket says 172.21.15.23:52062) 2024-02-28T16:31:36.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bde00700 1 -- 172.21.15.23:0/3037149449 learned_addr learned my addr 172.21.15.23:0/3037149449 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:36.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bd400700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c0101440 0x7f20c0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:36.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bde00700 1 -- 172.21.15.23:0/3037149449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c0101440 msgr2=0x7f20c0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bde00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c0101440 0x7f20c0073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bde00700 1 -- 172.21.15.23:0/3037149449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00095f0 con 0x7f20c0100240 2024-02-28T16:31:36.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.159+0000 7f20bd400700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c0101440 0x7f20c0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:31:36.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.160+0000 7f20bde00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0074af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f20b000bda0 tx=0x7f20b000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:36.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.160+0000 7f20b6a00700 1 -- 172.21.15.23:0/3037149449 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b001d070 con 0x7f20c0100240 2024-02-28T16:31:36.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.160+0000 7f20b6a00700 1 -- 172.21.15.23:0/3037149449 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f20b0004c50 con 0x7f20c0100240 2024-02-28T16:31:36.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.160+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c0073a40 con 0x7f20c0100240 2024-02-28T16:31:36.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.160+0000 7f20b6a00700 1 -- 172.21.15.23:0/3037149449 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b000f690 con 0x7f20c0100240 2024-02-28T16:31:36.155 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.160+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c0073f30 con 0x7f20c0100240 2024-02-28T16:31:36.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.161+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c0108e10 con 0x7f20c0100240 2024-02-28T16:31:36.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.162+0000 7f20b6a00700 1 -- 172.21.15.23:0/3037149449 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f20b000f7f0 con 0x7f20c0100240 2024-02-28T16:31:36.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.163+0000 7f20b6a00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20a406d8a0 0x7f20a406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:36.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.163+0000 7f20b6a00700 1 -- 172.21.15.23:0/3037149449 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f20b008ec40 con 0x7f20c0100240 2024-02-28T16:31:36.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.164+0000 7f20bd400700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20a406d8a0 0x7f20a406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:36.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.164+0000 7f20bd400700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20a406d8a0 0x7f20a406fd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f20ac007900 tx=0x7f20ac008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:36.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.168+0000 7f20b6a00700 1 -- 172.21.15.23:0/3037149449 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f20b005bff0 con 0x7f20c0100240 2024-02-28T16:31:36.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.452+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20c019dfe0 con 0x7f20c0100240 2024-02-28T16:31:36.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.453+0000 7f20b6a00700 1 -- 172.21.15.23:0/3037149449 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f20b0027070 con 0x7f20c0100240 2024-02-28T16:31:36.442 INFO:teuthology.orchestra.run.smithi023.stdout:e18 2024-02-28T16:31:36.442 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:31:36.442 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:36.442 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:31:36.442 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:36.442 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 15 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:20:30.265323+0000 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:31:36.443 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 47 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=14476} 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:31:36.444 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{0:14476} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.23:6828/869339807,v1:172.21.15.23:6829/869339807] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:24247} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:36.445 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:31:36.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20a406d8a0 msgr2=0x7f20a406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20a406d8a0 0x7f20a406fd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f20ac007900 tx=0x7f20ac008040 comp rx=0 tx=0).stop 2024-02-28T16:31:36.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 msgr2=0x7f20c0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0074af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f20b000bda0 tx=0x7f20b000be80 comp rx=0 tx=0).stop 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 shutdown_connections 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f20a406d8a0 0x7f20a406fd50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f20c0100240 0x7f20c0074af0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 --2- 172.21.15.23:0/3037149449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20c0101440 0x7f20c0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 >> 172.21.15.23:0/3037149449 conn(0x7f20c00fb7f0 msgr2=0x7f20c0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 shutdown_connections 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.456+0000 7f20c4c00700 1 -- 172.21.15.23:0/3037149449 wait complete. 2024-02-28T16:31:36.447 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 18 2024-02-28T16:31:36.596 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 -- 172.21.15.23:0/2156904137 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 msgr2=0x7f2a88101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.596 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2156904137 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a88101890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009910 tx=0x7f2a74009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:36.596 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 -- 172.21.15.23:0/2156904137 shutdown_connections 2024-02-28T16:31:36.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2156904137 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a88101890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2156904137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88100240 0x7f2a88100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 -- 172.21.15.23:0/2156904137 >> 172.21.15.23:0/2156904137 conn(0x7f2a880fb7f0 msgr2=0x7f2a880fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:36.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 -- 172.21.15.23:0/2156904137 shutdown_connections 2024-02-28T16:31:36.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.607+0000 7f2a8f200700 1 -- 172.21.15.23:0/2156904137 wait complete. 2024-02-28T16:31:36.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.609+0000 7f2a8f200700 1 Processor -- start 2024-02-28T16:31:36.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.609+0000 7f2a8f200700 1 -- start start 2024-02-28T16:31:36.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.609+0000 7f2a8f200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88100240 0x7f2a88197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:36.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.609+0000 7f2a8f200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a881981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:36.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.609+0000 7f2a8f200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a881987d0 con 0x7f2a88101440 2024-02-28T16:31:36.598 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.609+0000 7f2a8f200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a88198940 con 0x7f2a88100240 2024-02-28T16:31:36.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a881981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:36.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a881981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52074/0 (socket says 172.21.15.23:52074) 2024-02-28T16:31:36.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87400700 1 -- 172.21.15.23:0/2297864508 learned_addr learned my addr 172.21.15.23:0/2297864508 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:36.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87e00700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88100240 0x7f2a88197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:36.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87400700 1 -- 172.21.15.23:0/2297864508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88100240 msgr2=0x7f2a88197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87400700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88100240 0x7f2a88197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87400700 1 -- 172.21.15.23:0/2297864508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a740095f0 con 0x7f2a88101440 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.610+0000 7f2a87400700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a881981d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400bd70 tx=0x7f2a7400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.611+0000 7f2a84c00700 1 -- 172.21.15.23:0/2297864508 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7401d070 con 0x7f2a88101440 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.611+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8819d370 con 0x7f2a88101440 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.611+0000 7f2a84c00700 1 -- 172.21.15.23:0/2297864508 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2a74022470 con 0x7f2a88101440 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.611+0000 7f2a84c00700 1 -- 172.21.15.23:0/2297864508 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7400f670 con 0x7f2a88101440 2024-02-28T16:31:36.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.611+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8819d860 con 0x7f2a88101440 2024-02-28T16:31:36.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.612+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a88105520 con 0x7f2a88101440 2024-02-28T16:31:36.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.613+0000 7f2a84c00700 1 -- 172.21.15.23:0/2297864508 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2a74022a50 con 0x7f2a88101440 2024-02-28T16:31:36.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.614+0000 7f2a84c00700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2a6c06d8a0 0x7f2a6c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:36.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.614+0000 7f2a84c00700 1 -- 172.21.15.23:0/2297864508 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2a7408ead0 con 0x7f2a88101440 2024-02-28T16:31:36.603 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.614+0000 7f2a87e00700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2a6c06d8a0 0x7f2a6c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:36.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.615+0000 7f2a87e00700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2a6c06d8a0 0x7f2a6c06fd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a78005950 tx=0x7f2a780058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:36.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.619+0000 7f2a84c00700 1 -- 172.21.15.23:0/2297864508 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2a74058520 con 0x7f2a88101440 2024-02-28T16:31:36.869 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.880+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a88061190 con 0x7f2a6c06d8a0 2024-02-28T16:31:36.869 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:36 smithi023 ceph-mon[78509]: pgmap v207: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:36.870 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:36 smithi023 ceph-mon[78509]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:36.870 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:36 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3246173404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:36.870 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:36.870 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:36.870 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:36 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3037149449' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:31:36.870 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.881+0000 7f2a84c00700 1 -- 172.21.15.23:0/2297864508 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2a88061190 con 0x7f2a6c06d8a0 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "osd" 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "12/23 daemons upgraded", 2024-02-28T16:31:36.871 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:31:36.872 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:31:36.872 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.884+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2a6c06d8a0 msgr2=0x7f2a6c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.884+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2a6c06d8a0 0x7f2a6c06fd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a78005950 tx=0x7f2a780058e0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.884+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 msgr2=0x7f2a881981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.884+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a881981d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400bd70 tx=0x7f2a7400be50 comp rx=0 tx=0).stop 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.885+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 shutdown_connections 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.885+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88100240 0x7f2a88197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.885+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2a6c06d8a0 0x7f2a6c06fd50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.885+0000 7f2a8f200700 1 --2- 172.21.15.23:0/2297864508 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2a88101440 0x7f2a881981d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.885+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 >> 172.21.15.23:0/2297864508 conn(0x7f2a880fb7f0 msgr2=0x7f2a88102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.885+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 shutdown_connections 2024-02-28T16:31:36.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:36.885+0000 7f2a8f200700 1 -- 172.21.15.23:0/2297864508 wait complete. 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1742779358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24074d20 msgr2=0x7f0f24073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1742779358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24074d20 0x7f0f24073180 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009910 tx=0x7f0f18009c20 comp rx=0 tx=0).stop 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1742779358 shutdown_connections 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1742779358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f24073750 0x7f0f24073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1742779358 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24074d20 0x7f0f24073180 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1742779358 >> 172.21.15.23:0/1742779358 conn(0x7f0f240fb610 msgr2=0x7f0f240fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1742779358 shutdown_connections 2024-02-28T16:31:37.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.034+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1742779358 wait complete. 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.035+0000 7f0f2ae00700 1 Processor -- start 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.035+0000 7f0f2ae00700 1 -- start start 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.035+0000 7f0f2ae00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24073750 0x7f0f24197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.035+0000 7f0f2ae00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f24074d20 0x7f0f24197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.035+0000 7f0f2ae00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241985a0 con 0x7f0f24073750 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.035+0000 7f0f2ae00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241986e0 con 0x7f0f24074d20 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24073750 0x7f0f24197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24073750 0x7f0f24197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52094/0 (socket says 172.21.15.23:52094) 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29a00700 1 -- 172.21.15.23:0/1632924969 learned_addr learned my addr 172.21.15.23:0/1632924969 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29000700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f24074d20 0x7f0f24197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29a00700 1 -- 172.21.15.23:0/1632924969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f24074d20 msgr2=0x7f0f24197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29a00700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f24074d20 0x7f0f24197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29a00700 1 -- 172.21.15.23:0/1632924969 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180095f0 con 0x7f0f24073750 2024-02-28T16:31:37.025 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29000700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f24074d20 0x7f0f24197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:31:37.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.036+0000 7f0f29a00700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24073750 0x7f0f24197a40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005b40 tx=0x7f0f1800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:37.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.037+0000 7f0f22000700 1 -- 172.21.15.23:0/1632924969 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f1801d070 con 0x7f0f24073750 2024-02-28T16:31:37.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.037+0000 7f0f22000700 1 -- 172.21.15.23:0/1632924969 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f1800f460 con 0x7f0f24073750 2024-02-28T16:31:37.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.037+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2419d130 con 0x7f0f24073750 2024-02-28T16:31:37.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.037+0000 7f0f22000700 1 -- 172.21.15.23:0/1632924969 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f18021640 con 0x7f0f24073750 2024-02-28T16:31:37.026 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.037+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2419d620 con 0x7f0f24073750 2024-02-28T16:31:37.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.038+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2410adc0 con 0x7f0f24073750 2024-02-28T16:31:37.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.039+0000 7f0f22000700 1 -- 172.21.15.23:0/1632924969 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0f1800fa90 con 0x7f0f24073750 2024-02-28T16:31:37.028 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.040+0000 7f0f22000700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f0c06d8a0 0x7f0f0c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:37.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.040+0000 7f0f22000700 1 -- 172.21.15.23:0/1632924969 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0f1808e7d0 con 0x7f0f24073750 2024-02-28T16:31:37.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.040+0000 7f0f29000700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f0c06d8a0 0x7f0f0c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:37.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.041+0000 7f0f29000700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f0c06d8a0 0x7f0f0c06fd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f10005fd0 tx=0x7f0f10005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:37.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.045+0000 7f0f22000700 1 -- 172.21.15.23:0/1632924969 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0f1805bb80 con 0x7f0f24073750 2024-02-28T16:31:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:36 smithi153 ceph-mon[66339]: pgmap v207: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:36 smithi153 ceph-mon[66339]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:36 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3246173404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:37.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:36 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3037149449' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:31:37.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.361+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0f2410afb0 con 0x7f0f24073750 2024-02-28T16:31:37.350 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.362+0000 7f0f22000700 1 -- 172.21.15.23:0/1632924969 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0f1805b710 con 0x7f0f24073750 2024-02-28T16:31:37.350 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:31:37.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.364+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f0c06d8a0 msgr2=0x7f0f0c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.364+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f0c06d8a0 0x7f0f0c06fd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f10005fd0 tx=0x7f0f10005ee0 comp rx=0 tx=0).stop 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.364+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24073750 msgr2=0x7f0f24197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.364+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24073750 0x7f0f24197a40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005b40 tx=0x7f0f1800be20 comp rx=0 tx=0).stop 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.365+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 shutdown_connections 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.365+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0f0c06d8a0 0x7f0f0c06fd50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.365+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f24073750 0x7f0f24197a40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.365+0000 7f0f2ae00700 1 --2- 172.21.15.23:0/1632924969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f24074d20 0x7f0f24197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.365+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 >> 172.21.15.23:0/1632924969 conn(0x7f0f240fb610 msgr2=0x7f0f24105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.365+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 shutdown_connections 2024-02-28T16:31:37.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:31:37.365+0000 7f0f2ae00700 1 -- 172.21.15.23:0/1632924969 wait complete. 2024-02-28T16:31:38.035 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:37 smithi023 ceph-mon[78509]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:38.036 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:37 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1632924969' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:31:38.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:37 smithi153 ceph-mon[66339]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:38.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:37 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1632924969' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:31:38.984 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:38 smithi023 ceph-mon[78509]: pgmap v208: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:39.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:38 smithi153 ceph-mon[66339]: pgmap v208: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:40.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:40 smithi023 ceph-mon[78509]: pgmap v209: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:41.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:40 smithi153 ceph-mon[66339]: pgmap v209: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:42.384 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:41 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:42.384 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:41 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:42.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:41 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:42.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:41 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:43.297 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:42 smithi153 ceph-mon[66339]: pgmap v210: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:43.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:42 smithi023 ceph-mon[78509]: pgmap v210: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:44.324 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:44.325 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:44.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:44.388 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:45.314 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:45 smithi023 ceph-mon[78509]: pgmap v211: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:45.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:45 smithi153 ceph-mon[66339]: pgmap v211: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:47.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:47 smithi153 ceph-mon[66339]: pgmap v212: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:47 smithi023 ceph-mon[78509]: pgmap v212: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:49 smithi153 ceph-mon[66339]: pgmap v213: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:49.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:49 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:49.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:49 smithi023 ceph-mon[78509]: pgmap v213: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:49.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:49.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:49.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:49.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:49.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:49 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:50.384 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:50 smithi023 ceph-mon[78509]: Detected new or changed devices on smithi023 2024-02-28T16:31:50.384 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:50.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi023.klbbrl"]}]: dispatch 2024-02-28T16:31:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:50 smithi153 ceph-mon[66339]: Detected new or changed devices on smithi023 2024-02-28T16:31:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:50.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi023.klbbrl"]}]: dispatch 2024-02-28T16:31:51.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:51 smithi153 ceph-mon[66339]: Upgrade: It appears safe to stop mds.cephfs.smithi023.klbbrl 2024-02-28T16:31:51.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:51 smithi153 ceph-mon[66339]: pgmap v214: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:51.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:51 smithi023 ceph-mon[78509]: Upgrade: It appears safe to stop mds.cephfs.smithi023.klbbrl 2024-02-28T16:31:51.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:51 smithi023 ceph-mon[78509]: pgmap v214: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:52.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:52.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:52.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:31:52.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:52.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:52.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:31:52.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi023.klbbrl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:31:52.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:53.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:53 smithi153 ceph-mon[66339]: pgmap v215: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:53.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:53 smithi153 ceph-mon[66339]: Upgrade: Updating mds.cephfs.smithi023.klbbrl 2024-02-28T16:31:53.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:53 smithi153 ceph-mon[66339]: Deploying daemon mds.cephfs.smithi023.klbbrl on smithi023 2024-02-28T16:31:53.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:53 smithi023 ceph-mon[78509]: pgmap v215: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:53.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:53 smithi023 ceph-mon[78509]: Upgrade: Updating mds.cephfs.smithi023.klbbrl 2024-02-28T16:31:53.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:53 smithi023 ceph-mon[78509]: Deploying daemon mds.cephfs.smithi023.klbbrl on smithi023 2024-02-28T16:31:54.215 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:54 smithi023 ceph-mon[78509]: pgmap v216: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:54.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:54 smithi153 ceph-mon[66339]: pgmap v216: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[78505]: 2024-02-28T16:31:55.012+0000 7f38c2800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-mon[78509]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-mon[78509]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-mon[78509]: osdmap e83: 6 total, 6 up, 6 in 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-mon[78509]: Standby daemon mds.cephfs.smithi153.senzwp assigned to filesystem cephfs as rank 0 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-mon[78509]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-mon[78509]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:31:55.294 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:55 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:replay} 2 up:standby 2024-02-28T16:31:55.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:55 smithi153 ceph-mon[66339]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:31:55.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:55 smithi153 ceph-mon[66339]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:31:55.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:55 smithi153 ceph-mon[66339]: osdmap e83: 6 total, 6 up, 6 in 2024-02-28T16:31:55.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:55 smithi153 ceph-mon[66339]: Standby daemon mds.cephfs.smithi153.senzwp assigned to filesystem cephfs as rank 0 2024-02-28T16:31:55.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:55 smithi153 ceph-mon[66339]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:31:55.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:55 smithi153 ceph-mon[66339]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:31:55.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:55 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:replay} 2 up:standby 2024-02-28T16:31:56.248 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:56 smithi023 ceph-mon[78509]: pgmap v218: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:56.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:56 smithi153 ceph-mon[66339]: pgmap v218: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:31:57.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:31:57.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:31:58.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:31:58 smithi023 ceph-mon[78509]: pgmap v219: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 0 op/s 2024-02-28T16:31:58.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:31:58 smithi153 ceph-mon[66339]: pgmap v219: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 0 op/s 2024-02-28T16:32:00.614 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:00 smithi023 ceph-mon[78509]: pgmap v220: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-02-28T16:32:00.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:00 smithi153 ceph-mon[66339]: pgmap v220: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-02-28T16:32:02.539 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:02 smithi023 ceph-mon[78509]: pgmap v221: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:32:02.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:02 smithi153 ceph-mon[66339]: pgmap v221: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:32:04.280 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:04.280 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:04.281 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:04.281 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:03 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] up:boot 2024-02-28T16:32:04.281 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:03 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:replay} 3 up:standby 2024-02-28T16:32:04.281 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:32:04.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:04.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:04.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:04.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:03 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] up:boot 2024-02-28T16:32:04.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:03 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:replay} 3 up:standby 2024-02-28T16:32:04.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:32:05.265 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:05 smithi023 ceph-mon[78509]: pgmap v222: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:32:05.265 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:05 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:reconnect 2024-02-28T16:32:05.266 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:05 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:reconnect} 3 up:standby 2024-02-28T16:32:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:05 smithi153 ceph-mon[66339]: pgmap v222: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:32:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:05 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:reconnect 2024-02-28T16:32:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:05 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:reconnect} 3 up:standby 2024-02-28T16:32:06.277 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:06 smithi023 ceph-mon[78509]: reconnect by client.24297 192.168.0.1:0/123756084 after 0.00299995 2024-02-28T16:32:06.277 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:06 smithi023 ceph-mon[78509]: reconnect by client.14528 192.168.0.1:0/3625101817 after 0.00499991 2024-02-28T16:32:06.277 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:06 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:rejoin 2024-02-28T16:32:06.278 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:06 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:rejoin} 3 up:standby 2024-02-28T16:32:06.278 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:06 smithi023 ceph-mon[78509]: daemon mds.cephfs.smithi153.senzwp is now active in filesystem cephfs as rank 0 2024-02-28T16:32:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:06 smithi153 ceph-mon[66339]: reconnect by client.24297 192.168.0.1:0/123756084 after 0.00299995 2024-02-28T16:32:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:06 smithi153 ceph-mon[66339]: reconnect by client.14528 192.168.0.1:0/3625101817 after 0.00499991 2024-02-28T16:32:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:06 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:rejoin 2024-02-28T16:32:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:06 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi153.senzwp=up:rejoin} 3 up:standby 2024-02-28T16:32:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:06 smithi153 ceph-mon[66339]: daemon mds.cephfs.smithi153.senzwp is now active in filesystem cephfs as rank 0 2024-02-28T16:32:07.268 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:07 smithi023 ceph-mon[78509]: pgmap v223: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:32:07.268 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:07.268 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:07.268 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:07 smithi023 ceph-mon[78509]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:32:07.268 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:07 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:32:07.268 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:07 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:active 2024-02-28T16:32:07.268 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:07 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi153.senzwp=up:active} 3 up:standby 2024-02-28T16:32:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:07 smithi153 ceph-mon[66339]: pgmap v223: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:32:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:07 smithi153 ceph-mon[66339]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:32:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:07 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:32:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:07 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] up:active 2024-02-28T16:32:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:07 smithi153 ceph-mon[66339]: fsmap cephfs:1 {0=cephfs.smithi153.senzwp=up:active} 3 up:standby 2024-02-28T16:32:07.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.541+0000 7f5d32400700 1 -- 172.21.15.23:0/1057121240 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c074d20 msgr2=0x7f5d2c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.541+0000 7f5d32400700 1 --2- 172.21.15.23:0/1057121240 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c074d20 0x7f5d2c073180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009910 tx=0x7f5d1c009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.541+0000 7f5d32400700 1 -- 172.21.15.23:0/1057121240 shutdown_connections 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.541+0000 7f5d32400700 1 --2- 172.21.15.23:0/1057121240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c073750 0x7f5d2c073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.541+0000 7f5d32400700 1 --2- 172.21.15.23:0/1057121240 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c074d20 0x7f5d2c073180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.541+0000 7f5d32400700 1 -- 172.21.15.23:0/1057121240 >> 172.21.15.23:0/1057121240 conn(0x7f5d2c0fb7f0 msgr2=0x7f5d2c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.542+0000 7f5d32400700 1 -- 172.21.15.23:0/1057121240 shutdown_connections 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.542+0000 7f5d32400700 1 -- 172.21.15.23:0/1057121240 wait complete. 2024-02-28T16:32:07.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.543+0000 7f5d32400700 1 Processor -- start 2024-02-28T16:32:07.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.543+0000 7f5d32400700 1 -- start start 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.543+0000 7f5d32400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c073750 0x7f5d2c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.543+0000 7f5d32400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c074d20 0x7f5d2c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.543+0000 7f5d32400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c1987e0 con 0x7f5d2c073750 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.543+0000 7f5d32400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c198950 con 0x7f5d2c074d20 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c073750 0x7f5d2c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c073750 0x7f5d2c197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:40674/0 (socket says 172.21.15.23:40674) 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2b400700 1 -- 172.21.15.23:0/3946547758 learned_addr learned my addr 172.21.15.23:0/3946547758 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2aa00700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c074d20 0x7f5d2c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2b400700 1 -- 172.21.15.23:0/3946547758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c074d20 msgr2=0x7f5d2c1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2b400700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c074d20 0x7f5d2c1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2b400700 1 -- 172.21.15.23:0/3946547758 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0095f0 con 0x7f5d2c073750 2024-02-28T16:32:07.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.544+0000 7f5d2aa00700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c074d20 0x7f5d2c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:32:07.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.545+0000 7f5d2b400700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c073750 0x7f5d2c197ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c006010 tx=0x7f5d1c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:07.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.545+0000 7f5d23e00700 1 -- 172.21.15.23:0/3946547758 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1c01d070 con 0x7f5d2c073750 2024-02-28T16:32:07.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.545+0000 7f5d23e00700 1 -- 172.21.15.23:0/3946547758 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d1c00f460 con 0x7f5d2c073750 2024-02-28T16:32:07.534 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.545+0000 7f5d23e00700 1 -- 172.21.15.23:0/3946547758 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1c021640 con 0x7f5d2c073750 2024-02-28T16:32:07.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.545+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c19d380 con 0x7f5d2c073750 2024-02-28T16:32:07.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.545+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c19d820 con 0x7f5d2c073750 2024-02-28T16:32:07.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.546+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c10af80 con 0x7f5d2c073750 2024-02-28T16:32:07.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.547+0000 7f5d23e00700 1 -- 172.21.15.23:0/3946547758 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f5d1c00fab0 con 0x7f5d2c073750 2024-02-28T16:32:07.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.548+0000 7f5d23e00700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5d1006d8a0 0x7f5d1006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:07.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.548+0000 7f5d23e00700 1 -- 172.21.15.23:0/3946547758 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5d1c08e990 con 0x7f5d2c073750 2024-02-28T16:32:07.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.549+0000 7f5d2aa00700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5d1006d8a0 0x7f5d1006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:07.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.549+0000 7f5d2aa00700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5d1006d8a0 0x7f5d1006fd50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5d18005fd0 tx=0x7f5d18005dc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:07.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.554+0000 7f5d23e00700 1 -- 172.21.15.23:0/3946547758 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5d1c058120 con 0x7f5d2c073750 2024-02-28T16:32:07.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.824+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d2c1077a0 con 0x7f5d1006d8a0 2024-02-28T16:32:07.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.827+0000 7f5d23e00700 1 -- 172.21.15.23:0/3946547758 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5d2c1077a0 con 0x7f5d1006d8a0 2024-02-28T16:32:07.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.829+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5d1006d8a0 msgr2=0x7f5d1006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.829+0000 7f5d32400700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5d1006d8a0 0x7f5d1006fd50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5d18005fd0 tx=0x7f5d18005dc0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.829+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c073750 msgr2=0x7f5d2c197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.829+0000 7f5d32400700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c073750 0x7f5d2c197ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c006010 tx=0x7f5d1c00be20 comp rx=0 tx=0).stop 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.830+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 shutdown_connections 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.830+0000 7f5d32400700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f5d1006d8a0 0x7f5d1006fd50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.830+0000 7f5d32400700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5d2c073750 0x7f5d2c197ca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.830+0000 7f5d32400700 1 --2- 172.21.15.23:0/3946547758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c074d20 0x7f5d2c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.830+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 >> 172.21.15.23:0/3946547758 conn(0x7f5d2c0fb7f0 msgr2=0x7f5d2c106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.830+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 shutdown_connections 2024-02-28T16:32:07.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.830+0000 7f5d32400700 1 -- 172.21.15.23:0/3946547758 wait complete. 2024-02-28T16:32:07.836 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:32:07.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 -- 172.21.15.23:0/1228591498 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0101440 msgr2=0x7f2ad0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:07.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 --2- 172.21.15.23:0/1228591498 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0101440 0x7f2ad0101890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009910 tx=0x7f2abc009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:07.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 -- 172.21.15.23:0/1228591498 shutdown_connections 2024-02-28T16:32:07.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 --2- 172.21.15.23:0/1228591498 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0101440 0x7f2ad0101890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 --2- 172.21.15.23:0/1228591498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad0100240 0x7f2ad0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 -- 172.21.15.23:0/1228591498 >> 172.21.15.23:0/1228591498 conn(0x7f2ad00fb7f0 msgr2=0x7f2ad00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:07.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 -- 172.21.15.23:0/1228591498 shutdown_connections 2024-02-28T16:32:07.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.987+0000 7f2ad7200700 1 -- 172.21.15.23:0/1228591498 wait complete. 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.988+0000 7f2ad7200700 1 Processor -- start 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.988+0000 7f2ad7200700 1 -- start start 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2ad7200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0100240 0x7f2ad0197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2ad7200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad0101440 0x7f2ad0198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2ad7200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01988b0 con 0x7f2ad0100240 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2ad7200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01989f0 con 0x7f2ad0101440 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2acfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0100240 0x7f2ad0197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:07.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2acfe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0100240 0x7f2ad0197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:40698/0 (socket says 172.21.15.23:40698) 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2acfe00700 1 -- 172.21.15.23:0/4159167313 learned_addr learned my addr 172.21.15.23:0/4159167313 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2acf400700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad0101440 0x7f2ad0198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2acfe00700 1 -- 172.21.15.23:0/4159167313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad0101440 msgr2=0x7f2ad0198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2acfe00700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad0101440 0x7f2ad0198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.989+0000 7f2acfe00700 1 -- 172.21.15.23:0/4159167313 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0095f0 con 0x7f2ad0100240 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.990+0000 7f2acfe00700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0100240 0x7f2ad0197d50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000b480 tx=0x7f2ac000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.990+0000 7f2accc00700 1 -- 172.21.15.23:0/4159167313 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac00118c0 con 0x7f2ad0100240 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.990+0000 7f2accc00700 1 -- 172.21.15.23:0/4159167313 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ac0010380 con 0x7f2ad0100240 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.990+0000 7f2accc00700 1 -- 172.21.15.23:0/4159167313 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac000f4f0 con 0x7f2ad0100240 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.990+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad019d4a0 con 0x7f2ad0100240 2024-02-28T16:32:07.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.991+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad019d9c0 con 0x7f2ad0100240 2024-02-28T16:32:07.981 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.992+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad0105520 con 0x7f2ad0100240 2024-02-28T16:32:07.981 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.993+0000 7f2accc00700 1 -- 172.21.15.23:0/4159167313 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2ac00104f0 con 0x7f2ad0100240 2024-02-28T16:32:07.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.994+0000 7f2accc00700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ab406d8a0 0x7f2ab406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:07.982 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.994+0000 7f2accc00700 1 -- 172.21.15.23:0/4159167313 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2ac008cc00 con 0x7f2ad0100240 2024-02-28T16:32:07.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.994+0000 7f2acf400700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ab406d8a0 0x7f2ab406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:07.983 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.995+0000 7f2acf400700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ab406d8a0 0x7f2ab406fd50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2abc006010 tx=0x7f2abc00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:07.987 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:07.999+0000 7f2accc00700 1 -- 172.21.15.23:0/4159167313 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2ac0059ec0 con 0x7f2ad0100240 2024-02-28T16:32:08.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.257+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad0061190 con 0x7f2ab406d8a0 2024-02-28T16:32:08.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.259+0000 7f2accc00700 1 -- 172.21.15.23:0/4159167313 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2ad0061190 con 0x7f2ab406d8a0 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ab406d8a0 msgr2=0x7f2ab406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ab406d8a0 0x7f2ab406fd50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2abc006010 tx=0x7f2abc00b540 comp rx=0 tx=0).stop 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0100240 msgr2=0x7f2ad0197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0100240 0x7f2ad0197d50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000b480 tx=0x7f2ac000b840 comp rx=0 tx=0).stop 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 shutdown_connections 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2ab406d8a0 0x7f2ab406fd50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2ad0100240 0x7f2ad0197d50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.261+0000 7f2ad7200700 1 --2- 172.21.15.23:0/4159167313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad0101440 0x7f2ad0198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.262+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 >> 172.21.15.23:0/4159167313 conn(0x7f2ad00fb7f0 msgr2=0x7f2ad0102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:08.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.262+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 shutdown_connections 2024-02-28T16:32:08.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.262+0000 7f2ad7200700 1 -- 172.21.15.23:0/4159167313 wait complete. 2024-02-28T16:32:08.409 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 -- 172.21.15.23:0/3972405976 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8101440 msgr2=0x7fc2b8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.409 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 --2- 172.21.15.23:0/3972405976 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8101440 0x7fc2b8101890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009910 tx=0x7fc2a4009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:08.409 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 -- 172.21.15.23:0/3972405976 shutdown_connections 2024-02-28T16:32:08.409 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 --2- 172.21.15.23:0/3972405976 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8101440 0x7fc2b8101890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.409 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 --2- 172.21.15.23:0/3972405976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2b8100240 0x7fc2b8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.409 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 -- 172.21.15.23:0/3972405976 >> 172.21.15.23:0/3972405976 conn(0x7fc2b80fb7f0 msgr2=0x7fc2b80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:08.410 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 -- 172.21.15.23:0/3972405976 shutdown_connections 2024-02-28T16:32:08.410 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.420+0000 7fc2bf000700 1 -- 172.21.15.23:0/3972405976 wait complete. 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.421+0000 7fc2bf000700 1 Processor -- start 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2bf000700 1 -- start start 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2bf000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8100240 0x7fc2b8197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2bf000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2b8101440 0x7fc2b8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2bf000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81988b0 con 0x7fc2b8100240 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2bf000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81989f0 con 0x7fc2b8101440 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2b7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8100240 0x7fc2b8197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:08.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2b7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8100240 0x7fc2b8197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:40706/0 (socket says 172.21.15.23:40706) 2024-02-28T16:32:08.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2b7e00700 1 -- 172.21.15.23:0/2353036866 learned_addr learned my addr 172.21.15.23:0/2353036866 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:08.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.422+0000 7fc2b7400700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2b8101440 0x7fc2b8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:08.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2b7e00700 1 -- 172.21.15.23:0/2353036866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2b8101440 msgr2=0x7fc2b8198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2b7e00700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2b8101440 0x7fc2b8198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2b7e00700 1 -- 172.21.15.23:0/2353036866 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40095f0 con 0x7fc2b8100240 2024-02-28T16:32:08.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2b7e00700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8100240 0x7fc2b8197d50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800b480 tx=0x7fc2a800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:08.413 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2b4c00700 1 -- 172.21.15.23:0/2353036866 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a80118c0 con 0x7fc2b8100240 2024-02-28T16:32:08.413 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2b4c00700 1 -- 172.21.15.23:0/2353036866 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc2a8010380 con 0x7fc2b8100240 2024-02-28T16:32:08.413 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b819d4a0 con 0x7fc2b8100240 2024-02-28T16:32:08.413 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2b4c00700 1 -- 172.21.15.23:0/2353036866 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a800f4f0 con 0x7fc2b8100240 2024-02-28T16:32:08.413 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.423+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b819d9f0 con 0x7fc2b8100240 2024-02-28T16:32:08.413 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.424+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b8105520 con 0x7fc2b8100240 2024-02-28T16:32:08.414 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.426+0000 7fc2b4c00700 1 -- 172.21.15.23:0/2353036866 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc2a80104f0 con 0x7fc2b8100240 2024-02-28T16:32:08.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.427+0000 7fc2b4c00700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc29c06d8a0 0x7fc29c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:08.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.427+0000 7fc2b4c00700 1 -- 172.21.15.23:0/2353036866 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc2a808d630 con 0x7fc2b8100240 2024-02-28T16:32:08.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.427+0000 7fc2b7400700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc29c06d8a0 0x7fc29c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:08.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.428+0000 7fc2b7400700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc29c06d8a0 0x7fc29c06fd50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006010 tx=0x7fc2a400b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:08.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.431+0000 7fc2b4c00700 1 -- 172.21.15.23:0/2353036866 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc2a805a8f0 con 0x7fc2b8100240 2024-02-28T16:32:08.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.679+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b8061190 con 0x7fc29c06d8a0 2024-02-28T16:32:08.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.694+0000 7fc2b4c00700 1 -- 172.21.15.23:0/2353036866 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc2b8061190 con 0x7fc29c06d8a0 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (17m) 27s ago 18m 14.4M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (19m) 27s ago 19m 9139k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (17m) 54s ago 17m 8476k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (4m) 27s ago 19m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (4m) 54s ago 17m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (16m) 27s ago 18m 74.6M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 starting - - - - 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (35s) 27s ago 11m 10.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (11m) 54s ago 11m 17.3M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (11m) 54s ago 11m 17.5M - 18.2.0 dc2bc1663786 0fec5763f2ee 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (8m) 27s ago 20m 507M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (6m) 54s ago 17m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:32:08.683 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (6m) 27s ago 20m 52.8M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (5m) 54s ago 17m 39.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (19m) 27s ago 19m 8380k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (17m) 54s ago 17m 8250k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (4m) 27s ago 16m 92.3M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (3m) 27s ago 16m 102M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (3m) 27s ago 15m 91.7M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (2m) 54s ago 14m 107M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (101s) 54s ago 14m 98.9M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (59s) 54s ago 13m 11.2M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:32:08.684 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (7m) 27s ago 18m 60.2M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:32:08.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.696+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc29c06d8a0 msgr2=0x7fc29c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.696+0000 7fc2bf000700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc29c06d8a0 0x7fc29c06fd50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006010 tx=0x7fc2a400b540 comp rx=0 tx=0).stop 2024-02-28T16:32:08.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.696+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8100240 msgr2=0x7fc2b8197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.696+0000 7fc2bf000700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8100240 0x7fc2b8197d50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800b480 tx=0x7fc2a800b840 comp rx=0 tx=0).stop 2024-02-28T16:32:08.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.697+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 shutdown_connections 2024-02-28T16:32:08.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.697+0000 7fc2bf000700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc29c06d8a0 0x7fc29c06fd50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.697+0000 7fc2bf000700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc2b8100240 0x7fc2b8197d50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.697+0000 7fc2bf000700 1 --2- 172.21.15.23:0/2353036866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2b8101440 0x7fc2b8198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.697+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 >> 172.21.15.23:0/2353036866 conn(0x7fc2b80fb7f0 msgr2=0x7fc2b8102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:08.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.697+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 shutdown_connections 2024-02-28T16:32:08.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.697+0000 7fc2bf000700 1 -- 172.21.15.23:0/2353036866 wait complete. 2024-02-28T16:32:08.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.850+0000 7ff87a200700 1 -- 172.21.15.23:0/831627907 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874101440 msgr2=0x7ff874101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.850+0000 7ff87a200700 1 --2- 172.21.15.23:0/831627907 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874101440 0x7ff874101890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff860009910 tx=0x7ff860009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:08.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.851+0000 7ff87a200700 1 -- 172.21.15.23:0/831627907 shutdown_connections 2024-02-28T16:32:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.851+0000 7ff87a200700 1 --2- 172.21.15.23:0/831627907 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874101440 0x7ff874101890 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.851+0000 7ff87a200700 1 --2- 172.21.15.23:0/831627907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff874100240 0x7ff874100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.851+0000 7ff87a200700 1 -- 172.21.15.23:0/831627907 >> 172.21.15.23:0/831627907 conn(0x7ff8740fb7f0 msgr2=0x7ff8740fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.851+0000 7ff87a200700 1 -- 172.21.15.23:0/831627907 shutdown_connections 2024-02-28T16:32:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.851+0000 7ff87a200700 1 -- 172.21.15.23:0/831627907 wait complete. 2024-02-28T16:32:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.852+0000 7ff87a200700 1 Processor -- start 2024-02-28T16:32:08.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.852+0000 7ff87a200700 1 -- start start 2024-02-28T16:32:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.852+0000 7ff87a200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874100240 0x7ff874195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.852+0000 7ff87a200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff874101440 0x7ff874195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.852+0000 7ff87a200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8741965f0 con 0x7ff874100240 2024-02-28T16:32:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.852+0000 7ff87a200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874196730 con 0x7ff874101440 2024-02-28T16:32:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.853+0000 7ff873400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874100240 0x7ff874195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.853+0000 7ff873400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874100240 0x7ff874195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:40728/0 (socket says 172.21.15.23:40728) 2024-02-28T16:32:08.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.853+0000 7ff873400700 1 -- 172.21.15.23:0/531771066 learned_addr learned my addr 172.21.15.23:0/531771066 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:08.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.853+0000 7ff872a00700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff874101440 0x7ff874195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:08.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.853+0000 7ff873400700 1 -- 172.21.15.23:0/531771066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff874101440 msgr2=0x7ff874195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:08.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.853+0000 7ff873400700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff874101440 0x7ff874195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:08.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.853+0000 7ff873400700 1 -- 172.21.15.23:0/531771066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600095f0 con 0x7ff874100240 2024-02-28T16:32:08.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.854+0000 7ff873400700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874100240 0x7ff874195a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c8f0 tx=0x7ff86400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:08.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.854+0000 7ff86be00700 1 -- 172.21.15.23:0/531771066 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff864007a70 con 0x7ff874100240 2024-02-28T16:32:08.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.854+0000 7ff86be00700 1 -- 172.21.15.23:0/531771066 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff864007bd0 con 0x7ff874100240 2024-02-28T16:32:08.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.854+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87419b1e0 con 0x7ff874100240 2024-02-28T16:32:08.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.854+0000 7ff86be00700 1 -- 172.21.15.23:0/531771066 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff864018630 con 0x7ff874100240 2024-02-28T16:32:08.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.854+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87419b730 con 0x7ff874100240 2024-02-28T16:32:08.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.855+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff874108d90 con 0x7ff874100240 2024-02-28T16:32:08.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.856+0000 7ff86be00700 1 -- 172.21.15.23:0/531771066 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff86400f450 con 0x7ff874100240 2024-02-28T16:32:08.846 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.858+0000 7ff86be00700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff85806d8a0 0x7ff85806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:08.846 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.858+0000 7ff86be00700 1 -- 172.21.15.23:0/531771066 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff86408d520 con 0x7ff874100240 2024-02-28T16:32:08.847 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.858+0000 7ff872a00700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff85806d8a0 0x7ff85806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:08.847 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.859+0000 7ff872a00700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff85806d8a0 0x7ff85806fd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff860006010 tx=0x7ff86000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:08.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:08.863+0000 7ff86be00700 1 -- 172.21.15.23:0/531771066 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff86405a8b0 con 0x7ff874100240 2024-02-28T16:32:09.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.220+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff87419bdd0 con 0x7ff874100240 2024-02-28T16:32:09.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.221+0000 7ff86be00700 1 -- 172.21.15.23:0/531771066 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7ff86405a440 con 0x7ff874100240 2024-02-28T16:32:09.210 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-02-28T16:32:09.211 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 12 2024-02-28T16:32:09.212 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:32:09.212 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:32:09.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff85806d8a0 msgr2=0x7ff85806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff85806d8a0 0x7ff85806fd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff860006010 tx=0x7ff86000b540 comp rx=0 tx=0).stop 2024-02-28T16:32:09.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874100240 msgr2=0x7ff874195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874100240 0x7ff874195a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c8f0 tx=0x7ff86400ccb0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.213 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 shutdown_connections 2024-02-28T16:32:09.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff85806d8a0 0x7ff85806fd50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff874100240 0x7ff874195a90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 --2- 172.21.15.23:0/531771066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff874101440 0x7ff874195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 >> 172.21.15.23:0/531771066 conn(0x7ff8740fb7f0 msgr2=0x7ff874104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:09.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.224+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 shutdown_connections 2024-02-28T16:32:09.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.225+0000 7ff87a200700 1 -- 172.21.15.23:0/531771066 wait complete. 2024-02-28T16:32:09.249 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:09 smithi023 ceph-mon[78509]: pgmap v224: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-02-28T16:32:09.249 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:09 smithi023 ceph-mon[78509]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:09.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 -- 172.21.15.23:0/186313596 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 msgr2=0x7fde7c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 --2- 172.21.15.23:0/186313596 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c100650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00b0a0 tx=0x7fde6c00b3b0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 -- 172.21.15.23:0/186313596 shutdown_connections 2024-02-28T16:32:09.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 --2- 172.21.15.23:0/186313596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde7c101440 0x7fde7c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 --2- 172.21.15.23:0/186313596 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c100650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 -- 172.21.15.23:0/186313596 >> 172.21.15.23:0/186313596 conn(0x7fde7c0fb7f0 msgr2=0x7fde7c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:09.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 -- 172.21.15.23:0/186313596 shutdown_connections 2024-02-28T16:32:09.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.381+0000 7fde82800700 1 -- 172.21.15.23:0/186313596 wait complete. 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.382+0000 7fde82800700 1 Processor -- start 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde82800700 1 -- start start 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde82800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde82800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde7c101440 0x7fde7c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde82800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1989a0 con 0x7fde7c100240 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde82800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c198ae0 con 0x7fde7c101440 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde7b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde7b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:40754/0 (socket says 172.21.15.23:40754) 2024-02-28T16:32:09.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.383+0000 7fde7b400700 1 -- 172.21.15.23:0/2103009124 learned_addr learned my addr 172.21.15.23:0/2103009124 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:09.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde7b400700 1 -- 172.21.15.23:0/2103009124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde7c101440 msgr2=0x7fde7c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde7aa00700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde7c101440 0x7fde7c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:09.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde7b400700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde7c101440 0x7fde7c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.373 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde7b400700 1 -- 172.21.15.23:0/2103009124 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009d00 con 0x7fde7c100240 2024-02-28T16:32:09.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde7b400700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c197e40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00b070 tx=0x7fde6c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:09.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde73e00700 1 -- 172.21.15.23:0/2103009124 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6c00e040 con 0x7fde7c100240 2024-02-28T16:32:09.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde73e00700 1 -- 172.21.15.23:0/2103009124 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fde6c00ce60 con 0x7fde7c100240 2024-02-28T16:32:09.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde73e00700 1 -- 172.21.15.23:0/2103009124 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6c01da90 con 0x7fde7c100240 2024-02-28T16:32:09.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.384+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c19d530 con 0x7fde7c100240 2024-02-28T16:32:09.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.385+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c19da20 con 0x7fde7c100240 2024-02-28T16:32:09.374 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.386+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c105520 con 0x7fde7c100240 2024-02-28T16:32:09.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.387+0000 7fde73e00700 1 -- 172.21.15.23:0/2103009124 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fde6c004250 con 0x7fde7c100240 2024-02-28T16:32:09.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.388+0000 7fde73e00700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fde6006d8a0 0x7fde6006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:09.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.388+0000 7fde73e00700 1 -- 172.21.15.23:0/2103009124 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fde6c08f1d0 con 0x7fde7c100240 2024-02-28T16:32:09.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.388+0000 7fde7aa00700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fde6006d8a0 0x7fde6006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:09.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.389+0000 7fde7aa00700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fde6006d8a0 0x7fde6006fd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde68006fd0 tx=0x7fde68008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:09.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.392+0000 7fde73e00700 1 -- 172.21.15.23:0/2103009124 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fde6c05c490 con 0x7fde7c100240 2024-02-28T16:32:09.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:09 smithi153 ceph-mon[66339]: pgmap v224: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-02-28T16:32:09.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:09 smithi153 ceph-mon[66339]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:09.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.678+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fde7c02cc30 con 0x7fde7c100240 2024-02-28T16:32:09.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.678+0000 7fde73e00700 1 -- 172.21.15.23:0/2103009124 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fde6c05c020 con 0x7fde7c100240 2024-02-28T16:32:09.667 INFO:teuthology.orchestra.run.smithi023.stdout:e24 2024-02-28T16:32:09.667 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 24 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:32:05.482218+0000 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:32:09.668 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 83 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=24247} 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:32:09.669 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{0:24247} state up:active seq 180 join_fscid=1 addr [v2:172.21.15.153:6824/1090050783,v1:172.21.15.153:6825/1090050783] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:32:09.670 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fde6006d8a0 msgr2=0x7fde6006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fde6006d8a0 0x7fde6006fd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde68006fd0 tx=0x7fde68008040 comp rx=0 tx=0).stop 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 msgr2=0x7fde7c197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c197e40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00b070 tx=0x7fde6c003ce0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 shutdown_connections 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fde6006d8a0 0x7fde6006fd50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fde7c100240 0x7fde7c197e40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 --2- 172.21.15.23:0/2103009124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde7c101440 0x7fde7c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 >> 172.21.15.23:0/2103009124 conn(0x7fde7c0fb7f0 msgr2=0x7fde7c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 shutdown_connections 2024-02-28T16:32:09.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.682+0000 7fde82800700 1 -- 172.21.15.23:0/2103009124 wait complete. 2024-02-28T16:32:09.672 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 24 2024-02-28T16:32:09.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 -- 172.21.15.23:0/2193162760 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 msgr2=0x7f6f0010ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 --2- 172.21.15.23:0/2193162760 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f0010ae60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009920 tx=0x7f6ef0009c30 comp rx=0 tx=0).stop 2024-02-28T16:32:09.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 -- 172.21.15.23:0/2193162760 shutdown_connections 2024-02-28T16:32:09.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 --2- 172.21.15.23:0/2193162760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0010bcf0 0x7f6f0010c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 --2- 172.21.15.23:0/2193162760 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f0010ae60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.834 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 -- 172.21.15.23:0/2193162760 >> 172.21.15.23:0/2193162760 conn(0x7f6f0006a5b0 msgr2=0x7f6f0006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:09.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 -- 172.21.15.23:0/2193162760 shutdown_connections 2024-02-28T16:32:09.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.845+0000 7f6f05a00700 1 -- 172.21.15.23:0/2193162760 wait complete. 2024-02-28T16:32:09.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.846+0000 7f6f05a00700 1 Processor -- start 2024-02-28T16:32:09.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6f05a00700 1 -- start start 2024-02-28T16:32:09.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6f05a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f001a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:09.835 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6f05a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0010bcf0 0x7f6f001a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:09.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6f05a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001a0d10 con 0x7f6f0010aa50 2024-02-28T16:32:09.836 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6f05a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001a0e50 con 0x7f6f0010bcf0 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6effe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f001a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6effe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f001a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54600/0 (socket says 172.21.15.23:54600) 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.847+0000 7f6effe00700 1 -- 172.21.15.23:0/729919202 learned_addr learned my addr 172.21.15.23:0/729919202 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.848+0000 7f6eff400700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0010bcf0 0x7f6f001a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.848+0000 7f6effe00700 1 -- 172.21.15.23:0/729919202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0010bcf0 msgr2=0x7f6f001a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.848+0000 7f6effe00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0010bcf0 0x7f6f001a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.848+0000 7f6effe00700 1 -- 172.21.15.23:0/729919202 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0009580 con 0x7f6f0010aa50 2024-02-28T16:32:09.837 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.848+0000 7f6effe00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f001a0240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000b910 tx=0x7f6ef0004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:09.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.848+0000 7f6efcc00700 1 -- 172.21.15.23:0/729919202 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef001d070 con 0x7f6f0010aa50 2024-02-28T16:32:09.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.848+0000 7f6efcc00700 1 -- 172.21.15.23:0/729919202 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ef0004020 con 0x7f6f0010aa50 2024-02-28T16:32:09.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.849+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f001a58b0 con 0x7f6f0010aa50 2024-02-28T16:32:09.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.849+0000 7f6efcc00700 1 -- 172.21.15.23:0/729919202 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef0003de0 con 0x7f6f0010aa50 2024-02-28T16:32:09.838 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.849+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f001a5d90 con 0x7f6f0010aa50 2024-02-28T16:32:09.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.850+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00113530 con 0x7f6f0010aa50 2024-02-28T16:32:09.839 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.851+0000 7f6efcc00700 1 -- 172.21.15.23:0/729919202 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6ef0004190 con 0x7f6f0010aa50 2024-02-28T16:32:09.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.852+0000 7f6efcc00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ee406d8a0 0x7f6ee406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:09.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.852+0000 7f6efcc00700 1 -- 172.21.15.23:0/729919202 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6ef008ea40 con 0x7f6f0010aa50 2024-02-28T16:32:09.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.852+0000 7f6eff400700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ee406d8a0 0x7f6ee406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:09.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.853+0000 7f6eff400700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ee406d8a0 0x7f6ee406fd50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6eec005ea0 tx=0x7f6eec005e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:09.848 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:09.860+0000 7f6efcc00700 1 -- 172.21.15.23:0/729919202 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6ef005bd00 con 0x7f6f0010aa50 2024-02-28T16:32:10.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.137+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f00110640 con 0x7f6ee406d8a0 2024-02-28T16:32:10.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.138+0000 7f6efcc00700 1 -- 172.21.15.23:0/729919202 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6f00110640 con 0x7f6ee406d8a0 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: "osd" 2024-02-28T16:32:10.127 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:32:10.128 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "14/23 daemons upgraded", 2024-02-28T16:32:10.128 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:32:10.128 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:32:10.128 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:32:10.129 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ee406d8a0 msgr2=0x7f6ee406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:10.129 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ee406d8a0 0x7f6ee406fd50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6eec005ea0 tx=0x7f6eec005e30 comp rx=0 tx=0).stop 2024-02-28T16:32:10.129 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 msgr2=0x7f6f001a0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:10.129 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f001a0240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000b910 tx=0x7f6ef0004ea0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 shutdown_connections 2024-02-28T16:32:10.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6ee406d8a0 0x7f6ee406fd50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6f0010aa50 0x7f6f001a0240 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 --2- 172.21.15.23:0/729919202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0010bcf0 0x7f6f001a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 >> 172.21.15.23:0/729919202 conn(0x7f6f0006a5b0 msgr2=0x7f6f0010ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:10.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 shutdown_connections 2024-02-28T16:32:10.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.141+0000 7f6f05a00700 1 -- 172.21.15.23:0/729919202 wait complete. 2024-02-28T16:32:10.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 -- 172.21.15.23:0/286571670 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8100240 msgr2=0x7f50c8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:10.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 --2- 172.21.15.23:0/286571670 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8100240 0x7f50c8100650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009910 tx=0x7f50bc009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:10.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 -- 172.21.15.23:0/286571670 shutdown_connections 2024-02-28T16:32:10.279 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:10 smithi023 ceph-mon[78509]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:10.279 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:10 smithi023 ceph-mon[78509]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:10.279 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:10 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/531771066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:10.279 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:10 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2103009124' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:10.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 --2- 172.21.15.23:0/286571670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c8101440 0x7f50c8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 --2- 172.21.15.23:0/286571670 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8100240 0x7f50c8100650 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 -- 172.21.15.23:0/286571670 >> 172.21.15.23:0/286571670 conn(0x7f50c80fb7f0 msgr2=0x7f50c80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:10.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 -- 172.21.15.23:0/286571670 shutdown_connections 2024-02-28T16:32:10.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.290+0000 7f50cf600700 1 -- 172.21.15.23:0/286571670 wait complete. 2024-02-28T16:32:10.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.291+0000 7f50cf600700 1 Processor -- start 2024-02-28T16:32:10.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.291+0000 7f50cf600700 1 -- start start 2024-02-28T16:32:10.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.292+0000 7f50cf600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c8100240 0x7f50c8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:10.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.292+0000 7f50cf600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8101440 0x7f50c8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:10.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.292+0000 7f50cf600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8073680 con 0x7f50c8101440 2024-02-28T16:32:10.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.292+0000 7f50cf600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80737c0 con 0x7f50c8100240 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.292+0000 7f50c7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8101440 0x7f50c8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.292+0000 7f50c7e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8101440 0x7f50c8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54622/0 (socket says 172.21.15.23:54622) 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.292+0000 7f50c7e00700 1 -- 172.21.15.23:0/3239880252 learned_addr learned my addr 172.21.15.23:0/3239880252 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.293+0000 7f50ccc00700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c8100240 0x7f50c8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.293+0000 7f50c7e00700 1 -- 172.21.15.23:0/3239880252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c8100240 msgr2=0x7f50c8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.293+0000 7f50c7e00700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c8100240 0x7f50c8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.293+0000 7f50c7e00700 1 -- 172.21.15.23:0/3239880252 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0095f0 con 0x7f50c8101440 2024-02-28T16:32:10.282 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.293+0000 7f50c7e00700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8101440 0x7f50c8073140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b4b0 tx=0x7f50b400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:10.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.294+0000 7f50c5600700 1 -- 172.21.15.23:0/3239880252 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b4011800 con 0x7f50c8101440 2024-02-28T16:32:10.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.294+0000 7f50c5600700 1 -- 172.21.15.23:0/3239880252 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50b4011e10 con 0x7f50c8101440 2024-02-28T16:32:10.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.294+0000 7f50c5600700 1 -- 172.21.15.23:0/3239880252 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b400f2e0 con 0x7f50c8101440 2024-02-28T16:32:10.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.294+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c8073aa0 con 0x7f50c8101440 2024-02-28T16:32:10.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.294+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c819dbc0 con 0x7f50c8101440 2024-02-28T16:32:10.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.295+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c8108e10 con 0x7f50c8101440 2024-02-28T16:32:10.285 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.296+0000 7f50c5600700 1 -- 172.21.15.23:0/3239880252 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f50b4010380 con 0x7f50c8101440 2024-02-28T16:32:10.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.297+0000 7f50c5600700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f50b006d8a0 0x7f50b006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:10.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.297+0000 7f50c5600700 1 -- 172.21.15.23:0/3239880252 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f50b408d110 con 0x7f50c8101440 2024-02-28T16:32:10.286 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.298+0000 7f50ccc00700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f50b006d8a0 0x7f50b006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:10.287 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.298+0000 7f50ccc00700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f50b006d8a0 0x7f50b006fd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006010 tx=0x7f50bc00b580 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:10.291 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.302+0000 7f50c5600700 1 -- 172.21.15.23:0/3239880252 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f50b405a3d0 con 0x7f50c8101440 2024-02-28T16:32:10.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:10 smithi153 ceph-mon[66339]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:10.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:10 smithi153 ceph-mon[66339]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:10.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:10 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/531771066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:10.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:10 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2103009124' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:10.606 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.617+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f50c8108fd0 con 0x7f50c8101440 2024-02-28T16:32:10.606 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.618+0000 7f50c5600700 1 -- 172.21.15.23:0/3239880252 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f50b4056030 con 0x7f50c8101440 2024-02-28T16:32:10.606 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:32:10.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.620+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f50b006d8a0 msgr2=0x7f50b006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:10.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.620+0000 7f50cf600700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f50b006d8a0 0x7f50b006fd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006010 tx=0x7f50bc00b580 comp rx=0 tx=0).stop 2024-02-28T16:32:10.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.620+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8101440 msgr2=0x7f50c8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:10.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.620+0000 7f50cf600700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8101440 0x7f50c8073140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b4b0 tx=0x7f50b400b870 comp rx=0 tx=0).stop 2024-02-28T16:32:10.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.621+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 shutdown_connections 2024-02-28T16:32:10.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.621+0000 7f50cf600700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c8100240 0x7f50c8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.610 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.621+0000 7f50cf600700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f50b006d8a0 0x7f50b006fd50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.610 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.621+0000 7f50cf600700 1 --2- 172.21.15.23:0/3239880252 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f50c8101440 0x7f50c8073140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:10.610 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.621+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 >> 172.21.15.23:0/3239880252 conn(0x7f50c80fb7f0 msgr2=0x7f50c8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:10.610 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.621+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 shutdown_connections 2024-02-28T16:32:10.610 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:10.621+0000 7f50cf600700 1 -- 172.21.15.23:0/3239880252 wait complete. 2024-02-28T16:32:11.369 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:11 smithi023 ceph-mon[78509]: pgmap v225: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-02-28T16:32:11.369 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:11.369 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:11 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:11.370 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:11 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3239880252' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:11.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:11 smithi153 ceph-mon[66339]: pgmap v225: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-02-28T16:32:11.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:11.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:11 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:11.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:11 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3239880252' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:12.383 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:12 smithi023 ceph-mon[78509]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:12.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:12 smithi153 ceph-mon[66339]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:13.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:13 smithi153 ceph-mon[66339]: pgmap v226: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-02-28T16:32:13.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:13 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:13.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:13 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:13.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:13 smithi023 ceph-mon[78509]: pgmap v226: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-02-28T16:32:13.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:13 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:13.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:13 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:15.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:15 smithi153 ceph-mon[66339]: pgmap v227: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-28T16:32:15.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:15 smithi023 ceph-mon[78509]: pgmap v227: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-28T16:32:17.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:17 smithi153 ceph-mon[66339]: pgmap v228: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-28T16:32:17.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:17 smithi023 ceph-mon[78509]: pgmap v228: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: pgmap v229: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.341 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.342 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:19 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi153.senzwp"]}]: dispatch 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: pgmap v229: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:19.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:19 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi153.senzwp"]}]: dispatch 2024-02-28T16:32:20.355 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:20 smithi153 ceph-mon[66339]: Upgrade: It appears safe to stop mds.cephfs.smithi153.senzwp 2024-02-28T16:32:20.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:20 smithi023 ceph-mon[78509]: Upgrade: It appears safe to stop mds.cephfs.smithi153.senzwp 2024-02-28T16:32:21.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:21 smithi153 ceph-mon[66339]: pgmap v230: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-02-28T16:32:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:21.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:21.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:21 smithi023 ceph-mon[78509]: pgmap v230: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-02-28T16:32:21.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:21.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.senzwp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:21.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:22.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:22 smithi023 ceph-mon[78509]: Upgrade: Updating mds.cephfs.smithi153.senzwp 2024-02-28T16:32:22.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:22 smithi023 ceph-mon[78509]: Deploying daemon mds.cephfs.smithi153.senzwp on smithi153 2024-02-28T16:32:22.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:22.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:22.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:22 smithi153 ceph-mon[66339]: Upgrade: Updating mds.cephfs.smithi153.senzwp 2024-02-28T16:32:22.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:22 smithi153 ceph-mon[66339]: Deploying daemon mds.cephfs.smithi153.senzwp on smithi153 2024-02-28T16:32:22.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:22.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:23.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:23 smithi153 ceph-mon[66339]: pgmap v231: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-28T16:32:23.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:23 smithi023 ceph-mon[78509]: pgmap v231: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-28T16:32:24.068 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:23 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[78505]: 2024-02-28T16:32:23.774+0000 7f38c2800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:32:24.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:24 smithi153 ceph-mon[66339]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:32:24.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:24 smithi153 ceph-mon[66339]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:32:24.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:24 smithi153 ceph-mon[66339]: osdmap e84: 6 total, 6 up, 6 in 2024-02-28T16:32:24.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:24 smithi153 ceph-mon[66339]: Standby daemon mds.cephfs.smithi153.dhwpyj assigned to filesystem cephfs as rank 0 2024-02-28T16:32:24.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:24 smithi153 ceph-mon[66339]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:32:24.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:24 smithi153 ceph-mon[66339]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:32:24.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:24 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi153.dhwpyj=up:replay} 2 up:standby 2024-02-28T16:32:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:24 smithi023 ceph-mon[78509]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:32:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:24 smithi023 ceph-mon[78509]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:32:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:24 smithi023 ceph-mon[78509]: osdmap e84: 6 total, 6 up, 6 in 2024-02-28T16:32:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:24 smithi023 ceph-mon[78509]: Standby daemon mds.cephfs.smithi153.dhwpyj assigned to filesystem cephfs as rank 0 2024-02-28T16:32:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:24 smithi023 ceph-mon[78509]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:32:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:24 smithi023 ceph-mon[78509]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:32:24.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:24 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi153.dhwpyj=up:replay} 2 up:standby 2024-02-28T16:32:25.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:25 smithi153 ceph-mon[66339]: pgmap v232: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:32:25.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:25 smithi023 ceph-mon[78509]: pgmap v232: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:32:27.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:27 smithi153 ceph-mon[66339]: pgmap v234: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-02-28T16:32:27.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:27 smithi023 ceph-mon[78509]: pgmap v234: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-02-28T16:32:29.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:29 smithi153 ceph-mon[66339]: pgmap v235: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-02-28T16:32:29.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:29 smithi023 ceph-mon[78509]: pgmap v235: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-02-28T16:32:31.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:31 smithi153 ceph-mon[66339]: pgmap v236: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:32:31.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:31 smithi023 ceph-mon[78509]: pgmap v236: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:32:33.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:33 smithi153 ceph-mon[66339]: pgmap v237: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-28T16:32:33.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:33 smithi023 ceph-mon[78509]: pgmap v237: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-28T16:32:34.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:34 smithi153 ceph-mon[66339]: reconnect by client.24297 192.168.0.1:0/123756084 after 0.00299995 2024-02-28T16:32:34.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:34 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:reconnect 2024-02-28T16:32:34.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:34 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi153.dhwpyj=up:reconnect} 2 up:standby 2024-02-28T16:32:34.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:34 smithi153 ceph-mon[66339]: reconnect by client.14528 192.168.0.1:0/3625101817 after 0.00299995 2024-02-28T16:32:34.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:34 smithi023 ceph-mon[78509]: reconnect by client.24297 192.168.0.1:0/123756084 after 0.00299995 2024-02-28T16:32:34.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:34 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:reconnect 2024-02-28T16:32:34.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:34 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi153.dhwpyj=up:reconnect} 2 up:standby 2024-02-28T16:32:34.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:34 smithi023 ceph-mon[78509]: reconnect by client.14528 192.168.0.1:0/3625101817 after 0.00299995 2024-02-28T16:32:35.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:35 smithi153 ceph-mon[66339]: pgmap v238: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:32:35.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:35 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:rejoin 2024-02-28T16:32:35.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:35 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi153.dhwpyj=up:rejoin} 2 up:standby 2024-02-28T16:32:35.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:35 smithi153 ceph-mon[66339]: daemon mds.cephfs.smithi153.dhwpyj is now active in filesystem cephfs as rank 0 2024-02-28T16:32:35.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:35 smithi023 ceph-mon[78509]: pgmap v238: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:32:35.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:35 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:rejoin 2024-02-28T16:32:35.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:35 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi153.dhwpyj=up:rejoin} 2 up:standby 2024-02-28T16:32:35.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:35 smithi023 ceph-mon[78509]: daemon mds.cephfs.smithi153.dhwpyj is now active in filesystem cephfs as rank 0 2024-02-28T16:32:36.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:36 smithi153 ceph-mon[66339]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:32:36.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:36 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:32:36.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:36 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:active 2024-02-28T16:32:36.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:36 smithi153 ceph-mon[66339]: fsmap cephfs:1 {0=cephfs.smithi153.dhwpyj=up:active} 2 up:standby 2024-02-28T16:32:36.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:36 smithi023 ceph-mon[78509]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:32:36.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:36 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:32:36.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:36 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] up:active 2024-02-28T16:32:36.423 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:36 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi153.dhwpyj=up:active} 2 up:standby 2024-02-28T16:32:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:37 smithi153 ceph-mon[66339]: pgmap v239: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:32:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:37 smithi023 ceph-mon[78509]: pgmap v239: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:32:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:38 smithi023 ceph-mon[78509]: pgmap v240: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-02-28T16:32:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:38 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] up:boot 2024-02-28T16:32:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:38 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi153.dhwpyj=up:active} 3 up:standby 2024-02-28T16:32:38.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:32:38.695 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:38 smithi153 ceph-mon[66339]: pgmap v240: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-02-28T16:32:38.695 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:38.696 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:38.696 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:38.696 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:38 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] up:boot 2024-02-28T16:32:38.696 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:38 smithi153 ceph-mon[66339]: fsmap cephfs:1 {0=cephfs.smithi153.dhwpyj=up:active} 3 up:standby 2024-02-28T16:32:38.696 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:32:40.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:40 smithi023 ceph-mon[78509]: pgmap v241: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-02-28T16:32:40.730 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:40 smithi153 ceph-mon[66339]: pgmap v241: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-02-28T16:32:40.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 -- 172.21.15.23:0/745822614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b00737b0 msgr2=0x7fb0b0073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:40.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 --2- 172.21.15.23:0/745822614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b00737b0 0x7fb0b0073c20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb098009940 tx=0x7fb098009c50 comp rx=0 tx=0).stop 2024-02-28T16:32:40.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 -- 172.21.15.23:0/745822614 shutdown_connections 2024-02-28T16:32:40.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 --2- 172.21.15.23:0/745822614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b00737b0 0x7fb0b0073c20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:40.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 --2- 172.21.15.23:0/745822614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0b0074d80 0x7fb0b00731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:40.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 -- 172.21.15.23:0/745822614 >> 172.21.15.23:0/745822614 conn(0x7fb0b00fb7f0 msgr2=0x7fb0b00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:40.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 -- 172.21.15.23:0/745822614 shutdown_connections 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.799+0000 7fb0b6600700 1 -- 172.21.15.23:0/745822614 wait complete. 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.801+0000 7fb0b6600700 1 Processor -- start 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.801+0000 7fb0b6600700 1 -- start start 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.801+0000 7fb0b6600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0b00737b0 0x7fb0b0197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.801+0000 7fb0b6600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b0074d80 0x7fb0b01981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.801+0000 7fb0b6600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01987c0 con 0x7fb0b0074d80 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.801+0000 7fb0b6600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0198930 con 0x7fb0b00737b0 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0a6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b0074d80 0x7fb0b01981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0a6a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b0074d80 0x7fb0b01981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:49786/0 (socket says 172.21.15.23:49786) 2024-02-28T16:32:40.791 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0a6a00700 1 -- 172.21.15.23:0/2186524829 learned_addr learned my addr 172.21.15.23:0/2186524829 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:40.792 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0af400700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0b00737b0 0x7fb0b0197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:40.792 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0a6a00700 1 -- 172.21.15.23:0/2186524829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0b00737b0 msgr2=0x7fb0b0197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:40.792 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0a6a00700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0b00737b0 0x7fb0b0197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0a6a00700 1 -- 172.21.15.23:0/2186524829 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980095f0 con 0x7fb0b0074d80 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0af400700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0b00737b0 0x7fb0b0197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.802+0000 7fb0a6a00700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b0074d80 0x7fb0b01981c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0980055f0 tx=0x7fb0980056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.803+0000 7fb0acc00700 1 -- 172.21.15.23:0/2186524829 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb09801d070 con 0x7fb0b0074d80 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.803+0000 7fb0acc00700 1 -- 172.21.15.23:0/2186524829 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb098003ba0 con 0x7fb0b0074d80 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.803+0000 7fb0acc00700 1 -- 172.21.15.23:0/2186524829 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb098021640 con 0x7fb0b0074d80 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.803+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b019d360 con 0x7fb0b0074d80 2024-02-28T16:32:40.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.803+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b019d850 con 0x7fb0b0074d80 2024-02-28T16:32:40.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.804+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b010af80 con 0x7fb0b0074d80 2024-02-28T16:32:40.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.805+0000 7fb0acc00700 1 -- 172.21.15.23:0/2186524829 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb098003d10 con 0x7fb0b0074d80 2024-02-28T16:32:40.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.806+0000 7fb0acc00700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb09406d8a0 0x7fb09406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:40.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.806+0000 7fb0acc00700 1 -- 172.21.15.23:0/2186524829 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb09808e910 con 0x7fb0b0074d80 2024-02-28T16:32:40.795 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.807+0000 7fb0af400700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb09406d8a0 0x7fb09406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:40.796 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.807+0000 7fb0af400700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb09406d8a0 0x7fb09406fd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0005fd0 tx=0x7fb0a0005de0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:40.800 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:40.812+0000 7fb0acc00700 1 -- 172.21.15.23:0/2186524829 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb0980580f0 con 0x7fb0b0074d80 2024-02-28T16:32:41.053 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.064+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0b0107740 con 0x7fb09406d8a0 2024-02-28T16:32:41.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.066+0000 7fb0acc00700 1 -- 172.21.15.23:0/2186524829 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb0b0107740 con 0x7fb09406d8a0 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb09406d8a0 msgr2=0x7fb09406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb09406d8a0 0x7fb09406fd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0005fd0 tx=0x7fb0a0005de0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b0074d80 msgr2=0x7fb0b01981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b0074d80 0x7fb0b01981c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0980055f0 tx=0x7fb0980056d0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 shutdown_connections 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0b00737b0 0x7fb0b0197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb09406d8a0 0x7fb09406fd50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 --2- 172.21.15.23:0/2186524829 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb0b0074d80 0x7fb0b01981c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.058 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.069+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 >> 172.21.15.23:0/2186524829 conn(0x7fb0b00fb7f0 msgr2=0x7fb0b0106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:41.059 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.070+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 shutdown_connections 2024-02-28T16:32:41.059 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.070+0000 7fb0b6600700 1 -- 172.21.15.23:0/2186524829 wait complete. 2024-02-28T16:32:41.076 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:32:41.225 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.236+0000 7fce53e00700 1 -- 172.21.15.23:0/3957609751 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54103170 msgr2=0x7fce54105590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.225 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.236+0000 7fce53e00700 1 --2- 172.21.15.23:0/3957609751 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54103170 0x7fce54105590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009910 tx=0x7fce3c009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.237+0000 7fce53e00700 1 -- 172.21.15.23:0/3957609751 shutdown_connections 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.237+0000 7fce53e00700 1 --2- 172.21.15.23:0/3957609751 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54103170 0x7fce54105590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.237+0000 7fce53e00700 1 --2- 172.21.15.23:0/3957609751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce54069aa0 0x7fce54102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.237+0000 7fce53e00700 1 -- 172.21.15.23:0/3957609751 >> 172.21.15.23:0/3957609751 conn(0x7fce540fa5a0 msgr2=0x7fce540fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.237+0000 7fce53e00700 1 -- 172.21.15.23:0/3957609751 shutdown_connections 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.237+0000 7fce53e00700 1 -- 172.21.15.23:0/3957609751 wait complete. 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.238+0000 7fce53e00700 1 Processor -- start 2024-02-28T16:32:41.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.238+0000 7fce53e00700 1 -- start start 2024-02-28T16:32:41.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.238+0000 7fce53e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54069aa0 0x7fce54197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:41.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.238+0000 7fce53e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce54103170 0x7fce54197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:41.227 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.238+0000 7fce53e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce541985a0 con 0x7fce54069aa0 2024-02-28T16:32:41.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.238+0000 7fce53e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce541986e0 con 0x7fce54103170 2024-02-28T16:32:41.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.239+0000 7fce52a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54069aa0 0x7fce54197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:41.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.239+0000 7fce52a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54069aa0 0x7fce54197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:49810/0 (socket says 172.21.15.23:49810) 2024-02-28T16:32:41.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.239+0000 7fce52a00700 1 -- 172.21.15.23:0/1010406103 learned_addr learned my addr 172.21.15.23:0/1010406103 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:41.228 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.239+0000 7fce4a000700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce54103170 0x7fce54197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.239+0000 7fce52a00700 1 -- 172.21.15.23:0/1010406103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce54103170 msgr2=0x7fce54197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.239+0000 7fce52a00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce54103170 0x7fce54197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.239+0000 7fce52a00700 1 -- 172.21.15.23:0/1010406103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0095f0 con 0x7fce54069aa0 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.240+0000 7fce52a00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54069aa0 0x7fce54197a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fce4400d900 tx=0x7fce4400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.240+0000 7fce4be00700 1 -- 172.21.15.23:0/1010406103 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce440041f0 con 0x7fce54069aa0 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.240+0000 7fce4be00700 1 -- 172.21.15.23:0/1010406103 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fce44004350 con 0x7fce54069aa0 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.240+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5419d190 con 0x7fce54069aa0 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.240+0000 7fce4be00700 1 -- 172.21.15.23:0/1010406103 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce44003d20 con 0x7fce54069aa0 2024-02-28T16:32:41.229 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.240+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5419d6e0 con 0x7fce54069aa0 2024-02-28T16:32:41.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.241+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce540fc110 con 0x7fce54069aa0 2024-02-28T16:32:41.231 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.242+0000 7fce4be00700 1 -- 172.21.15.23:0/1010406103 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fce44009730 con 0x7fce54069aa0 2024-02-28T16:32:41.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.243+0000 7fce4be00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fce3806d8a0 0x7fce3806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:41.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.243+0000 7fce4be00700 1 -- 172.21.15.23:0/1010406103 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fce4408d430 con 0x7fce54069aa0 2024-02-28T16:32:41.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.244+0000 7fce4a000700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fce3806d8a0 0x7fce3806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:41.232 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.244+0000 7fce4a000700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fce3806d8a0 0x7fce3806fd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce3c006010 tx=0x7fce3c00b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:41.236 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.248+0000 7fce4be00700 1 -- 172.21.15.23:0/1010406103 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fce4405a6c0 con 0x7fce54069aa0 2024-02-28T16:32:41.487 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.498+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce54061190 con 0x7fce3806d8a0 2024-02-28T16:32:41.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.501+0000 7fce4be00700 1 -- 172.21.15.23:0/1010406103 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fce54061190 con 0x7fce3806d8a0 2024-02-28T16:32:41.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.503+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fce3806d8a0 msgr2=0x7fce3806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.503+0000 7fce53e00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fce3806d8a0 0x7fce3806fd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce3c006010 tx=0x7fce3c00b560 comp rx=0 tx=0).stop 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.503+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54069aa0 msgr2=0x7fce54197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.503+0000 7fce53e00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54069aa0 0x7fce54197a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fce4400d900 tx=0x7fce4400dc10 comp rx=0 tx=0).stop 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.504+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 shutdown_connections 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.504+0000 7fce53e00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fce3806d8a0 0x7fce3806fd50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.504+0000 7fce53e00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fce54069aa0 0x7fce54197a40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.504+0000 7fce53e00700 1 --2- 172.21.15.23:0/1010406103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce54103170 0x7fce54197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.504+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 >> 172.21.15.23:0/1010406103 conn(0x7fce540fa5a0 msgr2=0x7fce540ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.504+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 shutdown_connections 2024-02-28T16:32:41.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.504+0000 7fce53e00700 1 -- 172.21.15.23:0/1010406103 wait complete. 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.659+0000 7fc848000700 1 -- 172.21.15.23:0/893177157 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840103680 msgr2=0x7fc840105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.660+0000 7fc848000700 1 --2- 172.21.15.23:0/893177157 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840103680 0x7fc840105a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009910 tx=0x7fc82c009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.660+0000 7fc848000700 1 -- 172.21.15.23:0/893177157 shutdown_connections 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.660+0000 7fc848000700 1 --2- 172.21.15.23:0/893177157 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840103680 0x7fc840105a60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.660+0000 7fc848000700 1 --2- 172.21.15.23:0/893177157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840100d60 0x7fc840103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.660+0000 7fc848000700 1 -- 172.21.15.23:0/893177157 >> 172.21.15.23:0/893177157 conn(0x7fc8400fa780 msgr2=0x7fc8400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.660+0000 7fc848000700 1 -- 172.21.15.23:0/893177157 shutdown_connections 2024-02-28T16:32:41.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.660+0000 7fc848000700 1 -- 172.21.15.23:0/893177157 wait complete. 2024-02-28T16:32:41.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.661+0000 7fc848000700 1 Processor -- start 2024-02-28T16:32:41.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.661+0000 7fc848000700 1 -- start start 2024-02-28T16:32:41.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc848000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840100d60 0x7fc840197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:41.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc848000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840103680 0x7fc840198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:41.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc848000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840198870 con 0x7fc840100d60 2024-02-28T16:32:41.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc848000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84019d280 con 0x7fc840103680 2024-02-28T16:32:41.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc845600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840100d60 0x7fc840197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:41.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc845600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840100d60 0x7fc840197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:49818/0 (socket says 172.21.15.23:49818) 2024-02-28T16:32:41.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc845600700 1 -- 172.21.15.23:0/4254204053 learned_addr learned my addr 172.21.15.23:0/4254204053 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:41.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc844c00700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840103680 0x7fc840198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:41.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc845600700 1 -- 172.21.15.23:0/4254204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840103680 msgr2=0x7fc840198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc845600700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840103680 0x7fc840198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.662+0000 7fc845600700 1 -- 172.21.15.23:0/4254204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0095f0 con 0x7fc840100d60 2024-02-28T16:32:41.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.663+0000 7fc845600700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840100d60 0x7fc840197d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc83400e970 tx=0x7fc83400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:41.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.663+0000 7fc83e000700 1 -- 172.21.15.23:0/4254204053 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc834009750 con 0x7fc840100d60 2024-02-28T16:32:41.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.663+0000 7fc83e000700 1 -- 172.21.15.23:0/4254204053 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc834004ce0 con 0x7fc840100d60 2024-02-28T16:32:41.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.663+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84019d480 con 0x7fc840100d60 2024-02-28T16:32:41.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.663+0000 7fc83e000700 1 -- 172.21.15.23:0/4254204053 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc834005690 con 0x7fc840100d60 2024-02-28T16:32:41.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.663+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84019d9a0 con 0x7fc840100d60 2024-02-28T16:32:41.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.664+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8400fc340 con 0x7fc840100d60 2024-02-28T16:32:41.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.665+0000 7fc83e000700 1 -- 172.21.15.23:0/4254204053 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc834004750 con 0x7fc840100d60 2024-02-28T16:32:41.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.666+0000 7fc83e000700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc82806d8a0 0x7fc82806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:41.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.666+0000 7fc83e000700 1 -- 172.21.15.23:0/4254204053 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fc834014070 con 0x7fc840100d60 2024-02-28T16:32:41.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.667+0000 7fc844c00700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc82806d8a0 0x7fc82806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:41.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.667+0000 7fc844c00700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc82806d8a0 0x7fc82806fd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00b6f0 tx=0x7fc82c009f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:41.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.671+0000 7fc83e000700 1 -- 172.21.15.23:0/4254204053 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc834057120 con 0x7fc840100d60 2024-02-28T16:32:41.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:41 smithi023 ceph-mon[78509]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:41.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:41 smithi153 ceph-mon[66339]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:41.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.910+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc840061190 con 0x7fc82806d8a0 2024-02-28T16:32:41.926 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.937+0000 7fc83e000700 1 -- 172.21.15.23:0/4254204053 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc840061190 con 0x7fc82806d8a0 2024-02-28T16:32:41.926 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (17m) 31s ago 19m 14.4M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (19m) 31s ago 19m 9185k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (18m) 0s ago 18m 9118k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (5m) 31s ago 19m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (5m) 0s ago 18m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (17m) 31s ago 19m 71.9M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (39s) 31s ago 12m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (68s) 31s ago 12m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (12m) 0s ago 12m 88.4M - 18.2.0 dc2bc1663786 5cd6d42478af 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (8s) 0s ago 12m 10.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (8m) 31s ago 21m 508M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (7m) 0s ago 18m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (7m) 31s ago 21m 53.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (6m) 0s ago 18m 43.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:32:41.927 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (19m) 31s ago 19m 8200k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (18m) 0s ago 18m 8132k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (4m) 31s ago 17m 97.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (4m) 31s ago 16m 110M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (3m) 31s ago 15m 98.4M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (2m) 0s ago 15m 118M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (2m) 0s ago 14m 103M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (93s) 0s ago 14m 94.9M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:32:41.928 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (7m) 31s ago 18m 60.2M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:32:41.929 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc82806d8a0 msgr2=0x7fc82806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.929 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc82806d8a0 0x7fc82806fd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00b6f0 tx=0x7fc82c009f90 comp rx=0 tx=0).stop 2024-02-28T16:32:41.929 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840100d60 msgr2=0x7fc840197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840100d60 0x7fc840197d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc83400e970 tx=0x7fc83400ed30 comp rx=0 tx=0).stop 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 shutdown_connections 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc82806d8a0 0x7fc82806fd50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc840100d60 0x7fc840197d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 --2- 172.21.15.23:0/4254204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc840103680 0x7fc840198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.940+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 >> 172.21.15.23:0/4254204053 conn(0x7fc8400fa780 msgr2=0x7fc840100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.941+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 shutdown_connections 2024-02-28T16:32:41.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:41.941+0000 7fc848000700 1 -- 172.21.15.23:0/4254204053 wait complete. 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 -- 172.21.15.23:0/3429604398 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584100240 msgr2=0x7f3584100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 --2- 172.21.15.23:0/3429604398 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584100240 0x7f3584100650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f357400b0a0 tx=0x7f357400b3b0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 -- 172.21.15.23:0/3429604398 shutdown_connections 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 --2- 172.21.15.23:0/3429604398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3584101440 0x7f3584101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 --2- 172.21.15.23:0/3429604398 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584100240 0x7f3584100650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 -- 172.21.15.23:0/3429604398 >> 172.21.15.23:0/3429604398 conn(0x7f35840fb7f0 msgr2=0x7f35840fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 -- 172.21.15.23:0/3429604398 shutdown_connections 2024-02-28T16:32:42.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.103+0000 7f358a000700 1 -- 172.21.15.23:0/3429604398 wait complete. 2024-02-28T16:32:42.094 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.104+0000 7f358a000700 1 Processor -- start 2024-02-28T16:32:42.094 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.104+0000 7f358a000700 1 -- start start 2024-02-28T16:32:42.094 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f358a000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3584100240 0x7f3584074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:42.094 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f358a000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584101440 0x7f3584073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:42.094 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f358a000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584073680 con 0x7f3584101440 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f358a000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840737c0 con 0x7f3584100240 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f357be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584101440 0x7f3584073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f357be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584101440 0x7f3584073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:49830/0 (socket says 172.21.15.23:49830) 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f357be00700 1 -- 172.21.15.23:0/2983189868 learned_addr learned my addr 172.21.15.23:0/2983189868 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.105+0000 7f3583400700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3584100240 0x7f3584074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f357be00700 1 -- 172.21.15.23:0/2983189868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3584100240 msgr2=0x7f3584074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f357be00700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3584100240 0x7f3584074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f357be00700 1 -- 172.21.15.23:0/2983189868 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009d00 con 0x7f3584101440 2024-02-28T16:32:42.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f357be00700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584101440 0x7f3584073140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f356c00d900 tx=0x7f356c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:42.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f3580c00700 1 -- 172.21.15.23:0/2983189868 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356c0041f0 con 0x7f3584101440 2024-02-28T16:32:42.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f3580c00700 1 -- 172.21.15.23:0/2983189868 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f356c004ce0 con 0x7f3584101440 2024-02-28T16:32:42.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584073aa0 con 0x7f3584101440 2024-02-28T16:32:42.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f3580c00700 1 -- 172.21.15.23:0/2983189868 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356c00b750 con 0x7f3584101440 2024-02-28T16:32:42.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.106+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358419db90 con 0x7f3584101440 2024-02-28T16:32:42.096 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.108+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584108d90 con 0x7f3584101440 2024-02-28T16:32:42.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.109+0000 7f3580c00700 1 -- 172.21.15.23:0/2983189868 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f356c004e50 con 0x7f3584101440 2024-02-28T16:32:42.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.110+0000 7f3580c00700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f356806d8a0 0x7f356806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:42.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.110+0000 7f3580c00700 1 -- 172.21.15.23:0/2983189868 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f356c08d4a0 con 0x7f3584101440 2024-02-28T16:32:42.098 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.110+0000 7f3583400700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f356806d8a0 0x7f356806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:42.099 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.111+0000 7f3583400700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f356806d8a0 0x7f356806fd50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3574009fd0 tx=0x7f3574000f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:42.103 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.114+0000 7f3580c00700 1 -- 172.21.15.23:0/2983189868 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f356c05a6b0 con 0x7f3584101440 2024-02-28T16:32:42.427 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.438+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3584108f80 con 0x7f3584101440 2024-02-28T16:32:42.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.440+0000 7f3580c00700 1 -- 172.21.15.23:0/2983189868 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f356c05a240 con 0x7f3584101440 2024-02-28T16:32:42.428 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:32:42.429 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:32:42.430 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-28T16:32:42.430 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 13 2024-02-28T16:32:42.430 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:32:42.430 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:32:42.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.442+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f356806d8a0 msgr2=0x7f356806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.442+0000 7f358a000700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f356806d8a0 0x7f356806fd50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3574009fd0 tx=0x7f3574000f40 comp rx=0 tx=0).stop 2024-02-28T16:32:42.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.442+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584101440 msgr2=0x7f3584073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.442+0000 7f358a000700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584101440 0x7f3584073140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f356c00d900 tx=0x7f356c00dc10 comp rx=0 tx=0).stop 2024-02-28T16:32:42.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.443+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 shutdown_connections 2024-02-28T16:32:42.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.443+0000 7f358a000700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3584100240 0x7f3584074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.443+0000 7f358a000700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f356806d8a0 0x7f356806fd50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.443+0000 7f358a000700 1 --2- 172.21.15.23:0/2983189868 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3584101440 0x7f3584073140 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.443+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 >> 172.21.15.23:0/2983189868 conn(0x7f35840fb7f0 msgr2=0x7f3584104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:42.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.443+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 shutdown_connections 2024-02-28T16:32:42.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.443+0000 7f358a000700 1 -- 172.21.15.23:0/2983189868 wait complete. 2024-02-28T16:32:42.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.600+0000 7feb75a00700 1 -- 172.21.15.23:0/2995893360 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb70074d80 msgr2=0x7feb700731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.600+0000 7feb75a00700 1 --2- 172.21.15.23:0/2995893360 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb70074d80 0x7feb700731e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feb6000b0a0 tx=0x7feb6000b3b0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.600+0000 7feb75a00700 1 -- 172.21.15.23:0/2995893360 shutdown_connections 2024-02-28T16:32:42.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.600+0000 7feb75a00700 1 --2- 172.21.15.23:0/2995893360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb700737b0 0x7feb70073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.600+0000 7feb75a00700 1 --2- 172.21.15.23:0/2995893360 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb70074d80 0x7feb700731e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.600+0000 7feb75a00700 1 -- 172.21.15.23:0/2995893360 >> 172.21.15.23:0/2995893360 conn(0x7feb700fb7f0 msgr2=0x7feb700fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:42.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.601+0000 7feb75a00700 1 -- 172.21.15.23:0/2995893360 shutdown_connections 2024-02-28T16:32:42.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.601+0000 7feb75a00700 1 -- 172.21.15.23:0/2995893360 wait complete. 2024-02-28T16:32:42.590 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.602+0000 7feb75a00700 1 Processor -- start 2024-02-28T16:32:42.591 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.602+0000 7feb75a00700 1 -- start start 2024-02-28T16:32:42.591 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.602+0000 7feb75a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb700737b0 0x7feb7019c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:42.591 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.602+0000 7feb75a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb70074d80 0x7feb7019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:42.591 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.602+0000 7feb75a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7019cc20 con 0x7feb700737b0 2024-02-28T16:32:42.591 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.602+0000 7feb75a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7019cd60 con 0x7feb70074d80 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.603+0000 7feb6ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb700737b0 0x7feb7019c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.603+0000 7feb67e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb70074d80 0x7feb7019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.603+0000 7feb67e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb70074d80 0x7feb7019c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.23:39486/0 (socket says 172.21.15.23:39486) 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.603+0000 7feb67e00700 1 -- 172.21.15.23:0/2219531785 learned_addr learned my addr 172.21.15.23:0/2219531785 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.603+0000 7feb6ea00700 1 -- 172.21.15.23:0/2219531785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb70074d80 msgr2=0x7feb7019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.603+0000 7feb6ea00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb70074d80 0x7feb7019c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.603+0000 7feb6ea00700 1 -- 172.21.15.23:0/2219531785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009d00 con 0x7feb700737b0 2024-02-28T16:32:42.592 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.604+0000 7feb6ea00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb700737b0 0x7feb7019c0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feb60015040 tx=0x7feb60009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:42.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.604+0000 7feb67400700 1 -- 172.21.15.23:0/2219531785 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb6000e040 con 0x7feb700737b0 2024-02-28T16:32:42.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.604+0000 7feb67400700 1 -- 172.21.15.23:0/2219531785 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb60003de0 con 0x7feb700737b0 2024-02-28T16:32:42.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.604+0000 7feb67400700 1 -- 172.21.15.23:0/2219531785 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb6001d970 con 0x7feb700737b0 2024-02-28T16:32:42.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.604+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb701a17b0 con 0x7feb700737b0 2024-02-28T16:32:42.593 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.604+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb701a1c70 con 0x7feb700737b0 2024-02-28T16:32:42.594 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.605+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7010f370 con 0x7feb700737b0 2024-02-28T16:32:42.595 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.607+0000 7feb67400700 1 -- 172.21.15.23:0/2219531785 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7feb600048b0 con 0x7feb700737b0 2024-02-28T16:32:42.596 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.608+0000 7feb67400700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7feb5406d8a0 0x7feb5406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:42.596 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.608+0000 7feb67400700 1 -- 172.21.15.23:0/2219531785 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7feb6008f7e0 con 0x7feb700737b0 2024-02-28T16:32:42.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.608+0000 7feb67e00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7feb5406d8a0 0x7feb5406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:42.597 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.609+0000 7feb67e00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7feb5406d8a0 0x7feb5406fd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb58009d20 tx=0x7feb58009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:42.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.612+0000 7feb67400700 1 -- 172.21.15.23:0/2219531785 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feb6005ce20 con 0x7feb700737b0 2024-02-28T16:32:42.882 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.893+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feb7010f560 con 0x7feb700737b0 2024-02-28T16:32:42.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.894+0000 7feb67400700 1 -- 172.21.15.23:0/2219531785 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1852 (secure 0 0 0) 0x7feb6005c9b0 con 0x7feb700737b0 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:e30 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 29 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:32:42.884 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:32:34.266312+0000 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 84 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:32:42.885 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=24259} 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{0:24259} state up:active seq 185 join_fscid=1 addr [v2:172.21.15.153:6826/3382879257,v1:172.21.15.153:6827/3382879257] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:32:42.886 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:32:42.887 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:32:42.887 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:32:42.887 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.897+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7feb5406d8a0 msgr2=0x7feb5406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.897+0000 7feb75a00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7feb5406d8a0 0x7feb5406fd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb58009d20 tx=0x7feb58009260 comp rx=0 tx=0).stop 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.897+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb700737b0 msgr2=0x7feb7019c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.897+0000 7feb75a00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb700737b0 0x7feb7019c0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feb60015040 tx=0x7feb60009700 comp rx=0 tx=0).stop 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.898+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 shutdown_connections 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.898+0000 7feb75a00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7feb5406d8a0 0x7feb5406fd50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.898+0000 7feb75a00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7feb700737b0 0x7feb7019c0c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.898+0000 7feb75a00700 1 --2- 172.21.15.23:0/2219531785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb70074d80 0x7feb7019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.898+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 >> 172.21.15.23:0/2219531785 conn(0x7feb700fb7f0 msgr2=0x7feb70101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:42.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.898+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 shutdown_connections 2024-02-28T16:32:42.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:42.898+0000 7feb75a00700 1 -- 172.21.15.23:0/2219531785 wait complete. 2024-02-28T16:32:42.889 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 30 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 -- 172.21.15.23:0/448378189 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 msgr2=0x7f2638103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 --2- 172.21.15.23:0/448378189 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638103180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2628009910 tx=0x7f2628009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 -- 172.21.15.23:0/448378189 shutdown_connections 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 --2- 172.21.15.23:0/448378189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26381036c0 0x7f2638105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 --2- 172.21.15.23:0/448378189 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638103180 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 -- 172.21.15.23:0/448378189 >> 172.21.15.23:0/448378189 conn(0x7f26380fa780 msgr2=0x7f26380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 -- 172.21.15.23:0/448378189 shutdown_connections 2024-02-28T16:32:43.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.048+0000 7f263e600700 1 -- 172.21.15.23:0/448378189 wait complete. 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.049+0000 7f263e600700 1 Processor -- start 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.049+0000 7f263e600700 1 -- start start 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.049+0000 7f263e600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f263e600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26381036c0 0x7f2638198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f263e600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26381988a0 con 0x7f2638100da0 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f263e600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263819d260 con 0x7f26381036c0 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2637400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2637400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:49858/0 (socket says 172.21.15.23:49858) 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2637400700 1 -- 172.21.15.23:0/973582896 learned_addr learned my addr 172.21.15.23:0/973582896 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2636a00700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26381036c0 0x7f2638198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2637400700 1 -- 172.21.15.23:0/973582896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26381036c0 msgr2=0x7f2638198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2637400700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26381036c0 0x7f2638198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2637400700 1 -- 172.21.15.23:0/973582896 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280095f0 con 0x7f2638100da0 2024-02-28T16:32:43.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.050+0000 7f2636a00700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26381036c0 0x7f2638198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:32:43.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.051+0000 7f2637400700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638197d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f262800bda0 tx=0x7f262800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:43.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.051+0000 7f262fe00700 1 -- 172.21.15.23:0/973582896 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f262801d070 con 0x7f2638100da0 2024-02-28T16:32:43.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.051+0000 7f262fe00700 1 -- 172.21.15.23:0/973582896 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2628004c50 con 0x7f2638100da0 2024-02-28T16:32:43.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.051+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263819d400 con 0x7f2638100da0 2024-02-28T16:32:43.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.051+0000 7f262fe00700 1 -- 172.21.15.23:0/973582896 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f262800f690 con 0x7f2638100da0 2024-02-28T16:32:43.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.051+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263819d8c0 con 0x7f2638100da0 2024-02-28T16:32:43.042 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.053+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26380fc340 con 0x7f2638100da0 2024-02-28T16:32:43.042 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.053+0000 7f262fe00700 1 -- 172.21.15.23:0/973582896 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2628022a20 con 0x7f2638100da0 2024-02-28T16:32:43.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.054+0000 7f262fe00700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f261c06d8a0 0x7f261c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:43.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.054+0000 7f262fe00700 1 -- 172.21.15.23:0/973582896 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f262808ec70 con 0x7f2638100da0 2024-02-28T16:32:43.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.055+0000 7f2636a00700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f261c06d8a0 0x7f261c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:43.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.055+0000 7f2636a00700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f261c06d8a0 0x7f261c06fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2624005fd0 tx=0x7f2624005dc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:43.047 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.059+0000 7f262fe00700 1 -- 172.21.15.23:0/973582896 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2628095080 con 0x7f2638100da0 2024-02-28T16:32:43.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:42 smithi153 ceph-mon[66339]: pgmap v242: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:32:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:42 smithi153 ceph-mon[66339]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:42 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:42 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:42 smithi153 ceph-mon[66339]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:42 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2983189868' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:43.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:42 smithi023 ceph-mon[78509]: pgmap v242: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:32:43.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:42 smithi023 ceph-mon[78509]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:43.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:42 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:43.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:42 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:43.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:42 smithi023 ceph-mon[78509]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:43.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:42 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2983189868' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:43.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.321+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2638061190 con 0x7f261c06d8a0 2024-02-28T16:32:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.323+0000 7f262fe00700 1 -- 172.21.15.23:0/973582896 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2638061190 con 0x7f261c06d8a0 2024-02-28T16:32:43.312 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:32:43.312 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:32:43.312 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:32:43.312 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "osd" 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "15/23 daemons upgraded", 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:32:43.313 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f261c06d8a0 msgr2=0x7f261c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f261c06d8a0 0x7f261c06fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2624005fd0 tx=0x7f2624005dc0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 msgr2=0x7f2638197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638197d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f262800bda0 tx=0x7f262800be80 comp rx=0 tx=0).stop 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 shutdown_connections 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f261c06d8a0 0x7f261c06fd50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2638100da0 0x7f2638197d40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 --2- 172.21.15.23:0/973582896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26381036c0 0x7f2638198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.326+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 >> 172.21.15.23:0/973582896 conn(0x7f26380fa780 msgr2=0x7f2638100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:43.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.327+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 shutdown_connections 2024-02-28T16:32:43.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.327+0000 7f263e600700 1 -- 172.21.15.23:0/973582896 wait complete. 2024-02-28T16:32:43.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 -- 172.21.15.23:0/52835741 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 msgr2=0x7f3098100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 --2- 172.21.15.23:0/52835741 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098100660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f308c009910 tx=0x7f308c009c20 comp rx=0 tx=0).stop 2024-02-28T16:32:43.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 -- 172.21.15.23:0/52835741 shutdown_connections 2024-02-28T16:32:43.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 --2- 172.21.15.23:0/52835741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3098101450 0x7f30981018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 --2- 172.21.15.23:0/52835741 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098100660 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 -- 172.21.15.23:0/52835741 >> 172.21.15.23:0/52835741 conn(0x7f30980fb7e0 msgr2=0x7f30980fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:43.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 -- 172.21.15.23:0/52835741 shutdown_connections 2024-02-28T16:32:43.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.486+0000 7f309f600700 1 -- 172.21.15.23:0/52835741 wait complete. 2024-02-28T16:32:43.478 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.487+0000 7f309f600700 1 Processor -- start 2024-02-28T16:32:43.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309f600700 1 -- start start 2024-02-28T16:32:43.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309f600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:43.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309f600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3098101450 0x7f3098073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:43.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309f600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098073680 con 0x7f3098100250 2024-02-28T16:32:43.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309f600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980737c0 con 0x7f3098101450 2024-02-28T16:32:43.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309cc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309cc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:49882/0 (socket says 172.21.15.23:49882) 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.488+0000 7f309cc00700 1 -- 172.21.15.23:0/598823976 learned_addr learned my addr 172.21.15.23:0/598823976 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f3097e00700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3098101450 0x7f3098073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f309cc00700 1 -- 172.21.15.23:0/598823976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3098101450 msgr2=0x7f3098073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f309cc00700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3098101450 0x7f3098073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f309cc00700 1 -- 172.21.15.23:0/598823976 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c0095f0 con 0x7f3098100250 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f309cc00700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098074af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f308c00bda0 tx=0x7f308c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f3095600700 1 -- 172.21.15.23:0/598823976 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308c01d070 con 0x7f3098100250 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f3095600700 1 -- 172.21.15.23:0/598823976 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f308c00f460 con 0x7f3098100250 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f3095600700 1 -- 172.21.15.23:0/598823976 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308c021640 con 0x7f3098100250 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.489+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3098073a40 con 0x7f3098100250 2024-02-28T16:32:43.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.490+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3098073f30 con 0x7f3098100250 2024-02-28T16:32:43.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.491+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3098108da0 con 0x7f3098100250 2024-02-28T16:32:43.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.492+0000 7f3095600700 1 -- 172.21.15.23:0/598823976 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f308c00fa00 con 0x7f3098100250 2024-02-28T16:32:43.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.493+0000 7f3095600700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f308006d8a0 0x7f308006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:43.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.493+0000 7f3095600700 1 -- 172.21.15.23:0/598823976 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f308c08e8d0 con 0x7f3098100250 2024-02-28T16:32:43.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.493+0000 7f3097e00700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f308006d8a0 0x7f308006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:43.482 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.494+0000 7f3097e00700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f308006d8a0 0x7f308006fd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3084005950 tx=0x7f30840058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:43.486 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.497+0000 7f3095600700 1 -- 172.21.15.23:0/598823976 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f308c05bae0 con 0x7f3098100250 2024-02-28T16:32:43.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.825+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3098108f90 con 0x7f3098100250 2024-02-28T16:32:43.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.826+0000 7f3095600700 1 -- 172.21.15.23:0/598823976 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f308c05b670 con 0x7f3098100250 2024-02-28T16:32:43.815 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:32:43.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f308006d8a0 msgr2=0x7f308006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f308006d8a0 0x7f308006fd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3084005950 tx=0x7f30840058e0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 msgr2=0x7f3098074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:43.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098074af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f308c00bda0 tx=0x7f308c00be80 comp rx=0 tx=0).stop 2024-02-28T16:32:43.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 shutdown_connections 2024-02-28T16:32:43.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f308006d8a0 0x7f308006fd50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3098100250 0x7f3098074af0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 --2- 172.21.15.23:0/598823976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3098101450 0x7f3098073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:43.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.829+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 >> 172.21.15.23:0/598823976 conn(0x7f30980fb7e0 msgr2=0x7f3098104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:43.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.830+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 shutdown_connections 2024-02-28T16:32:43.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:32:43.830+0000 7f309f600700 1 -- 172.21.15.23:0/598823976 wait complete. 2024-02-28T16:32:44.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:43 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2219531785' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:44.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:43 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/598823976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:44.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:43 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2219531785' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:44.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:43 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/598823976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:45.009 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:44 smithi153 ceph-mon[66339]: pgmap v243: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:32:45.010 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:44 smithi153 ceph-mon[66339]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:45.010 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:45.010 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:45.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:44 smithi023 ceph-mon[78509]: pgmap v243: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:32:45.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:44 smithi023 ceph-mon[78509]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:45.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:45.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:47.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:46 smithi153 ceph-mon[66339]: pgmap v244: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 805 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:32:47.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:46 smithi023 ceph-mon[78509]: pgmap v244: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 805 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:32:49.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:48 smithi153 ceph-mon[66339]: pgmap v245: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:32:49.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:48 smithi023 ceph-mon[78509]: pgmap v245: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:32:50.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: pgmap v246: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T16:32:50.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: Detected new or changed devices on smithi153 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi153.dhwpyj"]}]: dispatch 2024-02-28T16:32:50.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:50 smithi153 ceph-mon[66339]: Upgrade: It appears safe to stop mds.cephfs.smithi153.dhwpyj 2024-02-28T16:32:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: pgmap v246: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T16:32:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: Detected new or changed devices on smithi153 2024-02-28T16:32:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:50.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:50.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:50.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:50.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:50.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:50.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi153.dhwpyj"]}]: dispatch 2024-02-28T16:32:50.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:50 smithi023 ceph-mon[78509]: Upgrade: It appears safe to stop mds.cephfs.smithi153.dhwpyj 2024-02-28T16:32:51.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:51.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:52.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:52 smithi023 ceph-mon[78509]: pgmap v247: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-28T16:32:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:52.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:52.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:52 smithi153 ceph-mon[66339]: pgmap v247: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-28T16:32:52.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:32:52.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.dhwpyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:52.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:53.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:53 smithi153 ceph-mon[66339]: Upgrade: Updating mds.cephfs.smithi153.dhwpyj 2024-02-28T16:32:53.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:53 smithi153 ceph-mon[66339]: Deploying daemon mds.cephfs.smithi153.dhwpyj on smithi153 2024-02-28T16:32:53.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:53 smithi023 ceph-mon[78509]: Upgrade: Updating mds.cephfs.smithi153.dhwpyj 2024-02-28T16:32:53.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:53 smithi023 ceph-mon[78509]: Deploying daemon mds.cephfs.smithi153.dhwpyj on smithi153 2024-02-28T16:32:54.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:54 smithi153 ceph-mon[66339]: pgmap v248: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:32:54.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:54 smithi023 ceph-mon[78509]: pgmap v248: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:32:55.636 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[78505]: 2024-02-28T16:32:55.294+0000 7f38c2800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:32:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:55 smithi153 ceph-mon[66339]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:32:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:55 smithi153 ceph-mon[66339]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:32:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:55 smithi153 ceph-mon[66339]: osdmap e85: 6 total, 6 up, 6 in 2024-02-28T16:32:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:55 smithi153 ceph-mon[66339]: Standby daemon mds.cephfs.smithi023.pplvdo assigned to filesystem cephfs as rank 0 2024-02-28T16:32:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:55 smithi153 ceph-mon[66339]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:32:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:55 smithi153 ceph-mon[66339]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:32:55.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:55 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:replay} 2 up:standby 2024-02-28T16:32:55.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-mon[78509]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:32:55.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-mon[78509]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:32:55.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-mon[78509]: osdmap e85: 6 total, 6 up, 6 in 2024-02-28T16:32:55.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-mon[78509]: Standby daemon mds.cephfs.smithi023.pplvdo assigned to filesystem cephfs as rank 0 2024-02-28T16:32:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-mon[78509]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:32:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-mon[78509]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:32:55.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:55 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:replay} 2 up:standby 2024-02-28T16:32:56.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:56 smithi153 ceph-mon[66339]: pgmap v249: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:32:56.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:56 smithi023 ceph-mon[78509]: pgmap v249: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:32:57.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:32:58.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:32:58.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:32:58 smithi023 ceph-mon[78509]: pgmap v251: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-02-28T16:32:59.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:32:58 smithi153 ceph-mon[66339]: pgmap v251: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-02-28T16:33:00.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:00 smithi153 ceph-mon[66339]: pgmap v252: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-02-28T16:33:00.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:00 smithi023 ceph-mon[78509]: pgmap v252: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-02-28T16:33:02.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:02 smithi153 ceph-mon[66339]: pgmap v253: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-28T16:33:03.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:02 smithi023 ceph-mon[78509]: pgmap v253: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-28T16:33:04.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] up:boot 2024-02-28T16:33:04.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:replay} 3 up:standby 2024-02-28T16:33:04.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:33:04.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:04.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:04.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:04.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:04.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:04.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] up:boot 2024-02-28T16:33:04.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:replay} 3 up:standby 2024-02-28T16:33:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:33:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:04.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:05.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:04 smithi153 ceph-mon[66339]: pgmap v254: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:33:05.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:04 smithi023 ceph-mon[78509]: pgmap v254: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:33:06.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:05 smithi153 ceph-mon[66339]: reconnect by client.24297 192.168.0.1:0/123756084 after 0.00299998 2024-02-28T16:33:06.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:05 smithi153 ceph-mon[66339]: reconnect by client.14528 192.168.0.1:0/3625101817 after 0.00399997 2024-02-28T16:33:06.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:05 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:reconnect 2024-02-28T16:33:06.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:05 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:reconnect} 3 up:standby 2024-02-28T16:33:06.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:05 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:rejoin 2024-02-28T16:33:06.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:05 smithi153 ceph-mon[66339]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:rejoin} 3 up:standby 2024-02-28T16:33:06.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:05 smithi023 ceph-mon[78509]: reconnect by client.24297 192.168.0.1:0/123756084 after 0.00299998 2024-02-28T16:33:06.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:05 smithi023 ceph-mon[78509]: reconnect by client.14528 192.168.0.1:0/3625101817 after 0.00399997 2024-02-28T16:33:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:05 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:reconnect 2024-02-28T16:33:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:05 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:reconnect} 3 up:standby 2024-02-28T16:33:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:05 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:rejoin 2024-02-28T16:33:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:05 smithi023 ceph-mon[78509]: fsmap cephfs:1/1 {0=cephfs.smithi023.pplvdo=up:rejoin} 3 up:standby 2024-02-28T16:33:07.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:06 smithi153 ceph-mon[66339]: pgmap v255: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:33:07.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:06 smithi153 ceph-mon[66339]: daemon mds.cephfs.smithi023.pplvdo is now active in filesystem cephfs as rank 0 2024-02-28T16:33:07.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:07.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:07.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:06 smithi023 ceph-mon[78509]: pgmap v255: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:33:07.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:06 smithi023 ceph-mon[78509]: daemon mds.cephfs.smithi023.pplvdo is now active in filesystem cephfs as rank 0 2024-02-28T16:33:07.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:07.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:08.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:07 smithi153 ceph-mon[66339]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:33:08.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:07 smithi153 ceph-mon[66339]: Cluster is now healthy 2024-02-28T16:33:08.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:07 smithi153 ceph-mon[66339]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:active 2024-02-28T16:33:08.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:07 smithi153 ceph-mon[66339]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 3 up:standby 2024-02-28T16:33:08.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:08.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:08.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:07 smithi023 ceph-mon[78509]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:33:08.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:07 smithi023 ceph-mon[78509]: Cluster is now healthy 2024-02-28T16:33:08.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:07 smithi023 ceph-mon[78509]: mds.? [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] up:active 2024-02-28T16:33:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:07 smithi023 ceph-mon[78509]: fsmap cephfs:1 {0=cephfs.smithi023.pplvdo=up:active} 3 up:standby 2024-02-28T16:33:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:08.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:09.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:08 smithi153 ceph-mon[66339]: pgmap v256: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T16:33:09.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:08 smithi023 ceph-mon[78509]: pgmap v256: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T16:33:10.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:10.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:10.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:10 smithi153 ceph-mon[66339]: pgmap v257: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-02-28T16:33:10.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:10.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:10.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:10 smithi023 ceph-mon[78509]: pgmap v257: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-02-28T16:33:12.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:12 smithi153 ceph-mon[66339]: pgmap v258: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 9.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:33:12.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:12 smithi023 ceph-mon[78509]: pgmap v258: 65 pgs: 65 active+clean; 209 MiB data, 861 MiB used, 536 GiB / 536 GiB avail; 9.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 -- 172.21.15.23:0/2954955560 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d4100020 msgr2=0x7f62d4100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 --2- 172.21.15.23:0/2954955560 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d4100020 0x7f62d4100430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009910 tx=0x7f62c4009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 -- 172.21.15.23:0/2954955560 shutdown_connections 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 --2- 172.21.15.23:0/2954955560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d41012c0 0x7f62d4101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 --2- 172.21.15.23:0/2954955560 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d4100020 0x7f62d4100430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 -- 172.21.15.23:0/2954955560 >> 172.21.15.23:0/2954955560 conn(0x7f62d40fb650 msgr2=0x7f62d40fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 -- 172.21.15.23:0/2954955560 shutdown_connections 2024-02-28T16:33:13.994 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.005+0000 7f62d9200700 1 -- 172.21.15.23:0/2954955560 wait complete. 2024-02-28T16:33:13.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.006+0000 7f62d9200700 1 Processor -- start 2024-02-28T16:33:13.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62d9200700 1 -- start start 2024-02-28T16:33:13.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62d9200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d4100020 0x7f62d4197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:13.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62d9200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d41012c0 0x7f62d4197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:13.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62d9200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4198560 con 0x7f62d41012c0 2024-02-28T16:33:13.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62d9200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d41986a0 con 0x7f62d4100020 2024-02-28T16:33:13.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62caa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d41012c0 0x7f62d4197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:13.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62caa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d41012c0 0x7f62d4197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52796/0 (socket says 172.21.15.23:52796) 2024-02-28T16:33:13.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.007+0000 7f62caa00700 1 -- 172.21.15.23:0/1544016856 learned_addr learned my addr 172.21.15.23:0/1544016856 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:13.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.008+0000 7f62d3400700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d4100020 0x7f62d4197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:13.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.008+0000 7f62caa00700 1 -- 172.21.15.23:0/1544016856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d4100020 msgr2=0x7f62d4197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:13.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.008+0000 7f62caa00700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d4100020 0x7f62d4197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:13.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.008+0000 7f62caa00700 1 -- 172.21.15.23:0/1544016856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40095f0 con 0x7f62d41012c0 2024-02-28T16:33:13.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.008+0000 7f62caa00700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d41012c0 0x7f62d4197f40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00d8d0 tx=0x7f62bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:13.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.009+0000 7f62d0c00700 1 -- 172.21.15.23:0/1544016856 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc009940 con 0x7f62d41012c0 2024-02-28T16:33:13.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.009+0000 7f62d0c00700 1 -- 172.21.15.23:0/1544016856 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62bc010460 con 0x7f62d41012c0 2024-02-28T16:33:13.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.009+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d419d150 con 0x7f62d41012c0 2024-02-28T16:33:13.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.009+0000 7f62d0c00700 1 -- 172.21.15.23:0/1544016856 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc00f5f0 con 0x7f62d41012c0 2024-02-28T16:33:13.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.009+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d419d6a0 con 0x7f62d41012c0 2024-02-28T16:33:13.998 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.010+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d4108b00 con 0x7f62d41012c0 2024-02-28T16:33:13.999 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.011+0000 7f62d0c00700 1 -- 172.21.15.23:0/1544016856 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f62bc0105d0 con 0x7f62d41012c0 2024-02-28T16:33:14.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.012+0000 7f62d0c00700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f62b806d8a0 0x7f62b806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:14.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.012+0000 7f62d0c00700 1 -- 172.21.15.23:0/1544016856 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f62bc08d4d0 con 0x7f62d41012c0 2024-02-28T16:33:14.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.013+0000 7f62d3400700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f62b806d8a0 0x7f62b806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:14.001 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.013+0000 7f62d3400700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f62b806d8a0 0x7f62b806fd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62c4006010 tx=0x7f62c400b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:14.006 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.018+0000 7f62d0c00700 1 -- 172.21.15.23:0/1544016856 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f62bc05a780 con 0x7f62d41012c0 2024-02-28T16:33:14.256 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.267+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62d4074470 con 0x7f62b806d8a0 2024-02-28T16:33:14.259 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.271+0000 7f62d0c00700 1 -- 172.21.15.23:0/1544016856 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f62d4074470 con 0x7f62b806d8a0 2024-02-28T16:33:14.262 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.273+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f62b806d8a0 msgr2=0x7f62b806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.262 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.273+0000 7f62d9200700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f62b806d8a0 0x7f62b806fd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62c4006010 tx=0x7f62c400b540 comp rx=0 tx=0).stop 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.273+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d41012c0 msgr2=0x7f62d4197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.273+0000 7f62d9200700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d41012c0 0x7f62d4197f40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00d8d0 tx=0x7f62bc00dc90 comp rx=0 tx=0).stop 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.274+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 shutdown_connections 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.274+0000 7f62d9200700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d4100020 0x7f62d4197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.274+0000 7f62d9200700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f62b806d8a0 0x7f62b806fd50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.274+0000 7f62d9200700 1 --2- 172.21.15.23:0/1544016856 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f62d41012c0 0x7f62d4197f40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.274+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 >> 172.21.15.23:0/1544016856 conn(0x7f62d40fb650 msgr2=0x7f62d40fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.274+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 shutdown_connections 2024-02-28T16:33:14.263 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.274+0000 7f62d9200700 1 -- 172.21.15.23:0/1544016856 wait complete. 2024-02-28T16:33:14.279 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:33:14.427 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.438+0000 7fab3d000700 1 -- 172.21.15.23:0/1141338409 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab38102430 msgr2=0x7fab38102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.438+0000 7fab3d000700 1 --2- 172.21.15.23:0/1141338409 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab38102430 0x7fab38102840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab28009910 tx=0x7fab28009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:14.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.439+0000 7fab3d000700 1 -- 172.21.15.23:0/1141338409 shutdown_connections 2024-02-28T16:33:14.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.439+0000 7fab3d000700 1 --2- 172.21.15.23:0/1141338409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab381036d0 0x7fab38103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.439+0000 7fab3d000700 1 --2- 172.21.15.23:0/1141338409 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab38102430 0x7fab38102840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.439+0000 7fab3d000700 1 -- 172.21.15.23:0/1141338409 >> 172.21.15.23:0/1141338409 conn(0x7fab380fda80 msgr2=0x7fab380ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:14.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.439+0000 7fab3d000700 1 -- 172.21.15.23:0/1141338409 shutdown_connections 2024-02-28T16:33:14.428 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.439+0000 7fab3d000700 1 -- 172.21.15.23:0/1141338409 wait complete. 2024-02-28T16:33:14.429 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.440+0000 7fab3d000700 1 Processor -- start 2024-02-28T16:33:14.429 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.440+0000 7fab3d000700 1 -- start start 2024-02-28T16:33:14.429 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab3d000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab38102430 0x7fab38197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:14.429 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab3d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab381036d0 0x7fab38198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:14.429 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab3d000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38198850 con 0x7fab381036d0 2024-02-28T16:33:14.429 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab3d000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3819d260 con 0x7fab38102430 2024-02-28T16:33:14.430 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab2fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab381036d0 0x7fab38198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:14.430 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab2fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab381036d0 0x7fab38198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52806/0 (socket says 172.21.15.23:52806) 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab2fe00700 1 -- 172.21.15.23:0/2097606967 learned_addr learned my addr 172.21.15.23:0/2097606967 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab35e00700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab38102430 0x7fab38197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab2fe00700 1 -- 172.21.15.23:0/2097606967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab38102430 msgr2=0x7fab38197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab2fe00700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab38102430 0x7fab38197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.441+0000 7fab2fe00700 1 -- 172.21.15.23:0/2097606967 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280095f0 con 0x7fab381036d0 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.442+0000 7fab2fe00700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab381036d0 0x7fab38198230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab2000d8d0 tx=0x7fab2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.442+0000 7fab2ea00700 1 -- 172.21.15.23:0/2097606967 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab20009940 con 0x7fab381036d0 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.442+0000 7fab2ea00700 1 -- 172.21.15.23:0/2097606967 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab20010460 con 0x7fab381036d0 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.442+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3819d460 con 0x7fab381036d0 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.442+0000 7fab2ea00700 1 -- 172.21.15.23:0/2097606967 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab2000f5f0 con 0x7fab381036d0 2024-02-28T16:33:14.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.442+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3819d980 con 0x7fab381036d0 2024-02-28T16:33:14.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.444+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3810af10 con 0x7fab381036d0 2024-02-28T16:33:14.433 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.444+0000 7fab2ea00700 1 -- 172.21.15.23:0/2097606967 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fab200105d0 con 0x7fab381036d0 2024-02-28T16:33:14.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.445+0000 7fab2ea00700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab1c06d8a0 0x7fab1c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:14.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.446+0000 7fab2ea00700 1 -- 172.21.15.23:0/2097606967 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fab2008d630 con 0x7fab381036d0 2024-02-28T16:33:14.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.446+0000 7fab35e00700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab1c06d8a0 0x7fab1c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:14.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.447+0000 7fab35e00700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab1c06d8a0 0x7fab1c06fd50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab28006010 tx=0x7fab2800b560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:14.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.451+0000 7fab2ea00700 1 -- 172.21.15.23:0/2097606967 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fab20056c90 con 0x7fab381036d0 2024-02-28T16:33:14.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:14 smithi153 ceph-mon[66339]: pgmap v259: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:33:14.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.699+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab38108020 con 0x7fab1c06d8a0 2024-02-28T16:33:14.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.702+0000 7fab2ea00700 1 -- 172.21.15.23:0/2097606967 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fab38108020 con 0x7fab1c06d8a0 2024-02-28T16:33:14.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab1c06d8a0 msgr2=0x7fab1c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab1c06d8a0 0x7fab1c06fd50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab28006010 tx=0x7fab2800b560 comp rx=0 tx=0).stop 2024-02-28T16:33:14.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab381036d0 msgr2=0x7fab38198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab381036d0 0x7fab38198230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab2000d8d0 tx=0x7fab2000dc90 comp rx=0 tx=0).stop 2024-02-28T16:33:14.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 shutdown_connections 2024-02-28T16:33:14.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab38102430 0x7fab38197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fab1c06d8a0 0x7fab1c06fd50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 --2- 172.21.15.23:0/2097606967 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fab381036d0 0x7fab38198230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 >> 172.21.15.23:0/2097606967 conn(0x7fab380fda80 msgr2=0x7fab38106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:14.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 shutdown_connections 2024-02-28T16:33:14.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.705+0000 7fab3d000700 1 -- 172.21.15.23:0/2097606967 wait complete. 2024-02-28T16:33:14.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 -- 172.21.15.23:0/2983581187 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 msgr2=0x7fd9581004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 --2- 172.21.15.23:0/2983581187 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd9581004f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd944009910 tx=0x7fd944009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:14.857 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:14 smithi023 ceph-mon[78509]: pgmap v259: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:33:14.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 -- 172.21.15.23:0/2983581187 shutdown_connections 2024-02-28T16:33:14.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 --2- 172.21.15.23:0/2983581187 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd9581004f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 --2- 172.21.15.23:0/2983581187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9580fef20 0x7fd9580ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 -- 172.21.15.23:0/2983581187 >> 172.21.15.23:0/2983581187 conn(0x7fd9580fa4d0 msgr2=0x7fd9580fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:14.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 -- 172.21.15.23:0/2983581187 shutdown_connections 2024-02-28T16:33:14.858 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.868+0000 7fd957e00700 1 -- 172.21.15.23:0/2983581187 wait complete. 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.870+0000 7fd957e00700 1 Processor -- start 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.870+0000 7fd957e00700 1 -- start start 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.870+0000 7fd957e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9580fef20 0x7fd958197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.870+0000 7fd957e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd958197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.870+0000 7fd957e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958198580 con 0x7fd958100080 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.870+0000 7fd957e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9581986c0 con 0x7fd9580fef20 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd958197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd958197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52822/0 (socket says 172.21.15.23:52822) 2024-02-28T16:33:14.859 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956000700 1 -- 172.21.15.23:0/1737179905 learned_addr learned my addr 172.21.15.23:0/1737179905 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:14.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956a00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9580fef20 0x7fd958197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:14.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956000700 1 -- 172.21.15.23:0/1737179905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9580fef20 msgr2=0x7fd958197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:14.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956000700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9580fef20 0x7fd958197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:14.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956000700 1 -- 172.21.15.23:0/1737179905 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440095f0 con 0x7fd958100080 2024-02-28T16:33:14.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.871+0000 7fd956a00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9580fef20 0x7fd958197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:33:14.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.872+0000 7fd956000700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd958197f60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b5c0 tx=0x7fd94400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:14.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.872+0000 7fd94f400700 1 -- 172.21.15.23:0/1737179905 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd94401d070 con 0x7fd958100080 2024-02-28T16:33:14.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.872+0000 7fd94f400700 1 -- 172.21.15.23:0/1737179905 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd94400f460 con 0x7fd958100080 2024-02-28T16:33:14.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.872+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95819d110 con 0x7fd958100080 2024-02-28T16:33:14.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.872+0000 7fd94f400700 1 -- 172.21.15.23:0/1737179905 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd944021640 con 0x7fd958100080 2024-02-28T16:33:14.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.872+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95819d600 con 0x7fd958100080 2024-02-28T16:33:14.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.873+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd958103ae0 con 0x7fd958100080 2024-02-28T16:33:14.862 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.874+0000 7fd94f400700 1 -- 172.21.15.23:0/1737179905 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd944003a60 con 0x7fd958100080 2024-02-28T16:33:14.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.875+0000 7fd94f400700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd93c06d8a0 0x7fd93c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:14.863 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.875+0000 7fd94f400700 1 -- 172.21.15.23:0/1737179905 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd94408e9c0 con 0x7fd958100080 2024-02-28T16:33:14.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.875+0000 7fd956a00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd93c06d8a0 0x7fd93c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:14.864 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.876+0000 7fd956a00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd93c06d8a0 0x7fd93c06fd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd948005950 tx=0x7fd9480058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:14.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:14.880+0000 7fd94f400700 1 -- 172.21.15.23:0/1737179905 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd94405bbd0 con 0x7fd958100080 2024-02-28T16:33:15.097 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.109+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd958061190 con 0x7fd93c06d8a0 2024-02-28T16:33:15.131 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.142+0000 7fd94f400700 1 -- 172.21.15.23:0/1737179905 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fd958061190 con 0x7fd93c06d8a0 2024-02-28T16:33:15.131 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:33:15.132 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (18m) 65s ago 20m 14.4M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:33:15.132 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (20m) 65s ago 20m 9185k - 18.2.0 dc2bc1663786 7effe68e0c4f 2024-02-28T16:33:15.132 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (19m) 7s ago 19m 9151k - 18.2.0 dc2bc1663786 91a739590451 2024-02-28T16:33:15.132 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (5m) 65s ago 20m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:33:15.132 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (5m) 7s ago 18m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:33:15.132 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (17m) 65s ago 19m 71.9M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:33:15.132 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (72s) 65s ago 12m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (102s) 65s ago 13m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (12s) 7s ago 12m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b4ff1f848efc 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (41s) 7s ago 12m 11.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (9m) 65s ago 21m 508M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (8m) 7s ago 18m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (7m) 65s ago 22m 53.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (6m) 7s ago 18m 43.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (20m) 65s ago 20m 8200k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:33:15.133 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (18m) 7s ago 18m 8338k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:33:15.134 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (5m) 65s ago 17m 97.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:33:15.134 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (4m) 65s ago 17m 110M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:33:15.134 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (4m) 65s ago 16m 98.4M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:33:15.134 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (3m) 7s ago 15m 119M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:33:15.134 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (2m) 7s ago 15m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:33:15.134 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (2m) 7s ago 14m 95.2M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:33:15.134 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (8m) 65s ago 19m 60.2M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:33:15.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.146+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd93c06d8a0 msgr2=0x7fd93c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.146+0000 7fd957e00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd93c06d8a0 0x7fd93c06fd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd948005950 tx=0x7fd9480058e0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.146+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 msgr2=0x7fd958197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.135 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.146+0000 7fd957e00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd958197f60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b5c0 tx=0x7fd94400be20 comp rx=0 tx=0).stop 2024-02-28T16:33:15.136 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.147+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 shutdown_connections 2024-02-28T16:33:15.136 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.147+0000 7fd957e00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9580fef20 0x7fd958197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.147+0000 7fd957e00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd93c06d8a0 0x7fd93c06fd50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.147+0000 7fd957e00700 1 --2- 172.21.15.23:0/1737179905 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd958100080 0x7fd958197f60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.147+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 >> 172.21.15.23:0/1737179905 conn(0x7fd9580fa4d0 msgr2=0x7fd9580fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:15.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.147+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 shutdown_connections 2024-02-28T16:33:15.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.147+0000 7fd957e00700 1 -- 172.21.15.23:0/1737179905 wait complete. 2024-02-28T16:33:15.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 -- 172.21.15.23:0/2137211087 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50101440 msgr2=0x7f3c50101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 --2- 172.21.15.23:0/2137211087 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50101440 0x7f3c50101890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009910 tx=0x7f3c3c009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:15.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 -- 172.21.15.23:0/2137211087 shutdown_connections 2024-02-28T16:33:15.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 --2- 172.21.15.23:0/2137211087 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50101440 0x7f3c50101890 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 --2- 172.21.15.23:0/2137211087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c50100240 0x7f3c50100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 -- 172.21.15.23:0/2137211087 >> 172.21.15.23:0/2137211087 conn(0x7f3c500fb7f0 msgr2=0x7f3c500fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:15.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 -- 172.21.15.23:0/2137211087 shutdown_connections 2024-02-28T16:33:15.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.319+0000 7f3c57e00700 1 -- 172.21.15.23:0/2137211087 wait complete. 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c57e00700 1 Processor -- start 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c57e00700 1 -- start start 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c57e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50100240 0x7f3c50197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c57e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c50101440 0x7f3c501981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c57e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50198740 con 0x7f3c50100240 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c57e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c501988b0 con 0x7f3c50101440 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c55400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50100240 0x7f3c50197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.321+0000 7f3c55400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50100240 0x7f3c50197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52834/0 (socket says 172.21.15.23:52834) 2024-02-28T16:33:15.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.322+0000 7f3c55400700 1 -- 172.21.15.23:0/3655435796 learned_addr learned my addr 172.21.15.23:0/3655435796 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.322+0000 7f3c54a00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c50101440 0x7f3c501981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.322+0000 7f3c55400700 1 -- 172.21.15.23:0/3655435796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c50101440 msgr2=0x7f3c501981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.322+0000 7f3c55400700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c50101440 0x7f3c501981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.322+0000 7f3c55400700 1 -- 172.21.15.23:0/3655435796 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0095f0 con 0x7f3c50100240 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.322+0000 7f3c55400700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50100240 0x7f3c50197c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c910 tx=0x7f3c4400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.323+0000 7f3c4e000700 1 -- 172.21.15.23:0/3655435796 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c440041f0 con 0x7f3c50100240 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.323+0000 7f3c4e000700 1 -- 172.21.15.23:0/3655435796 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3c44007db0 con 0x7f3c50100240 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.323+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5019d350 con 0x7f3c50100240 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.323+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5019d8a0 con 0x7f3c50100240 2024-02-28T16:33:15.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.323+0000 7f3c4e000700 1 -- 172.21.15.23:0/3655435796 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c44003d60 con 0x7f3c50100240 2024-02-28T16:33:15.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.324+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c50105520 con 0x7f3c50100240 2024-02-28T16:33:15.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.325+0000 7f3c4e000700 1 -- 172.21.15.23:0/3655435796 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f3c44007900 con 0x7f3c50100240 2024-02-28T16:33:15.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.326+0000 7f3c4e000700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3c3806d8a0 0x7f3c3806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:15.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.326+0000 7f3c4e000700 1 -- 172.21.15.23:0/3655435796 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3c4408d250 con 0x7f3c50100240 2024-02-28T16:33:15.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.327+0000 7f3c54a00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3c3806d8a0 0x7f3c3806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:15.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.327+0000 7f3c54a00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3c3806d8a0 0x7f3c3806fd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c501991a0 tx=0x7f3c3c00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:15.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.334+0000 7f3c4e000700 1 -- 172.21.15.23:0/3655435796 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3c440569d0 con 0x7f3c50100240 2024-02-28T16:33:15.644 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.655+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c5002ce90 con 0x7f3c50100240 2024-02-28T16:33:15.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.656+0000 7f3c4e000700 1 -- 172.21.15.23:0/3655435796 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f3c4405a090 con 0x7f3c50100240 2024-02-28T16:33:15.645 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:33:15.645 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:33:15.645 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:15.645 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:15.645 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:33:15.645 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:33:15.646 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:33:15.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3c3806d8a0 msgr2=0x7f3c3806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3c3806d8a0 0x7f3c3806fd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c501991a0 tx=0x7f3c3c00b540 comp rx=0 tx=0).stop 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50100240 msgr2=0x7f3c50197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50100240 0x7f3c50197c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c910 tx=0x7f3c4400ccd0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 shutdown_connections 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3c3806d8a0 0x7f3c3806fd50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3c50100240 0x7f3c50197c90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 --2- 172.21.15.23:0/3655435796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c50101440 0x7f3c501981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 >> 172.21.15.23:0/3655435796 conn(0x7f3c500fb7f0 msgr2=0x7f3c50102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 shutdown_connections 2024-02-28T16:33:15.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.660+0000 7f3c57e00700 1 -- 172.21.15.23:0/3655435796 wait complete. 2024-02-28T16:33:15.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 -- 172.21.15.23:0/2254339331 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 msgr2=0x7fc0b4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 --2- 172.21.15.23:0/2254339331 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4100650 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009910 tx=0x7fc0a4009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:15.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 -- 172.21.15.23:0/2254339331 shutdown_connections 2024-02-28T16:33:15.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 --2- 172.21.15.23:0/2254339331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b4101440 0x7fc0b4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 --2- 172.21.15.23:0/2254339331 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4100650 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.812 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 -- 172.21.15.23:0/2254339331 >> 172.21.15.23:0/2254339331 conn(0x7fc0b40fb7f0 msgr2=0x7fc0b40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:15.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 -- 172.21.15.23:0/2254339331 shutdown_connections 2024-02-28T16:33:15.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.823+0000 7fc0ba000700 1 -- 172.21.15.23:0/2254339331 wait complete. 2024-02-28T16:33:15.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.825+0000 7fc0ba000700 1 Processor -- start 2024-02-28T16:33:15.813 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.825+0000 7fc0ba000700 1 -- start start 2024-02-28T16:33:15.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.825+0000 7fc0ba000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:15.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.825+0000 7fc0ba000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b4101440 0x7fc0b41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:15.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.825+0000 7fc0ba000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41987f0 con 0x7fc0b4100240 2024-02-28T16:33:15.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.825+0000 7fc0ba000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4198960 con 0x7fc0b4101440 2024-02-28T16:33:15.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:15.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52852/0 (socket says 172.21.15.23:52852) 2024-02-28T16:33:15.814 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b3400700 1 -- 172.21.15.23:0/3945135927 learned_addr learned my addr 172.21.15.23:0/3945135927 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:15.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b2a00700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b4101440 0x7fc0b41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:15.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b3400700 1 -- 172.21.15.23:0/3945135927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b4101440 msgr2=0x7fc0b41981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:15.815 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b3400700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b4101440 0x7fc0b41981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b3400700 1 -- 172.21.15.23:0/3945135927 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40095f0 con 0x7fc0b4100240 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.826+0000 7fc0b2a00700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b4101440 0x7fc0b41981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.827+0000 7fc0b3400700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4197cb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400bda0 tx=0x7fc0a400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.827+0000 7fc0abe00700 1 -- 172.21.15.23:0/3945135927 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a401d070 con 0x7fc0b4100240 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.827+0000 7fc0abe00700 1 -- 172.21.15.23:0/3945135927 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0a400f460 con 0x7fc0b4100240 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.827+0000 7fc0abe00700 1 -- 172.21.15.23:0/3945135927 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a4021620 con 0x7fc0b4100240 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.827+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b419d390 con 0x7fc0b4100240 2024-02-28T16:33:15.816 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.827+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b419d880 con 0x7fc0b4100240 2024-02-28T16:33:15.817 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.829+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b4105520 con 0x7fc0b4100240 2024-02-28T16:33:15.818 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.830+0000 7fc0abe00700 1 -- 172.21.15.23:0/3945135927 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc0a400f5d0 con 0x7fc0b4100240 2024-02-28T16:33:15.819 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.831+0000 7fc0abe00700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc09806d8a0 0x7fc09806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:15.820 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.831+0000 7fc0abe00700 1 -- 172.21.15.23:0/3945135927 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc0a408e810 con 0x7fc0b4100240 2024-02-28T16:33:15.820 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.832+0000 7fc0b2a00700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc09806d8a0 0x7fc09806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:15.820 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.832+0000 7fc0b2a00700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc09806d8a0 0x7fc09806fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005950 tx=0x7fc0a00058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:15.831 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:15.842+0000 7fc0abe00700 1 -- 172.21.15.23:0/3945135927 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc0a4057f10 con 0x7fc0b4100240 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:15.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.klbbrl"}]': finished 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.pplvdo"}]': finished 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.dhwpyj"}]': finished 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.senzwp"}]': finished 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.925 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:15.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:15.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:15.926 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:15 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3655435796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:16.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:16.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:16.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:16.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:16.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:33:16.105 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.klbbrl"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.klbbrl"}]': finished 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.pplvdo"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi023.pplvdo"}]': finished 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.dhwpyj"}]: dispatch 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.dhwpyj"}]': finished 2024-02-28T16:33:16.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.senzwp"}]: dispatch 2024-02-28T16:33:16.107 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.senzwp"}]': finished 2024-02-28T16:33:16.107 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.107 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:16.107 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.107 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:16.107 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.107 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:15 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3655435796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:16.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.131+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0b402cc30 con 0x7fc0b4100240 2024-02-28T16:33:16.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.132+0000 7fc0abe00700 1 -- 172.21.15.23:0/3945135927 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1873 (secure 0 0 0) 0x7fc0a405b5d0 con 0x7fc0b4100240 2024-02-28T16:33:16.121 INFO:teuthology.orchestra.run.smithi023.stdout:e36 2024-02-28T16:33:16.121 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:33:16.121 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 36 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:33:05.948811+0000 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:33:16.122 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 85 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=34420} 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:33:16.123 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{0:34420} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:16.124 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:44333} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc09806d8a0 msgr2=0x7fc09806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc09806d8a0 0x7fc09806fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005950 tx=0x7fc0a00058e0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 msgr2=0x7fc0b4197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4197cb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400bda0 tx=0x7fc0a400be80 comp rx=0 tx=0).stop 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 shutdown_connections 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc09806d8a0 0x7fc09806fd50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc0b4100240 0x7fc0b4197cb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 --2- 172.21.15.23:0/3945135927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b4101440 0x7fc0b41981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 >> 172.21.15.23:0/3945135927 conn(0x7fc0b40fb7f0 msgr2=0x7fc0b4102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 shutdown_connections 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.135+0000 7fc0ba000700 1 -- 172.21.15.23:0/3945135927 wait complete. 2024-02-28T16:33:16.128 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 36 2024-02-28T16:33:16.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 -- 172.21.15.23:0/3231782887 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 msgr2=0x7f3ea4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/3231782887 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea4101890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009910 tx=0x7f3e90009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:16.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 -- 172.21.15.23:0/3231782887 shutdown_connections 2024-02-28T16:33:16.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/3231782887 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea4101890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/3231782887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4100240 0x7f3ea4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.277 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 -- 172.21.15.23:0/3231782887 >> 172.21.15.23:0/3231782887 conn(0x7f3ea40fb7f0 msgr2=0x7f3ea40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:16.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 -- 172.21.15.23:0/3231782887 shutdown_connections 2024-02-28T16:33:16.278 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.288+0000 7f3ea9e00700 1 -- 172.21.15.23:0/3231782887 wait complete. 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.289+0000 7f3ea9e00700 1 Processor -- start 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea9e00700 1 -- start start 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea9e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4100240 0x7f3ea4197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea9e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea9e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea41987f0 con 0x7f3ea4101440 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea9e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4198960 con 0x7f3ea4100240 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea2000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea2000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea41981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52878/0 (socket says 172.21.15.23:52878) 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea2000700 1 -- 172.21.15.23:0/610682335 learned_addr learned my addr 172.21.15.23:0/610682335 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.290+0000 7f3ea2a00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4100240 0x7f3ea4197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea2000700 1 -- 172.21.15.23:0/610682335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4100240 msgr2=0x7f3ea4197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea2000700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4100240 0x7f3ea4197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea2000700 1 -- 172.21.15.23:0/610682335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900095f0 con 0x7f3ea4101440 2024-02-28T16:33:16.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea2000700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea41981f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b5c0 tx=0x7f3e9000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:16.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea8a00700 1 -- 172.21.15.23:0/610682335 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e9001d070 con 0x7f3ea4101440 2024-02-28T16:33:16.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea8a00700 1 -- 172.21.15.23:0/610682335 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e9000f460 con 0x7f3ea4101440 2024-02-28T16:33:16.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea419d390 con 0x7f3ea4101440 2024-02-28T16:33:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea8a00700 1 -- 172.21.15.23:0/610682335 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e90021640 con 0x7f3ea4101440 2024-02-28T16:33:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.291+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea419d880 con 0x7f3ea4101440 2024-02-28T16:33:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.292+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea4105520 con 0x7f3ea4101440 2024-02-28T16:33:16.281 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.293+0000 7f3ea8a00700 1 -- 172.21.15.23:0/610682335 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f3e9000f5d0 con 0x7f3ea4101440 2024-02-28T16:33:16.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.295+0000 7f3ea8a00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3e8806d8a0 0x7f3e8806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:16.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.295+0000 7f3ea8a00700 1 -- 172.21.15.23:0/610682335 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3e9008e9a0 con 0x7f3ea4101440 2024-02-28T16:33:16.283 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.295+0000 7f3ea2a00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3e8806d8a0 0x7f3e8806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:16.284 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.296+0000 7f3ea2a00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3e8806d8a0 0x7f3e8806fd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3e94005950 tx=0x7f3e940058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:16.288 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.300+0000 7f3ea8a00700 1 -- 172.21.15.23:0/610682335 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3e90058000 con 0x7f3ea4101440 2024-02-28T16:33:16.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.542+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ea4061190 con 0x7f3e8806d8a0 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.544+0000 7f3ea8a00700 1 -- 172.21.15.23:0/610682335 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f3ea4061190 con 0x7f3e8806d8a0 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "mds", 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:33:16.533 INFO:teuthology.orchestra.run.smithi023.stdout: "osd", 2024-02-28T16:33:16.534 INFO:teuthology.orchestra.run.smithi023.stdout: "mon" 2024-02-28T16:33:16.534 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:33:16.534 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "16/23 daemons upgraded", 2024-02-28T16:33:16.534 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-02-28T16:33:16.534 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:33:16.534 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.547+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3e8806d8a0 msgr2=0x7f3e8806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.547+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3e8806d8a0 0x7f3e8806fd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3e94005950 tx=0x7f3e940058e0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.547+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 msgr2=0x7f3ea41981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.547+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea41981f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b5c0 tx=0x7f3e9000be20 comp rx=0 tx=0).stop 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.548+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 shutdown_connections 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.548+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4100240 0x7f3ea4197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.548+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3e8806d8a0 0x7f3e8806fd50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.548+0000 7f3ea9e00700 1 --2- 172.21.15.23:0/610682335 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3ea4101440 0x7f3ea41981f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.548+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 >> 172.21.15.23:0/610682335 conn(0x7f3ea40fb7f0 msgr2=0x7f3ea4102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:16.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.548+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 shutdown_connections 2024-02-28T16:33:16.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.548+0000 7f3ea9e00700 1 -- 172.21.15.23:0/610682335 wait complete. 2024-02-28T16:33:16.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 -- 172.21.15.23:0/874359405 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 msgr2=0x7f6d50073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 --2- 172.21.15.23:0/874359405 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50073ba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009910 tx=0x7f6d3c009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:16.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 -- 172.21.15.23:0/874359405 shutdown_connections 2024-02-28T16:33:16.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 --2- 172.21.15.23:0/874359405 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50073ba0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 --2- 172.21.15.23:0/874359405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d50074d00 0x7f6d50073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 -- 172.21.15.23:0/874359405 >> 172.21.15.23:0/874359405 conn(0x7f6d500fb7f0 msgr2=0x7f6d500fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:16.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 -- 172.21.15.23:0/874359405 shutdown_connections 2024-02-28T16:33:16.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.708+0000 7f6d55000700 1 -- 172.21.15.23:0/874359405 wait complete. 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.709+0000 7f6d55000700 1 Processor -- start 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.709+0000 7f6d55000700 1 -- start start 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.709+0000 7f6d55000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.709+0000 7f6d55000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d50074d00 0x7f6d501981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.709+0000 7f6d55000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d501987b0 con 0x7f6d50073730 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.709+0000 7f6d55000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50198920 con 0x7f6d50074d00 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:16.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4de00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:52906/0 (socket says 172.21.15.23:52906) 2024-02-28T16:33:16.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4de00700 1 -- 172.21.15.23:0/2424153954 learned_addr learned my addr 172.21.15.23:0/2424153954 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4d400700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d50074d00 0x7f6d501981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4de00700 1 -- 172.21.15.23:0/2424153954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d50074d00 msgr2=0x7f6d501981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4de00700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d50074d00 0x7f6d501981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4de00700 1 -- 172.21.15.23:0/2424153954 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0095f0 con 0x7f6d50073730 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4d400700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d50074d00 0x7f6d501981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.710+0000 7f6d4de00700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50197c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000d8d0 tx=0x7f6d4000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.711+0000 7f6d46a00700 1 -- 172.21.15.23:0/2424153954 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d40009940 con 0x7f6d50073730 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.711+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5019d3b0 con 0x7f6d50073730 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.711+0000 7f6d46a00700 1 -- 172.21.15.23:0/2424153954 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d40010460 con 0x7f6d50073730 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.711+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5019d900 con 0x7f6d50073730 2024-02-28T16:33:16.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.711+0000 7f6d46a00700 1 -- 172.21.15.23:0/2424153954 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4001b620 con 0x7f6d50073730 2024-02-28T16:33:16.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.712+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5010af70 con 0x7f6d50073730 2024-02-28T16:33:16.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.713+0000 7f6d46a00700 1 -- 172.21.15.23:0/2424153954 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6d400105d0 con 0x7f6d50073730 2024-02-28T16:33:16.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.714+0000 7f6d46a00700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6d3406d8a0 0x7f6d3406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:16.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.714+0000 7f6d46a00700 1 -- 172.21.15.23:0/2424153954 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f6d4008d600 con 0x7f6d50073730 2024-02-28T16:33:16.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.714+0000 7f6d4d400700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6d3406d8a0 0x7f6d3406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:16.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.715+0000 7f6d4d400700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6d3406d8a0 0x7f6d3406fd50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00b5c0 tx=0x7f6d3c005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:16.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:16.719+0000 7f6d46a00700 1 -- 172.21.15.23:0/2424153954 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6d40056c60 con 0x7f6d50073730 2024-02-28T16:33:16.950 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:16 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all mds 2024-02-28T16:33:16.951 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:16 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all rgw 2024-02-28T16:33:16.951 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:16 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:33:16.951 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:16 smithi023 ceph-mon[78509]: pgmap v260: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:33:16.951 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:16 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3945135927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:17.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.046+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6d5010b130 con 0x7f6d50073730 2024-02-28T16:33:17.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.046+0000 7f6d46a00700 1 -- 172.21.15.23:0/2424153954 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6d4005a320 con 0x7f6d50073730 2024-02-28T16:33:17.035 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:33:17.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6d3406d8a0 msgr2=0x7f6d3406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:17.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6d3406d8a0 0x7f6d3406fd50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00b5c0 tx=0x7f6d3c005e20 comp rx=0 tx=0).stop 2024-02-28T16:33:17.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 msgr2=0x7f6d50197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:17.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50197c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000d8d0 tx=0x7f6d4000dc90 comp rx=0 tx=0).stop 2024-02-28T16:33:17.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 shutdown_connections 2024-02-28T16:33:17.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6d3406d8a0 0x7f6d3406fd50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:17.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6d50073730 0x7f6d50197c70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:17.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 --2- 172.21.15.23:0/2424153954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d50074d00 0x7f6d501981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:17.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.049+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 >> 172.21.15.23:0/2424153954 conn(0x7f6d500fb7f0 msgr2=0x7f6d501060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:17.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.050+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 shutdown_connections 2024-02-28T16:33:17.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:17.050+0000 7f6d55000700 1 -- 172.21.15.23:0/2424153954 wait complete. 2024-02-28T16:33:17.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:16 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all mds 2024-02-28T16:33:17.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:16 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all rgw 2024-02-28T16:33:17.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:16 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:33:17.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:16 smithi153 ceph-mon[66339]: pgmap v260: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:33:17.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:16 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3945135927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:18.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:17 smithi153 ceph-mon[66339]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:17 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2424153954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:33:18.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:17 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:17 smithi023 ceph-mon[78509]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:17 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2424153954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi023", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:33:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:17 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:19.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:18 smithi153 ceph-mon[66339]: pgmap v261: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:33:19.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:18 smithi153 ceph-mon[66339]: Upgrade: Updating ceph-exporter.smithi023 (1/2) 2024-02-28T16:33:19.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:18 smithi153 ceph-mon[66339]: Deploying daemon ceph-exporter.smithi023 on smithi023 2024-02-28T16:33:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:18 smithi023 ceph-mon[78509]: pgmap v261: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:33:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:18 smithi023 ceph-mon[78509]: Upgrade: Updating ceph-exporter.smithi023 (1/2) 2024-02-28T16:33:19.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:18 smithi023 ceph-mon[78509]: Deploying daemon ceph-exporter.smithi023 on smithi023 2024-02-28T16:33:21.080 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:20 smithi023 ceph-mon[78509]: pgmap v262: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:33:21.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:20 smithi153 ceph-mon[66339]: pgmap v262: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:33:22.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:22 smithi153 ceph-mon[66339]: pgmap v263: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-28T16:33:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:22.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:22.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:22 smithi023 ceph-mon[78509]: pgmap v263: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-28T16:33:22.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:22.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:24.641 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:24 smithi153 ceph-mon[66339]: pgmap v264: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T16:33:24.642 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:24.642 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:24.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:24 smithi023 ceph-mon[78509]: pgmap v264: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T16:33:24.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:24.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:26.755 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:26 smithi153 ceph-mon[66339]: pgmap v265: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:26.755 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:26 smithi153 ceph-mon[66339]: Upgrade: Updating ceph-exporter.smithi153 (2/2) 2024-02-28T16:33:26.755 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:26 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:26.755 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:26 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:33:26.756 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:26 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:26.756 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:26 smithi153 ceph-mon[66339]: Deploying daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:33:26.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:26 smithi023 ceph-mon[78509]: pgmap v265: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:26.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:26 smithi023 ceph-mon[78509]: Upgrade: Updating ceph-exporter.smithi153 (2/2) 2024-02-28T16:33:26.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:26 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:26.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:26 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T16:33:26.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:26 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:26.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:26 smithi023 ceph-mon[78509]: Deploying daemon ceph-exporter.smithi153 on smithi153 2024-02-28T16:33:28.872 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:28 smithi153 ceph-mon[66339]: pgmap v266: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:28.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:28 smithi023 ceph-mon[78509]: pgmap v266: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:30.847 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:30 smithi153 ceph-mon[66339]: pgmap v267: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:30.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:30 smithi023 ceph-mon[78509]: pgmap v267: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:32.317 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:32.317 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:32.318 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:32.385 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:32.386 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:32.386 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:33.384 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:33 smithi153 ceph-mon[66339]: pgmap v268: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:33.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:33 smithi023 ceph-mon[78509]: pgmap v268: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:35.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:35 smithi023 ceph-mon[78509]: pgmap v269: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:35.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:35.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:35 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:35.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:35 smithi153 ceph-mon[66339]: pgmap v269: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:35.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:35 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:37 smithi153 ceph-mon[66339]: pgmap v270: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:37.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:37 smithi023 ceph-mon[78509]: pgmap v270: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:38.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:38 smithi023 ceph-mon[78509]: pgmap v271: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:38.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:38.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:38 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:39.051 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:38 smithi153 ceph-mon[66339]: pgmap v271: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:39.051 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:39.051 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:38 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:41.093 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:40 smithi153 ceph-mon[66339]: pgmap v272: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:41.093 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:41.093 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:41.140 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:40 smithi023 ceph-mon[78509]: pgmap v272: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:41.140 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:41.141 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:42.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:42 smithi023 ceph-mon[78509]: pgmap v273: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:42.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:42 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:42.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:42 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:42 smithi153 ceph-mon[66339]: pgmap v273: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:42 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:43.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:42 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:44.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:44 smithi023 ceph-mon[78509]: pgmap v274: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:45.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:44 smithi153 ceph-mon[66339]: pgmap v274: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: pgmap v275: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi023"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi023"}]': finished 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi153"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi153"}]': finished 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:33:46.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all nfs 2024-02-28T16:33:46.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:33:46.898 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: pgmap v275: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:46.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi023"}]: dispatch 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi023"}]': finished 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi153"}]: dispatch 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi153"}]': finished 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all nfs 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:33:46.924 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:47.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.229+0000 7f49ea200700 1 -- 172.21.15.23:0/4179348900 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4103680 msgr2=0x7f49e4105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.229+0000 7f49ea200700 1 --2- 172.21.15.23:0/4179348900 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4103680 0x7f49e4105a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009910 tx=0x7f49d0009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:47.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.229+0000 7f49ea200700 1 -- 172.21.15.23:0/4179348900 shutdown_connections 2024-02-28T16:33:47.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.229+0000 7f49ea200700 1 --2- 172.21.15.23:0/4179348900 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4103680 0x7f49e4105a60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.229+0000 7f49ea200700 1 --2- 172.21.15.23:0/4179348900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4100d60 0x7f49e4103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.218 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.229+0000 7f49ea200700 1 -- 172.21.15.23:0/4179348900 >> 172.21.15.23:0/4179348900 conn(0x7f49e40fa780 msgr2=0x7f49e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:47.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.229+0000 7f49ea200700 1 -- 172.21.15.23:0/4179348900 shutdown_connections 2024-02-28T16:33:47.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.230+0000 7f49ea200700 1 -- 172.21.15.23:0/4179348900 wait complete. 2024-02-28T16:33:47.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.231+0000 7f49ea200700 1 Processor -- start 2024-02-28T16:33:47.219 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.231+0000 7f49ea200700 1 -- start start 2024-02-28T16:33:47.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49ea200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4100d60 0x7f49e4191db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:47.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49ea200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4103680 0x7f49e41922f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:47.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49ea200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e418e8a0 con 0x7f49e4100d60 2024-02-28T16:33:47.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49ea200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e418ea10 con 0x7f49e4103680 2024-02-28T16:33:47.220 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49e3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4100d60 0x7f49e4191db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:47.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49e3400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4100d60 0x7f49e4191db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37726/0 (socket says 172.21.15.23:37726) 2024-02-28T16:33:47.221 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49e3400700 1 -- 172.21.15.23:0/2373216671 learned_addr learned my addr 172.21.15.23:0/2373216671 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.232+0000 7f49e2a00700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4103680 0x7f49e41922f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49e3400700 1 -- 172.21.15.23:0/2373216671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4103680 msgr2=0x7f49e41922f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49e3400700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4103680 0x7f49e41922f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49e3400700 1 -- 172.21.15.23:0/2373216671 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00095f0 con 0x7f49e4100d60 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49e2a00700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4103680 0x7f49e41922f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49e3400700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4100d60 0x7f49e4191db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f49d400d900 tx=0x7f49d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49dbe00700 1 -- 172.21.15.23:0/2373216671 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d4009900 con 0x7f49e4100d60 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49dbe00700 1 -- 172.21.15.23:0/2373216671 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49d4010460 con 0x7f49e4100d60 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49dbe00700 1 -- 172.21.15.23:0/2373216671 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d400f5f0 con 0x7f49e4100d60 2024-02-28T16:33:47.222 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.233+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e418ecf0 con 0x7f49e4100d60 2024-02-28T16:33:47.223 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.234+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e418f240 con 0x7f49e4100d60 2024-02-28T16:33:47.223 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.235+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e40fc340 con 0x7f49e4100d60 2024-02-28T16:33:47.224 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.236+0000 7f49dbe00700 1 -- 172.21.15.23:0/2373216671 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f49d40105d0 con 0x7f49e4100d60 2024-02-28T16:33:47.225 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.237+0000 7f49dbe00700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49c806d8a0 0x7f49c806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:47.225 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.237+0000 7f49dbe00700 1 -- 172.21.15.23:0/2373216671 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f49d408d1b0 con 0x7f49e4100d60 2024-02-28T16:33:47.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.237+0000 7f49e2a00700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49c806d8a0 0x7f49c806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:47.226 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.238+0000 7f49e2a00700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49c806d8a0 0x7f49c806fd50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49d0006010 tx=0x7f49d000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:47.230 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.242+0000 7f49dbe00700 1 -- 172.21.15.23:0/2373216671 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f49d405a3c0 con 0x7f49e4100d60 2024-02-28T16:33:47.486 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.497+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49e4061190 con 0x7f49c806d8a0 2024-02-28T16:33:47.489 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.500+0000 7f49dbe00700 1 -- 172.21.15.23:0/2373216671 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f49e4061190 con 0x7f49c806d8a0 2024-02-28T16:33:47.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.504+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49c806d8a0 msgr2=0x7f49c806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.504+0000 7f49ea200700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49c806d8a0 0x7f49c806fd50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49d0006010 tx=0x7f49d000b540 comp rx=0 tx=0).stop 2024-02-28T16:33:47.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.504+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4100d60 msgr2=0x7f49e4191db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.504+0000 7f49ea200700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4100d60 0x7f49e4191db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f49d400d900 tx=0x7f49d400dcc0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.505+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 shutdown_connections 2024-02-28T16:33:47.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.505+0000 7f49ea200700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49c806d8a0 0x7f49c806fd50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.505+0000 7f49ea200700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49e4100d60 0x7f49e4191db0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.505+0000 7f49ea200700 1 --2- 172.21.15.23:0/2373216671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4103680 0x7f49e41922f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.505+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 >> 172.21.15.23:0/2373216671 conn(0x7f49e40fa780 msgr2=0x7f49e40ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:47.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.505+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 shutdown_connections 2024-02-28T16:33:47.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.506+0000 7f49ea200700 1 -- 172.21.15.23:0/2373216671 wait complete. 2024-02-28T16:33:47.512 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:33:47.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 -- 172.21.15.23:0/1446910828 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254107a60 msgr2=0x7fb254107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 --2- 172.21.15.23:0/1446910828 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254107a60 0x7fb254107eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb240009910 tx=0x7fb240009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 -- 172.21.15.23:0/1446910828 shutdown_connections 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 --2- 172.21.15.23:0/1446910828 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254107a60 0x7fb254107eb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 --2- 172.21.15.23:0/1446910828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb254106860 0x7fb254106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 -- 172.21.15.23:0/1446910828 >> 172.21.15.23:0/1446910828 conn(0x7fb2540758b0 msgr2=0x7fb254077d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 -- 172.21.15.23:0/1446910828 shutdown_connections 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.668+0000 7fb25be00700 1 -- 172.21.15.23:0/1446910828 wait complete. 2024-02-28T16:33:47.657 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.669+0000 7fb25be00700 1 Processor -- start 2024-02-28T16:33:47.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.669+0000 7fb25be00700 1 -- start start 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb25be00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254106860 0x7fb25419c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb25be00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb254107a60 0x7fb25419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb25be00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25419ccb0 con 0x7fb254106860 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb25be00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25419cdf0 con 0x7fb254107a60 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb259400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254106860 0x7fb25419c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb259400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254106860 0x7fb25419c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37752/0 (socket says 172.21.15.23:37752) 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb259400700 1 -- 172.21.15.23:0/2425364134 learned_addr learned my addr 172.21.15.23:0/2425364134 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.670+0000 7fb258a00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb254107a60 0x7fb25419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb259400700 1 -- 172.21.15.23:0/2425364134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb254107a60 msgr2=0x7fb25419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb259400700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb254107a60 0x7fb25419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb259400700 1 -- 172.21.15.23:0/2425364134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400095f0 con 0x7fb254106860 2024-02-28T16:33:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb259400700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254106860 0x7fb25419c150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb24800b480 tx=0x7fb24800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb252000700 1 -- 172.21.15.23:0/2425364134 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2480118c0 con 0x7fb254106860 2024-02-28T16:33:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb252000700 1 -- 172.21.15.23:0/2425364134 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb248010380 con 0x7fb254106860 2024-02-28T16:33:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb252000700 1 -- 172.21.15.23:0/2425364134 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb24800f4f0 con 0x7fb254106860 2024-02-28T16:33:47.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2541a18a0 con 0x7fb254106860 2024-02-28T16:33:47.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.671+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2541a1df0 con 0x7fb254106860 2024-02-28T16:33:47.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.673+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25410f450 con 0x7fb254106860 2024-02-28T16:33:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.674+0000 7fb252000700 1 -- 172.21.15.23:0/2425364134 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb24800f760 con 0x7fb254106860 2024-02-28T16:33:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.675+0000 7fb252000700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb23c06d8a0 0x7fb23c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.675+0000 7fb252000700 1 -- 172.21.15.23:0/2425364134 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fb24808d160 con 0x7fb254106860 2024-02-28T16:33:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.675+0000 7fb258a00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb23c06d8a0 0x7fb23c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:47.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.676+0000 7fb258a00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb23c06d8a0 0x7fb23c06fd50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb240006010 tx=0x7fb24000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:47.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.680+0000 7fb252000700 1 -- 172.21.15.23:0/2425364134 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb24805a410 con 0x7fb254106860 2024-02-28T16:33:47.925 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.936+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb25410c3b0 con 0x7fb23c06d8a0 2024-02-28T16:33:47.927 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.939+0000 7fb252000700 1 -- 172.21.15.23:0/2425364134 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fb25410c3b0 con 0x7fb23c06d8a0 2024-02-28T16:33:47.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.941+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb23c06d8a0 msgr2=0x7fb23c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.941+0000 7fb25be00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb23c06d8a0 0x7fb23c06fd50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb240006010 tx=0x7fb24000b540 comp rx=0 tx=0).stop 2024-02-28T16:33:47.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.941+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254106860 msgr2=0x7fb25419c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:47.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254106860 0x7fb25419c150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb24800b480 tx=0x7fb24800b840 comp rx=0 tx=0).stop 2024-02-28T16:33:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 shutdown_connections 2024-02-28T16:33:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb23c06d8a0 0x7fb23c06fd50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb254106860 0x7fb25419c150 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 --2- 172.21.15.23:0/2425364134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb254107a60 0x7fb25419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 >> 172.21.15.23:0/2425364134 conn(0x7fb2540758b0 msgr2=0x7fb25410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 shutdown_connections 2024-02-28T16:33:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:47.942+0000 7fb25be00700 1 -- 172.21.15.23:0/2425364134 wait complete. 2024-02-28T16:33:48.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.091+0000 7f3a25800700 1 -- 172.21.15.23:0/2169129064 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 msgr2=0x7f3a20073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.091+0000 7f3a25800700 1 --2- 172.21.15.23:0/2169129064 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a20073c20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009910 tx=0x7f3a0c009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:48.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.091+0000 7f3a25800700 1 -- 172.21.15.23:0/2169129064 shutdown_connections 2024-02-28T16:33:48.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.091+0000 7f3a25800700 1 --2- 172.21.15.23:0/2169129064 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a20073c20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.091+0000 7f3a25800700 1 --2- 172.21.15.23:0/2169129064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a20074d80 0x7f3a200731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.081 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.091+0000 7f3a25800700 1 -- 172.21.15.23:0/2169129064 >> 172.21.15.23:0/2169129064 conn(0x7f3a200fb7f0 msgr2=0x7f3a200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:48.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.091+0000 7f3a25800700 1 -- 172.21.15.23:0/2169129064 shutdown_connections 2024-02-28T16:33:48.082 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.092+0000 7f3a25800700 1 -- 172.21.15.23:0/2169129064 wait complete. 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.093+0000 7f3a25800700 1 Processor -- start 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.093+0000 7f3a25800700 1 -- start start 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a25800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a2019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a25800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a20074d80 0x7f3a2019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a25800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2019cbd0 con 0x7f3a200737b0 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a25800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2019cd10 con 0x7f3a20074d80 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a1ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a2019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a1ea00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a2019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37770/0 (socket says 172.21.15.23:37770) 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a1ea00700 1 -- 172.21.15.23:0/41907898 learned_addr learned my addr 172.21.15.23:0/41907898 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:48.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.094+0000 7f3a1e000700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a20074d80 0x7f3a2019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a1ea00700 1 -- 172.21.15.23:0/41907898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a20074d80 msgr2=0x7f3a2019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a1ea00700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a20074d80 0x7f3a2019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a1ea00700 1 -- 172.21.15.23:0/41907898 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0095f0 con 0x7f3a200737b0 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a1ea00700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a2019c070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c8a0 tx=0x7f3a1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a17400700 1 -- 172.21.15.23:0/41907898 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1000cea0 con 0x7f3a200737b0 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a17400700 1 -- 172.21.15.23:0/41907898 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a10004830 con 0x7f3a200737b0 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a17400700 1 -- 172.21.15.23:0/41907898 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a100055b0 con 0x7f3a200737b0 2024-02-28T16:33:48.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.095+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a201a17c0 con 0x7f3a200737b0 2024-02-28T16:33:48.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.096+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a201a1d10 con 0x7f3a200737b0 2024-02-28T16:33:48.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.097+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2010f380 con 0x7f3a200737b0 2024-02-28T16:33:48.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.098+0000 7f3a17400700 1 -- 172.21.15.23:0/41907898 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f3a10007ad0 con 0x7f3a200737b0 2024-02-28T16:33:48.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.098+0000 7f3a17400700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3a0406d8a0 0x7f3a0406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:48.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.099+0000 7f3a17400700 1 -- 172.21.15.23:0/41907898 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3a1008d2c0 con 0x7f3a200737b0 2024-02-28T16:33:48.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.099+0000 7f3a1e000700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3a0406d8a0 0x7f3a0406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:48.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.100+0000 7f3a1e000700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3a0406d8a0 0x7f3a0406fd50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c006010 tx=0x7f3a0c00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:48.092 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.104+0000 7f3a17400700 1 -- 172.21.15.23:0/41907898 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3a1005a4d0 con 0x7f3a200737b0 2024-02-28T16:33:48.335 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.346+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a201031e0 con 0x7f3a0406d8a0 2024-02-28T16:33:48.369 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.381+0000 7f3a17400700 1 -- 172.21.15.23:0/41907898 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f3a201031e0 con 0x7f3a0406d8a0 2024-02-28T16:33:48.370 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:33:48.370 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (18m) 10s ago 20m 14.5M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:33:48.370 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (25s) 10s ago 21m 7750k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 64317e9be9ba 2024-02-28T16:33:48.371 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (17s) 13s ago 19m 6962k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 942e64d3de96 2024-02-28T16:33:48.371 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (6m) 10s ago 20m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:33:48.371 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (6m) 13s ago 19m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:33:48.371 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (18m) 10s ago 20m 73.2M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:33:48.371 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (105s) 10s ago 13m 12.4M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:33:48.371 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (2m) 10s ago 13m 86.5M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:33:48.371 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (46s) 13s ago 13m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b4ff1f848efc 2024-02-28T16:33:48.372 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (74s) 13s ago 13m 12.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:33:48.372 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (10m) 10s ago 22m 510M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:33:48.372 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (8m) 13s ago 19m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:33:48.372 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (8m) 10s ago 22m 57.8M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:33:48.372 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (7m) 13s ago 19m 44.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:33:48.372 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (20m) 10s ago 20m 8404k - 1.5.0 0da6a335fe13 3ee24feacc6c 2024-02-28T16:33:48.373 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (19m) 13s ago 19m 8082k - 1.5.0 0da6a335fe13 da436d8df280 2024-02-28T16:33:48.373 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (5m) 10s ago 18m 99.8M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:33:48.373 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (5m) 10s ago 17m 113M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:33:48.373 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (4m) 10s ago 17m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:33:48.373 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (4m) 13s ago 16m 120M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:33:48.373 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (3m) 13s ago 15m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:33:48.373 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (2m) 13s ago 15m 95.2M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:33:48.374 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (8m) 10s ago 20m 63.4M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:33:48.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.384+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3a0406d8a0 msgr2=0x7f3a0406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.384+0000 7f3a25800700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3a0406d8a0 0x7f3a0406fd50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c006010 tx=0x7f3a0c00b540 comp rx=0 tx=0).stop 2024-02-28T16:33:48.375 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.384+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 msgr2=0x7f3a2019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.384+0000 7f3a25800700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a2019c070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c8a0 tx=0x7f3a1000cc60 comp rx=0 tx=0).stop 2024-02-28T16:33:48.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.385+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 shutdown_connections 2024-02-28T16:33:48.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.385+0000 7f3a25800700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3a0406d8a0 0x7f3a0406fd50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.385+0000 7f3a25800700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3a200737b0 0x7f3a2019c070 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.385+0000 7f3a25800700 1 --2- 172.21.15.23:0/41907898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a20074d80 0x7f3a2019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.385+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 >> 172.21.15.23:0/41907898 conn(0x7f3a200fb7f0 msgr2=0x7f3a20101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:48.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.385+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 shutdown_connections 2024-02-28T16:33:48.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.385+0000 7f3a25800700 1 -- 172.21.15.23:0/41907898 wait complete. 2024-02-28T16:33:48.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.550+0000 7fa8e8e00700 1 -- 172.21.15.23:0/1108275136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4100d70 msgr2=0x7fa8e4103150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.550+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/1108275136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4100d70 0x7fa8e4103150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009910 tx=0x7fa8d4009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:48.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.550+0000 7fa8e8e00700 1 -- 172.21.15.23:0/1108275136 shutdown_connections 2024-02-28T16:33:48.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.550+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/1108275136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8e4103690 0x7fa8e4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.550+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/1108275136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4100d70 0x7fa8e4103150 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.550+0000 7fa8e8e00700 1 -- 172.21.15.23:0/1108275136 >> 172.21.15.23:0/1108275136 conn(0x7fa8e40fa6d0 msgr2=0x7fa8e40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:48.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.551+0000 7fa8e8e00700 1 -- 172.21.15.23:0/1108275136 shutdown_connections 2024-02-28T16:33:48.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.551+0000 7fa8e8e00700 1 -- 172.21.15.23:0/1108275136 wait complete. 2024-02-28T16:33:48.540 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.552+0000 7fa8e8e00700 1 Processor -- start 2024-02-28T16:33:48.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.552+0000 7fa8e8e00700 1 -- start start 2024-02-28T16:33:48.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.552+0000 7fa8e8e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8e4100d70 0x7fa8e4197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:48.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.552+0000 7fa8e8e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4103690 0x7fa8e41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:48.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.552+0000 7fa8e8e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4198750 con 0x7fa8e4103690 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.552+0000 7fa8e8e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e41988c0 con 0x7fa8e4100d70 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.553+0000 7fa8e1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4103690 0x7fa8e41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.553+0000 7fa8e1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4103690 0x7fa8e41981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37792/0 (socket says 172.21.15.23:37792) 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.553+0000 7fa8e1400700 1 -- 172.21.15.23:0/3569055658 learned_addr learned my addr 172.21.15.23:0/3569055658 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.553+0000 7fa8e1e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8e4100d70 0x7fa8e4197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.553+0000 7fa8e1400700 1 -- 172.21.15.23:0/3569055658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8e4100d70 msgr2=0x7fa8e4197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.553+0000 7fa8e1400700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8e4100d70 0x7fa8e4197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.553+0000 7fa8e1400700 1 -- 172.21.15.23:0/3569055658 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40095f0 con 0x7fa8e4103690 2024-02-28T16:33:48.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.554+0000 7fa8e1400700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4103690 0x7fa8e41981e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c930 tx=0x7fa8d000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:48.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.554+0000 7fa8daa00700 1 -- 172.21.15.23:0/3569055658 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d0007ad0 con 0x7fa8e4103690 2024-02-28T16:33:48.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.554+0000 7fa8daa00700 1 -- 172.21.15.23:0/3569055658 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8d0007c30 con 0x7fa8e4103690 2024-02-28T16:33:48.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.554+0000 7fa8daa00700 1 -- 172.21.15.23:0/3569055658 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d0018630 con 0x7fa8e4103690 2024-02-28T16:33:48.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.554+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e419d360 con 0x7fa8e4103690 2024-02-28T16:33:48.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.554+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e419d810 con 0x7fa8e4103690 2024-02-28T16:33:48.544 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.556+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e40fc2b0 con 0x7fa8e4103690 2024-02-28T16:33:48.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.558+0000 7fa8daa00700 1 -- 172.21.15.23:0/3569055658 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa8d000f450 con 0x7fa8e4103690 2024-02-28T16:33:48.547 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.558+0000 7fa8daa00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8c806d8a0 0x7fa8c806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:48.547 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.559+0000 7fa8daa00700 1 -- 172.21.15.23:0/3569055658 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa8d008d7d0 con 0x7fa8e4103690 2024-02-28T16:33:48.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.559+0000 7fa8e1e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8c806d8a0 0x7fa8c806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:48.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.560+0000 7fa8e1e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8c806d8a0 0x7fa8c806fd50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4006010 tx=0x7fa8d400b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:48.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.564+0000 7fa8daa00700 1 -- 172.21.15.23:0/3569055658 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa8d0056ed0 con 0x7fa8e4103690 2024-02-28T16:33:48.882 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.894+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8e4061960 con 0x7fa8e4103690 2024-02-28T16:33:48.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.895+0000 7fa8daa00700 1 -- 172.21.15.23:0/3569055658 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa8d005a590 con 0x7fa8e4103690 2024-02-28T16:33:48.883 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:33:48.884 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:33:48.885 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:33:48.885 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:33:48.885 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:33:48.885 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:33:48.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.899+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8c806d8a0 msgr2=0x7fa8c806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.888 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.899+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8c806d8a0 0x7fa8c806fd50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4006010 tx=0x7fa8d400b540 comp rx=0 tx=0).stop 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.899+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4103690 msgr2=0x7fa8e41981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.899+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4103690 0x7fa8e41981e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c930 tx=0x7fa8d000ccf0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.900+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 shutdown_connections 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.900+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8e4100d70 0x7fa8e4197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.900+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa8c806d8a0 0x7fa8c806fd50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.900+0000 7fa8e8e00700 1 --2- 172.21.15.23:0/3569055658 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa8e4103690 0x7fa8e41981e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.900+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 >> 172.21.15.23:0/3569055658 conn(0x7fa8e40fa6d0 msgr2=0x7fa8e41042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.900+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 shutdown_connections 2024-02-28T16:33:48.889 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:48.900+0000 7fa8e8e00700 1 -- 172.21.15.23:0/3569055658 wait complete. 2024-02-28T16:33:48.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:48 smithi023 ceph-mon[78509]: pgmap v276: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:48.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:48 smithi023 ceph-mon[78509]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:48.923 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:48 smithi023 ceph-mon[78509]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:49.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 -- 172.21.15.23:0/3803270851 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 msgr2=0x7f0250100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.072 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 --2- 172.21.15.23:0/3803270851 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250100650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0244009910 tx=0x7f0244009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:49.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 -- 172.21.15.23:0/3803270851 shutdown_connections 2024-02-28T16:33:49.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 --2- 172.21.15.23:0/3803270851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0250101440 0x7f0250101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 --2- 172.21.15.23:0/3803270851 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250100650 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 -- 172.21.15.23:0/3803270851 >> 172.21.15.23:0/3803270851 conn(0x7f02500fb7f0 msgr2=0x7f02500fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:49.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 -- 172.21.15.23:0/3803270851 shutdown_connections 2024-02-28T16:33:49.073 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.083+0000 7f0258000700 1 -- 172.21.15.23:0/3803270851 wait complete. 2024-02-28T16:33:49.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.085+0000 7f0258000700 1 Processor -- start 2024-02-28T16:33:49.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.085+0000 7f0258000700 1 -- start start 2024-02-28T16:33:49.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.085+0000 7f0258000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:49.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.085+0000 7f0258000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0250101440 0x7f0250073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:49.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.085+0000 7f0258000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0250073680 con 0x7f0250100240 2024-02-28T16:33:49.074 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.085+0000 7f0258000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500737c0 con 0x7f0250101440 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.086+0000 7f0255600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.086+0000 7f0255600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:37818/0 (socket says 172.21.15.23:37818) 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.086+0000 7f0255600700 1 -- 172.21.15.23:0/2762589369 learned_addr learned my addr 172.21.15.23:0/2762589369 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.086+0000 7f0254c00700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0250101440 0x7f0250073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.086+0000 7f0255600700 1 -- 172.21.15.23:0/2762589369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0250101440 msgr2=0x7f0250073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.086+0000 7f0255600700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0250101440 0x7f0250073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.086+0000 7f0255600700 1 -- 172.21.15.23:0/2762589369 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02440095f0 con 0x7f0250100240 2024-02-28T16:33:49.075 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.087+0000 7f0255600700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250074af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f024400bd70 tx=0x7f024400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:49.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.087+0000 7f024e000700 1 -- 172.21.15.23:0/2762589369 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f024401d070 con 0x7f0250100240 2024-02-28T16:33:49.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.087+0000 7f024e000700 1 -- 172.21.15.23:0/2762589369 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f024400f460 con 0x7f0250100240 2024-02-28T16:33:49.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.087+0000 7f024e000700 1 -- 172.21.15.23:0/2762589369 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0244021640 con 0x7f0250100240 2024-02-28T16:33:49.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.087+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0250073a40 con 0x7f0250100240 2024-02-28T16:33:49.076 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.087+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0250073e90 con 0x7f0250100240 2024-02-28T16:33:49.077 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.089+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0250108d90 con 0x7f0250100240 2024-02-28T16:33:49.078 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.090+0000 7f024e000700 1 -- 172.21.15.23:0/2762589369 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f024400fab0 con 0x7f0250100240 2024-02-28T16:33:49.079 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.091+0000 7f024e000700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f023806d8a0 0x7f023806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:49.079 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.091+0000 7f024e000700 1 -- 172.21.15.23:0/2762589369 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f024408ea00 con 0x7f0250100240 2024-02-28T16:33:49.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.091+0000 7f0254c00700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f023806d8a0 0x7f023806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:49.080 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.092+0000 7f0254c00700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f023806d8a0 0x7f023806fd50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f023c005fd0 tx=0x7f023c00a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:49.084 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.096+0000 7f024e000700 1 -- 172.21.15.23:0/2762589369 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f024405bc30 con 0x7f0250100240 2024-02-28T16:33:49.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:48 smithi153 ceph-mon[66339]: pgmap v276: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:49.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:48 smithi153 ceph-mon[66339]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:49.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:48 smithi153 ceph-mon[66339]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:49.370 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.382+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0250108f80 con 0x7f0250100240 2024-02-28T16:33:49.371 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.383+0000 7f024e000700 1 -- 172.21.15.23:0/2762589369 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1873 (secure 0 0 0) 0x7f024405b7c0 con 0x7f0250100240 2024-02-28T16:33:49.372 INFO:teuthology.orchestra.run.smithi023.stdout:e36 2024-02-28T16:33:49.372 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:33:49.372 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 36 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:33:05.948811+0000 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:33:49.373 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 85 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=34420} 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:33:49.374 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{0:34420} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:49.375 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:44333} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:33:49.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.387+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f023806d8a0 msgr2=0x7f023806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.387+0000 7f0258000700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f023806d8a0 0x7f023806fd50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f023c005fd0 tx=0x7f023c00a560 comp rx=0 tx=0).stop 2024-02-28T16:33:49.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.387+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 msgr2=0x7f0250074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.387+0000 7f0258000700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250074af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f024400bd70 tx=0x7f024400be50 comp rx=0 tx=0).stop 2024-02-28T16:33:49.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.388+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 shutdown_connections 2024-02-28T16:33:49.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.388+0000 7f0258000700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f023806d8a0 0x7f023806fd50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.388+0000 7f0258000700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0250100240 0x7f0250074af0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.388+0000 7f0258000700 1 --2- 172.21.15.23:0/2762589369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0250101440 0x7f0250073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.388+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 >> 172.21.15.23:0/2762589369 conn(0x7f02500fb7f0 msgr2=0x7f0250104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:49.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.389+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 shutdown_connections 2024-02-28T16:33:49.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.389+0000 7f0258000700 1 -- 172.21.15.23:0/2762589369 wait complete. 2024-02-28T16:33:49.380 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 36 2024-02-28T16:33:49.559 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.570+0000 7f0f10c00700 1 -- 172.21.15.23:0/2819867113 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 msgr2=0x7f0f0c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.570+0000 7f0f10c00700 1 --2- 172.21.15.23:0/2819867113 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c100650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009910 tx=0x7f0efc009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:49.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.570+0000 7f0f10c00700 1 -- 172.21.15.23:0/2819867113 shutdown_connections 2024-02-28T16:33:49.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.570+0000 7f0f10c00700 1 --2- 172.21.15.23:0/2819867113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0c101440 0x7f0f0c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.570+0000 7f0f10c00700 1 --2- 172.21.15.23:0/2819867113 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c100650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.570+0000 7f0f10c00700 1 -- 172.21.15.23:0/2819867113 >> 172.21.15.23:0/2819867113 conn(0x7f0f0c0fb7f0 msgr2=0x7f0f0c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:49.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.571+0000 7f0f10c00700 1 -- 172.21.15.23:0/2819867113 shutdown_connections 2024-02-28T16:33:49.560 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.571+0000 7f0f10c00700 1 -- 172.21.15.23:0/2819867113 wait complete. 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.572+0000 7f0f10c00700 1 Processor -- start 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.572+0000 7f0f10c00700 1 -- start start 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.572+0000 7f0f10c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.572+0000 7f0f10c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0c101440 0x7f0f0c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.572+0000 7f0f10c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c073680 con 0x7f0f0c100240 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.572+0000 7f0f10c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0737c0 con 0x7f0f0c101440 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.573+0000 7f0f09e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.573+0000 7f0f09e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45106/0 (socket says 172.21.15.23:45106) 2024-02-28T16:33:49.561 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.573+0000 7f0f09e00700 1 -- 172.21.15.23:0/330464726 learned_addr learned my addr 172.21.15.23:0/330464726 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:49.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.573+0000 7f0f09400700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0c101440 0x7f0f0c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:49.562 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.573+0000 7f0f09e00700 1 -- 172.21.15.23:0/330464726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0c101440 msgr2=0x7f0f0c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.573+0000 7f0f09e00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0c101440 0x7f0f0c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.573+0000 7f0f09e00700 1 -- 172.21.15.23:0/330464726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0095f0 con 0x7f0f0c100240 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.574+0000 7f0f09e00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c074af0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00bda0 tx=0x7f0efc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.574+0000 7f0f02a00700 1 -- 172.21.15.23:0/330464726 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0efc01d070 con 0x7f0f0c100240 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.574+0000 7f0f02a00700 1 -- 172.21.15.23:0/330464726 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0efc004c50 con 0x7f0f0c100240 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.574+0000 7f0f02a00700 1 -- 172.21.15.23:0/330464726 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0efc00f690 con 0x7f0f0c100240 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.574+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c073a40 con 0x7f0f0c100240 2024-02-28T16:33:49.563 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.574+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c073f30 con 0x7f0f0c100240 2024-02-28T16:33:49.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.575+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c108d90 con 0x7f0f0c100240 2024-02-28T16:33:49.564 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.576+0000 7f0f02a00700 1 -- 172.21.15.23:0/330464726 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0efc0229b0 con 0x7f0f0c100240 2024-02-28T16:33:49.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.578+0000 7f0f02a00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0ef006d8a0 0x7f0ef006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:49.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.578+0000 7f0f02a00700 1 -- 172.21.15.23:0/330464726 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f0efc08ed90 con 0x7f0f0c100240 2024-02-28T16:33:49.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.578+0000 7f0f09400700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0ef006d8a0 0x7f0ef006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:49.567 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.579+0000 7f0f09400700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0ef006d8a0 0x7f0ef006fd50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8005fd0 tx=0x7f0ef800a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:49.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.583+0000 7f0f02a00700 1 -- 172.21.15.23:0/330464726 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0efc05bfa0 con 0x7f0f0c100240 2024-02-28T16:33:49.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.854+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f0c19e010 con 0x7f0ef006d8a0 2024-02-28T16:33:49.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.856+0000 7f0f02a00700 1 -- 172.21.15.23:0/330464726 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f0f0c19e010 con 0x7f0ef006d8a0 2024-02-28T16:33:49.844 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:33:49.844 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:33:49.844 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:33:49.844 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:33:49.844 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:33:49.844 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "mds", 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "osd", 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph-exporter" 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "18/23 daemons upgraded", 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:33:49.845 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0ef006d8a0 msgr2=0x7f0ef006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0ef006d8a0 0x7f0ef006fd50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8005fd0 tx=0x7f0ef800a560 comp rx=0 tx=0).stop 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 msgr2=0x7f0f0c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c074af0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00bda0 tx=0x7f0efc00be80 comp rx=0 tx=0).stop 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 shutdown_connections 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f0ef006d8a0 0x7f0ef006fd50 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8005fd0 tx=0x7f0ef800a560 comp rx=0 tx=0).stop 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0f0c100240 0x7f0f0c074af0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.849 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 --2- 172.21.15.23:0/330464726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0c101440 0x7f0f0c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:49.850 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 >> 172.21.15.23:0/330464726 conn(0x7f0f0c0fb7f0 msgr2=0x7f0f0c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:49.850 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.860+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 shutdown_connections 2024-02-28T16:33:49.850 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:49.861+0000 7f0f10c00700 1 -- 172.21.15.23:0/330464726 wait complete. 2024-02-28T16:33:49.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:49 smithi023 ceph-mon[78509]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:49.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:49 smithi023 ceph-mon[78509]: Upgrade: Updating node-exporter.smithi023 (1/2) 2024-02-28T16:33:49.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:49 smithi023 ceph-mon[78509]: Deploying daemon node-exporter.smithi023 on smithi023 2024-02-28T16:33:49.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:49 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3569055658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:49.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:49 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2762589369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 -- 172.21.15.23:0/3833499266 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc101440 msgr2=0x7fd6cc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/3833499266 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc101440 0x7fd6cc101890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009910 tx=0x7fd6b8009c20 comp rx=0 tx=0).stop 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 -- 172.21.15.23:0/3833499266 shutdown_connections 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/3833499266 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc101440 0x7fd6cc101890 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/3833499266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6cc100240 0x7fd6cc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 -- 172.21.15.23:0/3833499266 >> 172.21.15.23:0/3833499266 conn(0x7fd6cc0fb7f0 msgr2=0x7fd6cc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 -- 172.21.15.23:0/3833499266 shutdown_connections 2024-02-28T16:33:50.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.046+0000 7fd6d2c00700 1 -- 172.21.15.23:0/3833499266 wait complete. 2024-02-28T16:33:50.036 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.047+0000 7fd6d2c00700 1 Processor -- start 2024-02-28T16:33:50.036 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6d2c00700 1 -- start start 2024-02-28T16:33:50.036 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6d2c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc100240 0x7fd6cc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6d2c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6cc101440 0x7fd6cc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6d2c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc073680 con 0x7fd6cc100240 2024-02-28T16:33:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6d2c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0737c0 con 0x7fd6cc101440 2024-02-28T16:33:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6cbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc100240 0x7fd6cc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6cbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc100240 0x7fd6cc074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:45132/0 (socket says 172.21.15.23:45132) 2024-02-28T16:33:50.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.048+0000 7fd6cbe00700 1 -- 172.21.15.23:0/2046744170 learned_addr learned my addr 172.21.15.23:0/2046744170 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:33:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6cb400700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6cc101440 0x7fd6cc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6cbe00700 1 -- 172.21.15.23:0/2046744170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6cc101440 msgr2=0x7fd6cc073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6cbe00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6cc101440 0x7fd6cc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6cbe00700 1 -- 172.21.15.23:0/2046744170 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b80095f0 con 0x7fd6cc100240 2024-02-28T16:33:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6cbe00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc100240 0x7fd6cc074af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00b480 tx=0x7fd6bc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6c8c00700 1 -- 172.21.15.23:0/2046744170 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6bc0118c0 con 0x7fd6cc100240 2024-02-28T16:33:50.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6c8c00700 1 -- 172.21.15.23:0/2046744170 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6bc010380 con 0x7fd6cc100240 2024-02-28T16:33:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6c8c00700 1 -- 172.21.15.23:0/2046744170 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6bc00f4f0 con 0x7fd6cc100240 2024-02-28T16:33:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.049+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc073aa0 con 0x7fd6cc100240 2024-02-28T16:33:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.050+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc19dbb0 con 0x7fd6cc100240 2024-02-28T16:33:50.039 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.051+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc108e30 con 0x7fd6cc100240 2024-02-28T16:33:50.040 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.052+0000 7fd6c8c00700 1 -- 172.21.15.23:0/2046744170 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd6bc0104f0 con 0x7fd6cc100240 2024-02-28T16:33:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.053+0000 7fd6c8c00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd6b006d8a0 0x7fd6b006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.053+0000 7fd6c8c00700 1 -- 172.21.15.23:0/2046744170 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd6bc08d1c0 con 0x7fd6cc100240 2024-02-28T16:33:50.041 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.053+0000 7fd6cb400700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd6b006d8a0 0x7fd6b006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:50.042 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.054+0000 7fd6cb400700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd6b006d8a0 0x7fd6b006fd50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8000c00 tx=0x7fd6b8005fb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:50.046 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.057+0000 7fd6c8c00700 1 -- 172.21.15.23:0/2046744170 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd6bc05a470 con 0x7fd6cc100240 2024-02-28T16:33:50.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:49 smithi153 ceph-mon[66339]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:50.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:49 smithi153 ceph-mon[66339]: Upgrade: Updating node-exporter.smithi023 (1/2) 2024-02-28T16:33:50.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:49 smithi153 ceph-mon[66339]: Deploying daemon node-exporter.smithi023 on smithi023 2024-02-28T16:33:50.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:49 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3569055658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:50.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:49 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2762589369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:50.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.383+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd6cc19e420 con 0x7fd6cc100240 2024-02-28T16:33:50.372 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.384+0000 7fd6c8c00700 1 -- 172.21.15.23:0/2046744170 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd6bc05a000 con 0x7fd6cc100240 2024-02-28T16:33:50.373 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:33:50.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd6b006d8a0 msgr2=0x7fd6b006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:50.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd6b006d8a0 0x7fd6b006fd50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8000c00 tx=0x7fd6b8005fb0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.376 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc100240 msgr2=0x7fd6cc074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:50.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc100240 0x7fd6cc074af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00b480 tx=0x7fd6bc00b840 comp rx=0 tx=0).stop 2024-02-28T16:33:50.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 shutdown_connections 2024-02-28T16:33:50.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd6b006d8a0 0x7fd6b006fd50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd6cc100240 0x7fd6cc074af0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 --2- 172.21.15.23:0/2046744170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6cc101440 0x7fd6cc073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.387+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 >> 172.21.15.23:0/2046744170 conn(0x7fd6cc0fb7f0 msgr2=0x7fd6cc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:50.377 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.388+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 shutdown_connections 2024-02-28T16:33:50.378 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:33:50.388+0000 7fd6d2c00700 1 -- 172.21.15.23:0/2046744170 wait complete. 2024-02-28T16:33:50.866 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:50 smithi023 ceph-mon[78509]: pgmap v277: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:50.866 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:50 smithi023 ceph-mon[78509]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:50.867 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:50 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2046744170' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:51.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:50 smithi153 ceph-mon[66339]: pgmap v277: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:51.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:50 smithi153 ceph-mon[66339]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:51.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:50 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2046744170' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:51.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:52.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:53.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:52 smithi153 ceph-mon[66339]: pgmap v278: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:53.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:53.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:53.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:52 smithi023 ceph-mon[78509]: pgmap v278: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:53.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:53.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:33:54.798 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:54 smithi153 ceph-mon[66339]: pgmap v279: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:55.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:54 smithi023 ceph-mon[78509]: pgmap v279: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:55.959 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:55 smithi153 ceph-mon[66339]: Upgrade: Updating node-exporter.smithi153 (2/2) 2024-02-28T16:33:55.959 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:55 smithi153 ceph-mon[66339]: Deploying daemon node-exporter.smithi153 on smithi153 2024-02-28T16:33:56.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:55 smithi023 ceph-mon[78509]: Upgrade: Updating node-exporter.smithi153 (2/2) 2024-02-28T16:33:56.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:55 smithi023 ceph-mon[78509]: Deploying daemon node-exporter.smithi153 on smithi153 2024-02-28T16:33:56.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:56 smithi153 ceph-mon[66339]: pgmap v280: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:57.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:56 smithi023 ceph-mon[78509]: pgmap v280: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:59.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:58 smithi153 ceph-mon[66339]: pgmap v281: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:33:59.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:58 smithi023 ceph-mon[78509]: pgmap v281: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:00.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:59 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:00.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:59 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:00.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:33:59 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:00.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:59 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:00.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:59 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:00.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:33:59 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:01.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:00 smithi153 ceph-mon[66339]: pgmap v282: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:01.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:00 smithi023 ceph-mon[78509]: pgmap v282: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:03.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:02 smithi153 ceph-mon[66339]: pgmap v283: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:03.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:02 smithi023 ceph-mon[78509]: pgmap v283: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:04.147 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:04.148 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:03 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:04.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:04.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:03 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:05.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:05 smithi023 ceph-mon[78509]: pgmap v284: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:05.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:05 smithi153 ceph-mon[66339]: pgmap v284: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:06.248 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:06.249 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:06.249 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:06.249 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:06.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:06.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:06.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:06.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:07 smithi153 ceph-mon[66339]: pgmap v285: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:07.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:07.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:07 smithi023 ceph-mon[78509]: pgmap v285: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:07.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:09.285 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:08 smithi023 ceph-mon[78509]: pgmap v286: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:09.285 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:09.285 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:08 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:09.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:08 smithi153 ceph-mon[66339]: pgmap v286: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:09.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:08 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:09.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:08 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:11.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:10 smithi023 ceph-mon[78509]: pgmap v287: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:11.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:11.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:10 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:11.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:10 smithi153 ceph-mon[66339]: pgmap v287: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:11.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:11.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:10 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:13.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:12 smithi023 ceph-mon[78509]: pgmap v288: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:13.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:12 smithi153 ceph-mon[66339]: pgmap v288: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: pgmap v289: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:15.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:14 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: pgmap v289: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:15.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:15.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:15.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:14 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:17.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:16 smithi153 ceph-mon[66339]: pgmap v290: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:17.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:16 smithi023 ceph-mon[78509]: pgmap v290: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:18.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:17 smithi153 ceph-mon[66339]: Upgrade: Updating prometheus.smithi023 2024-02-28T16:34:18.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:17 smithi153 ceph-mon[66339]: Deploying daemon prometheus.smithi023 on smithi023 2024-02-28T16:34:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:17 smithi023 ceph-mon[78509]: Upgrade: Updating prometheus.smithi023 2024-02-28T16:34:18.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:17 smithi023 ceph-mon[78509]: Deploying daemon prometheus.smithi023 on smithi023 2024-02-28T16:34:19.143 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:18 smithi023 ceph-mon[78509]: pgmap v291: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:19.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:18 smithi153 ceph-mon[66339]: pgmap v291: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 -- 172.21.15.23:0/1253545007 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 msgr2=0x7f49f01078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 --2- 172.21.15.23:0/1253545007 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f01078f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009910 tx=0x7f49dc009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 -- 172.21.15.23:0/1253545007 shutdown_connections 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 --2- 172.21.15.23:0/1253545007 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f01078f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 --2- 172.21.15.23:0/1253545007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0069b00 0x7f49f0104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 -- 172.21.15.23:0/1253545007 >> 172.21.15.23:0/1253545007 conn(0x7f49f00fa5a0 msgr2=0x7f49f00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 -- 172.21.15.23:0/1253545007 shutdown_connections 2024-02-28T16:34:20.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.560+0000 7f49f5400700 1 -- 172.21.15.23:0/1253545007 wait complete. 2024-02-28T16:34:20.550 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.561+0000 7f49f5400700 1 Processor -- start 2024-02-28T16:34:20.550 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49f5400700 1 -- start start 2024-02-28T16:34:20.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49f5400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f0197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:20.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49f5400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0197fe0 0x7f49f019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:20.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49f5400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f01984e0 con 0x7f49f0105510 2024-02-28T16:34:20.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49f5400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0198650 con 0x7f49f0197fe0 2024-02-28T16:34:20.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49efe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f0197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:20.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49efe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f0197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57634/0 (socket says 172.21.15.23:57634) 2024-02-28T16:34:20.551 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.562+0000 7f49efe00700 1 -- 172.21.15.23:0/787220808 learned_addr learned my addr 172.21.15.23:0/787220808 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.563+0000 7f49ef400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0197fe0 0x7f49f019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.563+0000 7f49efe00700 1 -- 172.21.15.23:0/787220808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0197fe0 msgr2=0x7f49f019d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.563+0000 7f49efe00700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0197fe0 0x7f49f019d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.563+0000 7f49efe00700 1 -- 172.21.15.23:0/787220808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0095f0 con 0x7f49f0105510 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.563+0000 7f49efe00700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f0197aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49e000d900 tx=0x7f49e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.563+0000 7f49ecc00700 1 -- 172.21.15.23:0/787220808 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e0009900 con 0x7f49f0105510 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.564+0000 7f49ecc00700 1 -- 172.21.15.23:0/787220808 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49e0010460 con 0x7f49f0105510 2024-02-28T16:34:20.552 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.564+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f019d5f0 con 0x7f49f0105510 2024-02-28T16:34:20.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.564+0000 7f49ecc00700 1 -- 172.21.15.23:0/787220808 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e000f5f0 con 0x7f49f0105510 2024-02-28T16:34:20.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.564+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f019db10 con 0x7f49f0105510 2024-02-28T16:34:20.553 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.565+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0191bf0 con 0x7f49f0105510 2024-02-28T16:34:20.554 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.566+0000 7f49ecc00700 1 -- 172.21.15.23:0/787220808 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f49e000fa80 con 0x7f49f0105510 2024-02-28T16:34:20.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.567+0000 7f49ecc00700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49d406d8a0 0x7f49d406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:20.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.567+0000 7f49ecc00700 1 -- 172.21.15.23:0/787220808 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f49e008d4e0 con 0x7f49f0105510 2024-02-28T16:34:20.555 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.567+0000 7f49ef400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49d406d8a0 0x7f49d406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:20.556 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.568+0000 7f49ef400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49d406d8a0 0x7f49d406fd50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006010 tx=0x7f49dc00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:20.565 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.577+0000 7f49ecc00700 1 -- 172.21.15.23:0/787220808 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f49e005a670 con 0x7f49f0105510 2024-02-28T16:34:20.825 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.836+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f002ce80 con 0x7f49d406d8a0 2024-02-28T16:34:20.826 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.838+0000 7f49ecc00700 1 -- 172.21.15.23:0/787220808 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f49f002ce80 con 0x7f49d406d8a0 2024-02-28T16:34:20.829 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49d406d8a0 msgr2=0x7f49d406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:20.829 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49d406d8a0 0x7f49d406fd50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006010 tx=0x7f49dc00b540 comp rx=0 tx=0).stop 2024-02-28T16:34:20.829 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 msgr2=0x7f49f0197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:20.829 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f0197aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49e000d900 tx=0x7f49e000dcc0 comp rx=0 tx=0).stop 2024-02-28T16:34:20.829 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 shutdown_connections 2024-02-28T16:34:20.829 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f49d406d8a0 0x7f49d406fd50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:20.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f49f0105510 0x7f49f0197aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:20.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 --2- 172.21.15.23:0/787220808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f0197fe0 0x7f49f019d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:20.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 >> 172.21.15.23:0/787220808 conn(0x7f49f00fa5a0 msgr2=0x7f49f00fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:20.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 shutdown_connections 2024-02-28T16:34:20.830 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:20.841+0000 7f49f5400700 1 -- 172.21.15.23:0/787220808 wait complete. 2024-02-28T16:34:20.845 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:34:21.009 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.020+0000 7fe9c6600700 1 -- 172.21.15.23:0/836584292 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 msgr2=0x7fe9c0103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.009 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.020+0000 7fe9c6600700 1 --2- 172.21.15.23:0/836584292 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0103140 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009910 tx=0x7fe9b0009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:21.009 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.021+0000 7fe9c6600700 1 -- 172.21.15.23:0/836584292 shutdown_connections 2024-02-28T16:34:21.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.021+0000 7fe9c6600700 1 --2- 172.21.15.23:0/836584292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c0103680 0x7fe9c0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.021+0000 7fe9c6600700 1 --2- 172.21.15.23:0/836584292 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0103140 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.021+0000 7fe9c6600700 1 -- 172.21.15.23:0/836584292 >> 172.21.15.23:0/836584292 conn(0x7fe9c00fa780 msgr2=0x7fe9c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:21.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.021+0000 7fe9c6600700 1 -- 172.21.15.23:0/836584292 shutdown_connections 2024-02-28T16:34:21.010 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.021+0000 7fe9c6600700 1 -- 172.21.15.23:0/836584292 wait complete. 2024-02-28T16:34:21.010 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:20 smithi023 ceph-mon[78509]: pgmap v292: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.022+0000 7fe9c6600700 1 Processor -- start 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.022+0000 7fe9c6600700 1 -- start start 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9c6600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9c6600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c0103680 0x7fe9c0195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9c6600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0196610 con 0x7fe9c0100d60 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9c6600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0196750 con 0x7fe9c0103680 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9bf400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9bf400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57650/0 (socket says 172.21.15.23:57650) 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9bf400700 1 -- 172.21.15.23:0/1964200384 learned_addr learned my addr 172.21.15.23:0/1964200384 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.023+0000 7fe9bea00700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c0103680 0x7fe9c0195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.012 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9bf400700 1 -- 172.21.15.23:0/1964200384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c0103680 msgr2=0x7fe9c0195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9bf400700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c0103680 0x7fe9c0195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9bf400700 1 -- 172.21.15.23:0/1964200384 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00095f0 con 0x7fe9c0100d60 2024-02-28T16:34:21.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9bea00700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c0103680 0x7fe9c0195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:34:21.013 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9bf400700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0195ab0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000bd70 tx=0x7fe9b000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:21.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9b7e00700 1 -- 172.21.15.23:0/1964200384 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b001d070 con 0x7fe9c0100d60 2024-02-28T16:34:21.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9b7e00700 1 -- 172.21.15.23:0/1964200384 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9b000f460 con 0x7fe9c0100d60 2024-02-28T16:34:21.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c019b1a0 con 0x7fe9c0100d60 2024-02-28T16:34:21.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.024+0000 7fe9b7e00700 1 -- 172.21.15.23:0/1964200384 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b0021620 con 0x7fe9c0100d60 2024-02-28T16:34:21.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.025+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c019b690 con 0x7fe9c0100d60 2024-02-28T16:34:21.014 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.026+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c018fbc0 con 0x7fe9c0100d60 2024-02-28T16:34:21.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.027+0000 7fe9b7e00700 1 -- 172.21.15.23:0/1964200384 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe9b000fa40 con 0x7fe9c0100d60 2024-02-28T16:34:21.016 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.028+0000 7fe9b7e00700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe9a406d8a0 0x7fe9a406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.029+0000 7fe9b7e00700 1 -- 172.21.15.23:0/1964200384 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe9b008e810 con 0x7fe9c0100d60 2024-02-28T16:34:21.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.029+0000 7fe9bea00700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe9a406d8a0 0x7fe9a406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.030+0000 7fe9bea00700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe9a406d8a0 0x7fe9a406fd50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac005fd0 tx=0x7fe9ac005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:21.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.033+0000 7fe9b7e00700 1 -- 172.21.15.23:0/1964200384 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe9b005ba60 con 0x7fe9c0100d60 2024-02-28T16:34:21.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:20 smithi153 ceph-mon[66339]: pgmap v292: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:21.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.284+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9c0061190 con 0x7fe9a406d8a0 2024-02-28T16:34:21.276 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.287+0000 7fe9b7e00700 1 -- 172.21.15.23:0/1964200384 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fe9c0061190 con 0x7fe9a406d8a0 2024-02-28T16:34:21.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.290+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe9a406d8a0 msgr2=0x7fe9a406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.290+0000 7fe9c6600700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe9a406d8a0 0x7fe9a406fd50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac005fd0 tx=0x7fe9ac005ee0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.290+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 msgr2=0x7fe9c0195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.290+0000 7fe9c6600700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0195ab0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000bd70 tx=0x7fe9b000be50 comp rx=0 tx=0).stop 2024-02-28T16:34:21.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.291+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 shutdown_connections 2024-02-28T16:34:21.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.291+0000 7fe9c6600700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe9a406d8a0 0x7fe9a406fd50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.279 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.291+0000 7fe9c6600700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe9c0100d60 0x7fe9c0195ab0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.291+0000 7fe9c6600700 1 --2- 172.21.15.23:0/1964200384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c0103680 0x7fe9c0195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.291+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 >> 172.21.15.23:0/1964200384 conn(0x7fe9c00fa780 msgr2=0x7fe9c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:21.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.291+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 shutdown_connections 2024-02-28T16:34:21.280 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.291+0000 7fe9c6600700 1 -- 172.21.15.23:0/1964200384 wait complete. 2024-02-28T16:34:21.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 -- 172.21.15.23:0/1487304314 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 msgr2=0x7f1680105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 --2- 172.21.15.23:0/1487304314 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f1680105840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f166c009910 tx=0x7f166c009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:21.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 -- 172.21.15.23:0/1487304314 shutdown_connections 2024-02-28T16:34:21.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 --2- 172.21.15.23:0/1487304314 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f1680105840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 --2- 172.21.15.23:0/1487304314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1680100b40 0x7f1680102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 -- 172.21.15.23:0/1487304314 >> 172.21.15.23:0/1487304314 conn(0x7f16800fa500 msgr2=0x7f16800fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:21.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 -- 172.21.15.23:0/1487304314 shutdown_connections 2024-02-28T16:34:21.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.450+0000 7f167f200700 1 -- 172.21.15.23:0/1487304314 wait complete. 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.451+0000 7f167f200700 1 Processor -- start 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.451+0000 7f167f200700 1 -- start start 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167f200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1680100b40 0x7f16801004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167f200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f16800feaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167f200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800ff030 con 0x7f1680103460 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167f200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800ff170 con 0x7f1680100b40 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f16800feaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f16800feaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57664/0 (socket says 172.21.15.23:57664) 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167d400700 1 -- 172.21.15.23:0/2394910070 learned_addr learned my addr 172.21.15.23:0/2394910070 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.452+0000 7f167de00700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1680100b40 0x7f16801004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f167d400700 1 -- 172.21.15.23:0/2394910070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1680100b40 msgr2=0x7f16801004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f167d400700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1680100b40 0x7f16801004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f167d400700 1 -- 172.21.15.23:0/2394910070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0095f0 con 0x7f1680103460 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f167de00700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1680100b40 0x7f16801004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f167d400700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f16800feaf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f166c005b40 tx=0x7f166c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f1676a00700 1 -- 172.21.15.23:0/2394910070 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166c01d070 con 0x7f1680103460 2024-02-28T16:34:21.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f1676a00700 1 -- 172.21.15.23:0/2394910070 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f166c022470 con 0x7f1680103460 2024-02-28T16:34:21.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16800ff3f0 con 0x7f1680103460 2024-02-28T16:34:21.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.453+0000 7f1676a00700 1 -- 172.21.15.23:0/2394910070 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166c00f690 con 0x7f1680103460 2024-02-28T16:34:21.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.454+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16800ff8e0 con 0x7f1680103460 2024-02-28T16:34:21.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.455+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168018faf0 con 0x7f1680103460 2024-02-28T16:34:21.444 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.456+0000 7f1676a00700 1 -- 172.21.15.23:0/2394910070 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f166c0225e0 con 0x7f1680103460 2024-02-28T16:34:21.445 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.457+0000 7f1676a00700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166406d8a0 0x7f166406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.458+0000 7f1676a00700 1 -- 172.21.15.23:0/2394910070 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f166c08ee20 con 0x7f1680103460 2024-02-28T16:34:21.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.458+0000 7f167de00700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166406d8a0 0x7f166406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.447 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.459+0000 7f167de00700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166406d8a0 0x7f166406fd50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1670007900 tx=0x7f1670008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:21.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.462+0000 7f1676a00700 1 -- 172.21.15.23:0/2394910070 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f166c05c0b0 con 0x7f1680103460 2024-02-28T16:34:21.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.724+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1680061190 con 0x7f166406d8a0 2024-02-28T16:34:21.729 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.740+0000 7f1676a00700 1 -- 172.21.15.23:0/2394910070 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1680061190 con 0x7f166406d8a0 2024-02-28T16:34:21.729 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:34:21.729 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (19m) 15s ago 21m 14.5M - 0.25.0 c8568f914cd2 0539ce5e0b8c 2024-02-28T16:34:21.729 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (58s) 15s ago 21m 7894k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 64317e9be9ba 2024-02-28T16:34:21.729 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (51s) 18s ago 20m 7583k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 942e64d3de96 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (6m) 15s ago 21m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (6m) 18s ago 20m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (19m) 15s ago 20m 73.2M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (2m) 15s ago 13m 12.6M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (2m) 15s ago 14m 86.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (79s) 18s ago 13m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b4ff1f848efc 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (108s) 18s ago 14m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (10m) 15s ago 22m 510M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (9m) 18s ago 19m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (8m) 15s ago 23m 59.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (8m) 18s ago 19m 45.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (29s) 15s ago 21m 2679k - 1.5.0 0da6a335fe13 5ea0d01203ff 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (23s) 18s ago 20m 2902k - 1.5.0 0da6a335fe13 d4b7c7fb1fb7 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (6m) 15s ago 18m 101M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:34:21.730 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (5m) 15s ago 18m 113M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:34:21.731 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (5m) 15s ago 17m 101M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:34:21.731 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (4m) 18s ago 17m 120M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:34:21.731 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (3m) 18s ago 16m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:34:21.731 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (3m) 18s ago 15m 95.3M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:34:21.731 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (9m) 15s ago 20m 64.2M - 2.43.0 a07b618ecd1d d67c677ea7a2 2024-02-28T16:34:21.731 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166406d8a0 msgr2=0x7f166406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.731 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166406d8a0 0x7f166406fd50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1670007900 tx=0x7f1670008040 comp rx=0 tx=0).stop 2024-02-28T16:34:21.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 msgr2=0x7f16800feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f16800feaf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f166c005b40 tx=0x7f166c00be20 comp rx=0 tx=0).stop 2024-02-28T16:34:21.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 shutdown_connections 2024-02-28T16:34:21.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1680100b40 0x7f16801004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f166406d8a0 0x7f166406fd50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 --2- 172.21.15.23:0/2394910070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1680103460 0x7f16800feaf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.732 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.743+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 >> 172.21.15.23:0/2394910070 conn(0x7f16800fa500 msgr2=0x7f16800fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:21.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.744+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 shutdown_connections 2024-02-28T16:34:21.733 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.744+0000 7f167f200700 1 -- 172.21.15.23:0/2394910070 wait complete. 2024-02-28T16:34:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 -- 172.21.15.23:0/3152943121 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 msgr2=0x7f212c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 --2- 172.21.15.23:0/3152943121 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c100650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f211c009910 tx=0x7f211c009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 -- 172.21.15.23:0/3152943121 shutdown_connections 2024-02-28T16:34:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 --2- 172.21.15.23:0/3152943121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f212c101440 0x7f212c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 --2- 172.21.15.23:0/3152943121 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c100650 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 -- 172.21.15.23:0/3152943121 >> 172.21.15.23:0/3152943121 conn(0x7f212c0fb7f0 msgr2=0x7f212c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:21.895 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 -- 172.21.15.23:0/3152943121 shutdown_connections 2024-02-28T16:34:21.896 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.906+0000 7f2131e00700 1 -- 172.21.15.23:0/3152943121 wait complete. 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.907+0000 7f2131e00700 1 Processor -- start 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f2131e00700 1 -- start start 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f2131e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f2131e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f212c101440 0x7f212c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f2131e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c073680 con 0x7f212c100240 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f2131e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0737c0 con 0x7f212c101440 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f212aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f212aa00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57696/0 (socket says 172.21.15.23:57696) 2024-02-28T16:34:21.897 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.908+0000 7f212aa00700 1 -- 172.21.15.23:0/2780149494 learned_addr learned my addr 172.21.15.23:0/2780149494 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:21.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.909+0000 7f212aa00700 1 -- 172.21.15.23:0/2780149494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f212c101440 msgr2=0x7f212c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:21.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.909+0000 7f212aa00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f212c101440 0x7f212c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:21.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.909+0000 7f212aa00700 1 -- 172.21.15.23:0/2780149494 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0095f0 con 0x7f212c100240 2024-02-28T16:34:21.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.909+0000 7f212aa00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c074af0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f211c00bd70 tx=0x7f211c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:21.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.909+0000 7f2130a00700 1 -- 172.21.15.23:0/2780149494 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f211c01d070 con 0x7f212c100240 2024-02-28T16:34:21.898 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.910+0000 7f2130a00700 1 -- 172.21.15.23:0/2780149494 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f211c00f460 con 0x7f212c100240 2024-02-28T16:34:21.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.910+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c073a40 con 0x7f212c100240 2024-02-28T16:34:21.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.910+0000 7f2130a00700 1 -- 172.21.15.23:0/2780149494 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f211c021620 con 0x7f212c100240 2024-02-28T16:34:21.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.910+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c073f30 con 0x7f212c100240 2024-02-28T16:34:21.899 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.911+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c108d90 con 0x7f212c100240 2024-02-28T16:34:21.900 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.912+0000 7f2130a00700 1 -- 172.21.15.23:0/2780149494 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f211c00fa40 con 0x7f212c100240 2024-02-28T16:34:21.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.913+0000 7f2130a00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f211006d8a0 0x7f211006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:21.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.913+0000 7f2130a00700 1 -- 172.21.15.23:0/2780149494 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f211c08e8d0 con 0x7f212c100240 2024-02-28T16:34:21.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.913+0000 7f212a000700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f211006d8a0 0x7f211006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:21.902 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.914+0000 7f212a000700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f211006d8a0 0x7f211006fd50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2118005950 tx=0x7f21180058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:21.906 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:21.918+0000 7f2130a00700 1 -- 172.21.15.23:0/2780149494 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f211c05bb00 con 0x7f212c100240 2024-02-28T16:34:21.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:21 smithi023 ceph-mon[78509]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:21.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:22.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:21 smithi153 ceph-mon[66339]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:22.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:22.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.255+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f212c19df30 con 0x7f212c100240 2024-02-28T16:34:22.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.256+0000 7f2130a00700 1 -- 172.21.15.23:0/2780149494 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f211c05b690 con 0x7f212c100240 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:34:22.245 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:34:22.246 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:34:22.246 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:34:22.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f211006d8a0 msgr2=0x7f211006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f211006d8a0 0x7f211006fd50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2118005950 tx=0x7f21180058e0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 msgr2=0x7f212c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c074af0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f211c00bd70 tx=0x7f211c00be50 comp rx=0 tx=0).stop 2024-02-28T16:34:22.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 shutdown_connections 2024-02-28T16:34:22.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f211006d8a0 0x7f211006fd50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f212c100240 0x7f212c074af0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 --2- 172.21.15.23:0/2780149494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f212c101440 0x7f212c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 >> 172.21.15.23:0/2780149494 conn(0x7f212c0fb7f0 msgr2=0x7f212c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:22.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 shutdown_connections 2024-02-28T16:34:22.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.259+0000 7f2131e00700 1 -- 172.21.15.23:0/2780149494 wait complete. 2024-02-28T16:34:22.400 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 -- 172.21.15.23:0/3957359374 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 msgr2=0x7fbcd4100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3957359374 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4100430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009910 tx=0x7fbcc4009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:22.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 -- 172.21.15.23:0/3957359374 shutdown_connections 2024-02-28T16:34:22.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3957359374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd41012c0 0x7fbcd4101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3957359374 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4100430 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 -- 172.21.15.23:0/3957359374 >> 172.21.15.23:0/3957359374 conn(0x7fbcd40fb650 msgr2=0x7fbcd40fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:22.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 -- 172.21.15.23:0/3957359374 shutdown_connections 2024-02-28T16:34:22.401 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.412+0000 7fbcd3200700 1 -- 172.21.15.23:0/3957359374 wait complete. 2024-02-28T16:34:22.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.413+0000 7fbcd3200700 1 Processor -- start 2024-02-28T16:34:22.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.413+0000 7fbcd3200700 1 -- start start 2024-02-28T16:34:22.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd3200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:22.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd3200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd41012c0 0x7fbcd4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:22.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd3200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd4198600 con 0x7fbcd4100020 2024-02-28T16:34:22.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd3200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd4198740 con 0x7fbcd41012c0 2024-02-28T16:34:22.402 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd1e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:22.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd1e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57712/0 (socket says 172.21.15.23:57712) 2024-02-28T16:34:22.403 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd1e00700 1 -- 172.21.15.23:0/3887769414 learned_addr learned my addr 172.21.15.23:0/3887769414 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd1400700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd41012c0 0x7fbcd4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd1e00700 1 -- 172.21.15.23:0/3887769414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd41012c0 msgr2=0x7fbcd4197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd1e00700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd41012c0 0x7fbcd4197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.414+0000 7fbcd1e00700 1 -- 172.21.15.23:0/3887769414 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40095f0 con 0x7fbcd4100020 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.415+0000 7fbcd1e00700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4197aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400b5c0 tx=0x7fbcc400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.415+0000 7fbccaa00700 1 -- 172.21.15.23:0/3887769414 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc401d070 con 0x7fbcd4100020 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.415+0000 7fbccaa00700 1 -- 172.21.15.23:0/3887769414 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbcc4022470 con 0x7fbcd4100020 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.415+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd419d190 con 0x7fbcd4100020 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.415+0000 7fbccaa00700 1 -- 172.21.15.23:0/3887769414 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc400f690 con 0x7fbcd4100020 2024-02-28T16:34:22.404 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.415+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd419d700 con 0x7fbcd4100020 2024-02-28T16:34:22.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.416+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd41053a0 con 0x7fbcd4100020 2024-02-28T16:34:22.405 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.417+0000 7fbccaa00700 1 -- 172.21.15.23:0/3887769414 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbcc4004b70 con 0x7fbcd4100020 2024-02-28T16:34:22.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.418+0000 7fbccaa00700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcb806d8a0 0x7fbcb806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:22.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.418+0000 7fbccaa00700 1 -- 172.21.15.23:0/3887769414 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbcc408edf0 con 0x7fbcd4100020 2024-02-28T16:34:22.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.419+0000 7fbcd1400700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcb806d8a0 0x7fbcb806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:22.407 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.419+0000 7fbcd1400700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcb806d8a0 0x7fbcb806fd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0006fd0 tx=0x7fbcc0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:22.411 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.423+0000 7fbccaa00700 1 -- 172.21.15.23:0/3887769414 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbcc405c150 con 0x7fbcd4100020 2024-02-28T16:34:22.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.712+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbcd402cc30 con 0x7fbcd4100020 2024-02-28T16:34:22.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.713+0000 7fbccaa00700 1 -- 172.21.15.23:0/3887769414 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1873 (secure 0 0 0) 0x7fbcc4027770 con 0x7fbcd4100020 2024-02-28T16:34:22.701 INFO:teuthology.orchestra.run.smithi023.stdout:e36 2024-02-28T16:34:22.701 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:34:22.701 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 36 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:33:05.948811+0000 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:34:22.702 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 85 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=34420} 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:34:22.703 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{0:34420} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:22.704 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:22.704 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:22.704 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:34:22.704 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:22.704 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:22.704 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:22.704 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:44333} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcb806d8a0 msgr2=0x7fbcb806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcb806d8a0 0x7fbcb806fd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0006fd0 tx=0x7fbcc0008040 comp rx=0 tx=0).stop 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 msgr2=0x7fbcd4197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4197aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400b5c0 tx=0x7fbcc400be20 comp rx=0 tx=0).stop 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 shutdown_connections 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcb806d8a0 0x7fbcb806fd50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcd4100020 0x7fbcd4197aa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 --2- 172.21.15.23:0/3887769414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd41012c0 0x7fbcd4197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 >> 172.21.15.23:0/3887769414 conn(0x7fbcd40fb650 msgr2=0x7fbcd41024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:22.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 shutdown_connections 2024-02-28T16:34:22.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.716+0000 7fbcd3200700 1 -- 172.21.15.23:0/3887769414 wait complete. 2024-02-28T16:34:22.710 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 36 2024-02-28T16:34:22.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 -- 172.21.15.23:0/469935662 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 msgr2=0x7fc56c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.865 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 --2- 172.21.15.23:0/469935662 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c0ff540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc560009910 tx=0x7fc560009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:22.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 -- 172.21.15.23:0/469935662 shutdown_connections 2024-02-28T16:34:22.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 --2- 172.21.15.23:0/469935662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc56c1003d0 0x7fc56c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 --2- 172.21.15.23:0/469935662 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c0ff540 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 -- 172.21.15.23:0/469935662 >> 172.21.15.23:0/469935662 conn(0x7fc56c0fa780 msgr2=0x7fc56c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:22.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 -- 172.21.15.23:0/469935662 shutdown_connections 2024-02-28T16:34:22.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.877+0000 7fc573c00700 1 -- 172.21.15.23:0/469935662 wait complete. 2024-02-28T16:34:22.867 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.879+0000 7fc573c00700 1 Processor -- start 2024-02-28T16:34:22.867 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.879+0000 7fc573c00700 1 -- start start 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.879+0000 7fc573c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.879+0000 7fc573c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc56c1003d0 0x7fc56c1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.879+0000 7fc573c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c101cf0 con 0x7fc56c0ff130 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.879+0000 7fc573c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c101e30 con 0x7fc56c1003d0 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc571200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc571200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57724/0 (socket says 172.21.15.23:57724) 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc571200700 1 -- 172.21.15.23:0/1065148323 learned_addr learned my addr 172.21.15.23:0/1065148323 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:22.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc56be00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc56c1003d0 0x7fc56c1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:22.869 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc571200700 1 -- 172.21.15.23:0/1065148323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc56c1003d0 msgr2=0x7fc56c1017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:22.869 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc571200700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc56c1003d0 0x7fc56c1017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:22.869 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc571200700 1 -- 172.21.15.23:0/1065148323 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600095f0 con 0x7fc56c0ff130 2024-02-28T16:34:22.869 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.880+0000 7fc571200700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c103160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc560005b40 tx=0x7fc56000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:22.870 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.881+0000 7fc569600700 1 -- 172.21.15.23:0/1065148323 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc56001d070 con 0x7fc56c0ff130 2024-02-28T16:34:22.870 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.881+0000 7fc569600700 1 -- 172.21.15.23:0/1065148323 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc560022470 con 0x7fc56c0ff130 2024-02-28T16:34:22.870 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.881+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c1020b0 con 0x7fc56c0ff130 2024-02-28T16:34:22.870 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.881+0000 7fc569600700 1 -- 172.21.15.23:0/1065148323 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc56000f690 con 0x7fc56c0ff130 2024-02-28T16:34:22.870 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.881+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c1025a0 con 0x7fc56c0ff130 2024-02-28T16:34:22.870 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.882+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c107c90 con 0x7fc56c0ff130 2024-02-28T16:34:22.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.884+0000 7fc569600700 1 -- 172.21.15.23:0/1065148323 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc5600225e0 con 0x7fc56c0ff130 2024-02-28T16:34:22.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.885+0000 7fc569600700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc55406d8a0 0x7fc55406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:22.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.885+0000 7fc569600700 1 -- 172.21.15.23:0/1065148323 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc56008ee20 con 0x7fc56c0ff130 2024-02-28T16:34:22.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.886+0000 7fc56be00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc55406d8a0 0x7fc55406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:22.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.886+0000 7fc56be00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc55406d8a0 0x7fc55406fd50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc558006fd0 tx=0x7fc558008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:22.879 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:22.891+0000 7fc569600700 1 -- 172.21.15.23:0/1065148323 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc56005c0b0 con 0x7fc56c0ff130 2024-02-28T16:34:23.144 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.156+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc56c068c50 con 0x7fc55406d8a0 2024-02-28T16:34:23.145 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:22 smithi023 ceph-mon[78509]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:23.145 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:22 smithi023 ceph-mon[78509]: pgmap v293: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:23.145 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:22 smithi023 ceph-mon[78509]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:23.145 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:22 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2780149494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:23.145 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:22 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3887769414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:34:23.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:22 smithi153 ceph-mon[66339]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:23.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:22 smithi153 ceph-mon[66339]: pgmap v293: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:23.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:22 smithi153 ceph-mon[66339]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:23.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:22 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2780149494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:23.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:22 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3887769414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:34:23.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.157+0000 7fc569600700 1 -- 172.21.15.23:0/1065148323 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fc56c068c50 con 0x7fc55406d8a0 2024-02-28T16:34:23.146 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:34:23.146 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "mds", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "osd", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph-exporter" 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "18/23 daemons upgraded", 2024-02-28T16:34:23.147 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-28T16:34:23.148 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:34:23.148 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:34:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc55406d8a0 msgr2=0x7fc55406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.148 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc55406d8a0 0x7fc55406fd50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc558006fd0 tx=0x7fc558008040 comp rx=0 tx=0).stop 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 msgr2=0x7fc56c103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c103160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc560005b40 tx=0x7fc56000be20 comp rx=0 tx=0).stop 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 shutdown_connections 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc55406d8a0 0x7fc55406fd50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc56c0ff130 0x7fc56c103160 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 --2- 172.21.15.23:0/1065148323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc56c1003d0 0x7fc56c1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 >> 172.21.15.23:0/1065148323 conn(0x7fc56c0fa780 msgr2=0x7fc56c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 shutdown_connections 2024-02-28T16:34:23.149 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.160+0000 7fc573c00700 1 -- 172.21.15.23:0/1065148323 wait complete. 2024-02-28T16:34:23.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 -- 172.21.15.23:0/2710854576 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c0737b0 msgr2=0x7f399c073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 --2- 172.21.15.23:0/2710854576 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c0737b0 0x7f399c073c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3988009910 tx=0x7f3988009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:23.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 -- 172.21.15.23:0/2710854576 shutdown_connections 2024-02-28T16:34:23.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 --2- 172.21.15.23:0/2710854576 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c0737b0 0x7f399c073c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 --2- 172.21.15.23:0/2710854576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f399c074d80 0x7f399c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 -- 172.21.15.23:0/2710854576 >> 172.21.15.23:0/2710854576 conn(0x7f399c0fb7f0 msgr2=0x7f399c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:23.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 -- 172.21.15.23:0/2710854576 shutdown_connections 2024-02-28T16:34:23.323 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.334+0000 7f39a1200700 1 -- 172.21.15.23:0/2710854576 wait complete. 2024-02-28T16:34:23.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.335+0000 7f39a1200700 1 Processor -- start 2024-02-28T16:34:23.324 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.335+0000 7f39a1200700 1 -- start start 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.335+0000 7f39a1200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f399c0737b0 0x7f399c19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.335+0000 7f39a1200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c074d80 0x7f399c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.335+0000 7f39a1200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c19cc70 con 0x7f399c074d80 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.335+0000 7f39a1200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c19cdb0 con 0x7f399c0737b0 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.336+0000 7f3999400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c074d80 0x7f399c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.336+0000 7f3999400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c074d80 0x7f399c19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57732/0 (socket says 172.21.15.23:57732) 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.336+0000 7f3999400700 1 -- 172.21.15.23:0/2791597537 learned_addr learned my addr 172.21.15.23:0/2791597537 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.336+0000 7f3999e00700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f399c0737b0 0x7f399c19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.336+0000 7f3999400700 1 -- 172.21.15.23:0/2791597537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f399c0737b0 msgr2=0x7f399c19c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.336+0000 7f3999400700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f399c0737b0 0x7f399c19c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.336+0000 7f3999400700 1 -- 172.21.15.23:0/2791597537 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39880095f0 con 0x7f399c074d80 2024-02-28T16:34:23.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.337+0000 7f3999400700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c074d80 0x7f399c19c650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3988005b40 tx=0x7f398800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:23.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.337+0000 7f3992a00700 1 -- 172.21.15.23:0/2791597537 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f398801d070 con 0x7f399c074d80 2024-02-28T16:34:23.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.337+0000 7f3992a00700 1 -- 172.21.15.23:0/2791597537 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3988022470 con 0x7f399c074d80 2024-02-28T16:34:23.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.337+0000 7f3992a00700 1 -- 172.21.15.23:0/2791597537 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f398800f690 con 0x7f399c074d80 2024-02-28T16:34:23.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.337+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c1a1800 con 0x7f399c074d80 2024-02-28T16:34:23.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.338+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c1a1ca0 con 0x7f399c074d80 2024-02-28T16:34:23.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.339+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c10f3f0 con 0x7f399c074d80 2024-02-28T16:34:23.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.340+0000 7f3992a00700 1 -- 172.21.15.23:0/2791597537 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f39880225e0 con 0x7f399c074d80 2024-02-28T16:34:23.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.341+0000 7f3992a00700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f398006d8a0 0x7f398006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:23.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.341+0000 7f3992a00700 1 -- 172.21.15.23:0/2791597537 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f398808eec0 con 0x7f399c074d80 2024-02-28T16:34:23.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.341+0000 7f3999e00700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f398006d8a0 0x7f398006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:23.330 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.342+0000 7f3999e00700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f398006d8a0 0x7f398006fd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f398c006fd0 tx=0x7f398c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:23.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.346+0000 7f3992a00700 1 -- 172.21.15.23:0/2791597537 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f398805c110 con 0x7f399c074d80 2024-02-28T16:34:23.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.697+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f399c1a2620 con 0x7f399c074d80 2024-02-28T16:34:23.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.698+0000 7f3992a00700 1 -- 172.21.15.23:0/2791597537 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3988027090 con 0x7f399c074d80 2024-02-28T16:34:23.687 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:34:23.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f398006d8a0 msgr2=0x7f398006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f398006d8a0 0x7f398006fd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f398c006fd0 tx=0x7f398c008040 comp rx=0 tx=0).stop 2024-02-28T16:34:23.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c074d80 msgr2=0x7f399c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c074d80 0x7f399c19c650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3988005b40 tx=0x7f398800be20 comp rx=0 tx=0).stop 2024-02-28T16:34:23.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 shutdown_connections 2024-02-28T16:34:23.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f399c0737b0 0x7f399c19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f398006d8a0 0x7f398006fd50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 --2- 172.21.15.23:0/2791597537 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f399c074d80 0x7f399c19c650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 >> 172.21.15.23:0/2791597537 conn(0x7f399c0fb7f0 msgr2=0x7f399c101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:23.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 shutdown_connections 2024-02-28T16:34:23.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:23.701+0000 7f39a1200700 1 -- 172.21.15.23:0/2791597537 wait complete. 2024-02-28T16:34:24.059 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:23 smithi023 ceph-mon[78509]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:24.059 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:23 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2791597537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:34:24.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:23 smithi153 ceph-mon[66339]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:24.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:23 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2791597537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:34:25.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:24 smithi023 ceph-mon[78509]: pgmap v294: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:25.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:25.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:25.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:24 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:25.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:24 smithi153 ceph-mon[66339]: pgmap v294: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:25.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:25.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:25.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:24 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:27.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:26 smithi023 ceph-mon[78509]: pgmap v295: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:27.192 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:26 smithi153 ceph-mon[66339]: pgmap v295: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:29.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:28 smithi023 ceph-mon[78509]: pgmap v296: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:29.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:28 smithi153 ceph-mon[66339]: pgmap v296: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:31.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:30 smithi153 ceph-mon[66339]: pgmap v297: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:31.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:30 smithi023 ceph-mon[78509]: pgmap v297: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:32.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:32 smithi153 ceph-mon[66339]: pgmap v298: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:32.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:32.645 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:32 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:32.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:32 smithi023 ceph-mon[78509]: pgmap v298: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:32.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:32.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:32 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:34.848 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:34 smithi023 ceph-mon[78509]: pgmap v299: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:34.849 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:34.849 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:34 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:34.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:34 smithi153 ceph-mon[66339]: pgmap v299: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:34.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:34.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:34 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:36.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:36 smithi153 ceph-mon[66339]: pgmap v300: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:36.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:36.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:36 smithi023 ceph-mon[78509]: pgmap v300: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:36.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:38.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:38 smithi153 ceph-mon[66339]: pgmap v301: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:38.899 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:38 smithi023 ceph-mon[78509]: pgmap v301: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:40.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: pgmap v302: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:40.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:40.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:40.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.674 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:40 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: pgmap v302: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:40.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:40.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:40.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.896 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:40.897 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:40 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:42.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:42 smithi023 ceph-mon[78509]: pgmap v303: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:42.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:42 smithi023 ceph-mon[78509]: Upgrade: Updating alertmanager.smithi023 2024-02-28T16:34:42.673 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:42 smithi023 ceph-mon[78509]: Deploying daemon alertmanager.smithi023 on smithi023 2024-02-28T16:34:42.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:42 smithi153 ceph-mon[66339]: pgmap v303: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:42.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:42 smithi153 ceph-mon[66339]: Upgrade: Updating alertmanager.smithi023 2024-02-28T16:34:42.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:42 smithi153 ceph-mon[66339]: Deploying daemon alertmanager.smithi023 on smithi023 2024-02-28T16:34:44.600 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:44 smithi023 ceph-mon[78509]: pgmap v304: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:44.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:44 smithi153 ceph-mon[66339]: pgmap v304: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:46.697 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:46 smithi153 ceph-mon[66339]: pgmap v305: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:46.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:46 smithi023 ceph-mon[78509]: pgmap v305: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:48.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:48 smithi153 ceph-mon[66339]: pgmap v306: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:48.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:48 smithi023 ceph-mon[78509]: pgmap v306: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:51.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:50 smithi153 ceph-mon[66339]: pgmap v307: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:51.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:51.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:50 smithi023 ceph-mon[78509]: pgmap v307: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:51.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:51.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:52.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:53.067 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:52 smithi023 ceph-mon[78509]: pgmap v308: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:53.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:52 smithi153 ceph-mon[66339]: pgmap v308: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:53.871 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 -- 172.21.15.23:0/2556700175 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c1014b0 msgr2=0x7fe01c103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:53.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 --2- 172.21.15.23:0/2556700175 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c1014b0 0x7fe01c103930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe008009910 tx=0x7fe008009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:53.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 -- 172.21.15.23:0/2556700175 shutdown_connections 2024-02-28T16:34:53.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 --2- 172.21.15.23:0/2556700175 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c1014b0 0x7fe01c103930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:53.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 --2- 172.21.15.23:0/2556700175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01c0feb50 0x7fe01c100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:53.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 -- 172.21.15.23:0/2556700175 >> 172.21.15.23:0/2556700175 conn(0x7fe01c0fa780 msgr2=0x7fe01c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:53.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 -- 172.21.15.23:0/2556700175 shutdown_connections 2024-02-28T16:34:53.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.883+0000 7fe023800700 1 -- 172.21.15.23:0/2556700175 wait complete. 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.884+0000 7fe023800700 1 Processor -- start 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.884+0000 7fe023800700 1 -- start start 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe023800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c0feb50 0x7fe01c19c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe023800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01c1014b0 0x7fe01c19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe023800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c19ccb0 con 0x7fe01c0feb50 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe023800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c19cdf0 con 0x7fe01c1014b0 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe020e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c0feb50 0x7fe01c19c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe020e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c0feb50 0x7fe01c19c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53972/0 (socket says 172.21.15.23:53972) 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe020e00700 1 -- 172.21.15.23:0/376484577 learned_addr learned my addr 172.21.15.23:0/376484577 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:53.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe01be00700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01c1014b0 0x7fe01c19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:53.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe020e00700 1 -- 172.21.15.23:0/376484577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01c1014b0 msgr2=0x7fe01c19c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:53.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.885+0000 7fe020e00700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01c1014b0 0x7fe01c19c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:53.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.886+0000 7fe020e00700 1 -- 172.21.15.23:0/376484577 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080095f0 con 0x7fe01c0feb50 2024-02-28T16:34:53.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.886+0000 7fe020e00700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c0feb50 0x7fe01c19c150 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe01000b480 tx=0x7fe01000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:53.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.886+0000 7fe019600700 1 -- 172.21.15.23:0/376484577 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0100118c0 con 0x7fe01c0feb50 2024-02-28T16:34:53.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.886+0000 7fe019600700 1 -- 172.21.15.23:0/376484577 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe010010380 con 0x7fe01c0feb50 2024-02-28T16:34:53.876 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.886+0000 7fe019600700 1 -- 172.21.15.23:0/376484577 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01000f4f0 con 0x7fe01c0feb50 2024-02-28T16:34:53.876 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.886+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c1a18a0 con 0x7fe01c0feb50 2024-02-28T16:34:53.876 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.886+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c1a1df0 con 0x7fe01c0feb50 2024-02-28T16:34:53.876 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.888+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c196260 con 0x7fe01c0feb50 2024-02-28T16:34:53.877 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.889+0000 7fe019600700 1 -- 172.21.15.23:0/376484577 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe0100104f0 con 0x7fe01c0feb50 2024-02-28T16:34:53.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.890+0000 7fe019600700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe00406d8a0 0x7fe00406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:53.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.890+0000 7fe019600700 1 -- 172.21.15.23:0/376484577 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe01008d1c0 con 0x7fe01c0feb50 2024-02-28T16:34:53.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.890+0000 7fe01be00700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe00406d8a0 0x7fe00406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:53.879 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.891+0000 7fe01be00700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe00406d8a0 0x7fe00406fd50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe008000c00 tx=0x7fe008005fb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:53.883 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:53.895+0000 7fe019600700 1 -- 172.21.15.23:0/376484577 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe01005a470 con 0x7fe01c0feb50 2024-02-28T16:34:54.145 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.156+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe01c061190 con 0x7fe00406d8a0 2024-02-28T16:34:54.147 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.159+0000 7fe019600700 1 -- 172.21.15.23:0/376484577 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fe01c061190 con 0x7fe00406d8a0 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe00406d8a0 msgr2=0x7fe00406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe00406d8a0 0x7fe00406fd50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe008000c00 tx=0x7fe008005fb0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c0feb50 msgr2=0x7fe01c19c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c0feb50 0x7fe01c19c150 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe01000b480 tx=0x7fe01000b840 comp rx=0 tx=0).stop 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 shutdown_connections 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe00406d8a0 0x7fe00406fd50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe01c0feb50 0x7fe01c19c150 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 --2- 172.21.15.23:0/376484577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe01c1014b0 0x7fe01c19c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.162+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 >> 172.21.15.23:0/376484577 conn(0x7fe01c0fa780 msgr2=0x7fe01c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:54.151 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.163+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 shutdown_connections 2024-02-28T16:34:54.152 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.163+0000 7fe023800700 1 -- 172.21.15.23:0/376484577 wait complete. 2024-02-28T16:34:54.169 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:34:54.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.324+0000 7f314e800700 1 -- 172.21.15.23:0/3046100872 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 msgr2=0x7f3148073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.324+0000 7f314e800700 1 --2- 172.21.15.23:0/3046100872 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148073c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3134009940 tx=0x7f3134009c50 comp rx=0 tx=0).stop 2024-02-28T16:34:54.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.324+0000 7f314e800700 1 -- 172.21.15.23:0/3046100872 shutdown_connections 2024-02-28T16:34:54.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.324+0000 7f314e800700 1 --2- 172.21.15.23:0/3046100872 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148073c20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.324+0000 7f314e800700 1 --2- 172.21.15.23:0/3046100872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3148074d80 0x7f31480731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.324+0000 7f314e800700 1 -- 172.21.15.23:0/3046100872 >> 172.21.15.23:0/3046100872 conn(0x7f31480fb7f0 msgr2=0x7f31480fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:54.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.324+0000 7f314e800700 1 -- 172.21.15.23:0/3046100872 shutdown_connections 2024-02-28T16:34:54.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.325+0000 7f314e800700 1 -- 172.21.15.23:0/3046100872 wait complete. 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.326+0000 7f314e800700 1 Processor -- start 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.326+0000 7f314e800700 1 -- start start 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.326+0000 7f314e800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.326+0000 7f314e800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3148074d80 0x7f31481981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.326+0000 7f314e800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148198750 con 0x7f31480737b0 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.326+0000 7f314e800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31481988c0 con 0x7f3148074d80 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.327+0000 7f3147400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.327+0000 7f3147400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53986/0 (socket says 172.21.15.23:53986) 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.327+0000 7f3147400700 1 -- 172.21.15.23:0/3422659599 learned_addr learned my addr 172.21.15.23:0/3422659599 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.327+0000 7f3146a00700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3148074d80 0x7f31481981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.327+0000 7f3147400700 1 -- 172.21.15.23:0/3422659599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3148074d80 msgr2=0x7f31481981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.327+0000 7f3147400700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3148074d80 0x7f31481981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.328+0000 7f3147400700 1 -- 172.21.15.23:0/3422659599 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340095f0 con 0x7f31480737b0 2024-02-28T16:34:54.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.328+0000 7f3147400700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148197ca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f313800c930 tx=0x7f313800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:54.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.328+0000 7f313fe00700 1 -- 172.21.15.23:0/3422659599 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3138007ad0 con 0x7f31480737b0 2024-02-28T16:34:54.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.328+0000 7f313fe00700 1 -- 172.21.15.23:0/3422659599 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3138007c30 con 0x7f31480737b0 2024-02-28T16:34:54.317 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.328+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314819d360 con 0x7f31480737b0 2024-02-28T16:34:54.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.329+0000 7f313fe00700 1 -- 172.21.15.23:0/3422659599 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3138018630 con 0x7f31480737b0 2024-02-28T16:34:54.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.329+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314819d8b0 con 0x7f31480737b0 2024-02-28T16:34:54.318 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.330+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314810af80 con 0x7f31480737b0 2024-02-28T16:34:54.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.332+0000 7f313fe00700 1 -- 172.21.15.23:0/3422659599 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f313800f450 con 0x7f31480737b0 2024-02-28T16:34:54.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.333+0000 7f313fe00700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f312c06d8a0 0x7f312c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:54.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.333+0000 7f313fe00700 1 -- 172.21.15.23:0/3422659599 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f313808d790 con 0x7f31480737b0 2024-02-28T16:34:54.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.333+0000 7f3146a00700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f312c06d8a0 0x7f312c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:54.322 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.334+0000 7f3146a00700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f312c06d8a0 0x7f312c06fd50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3134005f50 tx=0x7f3134005ea0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:54.326 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.338+0000 7f313fe00700 1 -- 172.21.15.23:0/3422659599 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3138056e70 con 0x7f31480737b0 2024-02-28T16:34:54.594 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.605+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3148107740 con 0x7f312c06d8a0 2024-02-28T16:34:54.596 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.608+0000 7f313fe00700 1 -- 172.21.15.23:0/3422659599 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f3148107740 con 0x7f312c06d8a0 2024-02-28T16:34:54.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f312c06d8a0 msgr2=0x7f312c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f312c06d8a0 0x7f312c06fd50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3134005f50 tx=0x7f3134005ea0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 msgr2=0x7f3148197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148197ca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f313800c930 tx=0x7f313800ccf0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 shutdown_connections 2024-02-28T16:34:54.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f312c06d8a0 0x7f312c06fd50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f31480737b0 0x7f3148197ca0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 --2- 172.21.15.23:0/3422659599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3148074d80 0x7f31481981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 >> 172.21.15.23:0/3422659599 conn(0x7f31480fb7f0 msgr2=0x7f3148106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:54.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 shutdown_connections 2024-02-28T16:34:54.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.611+0000 7f314e800700 1 -- 172.21.15.23:0/3422659599 wait complete. 2024-02-28T16:34:54.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 -- 172.21.15.23:0/3587692551 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c074d80 msgr2=0x7fbe6c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 --2- 172.21.15.23:0/3587692551 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c074d80 0x7fbe6c0731e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009910 tx=0x7fbe60009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:54.764 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 -- 172.21.15.23:0/3587692551 shutdown_connections 2024-02-28T16:34:54.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 --2- 172.21.15.23:0/3587692551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c0737b0 0x7fbe6c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 --2- 172.21.15.23:0/3587692551 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c074d80 0x7fbe6c0731e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 -- 172.21.15.23:0/3587692551 >> 172.21.15.23:0/3587692551 conn(0x7fbe6c0fb7f0 msgr2=0x7fbe6c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:54.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 -- 172.21.15.23:0/3587692551 shutdown_connections 2024-02-28T16:34:54.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.776+0000 7fbe74400700 1 -- 172.21.15.23:0/3587692551 wait complete. 2024-02-28T16:34:54.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.777+0000 7fbe74400700 1 Processor -- start 2024-02-28T16:34:54.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.777+0000 7fbe74400700 1 -- start start 2024-02-28T16:34:54.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe74400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c0737b0 0x7fbe6c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:54.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe74400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c074d80 0x7fbe6c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:54.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe74400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c19cbc0 con 0x7fbe6c0737b0 2024-02-28T16:34:54.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe74400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c19cd00 con 0x7fbe6c074d80 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe71a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c0737b0 0x7fbe6c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe71a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c0737b0 0x7fbe6c19c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54010/0 (socket says 172.21.15.23:54010) 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe71a00700 1 -- 172.21.15.23:0/2338565614 learned_addr learned my addr 172.21.15.23:0/2338565614 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.778+0000 7fbe71000700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c074d80 0x7fbe6c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe71a00700 1 -- 172.21.15.23:0/2338565614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c074d80 msgr2=0x7fbe6c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe71a00700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c074d80 0x7fbe6c19c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe71a00700 1 -- 172.21.15.23:0/2338565614 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600095f0 con 0x7fbe6c0737b0 2024-02-28T16:34:54.767 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe71000700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c074d80 0x7fbe6c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:34:54.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe71a00700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c0737b0 0x7fbe6c19c060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe60006010 tx=0x7fbe6000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:54.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe6a000700 1 -- 172.21.15.23:0/2338565614 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe6001d070 con 0x7fbe6c0737b0 2024-02-28T16:34:54.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c1a1750 con 0x7fbe6c0737b0 2024-02-28T16:34:54.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe6a000700 1 -- 172.21.15.23:0/2338565614 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbe6000f460 con 0x7fbe6c0737b0 2024-02-28T16:34:54.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe6a000700 1 -- 172.21.15.23:0/2338565614 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe60017630 con 0x7fbe6c0737b0 2024-02-28T16:34:54.768 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.779+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c1a1c40 con 0x7fbe6c0737b0 2024-02-28T16:34:54.769 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.781+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c10f370 con 0x7fbe6c0737b0 2024-02-28T16:34:54.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.783+0000 7fbe6a000700 1 -- 172.21.15.23:0/2338565614 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbe60003a60 con 0x7fbe6c0737b0 2024-02-28T16:34:54.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.785+0000 7fbe6a000700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbe5406d8a0 0x7fbe5406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:54.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.785+0000 7fbe6a000700 1 -- 172.21.15.23:0/2338565614 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbe6008e9d0 con 0x7fbe6c0737b0 2024-02-28T16:34:54.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.785+0000 7fbe71000700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbe5406d8a0 0x7fbe5406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:54.774 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.786+0000 7fbe71000700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbe5406d8a0 0x7fbe5406fd50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe58005950 tx=0x7fbe580058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:54.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:54.791+0000 7fbe6a000700 1 -- 172.21.15.23:0/2338565614 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbe6005bc80 con 0x7fbe6c0737b0 2024-02-28T16:34:55.030 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.042+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe6c1a2390 con 0x7fbe5406d8a0 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.053+0000 7fbe6a000700 1 -- 172.21.15.23:0/2338565614 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fbe6c1a2390 con 0x7fbe5406d8a0 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 starting - - - - 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (92s) 23s ago 22m 7926k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 64317e9be9ba 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (84s) 52s ago 20m 7583k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 942e64d3de96 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (7m) 23s ago 22m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (7m) 52s ago 20m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:34:55.042 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (19m) 23s ago 21m 73.3M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (2m) 23s ago 14m 12.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (3m) 23s ago 14m 86.6M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (112s) 52s ago 14m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b4ff1f848efc 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (2m) 52s ago 14m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (11m) 23s ago 23m 513M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (9m) 52s ago 20m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (9m) 23s ago 23m 59.8M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (8m) 52s ago 20m 45.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (63s) 23s ago 21m 7222k - 1.5.0 0da6a335fe13 5ea0d01203ff 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (56s) 52s ago 20m 2902k - 1.5.0 0da6a335fe13 d4b7c7fb1fb7 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (6m) 23s ago 19m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (6m) 23s ago 18m 114M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (5m) 23s ago 18m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (5m) 52s ago 17m 120M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:34:55.043 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (4m) 52s ago 17m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:34:55.044 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (3m) 52s ago 16m 95.3M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:34:55.044 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (31s) 23s ago 21m 46.0M - 2.43.0 a07b618ecd1d 4214bcd1aafd 2024-02-28T16:34:55.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbe5406d8a0 msgr2=0x7fbe5406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbe5406d8a0 0x7fbe5406fd50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe58005950 tx=0x7fbe580058e0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c0737b0 msgr2=0x7fbe6c19c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c0737b0 0x7fbe6c19c060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe60006010 tx=0x7fbe6000be20 comp rx=0 tx=0).stop 2024-02-28T16:34:55.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 shutdown_connections 2024-02-28T16:34:55.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbe5406d8a0 0x7fbe5406fd50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbe6c0737b0 0x7fbe6c19c060 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 --2- 172.21.15.23:0/2338565614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe6c074d80 0x7fbe6c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 >> 172.21.15.23:0/2338565614 conn(0x7fbe6c0fb7f0 msgr2=0x7fbe6c101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:55.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.056+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 shutdown_connections 2024-02-28T16:34:55.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.057+0000 7fbe74400700 1 -- 172.21.15.23:0/2338565614 wait complete. 2024-02-28T16:34:55.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:54 smithi153 ceph-mon[66339]: pgmap v309: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:55.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:54 smithi153 ceph-mon[66339]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:55.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:54 smithi023 ceph-mon[78509]: pgmap v309: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:55.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:54 smithi023 ceph-mon[78509]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 -- 172.21.15.23:0/3516125348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4103680 msgr2=0x7f3cc4105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/3516125348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4103680 0x7f3cc4105a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009910 tx=0x7f3cb0009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 -- 172.21.15.23:0/3516125348 shutdown_connections 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/3516125348 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4103680 0x7f3cc4105a60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/3516125348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cc4100d60 0x7f3cc4103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 -- 172.21.15.23:0/3516125348 >> 172.21.15.23:0/3516125348 conn(0x7f3cc40fa780 msgr2=0x7f3cc40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 -- 172.21.15.23:0/3516125348 shutdown_connections 2024-02-28T16:34:55.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.213+0000 7f3cc9a00700 1 -- 172.21.15.23:0/3516125348 wait complete. 2024-02-28T16:34:55.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.214+0000 7f3cc9a00700 1 Processor -- start 2024-02-28T16:34:55.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc9a00700 1 -- start start 2024-02-28T16:34:55.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc9a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4100d60 0x7f3cc4197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:55.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc9a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cc4103680 0x7f3cc4198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:55.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc9a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4198860 con 0x7f3cc4100d60 2024-02-28T16:34:55.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc9a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc419d270 con 0x7f3cc4103680 2024-02-28T16:34:55.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4100d60 0x7f3cc4197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:55.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc2a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4100d60 0x7f3cc4197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54028/0 (socket says 172.21.15.23:54028) 2024-02-28T16:34:55.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.215+0000 7f3cc2a00700 1 -- 172.21.15.23:0/304952960 learned_addr learned my addr 172.21.15.23:0/304952960 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cc2000700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cc4103680 0x7f3cc4198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cc2a00700 1 -- 172.21.15.23:0/304952960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cc4103680 msgr2=0x7f3cc4198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cc2a00700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cc4103680 0x7f3cc4198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cc2a00700 1 -- 172.21.15.23:0/304952960 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb00095f0 con 0x7f3cc4100d60 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cc2a00700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4100d60 0x7f3cc4197d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c8f0 tx=0x7f3cb400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cbb400700 1 -- 172.21.15.23:0/304952960 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb4007a50 con 0x7f3cc4100d60 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cbb400700 1 -- 172.21.15.23:0/304952960 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3cb4007bb0 con 0x7f3cc4100d60 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cbb400700 1 -- 172.21.15.23:0/304952960 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb4018630 con 0x7f3cc4100d60 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.216+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc419d470 con 0x7f3cc4100d60 2024-02-28T16:34:55.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.217+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc419d990 con 0x7f3cc4100d60 2024-02-28T16:34:55.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.218+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc40fc340 con 0x7f3cc4100d60 2024-02-28T16:34:55.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.220+0000 7f3cbb400700 1 -- 172.21.15.23:0/304952960 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f3cb4007d20 con 0x7f3cc4100d60 2024-02-28T16:34:55.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.221+0000 7f3cbb400700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3ca806d8a0 0x7f3ca806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:55.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.221+0000 7f3cbb400700 1 -- 172.21.15.23:0/304952960 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3cb408d4d0 con 0x7f3cc4100d60 2024-02-28T16:34:55.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.222+0000 7f3cc2000700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3ca806d8a0 0x7f3ca806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:55.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.222+0000 7f3cc2000700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3ca806d8a0 0x7f3ca806fd50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0006010 tx=0x7f3cb000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:55.214 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.226+0000 7f3cbb400700 1 -- 172.21.15.23:0/304952960 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3cb4056c50 con 0x7f3cc4100d60 2024-02-28T16:34:55.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.556+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3cc4061990 con 0x7f3cc4100d60 2024-02-28T16:34:55.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.557+0000 7f3cbb400700 1 -- 172.21.15.23:0/304952960 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f3cb405a310 con 0x7f3cc4100d60 2024-02-28T16:34:55.545 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:34:55.545 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:34:55.545 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:34:55.546 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3ca806d8a0 msgr2=0x7f3ca806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3ca806d8a0 0x7f3ca806fd50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0006010 tx=0x7f3cb000b540 comp rx=0 tx=0).stop 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4100d60 msgr2=0x7f3cc4197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4100d60 0x7f3cc4197d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c8f0 tx=0x7f3cb400ccb0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 shutdown_connections 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3ca806d8a0 0x7f3ca806fd50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3cc4100d60 0x7f3cc4197d00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 --2- 172.21.15.23:0/304952960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cc4103680 0x7f3cc4198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.559+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 >> 172.21.15.23:0/304952960 conn(0x7f3cc40fa780 msgr2=0x7f3cc41042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.560+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 shutdown_connections 2024-02-28T16:34:55.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.560+0000 7f3cc9a00700 1 -- 172.21.15.23:0/304952960 wait complete. 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 -- 172.21.15.23:0/3564210088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 msgr2=0x7fdd281057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 --2- 172.21.15.23:0/3564210088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd281057b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009910 tx=0x7fdd10009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 -- 172.21.15.23:0/3564210088 shutdown_connections 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 --2- 172.21.15.23:0/3564210088 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd281057b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 --2- 172.21.15.23:0/3564210088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd28100ab0 0x7fdd28102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 -- 172.21.15.23:0/3564210088 >> 172.21.15.23:0/3564210088 conn(0x7fdd280fa4d0 msgr2=0x7fdd280fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 -- 172.21.15.23:0/3564210088 shutdown_connections 2024-02-28T16:34:55.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.709+0000 7fdd2da00700 1 -- 172.21.15.23:0/3564210088 wait complete. 2024-02-28T16:34:55.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.711+0000 7fdd2da00700 1 Processor -- start 2024-02-28T16:34:55.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.711+0000 7fdd2da00700 1 -- start start 2024-02-28T16:34:55.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.711+0000 7fdd2da00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd28100ab0 0x7fdd28100410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:55.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.711+0000 7fdd2da00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd280fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:55.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.711+0000 7fdd2da00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28199480 con 0x7fdd281033d0 2024-02-28T16:34:55.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.711+0000 7fdd2da00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd281995c0 con 0x7fdd28100ab0 2024-02-28T16:34:55.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.712+0000 7fdd1fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd280fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:55.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.712+0000 7fdd1fe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd280fea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54050/0 (socket says 172.21.15.23:54050) 2024-02-28T16:34:55.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.712+0000 7fdd1fe00700 1 -- 172.21.15.23:0/1293577994 learned_addr learned my addr 172.21.15.23:0/1293577994 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:55.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.712+0000 7fdd27e00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd28100ab0 0x7fdd28100410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:55.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.712+0000 7fdd1fe00700 1 -- 172.21.15.23:0/1293577994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd28100ab0 msgr2=0x7fdd28100410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.712+0000 7fdd1fe00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd28100ab0 0x7fdd28100410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.712+0000 7fdd1fe00700 1 -- 172.21.15.23:0/1293577994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100095f0 con 0x7fdd281033d0 2024-02-28T16:34:55.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.713+0000 7fdd1fe00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd280fea60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdd10005b40 tx=0x7fdd1000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:55.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.713+0000 7fdd25600700 1 -- 172.21.15.23:0/1293577994 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd1001d070 con 0x7fdd281033d0 2024-02-28T16:34:55.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.713+0000 7fdd25600700 1 -- 172.21.15.23:0/1293577994 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd1000f460 con 0x7fdd281033d0 2024-02-28T16:34:55.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.713+0000 7fdd25600700 1 -- 172.21.15.23:0/1293577994 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd10021640 con 0x7fdd281033d0 2024-02-28T16:34:55.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.713+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd280fefa0 con 0x7fdd281033d0 2024-02-28T16:34:55.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.714+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd280ff460 con 0x7fdd281033d0 2024-02-28T16:34:55.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.715+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2818fa40 con 0x7fdd281033d0 2024-02-28T16:34:55.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.717+0000 7fdd25600700 1 -- 172.21.15.23:0/1293577994 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fdd1000fa90 con 0x7fdd281033d0 2024-02-28T16:34:55.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.718+0000 7fdd25600700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fdd0c06d8a0 0x7fdd0c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:55.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.718+0000 7fdd25600700 1 -- 172.21.15.23:0/1293577994 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fdd1008e970 con 0x7fdd281033d0 2024-02-28T16:34:55.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.718+0000 7fdd27e00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fdd0c06d8a0 0x7fdd0c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:55.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.719+0000 7fdd27e00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fdd0c06d8a0 0x7fdd0c06fd50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd18005950 tx=0x7fdd180058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:55.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.724+0000 7fdd25600700 1 -- 172.21.15.23:0/1293577994 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdd1005bb80 con 0x7fdd281033d0 2024-02-28T16:34:55.988 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:55.999+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd280ff790 con 0x7fdd281033d0 2024-02-28T16:34:55.988 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.000+0000 7fdd25600700 1 -- 172.21.15.23:0/1293577994 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1873 (secure 0 0 0) 0x7fdd1005b710 con 0x7fdd281033d0 2024-02-28T16:34:55.989 INFO:teuthology.orchestra.run.smithi023.stdout:e36 2024-02-28T16:34:55.989 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:34:55.989 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 36 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:33:05.948811+0000 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:34:55.990 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 85 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=34420} 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:34:55.991 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{0:34420} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:55.992 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:44333} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fdd0c06d8a0 msgr2=0x7fdd0c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fdd0c06d8a0 0x7fdd0c06fd50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd18005950 tx=0x7fdd180058e0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 msgr2=0x7fdd280fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd280fea60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdd10005b40 tx=0x7fdd1000be20 comp rx=0 tx=0).stop 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 shutdown_connections 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd28100ab0 0x7fdd28100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fdd0c06d8a0 0x7fdd0c06fd50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 --2- 172.21.15.23:0/1293577994 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fdd281033d0 0x7fdd280fea60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 >> 172.21.15.23:0/1293577994 conn(0x7fdd280fa4d0 msgr2=0x7fdd280fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 shutdown_connections 2024-02-28T16:34:55.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.003+0000 7fdd2da00700 1 -- 172.21.15.23:0/1293577994 wait complete. 2024-02-28T16:34:55.994 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 36 2024-02-28T16:34:56.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 -- 172.21.15.23:0/2975873046 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 msgr2=0x7ff46c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 --2- 172.21.15.23:0/2975873046 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c101890 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff458009910 tx=0x7ff458009c20 comp rx=0 tx=0).stop 2024-02-28T16:34:56.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 -- 172.21.15.23:0/2975873046 shutdown_connections 2024-02-28T16:34:56.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 --2- 172.21.15.23:0/2975873046 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c101890 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 --2- 172.21.15.23:0/2975873046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c100240 0x7ff46c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.153 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 -- 172.21.15.23:0/2975873046 >> 172.21.15.23:0/2975873046 conn(0x7ff46c0fb7f0 msgr2=0x7ff46c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:56.154 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:55 smithi023 ceph-mon[78509]: from='client.34608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:56.154 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:55 smithi023 ceph-mon[78509]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:56.154 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:55 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/304952960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:56.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 -- 172.21.15.23:0/2975873046 shutdown_connections 2024-02-28T16:34:56.154 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.165+0000 7ff471600700 1 -- 172.21.15.23:0/2975873046 wait complete. 2024-02-28T16:34:56.155 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.166+0000 7ff471600700 1 Processor -- start 2024-02-28T16:34:56.155 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff471600700 1 -- start start 2024-02-28T16:34:56.155 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff471600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c100240 0x7ff46c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff471600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff471600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c196560 con 0x7ff46c101440 2024-02-28T16:34:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff471600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1966a0 con 0x7ff46c100240 2024-02-28T16:34:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff46a000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff46a000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54072/0 (socket says 172.21.15.23:54072) 2024-02-28T16:34:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.167+0000 7ff46a000700 1 -- 172.21.15.23:0/859562777 learned_addr learned my addr 172.21.15.23:0/859562777 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:56.156 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.168+0000 7ff46aa00700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c100240 0x7ff46c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.168+0000 7ff46a000700 1 -- 172.21.15.23:0/859562777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c100240 msgr2=0x7ff46c195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.168+0000 7ff46a000700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c100240 0x7ff46c195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.157 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.168+0000 7ff46a000700 1 -- 172.21.15.23:0/859562777 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580095f0 con 0x7ff46c101440 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.168+0000 7ff46aa00700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c100240 0x7ff46c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.168+0000 7ff46a000700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c195fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff458005b40 tx=0x7ff45800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.169+0000 7ff463400700 1 -- 172.21.15.23:0/859562777 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45801d070 con 0x7ff46c101440 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.169+0000 7ff463400700 1 -- 172.21.15.23:0/859562777 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff458022470 con 0x7ff46c101440 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.169+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c19b100 con 0x7ff46c101440 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.169+0000 7ff463400700 1 -- 172.21.15.23:0/859562777 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45800f690 con 0x7ff46c101440 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.169+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c19b5c0 con 0x7ff46c101440 2024-02-28T16:34:56.158 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.170+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c108d90 con 0x7ff46c101440 2024-02-28T16:34:56.159 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.171+0000 7ff463400700 1 -- 172.21.15.23:0/859562777 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff4580225e0 con 0x7ff46c101440 2024-02-28T16:34:56.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.172+0000 7ff463400700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45006d8a0 0x7ff45006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.172+0000 7ff463400700 1 -- 172.21.15.23:0/859562777 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7ff45808ed90 con 0x7ff46c101440 2024-02-28T16:34:56.160 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.172+0000 7ff46aa00700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45006d8a0 0x7ff45006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.161 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.173+0000 7ff46aa00700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45006d8a0 0x7ff45006fd50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff45c005fd0 tx=0x7ff45c005e40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:56.165 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.177+0000 7ff463400700 1 -- 172.21.15.23:0/859562777 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff45805c020 con 0x7ff46c101440 2024-02-28T16:34:56.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:55 smithi153 ceph-mon[66339]: from='client.34608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:56.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:55 smithi153 ceph-mon[66339]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:56.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:55 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/304952960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:56.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.429+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff46c105d90 con 0x7ff45006d8a0 2024-02-28T16:34:56.418 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.430+0000 7ff463400700 1 -- 172.21.15.23:0/859562777 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7ff46c105d90 con 0x7ff45006d8a0 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "mds", 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "osd", 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph-exporter" 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:34:56.419 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "18/23 daemons upgraded", 2024-02-28T16:34:56.420 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-28T16:34:56.420 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:34:56.420 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.433+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45006d8a0 msgr2=0x7ff45006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.433+0000 7ff471600700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45006d8a0 0x7ff45006fd50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff45c005fd0 tx=0x7ff45c005e40 comp rx=0 tx=0).stop 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.433+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 msgr2=0x7ff46c195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.433+0000 7ff471600700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c195fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff458005b40 tx=0x7ff45800be20 comp rx=0 tx=0).stop 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.434+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 shutdown_connections 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.434+0000 7ff471600700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c100240 0x7ff46c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.434+0000 7ff471600700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45006d8a0 0x7ff45006fd50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.422 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.434+0000 7ff471600700 1 --2- 172.21.15.23:0/859562777 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff46c101440 0x7ff46c195fd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.434+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 >> 172.21.15.23:0/859562777 conn(0x7ff46c0fb7f0 msgr2=0x7ff46c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:56.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.434+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 shutdown_connections 2024-02-28T16:34:56.423 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.434+0000 7ff471600700 1 -- 172.21.15.23:0/859562777 wait complete. 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.591+0000 7f4902a00700 1 -- 172.21.15.23:0/1161204726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc074d80 msgr2=0x7f48fc0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.591+0000 7f4902a00700 1 --2- 172.21.15.23:0/1161204726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc074d80 0x7f48fc0731e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009940 tx=0x7f48ec009c50 comp rx=0 tx=0).stop 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.591+0000 7f4902a00700 1 -- 172.21.15.23:0/1161204726 shutdown_connections 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.591+0000 7f4902a00700 1 --2- 172.21.15.23:0/1161204726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48fc0737b0 0x7f48fc073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.591+0000 7f4902a00700 1 --2- 172.21.15.23:0/1161204726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc074d80 0x7f48fc0731e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.591+0000 7f4902a00700 1 -- 172.21.15.23:0/1161204726 >> 172.21.15.23:0/1161204726 conn(0x7f48fc0fb7f0 msgr2=0x7f48fc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.591+0000 7f4902a00700 1 -- 172.21.15.23:0/1161204726 shutdown_connections 2024-02-28T16:34:56.580 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.592+0000 7f4902a00700 1 -- 172.21.15.23:0/1161204726 wait complete. 2024-02-28T16:34:56.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f4902a00700 1 Processor -- start 2024-02-28T16:34:56.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f4902a00700 1 -- start start 2024-02-28T16:34:56.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f4902a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc0737b0 0x7f48fc197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.582 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f4902a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48fc074d80 0x7f48fc1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.582 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f4902a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc198900 con 0x7f48fc0737b0 2024-02-28T16:34:56.582 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f4902a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc198a40 con 0x7f48fc074d80 2024-02-28T16:34:56.582 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f48fbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc0737b0 0x7f48fc197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.582 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f48fbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc0737b0 0x7f48fc197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54088/0 (socket says 172.21.15.23:54088) 2024-02-28T16:34:56.582 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.593+0000 7f48fbe00700 1 -- 172.21.15.23:0/3183072400 learned_addr learned my addr 172.21.15.23:0/3183072400 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.594+0000 7f48fb400700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48fc074d80 0x7f48fc1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.594+0000 7f48fbe00700 1 -- 172.21.15.23:0/3183072400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48fc074d80 msgr2=0x7f48fc1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.594+0000 7f48fbe00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48fc074d80 0x7f48fc1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.594+0000 7f48fbe00700 1 -- 172.21.15.23:0/3183072400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0095f0 con 0x7f48fc0737b0 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.594+0000 7f48fbe00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc0737b0 0x7f48fc197da0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0055a0 tx=0x7f48ec005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.594+0000 7f48f8c00700 1 -- 172.21.15.23:0/3183072400 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ec01d070 con 0x7f48fc0737b0 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.595+0000 7f48f8c00700 1 -- 172.21.15.23:0/3183072400 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f48ec00f460 con 0x7f48fc0737b0 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.595+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc19d490 con 0x7f48fc0737b0 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.595+0000 7f48f8c00700 1 -- 172.21.15.23:0/3183072400 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ec021620 con 0x7f48fc0737b0 2024-02-28T16:34:56.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.595+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc19d980 con 0x7f48fc0737b0 2024-02-28T16:34:56.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.596+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc10b000 con 0x7f48fc0737b0 2024-02-28T16:34:56.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.597+0000 7f48f8c00700 1 -- 172.21.15.23:0/3183072400 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f48ec02b440 con 0x7f48fc0737b0 2024-02-28T16:34:56.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.598+0000 7f48f8c00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f48e006d8a0 0x7f48e006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.598+0000 7f48f8c00700 1 -- 172.21.15.23:0/3183072400 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f48ec08e8d0 con 0x7f48fc0737b0 2024-02-28T16:34:56.587 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.599+0000 7f48fb400700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f48e006d8a0 0x7f48e006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.587 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.599+0000 7f48fb400700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f48e006d8a0 0x7f48e006fd50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006fd0 tx=0x7f48e8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:56.591 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.603+0000 7f48f8c00700 1 -- 172.21.15.23:0/3183072400 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f48ec05bb80 con 0x7f48fc0737b0 2024-02-28T16:34:56.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.963+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f48fc10b1c0 con 0x7f48fc0737b0 2024-02-28T16:34:56.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.964+0000 7f48f8c00700 1 -- 172.21.15.23:0/3183072400 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f48ec05b710 con 0x7f48fc0737b0 2024-02-28T16:34:56.952 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:34:56.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f48e006d8a0 msgr2=0x7f48e006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f48e006d8a0 0x7f48e006fd50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006fd0 tx=0x7f48e8008040 comp rx=0 tx=0).stop 2024-02-28T16:34:56.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc0737b0 msgr2=0x7f48fc197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc0737b0 0x7f48fc197da0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0055a0 tx=0x7f48ec005680 comp rx=0 tx=0).stop 2024-02-28T16:34:56.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 shutdown_connections 2024-02-28T16:34:56.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f48e006d8a0 0x7f48e006fd50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f48fc0737b0 0x7f48fc197da0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 --2- 172.21.15.23:0/3183072400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48fc074d80 0x7f48fc1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 >> 172.21.15.23:0/3183072400 conn(0x7f48fc0fb7f0 msgr2=0x7f48fc106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:56.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 shutdown_connections 2024-02-28T16:34:56.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:34:56.967+0000 7f4902a00700 1 -- 172.21.15.23:0/3183072400 wait complete. 2024-02-28T16:34:57.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:56 smithi023 ceph-mon[78509]: pgmap v310: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:57.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:56 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1293577994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:34:57.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:56 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:57.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:56 smithi153 ceph-mon[66339]: pgmap v310: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:57.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:56 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1293577994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:34:57.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:56 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:58.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:57 smithi023 ceph-mon[78509]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:58.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:58.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:57 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3183072400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:34:58.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:57 smithi153 ceph-mon[66339]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:58.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:58.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:57 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3183072400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:34:59.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:58 smithi153 ceph-mon[66339]: pgmap v311: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:59.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:58 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:34:59.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:58 smithi023 ceph-mon[78509]: pgmap v311: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:34:59.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:58 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:00.210 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:34:59 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:00.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:34:59 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:01.022 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:00 smithi023 ceph-mon[78509]: pgmap v312: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:01.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:00 smithi153 ceph-mon[66339]: pgmap v312: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:03.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:02 smithi023 ceph-mon[78509]: pgmap v313: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:03.246 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:02 smithi153 ceph-mon[66339]: pgmap v313: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:04 smithi153 ceph-mon[66339]: pgmap v314: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:05.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:04 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:04 smithi023 ceph-mon[78509]: pgmap v314: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:04 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:05 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:06.396 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:05 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:07.363 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:06 smithi023 ceph-mon[78509]: pgmap v315: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:07.363 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:07.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:06 smithi153 ceph-mon[66339]: pgmap v315: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:07.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:09.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:08 smithi153 ceph-mon[66339]: pgmap v316: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:09.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:08 smithi153 ceph-mon[66339]: Upgrade: Updating grafana.smithi023 2024-02-28T16:35:09.395 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:08 smithi153 ceph-mon[66339]: Deploying daemon grafana.smithi023 on smithi023 2024-02-28T16:35:09.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:08 smithi023 ceph-mon[78509]: pgmap v316: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:09.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:08 smithi023 ceph-mon[78509]: Upgrade: Updating grafana.smithi023 2024-02-28T16:35:09.424 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:08 smithi023 ceph-mon[78509]: Deploying daemon grafana.smithi023 on smithi023 2024-02-28T16:35:11.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:11 smithi153 ceph-mon[66339]: pgmap v317: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:11.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:10 smithi023 ceph-mon[78509]: pgmap v317: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:13.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:13 smithi023 ceph-mon[78509]: pgmap v318: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:13.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:13 smithi153 ceph-mon[66339]: pgmap v318: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:15.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:15 smithi153 ceph-mon[66339]: pgmap v319: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:15.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:15 smithi023 ceph-mon[78509]: pgmap v319: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:17.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:17 smithi153 ceph-mon[66339]: pgmap v320: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:17.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:17 smithi023 ceph-mon[78509]: pgmap v320: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:19.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:19 smithi153 ceph-mon[66339]: pgmap v321: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:19.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:19 smithi023 ceph-mon[78509]: pgmap v321: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:21.329 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:21 smithi023 ceph-mon[78509]: pgmap v322: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:21.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:21 smithi153 ceph-mon[66339]: pgmap v322: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:22.384 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:22.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:23.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:23 smithi153 ceph-mon[66339]: pgmap v323: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:23.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:23 smithi023 ceph-mon[78509]: pgmap v323: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:25.292 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:25 smithi023 ceph-mon[78509]: pgmap v324: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:25.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:25 smithi153 ceph-mon[66339]: pgmap v324: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:27.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.145+0000 7fef8e600700 1 -- 172.21.15.23:0/1037431273 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88100240 msgr2=0x7fef88100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.145+0000 7fef8e600700 1 --2- 172.21.15.23:0/1037431273 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88100240 0x7fef88100650 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fef78009910 tx=0x7fef78009c20 comp rx=0 tx=0).stop 2024-02-28T16:35:27.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.146+0000 7fef8e600700 1 -- 172.21.15.23:0/1037431273 shutdown_connections 2024-02-28T16:35:27.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.146+0000 7fef8e600700 1 --2- 172.21.15.23:0/1037431273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef88101440 0x7fef88101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.137 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.146+0000 7fef8e600700 1 --2- 172.21.15.23:0/1037431273 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88100240 0x7fef88100650 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.138 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.146+0000 7fef8e600700 1 -- 172.21.15.23:0/1037431273 >> 172.21.15.23:0/1037431273 conn(0x7fef880fb7f0 msgr2=0x7fef880fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:27.138 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.146+0000 7fef8e600700 1 -- 172.21.15.23:0/1037431273 shutdown_connections 2024-02-28T16:35:27.138 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.146+0000 7fef8e600700 1 -- 172.21.15.23:0/1037431273 wait complete. 2024-02-28T16:35:27.138 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.147+0000 7fef8e600700 1 Processor -- start 2024-02-28T16:35:27.138 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.147+0000 7fef8e600700 1 -- start start 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.147+0000 7fef8e600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef88100240 0x7fef88074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.147+0000 7fef8e600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88101440 0x7fef88073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef8e600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef88073680 con 0x7fef88101440 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef8e600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef880737c0 con 0x7fef88100240 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef86a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88101440 0x7fef88073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef86a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88101440 0x7fef88073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53158/0 (socket says 172.21.15.23:53158) 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef86a00700 1 -- 172.21.15.23:0/1673228706 learned_addr learned my addr 172.21.15.23:0/1673228706 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef87400700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef88100240 0x7fef88074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:27.139 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef86a00700 1 -- 172.21.15.23:0/1673228706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef88100240 msgr2=0x7fef88074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef86a00700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef88100240 0x7fef88074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.148+0000 7fef86a00700 1 -- 172.21.15.23:0/1673228706 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780095f0 con 0x7fef88101440 2024-02-28T16:35:27.140 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.149+0000 7fef86a00700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88101440 0x7fef88073140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fef7000b4b0 tx=0x7fef7000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:27.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.149+0000 7fef7fe00700 1 -- 172.21.15.23:0/1673228706 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef70011800 con 0x7fef88101440 2024-02-28T16:35:27.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.149+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef88073aa0 con 0x7fef88101440 2024-02-28T16:35:27.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.149+0000 7fef7fe00700 1 -- 172.21.15.23:0/1673228706 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fef70011e10 con 0x7fef88101440 2024-02-28T16:35:27.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.149+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8819dbc0 con 0x7fef88101440 2024-02-28T16:35:27.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.149+0000 7fef7fe00700 1 -- 172.21.15.23:0/1673228706 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7000f2e0 con 0x7fef88101440 2024-02-28T16:35:27.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.150+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef88108e10 con 0x7fef88101440 2024-02-28T16:35:27.141 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.152+0000 7fef7fe00700 1 -- 172.21.15.23:0/1673228706 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fef70010380 con 0x7fef88101440 2024-02-28T16:35:27.142 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.152+0000 7fef7fe00700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fef6c06d8a0 0x7fef6c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:27.142 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.153+0000 7fef7fe00700 1 -- 172.21.15.23:0/1673228706 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fef7008d220 con 0x7fef88101440 2024-02-28T16:35:27.142 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.153+0000 7fef87400700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fef6c06d8a0 0x7fef6c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:27.142 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.154+0000 7fef87400700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fef6c06d8a0 0x7fef6c06fd50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef78006010 tx=0x7fef7800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:27.146 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.158+0000 7fef7fe00700 1 -- 172.21.15.23:0/1673228706 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fef7005a450 con 0x7fef88101440 2024-02-28T16:35:27.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:27 smithi153 ceph-mon[66339]: pgmap v325: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:27.410 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.422+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef8819e170 con 0x7fef6c06d8a0 2024-02-28T16:35:27.411 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:27 smithi023 ceph-mon[78509]: pgmap v325: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:27.412 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.424+0000 7fef7fe00700 1 -- 172.21.15.23:0/1673228706 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fef8819e170 con 0x7fef6c06d8a0 2024-02-28T16:35:27.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fef6c06d8a0 msgr2=0x7fef6c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fef6c06d8a0 0x7fef6c06fd50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef78006010 tx=0x7fef7800b540 comp rx=0 tx=0).stop 2024-02-28T16:35:27.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88101440 msgr2=0x7fef88073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88101440 0x7fef88073140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fef7000b4b0 tx=0x7fef7000b870 comp rx=0 tx=0).stop 2024-02-28T16:35:27.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 shutdown_connections 2024-02-28T16:35:27.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef88100240 0x7fef88074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fef6c06d8a0 0x7fef6c06fd50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 --2- 172.21.15.23:0/1673228706 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fef88101440 0x7fef88073140 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.427+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 >> 172.21.15.23:0/1673228706 conn(0x7fef880fb7f0 msgr2=0x7fef88104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:27.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.428+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 shutdown_connections 2024-02-28T16:35:27.417 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.428+0000 7fef8e600700 1 -- 172.21.15.23:0/1673228706 wait complete. 2024-02-28T16:35:27.432 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.592+0000 7f9d62800700 1 -- 172.21.15.23:0/260105120 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c069270 msgr2=0x7f9d5c102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.592+0000 7f9d62800700 1 --2- 172.21.15.23:0/260105120 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c069270 0x7f9d5c102dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009910 tx=0x7f9d4c009c20 comp rx=0 tx=0).stop 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.592+0000 7f9d62800700 1 -- 172.21.15.23:0/260105120 shutdown_connections 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.592+0000 7f9d62800700 1 --2- 172.21.15.23:0/260105120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d5c103310 0x7f9d5c105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.592+0000 7f9d62800700 1 --2- 172.21.15.23:0/260105120 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c069270 0x7f9d5c102dd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.592+0000 7f9d62800700 1 -- 172.21.15.23:0/260105120 >> 172.21.15.23:0/260105120 conn(0x7f9d5c0fa780 msgr2=0x7f9d5c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.593+0000 7f9d62800700 1 -- 172.21.15.23:0/260105120 shutdown_connections 2024-02-28T16:35:27.581 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.593+0000 7f9d62800700 1 -- 172.21.15.23:0/260105120 wait complete. 2024-02-28T16:35:27.582 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.595+0000 7f9d62800700 1 Processor -- start 2024-02-28T16:35:27.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.595+0000 7f9d62800700 1 -- start start 2024-02-28T16:35:27.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.595+0000 7f9d62800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c103310 0x7f9d5c197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:27.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.595+0000 7f9d62800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d5c198220 0x7f9d5c19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:27.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.595+0000 7f9d62800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c198690 con 0x7f9d5c103310 2024-02-28T16:35:27.583 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.595+0000 7f9d62800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c198800 con 0x7f9d5c198220 2024-02-28T16:35:27.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.596+0000 7f9d5b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c103310 0x7f9d5c197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:27.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.596+0000 7f9d5b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c103310 0x7f9d5c197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53182/0 (socket says 172.21.15.23:53182) 2024-02-28T16:35:27.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.596+0000 7f9d5b400700 1 -- 172.21.15.23:0/3105528849 learned_addr learned my addr 172.21.15.23:0/3105528849 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:35:27.584 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.596+0000 7f9d5aa00700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d5c198220 0x7f9d5c19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:27.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.596+0000 7f9d5b400700 1 -- 172.21.15.23:0/3105528849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d5c198220 msgr2=0x7f9d5c19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.596+0000 7f9d5b400700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d5c198220 0x7f9d5c19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.596+0000 7f9d5b400700 1 -- 172.21.15.23:0/3105528849 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0095f0 con 0x7f9d5c103310 2024-02-28T16:35:27.585 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.597+0000 7f9d5b400700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c103310 0x7f9d5c197ce0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00bd70 tx=0x7f9d4c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:27.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.597+0000 7f9d53e00700 1 -- 172.21.15.23:0/3105528849 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d4c01d070 con 0x7f9d5c103310 2024-02-28T16:35:27.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.597+0000 7f9d53e00700 1 -- 172.21.15.23:0/3105528849 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d4c00f460 con 0x7f9d5c103310 2024-02-28T16:35:27.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.597+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c19d790 con 0x7f9d5c103310 2024-02-28T16:35:27.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.597+0000 7f9d53e00700 1 -- 172.21.15.23:0/3105528849 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d4c021620 con 0x7f9d5c103310 2024-02-28T16:35:27.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.597+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c19dc50 con 0x7f9d5c103310 2024-02-28T16:35:27.586 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.598+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c0fc340 con 0x7f9d5c103310 2024-02-28T16:35:27.587 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.599+0000 7f9d53e00700 1 -- 172.21.15.23:0/3105528849 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9d4c00fa40 con 0x7f9d5c103310 2024-02-28T16:35:27.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.601+0000 7f9d53e00700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d4006d8a0 0x7f9d4006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:27.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.601+0000 7f9d53e00700 1 -- 172.21.15.23:0/3105528849 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f9d4c08e8b0 con 0x7f9d5c103310 2024-02-28T16:35:27.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.601+0000 7f9d5aa00700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d4006d8a0 0x7f9d4006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:27.589 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.602+0000 7f9d5aa00700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d4006d8a0 0x7f9d4006fd50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005950 tx=0x7f9d480058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:27.594 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.606+0000 7f9d53e00700 1 -- 172.21.15.23:0/3105528849 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9d4c057f90 con 0x7f9d5c103310 2024-02-28T16:35:27.850 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.862+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d5c02cef0 con 0x7f9d4006d8a0 2024-02-28T16:35:27.852 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.864+0000 7f9d53e00700 1 -- 172.21.15.23:0/3105528849 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f9d5c02cef0 con 0x7f9d4006d8a0 2024-02-28T16:35:27.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.867+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d4006d8a0 msgr2=0x7f9d4006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.867+0000 7f9d62800700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d4006d8a0 0x7f9d4006fd50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005950 tx=0x7f9d480058e0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.856 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.867+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c103310 msgr2=0x7f9d5c197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.867+0000 7f9d62800700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c103310 0x7f9d5c197ce0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00bd70 tx=0x7f9d4c00be50 comp rx=0 tx=0).stop 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.868+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 shutdown_connections 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.868+0000 7f9d62800700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9d4006d8a0 0x7f9d4006fd50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.868+0000 7f9d62800700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9d5c103310 0x7f9d5c197ce0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.868+0000 7f9d62800700 1 --2- 172.21.15.23:0/3105528849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d5c198220 0x7f9d5c19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.868+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 >> 172.21.15.23:0/3105528849 conn(0x7f9d5c0fa780 msgr2=0x7f9d5c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.868+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 shutdown_connections 2024-02-28T16:35:27.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:27.868+0000 7f9d62800700 1 -- 172.21.15.23:0/3105528849 wait complete. 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.028+0000 7fbb1d400700 1 -- 172.21.15.23:0/799481933 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 msgr2=0x7fbb18100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.028+0000 7fbb1d400700 1 --2- 172.21.15.23:0/799481933 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18100650 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009910 tx=0x7fbb08009c20 comp rx=0 tx=0).stop 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.028+0000 7fbb1d400700 1 -- 172.21.15.23:0/799481933 shutdown_connections 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.028+0000 7fbb1d400700 1 --2- 172.21.15.23:0/799481933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb18101440 0x7fbb18101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.028+0000 7fbb1d400700 1 --2- 172.21.15.23:0/799481933 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18100650 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.028+0000 7fbb1d400700 1 -- 172.21.15.23:0/799481933 >> 172.21.15.23:0/799481933 conn(0x7fbb180fb7f0 msgr2=0x7fbb180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.029+0000 7fbb1d400700 1 -- 172.21.15.23:0/799481933 shutdown_connections 2024-02-28T16:35:28.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.029+0000 7fbb1d400700 1 -- 172.21.15.23:0/799481933 wait complete. 2024-02-28T16:35:28.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.030+0000 7fbb1d400700 1 Processor -- start 2024-02-28T16:35:28.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.030+0000 7fbb1d400700 1 -- start start 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.030+0000 7fbb1d400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.030+0000 7fbb1d400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb18101440 0x7fbb18073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.030+0000 7fbb1d400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18073680 con 0x7fbb18100240 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.030+0000 7fbb1d400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180737c0 con 0x7fbb18101440 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb16800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb16800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53190/0 (socket says 172.21.15.23:53190) 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb16800700 1 -- 172.21.15.23:0/2185107028 learned_addr learned my addr 172.21.15.23:0/2185107028 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb0de00700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb18101440 0x7fbb18073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:28.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb16800700 1 -- 172.21.15.23:0/2185107028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb18101440 msgr2=0x7fbb18073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.020 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb16800700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb18101440 0x7fbb18073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.020 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb16800700 1 -- 172.21.15.23:0/2185107028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080095f0 con 0x7fbb18100240 2024-02-28T16:35:28.020 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.031+0000 7fbb0de00700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb18101440 0x7fbb18073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:35:28.020 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.032+0000 7fbb16800700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18074af0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800bd70 tx=0x7fbb0800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:28.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.032+0000 7fbb0fe00700 1 -- 172.21.15.23:0/2185107028 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0801d070 con 0x7fbb18100240 2024-02-28T16:35:28.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.032+0000 7fbb0fe00700 1 -- 172.21.15.23:0/2185107028 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb0800f460 con 0x7fbb18100240 2024-02-28T16:35:28.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.032+0000 7fbb0fe00700 1 -- 172.21.15.23:0/2185107028 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb08021620 con 0x7fbb18100240 2024-02-28T16:35:28.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.032+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb18073a40 con 0x7fbb18100240 2024-02-28T16:35:28.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.032+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb18073f30 con 0x7fbb18100240 2024-02-28T16:35:28.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.033+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb18108d90 con 0x7fbb18100240 2024-02-28T16:35:28.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.034+0000 7fbb0fe00700 1 -- 172.21.15.23:0/2185107028 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbb0800fa40 con 0x7fbb18100240 2024-02-28T16:35:28.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.035+0000 7fbb0fe00700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbafc06d8a0 0x7fbafc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:28.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.035+0000 7fbb0fe00700 1 -- 172.21.15.23:0/2185107028 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbb0808e850 con 0x7fbb18100240 2024-02-28T16:35:28.024 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.036+0000 7fbb0de00700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbafc06d8a0 0x7fbafc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:28.024 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.036+0000 7fbb0de00700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbafc06d8a0 0x7fbafc06fd50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb00005fd0 tx=0x7fbb00005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:28.029 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.041+0000 7fbb0fe00700 1 -- 172.21.15.23:0/2185107028 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbb0805ba60 con 0x7fbb18100240 2024-02-28T16:35:28.292 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.304+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb1819dff0 con 0x7fbafc06d8a0 2024-02-28T16:35:28.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.333+0000 7fbb0fe00700 1 -- 172.21.15.23:0/2185107028 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fbb1819dff0 con 0x7fbafc06d8a0 2024-02-28T16:35:28.322 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:35:28.322 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (39s) 31s ago 22m 14.0M - 0.25.0 c8568f914cd2 426b853f4a23 2024-02-28T16:35:28.322 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (2m) 31s ago 22m 7968k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 64317e9be9ba 2024-02-28T16:35:28.322 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (117s) 85s ago 21m 7583k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 942e64d3de96 2024-02-28T16:35:28.323 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (8m) 31s ago 22m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:35:28.323 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (7m) 85s ago 21m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:35:28.323 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (20m) 31s ago 21m 72.3M - 9.4.7 954c08fa6188 9fceda90732d 2024-02-28T16:35:28.323 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (3m) 31s ago 15m 13.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:35:28.323 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (3m) 31s ago 15m 87.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:35:28.323 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (2m) 85s ago 15m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b4ff1f848efc 2024-02-28T16:35:28.324 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (2m) 85s ago 15m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:35:28.324 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (11m) 31s ago 24m 513M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:35:28.324 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (10m) 85s ago 21m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:35:28.324 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (9m) 31s ago 24m 60.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:35:28.324 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (9m) 85s ago 20m 45.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:35:28.324 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (96s) 31s ago 22m 7763k - 1.5.0 0da6a335fe13 5ea0d01203ff 2024-02-28T16:35:28.325 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (89s) 85s ago 21m 2902k - 1.5.0 0da6a335fe13 d4b7c7fb1fb7 2024-02-28T16:35:28.325 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (7m) 31s ago 19m 101M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:35:28.325 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (6m) 31s ago 19m 113M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:35:28.325 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (6m) 31s ago 18m 102M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:35:28.325 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (5m) 85s ago 18m 120M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:35:28.325 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (5m) 85s ago 17m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:35:28.326 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (4m) 85s ago 16m 95.3M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:35:28.326 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (64s) 31s ago 21m 54.1M - 2.43.0 a07b618ecd1d 4214bcd1aafd 2024-02-28T16:35:28.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.336+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbafc06d8a0 msgr2=0x7fbafc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.336+0000 7fbb1d400700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbafc06d8a0 0x7fbafc06fd50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb00005fd0 tx=0x7fbb00005ee0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.327 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.336+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 msgr2=0x7fbb18074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.336+0000 7fbb1d400700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18074af0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800bd70 tx=0x7fbb0800be50 comp rx=0 tx=0).stop 2024-02-28T16:35:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.337+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 shutdown_connections 2024-02-28T16:35:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.337+0000 7fbb1d400700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbafc06d8a0 0x7fbafc06fd50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.328 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.337+0000 7fbb1d400700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb18100240 0x7fbb18074af0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.337+0000 7fbb1d400700 1 --2- 172.21.15.23:0/2185107028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb18101440 0x7fbb18073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.337+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 >> 172.21.15.23:0/2185107028 conn(0x7fbb180fb7f0 msgr2=0x7fbb18104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:28.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.337+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 shutdown_connections 2024-02-28T16:35:28.329 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.337+0000 7fbb1d400700 1 -- 172.21.15.23:0/2185107028 wait complete. 2024-02-28T16:35:28.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.507+0000 7f4c33200700 1 -- 172.21.15.23:0/3913744957 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c34100ab0 msgr2=0x7f4c34102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.507+0000 7f4c33200700 1 --2- 172.21.15.23:0/3913744957 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c34100ab0 0x7f4c34102e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009910 tx=0x7f4c24009c20 comp rx=0 tx=0).stop 2024-02-28T16:35:28.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.508+0000 7f4c33200700 1 -- 172.21.15.23:0/3913744957 shutdown_connections 2024-02-28T16:35:28.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.508+0000 7f4c33200700 1 --2- 172.21.15.23:0/3913744957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c341033d0 0x7f4c341057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.508+0000 7f4c33200700 1 --2- 172.21.15.23:0/3913744957 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c34100ab0 0x7f4c34102e90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.508+0000 7f4c33200700 1 -- 172.21.15.23:0/3913744957 >> 172.21.15.23:0/3913744957 conn(0x7f4c340fa4d0 msgr2=0x7f4c340fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:28.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.508+0000 7f4c33200700 1 -- 172.21.15.23:0/3913744957 shutdown_connections 2024-02-28T16:35:28.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.508+0000 7f4c33200700 1 -- 172.21.15.23:0/3913744957 wait complete. 2024-02-28T16:35:28.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.510+0000 7f4c33200700 1 Processor -- start 2024-02-28T16:35:28.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.510+0000 7f4c33200700 1 -- start start 2024-02-28T16:35:28.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.510+0000 7f4c33200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c34100ab0 0x7f4c34197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:28.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.510+0000 7f4c33200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c341033d0 0x7f4c34197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:28.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.510+0000 7f4c33200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341984d0 con 0x7f4c341033d0 2024-02-28T16:35:28.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.510+0000 7f4c33200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34198610 con 0x7f4c34100ab0 2024-02-28T16:35:28.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c341033d0 0x7f4c34197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:28.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c341033d0 0x7f4c34197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53202/0 (socket says 172.21.15.23:53202) 2024-02-28T16:35:28.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31400700 1 -- 172.21.15.23:0/4178905958 learned_addr learned my addr 172.21.15.23:0/4178905958 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:35:28.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31e00700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c34100ab0 0x7f4c34197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:28.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31400700 1 -- 172.21.15.23:0/4178905958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c34100ab0 msgr2=0x7f4c34197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31400700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c34100ab0 0x7f4c34197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31400700 1 -- 172.21.15.23:0/4178905958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240095f0 con 0x7f4c341033d0 2024-02-28T16:35:28.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.511+0000 7f4c31400700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c341033d0 0x7f4c34197f40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c930 tx=0x7f4c2000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:28.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.512+0000 7f4c2aa00700 1 -- 172.21.15.23:0/4178905958 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c20007ad0 con 0x7f4c341033d0 2024-02-28T16:35:28.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.512+0000 7f4c2aa00700 1 -- 172.21.15.23:0/4178905958 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c20007c30 con 0x7f4c341033d0 2024-02-28T16:35:28.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.512+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3419d0d0 con 0x7f4c341033d0 2024-02-28T16:35:28.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.512+0000 7f4c2aa00700 1 -- 172.21.15.23:0/4178905958 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c20018630 con 0x7f4c341033d0 2024-02-28T16:35:28.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.512+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3419d5f0 con 0x7f4c341033d0 2024-02-28T16:35:28.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.513+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c340fc090 con 0x7f4c341033d0 2024-02-28T16:35:28.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.514+0000 7f4c2aa00700 1 -- 172.21.15.23:0/4178905958 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f4c2000f450 con 0x7f4c341033d0 2024-02-28T16:35:28.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.515+0000 7f4c2aa00700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4c1806d8a0 0x7f4c1806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:28.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.515+0000 7f4c2aa00700 1 -- 172.21.15.23:0/4178905958 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f4c2008d780 con 0x7f4c341033d0 2024-02-28T16:35:28.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.515+0000 7f4c31e00700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4c1806d8a0 0x7f4c1806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:28.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.516+0000 7f4c31e00700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4c1806d8a0 0x7f4c1806fd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c24006010 tx=0x7f4c2400b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:28.508 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.520+0000 7f4c2aa00700 1 -- 172.21.15.23:0/4178905958 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4c2005a990 con 0x7f4c341033d0 2024-02-28T16:35:28.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.868+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c3402cc30 con 0x7f4c341033d0 2024-02-28T16:35:28.857 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.869+0000 7f4c2aa00700 1 -- 172.21.15.23:0/4178905958 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f4c2005a520 con 0x7f4c341033d0 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:35:28.858 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:35:28.859 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:35:28.859 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:35:28.859 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:35:28.859 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:35:28.859 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:35:28.859 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:35:28.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4c1806d8a0 msgr2=0x7f4c1806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4c1806d8a0 0x7f4c1806fd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c24006010 tx=0x7f4c2400b540 comp rx=0 tx=0).stop 2024-02-28T16:35:28.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c341033d0 msgr2=0x7f4c34197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:28.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c341033d0 0x7f4c34197f40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c930 tx=0x7f4c2000ccf0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 shutdown_connections 2024-02-28T16:35:28.860 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c34100ab0 0x7f4c34197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f4c1806d8a0 0x7f4c1806fd50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 --2- 172.21.15.23:0/4178905958 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f4c341033d0 0x7f4c34197f40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:28.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 >> 172.21.15.23:0/4178905958 conn(0x7f4c340fa4d0 msgr2=0x7f4c340ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:28.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 shutdown_connections 2024-02-28T16:35:28.861 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:28.872+0000 7f4c33200700 1 -- 172.21.15.23:0/4178905958 wait complete. 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 -- 172.21.15.23:0/1140839047 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 msgr2=0x7f6a98073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 --2- 172.21.15.23:0/1140839047 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a98073c20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009910 tx=0x7f6a84009c20 comp rx=0 tx=0).stop 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 -- 172.21.15.23:0/1140839047 shutdown_connections 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 --2- 172.21.15.23:0/1140839047 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a98073c20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 --2- 172.21.15.23:0/1140839047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a98074d80 0x7f6a980731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 -- 172.21.15.23:0/1140839047 >> 172.21.15.23:0/1140839047 conn(0x7f6a980fb7f0 msgr2=0x7f6a980fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 -- 172.21.15.23:0/1140839047 shutdown_connections 2024-02-28T16:35:29.015 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.026+0000 7f6a9e400700 1 -- 172.21.15.23:0/1140839047 wait complete. 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.027+0000 7f6a9e400700 1 Processor -- start 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.027+0000 7f6a9e400700 1 -- start start 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a9e400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a9819c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a9e400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a98074d80 0x7f6a9819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a9e400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9819cc00 con 0x7f6a980737b0 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a9e400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9819cd40 con 0x7f6a98074d80 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a97400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a9819c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a97400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a9819c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53230/0 (socket says 172.21.15.23:53230) 2024-02-28T16:35:29.017 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a97400700 1 -- 172.21.15.23:0/316706007 learned_addr learned my addr 172.21.15.23:0/316706007 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:35:29.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.028+0000 7f6a96a00700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a98074d80 0x7f6a9819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a97400700 1 -- 172.21.15.23:0/316706007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a98074d80 msgr2=0x7f6a9819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a97400700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a98074d80 0x7f6a9819c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a97400700 1 -- 172.21.15.23:0/316706007 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a840095f0 con 0x7f6a980737b0 2024-02-28T16:35:29.018 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a97400700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a9819c0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800c8f0 tx=0x7f6a8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a8fe00700 1 -- 172.21.15.23:0/316706007 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a88007a70 con 0x7f6a980737b0 2024-02-28T16:35:29.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a8fe00700 1 -- 172.21.15.23:0/316706007 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a88004ce0 con 0x7f6a980737b0 2024-02-28T16:35:29.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a8fe00700 1 -- 172.21.15.23:0/316706007 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a88005610 con 0x7f6a980737b0 2024-02-28T16:35:29.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.029+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a981a17f0 con 0x7f6a980737b0 2024-02-28T16:35:29.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.030+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981a1d40 con 0x7f6a980737b0 2024-02-28T16:35:29.019 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.031+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9810f3a0 con 0x7f6a980737b0 2024-02-28T16:35:29.020 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.032+0000 7f6a8fe00700 1 -- 172.21.15.23:0/316706007 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6a88004750 con 0x7f6a980737b0 2024-02-28T16:35:29.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.033+0000 7f6a8fe00700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6a7c06d8a0 0x7f6a7c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.033+0000 7f6a8fe00700 1 -- 172.21.15.23:0/316706007 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f6a88013070 con 0x7f6a980737b0 2024-02-28T16:35:29.021 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.033+0000 7f6a96a00700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6a7c06d8a0 0x7f6a7c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.023 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.034+0000 7f6a96a00700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6a7c06d8a0 0x7f6a7c06fd50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006010 tx=0x7f6a8400b580 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.027 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.038+0000 7f6a8fe00700 1 -- 172.21.15.23:0/316706007 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6a8805a6b0 con 0x7f6a980737b0 2024-02-28T16:35:29.283 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:29 smithi023 ceph-mon[78509]: pgmap v326: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:29.284 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:29 smithi023 ceph-mon[78509]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:29.284 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:29 smithi023 ceph-mon[78509]: from='client.34636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:29.284 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:29 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/4178905958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:29.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.311+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a981a2440 con 0x7f6a980737b0 2024-02-28T16:35:29.300 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.312+0000 7f6a8fe00700 1 -- 172.21.15.23:0/316706007 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1873 (secure 0 0 0) 0x7f6a8805a240 con 0x7f6a980737b0 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:e36 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 36 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:35:29.301 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:33:05.948811+0000 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 85 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:35:29.302 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=34420} 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{0:34420} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:35:29.303 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:35:29.304 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:35:29.304 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:35:29.304 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:35:29.304 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:44333} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6a7c06d8a0 msgr2=0x7f6a7c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6a7c06d8a0 0x7f6a7c06fd50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006010 tx=0x7f6a8400b580 comp rx=0 tx=0).stop 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 msgr2=0x7f6a9819c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a9819c0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800c8f0 tx=0x7f6a8800ccb0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 shutdown_connections 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6a7c06d8a0 0x7f6a7c06fd50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6a980737b0 0x7f6a9819c0a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 --2- 172.21.15.23:0/316706007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a98074d80 0x7f6a9819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 >> 172.21.15.23:0/316706007 conn(0x7f6a980fb7f0 msgr2=0x7f6a98101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.315+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 shutdown_connections 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.316+0000 7f6a9e400700 1 -- 172.21.15.23:0/316706007 wait complete. 2024-02-28T16:35:29.305 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 36 2024-02-28T16:35:29.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:29 smithi153 ceph-mon[66339]: pgmap v326: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:29.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:29 smithi153 ceph-mon[66339]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:29.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:29 smithi153 ceph-mon[66339]: from='client.34636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:29.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:29 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/4178905958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:29.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 -- 172.21.15.23:0/1783203603 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 msgr2=0x7fd22c073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 --2- 172.21.15.23:0/1783203603 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c073c20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd218009910 tx=0x7fd218009c20 comp rx=0 tx=0).stop 2024-02-28T16:35:29.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 -- 172.21.15.23:0/1783203603 shutdown_connections 2024-02-28T16:35:29.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 --2- 172.21.15.23:0/1783203603 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c073c20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 --2- 172.21.15.23:0/1783203603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd22c074d80 0x7fd22c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 -- 172.21.15.23:0/1783203603 >> 172.21.15.23:0/1783203603 conn(0x7fd22c0fb7f0 msgr2=0x7fd22c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:29.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 -- 172.21.15.23:0/1783203603 shutdown_connections 2024-02-28T16:35:29.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.473+0000 7fd232600700 1 -- 172.21.15.23:0/1783203603 wait complete. 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.474+0000 7fd232600700 1 Processor -- start 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd232600700 1 -- start start 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd232600700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd232600700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd22c074d80 0x7fd22c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd232600700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c19cb40 con 0x7fd22c0737b0 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd232600700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c19cc80 con 0x7fd22c074d80 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd22b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd22b400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c19c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33170/0 (socket says 172.21.15.23:33170) 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.475+0000 7fd22b400700 1 -- 172.21.15.23:0/967499774 learned_addr learned my addr 172.21.15.23:0/967499774 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:35:29.465 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.476+0000 7fd22aa00700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd22c074d80 0x7fd22c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.476+0000 7fd22b400700 1 -- 172.21.15.23:0/967499774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd22c074d80 msgr2=0x7fd22c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.476+0000 7fd22b400700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd22c074d80 0x7fd22c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.476+0000 7fd22b400700 1 -- 172.21.15.23:0/967499774 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180095f0 con 0x7fd22c0737b0 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.476+0000 7fd22b400700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c19c070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c930 tx=0x7fd21c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.476+0000 7fd223e00700 1 -- 172.21.15.23:0/967499774 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd21c007ad0 con 0x7fd22c0737b0 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.477+0000 7fd223e00700 1 -- 172.21.15.23:0/967499774 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd21c007c30 con 0x7fd22c0737b0 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.477+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c1a1740 con 0x7fd22c0737b0 2024-02-28T16:35:29.466 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.477+0000 7fd223e00700 1 -- 172.21.15.23:0/967499774 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd21c018630 con 0x7fd22c0737b0 2024-02-28T16:35:29.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.477+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c1a1c10 con 0x7fd22c0737b0 2024-02-28T16:35:29.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.478+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c10f380 con 0x7fd22c0737b0 2024-02-28T16:35:29.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.479+0000 7fd223e00700 1 -- 172.21.15.23:0/967499774 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd21c00f450 con 0x7fd22c0737b0 2024-02-28T16:35:29.469 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.481+0000 7fd223e00700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd21006d8a0 0x7fd21006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.469 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.481+0000 7fd223e00700 1 -- 172.21.15.23:0/967499774 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd21c08d870 con 0x7fd22c0737b0 2024-02-28T16:35:29.469 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.481+0000 7fd22aa00700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd21006d8a0 0x7fd21006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.470 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.482+0000 7fd22aa00700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd21006d8a0 0x7fd21006fd50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd218006010 tx=0x7fd21800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.486+0000 7fd223e00700 1 -- 172.21.15.23:0/967499774 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd21c05aa00 con 0x7fd22c0737b0 2024-02-28T16:35:29.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.800+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd22c1031e0 con 0x7fd21006d8a0 2024-02-28T16:35:29.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.802+0000 7fd223e00700 1 -- 172.21.15.23:0/967499774 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fd22c1031e0 con 0x7fd21006d8a0 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": true, 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [ 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr", 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout: "mds", 2024-02-28T16:35:29.790 INFO:teuthology.orchestra.run.smithi023.stdout: "crash", 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout: "osd", 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout: "mon", 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph-exporter" 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout: ], 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": "18/23 daemons upgraded", 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "Currently upgrading grafana daemons", 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:35:29.791 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd21006d8a0 msgr2=0x7fd21006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd21006d8a0 0x7fd21006fd50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd218006010 tx=0x7fd21800b540 comp rx=0 tx=0).stop 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 msgr2=0x7fd22c19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c19c070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c930 tx=0x7fd21c00ccf0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 shutdown_connections 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd21006d8a0 0x7fd21006fd50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd22c0737b0 0x7fd22c19c070 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 --2- 172.21.15.23:0/967499774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd22c074d80 0x7fd22c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.804+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 >> 172.21.15.23:0/967499774 conn(0x7fd22c0fb7f0 msgr2=0x7fd22c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.805+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 shutdown_connections 2024-02-28T16:35:29.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.805+0000 7fd232600700 1 -- 172.21.15.23:0/967499774 wait complete. 2024-02-28T16:35:29.953 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 -- 172.21.15.23:0/596673321 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 msgr2=0x7f1c58100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.953 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 --2- 172.21.15.23:0/596673321 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c58100840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009910 tx=0x7f1c44009c20 comp rx=0 tx=0).stop 2024-02-28T16:35:29.953 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 -- 172.21.15.23:0/596673321 shutdown_connections 2024-02-28T16:35:29.953 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 --2- 172.21.15.23:0/596673321 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c58100840 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.954 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 --2- 172.21.15.23:0/596673321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c580ff130 0x7f1c580ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.954 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 -- 172.21.15.23:0/596673321 >> 172.21.15.23:0/596673321 conn(0x7f1c580fa780 msgr2=0x7f1c580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:29.954 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 -- 172.21.15.23:0/596673321 shutdown_connections 2024-02-28T16:35:29.954 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.965+0000 7f1c60400700 1 -- 172.21.15.23:0/596673321 wait complete. 2024-02-28T16:35:29.954 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.966+0000 7f1c60400700 1 Processor -- start 2024-02-28T16:35:29.954 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c60400700 1 -- start start 2024-02-28T16:35:29.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c60400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c580ff130 0x7f1c58103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c60400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c581017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c60400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c58101cf0 con 0x7f1c581003d0 2024-02-28T16:35:29.955 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c60400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c58101e30 con 0x7f1c580ff130 2024-02-28T16:35:29.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c5d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c581017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c5d000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c581017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33194/0 (socket says 172.21.15.23:33194) 2024-02-28T16:35:29.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.967+0000 7f1c5d000700 1 -- 172.21.15.23:0/914298802 learned_addr learned my addr 172.21.15.23:0/914298802 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:35:29.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.968+0000 7f1c5da00700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c580ff130 0x7f1c58103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.968+0000 7f1c5d000700 1 -- 172.21.15.23:0/914298802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c580ff130 msgr2=0x7f1c58103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.968+0000 7f1c5d000700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c580ff130 0x7f1c58103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.956 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.968+0000 7f1c5d000700 1 -- 172.21.15.23:0/914298802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440095f0 con 0x7f1c581003d0 2024-02-28T16:35:29.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.968+0000 7f1c5d000700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c581017b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c44005b40 tx=0x7f1c4400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.968+0000 7f1c56000700 1 -- 172.21.15.23:0/914298802 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4401d070 con 0x7f1c581003d0 2024-02-28T16:35:29.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.969+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c581020b0 con 0x7f1c581003d0 2024-02-28T16:35:29.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.969+0000 7f1c56000700 1 -- 172.21.15.23:0/914298802 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1c44022470 con 0x7f1c581003d0 2024-02-28T16:35:29.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.969+0000 7f1c56000700 1 -- 172.21.15.23:0/914298802 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4400f690 con 0x7f1c581003d0 2024-02-28T16:35:29.957 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.969+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c581025a0 con 0x7f1c581003d0 2024-02-28T16:35:29.958 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.970+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c58107c10 con 0x7f1c581003d0 2024-02-28T16:35:29.959 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.971+0000 7f1c56000700 1 -- 172.21.15.23:0/914298802 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1c440225e0 con 0x7f1c581003d0 2024-02-28T16:35:29.960 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.972+0000 7f1c56000700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c4006d8a0 0x7f1c4006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.972+0000 7f1c56000700 1 -- 172.21.15.23:0/914298802 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f1c4408ee00 con 0x7f1c581003d0 2024-02-28T16:35:29.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.972+0000 7f1c5da00700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c4006d8a0 0x7f1c4006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.973+0000 7f1c5da00700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c4006d8a0 0x7f1c4006fd50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005fd0 tx=0x7f1c4c00a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.965 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:29.977+0000 7f1c56000700 1 -- 172.21.15.23:0/914298802 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c4405c0b0 con 0x7f1c581003d0 2024-02-28T16:35:30.315 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:30 smithi023 ceph-mon[78509]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:30.315 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:30 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/316706007' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:35:30.316 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:30 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:30.316 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:30 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:30.316 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:30 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:30.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.327+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1c58107dd0 con 0x7f1c581003d0 2024-02-28T16:35:30.316 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.328+0000 7f1c56000700 1 -- 172.21.15.23:0/914298802 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1c44027020 con 0x7f1c581003d0 2024-02-28T16:35:30.317 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:35:30.319 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.331+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c4006d8a0 msgr2=0x7f1c4006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.331+0000 7f1c60400700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c4006d8a0 0x7f1c4006fd50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005fd0 tx=0x7f1c4c00a560 comp rx=0 tx=0).stop 2024-02-28T16:35:30.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.331+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 msgr2=0x7f1c581017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.331+0000 7f1c60400700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c581017b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c44005b40 tx=0x7f1c4400be20 comp rx=0 tx=0).stop 2024-02-28T16:35:30.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.332+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 shutdown_connections 2024-02-28T16:35:30.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.332+0000 7f1c60400700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c580ff130 0x7f1c58103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.320 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.332+0000 7f1c60400700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c4006d8a0 0x7f1c4006fd50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.332+0000 7f1c60400700 1 --2- 172.21.15.23:0/914298802 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c581003d0 0x7f1c581017b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.332+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 >> 172.21.15.23:0/914298802 conn(0x7f1c580fa780 msgr2=0x7f1c58068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:30.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.332+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 shutdown_connections 2024-02-28T16:35:30.321 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:35:30.332+0000 7f1c60400700 1 -- 172.21.15.23:0/914298802 wait complete. 2024-02-28T16:35:30.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:30 smithi153 ceph-mon[66339]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:30.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:30 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/316706007' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:35:30.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:30 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:30.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:30 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:30.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:30 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:31.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:31 smithi153 ceph-mon[66339]: pgmap v327: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:31.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:31 smithi153 ceph-mon[66339]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:31.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:31 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/914298802' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:35:31.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:31 smithi023 ceph-mon[78509]: pgmap v327: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:31.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:31 smithi023 ceph-mon[78509]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:31.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:31 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/914298802' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:35:33.311 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:33 smithi023 ceph-mon[78509]: pgmap v328: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:33.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:33 smithi153 ceph-mon[66339]: pgmap v328: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:35.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:35 smithi153 ceph-mon[66339]: pgmap v329: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:35.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:35 smithi023 ceph-mon[78509]: pgmap v329: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:37 smithi153 ceph-mon[66339]: pgmap v330: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:37 smithi023 ceph-mon[78509]: pgmap v330: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:37.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:39.397 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:39 smithi023 ceph-mon[78509]: pgmap v331: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:39.397 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:39 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:39.397 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:39 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:39.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:39 smithi153 ceph-mon[66339]: pgmap v331: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:39.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:39 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:39.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:39 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:41.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:41 smithi023 ceph-mon[78509]: pgmap v332: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:41.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:41 smithi153 ceph-mon[66339]: pgmap v332: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:43.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:43 smithi023 ceph-mon[78509]: pgmap v333: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:43.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:43 smithi153 ceph-mon[66339]: pgmap v333: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:45.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: pgmap v334: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:45.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:45.145 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.146 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: Upgrade: Finalizing container_image settings 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:35:45.148 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:35:45.149 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:45.150 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:44 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: pgmap v334: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:35:45.173 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.174 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:45.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: Upgrade: Finalizing container_image settings 2024-02-28T16:35:45.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.175 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:35:45.176 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:35:45.177 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:45.178 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:44 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:46.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:45 smithi153 ceph-mon[66339]: Upgrade: Complete! 2024-02-28T16:35:46.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:45 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:46.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:45 smithi023 ceph-mon[78509]: Upgrade: Complete! 2024-02-28T16:35:46.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:45 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:46.942 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:46 smithi023 ceph-mon[78509]: pgmap v335: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:46.942 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:47.046 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:46 smithi153 ceph-mon[66339]: pgmap v335: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:47.046 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:35:49.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:48 smithi153 ceph-mon[66339]: pgmap v336: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:49.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:48 smithi023 ceph-mon[78509]: pgmap v336: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:51.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:50 smithi153 ceph-mon[66339]: pgmap v337: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:50 smithi023 ceph-mon[78509]: pgmap v337: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:52.103 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:52.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:53.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:52 smithi153 ceph-mon[66339]: pgmap v338: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:53.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:52 smithi023 ceph-mon[78509]: pgmap v338: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:54.975 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:54 smithi023 ceph-mon[78509]: pgmap v339: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:55.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:54 smithi153 ceph-mon[66339]: pgmap v339: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:56.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:56 smithi023 ceph-mon[78509]: pgmap v340: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:57.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:56 smithi153 ceph-mon[66339]: pgmap v340: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:59.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:35:58 smithi153 ceph-mon[66339]: pgmap v341: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:35:59.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:35:58 smithi023 ceph-mon[78509]: pgmap v341: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.510+0000 7fc8c9000700 1 -- 172.21.15.23:0/1942637795 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 msgr2=0x7fc8c40731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.510+0000 7fc8c9000700 1 --2- 172.21.15.23:0/1942637795 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c40731e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009910 tx=0x7fc8b4009c20 comp rx=0 tx=0).stop 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.510+0000 7fc8c9000700 1 -- 172.21.15.23:0/1942637795 shutdown_connections 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.510+0000 7fc8c9000700 1 --2- 172.21.15.23:0/1942637795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c40737b0 0x7fc8c4073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.510+0000 7fc8c9000700 1 --2- 172.21.15.23:0/1942637795 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c40731e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.510+0000 7fc8c9000700 1 -- 172.21.15.23:0/1942637795 >> 172.21.15.23:0/1942637795 conn(0x7fc8c40fb7f0 msgr2=0x7fc8c40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.511+0000 7fc8c9000700 1 -- 172.21.15.23:0/1942637795 shutdown_connections 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.511+0000 7fc8c9000700 1 -- 172.21.15.23:0/1942637795 wait complete. 2024-02-28T16:36:00.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.512+0000 7fc8c9000700 1 Processor -- start 2024-02-28T16:36:00.501 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.512+0000 7fc8c9000700 1 -- start start 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.512+0000 7fc8c9000700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c40737b0 0x7fc8c419c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.512+0000 7fc8c9000700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.512+0000 7fc8c9000700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c419cbc0 con 0x7fc8c4074d80 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.512+0000 7fc8c9000700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c419cd00 con 0x7fc8c40737b0 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.513+0000 7fc8bbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.513+0000 7fc8bbe00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c419c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:55128/0 (socket says 172.21.15.23:55128) 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.513+0000 7fc8bbe00700 1 -- 172.21.15.23:0/999851154 learned_addr learned my addr 172.21.15.23:0/999851154 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.513+0000 7fc8c1e00700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c40737b0 0x7fc8c419c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.513+0000 7fc8bbe00700 1 -- 172.21.15.23:0/999851154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c40737b0 msgr2=0x7fc8c419c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.513+0000 7fc8bbe00700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c40737b0 0x7fc8c419c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.513+0000 7fc8bbe00700 1 -- 172.21.15.23:0/999851154 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b40095f0 con 0x7fc8c4074d80 2024-02-28T16:36:00.502 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.514+0000 7fc8bbe00700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c419c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c8a0 tx=0x7fc8ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:00.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.514+0000 7fc8baa00700 1 -- 172.21.15.23:0/999851154 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ac00cea0 con 0x7fc8c4074d80 2024-02-28T16:36:00.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.514+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c41a17b0 con 0x7fc8c4074d80 2024-02-28T16:36:00.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.514+0000 7fc8baa00700 1 -- 172.21.15.23:0/999851154 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8ac004830 con 0x7fc8c4074d80 2024-02-28T16:36:00.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.514+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c41a1d00 con 0x7fc8c4074d80 2024-02-28T16:36:00.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.514+0000 7fc8baa00700 1 -- 172.21.15.23:0/999851154 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ac0055d0 con 0x7fc8c4074d80 2024-02-28T16:36:00.503 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.515+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c410f370 con 0x7fc8c4074d80 2024-02-28T16:36:00.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.517+0000 7fc8baa00700 1 -- 172.21.15.23:0/999851154 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc8ac0049a0 con 0x7fc8c4074d80 2024-02-28T16:36:00.505 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.518+0000 7fc8baa00700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc8a806d8a0 0x7fc8a806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:00.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.518+0000 7fc8baa00700 1 -- 172.21.15.23:0/999851154 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc8ac08d690 con 0x7fc8c4074d80 2024-02-28T16:36:00.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.518+0000 7fc8c1e00700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc8a806d8a0 0x7fc8a806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:00.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.519+0000 7fc8c1e00700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc8a806d8a0 0x7fc8a806fd50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40059d0 tx=0x7fc8b4005920 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:00.511 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.523+0000 7fc8baa00700 1 -- 172.21.15.23:0/999851154 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc8ac05a820 con 0x7fc8c4074d80 2024-02-28T16:36:00.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.783+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8c41032f0 con 0x7fc8a806d8a0 2024-02-28T16:36:00.771 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:00 smithi023 ceph-mon[78509]: pgmap v342: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:00.774 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.786+0000 7fc8baa00700 1 -- 172.21.15.23:0/999851154 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc8c41032f0 con 0x7fc8a806d8a0 2024-02-28T16:36:00.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc8a806d8a0 msgr2=0x7fc8a806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:00.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc8a806d8a0 0x7fc8a806fd50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40059d0 tx=0x7fc8b4005920 comp rx=0 tx=0).stop 2024-02-28T16:36:00.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 msgr2=0x7fc8c419c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:00.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c419c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c8a0 tx=0x7fc8ac00cc60 comp rx=0 tx=0).stop 2024-02-28T16:36:00.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 shutdown_connections 2024-02-28T16:36:00.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c40737b0 0x7fc8c419c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:00.777 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc8a806d8a0 0x7fc8a806fd50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:00.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 --2- 172.21.15.23:0/999851154 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc8c4074d80 0x7fc8c419c5a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:00.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 >> 172.21.15.23:0/999851154 conn(0x7fc8c40fb7f0 msgr2=0x7fc8c4101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:00.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 shutdown_connections 2024-02-28T16:36:00.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:00.789+0000 7fc8c9000700 1 -- 172.21.15.23:0/999851154 wait complete. 2024-02-28T16:36:01.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:00 smithi153 ceph-mon[66339]: pgmap v342: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:01.571 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T16:36:01.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:01 smithi023 ceph-mon[78509]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:02.053 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:36:02.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:01 smithi153 ceph-mon[66339]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:02.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:02 smithi023 ceph-mon[78509]: pgmap v343: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:03.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:02 smithi153 ceph-mon[66339]: pgmap v343: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:04.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 -- 172.21.15.23:0/2613046553 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff4740739a0 msgr2=0x7ff47410c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 --2- 172.21.15.23:0/2613046553 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff4740739a0 0x7ff47410c5e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009940 tx=0x7ff45c009c50 comp rx=0 tx=0).stop 2024-02-28T16:36:04.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 -- 172.21.15.23:0/2613046553 shutdown_connections 2024-02-28T16:36:04.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 --2- 172.21.15.23:0/2613046553 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff4740739a0 0x7ff47410c5e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.351 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 --2- 172.21.15.23:0/2613046553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff474073090 0x7ff474073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 -- 172.21.15.23:0/2613046553 >> 172.21.15.23:0/2613046553 conn(0x7ff4740fbda0 msgr2=0x7ff4740fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:04.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 -- 172.21.15.23:0/2613046553 shutdown_connections 2024-02-28T16:36:04.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.362+0000 7ff47bc00700 1 -- 172.21.15.23:0/2613046553 wait complete. 2024-02-28T16:36:04.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.364+0000 7ff47bc00700 1 Processor -- start 2024-02-28T16:36:04.352 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.364+0000 7ff47bc00700 1 -- start start 2024-02-28T16:36:04.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff47bc00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff474073090 0x7ff4741981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff47bc00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740739a0 0x7ff4741986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff47bc00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474198dd0 con 0x7ff474073090 2024-02-28T16:36:04.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff47bc00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47419cb60 con 0x7ff4740739a0 2024-02-28T16:36:04.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff479200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff474073090 0x7ff4741981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff479200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff474073090 0x7ff4741981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:55154/0 (socket says 172.21.15.23:55154) 2024-02-28T16:36:04.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff479200700 1 -- 172.21.15.23:0/646282440 learned_addr learned my addr 172.21.15.23:0/646282440 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:36:04.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.365+0000 7ff46be00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740739a0 0x7ff4741986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.366+0000 7ff479200700 1 -- 172.21.15.23:0/646282440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740739a0 msgr2=0x7ff4741986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.366+0000 7ff479200700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740739a0 0x7ff4741986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.366+0000 7ff479200700 1 -- 172.21.15.23:0/646282440 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0095f0 con 0x7ff474073090 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.366+0000 7ff46be00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740739a0 0x7ff4741986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.366+0000 7ff479200700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff474073090 0x7ff4741981b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff46400d8d0 tx=0x7ff46400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.366+0000 7ff472000700 1 -- 172.21.15.23:0/646282440 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff464009940 con 0x7ff474073090 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.367+0000 7ff472000700 1 -- 172.21.15.23:0/646282440 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff464010460 con 0x7ff474073090 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.367+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47419ce40 con 0x7ff474073090 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.367+0000 7ff472000700 1 -- 172.21.15.23:0/646282440 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff46400f5f0 con 0x7ff474073090 2024-02-28T16:36:04.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.367+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47419d390 con 0x7ff474073090 2024-02-28T16:36:04.356 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.368+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474109ce0 con 0x7ff474073090 2024-02-28T16:36:04.357 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.369+0000 7ff472000700 1 -- 172.21.15.23:0/646282440 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff4640105d0 con 0x7ff474073090 2024-02-28T16:36:04.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.370+0000 7ff472000700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45806d8a0 0x7ff45806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.370+0000 7ff472000700 1 -- 172.21.15.23:0/646282440 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7ff46408d570 con 0x7ff474073090 2024-02-28T16:36:04.358 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.370+0000 7ff46be00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45806d8a0 0x7ff45806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.359 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.371+0000 7ff46be00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45806d8a0 0x7ff45806fd50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff45c005b40 tx=0x7ff45c005ad0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:04.363 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.375+0000 7ff472000700 1 -- 172.21.15.23:0/646282440 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff464056c50 con 0x7ff474073090 2024-02-28T16:36:04.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.616+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff474199620 con 0x7ff45806d8a0 2024-02-28T16:36:04.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.649+0000 7ff472000700 1 -- 172.21.15.23:0/646282440 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7ff474199620 con 0x7ff45806d8a0 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (75s) 28s ago 22m 14.0M - 0.25.0 c8568f914cd2 426b853f4a23 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (2m) 28s ago 23m 8014k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 64317e9be9ba 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (2m) 2m ago 21m 7583k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 942e64d3de96 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (8m) 28s ago 23m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (8m) 2m ago 21m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (35s) 28s ago 22m 51.8M - 9.4.12 a0ea5e3c46d9 91bd0221cbdb 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (4m) 28s ago 15m 13.4M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (4m) 28s ago 15m 86.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (3m) 2m ago 15m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b4ff1f848efc 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (3m) 2m ago 15m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (12m) 28s ago 24m 513M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (10m) 2m ago 21m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:36:04.638 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (10m) 28s ago 24m 61.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (9m) 2m ago 21m 45.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (2m) 28s ago 23m 7642k - 1.5.0 0da6a335fe13 5ea0d01203ff 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (2m) 2m ago 21m 2902k - 1.5.0 0da6a335fe13 d4b7c7fb1fb7 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (8m) 28s ago 20m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (7m) 28s ago 19m 113M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (7m) 28s ago 19m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (6m) 2m ago 18m 120M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (5m) 2m ago 18m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (4m) 2m ago 17m 95.3M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:36:04.639 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (100s) 28s ago 22m 58.0M - 2.43.0 a07b618ecd1d 4214bcd1aafd 2024-02-28T16:36:04.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.651+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45806d8a0 msgr2=0x7ff45806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.651+0000 7ff47bc00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45806d8a0 0x7ff45806fd50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff45c005b40 tx=0x7ff45c005ad0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.651+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff474073090 msgr2=0x7ff4741981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff474073090 0x7ff4741981b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff46400d8d0 tx=0x7ff46400dc90 comp rx=0 tx=0).stop 2024-02-28T16:36:04.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 shutdown_connections 2024-02-28T16:36:04.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff45806d8a0 0x7ff45806fd50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff474073090 0x7ff4741981b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 --2- 172.21.15.23:0/646282440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740739a0 0x7ff4741986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 >> 172.21.15.23:0/646282440 conn(0x7ff4740fbda0 msgr2=0x7ff474106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:04.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 shutdown_connections 2024-02-28T16:36:04.641 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:04.652+0000 7ff47bc00700 1 -- 172.21.15.23:0/646282440 wait complete. 2024-02-28T16:36:04.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:04 smithi023 ceph-mon[78509]: pgmap v344: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:05.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:04 smithi153 ceph-mon[66339]: pgmap v344: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:05.473 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade status' 2024-02-28T16:36:05.921 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:36:06.045 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:05 smithi023 ceph-mon[78509]: from='client.34664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:06.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:05 smithi153 ceph-mon[66339]: from='client.34664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:06.981 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:06 smithi023 ceph-mon[78509]: pgmap v345: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:06.981 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:07.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:06 smithi153 ceph-mon[66339]: pgmap v345: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:07.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:08.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 -- 172.21.15.23:0/3202456068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 msgr2=0x7f76a80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:08.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 --2- 172.21.15.23:0/3202456068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a80689b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7694009910 tx=0x7f7694009c20 comp rx=0 tx=0).stop 2024-02-28T16:36:08.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 -- 172.21.15.23:0/3202456068 shutdown_connections 2024-02-28T16:36:08.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 --2- 172.21.15.23:0/3202456068 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a80689b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:08.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 --2- 172.21.15.23:0/3202456068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76a81061b0 0x7f76a8106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:08.085 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 -- 172.21.15.23:0/3202456068 >> 172.21.15.23:0/3202456068 conn(0x7f76a8074fa0 msgr2=0x7f76a80753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 -- 172.21.15.23:0/3202456068 shutdown_connections 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.095+0000 7f76ae800700 1 -- 172.21.15.23:0/3202456068 wait complete. 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.096+0000 7f76ae800700 1 Processor -- start 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.096+0000 7f76ae800700 1 -- start start 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76ae800700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a8197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76ae800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76a81061b0 0x7f76a8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76ae800700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8198960 con 0x7f76a8068540 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76ae800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a819c6f0 con 0x7f76a81061b0 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76ad400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a8197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76ad400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a8197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:55180/0 (socket says 172.21.15.23:55180) 2024-02-28T16:36:08.086 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76ad400700 1 -- 172.21.15.23:0/3741988991 learned_addr learned my addr 172.21.15.23:0/3741988991 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:36:08.087 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.097+0000 7f76aca00700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76a81061b0 0x7f76a8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76ad400700 1 -- 172.21.15.23:0/3741988991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76a81061b0 msgr2=0x7f76a8198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76ad400700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76a81061b0 0x7f76a8198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76ad400700 1 -- 172.21.15.23:0/3741988991 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940095f0 con 0x7f76a8068540 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76ad400700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a8197d40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f769c0060b0 tx=0x7f769c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76a6000700 1 -- 172.21.15.23:0/3741988991 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f769c00dda0 con 0x7f76a8068540 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76a6000700 1 -- 172.21.15.23:0/3741988991 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f769c00f040 con 0x7f76a8068540 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76a6000700 1 -- 172.21.15.23:0/3741988991 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f769c014790 con 0x7f76a8068540 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a819c9d0 con 0x7f76a8068540 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.098+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a819cfa0 con 0x7f76a8068540 2024-02-28T16:36:08.088 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.100+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a8100a20 con 0x7f76a8068540 2024-02-28T16:36:08.089 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.101+0000 7f76a6000700 1 -- 172.21.15.23:0/3741988991 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f769c0148f0 con 0x7f76a8068540 2024-02-28T16:36:08.090 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.102+0000 7f76a6000700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f769006d8a0 0x7f769006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:08.090 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.102+0000 7f76a6000700 1 -- 172.21.15.23:0/3741988991 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f769c08cfe0 con 0x7f76a8068540 2024-02-28T16:36:08.090 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.102+0000 7f76aca00700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f769006d8a0 0x7f769006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:08.090 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.103+0000 7f76aca00700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f769006d8a0 0x7f769006fd50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76a8199360 tx=0x7f769401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:08.095 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.107+0000 7f76a6000700 1 -- 172.21.15.23:0/3741988991 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f769c0567b0 con 0x7f76a8068540 2024-02-28T16:36:08.348 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.359+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76a810d170 con 0x7f769006d8a0 2024-02-28T16:36:08.349 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.361+0000 7f76a6000700 1 -- 172.21.15.23:0/3741988991 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f76a810d170 con 0x7f769006d8a0 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout: "target_image": null, 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout: "in_progress": false, 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout: "which": "", 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout: "services_complete": [], 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout: "progress": null, 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout: "message": "", 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout: "is_paused": false 2024-02-28T16:36:08.350 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:36:08.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.364+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f769006d8a0 msgr2=0x7f769006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:08.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.364+0000 7f76ae800700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f769006d8a0 0x7f769006fd50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76a8199360 tx=0x7f769401a040 comp rx=0 tx=0).stop 2024-02-28T16:36:08.353 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.364+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 msgr2=0x7f76a8197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:08.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.364+0000 7f76ae800700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a8197d40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f769c0060b0 tx=0x7f769c00d3b0 comp rx=0 tx=0).stop 2024-02-28T16:36:08.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.365+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 shutdown_connections 2024-02-28T16:36:08.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.365+0000 7f76ae800700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f769006d8a0 0x7f769006fd50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:08.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.365+0000 7f76ae800700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f76a8068540 0x7f76a8197d40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:08.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.365+0000 7f76ae800700 1 --2- 172.21.15.23:0/3741988991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76a81061b0 0x7f76a8198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:08.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.365+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 >> 172.21.15.23:0/3741988991 conn(0x7f76a8074fa0 msgr2=0x7f76a810a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:08.354 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.365+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 shutdown_connections 2024-02-28T16:36:08.355 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:08.365+0000 7f76ae800700 1 -- 172.21.15.23:0/3741988991 wait complete. 2024-02-28T16:36:09.106 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:08 smithi023 ceph-mon[78509]: pgmap v346: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:09.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:08 smithi153 ceph-mon[66339]: pgmap v346: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:09.149 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph health detail' 2024-02-28T16:36:09.602 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:36:10.109 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:09 smithi023 ceph-mon[78509]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:10.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:09 smithi153 ceph-mon[66339]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:11.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:10 smithi153 ceph-mon[66339]: pgmap v347: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:11.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:10 smithi023 ceph-mon[78509]: pgmap v347: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:11.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 -- 172.21.15.23:0/2622701704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 msgr2=0x7f9aec106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:11.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 --2- 172.21.15.23:0/2622701704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec106580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00b0a0 tx=0x7f9adc00b3b0 comp rx=0 tx=0).stop 2024-02-28T16:36:11.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 -- 172.21.15.23:0/2622701704 shutdown_connections 2024-02-28T16:36:11.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 --2- 172.21.15.23:0/2622701704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aec068540 0x7f9aec0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:11.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 --2- 172.21.15.23:0/2622701704 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec106580 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:11.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 -- 172.21.15.23:0/2622701704 >> 172.21.15.23:0/2622701704 conn(0x7f9aec074fa0 msgr2=0x7f9aec0753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:11.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 -- 172.21.15.23:0/2622701704 shutdown_connections 2024-02-28T16:36:11.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.793+0000 7f9aeb200700 1 -- 172.21.15.23:0/2622701704 wait complete. 2024-02-28T16:36:11.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.794+0000 7f9aeb200700 1 Processor -- start 2024-02-28T16:36:11.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.794+0000 7f9aeb200700 1 -- start start 2024-02-28T16:36:11.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.795+0000 7f9aeb200700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aec068540 0x7f9aec197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:11.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.795+0000 7f9aeb200700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:11.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.795+0000 7f9aeb200700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec1989c0 con 0x7f9aec1061b0 2024-02-28T16:36:11.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.795+0000 7f9aeb200700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec19c750 con 0x7f9aec068540 2024-02-28T16:36:11.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.795+0000 7f9ae1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:11.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.795+0000 7f9ae1400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:55342/0 (socket says 172.21.15.23:55342) 2024-02-28T16:36:11.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.795+0000 7f9ae1400700 1 -- 172.21.15.23:0/3781126264 learned_addr learned my addr 172.21.15.23:0/3781126264 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:36:11.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae9e00700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aec068540 0x7f9aec197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:11.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae1400700 1 -- 172.21.15.23:0/3781126264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aec068540 msgr2=0x7f9aec197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:11.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae1400700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aec068540 0x7f9aec197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:11.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae1400700 1 -- 172.21.15.23:0/3781126264 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc009d00 con 0x7f9aec1061b0 2024-02-28T16:36:11.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae9e00700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aec068540 0x7f9aec197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:36:11.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae1400700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec1982e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400d8d0 tx=0x7f9ad400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:11.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae3400700 1 -- 172.21.15.23:0/3781126264 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad4009940 con 0x7f9aec1061b0 2024-02-28T16:36:11.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae3400700 1 -- 172.21.15.23:0/3781126264 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ad4010460 con 0x7f9aec1061b0 2024-02-28T16:36:11.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9ae3400700 1 -- 172.21.15.23:0/3781126264 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad400f5f0 con 0x7f9aec1061b0 2024-02-28T16:36:11.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.796+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aec19ca30 con 0x7f9aec1061b0 2024-02-28T16:36:11.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.797+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aec19d000 con 0x7f9aec1061b0 2024-02-28T16:36:11.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.798+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aec100e60 con 0x7f9aec1061b0 2024-02-28T16:36:11.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.799+0000 7f9ae3400700 1 -- 172.21.15.23:0/3781126264 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9ad40105d0 con 0x7f9aec1061b0 2024-02-28T16:36:11.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.800+0000 7f9ae3400700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9ad006d8a0 0x7f9ad006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:11.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.800+0000 7f9ae3400700 1 -- 172.21.15.23:0/3781126264 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f9ad408d4d0 con 0x7f9aec1061b0 2024-02-28T16:36:11.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.800+0000 7f9ae9e00700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9ad006d8a0 0x7f9ad006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:11.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.801+0000 7f9ae9e00700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9ad006d8a0 0x7f9ad006fd50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009480 tx=0x7f9adc000f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:11.793 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:11.805+0000 7f9ae3400700 1 -- 172.21.15.23:0/3781126264 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ad4056c50 con 0x7f9aec1061b0 2024-02-28T16:36:12.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.134+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9aec062380 con 0x7f9aec1061b0 2024-02-28T16:36:12.123 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.134+0000 7f9ae3400700 1 -- 172.21.15.23:0/3781126264 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9ad405a310 con 0x7f9aec1061b0 2024-02-28T16:36:12.123 INFO:teuthology.orchestra.run.smithi023.stdout:HEALTH_OK 2024-02-28T16:36:12.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9ad006d8a0 msgr2=0x7f9ad006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:12.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9ad006d8a0 0x7f9ad006fd50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009480 tx=0x7f9adc000f40 comp rx=0 tx=0).stop 2024-02-28T16:36:12.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 msgr2=0x7f9aec1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:12.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec1982e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400d8d0 tx=0x7f9ad400dc90 comp rx=0 tx=0).stop 2024-02-28T16:36:12.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 shutdown_connections 2024-02-28T16:36:12.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aec068540 0x7f9aec197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:12.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f9ad006d8a0 0x7f9ad006fd50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:12.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.137+0000 7f9aeb200700 1 --2- 172.21.15.23:0/3781126264 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f9aec1061b0 0x7f9aec1982e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:12.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.138+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 >> 172.21.15.23:0/3781126264 conn(0x7f9aec074fa0 msgr2=0x7f9aec107100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:12.126 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.138+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 shutdown_connections 2024-02-28T16:36:12.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:12.138+0000 7f9aeb200700 1 -- 172.21.15.23:0/3781126264 wait complete. 2024-02-28T16:36:12.811 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T16:36:13.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:12 smithi153 ceph-mon[66339]: pgmap v348: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:13.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:12 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3781126264' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:36:13.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:12 smithi023 ceph-mon[78509]: pgmap v348: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:13.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:12 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3781126264' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:36:13.217 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:36:15.064 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:14 smithi023 ceph-mon[78509]: pgmap v349: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:15.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:14 smithi153 ceph-mon[66339]: pgmap v349: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:15.381 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 -- 172.21.15.23:0/3893122132 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314108470 msgr2=0x7f8314108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:15.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 --2- 172.21.15.23:0/3893122132 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314108470 0x7f8314108840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8304009910 tx=0x7f8304009c20 comp rx=0 tx=0).stop 2024-02-28T16:36:15.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 -- 172.21.15.23:0/3893122132 shutdown_connections 2024-02-28T16:36:15.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 --2- 172.21.15.23:0/3893122132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8314102470 0x7f83141028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:15.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 --2- 172.21.15.23:0/3893122132 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314108470 0x7f8314108840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:15.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 -- 172.21.15.23:0/3893122132 >> 172.21.15.23:0/3893122132 conn(0x7f83140fdf90 msgr2=0x7f83141003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:15.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 -- 172.21.15.23:0/3893122132 shutdown_connections 2024-02-28T16:36:15.382 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.393+0000 7f8318a00700 1 -- 172.21.15.23:0/3893122132 wait complete. 2024-02-28T16:36:15.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.394+0000 7f8318a00700 1 Processor -- start 2024-02-28T16:36:15.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.394+0000 7f8318a00700 1 -- start start 2024-02-28T16:36:15.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.395+0000 7f8318a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314102470 0x7f83141981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:15.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.395+0000 7f8318a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8314108470 0x7f8314198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:15.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.395+0000 7f8318a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8314198d80 con 0x7f8314102470 2024-02-28T16:36:15.383 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.395+0000 7f8318a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8314198ec0 con 0x7f8314108470 2024-02-28T16:36:15.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.395+0000 7f8311e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314102470 0x7f83141981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:15.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.395+0000 7f8311e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314102470 0x7f83141981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:55346/0 (socket says 172.21.15.23:55346) 2024-02-28T16:36:15.384 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.395+0000 7f8311e00700 1 -- 172.21.15.23:0/4020204053 learned_addr learned my addr 172.21.15.23:0/4020204053 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.396+0000 7f8311400700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8314108470 0x7f8314198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.396+0000 7f8311e00700 1 -- 172.21.15.23:0/4020204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8314108470 msgr2=0x7f8314198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.396+0000 7f8311e00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8314108470 0x7f8314198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.396+0000 7f8311e00700 1 -- 172.21.15.23:0/4020204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040095f0 con 0x7f8314102470 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.396+0000 7f8311400700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8314108470 0x7f8314198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.396+0000 7f8311e00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314102470 0x7f83141981f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8304006010 tx=0x7f830400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.397+0000 7f830aa00700 1 -- 172.21.15.23:0/4020204053 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f830401d070 con 0x7f8314102470 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.397+0000 7f830aa00700 1 -- 172.21.15.23:0/4020204053 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8304004fb0 con 0x7f8314102470 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.397+0000 7f830aa00700 1 -- 172.21.15.23:0/4020204053 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f830400f690 con 0x7f8314102470 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.397+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831419ccb0 con 0x7f8314102470 2024-02-28T16:36:15.385 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.397+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831419d150 con 0x7f8314102470 2024-02-28T16:36:15.386 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.398+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831404f2a0 con 0x7f8314102470 2024-02-28T16:36:15.387 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.399+0000 7f830aa00700 1 -- 172.21.15.23:0/4020204053 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f83040228a0 con 0x7f8314102470 2024-02-28T16:36:15.388 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.400+0000 7f830aa00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f82f806d8a0 0x7f82f806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:15.388 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.400+0000 7f830aa00700 1 -- 172.21.15.23:0/4020204053 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f830408ee80 con 0x7f8314102470 2024-02-28T16:36:15.388 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.400+0000 7f8311400700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f82f806d8a0 0x7f82f806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:15.389 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.401+0000 7f8311400700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f82f806d8a0 0x7f82f806fd50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8300005fd0 tx=0x7f8300005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:15.393 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.406+0000 7f830aa00700 1 -- 172.21.15.23:0/4020204053 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8304058580 con 0x7f8314102470 2024-02-28T16:36:15.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.729+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f831410a3f0 con 0x7f8314102470 2024-02-28T16:36:15.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.730+0000 7f830aa00700 1 -- 172.21.15.23:0/4020204053 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8304027280 con 0x7f8314102470 2024-02-28T16:36:15.719 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:36:15.719 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:36:15.719 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:36:15.719 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:36:15.720 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.733+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f82f806d8a0 msgr2=0x7f82f806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.733+0000 7f8318a00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f82f806d8a0 0x7f82f806fd50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8300005fd0 tx=0x7f8300005e20 comp rx=0 tx=0).stop 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.733+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314102470 msgr2=0x7f83141981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.733+0000 7f8318a00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314102470 0x7f83141981f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8304006010 tx=0x7f830400be20 comp rx=0 tx=0).stop 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.734+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 shutdown_connections 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.734+0000 7f8318a00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f82f806d8a0 0x7f82f806fd50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.734+0000 7f8318a00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f8314102470 0x7f83141981f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.734+0000 7f8318a00700 1 --2- 172.21.15.23:0/4020204053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8314108470 0x7f8314198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:15.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.734+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 >> 172.21.15.23:0/4020204053 conn(0x7f83140fdf90 msgr2=0x7f83141002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:15.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.734+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 shutdown_connections 2024-02-28T16:36:15.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:36:15.734+0000 7f8318a00700 1 -- 172.21.15.23:0/4020204053 wait complete. 2024-02-28T16:36:16.105 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:15 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/4020204053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:16.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:15 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/4020204053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:16.498 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-28T16:36:16.935 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:36:17.079 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:16 smithi023 ceph-mon[78509]: pgmap v350: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:17.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:16 smithi153 ceph-mon[66339]: pgmap v350: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:18.890 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:18 smithi023 ceph-mon[78509]: pgmap v351: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:19.117 INFO:teuthology.orchestra.run.smithi023.stdout:wait for servicemap items w/ changing names to refresh 2024-02-28T16:36:19.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:18 smithi153 ceph-mon[66339]: pgmap v351: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:19.919 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'sleep 60' 2024-02-28T16:36:20.367 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:36:21.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:20 smithi153 ceph-mon[66339]: pgmap v352: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:21.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:20 smithi023 ceph-mon[78509]: pgmap v352: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:22.016 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:22.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:23.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:22 smithi153 ceph-mon[66339]: pgmap v353: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:23.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:22 smithi023 ceph-mon[78509]: pgmap v353: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:25.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:24 smithi153 ceph-mon[66339]: pgmap v354: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:25.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:24 smithi023 ceph-mon[78509]: pgmap v354: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:27.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:26 smithi153 ceph-mon[66339]: pgmap v355: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:27.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:26 smithi023 ceph-mon[78509]: pgmap v355: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:29.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:28 smithi153 ceph-mon[66339]: pgmap v356: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:29.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:28 smithi023 ceph-mon[78509]: pgmap v356: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:31.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:30 smithi153 ceph-mon[66339]: pgmap v357: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:31.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:30 smithi023 ceph-mon[78509]: pgmap v357: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:33.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:32 smithi153 ceph-mon[66339]: pgmap v358: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:33.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:32 smithi023 ceph-mon[78509]: pgmap v358: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:35.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:34 smithi023 ceph-mon[78509]: pgmap v359: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:35.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:34 smithi153 ceph-mon[66339]: pgmap v359: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:37.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:36 smithi023 ceph-mon[78509]: pgmap v360: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:37.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:36 smithi153 ceph-mon[66339]: pgmap v360: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:39.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:38 smithi023 ceph-mon[78509]: pgmap v361: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:39.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:38 smithi153 ceph-mon[66339]: pgmap v361: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:41.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:40 smithi023 ceph-mon[78509]: pgmap v362: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:41.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:40 smithi153 ceph-mon[66339]: pgmap v362: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:43.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:42 smithi153 ceph-mon[66339]: pgmap v363: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:43.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:42 smithi023 ceph-mon[78509]: pgmap v363: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:45.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:44 smithi153 ceph-mon[66339]: pgmap v364: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:45.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:44 smithi023 ceph-mon[78509]: pgmap v364: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:46.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:45 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:36:46.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:45 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:36:47.296 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:46 smithi153 ceph-mon[66339]: pgmap v365: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:47.296 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:47.296 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:36:47.296 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:46 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:36:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:46 smithi023 ceph-mon[78509]: pgmap v365: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:36:47.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:46 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:36:49.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:48 smithi023 ceph-mon[78509]: pgmap v366: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:49.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:48 smithi153 ceph-mon[66339]: pgmap v366: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:51.317 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:50 smithi153 ceph-mon[66339]: pgmap v367: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:51.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:50 smithi023 ceph-mon[78509]: pgmap v367: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:52.384 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:52.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:53.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:52 smithi153 ceph-mon[66339]: pgmap v368: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:53.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:52 smithi023 ceph-mon[78509]: pgmap v368: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:55.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:55 smithi153 ceph-mon[66339]: pgmap v369: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:55.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:55 smithi023 ceph-mon[78509]: pgmap v369: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:57.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:57 smithi153 ceph-mon[66339]: pgmap v370: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:57.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:57 smithi023 ceph-mon[78509]: pgmap v370: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:59.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:36:59 smithi153 ceph-mon[66339]: pgmap v371: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:36:59.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:36:59 smithi023 ceph-mon[78509]: pgmap v371: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:01.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:01 smithi153 ceph-mon[66339]: pgmap v372: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:01.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:01 smithi023 ceph-mon[78509]: pgmap v372: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:03.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:03 smithi153 ceph-mon[66339]: pgmap v373: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:03.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:03 smithi023 ceph-mon[78509]: pgmap v373: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:05.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:05 smithi153 ceph-mon[66339]: pgmap v374: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:05.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:05 smithi023 ceph-mon[78509]: pgmap v374: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:07.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:07 smithi153 ceph-mon[66339]: pgmap v375: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:07.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:07.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:07 smithi023 ceph-mon[78509]: pgmap v375: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:07.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:09.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:09 smithi153 ceph-mon[66339]: pgmap v376: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:09.400 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:09 smithi023 ceph-mon[78509]: pgmap v376: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:11.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:11 smithi153 ceph-mon[66339]: pgmap v377: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:11.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:11 smithi023 ceph-mon[78509]: pgmap v377: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:13.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:13 smithi153 ceph-mon[66339]: pgmap v378: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:13.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:13 smithi023 ceph-mon[78509]: pgmap v378: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:15.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:15 smithi153 ceph-mon[66339]: pgmap v379: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:15.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:15 smithi023 ceph-mon[78509]: pgmap v379: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:17.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:17 smithi153 ceph-mon[66339]: pgmap v380: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:17.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:17 smithi023 ceph-mon[78509]: pgmap v380: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:19.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:19 smithi153 ceph-mon[66339]: pgmap v381: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:19.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:19 smithi023 ceph-mon[78509]: pgmap v381: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:21.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:21 smithi153 ceph-mon[66339]: pgmap v382: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:21.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:21 smithi023 ceph-mon[78509]: pgmap v382: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:22.383 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:22.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:23.359 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:23 smithi023 ceph-mon[78509]: pgmap v383: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:23.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:23 smithi153 ceph-mon[66339]: pgmap v383: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:23.398 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T16:37:23.842 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:37:25.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:25 smithi023 ceph-mon[78509]: pgmap v384: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:25.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:25 smithi153 ceph-mon[66339]: pgmap v384: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:26.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 -- 172.21.15.23:0/4281225626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 msgr2=0x7f14240689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 --2- 172.21.15.23:0/4281225626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f14240689b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f140c009910 tx=0x7f140c009c20 comp rx=0 tx=0).stop 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 -- 172.21.15.23:0/4281225626 shutdown_connections 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 --2- 172.21.15.23:0/4281225626 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f14240689b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 --2- 172.21.15.23:0/4281225626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14241061b0 0x7f1424106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 -- 172.21.15.23:0/4281225626 >> 172.21.15.23:0/4281225626 conn(0x7f1424074fa0 msgr2=0x7f14240753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 -- 172.21.15.23:0/4281225626 shutdown_connections 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.261+0000 7f1423e00700 1 -- 172.21.15.23:0/4281225626 wait complete. 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.262+0000 7f1423e00700 1 Processor -- start 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.263+0000 7f1423e00700 1 -- start start 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.263+0000 7f1423e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f1424197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:26.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.263+0000 7f1423e00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14241061b0 0x7f1424198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.263+0000 7f1423e00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1424198960 con 0x7f1424068540 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.263+0000 7f1423e00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142419c6f0 con 0x7f14241061b0 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.263+0000 7f1422a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f1424197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.264+0000 7f1422a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f1424197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:41576/0 (socket says 172.21.15.23:41576) 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.264+0000 7f1422a00700 1 -- 172.21.15.23:0/550930186 learned_addr learned my addr 172.21.15.23:0/550930186 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.264+0000 7f141a000700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14241061b0 0x7f1424198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.264+0000 7f1422a00700 1 -- 172.21.15.23:0/550930186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14241061b0 msgr2=0x7f1424198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.264+0000 7f1422a00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14241061b0 0x7f1424198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.264+0000 7f1422a00700 1 -- 172.21.15.23:0/550930186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0095f0 con 0x7f1424068540 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.264+0000 7f141a000700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14241061b0 0x7f1424198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.265+0000 7f1422a00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f1424197d40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f141400c8a0 tx=0x7f141400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.265+0000 7f141be00700 1 -- 172.21.15.23:0/550930186 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141400cea0 con 0x7f1424068540 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.265+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142419c9d0 con 0x7f1424068540 2024-02-28T16:37:26.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.265+0000 7f141be00700 1 -- 172.21.15.23:0/550930186 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1414004830 con 0x7f1424068540 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.265+0000 7f141be00700 1 -- 172.21.15.23:0/550930186 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14140055b0 con 0x7f1424068540 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.265+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142419cfa0 con 0x7f1424068540 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.266+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1424100a20 con 0x7f1424068540 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.268+0000 7f141be00700 1 -- 172.21.15.23:0/550930186 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f14140049a0 con 0x7f1424068540 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.269+0000 7f141be00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f140406d8a0 0x7f140406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.269+0000 7f141be00700 1 -- 172.21.15.23:0/550930186 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f141408d310 con 0x7f1424068540 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.269+0000 7f141a000700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f140406d8a0 0x7f140406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.270+0000 7f141a000700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f140406d8a0 0x7f140406fd50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f140c005b40 tx=0x7f140c01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:26.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.275+0000 7f141be00700 1 -- 172.21.15.23:0/550930186 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1414056970 con 0x7f1424068540 2024-02-28T16:37:26.506 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.517+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 --> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f142419d290 con 0x7f140406d8a0 2024-02-28T16:37:26.523 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.534+0000 7f141be00700 1 -- 172.21.15.23:0/550930186 <== mgr.34102 v2:172.21.15.23:6800/2326856362 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f142419d290 con 0x7f140406d8a0 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:alertmanager.smithi023 smithi023 *:9093,9094 running (2m) 110s ago 24m 14.0M - 0.25.0 c8568f914cd2 426b853f4a23 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi023 smithi023 running (4m) 110s ago 24m 8014k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 64317e9be9ba 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-exporter.smithi153 smithi153 running (3m) 3m ago 23m 7583k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 942e64d3de96 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi023 smithi023 running (10m) 110s ago 24m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b fcefd4f594b2 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:crash.smithi153 smithi153 running (9m) 3m ago 23m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1323cbc704b 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:grafana.smithi023 smithi023 *:3000 running (117s) 110s ago 23m 51.8M - 9.4.12 a0ea5e3c46d9 91bd0221cbdb 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.klbbrl smithi023 running (5m) 110s ago 17m 13.4M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 7083669af39a 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi023.pplvdo smithi023 running (5m) 110s ago 17m 86.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 82c986e8581d 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.dhwpyj smithi153 running (4m) 3m ago 17m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b4ff1f848efc 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:mds.cephfs.smithi153.senzwp smithi153 running (4m) 3m ago 17m 12.2M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 6c5417f6de56 2024-02-28T16:37:26.524 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi023.bbebnt smithi023 *:8443,9283,8765 running (13m) 110s ago 26m 513M - 19.0.0-1670-g1fb5d106 2272b2c42f9b bc71c8893669 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:mgr.smithi153.qlkchp smithi153 *:8443,9283,8765 running (12m) 3m ago 23m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 221fc7fdd46b 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi023 smithi023 running (11m) 110s ago 26m 61.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b b383e5ebc0af 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:mon.smithi153 smithi153 running (11m) 3m ago 22m 45.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7b3873f5f7b3 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi023 smithi023 *:9100 running (3m) 110s ago 24m 7642k - 1.5.0 0da6a335fe13 5ea0d01203ff 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:node-exporter.smithi153 smithi153 *:9100 running (3m) 3m ago 23m 2902k - 1.5.0 0da6a335fe13 d4b7c7fb1fb7 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:osd.0 smithi023 running (9m) 110s ago 21m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b f272a8c24733 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:osd.1 smithi023 running (8m) 110s ago 21m 113M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b e3ca8579a9f9 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:osd.2 smithi023 running (8m) 110s ago 20m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 04b8de84daf7 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:osd.3 smithi153 running (7m) 3m ago 20m 120M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 96b969027329 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:osd.4 smithi153 running (6m) 3m ago 19m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79f6584de783 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:osd.5 smithi153 running (6m) 3m ago 18m 95.3M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b ac551516eb38 2024-02-28T16:37:26.525 INFO:teuthology.orchestra.run.smithi023.stdout:prometheus.smithi023 smithi023 *:9095 running (3m) 110s ago 23m 58.0M - 2.43.0 a07b618ecd1d 4214bcd1aafd 2024-02-28T16:37:26.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f140406d8a0 msgr2=0x7f140406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:26.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f140406d8a0 0x7f140406fd50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f140c005b40 tx=0x7f140c01a040 comp rx=0 tx=0).stop 2024-02-28T16:37:26.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 msgr2=0x7f1424197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:26.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f1424197d40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f141400c8a0 tx=0x7f141400cc60 comp rx=0 tx=0).stop 2024-02-28T16:37:26.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 shutdown_connections 2024-02-28T16:37:26.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f140406d8a0 0x7f140406fd50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:26.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1424068540 0x7f1424197d40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:26.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 --2- 172.21.15.23:0/550930186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14241061b0 0x7f1424198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:26.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 >> 172.21.15.23:0/550930186 conn(0x7f1424074fa0 msgr2=0x7f142410a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:26.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 shutdown_connections 2024-02-28T16:37:26.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:26.538+0000 7f1423e00700 1 -- 172.21.15.23:0/550930186 wait complete. 2024-02-28T16:37:27.354 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:27 smithi023 ceph-mon[78509]: pgmap v385: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:27.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:27 smithi153 ceph-mon[66339]: pgmap v385: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:27.421 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T16:37:27.885 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:37:28.366 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:28 smithi023 ceph-mon[78509]: from='client.34680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:28.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:28 smithi153 ceph-mon[66339]: from='client.34680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:29.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:29 smithi023 ceph-mon[78509]: pgmap v386: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:29.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:29 smithi153 ceph-mon[66339]: pgmap v386: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:30.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.156+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3311261894 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f78073a00 msgr2=0x7f1f7810c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:30.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.156+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3311261894 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f78073a00 0x7f1f7810c560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009910 tx=0x7f1f64009c20 comp rx=0 tx=0).stop 2024-02-28T16:37:30.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.156+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3311261894 shutdown_connections 2024-02-28T16:37:30.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.156+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3311261894 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f78073a00 0x7f1f7810c560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:30.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.156+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3311261894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f780730f0 0x7f1f780734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:30.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.156+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3311261894 >> 172.21.15.23:0/3311261894 conn(0x7f1f780fbd80 msgr2=0x7f1f780fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.156+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3311261894 shutdown_connections 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.157+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3311261894 wait complete. 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.157+0000 7f1f7ec00700 1 Processor -- start 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f7ec00700 1 -- start start 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f7ec00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f780730f0 0x7f1f78197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f7ec00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f78073a00 0x7f1f781984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f7ec00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f78198ba0 con 0x7f1f780730f0 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f7ec00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7819c930 con 0x7f1f78073a00 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f77e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f780730f0 0x7f1f78197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f77e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f780730f0 0x7f1f78197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57772/0 (socket says 172.21.15.23:57772) 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.158+0000 7f1f77e00700 1 -- 172.21.15.23:0/3815638897 learned_addr learned my addr 172.21.15.23:0/3815638897 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.159+0000 7f1f77400700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f78073a00 0x7f1f781984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.159+0000 7f1f77e00700 1 -- 172.21.15.23:0/3815638897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f78073a00 msgr2=0x7f1f781984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:30.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.159+0000 7f1f77e00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f78073a00 0x7f1f781984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.159+0000 7f1f77e00700 1 -- 172.21.15.23:0/3815638897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640095f0 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.159+0000 7f1f77e00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f780730f0 0x7f1f78197f80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800c930 tx=0x7f1f6800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.160+0000 7f1f74c00700 1 -- 172.21.15.23:0/3815638897 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f68007ad0 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.160+0000 7f1f74c00700 1 -- 172.21.15.23:0/3815638897 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f68007c30 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.160+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7819cc10 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.160+0000 7f1f74c00700 1 -- 172.21.15.23:0/3815638897 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f68018610 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.160+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7819d160 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.161+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f78109c60 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.162+0000 7f1f74c00700 1 -- 172.21.15.23:0/3815638897 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1f6800f450 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.163+0000 7f1f74c00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1f5c06d8a0 0x7f1f5c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.163+0000 7f1f74c00700 1 -- 172.21.15.23:0/3815638897 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f1f6808d8c0 con 0x7f1f780730f0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.163+0000 7f1f77400700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1f5c06d8a0 0x7f1f5c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.164+0000 7f1f77400700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1f5c06d8a0 0x7f1f5c06fd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f781995a0 tx=0x7f1f6401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:30.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.169+0000 7f1f74c00700 1 -- 172.21.15.23:0/3815638897 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1f68056f20 con 0x7f1f780730f0 2024-02-28T16:37:30.486 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.497+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1f7819d3e0 con 0x7f1f780730f0 2024-02-28T16:37:30.487 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.498+0000 7f1f74c00700 1 -- 172.21.15.23:0/3815638897 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1f6805a5e0 con 0x7f1f780730f0 2024-02-28T16:37:30.487 INFO:teuthology.orchestra.run.smithi023.stdout:{ 2024-02-28T16:37:30.487 INFO:teuthology.orchestra.run.smithi023.stdout: "mon": { 2024-02-28T16:37:30.487 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:37:30.487 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "mgr": { 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "osd": { 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "mds": { 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: }, 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "overall": { 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout: } 2024-02-28T16:37:30.488 INFO:teuthology.orchestra.run.smithi023.stdout:} 2024-02-28T16:37:30.490 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.501+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1f5c06d8a0 msgr2=0x7f1f5c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.501+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1f5c06d8a0 0x7f1f5c06fd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f781995a0 tx=0x7f1f6401a040 comp rx=0 tx=0).stop 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.501+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f780730f0 msgr2=0x7f1f78197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.501+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f780730f0 0x7f1f78197f80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800c930 tx=0x7f1f6800ccf0 comp rx=0 tx=0).stop 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.502+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 shutdown_connections 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.502+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1f5c06d8a0 0x7f1f5c06fd50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.502+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1f780730f0 0x7f1f78197f80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.502+0000 7f1f7ec00700 1 --2- 172.21.15.23:0/3815638897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f78073a00 0x7f1f781984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:30.491 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.502+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 >> 172.21.15.23:0/3815638897 conn(0x7f1f780fbd80 msgr2=0x7f1f78106da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:30.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.502+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 shutdown_connections 2024-02-28T16:37:30.492 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:30.502+0000 7f1f7ec00700 1 -- 172.21.15.23:0/3815638897 wait complete. 2024-02-28T16:37:31.322 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-28T16:37:31.416 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:31 smithi023 ceph-mon[78509]: pgmap v387: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:31.416 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:31 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3815638897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:31.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:31 smithi153 ceph-mon[66339]: pgmap v387: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:31.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:31 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3815638897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:31.771 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:37:33.416 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:33 smithi023 ceph-mon[78509]: pgmap v388: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:33.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:33 smithi153 ceph-mon[66339]: pgmap v388: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:33.973 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.983+0000 7ff128c00700 1 -- 172.21.15.23:0/1971622899 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 msgr2=0x7ff12410ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.983+0000 7ff128c00700 1 --2- 172.21.15.23:0/1971622899 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12410ccc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff114009910 tx=0x7ff114009c20 comp rx=0 tx=0).stop 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.983+0000 7ff128c00700 1 -- 172.21.15.23:0/1971622899 shutdown_connections 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.983+0000 7ff128c00700 1 --2- 172.21.15.23:0/1971622899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff124106b80 0x7ff124106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.983+0000 7ff128c00700 1 --2- 172.21.15.23:0/1971622899 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12410ccc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.984+0000 7ff128c00700 1 -- 172.21.15.23:0/1971622899 >> 172.21.15.23:0/1971622899 conn(0x7ff124076060 msgr2=0x7ff124078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.984+0000 7ff128c00700 1 -- 172.21.15.23:0/1971622899 shutdown_connections 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.984+0000 7ff128c00700 1 -- 172.21.15.23:0/1971622899 wait complete. 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.985+0000 7ff128c00700 1 Processor -- start 2024-02-28T16:37:33.974 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.985+0000 7ff128c00700 1 -- start start 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.985+0000 7ff128c00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff124106b80 0x7ff12419c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.985+0000 7ff128c00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.985+0000 7ff128c00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12419d120 con 0x7ff12410c8f0 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.985+0000 7ff128c00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1241a0eb0 con 0x7ff124106b80 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12419ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57788/0 (socket says 172.21.15.23:57788) 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121400700 1 -- 172.21.15.23:0/2341605726 learned_addr learned my addr 172.21.15.23:0/2341605726 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121e00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff124106b80 0x7ff12419c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121400700 1 -- 172.21.15.23:0/2341605726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff124106b80 msgr2=0x7ff12419c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121400700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff124106b80 0x7ff12419c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121400700 1 -- 172.21.15.23:0/2341605726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140095f0 con 0x7ff12410c8f0 2024-02-28T16:37:33.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.986+0000 7ff121400700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12419ca40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c8a0 tx=0x7ff11000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:33.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.987+0000 7ff11aa00700 1 -- 172.21.15.23:0/2341605726 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11000cea0 con 0x7ff12410c8f0 2024-02-28T16:37:33.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.987+0000 7ff11aa00700 1 -- 172.21.15.23:0/2341605726 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff110004830 con 0x7ff12410c8f0 2024-02-28T16:37:33.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.987+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1241a1190 con 0x7ff12410c8f0 2024-02-28T16:37:33.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.987+0000 7ff11aa00700 1 -- 172.21.15.23:0/2341605726 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1100055b0 con 0x7ff12410c8f0 2024-02-28T16:37:33.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.987+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1241a16e0 con 0x7ff12410c8f0 2024-02-28T16:37:33.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.988+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff124109b20 con 0x7ff12410c8f0 2024-02-28T16:37:33.978 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.989+0000 7ff11aa00700 1 -- 172.21.15.23:0/2341605726 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff1100049a0 con 0x7ff12410c8f0 2024-02-28T16:37:33.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.990+0000 7ff11aa00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff10806d8a0 0x7ff10806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:33.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.990+0000 7ff11aa00700 1 -- 172.21.15.23:0/2341605726 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7ff11008d310 con 0x7ff12410c8f0 2024-02-28T16:37:33.979 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.991+0000 7ff121e00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff10806d8a0 0x7ff10806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:33.980 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.991+0000 7ff121e00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff10806d8a0 0x7ff10806fd50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff11400b5c0 tx=0x7ff11401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:33.984 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:33.996+0000 7ff11aa00700 1 -- 172.21.15.23:0/2341605726 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff110056970 con 0x7ff12410c8f0 2024-02-28T16:37:34.303 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.314+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff12404f2a0 con 0x7ff12410c8f0 2024-02-28T16:37:34.304 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.315+0000 7ff11aa00700 1 -- 172.21.15.23:0/2341605726 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ff110004c50 con 0x7ff12410c8f0 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.317+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff10806d8a0 msgr2=0x7ff10806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.317+0000 7ff128c00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff10806d8a0 0x7ff10806fd50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff11400b5c0 tx=0x7ff11401a040 comp rx=0 tx=0).stop 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.317+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 msgr2=0x7ff12419ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.317+0000 7ff128c00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12419ca40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c8a0 tx=0x7ff11000cc60 comp rx=0 tx=0).stop 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.318+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 shutdown_connections 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.318+0000 7ff128c00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff124106b80 0x7ff12419c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.318+0000 7ff128c00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7ff10806d8a0 0x7ff10806fd50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.318+0000 7ff128c00700 1 --2- 172.21.15.23:0/2341605726 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7ff12410c8f0 0x7ff12419ca40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:34.307 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.318+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 >> 172.21.15.23:0/2341605726 conn(0x7ff124076060 msgr2=0x7ff124077aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:34.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.318+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 shutdown_connections 2024-02-28T16:37:34.308 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:34.318+0000 7ff128c00700 1 -- 172.21.15.23:0/2341605726 wait complete. 2024-02-28T16:37:34.321 INFO:teuthology.orchestra.run.smithi023.stdout:true 2024-02-28T16:37:35.084 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-28T16:37:35.341 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:35 smithi023 ceph-mon[78509]: pgmap v389: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:35.341 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:35 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2341605726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:35.527 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:37:35.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:35 smithi153 ceph-mon[66339]: pgmap v389: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:35.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:35 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2341605726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:37.436 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:37 smithi023 ceph-mon[78509]: pgmap v390: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:37.437 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:37.639 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:37 smithi153 ceph-mon[66339]: pgmap v390: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:37.639 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.719+0000 7f6064400700 1 -- 172.21.15.23:0/12506910 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c10c8f0 msgr2=0x7f605c10ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.719+0000 7f6064400700 1 --2- 172.21.15.23:0/12506910 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c10c8f0 0x7f605c10ccc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6050009910 tx=0x7f6050009c20 comp rx=0 tx=0).stop 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.719+0000 7f6064400700 1 -- 172.21.15.23:0/12506910 shutdown_connections 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.719+0000 7f6064400700 1 --2- 172.21.15.23:0/12506910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f605c106b80 0x7f605c106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.719+0000 7f6064400700 1 --2- 172.21.15.23:0/12506910 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c10c8f0 0x7f605c10ccc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.719+0000 7f6064400700 1 -- 172.21.15.23:0/12506910 >> 172.21.15.23:0/12506910 conn(0x7f605c076060 msgr2=0x7f605c078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.720+0000 7f6064400700 1 -- 172.21.15.23:0/12506910 shutdown_connections 2024-02-28T16:37:37.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.720+0000 7f6064400700 1 -- 172.21.15.23:0/12506910 wait complete. 2024-02-28T16:37:37.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.721+0000 7f6064400700 1 Processor -- start 2024-02-28T16:37:37.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.721+0000 7f6064400700 1 -- start start 2024-02-28T16:37:37.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6064400700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c106b80 0x7f605c19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:37.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6064400700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f605c10c8f0 0x7f605c19ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:37.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6064400700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c19d090 con 0x7f605c106b80 2024-02-28T16:37:37.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6064400700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c19d1d0 con 0x7f605c10c8f0 2024-02-28T16:37:37.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6061a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c106b80 0x7f605c19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:37.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6061a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c106b80 0x7f605c19c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:57810/0 (socket says 172.21.15.23:57810) 2024-02-28T16:37:37.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6061a00700 1 -- 172.21.15.23:0/4256715627 learned_addr learned my addr 172.21.15.23:0/4256715627 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:37.710 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.722+0000 7f6061000700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f605c10c8f0 0x7f605c19ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:37.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f6061a00700 1 -- 172.21.15.23:0/4256715627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f605c10c8f0 msgr2=0x7f605c19ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:37.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f6061a00700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f605c10c8f0 0x7f605c19ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:37.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f6061a00700 1 -- 172.21.15.23:0/4256715627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500095f0 con 0x7f605c106b80 2024-02-28T16:37:37.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f6061a00700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c106b80 0x7f605c19c500 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6050006010 tx=0x7f605000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:37.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f605a000700 1 -- 172.21.15.23:0/4256715627 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f605001d070 con 0x7f605c106b80 2024-02-28T16:37:37.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f605a000700 1 -- 172.21.15.23:0/4256715627 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6050004fb0 con 0x7f605c106b80 2024-02-28T16:37:37.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c1a0fc0 con 0x7f605c106b80 2024-02-28T16:37:37.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.723+0000 7f605a000700 1 -- 172.21.15.23:0/4256715627 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6050022ea0 con 0x7f605c106b80 2024-02-28T16:37:37.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.724+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c1a14b0 con 0x7f605c106b80 2024-02-28T16:37:37.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.725+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c109b20 con 0x7f605c106b80 2024-02-28T16:37:37.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.726+0000 7f605a000700 1 -- 172.21.15.23:0/4256715627 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6050022470 con 0x7f605c106b80 2024-02-28T16:37:37.714 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.727+0000 7f605a000700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f604406d8a0 0x7f604406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:37.714 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.727+0000 7f605a000700 1 -- 172.21.15.23:0/4256715627 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f605008eb60 con 0x7f605c106b80 2024-02-28T16:37:37.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.727+0000 7f6061000700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f604406d8a0 0x7f604406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:37.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.728+0000 7f6061000700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f604406d8a0 0x7f604406fd50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6048005ea0 tx=0x7f6048005e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:37.720 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:37.732+0000 7f605a000700 1 -- 172.21.15.23:0/4256715627 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6050058410 con 0x7f605c106b80 2024-02-28T16:37:38.044 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.057+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f605c04f2a0 con 0x7f605c106b80 2024-02-28T16:37:38.045 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.058+0000 7f605a000700 1 -- 172.21.15.23:0/4256715627 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6050027070 con 0x7f605c106b80 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f604406d8a0 msgr2=0x7f604406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f604406d8a0 0x7f604406fd50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6048005ea0 tx=0x7f6048005e30 comp rx=0 tx=0).stop 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c106b80 msgr2=0x7f605c19c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c106b80 0x7f605c19c500 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6050006010 tx=0x7f605000be20 comp rx=0 tx=0).stop 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 shutdown_connections 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f604406d8a0 0x7f604406fd50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f605c106b80 0x7f605c19c500 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 --2- 172.21.15.23:0/4256715627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f605c10c8f0 0x7f605c19ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:38.049 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.061+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 >> 172.21.15.23:0/4256715627 conn(0x7f605c076060 msgr2=0x7f605c077aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:38.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.062+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 shutdown_connections 2024-02-28T16:37:38.050 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:38.062+0000 7f6064400700 1 -- 172.21.15.23:0/4256715627 wait complete. 2024-02-28T16:37:38.067 INFO:teuthology.orchestra.run.smithi023.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)" 2024-02-28T16:37:38.417 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:38 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/4256715627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:38.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:38 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/4256715627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:38.781 DEBUG:teuthology.parallel:result is None 2024-02-28T16:37:38.781 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:37:38.793 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:37:38.794 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dea052fa-d653-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T16:37:39.238 INFO:teuthology.orchestra.run.smithi023.stderr:Inferring config /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/mon.smithi023/config 2024-02-28T16:37:39.556 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:39 smithi023 ceph-mon[78509]: pgmap v391: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:39.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:39 smithi153 ceph-mon[66339]: pgmap v391: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:40.577 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:40 smithi023 ceph-mon[78509]: pgmap v392: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:40.644 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:40 smithi153 ceph-mon[66339]: pgmap v392: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:41.473 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 -- 172.21.15.23:0/2719954640 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 msgr2=0x7f1c2c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:41.473 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2719954640 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c104e50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009910 tx=0x7f1c14009c20 comp rx=0 tx=0).stop 2024-02-28T16:37:41.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 -- 172.21.15.23:0/2719954640 shutdown_connections 2024-02-28T16:37:41.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2719954640 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c104e50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2719954640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2c1004e0 0x7f1c2c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 -- 172.21.15.23:0/2719954640 >> 172.21.15.23:0/2719954640 conn(0x7f1c2c0fbda0 msgr2=0x7f1c2c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:41.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 -- 172.21.15.23:0/2719954640 shutdown_connections 2024-02-28T16:37:41.474 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.485+0000 7f1c32a00700 1 -- 172.21.15.23:0/2719954640 wait complete. 2024-02-28T16:37:41.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.486+0000 7f1c32a00700 1 Processor -- start 2024-02-28T16:37:41.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.486+0000 7f1c32a00700 1 -- start start 2024-02-28T16:37:41.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.487+0000 7f1c32a00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2c1004e0 0x7f1c2c198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:41.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.487+0000 7f1c32a00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:41.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.487+0000 7f1c32a00700 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c198ca0 con 0x7f1c2c100e80 2024-02-28T16:37:41.475 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.487+0000 7f1c32a00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c198de0 con 0x7f1c2c1004e0 2024-02-28T16:37:41.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.487+0000 7f1c23e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:41.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.487+0000 7f1c23e00700 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53794/0 (socket says 172.21.15.23:53794) 2024-02-28T16:37:41.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.487+0000 7f1c23e00700 1 -- 172.21.15.23:0/2294012986 learned_addr learned my addr 172.21.15.23:0/2294012986 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:41.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.488+0000 7f1c2be00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2c1004e0 0x7f1c2c198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:41.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.488+0000 7f1c23e00700 1 -- 172.21.15.23:0/2294012986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2c1004e0 msgr2=0x7f1c2c198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:41.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.488+0000 7f1c23e00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2c1004e0 0x7f1c2c198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.476 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.488+0000 7f1c23e00700 1 -- 172.21.15.23:0/2294012986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140095f0 con 0x7f1c2c100e80 2024-02-28T16:37:41.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.488+0000 7f1c23e00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c198650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400bda0 tx=0x7f1c1400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:41.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.489+0000 7f1c29600700 1 -- 172.21.15.23:0/2294012986 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c1401d070 con 0x7f1c2c100e80 2024-02-28T16:37:41.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.489+0000 7f1c29600700 1 -- 172.21.15.23:0/2294012986 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c14004fb0 con 0x7f1c2c100e80 2024-02-28T16:37:41.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.489+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c19cbd0 con 0x7f1c2c100e80 2024-02-28T16:37:41.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.489+0000 7f1c29600700 1 -- 172.21.15.23:0/2294012986 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c1400f460 con 0x7f1c2c100e80 2024-02-28T16:37:41.477 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.489+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c19d0c0 con 0x7f1c2c100e80 2024-02-28T16:37:41.478 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.490+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c1045d0 con 0x7f1c2c100e80 2024-02-28T16:37:41.479 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.491+0000 7f1c29600700 1 -- 172.21.15.23:0/2294012986 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1c14022800 con 0x7f1c2c100e80 2024-02-28T16:37:41.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.492+0000 7f1c29600700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c1006d8a0 0x7f1c1006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:41.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.492+0000 7f1c29600700 1 -- 172.21.15.23:0/2294012986 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f1c1408ebb0 con 0x7f1c2c100e80 2024-02-28T16:37:41.480 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.493+0000 7f1c2be00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c1006d8a0 0x7f1c1006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:41.481 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.493+0000 7f1c2be00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c1006d8a0 0x7f1c1006fd50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c005ea0 tx=0x7f1c1c005e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:41.484 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.497+0000 7f1c29600700 1 -- 172.21.15.23:0/2294012986 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c140583e0 con 0x7f1c2c100e80 2024-02-28T16:37:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.776+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1c2c04f2a0 con 0x7f1c2c100e80 2024-02-28T16:37:41.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.777+0000 7f1c29600700 1 -- 172.21.15.23:0/2294012986 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1873 (secure 0 0 0) 0x7f1c14027070 con 0x7f1c2c100e80 2024-02-28T16:37:41.766 INFO:teuthology.orchestra.run.smithi023.stdout:e36 2024-02-28T16:37:41.766 INFO:teuthology.orchestra.run.smithi023.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:legacy client fscid: 1 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:fs_name cephfs 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:epoch 36 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:created 2024-02-28T16:20:08.831226+0000 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:modified 2024-02-28T16:33:05.948811+0000 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:tableserver 0 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:root 0 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:session_timeout 60 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:session_autoclose 300 2024-02-28T16:37:41.767 INFO:teuthology.orchestra.run.smithi023.stdout:max_file_size 1099511627776 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:max_xattr_size 65536 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:required_client_features {} 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure 0 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:last_failure_osd_epoch 85 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:max_mds 1 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:in 0 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:up {0=34420} 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:failed 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:damaged 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:stopped 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:data_pools [3] 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:metadata_pool 2 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:inline_data disabled 2024-02-28T16:37:41.768 INFO:teuthology.orchestra.run.smithi023.stdout:balancer 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout:bal_rank_mask -1 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout:standby_count_wanted 1 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.pplvdo{0:34420} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.23:6826/2111137079,v1:172.21.15.23:6827/2111137079] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout:Standby daemons: 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi023.klbbrl{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.23:6828/2931963511,v1:172.21.15.23:6829/2931963511] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.senzwp{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3004350118,v1:172.21.15.153:6825/3004350118] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:37:41.769 INFO:teuthology.orchestra.run.smithi023.stdout:[mds.cephfs.smithi153.dhwpyj{-1:44333} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6826/3989995611,v1:172.21.15.153:6827/3989995611] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.780+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c1006d8a0 msgr2=0x7f1c1006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.780+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c1006d8a0 0x7f1c1006fd50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c005ea0 tx=0x7f1c1c005e30 comp rx=0 tx=0).stop 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 msgr2=0x7f1c2c198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c198650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400bda0 tx=0x7f1c1400be80 comp rx=0 tx=0).stop 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 shutdown_connections 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c2c1004e0 0x7f1c2c198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f1c1006d8a0 0x7f1c1006fd50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 --2- 172.21.15.23:0/2294012986 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f1c2c100e80 0x7f1c2c198650 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 >> 172.21.15.23:0/2294012986 conn(0x7f1c2c0fbda0 msgr2=0x7f1c2c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 shutdown_connections 2024-02-28T16:37:41.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:41.781+0000 7f1c32a00700 1 -- 172.21.15.23:0/2294012986 wait complete. 2024-02-28T16:37:41.771 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 36 2024-02-28T16:37:42.592 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-28T16:37:42.604 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:37:42.786 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:42 smithi153 ceph-mon[66339]: pgmap v393: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:42.787 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:42 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2294012986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:37:42.840 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.852+0000 7fa933000640 1 -- 172.21.15.23:0/3242028835 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072580 msgr2=0x7fa92c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.852+0000 7fa933000640 1 --2- 172.21.15.23:0/3242028835 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072580 0x7fa92c072950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009c20 tx=0x7fa91c02c230 comp rx=0 tx=0).stop 2024-02-28T16:37:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.853+0000 7fa933000640 1 -- 172.21.15.23:0/3242028835 shutdown_connections 2024-02-28T16:37:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.853+0000 7fa933000640 1 --2- 172.21.15.23:0/3242028835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa92c072e90 0x7fa92c10b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.853+0000 7fa933000640 1 --2- 172.21.15.23:0/3242028835 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072580 0x7fa92c072950 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.853+0000 7fa933000640 1 -- 172.21.15.23:0/3242028835 >> 172.21.15.23:0/3242028835 conn(0x7fa92c0faff0 msgr2=0x7fa92c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.853+0000 7fa933000640 1 -- 172.21.15.23:0/3242028835 shutdown_connections 2024-02-28T16:37:42.841 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.853+0000 7fa933000640 1 -- 172.21.15.23:0/3242028835 wait complete. 2024-02-28T16:37:42.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.854+0000 7fa933000640 1 Processor -- start 2024-02-28T16:37:42.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.854+0000 7fa933000640 1 -- start start 2024-02-28T16:37:42.842 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.854+0000 7fa933000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa92c072580 0x7fa92c1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.854+0000 7fa933000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072e90 0x7fa92c197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.854+0000 7fa933000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c197e90 con 0x7fa92c072e90 2024-02-28T16:37:42.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.854+0000 7fa933000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c19bc60 con 0x7fa92c072580 2024-02-28T16:37:42.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.855+0000 7fa931200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072e90 0x7fa92c197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.855+0000 7fa931200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072e90 0x7fa92c197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53816/0 (socket says 172.21.15.23:53816) 2024-02-28T16:37:42.843 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.855+0000 7fa931200640 1 -- 172.21.15.23:0/2519221199 learned_addr learned my addr 172.21.15.23:0/2519221199 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:42.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.855+0000 7fa931c00640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa92c072580 0x7fa92c1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.855+0000 7fa931200640 1 -- 172.21.15.23:0/2519221199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa92c072580 msgr2=0x7fa92c1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.844 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.855+0000 7fa931200640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa92c072580 0x7fa92c1972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.855+0000 7fa931200640 1 -- 172.21.15.23:0/2519221199 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c009900 con 0x7fa92c072e90 2024-02-28T16:37:42.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.856+0000 7fa931200640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072e90 0x7fa92c197800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa91800d6f0 tx=0x7fa91800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:42.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.856+0000 7fa92a000640 1 -- 172.21.15.23:0/2519221199 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa918009a30 con 0x7fa92c072e90 2024-02-28T16:37:42.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.856+0000 7fa92a000640 1 -- 172.21.15.23:0/2519221199 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9180054e0 con 0x7fa92c072e90 2024-02-28T16:37:42.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.856+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c19bf40 con 0x7fa92c072e90 2024-02-28T16:37:42.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.856+0000 7fa92a000640 1 -- 172.21.15.23:0/2519221199 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa918010460 con 0x7fa92c072e90 2024-02-28T16:37:42.845 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.856+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c19c4a0 con 0x7fa92c072e90 2024-02-28T16:37:42.846 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.857+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c04e850 con 0x7fa92c072e90 2024-02-28T16:37:42.846 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.858+0000 7fa92a000640 1 -- 172.21.15.23:0/2519221199 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa918009b90 con 0x7fa92c072e90 2024-02-28T16:37:42.848 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.860+0000 7fa92a000640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa91006d8d0 0x7fa91006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.848 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.860+0000 7fa92a000640 1 -- 172.21.15.23:0/2519221199 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa91808d070 con 0x7fa92c072e90 2024-02-28T16:37:42.848 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.860+0000 7fa931c00640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa91006d8d0 0x7fa91006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.851 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.861+0000 7fa931c00640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa91006d8d0 0x7fa91006fd80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa91c000f80 tx=0x7fa91c034dd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:42.853 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:42.865+0000 7fa92a000640 1 -- 172.21.15.23:0/2519221199 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa9180567f0 con 0x7fa92c072e90 2024-02-28T16:37:42.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:42 smithi023 ceph-mon[78509]: pgmap v393: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:42.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:42 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2294012986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:37:43.055 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.067+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa92c10e8c0 con 0x7fa92c072e90 2024-02-28T16:37:43.060 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.069+0000 7fa92a000640 1 -- 172.21.15.23:0/2519221199 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17018 (secure 0 0 0) 0x7fa918020090 con 0x7fa92c072e90 2024-02-28T16:37:43.060 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:43.061 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":85,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","created":"2024-02-28T16:11:11.971217+0000","modified":"2024-02-28T16:32:55.295716+0000","last_up_change":"2024-02-28T16:31:16.808610+0000","last_in_change":"2024-02-28T16:18:11.748474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:16:55.847665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:20:07.748175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:20:08.353450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1936c40d-0a71-495b-af57-ea0cb7224068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6803","nonce":4096152307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6805","nonce":4096152307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6809","nonce":4096152307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6807","nonce":4096152307}]},"public_addr":"172.21.15.23:6803/4096152307","cluster_addr":"172.21.15.23:6805/4096152307","heartbeat_back_addr":"172.21.15.23:6809/4096152307","heartbeat_front_addr":"172.21.15.23:6807/4096152307","state":["exists","up"]},{"osd":1,"uuid":"f2211134-0ddf-4faf-8fda-41ff13201231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6811","nonce":1249689655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6813","nonce":1249689655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6817","nonce":1249689655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6815","nonce":1249689655}]},"public_addr":"172.21.15.23:6811/1249689655","cluster_addr":"172.21.15.23:6813/1249689655","heartbeat_back_addr":"172.21.15.23:6817/1249689655","heartbeat_front_addr":"172.21.15.23:6815/1249689655","state":["exists","up"]},{"osd":2,"uuid":"513a900d-c438-4f9a-ad29-c667f5335070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6819","nonce":779926877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6821","nonce":779926877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6825","nonce":779926877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6823","nonce":779926877}]},"public_addr":"172.21.15.23:6819/779926877","cluster_addr":"172.21.15.23:6821/779926877","heartbeat_back_addr":"172.21.15.23:6825/779926877","heartbeat_front_addr":"172.21.15.23:6823/779926877","state":["exists","up"]},{"osd":3,"uuid":"0b9875a7-8961-49db-bee2-40980eeec169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6801","nonce":487138192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6803","nonce":487138192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6807","nonce":487138192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6805","nonce":487138192}]},"public_addr":"172.21.15.153:6801/487138192","cluster_addr":"172.21.15.153:6803/487138192","heartbeat_back_addr":"172.21.15.153:6807/487138192","heartbeat_front_addr":"172.21.15.153:6805/487138192","state":["exists","up"]},{"osd":4,"uuid":"3266acd3-21ec-4c65-bb5d-48d82334bf09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6809","nonce":1758644183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6811","nonce":1758644183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6815","nonce":1758644183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6813","nonce":1758644183}]},"public_addr":"172.21.15.153:6809/1758644183","cluster_addr":"172.21.15.153:6811/1758644183","heartbeat_back_addr":"172.21.15.153:6815/1758644183","heartbeat_front_addr":"172.21.15.153:6813/1758644183","state":["exists","up"]},{"osd":5,"uuid":"82e08ef8-51d2-494b-b140-ac7bd2c5a320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6817","nonce":3414117647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6819","nonce":3414117647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6823","nonce":3414117647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6821","nonce":3414117647}]},"public_addr":"172.21.15.153:6817/3414117647","cluster_addr":"172.21.15.153:6819/3414117647","heartbeat_back_addr":"172.21.15.153:6823/3414117647","heartbeat_front_addr":"172.21.15.153:6821/3414117647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:15:36.785669+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:13.722392+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:51.886029+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:25.675647+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:59.836960+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:34.102730+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6827/3382879257":"2024-02-29T16:32:55.295667+0000","172.21.15.153:6824/1090050783":"2024-02-29T16:32:23.774174+0000","172.21.15.23:6829/869339807":"2024-02-29T16:31:55.013170+0000","172.21.15.23:0/3255127518":"2024-02-29T16:25:51.083342+0000","172.21.15.23:6801/877826779":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/1312665589":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/2047089350":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6828/869339807":"2024-02-29T16:31:55.013170+0000","172.21.15.23:0/222399421":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/3957078359":"2024-02-29T16:23:02.627520+0000","172.21.15.153:0/3506879033":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/2569614083":"2024-02-29T16:11:45.267597+0000","172.21.15.153:6828/1832791633":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6800/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/2855046725":"2024-02-29T16:23:02.627520+0000","172.21.15.153:0/2101473361":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/1357875446":"2024-02-29T16:12:27.412905+0000","172.21.15.153:6826/3382879257":"2024-02-29T16:32:55.295667+0000","172.21.15.153:0/2394523153":"2024-02-29T16:24:26.370048+0000","172.21.15.153:6825/1090050783":"2024-02-29T16:32:23.774174+0000","172.21.15.153:0/3123495442":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6827/1762270035":"2024-02-29T16:20:27.240686+0000","172.21.15.23:6826/1762270035":"2024-02-29T16:20:27.240686+0000","172.21.15.23:6801/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6800/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1385314359":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6800/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.153:0/4210128758":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6801/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1928653257":"2024-02-29T16:25:51.083342+0000","172.21.15.153:0/1731228796":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/2580029340":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/287772389":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/488139137":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/364787592":"2024-02-29T16:23:02.627520+0000","172.21.15.23:0/3255579829":"2024-02-29T16:12:27.412905+0000","172.21.15.153:6829/1832791633":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/4127609829":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/2032489561":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6801/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/3191093495":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6801/3957078359":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6800/877826779":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/1246504563":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/4090647671":"2024-02-29T16:25:51.083342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:37:43.062 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.071+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa91006d8d0 msgr2=0x7fa91006fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.062 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.071+0000 7fa933000640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa91006d8d0 0x7fa91006fd80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa91c000f80 tx=0x7fa91c034dd0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.071+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072e90 msgr2=0x7fa92c197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.071+0000 7fa933000640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072e90 0x7fa92c197800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa91800d6f0 tx=0x7fa91800dbb0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.071+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 shutdown_connections 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.071+0000 7fa933000640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa91006d8d0 0x7fa91006fd80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.072+0000 7fa933000640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa92c072e90 0x7fa92c197800 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.072+0000 7fa933000640 1 --2- 172.21.15.23:0/2519221199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa92c072580 0x7fa92c1972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.072+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 >> 172.21.15.23:0/2519221199 conn(0x7fa92c0faff0 msgr2=0x7fa92c106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.072+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 shutdown_connections 2024-02-28T16:37:43.063 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.072+0000 7fa933000640 1 -- 172.21.15.23:0/2519221199 wait complete. 2024-02-28T16:37:43.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:16:55.847665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:20:07.748175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:20:08.353450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:37:43.082 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:37:43.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.320+0000 7fe8bac00640 1 -- 172.21.15.23:0/2445217715 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 msgr2=0x7fe8b4072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.320+0000 7fe8bac00640 1 --2- 172.21.15.23:0/2445217715 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4072950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009880 tx=0x7fe8a802bd90 comp rx=0 tx=0).stop 2024-02-28T16:37:43.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.321+0000 7fe8bac00640 1 -- 172.21.15.23:0/2445217715 shutdown_connections 2024-02-28T16:37:43.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.321+0000 7fe8bac00640 1 --2- 172.21.15.23:0/2445217715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8b4072e90 0x7fe8b410b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.321+0000 7fe8bac00640 1 --2- 172.21.15.23:0/2445217715 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4072950 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.309 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.321+0000 7fe8bac00640 1 -- 172.21.15.23:0/2445217715 >> 172.21.15.23:0/2445217715 conn(0x7fe8b40fafb0 msgr2=0x7fe8b40fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.321+0000 7fe8bac00640 1 -- 172.21.15.23:0/2445217715 shutdown_connections 2024-02-28T16:37:43.310 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.321+0000 7fe8bac00640 1 -- 172.21.15.23:0/2445217715 wait complete. 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.322+0000 7fe8bac00640 1 Processor -- start 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.322+0000 7fe8bac00640 1 -- start start 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.322+0000 7fe8bac00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.322+0000 7fe8bac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8b4072e90 0x7fe8b4197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.322+0000 7fe8bac00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4197e50 con 0x7fe8b4072580 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.322+0000 7fe8bac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4197fc0 con 0x7fe8b4072e90 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b9800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b9800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53838/0 (socket says 172.21.15.23:53838) 2024-02-28T16:37:43.312 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b9800640 1 -- 172.21.15.23:0/3964138858 learned_addr learned my addr 172.21.15.23:0/3964138858 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b8e00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8b4072e90 0x7fe8b4197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b9800640 1 -- 172.21.15.23:0/3964138858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8b4072e90 msgr2=0x7fe8b4197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b9800640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8b4072e90 0x7fe8b4197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b9800640 1 -- 172.21.15.23:0/3964138858 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8009560 con 0x7fe8b4072580 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b8e00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8b4072e90 0x7fe8b4197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.323+0000 7fe8b9800640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4197310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8036040 tx=0x7fe8a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.324+0000 7fe8b2000640 1 -- 172.21.15.23:0/3964138858 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a80037c0 con 0x7fe8b4072580 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.324+0000 7fe8b2000640 1 -- 172.21.15.23:0/3964138858 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8a8003de0 con 0x7fe8b4072580 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.324+0000 7fe8b2000640 1 -- 172.21.15.23:0/3964138858 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a803e450 con 0x7fe8b4072580 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.324+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b419bdf0 con 0x7fe8b4072580 2024-02-28T16:37:43.313 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.324+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b419c350 con 0x7fe8b4072580 2024-02-28T16:37:43.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.325+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b404e000 con 0x7fe8b4072580 2024-02-28T16:37:43.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.326+0000 7fe8b2000640 1 -- 172.21.15.23:0/3964138858 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe8a8004fd0 con 0x7fe8b4072580 2024-02-28T16:37:43.314 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.327+0000 7fe8b2000640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe89c06d810 0x7fe89c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.327+0000 7fe8b2000640 1 -- 172.21.15.23:0/3964138858 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe8a80b0380 con 0x7fe8b4072580 2024-02-28T16:37:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.327+0000 7fe8b8e00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe89c06d810 0x7fe89c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.315 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.328+0000 7fe8b8e00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe89c06d810 0x7fe89c06fcc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4198920 tx=0x7fe8a0005d90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.325 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.337+0000 7fe8b2000640 1 -- 172.21.15.23:0/3964138858 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe8a8079b80 con 0x7fe8b4072580 2024-02-28T16:37:43.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.549+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8b410e940 con 0x7fe8b4072580 2024-02-28T16:37:43.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.550+0000 7fe8b2000640 1 -- 172.21.15.23:0/3964138858 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8a807d240 con 0x7fe8b4072580 2024-02-28T16:37:43.538 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 1 2024-02-28T16:37:43.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe89c06d810 msgr2=0x7fe89c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe89c06d810 0x7fe89c06fcc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4198920 tx=0x7fe8a0005d90 comp rx=0 tx=0).stop 2024-02-28T16:37:43.541 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 msgr2=0x7fe8b4197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4197310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8036040 tx=0x7fe8a8004270 comp rx=0 tx=0).stop 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 shutdown_connections 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe89c06d810 0x7fe89c06fcc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8b4072e90 0x7fe8b4197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 --2- 172.21.15.23:0/3964138858 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8b4072580 0x7fe8b4197310 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 >> 172.21.15.23:0/3964138858 conn(0x7fe8b40fafb0 msgr2=0x7fe8b4106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.553+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 shutdown_connections 2024-02-28T16:37:43.542 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.554+0000 7fe8bac00640 1 -- 172.21.15.23:0/3964138858 wait complete. 2024-02-28T16:37:43.559 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:37:43.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.791+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2746885434 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 msgr2=0x7f3d24074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.791+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2746885434 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d24074b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009c20 tx=0x7f3d1402c1b0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.791+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2746885434 shutdown_connections 2024-02-28T16:37:43.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.791+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2746885434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d240750a0 0x7f3d2410fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.791+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2746885434 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d24074b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.791+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2746885434 >> 172.21.15.23:0/2746885434 conn(0x7f3d240fd330 msgr2=0x7f3d240ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.792+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2746885434 shutdown_connections 2024-02-28T16:37:43.780 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.792+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2746885434 wait complete. 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d2ba00640 1 Processor -- start 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d2ba00640 1 -- start start 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d2ba00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d241a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d2ba00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d240750a0 0x7f3d241a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d2ba00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241a2200 con 0x7f3d24074790 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d2ba00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2419b750 con 0x7f3d240750a0 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d29000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d241a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.781 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d29000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d241a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53860/0 (socket says 172.21.15.23:53860) 2024-02-28T16:37:43.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.793+0000 7f3d29000640 1 -- 172.21.15.23:0/2364758370 learned_addr learned my addr 172.21.15.23:0/2364758370 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:43.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d29000640 1 -- 172.21.15.23:0/2364758370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d240750a0 msgr2=0x7f3d241a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d29000640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d240750a0 0x7f3d241a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d29000640 1 -- 172.21.15.23:0/2364758370 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14009900 con 0x7f3d24074790 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d29000640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d241a16c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000f80 tx=0x7f3d14032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d21600640 1 -- 172.21.15.23:0/2364758370 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d14034820 con 0x7f3d24074790 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2419ba30 con 0x7f3d24074790 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d21600640 1 -- 172.21.15.23:0/2364758370 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d14003e30 con 0x7f3d24074790 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.794+0000 7f3d21600640 1 -- 172.21.15.23:0/2364758370 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d1403f440 con 0x7f3d24074790 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.795+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2419bf90 con 0x7f3d24074790 2024-02-28T16:37:43.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.796+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2404e000 con 0x7f3d24074790 2024-02-28T16:37:43.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.797+0000 7f3d21600640 1 -- 172.21.15.23:0/2364758370 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f3d1403b040 con 0x7f3d24074790 2024-02-28T16:37:43.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.798+0000 7f3d21600640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3d0806d810 0x7f3d0806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.798+0000 7f3d21600640 1 -- 172.21.15.23:0/2364758370 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3d140b0430 con 0x7f3d24074790 2024-02-28T16:37:43.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.798+0000 7f3d23e00640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3d0806d810 0x7f3d0806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.799+0000 7f3d23e00640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3d0806d810 0x7f3d0806fcc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d2419cf40 tx=0x7f3d0c005c70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:43.803+0000 7f3d21600640 1 -- 172.21.15.23:0/2364758370 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3d14079a90 con 0x7f3d24074790 2024-02-28T16:37:43.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:43 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2519221199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:37:43.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:43 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2519221199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:37:43.992 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.004+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f3d24112e20 con 0x7f3d24074790 2024-02-28T16:37:43.993 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.005+0000 7f3d21600640 1 -- 172.21.15.23:0/2364758370 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3d1407d150 con 0x7f3d24074790 2024-02-28T16:37:43.993 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:37:43.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3d0806d810 msgr2=0x7f3d0806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3d0806d810 0x7f3d0806fcc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d2419cf40 tx=0x7f3d0c005c70 comp rx=0 tx=0).stop 2024-02-28T16:37:43.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 msgr2=0x7f3d241a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d241a16c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000f80 tx=0x7f3d14032b60 comp rx=0 tx=0).stop 2024-02-28T16:37:43.996 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 shutdown_connections 2024-02-28T16:37:43.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f3d0806d810 0x7f3d0806fcc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d240750a0 0x7f3d241a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 --2- 172.21.15.23:0/2364758370 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f3d24074790 0x7f3d241a16c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 >> 172.21.15.23:0/2364758370 conn(0x7f3d240fd330 msgr2=0x7f3d240fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 shutdown_connections 2024-02-28T16:37:43.997 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.008+0000 7f3d2ba00640 1 -- 172.21.15.23:0/2364758370 wait complete. 2024-02-28T16:37:44.016 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:37:44.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.256+0000 7fe4c8000640 1 -- 172.21.15.23:0/2475661474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 msgr2=0x7fe4c0107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.256+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2475661474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0107c70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009880 tx=0x7fe4b402bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.256+0000 7fe4c8000640 1 -- 172.21.15.23:0/2475661474 shutdown_connections 2024-02-28T16:37:44.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.256+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2475661474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c0101890 0x7fe4c0101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.256+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2475661474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0107c70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.256+0000 7fe4c8000640 1 -- 172.21.15.23:0/2475661474 >> 172.21.15.23:0/2475661474 conn(0x7fe4c00fd330 msgr2=0x7fe4c00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:44.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.257+0000 7fe4c8000640 1 -- 172.21.15.23:0/2475661474 shutdown_connections 2024-02-28T16:37:44.245 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.257+0000 7fe4c8000640 1 -- 172.21.15.23:0/2475661474 wait complete. 2024-02-28T16:37:44.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.258+0000 7fe4c8000640 1 Processor -- start 2024-02-28T16:37:44.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.258+0000 7fe4c8000640 1 -- start start 2024-02-28T16:37:44.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c8000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c0101890 0x7fe4c01974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c8000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c8000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c01980c0 con 0x7fe4c01078a0 2024-02-28T16:37:44.246 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c8000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c019be90 con 0x7fe4c0101890 2024-02-28T16:37:44.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c4c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c4c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53878/0 (socket says 172.21.15.23:53878) 2024-02-28T16:37:44.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c4c00640 1 -- 172.21.15.23:0/2949613992 learned_addr learned my addr 172.21.15.23:0/2949613992 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:44.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c5600640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c0101890 0x7fe4c01974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c4c00640 1 -- 172.21.15.23:0/2949613992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c0101890 msgr2=0x7fe4c01974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c4c00640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c0101890 0x7fe4c01974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.259+0000 7fe4c4c00640 1 -- 172.21.15.23:0/2949613992 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009560 con 0x7fe4c01078a0 2024-02-28T16:37:44.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.260+0000 7fe4c4c00640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0197a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00e970 tx=0x7fe4ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:44.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.260+0000 7fe4be000640 1 -- 172.21.15.23:0/2949613992 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4ac00cc90 con 0x7fe4c01078a0 2024-02-28T16:37:44.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.260+0000 7fe4be000640 1 -- 172.21.15.23:0/2949613992 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4ac00cdf0 con 0x7fe4c01078a0 2024-02-28T16:37:44.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.260+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c019c170 con 0x7fe4c01078a0 2024-02-28T16:37:44.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.260+0000 7fe4be000640 1 -- 172.21.15.23:0/2949613992 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4ac010430 con 0x7fe4c01078a0 2024-02-28T16:37:44.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.260+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c019c750 con 0x7fe4c01078a0 2024-02-28T16:37:44.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.261+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c004e000 con 0x7fe4c01078a0 2024-02-28T16:37:44.250 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.263+0000 7fe4be000640 1 -- 172.21.15.23:0/2949613992 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe4ac0046c0 con 0x7fe4c01078a0 2024-02-28T16:37:44.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.263+0000 7fe4be000640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe4a806d810 0x7fe4a806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.251 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.264+0000 7fe4be000640 1 -- 172.21.15.23:0/2949613992 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe4ac014070 con 0x7fe4c01078a0 2024-02-28T16:37:44.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.264+0000 7fe4c5600640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe4a806d810 0x7fe4a806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.252 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.265+0000 7fe4c5600640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe4a806d810 0x7fe4a806fcc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4006010 tx=0x7fe4b4000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:44.256 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.268+0000 7fe4be000640 1 -- 172.21.15.23:0/2949613992 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe4ac0572a0 con 0x7fe4c01078a0 2024-02-28T16:37:44.458 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.470+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe4c0198840 con 0x7fe4c01078a0 2024-02-28T16:37:44.459 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.471+0000 7fe4be000640 1 -- 172.21.15.23:0/2949613992 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe4ac05a960 con 0x7fe4c01078a0 2024-02-28T16:37:44.459 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:37:44.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe4a806d810 msgr2=0x7fe4a806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe4a806d810 0x7fe4a806fcc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4006010 tx=0x7fe4b4000bc0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 msgr2=0x7fe4c0197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0197a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00e970 tx=0x7fe4ac00ed70 comp rx=0 tx=0).stop 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 shutdown_connections 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe4a806d810 0x7fe4a806fcc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe4c01078a0 0x7fe4c0197a30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 --2- 172.21.15.23:0/2949613992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c0101890 0x7fe4c01974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.474+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 >> 172.21.15.23:0/2949613992 conn(0x7fe4c00fd330 msgr2=0x7fe4c00feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.475+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 shutdown_connections 2024-02-28T16:37:44.463 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.475+0000 7fe4c8000640 1 -- 172.21.15.23:0/2949613992 wait complete. 2024-02-28T16:37:44.481 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T16:37:44.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 -- 172.21.15.23:0/2250528217 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072f10 msgr2=0x7fb15410b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 --2- 172.21.15.23:0/2250528217 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072f10 0x7fb15410b750 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009880 tx=0x7fb13c02bd80 comp rx=0 tx=0).stop 2024-02-28T16:37:44.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 -- 172.21.15.23:0/2250528217 shutdown_connections 2024-02-28T16:37:44.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 --2- 172.21.15.23:0/2250528217 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072f10 0x7fb15410b750 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 --2- 172.21.15.23:0/2250528217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb154072600 0x7fb1540729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 -- 172.21.15.23:0/2250528217 >> 172.21.15.23:0/2250528217 conn(0x7fb1540faf50 msgr2=0x7fb1540fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:44.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 -- 172.21.15.23:0/2250528217 shutdown_connections 2024-02-28T16:37:44.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.712+0000 7fb159000640 1 -- 172.21.15.23:0/2250528217 wait complete. 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.713+0000 7fb159000640 1 Processor -- start 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.713+0000 7fb159000640 1 -- start start 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb159000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072600 0x7fb154197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb159000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb154072f10 0x7fb1541977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb159000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb154197db0 con 0x7fb154072600 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb159000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb154197f20 con 0x7fb154072f10 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb153400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072600 0x7fb154197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb153400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072600 0x7fb154197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53884/0 (socket says 172.21.15.23:53884) 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb153400640 1 -- 172.21.15.23:0/2059963887 learned_addr learned my addr 172.21.15.23:0/2059963887 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:44.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb153400640 1 -- 172.21.15.23:0/2059963887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb154072f10 msgr2=0x7fb1541977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb14be00640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb154072f10 0x7fb1541977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb153400640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb154072f10 0x7fb1541977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb153400640 1 -- 172.21.15.23:0/2059963887 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c009560 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.714+0000 7fb14be00640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb154072f10 0x7fb1541977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.715+0000 7fb153400640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072600 0x7fb154197270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb14400c8a0 tx=0x7fb14400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.715+0000 7fb150c00640 1 -- 172.21.15.23:0/2059963887 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb144007b80 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.715+0000 7fb150c00640 1 -- 172.21.15.23:0/2059963887 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb144007ce0 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.715+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15419bdb0 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.715+0000 7fb150c00640 1 -- 172.21.15.23:0/2059963887 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb144018810 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.715+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15419c310 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.716+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15404e850 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.717+0000 7fb150c00640 1 -- 172.21.15.23:0/2059963887 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb144018a80 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.718+0000 7fb150c00640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb13806d8d0 0x7fb13806fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.718+0000 7fb150c00640 1 -- 172.21.15.23:0/2059963887 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fb14408d840 con 0x7fb154072600 2024-02-28T16:37:44.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.718+0000 7fb14be00640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb13806d8d0 0x7fb13806fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.719+0000 7fb14be00640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb13806d8d0 0x7fb13806fd80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb13c005ec0 tx=0x7fb13c000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:44.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.723+0000 7fb150c00640 1 -- 172.21.15.23:0/2059963887 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb144056ea0 con 0x7fb154072600 2024-02-28T16:37:44.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:44 smithi153 ceph-mon[66339]: pgmap v394: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:44.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:44 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3964138858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:37:44.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:44 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2364758370' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:37:44.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:44 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2949613992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:37:44.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:44 smithi023 ceph-mon[78509]: pgmap v394: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:44.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:44 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3964138858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:37:44.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:44 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2364758370' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:37:44.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:44 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2949613992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:37:44.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.960+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb154108dc0 con 0x7fb154072600 2024-02-28T16:37:44.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.960+0000 7fb150c00640 1 -- 172.21.15.23:0/2059963887 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5002 (secure 0 0 0) 0x7fb14405a560 con 0x7fb154072600 2024-02-28T16:37:44.949 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:44.949 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44309,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3004350118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3004350118},{"type":"v1","addr":"172.21.15.153:6825","nonce":3004350118}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44333,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6827/3989995611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3989995611},{"type":"v1","addr":"172.21.15.153:6827","nonce":3989995611}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:33:05.948811+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34420":{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":0,"incarnation":32,"state":"up:active","state_seq":26,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:44.949 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 36 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb13806d8d0 msgr2=0x7fb13806fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb13806d8d0 0x7fb13806fd80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb13c005ec0 tx=0x7fb13c000bc0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072600 msgr2=0x7fb154197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072600 0x7fb154197270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb14400c8a0 tx=0x7fb14400cd60 comp rx=0 tx=0).stop 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 shutdown_connections 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb13806d8d0 0x7fb13806fd80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb154072f10 0x7fb1541977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 --2- 172.21.15.23:0/2059963887 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb154072600 0x7fb154197270 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 >> 172.21.15.23:0/2059963887 conn(0x7fb1540faf50 msgr2=0x7fb154105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:44.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 shutdown_connections 2024-02-28T16:37:44.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:44.963+0000 7fb159000640 1 -- 172.21.15.23:0/2059963887 wait complete. 2024-02-28T16:37:44.969 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-02-28T16:37:44.969 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-02-28T16:37:45.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 -- 172.21.15.23:0/1490851188 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0294074790 msgr2=0x7f0294074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 --2- 172.21.15.23:0/1490851188 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0294074790 0x7f0294074b60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0284009880 tx=0x7f028402bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 -- 172.21.15.23:0/1490851188 shutdown_connections 2024-02-28T16:37:45.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 --2- 172.21.15.23:0/1490851188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02940750a0 0x7f029410ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 --2- 172.21.15.23:0/1490851188 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f0294074790 0x7f0294074b60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 -- 172.21.15.23:0/1490851188 >> 172.21.15.23:0/1490851188 conn(0x7f02940fd370 msgr2=0x7f02940ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:45.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 -- 172.21.15.23:0/1490851188 shutdown_connections 2024-02-28T16:37:45.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.211+0000 7f029ac00640 1 -- 172.21.15.23:0/1490851188 wait complete. 2024-02-28T16:37:45.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.212+0000 7f029ac00640 1 Processor -- start 2024-02-28T16:37:45.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.212+0000 7f029ac00640 1 -- start start 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.213+0000 7f029ac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0294074790 0x7f02941a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.213+0000 7f029ac00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f02940750a0 0x7f02941a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.213+0000 7f029ac00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029419b810 con 0x7f02940750a0 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.213+0000 7f029ac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029419b980 con 0x7f0294074790 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.213+0000 7f0293400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f02940750a0 0x7f02941a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.213+0000 7f0293400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f02940750a0 0x7f02941a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53894/0 (socket says 172.21.15.23:53894) 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.213+0000 7f0293400640 1 -- 172.21.15.23:0/3120594725 learned_addr learned my addr 172.21.15.23:0/3120594725 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0293e00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0294074790 0x7f02941a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0293400640 1 -- 172.21.15.23:0/3120594725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0294074790 msgr2=0x7f02941a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0293400640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0294074790 0x7f02941a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0293400640 1 -- 172.21.15.23:0/3120594725 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284009560 con 0x7f02940750a0 2024-02-28T16:37:45.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0293400640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f02940750a0 0x7f02941a1ce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c810 tx=0x7f027c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:45.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0290c00640 1 -- 172.21.15.23:0/3120594725 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027c0041f0 con 0x7f02940750a0 2024-02-28T16:37:45.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029419bc60 con 0x7f02940750a0 2024-02-28T16:37:45.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0290c00640 1 -- 172.21.15.23:0/3120594725 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f027c007e70 con 0x7f02940750a0 2024-02-28T16:37:45.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f0290c00640 1 -- 172.21.15.23:0/3120594725 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027c0049d0 con 0x7f02940750a0 2024-02-28T16:37:45.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.214+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029419c1c0 con 0x7f02940750a0 2024-02-28T16:37:45.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.215+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029404e000 con 0x7f02940750a0 2024-02-28T16:37:45.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.217+0000 7f0290c00640 1 -- 172.21.15.23:0/3120594725 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f027c0079b0 con 0x7f02940750a0 2024-02-28T16:37:45.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.218+0000 7f0290c00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f027806d810 0x7f027806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.218+0000 7f0290c00640 1 -- 172.21.15.23:0/3120594725 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f027c08d4d0 con 0x7f02940750a0 2024-02-28T16:37:45.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.218+0000 7f0293e00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f027806d810 0x7f027806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:45.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.219+0000 7f0293e00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f027806d810 0x7f027806fcc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0284036040 tx=0x7f028402cf90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:45.211 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.223+0000 7f0290c00640 1 -- 172.21.15.23:0/3120594725 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f027c056b30 con 0x7f02940750a0 2024-02-28T16:37:45.462 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.474+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f029419cdf0 con 0x7f02940750a0 2024-02-28T16:37:45.464 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.476+0000 7f0290c00640 1 -- 172.21.15.23:0/3120594725 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v36) v1 ==== 107+0+4828 (secure 0 0 0) 0x7f027c05a1f0 con 0x7f02940750a0 2024-02-28T16:37:45.464 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:45.464 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2195483511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2195483511},{"type":"v1","addr":"172.21.15.23:6827","nonce":2195483511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:20:30.265323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi023.klbbrl","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.23:6829/869339807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":869339807},{"type":"v1","addr":"172.21.15.23:6829","nonce":869339807}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:45.465 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 16 2024-02-28T16:37:45.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f027806d810 msgr2=0x7f027806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f027806d810 0x7f027806fcc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0284036040 tx=0x7f028402cf90 comp rx=0 tx=0).stop 2024-02-28T16:37:45.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f02940750a0 msgr2=0x7f02941a1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f02940750a0 0x7f02941a1ce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c810 tx=0x7f027c00ccd0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 shutdown_connections 2024-02-28T16:37:45.467 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f027806d810 0x7f027806fcc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.468 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f02940750a0 0x7f02941a1ce0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.468 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 --2- 172.21.15.23:0/3120594725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0294074790 0x7f02941a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.468 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 >> 172.21.15.23:0/3120594725 conn(0x7f02940fd370 msgr2=0x7f02940fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:45.468 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 shutdown_connections 2024-02-28T16:37:45.468 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.479+0000 7f029ac00640 1 -- 172.21.15.23:0/3120594725 wait complete. 2024-02-28T16:37:45.486 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-28T16:37:45.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:45 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2059963887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:37:45.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:45 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3120594725' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.699+0000 7f98dd600640 1 -- 172.21.15.23:0/2605476498 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 msgr2=0x7f98d8107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.699+0000 7f98dd600640 1 --2- 172.21.15.23:0/2605476498 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8107c60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009880 tx=0x7f98c802bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.700+0000 7f98dd600640 1 -- 172.21.15.23:0/2605476498 shutdown_connections 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.700+0000 7f98dd600640 1 --2- 172.21.15.23:0/2605476498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98d8101880 0x7f98d8101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.700+0000 7f98dd600640 1 --2- 172.21.15.23:0/2605476498 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8107c60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.700+0000 7f98dd600640 1 -- 172.21.15.23:0/2605476498 >> 172.21.15.23:0/2605476498 conn(0x7f98d80fd360 msgr2=0x7f98d80ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.700+0000 7f98dd600640 1 -- 172.21.15.23:0/2605476498 shutdown_connections 2024-02-28T16:37:45.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.700+0000 7f98dd600640 1 -- 172.21.15.23:0/2605476498 wait complete. 2024-02-28T16:37:45.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.701+0000 7f98dd600640 1 Processor -- start 2024-02-28T16:37:45.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.701+0000 7f98dd600640 1 -- start start 2024-02-28T16:37:45.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.701+0000 7f98dd600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98d8101880 0x7f98d81974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:45.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.701+0000 7f98dd600640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:45.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.701+0000 7f98dd600640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81980b0 con 0x7f98d8107890 2024-02-28T16:37:45.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.701+0000 7f98dd600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d819be80 con 0x7f98d8101880 2024-02-28T16:37:45.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.702+0000 7f98d6000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:45.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.702+0000 7f98d6000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53914/0 (socket says 172.21.15.23:53914) 2024-02-28T16:37:45.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.702+0000 7f98d6000640 1 -- 172.21.15.23:0/4115134376 learned_addr learned my addr 172.21.15.23:0/4115134376 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.702+0000 7f98d6a00640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98d8101880 0x7f98d81974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.702+0000 7f98d6000640 1 -- 172.21.15.23:0/4115134376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98d8101880 msgr2=0x7f98d81974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.702+0000 7f98d6000640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98d8101880 0x7f98d81974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.702+0000 7f98d6000640 1 -- 172.21.15.23:0/4115134376 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009560 con 0x7f98d8107890 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.703+0000 7f98d6000640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8197a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f98c400d6f0 tx=0x7f98c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.703+0000 7f98cf400640 1 -- 172.21.15.23:0/4115134376 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c4009a30 con 0x7f98d8107890 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.703+0000 7f98cf400640 1 -- 172.21.15.23:0/4115134376 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98c40054e0 con 0x7f98d8107890 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.703+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d819c160 con 0x7f98d8107890 2024-02-28T16:37:45.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.703+0000 7f98cf400640 1 -- 172.21.15.23:0/4115134376 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c4010460 con 0x7f98d8107890 2024-02-28T16:37:45.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.703+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d819c740 con 0x7f98d8107890 2024-02-28T16:37:45.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.704+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d804e000 con 0x7f98d8107890 2024-02-28T16:37:45.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.705+0000 7f98cf400640 1 -- 172.21.15.23:0/4115134376 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f98c4009b90 con 0x7f98d8107890 2024-02-28T16:37:45.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.706+0000 7f98cf400640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f98bc06d810 0x7f98bc06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:45.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.706+0000 7f98cf400640 1 -- 172.21.15.23:0/4115134376 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f98c408d160 con 0x7f98d8107890 2024-02-28T16:37:45.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.707+0000 7f98d6a00640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f98bc06d810 0x7f98bc06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:45.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.707+0000 7f98d6a00640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f98bc06d810 0x7f98bc06fcc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f98c8006010 tx=0x7f98c8000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:45.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.711+0000 7f98cf400640 1 -- 172.21.15.23:0/4115134376 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f98c4056860 con 0x7f98d8107890 2024-02-28T16:37:45.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:45 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2059963887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:37:45.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:45 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3120594725' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-28T16:37:45.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.959+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f98d80008d0 con 0x7f98d8107890 2024-02-28T16:37:45.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.960+0000 7f98cf400640 1 -- 172.21.15.23:0/4115134376 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) v1 ==== 107+0+4049 (secure 0 0 0) 0x7f98c4059f20 con 0x7f98d8107890 2024-02-28T16:37:45.948 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:45.948 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:20:30.265323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi023.klbbrl","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.23:6829/869339807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":869339807},{"type":"v1","addr":"172.21.15.23:6829","nonce":869339807}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:45.948 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 17 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f98bc06d810 msgr2=0x7f98bc06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f98bc06d810 0x7f98bc06fcc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f98c8006010 tx=0x7f98c8000bc0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 msgr2=0x7f98d8197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8197a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f98c400d6f0 tx=0x7f98c400dbb0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 shutdown_connections 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f98bc06d810 0x7f98bc06fcc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f98d8107890 0x7f98d8197a20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 --2- 172.21.15.23:0/4115134376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98d8101880 0x7f98d81974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 >> 172.21.15.23:0/4115134376 conn(0x7f98d80fd360 msgr2=0x7f98d80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 shutdown_connections 2024-02-28T16:37:45.951 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:45.963+0000 7f98dd600640 1 -- 172.21.15.23:0/4115134376 wait complete. 2024-02-28T16:37:45.971 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 -- 172.21.15.23:0/1153577615 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 msgr2=0x7f005c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 --2- 172.21.15.23:0/1153577615 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c0729d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0050009c20 tx=0x7f005002c230 comp rx=0 tx=0).stop 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 -- 172.21.15.23:0/1153577615 shutdown_connections 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 --2- 172.21.15.23:0/1153577615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f005c072f10 0x7f005c10b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 --2- 172.21.15.23:0/1153577615 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c0729d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 -- 172.21.15.23:0/1153577615 >> 172.21.15.23:0/1153577615 conn(0x7f005c0fafb0 msgr2=0x7f005c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 -- 172.21.15.23:0/1153577615 shutdown_connections 2024-02-28T16:37:46.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.209+0000 7f0062c00640 1 -- 172.21.15.23:0/1153577615 wait complete. 2024-02-28T16:37:46.198 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.210+0000 7f0062c00640 1 Processor -- start 2024-02-28T16:37:46.198 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.210+0000 7f0062c00640 1 -- start start 2024-02-28T16:37:46.198 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0062c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:46.198 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0062c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f005c072f10 0x7f005c197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:46.198 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0062c00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c197f10 con 0x7f005c072600 2024-02-28T16:37:46.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0062c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c19bce0 con 0x7f005c072f10 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0061800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0061800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53942/0 (socket says 172.21.15.23:53942) 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0061800640 1 -- 172.21.15.23:0/4182959602 learned_addr learned my addr 172.21.15.23:0/4182959602 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0060e00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f005c072f10 0x7f005c197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0061800640 1 -- 172.21.15.23:0/4182959602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f005c072f10 msgr2=0x7f005c197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0061800640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f005c072f10 0x7f005c197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.211+0000 7f0061800640 1 -- 172.21.15.23:0/4182959602 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050009900 con 0x7f005c072600 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.212+0000 7f0061800640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c197340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0050037040 tx=0x7f0050034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.212+0000 7f005a000640 1 -- 172.21.15.23:0/4182959602 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0050003b40 con 0x7f005c072600 2024-02-28T16:37:46.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.212+0000 7f005a000640 1 -- 172.21.15.23:0/4182959602 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0050032e60 con 0x7f005c072600 2024-02-28T16:37:46.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.212+0000 7f005a000640 1 -- 172.21.15.23:0/4182959602 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0050004800 con 0x7f005c072600 2024-02-28T16:37:46.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.212+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c19bf60 con 0x7f005c072600 2024-02-28T16:37:46.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.212+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c19c460 con 0x7f005c072600 2024-02-28T16:37:46.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.213+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c04e000 con 0x7f005c072600 2024-02-28T16:37:46.202 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.214+0000 7f005a000640 1 -- 172.21.15.23:0/4182959602 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f005003b040 con 0x7f005c072600 2024-02-28T16:37:46.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.215+0000 7f005a000640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f004406d810 0x7f004406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:46.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.215+0000 7f005a000640 1 -- 172.21.15.23:0/4182959602 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f00500b0230 con 0x7f005c072600 2024-02-28T16:37:46.203 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.216+0000 7f0060e00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f004406d810 0x7f004406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:46.204 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.216+0000 7f0060e00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f004406d810 0x7f004406fcc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0048005fd0 tx=0x7f0048005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:46.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.220+0000 7f005a000640 1 -- 172.21.15.23:0/4182959602 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0050079910 con 0x7f005c072600 2024-02-28T16:37:46.451 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.463+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f005c108e20 con 0x7f005c072600 2024-02-28T16:37:46.452 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.465+0000 7f005a000640 1 -- 172.21.15.23:0/4182959602 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4862 (secure 0 0 0) 0x7f005007cfd0 con 0x7f005c072600 2024-02-28T16:37:46.453 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:46.453 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:20:30.265323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi023.klbbrl","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.23:6829/869339807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":869339807},{"type":"v1","addr":"172.21.15.23:6829","nonce":869339807}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:46.453 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 18 2024-02-28T16:37:46.455 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.467+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f004406d810 msgr2=0x7f004406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.455 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f004406d810 0x7f004406fcc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0048005fd0 tx=0x7f0048005850 comp rx=0 tx=0).stop 2024-02-28T16:37:46.455 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 msgr2=0x7f005c197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c197340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0050037040 tx=0x7f0050034670 comp rx=0 tx=0).stop 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 shutdown_connections 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f004406d810 0x7f004406fcc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f005c072f10 0x7f005c197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 --2- 172.21.15.23:0/4182959602 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f005c072600 0x7f005c197340 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 >> 172.21.15.23:0/4182959602 conn(0x7f005c0fafb0 msgr2=0x7f005c105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 shutdown_connections 2024-02-28T16:37:46.456 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.468+0000 7f0062c00640 1 -- 172.21.15.23:0/4182959602 wait complete. 2024-02-28T16:37:46.476 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-28T16:37:46.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 -- 172.21.15.23:0/3749809214 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072600 msgr2=0x7fd8880729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 --2- 172.21.15.23:0/3749809214 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072600 0x7fd8880729d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd878009880 tx=0x7fd87802bd90 comp rx=0 tx=0).stop 2024-02-28T16:37:46.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 -- 172.21.15.23:0/3749809214 shutdown_connections 2024-02-28T16:37:46.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 --2- 172.21.15.23:0/3749809214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd888072f10 0x7fd88810b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 --2- 172.21.15.23:0/3749809214 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072600 0x7fd8880729d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 -- 172.21.15.23:0/3749809214 >> 172.21.15.23:0/3749809214 conn(0x7fd8880fafb0 msgr2=0x7fd8880fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:46.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 -- 172.21.15.23:0/3749809214 shutdown_connections 2024-02-28T16:37:46.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.716+0000 7fd88d600640 1 -- 172.21.15.23:0/3749809214 wait complete. 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.717+0000 7fd88d600640 1 Processor -- start 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.717+0000 7fd88d600640 1 -- start start 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.717+0000 7fd88d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd888072600 0x7fd888197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.717+0000 7fd88d600640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072f10 0x7fd888197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.717+0000 7fd88d600640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888197f10 con 0x7fd888072f10 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.717+0000 7fd88d600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88819bce0 con 0x7fd888072600 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.718+0000 7fd87f400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072f10 0x7fd888197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.718+0000 7fd87f400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072f10 0x7fd888197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53958/0 (socket says 172.21.15.23:53958) 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.718+0000 7fd87f400640 1 -- 172.21.15.23:0/2201465042 learned_addr learned my addr 172.21.15.23:0/2201465042 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:46.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.718+0000 7fd887e00640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd888072600 0x7fd888197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:46.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.718+0000 7fd87f400640 1 -- 172.21.15.23:0/2201465042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd888072600 msgr2=0x7fd888197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.718+0000 7fd87f400640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd888072600 0x7fd888197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.718+0000 7fd87f400640 1 -- 172.21.15.23:0/2201465042 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878009560 con 0x7fd888072f10 2024-02-28T16:37:46.707 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.719+0000 7fd87f400640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072f10 0x7fd888197880 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd87000d6f0 tx=0x7fd87000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:46.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.719+0000 7fd885600640 1 -- 172.21.15.23:0/2201465042 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd870009a30 con 0x7fd888072f10 2024-02-28T16:37:46.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.719+0000 7fd885600640 1 -- 172.21.15.23:0/2201465042 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8700054e0 con 0x7fd888072f10 2024-02-28T16:37:46.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.719+0000 7fd885600640 1 -- 172.21.15.23:0/2201465042 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd870010460 con 0x7fd888072f10 2024-02-28T16:37:46.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.719+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88819bfc0 con 0x7fd888072f10 2024-02-28T16:37:46.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.719+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88819c520 con 0x7fd888072f10 2024-02-28T16:37:46.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.720+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88804e000 con 0x7fd888072f10 2024-02-28T16:37:46.709 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.721+0000 7fd885600640 1 -- 172.21.15.23:0/2201465042 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd870009b90 con 0x7fd888072f10 2024-02-28T16:37:46.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.723+0000 7fd885600640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd86c06d810 0x7fd86c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:46.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.723+0000 7fd885600640 1 -- 172.21.15.23:0/2201465042 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd87008d070 con 0x7fd888072f10 2024-02-28T16:37:46.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.723+0000 7fd887e00640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd86c06d810 0x7fd86c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:46.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.724+0000 7fd887e00640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd86c06d810 0x7fd86c06fcc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd878006010 tx=0x7fd878000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:46.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.728+0000 7fd885600640 1 -- 172.21.15.23:0/2201465042 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd8700567f0 con 0x7fd888072f10 2024-02-28T16:37:46.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:46 smithi153 ceph-mon[66339]: pgmap v395: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:46.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:46 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/4115134376' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-28T16:37:46.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:46 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/4182959602' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-28T16:37:46.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:46 smithi023 ceph-mon[78509]: pgmap v395: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:46.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:46 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/4115134376' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-28T16:37:46.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:46 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/4182959602' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-28T16:37:46.960 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.972+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fd888108e20 con 0x7fd888072f10 2024-02-28T16:37:46.961 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.973+0000 7fd885600640 1 -- 172.21.15.23:0/2201465042 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4075 (secure 0 0 0) 0x7fd870020090 con 0x7fd888072f10 2024-02-28T16:37:46.961 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:46.961 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:31:55.013185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:46.961 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 19 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.975+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd86c06d810 msgr2=0x7fd86c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.975+0000 7fd88d600640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd86c06d810 0x7fd86c06fcc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd878006010 tx=0x7fd878000bc0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.975+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072f10 msgr2=0x7fd888197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.975+0000 7fd88d600640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072f10 0x7fd888197880 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd87000d6f0 tx=0x7fd87000dbb0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.976+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 shutdown_connections 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.976+0000 7fd88d600640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fd86c06d810 0x7fd86c06fcc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.976+0000 7fd88d600640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fd888072f10 0x7fd888197880 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.976+0000 7fd88d600640 1 --2- 172.21.15.23:0/2201465042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd888072600 0x7fd888197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.976+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 >> 172.21.15.23:0/2201465042 conn(0x7fd8880fafb0 msgr2=0x7fd888105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.976+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 shutdown_connections 2024-02-28T16:37:46.964 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:46.976+0000 7fd88d600640 1 -- 172.21.15.23:0/2201465042 wait complete. 2024-02-28T16:37:46.982 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-28T16:37:47.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 -- 172.21.15.23:0/1827220990 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 msgr2=0x7f5760074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 --2- 172.21.15.23:0/1827220990 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f5760074b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5750009880 tx=0x7f575002bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 -- 172.21.15.23:0/1827220990 shutdown_connections 2024-02-28T16:37:47.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 --2- 172.21.15.23:0/1827220990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57600750a0 0x7f576010fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 --2- 172.21.15.23:0/1827220990 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f5760074b60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 -- 172.21.15.23:0/1827220990 >> 172.21.15.23:0/1827220990 conn(0x7f57600fd390 msgr2=0x7f57600ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:47.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 -- 172.21.15.23:0/1827220990 shutdown_connections 2024-02-28T16:37:47.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.192+0000 7f5765800640 1 -- 172.21.15.23:0/1827220990 wait complete. 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.193+0000 7f5765800640 1 Processor -- start 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.193+0000 7f5765800640 1 -- start start 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f5765800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f57601a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f5765800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57600750a0 0x7f57601a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f5765800640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57601a22a0 con 0x7f5760074790 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f5765800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576019b7a0 con 0x7f57600750a0 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f575ea00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f57601a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f575ea00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f57601a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53978/0 (socket says 172.21.15.23:53978) 2024-02-28T16:37:47.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f575ea00640 1 -- 172.21.15.23:0/771519897 learned_addr learned my addr 172.21.15.23:0/771519897 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:47.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f575e000640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57600750a0 0x7f57601a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:47.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.194+0000 7f575ea00640 1 -- 172.21.15.23:0/771519897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57600750a0 msgr2=0x7f57601a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f575ea00640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57600750a0 0x7f57601a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f575ea00640 1 -- 172.21.15.23:0/771519897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750009560 con 0x7f5760074790 2024-02-28T16:37:47.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f575e000640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57600750a0 0x7f57601a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:47.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f575ea00640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f57601a16d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5750036040 tx=0x7f5750004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:47.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f5757400640 1 -- 172.21.15.23:0/771519897 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5750004aa0 con 0x7f5760074790 2024-02-28T16:37:47.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f5757400640 1 -- 172.21.15.23:0/771519897 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5750003cc0 con 0x7f5760074790 2024-02-28T16:37:47.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f5757400640 1 -- 172.21.15.23:0/771519897 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5750034440 con 0x7f5760074790 2024-02-28T16:37:47.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576019ba20 con 0x7f5760074790 2024-02-28T16:37:47.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.195+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576019bf80 con 0x7f5760074790 2024-02-28T16:37:47.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.197+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576004e000 con 0x7f5760074790 2024-02-28T16:37:47.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.198+0000 7f5757400640 1 -- 172.21.15.23:0/771519897 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f5750005060 con 0x7f5760074790 2024-02-28T16:37:47.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.199+0000 7f5757400640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f574406d810 0x7f574406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:47.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.199+0000 7f5757400640 1 -- 172.21.15.23:0/771519897 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f57500afc60 con 0x7f5760074790 2024-02-28T16:37:47.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.199+0000 7f575e000640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f574406d810 0x7f574406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:47.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.200+0000 7f575e000640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f574406d810 0x7f574406fcc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f576019cf90 tx=0x7f574c005d30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:47.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.208+0000 7f5757400640 1 -- 172.21.15.23:0/771519897 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f57500792c0 con 0x7f5760074790 2024-02-28T16:37:47.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.454+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f576010d6d0 con 0x7f5760074790 2024-02-28T16:37:47.443 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.455+0000 7f5757400640 1 -- 172.21.15.23:0/771519897 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4086 (secure 0 0 0) 0x7f575007c980 con 0x7f5760074790 2024-02-28T16:37:47.443 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:47.443 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:31:55.022316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":0,"incarnation":20,"state":"up:replay","state_seq":4,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:47.443 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 20 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f574406d810 msgr2=0x7f574406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f574406d810 0x7f574406fcc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f576019cf90 tx=0x7f574c005d30 comp rx=0 tx=0).stop 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 msgr2=0x7f57601a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f57601a16d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5750036040 tx=0x7f5750004270 comp rx=0 tx=0).stop 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 shutdown_connections 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f574406d810 0x7f574406fcc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57600750a0 0x7f57601a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 --2- 172.21.15.23:0/771519897 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f5760074790 0x7f57601a16d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 >> 172.21.15.23:0/771519897 conn(0x7f57600fd390 msgr2=0x7f57600ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 shutdown_connections 2024-02-28T16:37:47.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.458+0000 7f5765800640 1 -- 172.21.15.23:0/771519897 wait complete. 2024-02-28T16:37:47.465 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-28T16:37:47.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.671+0000 7f7480200640 1 -- 172.21.15.23:0/1289451829 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7478074790 msgr2=0x7f7478074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.671+0000 7f7480200640 1 --2- 172.21.15.23:0/1289451829 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7478074790 0x7f7478074b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f746c009880 tx=0x7f746c02bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.671+0000 7f7480200640 1 -- 172.21.15.23:0/1289451829 shutdown_connections 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.671+0000 7f7480200640 1 --2- 172.21.15.23:0/1289451829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74780750a0 0x7f747810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.671+0000 7f7480200640 1 --2- 172.21.15.23:0/1289451829 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f7478074790 0x7f7478074b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.671+0000 7f7480200640 1 -- 172.21.15.23:0/1289451829 >> 172.21.15.23:0/1289451829 conn(0x7f74780fd390 msgr2=0x7f74780ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.672+0000 7f7480200640 1 -- 172.21.15.23:0/1289451829 shutdown_connections 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.672+0000 7f7480200640 1 -- 172.21.15.23:0/1289451829 wait complete. 2024-02-28T16:37:47.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.673+0000 7f7480200640 1 Processor -- start 2024-02-28T16:37:47.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.673+0000 7f7480200640 1 -- start start 2024-02-28T16:37:47.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.673+0000 7f7480200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478074790 0x7f74781a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f7480200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74780750a0 0x7f74781a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f7480200640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74781a22a0 con 0x7f74780750a0 2024-02-28T16:37:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f7480200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747819b7a0 con 0x7f7478074790 2024-02-28T16:37:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f747ce00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74780750a0 0x7f74781a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f747ce00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74780750a0 0x7f74781a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53984/0 (socket says 172.21.15.23:53984) 2024-02-28T16:37:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f747ce00640 1 -- 172.21.15.23:0/2470608365 learned_addr learned my addr 172.21.15.23:0/2470608365 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:47.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f747d800640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478074790 0x7f74781a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f747ce00640 1 -- 172.21.15.23:0/2470608365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478074790 msgr2=0x7f74781a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f747ce00640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478074790 0x7f74781a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.674+0000 7f747ce00640 1 -- 172.21.15.23:0/2470608365 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009560 con 0x7f74780750a0 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.675+0000 7f747ce00640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74780750a0 0x7f74781a1c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f746400d6f0 tx=0x7f746400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.675+0000 7f7476000640 1 -- 172.21.15.23:0/2470608365 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7464009a30 con 0x7f74780750a0 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.675+0000 7f7476000640 1 -- 172.21.15.23:0/2470608365 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74640054e0 con 0x7f74780750a0 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.675+0000 7f7476000640 1 -- 172.21.15.23:0/2470608365 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7464010460 con 0x7f74780750a0 2024-02-28T16:37:47.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.675+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747819ba80 con 0x7f74780750a0 2024-02-28T16:37:47.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.675+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747819bf90 con 0x7f74780750a0 2024-02-28T16:37:47.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.676+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747804e000 con 0x7f74780750a0 2024-02-28T16:37:47.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.678+0000 7f7476000640 1 -- 172.21.15.23:0/2470608365 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f7464009b90 con 0x7f74780750a0 2024-02-28T16:37:47.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.678+0000 7f7476000640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f746006d810 0x7f746006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:47.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.679+0000 7f7476000640 1 -- 172.21.15.23:0/2470608365 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f746408d160 con 0x7f74780750a0 2024-02-28T16:37:47.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.679+0000 7f747d800640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f746006d810 0x7f746006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:47.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.680+0000 7f747d800640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f746006d810 0x7f746006fcc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f746c006010 tx=0x7f746c02cf90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:47.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.684+0000 7f7476000640 1 -- 172.21.15.23:0/2470608365 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7464056860 con 0x7f74780750a0 2024-02-28T16:37:47.795 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:47 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:47.795 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:47 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2201465042' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T16:37:47.795 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:47 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/771519897' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T16:37:47.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:47 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:47.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:47 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2201465042' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T16:37:47.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:47 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/771519897' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T16:37:47.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.942+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f747810d6d0 con 0x7f74780750a0 2024-02-28T16:37:47.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.943+0000 7f7476000640 1 -- 172.21.15.23:0/2470608365 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4899 (secure 0 0 0) 0x7f7464059f20 con 0x7f74780750a0 2024-02-28T16:37:47.932 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:47.932 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:31:55.022316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":0,"incarnation":20,"state":"up:replay","state_seq":4,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:47.932 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 21 2024-02-28T16:37:47.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f746006d810 msgr2=0x7f746006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f746006d810 0x7f746006fcc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f746c006010 tx=0x7f746c02cf90 comp rx=0 tx=0).stop 2024-02-28T16:37:47.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74780750a0 msgr2=0x7f74781a1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:47.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74780750a0 0x7f74781a1c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f746400d6f0 tx=0x7f746400dbb0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 shutdown_connections 2024-02-28T16:37:47.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f746006d810 0x7f746006fcc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74780750a0 0x7f74781a1c10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 --2- 172.21.15.23:0/2470608365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478074790 0x7f74781a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:47.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.947+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 >> 172.21.15.23:0/2470608365 conn(0x7f74780fd390 msgr2=0x7f74780ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:47.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.948+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 shutdown_connections 2024-02-28T16:37:47.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:47.948+0000 7f7480200640 1 -- 172.21.15.23:0/2470608365 wait complete. 2024-02-28T16:37:47.955 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 -- 172.21.15.23:0/1908189450 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb40ff4b0 msgr2=0x7fcbb40ff920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 --2- 172.21.15.23:0/1908189450 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb40ff4b0 0x7fcbb40ff920 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009880 tx=0x7fcba002bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 -- 172.21.15.23:0/1908189450 shutdown_connections 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 --2- 172.21.15.23:0/1908189450 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb40ff4b0 0x7fcbb40ff920 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 --2- 172.21.15.23:0/1908189450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb41054c0 0x7fcbb4105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 -- 172.21.15.23:0/1908189450 >> 172.21.15.23:0/1908189450 conn(0x7fcbb40fafb0 msgr2=0x7fcbb40fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 -- 172.21.15.23:0/1908189450 shutdown_connections 2024-02-28T16:37:48.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.188+0000 7fcbba400640 1 -- 172.21.15.23:0/1908189450 wait complete. 2024-02-28T16:37:48.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.189+0000 7fcbba400640 1 Processor -- start 2024-02-28T16:37:48.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.189+0000 7fcbba400640 1 -- start start 2024-02-28T16:37:48.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.189+0000 7fcbba400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb40ff4b0 0x7fcbb4072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:48.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.189+0000 7fcbba400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb41054c0 0x7fcbb4072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:48.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.189+0000 7fcbba400640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4072fe0 con 0x7fcbb41054c0 2024-02-28T16:37:48.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.189+0000 7fcbba400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4073150 con 0x7fcbb40ff4b0 2024-02-28T16:37:48.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.190+0000 7fcbb3e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb41054c0 0x7fcbb4072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:48.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.190+0000 7fcbb3e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb41054c0 0x7fcbb4072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:53996/0 (socket says 172.21.15.23:53996) 2024-02-28T16:37:48.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.190+0000 7fcbb3e00640 1 -- 172.21.15.23:0/594434824 learned_addr learned my addr 172.21.15.23:0/594434824 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:48.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.190+0000 7fcbb9000640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb40ff4b0 0x7fcbb4072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:48.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.190+0000 7fcbb3e00640 1 -- 172.21.15.23:0/594434824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb40ff4b0 msgr2=0x7fcbb4072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.190+0000 7fcbb3e00640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb40ff4b0 0x7fcbb4072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.190+0000 7fcbb3e00640 1 -- 172.21.15.23:0/594434824 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0009560 con 0x7fcbb41054c0 2024-02-28T16:37:48.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.191+0000 7fcbb3e00640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb41054c0 0x7fcbb4072aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000c00 tx=0x7fcba0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:48.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.191+0000 7fcbb1600640 1 -- 172.21.15.23:0/594434824 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba00037c0 con 0x7fcbb41054c0 2024-02-28T16:37:48.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.191+0000 7fcbb1600640 1 -- 172.21.15.23:0/594434824 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcba0003de0 con 0x7fcbb41054c0 2024-02-28T16:37:48.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.191+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb4073370 con 0x7fcbb41054c0 2024-02-28T16:37:48.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.191+0000 7fcbb1600640 1 -- 172.21.15.23:0/594434824 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba0034460 con 0x7fcbb41054c0 2024-02-28T16:37:48.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.191+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb41a1640 con 0x7fcbb41054c0 2024-02-28T16:37:48.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.193+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb404e000 con 0x7fcbb41054c0 2024-02-28T16:37:48.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.194+0000 7fcbb1600640 1 -- 172.21.15.23:0/594434824 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fcba0003920 con 0x7fcbb41054c0 2024-02-28T16:37:48.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.196+0000 7fcbb1600640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcb9c06d810 0x7fcb9c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:48.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.196+0000 7fcbb1600640 1 -- 172.21.15.23:0/594434824 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fcba00afb00 con 0x7fcbb41054c0 2024-02-28T16:37:48.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.196+0000 7fcbb9000640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcb9c06d810 0x7fcb9c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:48.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.197+0000 7fcbb9000640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcb9c06d810 0x7fcb9c06fcc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcba80058c0 tx=0x7fcba800a4c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:48.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.201+0000 7fcbb1600640 1 -- 172.21.15.23:0/594434824 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcba00792c0 con 0x7fcbb41054c0 2024-02-28T16:37:48.430 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.442+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fcbb410c8f0 con 0x7fcbb41054c0 2024-02-28T16:37:48.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.443+0000 7fcbb1600640 1 -- 172.21.15.23:0/594434824 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+4904 (secure 0 0 0) 0x7fcba007c980 con 0x7fcbb41054c0 2024-02-28T16:37:48.431 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:48.431 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:03.488377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":178,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:48.431 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 22 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcb9c06d810 msgr2=0x7fcb9c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcb9c06d810 0x7fcb9c06fcc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcba80058c0 tx=0x7fcba800a4c0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb41054c0 msgr2=0x7fcbb4072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb41054c0 0x7fcbb4072aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000c00 tx=0x7fcba0004270 comp rx=0 tx=0).stop 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 shutdown_connections 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fcb9c06d810 0x7fcb9c06fcc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fcbb41054c0 0x7fcbb4072aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 --2- 172.21.15.23:0/594434824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb40ff4b0 0x7fcbb4072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 >> 172.21.15.23:0/594434824 conn(0x7fcbb40fafb0 msgr2=0x7fcbb40fb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:48.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 shutdown_connections 2024-02-28T16:37:48.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.446+0000 7fcbba400640 1 -- 172.21.15.23:0/594434824 wait complete. 2024-02-28T16:37:48.455 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-28T16:37:48.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.689+0000 7f10f2c00640 1 -- 172.21.15.23:0/1296438876 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 msgr2=0x7f10ec107c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.689+0000 7f10f2c00640 1 --2- 172.21.15.23:0/1296438876 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec107c10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009880 tx=0x7f10d402bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.689+0000 7f10f2c00640 1 -- 172.21.15.23:0/1296438876 shutdown_connections 2024-02-28T16:37:48.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.689+0000 7f10f2c00640 1 --2- 172.21.15.23:0/1296438876 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec107c10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.689+0000 7f10f2c00640 1 --2- 172.21.15.23:0/1296438876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec06d1d0 0x7f10ec107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.689+0000 7f10f2c00640 1 -- 172.21.15.23:0/1296438876 >> 172.21.15.23:0/1296438876 conn(0x7f10ec06bc20 msgr2=0x7f10ec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:48.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.690+0000 7f10f2c00640 1 -- 172.21.15.23:0/1296438876 shutdown_connections 2024-02-28T16:37:48.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.690+0000 7f10f2c00640 1 -- 172.21.15.23:0/1296438876 wait complete. 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.690+0000 7f10f2c00640 1 Processor -- start 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10f2c00640 1 -- start start 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10f2c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec06d1d0 0x7f10ec1a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10f2c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec1a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10f2c00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec19daa0 con 0x7f10ec1077a0 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10f2c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec19dbe0 con 0x7f10ec06d1d0 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10e3e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec1a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10e3e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec1a4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54006/0 (socket says 172.21.15.23:54006) 2024-02-28T16:37:48.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.691+0000 7f10e3e00640 1 -- 172.21.15.23:0/632408569 learned_addr learned my addr 172.21.15.23:0/632408569 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:48.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10e3e00640 1 -- 172.21.15.23:0/632408569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec06d1d0 msgr2=0x7f10ec1a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10e3e00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec06d1d0 0x7f10ec1a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10e3e00640 1 -- 172.21.15.23:0/632408569 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4009560 con 0x7f10ec1077a0 2024-02-28T16:37:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10e3e00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec1a4000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009230 tx=0x7f10d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:48.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10e9600640 1 -- 172.21.15.23:0/632408569 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d40037c0 con 0x7f10ec1077a0 2024-02-28T16:37:48.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10e9600640 1 -- 172.21.15.23:0/632408569 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10d4003de0 con 0x7f10ec1077a0 2024-02-28T16:37:48.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10e9600640 1 -- 172.21.15.23:0/632408569 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d403e450 con 0x7f10ec1077a0 2024-02-28T16:37:48.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.692+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec19de60 con 0x7f10ec1077a0 2024-02-28T16:37:48.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.693+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec19e3c0 con 0x7f10ec1077a0 2024-02-28T16:37:48.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.694+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec04e000 con 0x7f10ec1077a0 2024-02-28T16:37:48.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.695+0000 7f10e9600640 1 -- 172.21.15.23:0/632408569 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f10d4004f60 con 0x7f10ec1077a0 2024-02-28T16:37:48.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.696+0000 7f10e9600640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f10d006d810 0x7f10d006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:48.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.696+0000 7f10e9600640 1 -- 172.21.15.23:0/632408569 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f10d40b0370 con 0x7f10ec1077a0 2024-02-28T16:37:48.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.696+0000 7f10ebe00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f10d006d810 0x7f10d006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:48.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.697+0000 7f10ebe00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f10d006d810 0x7f10d006fcc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009710 tx=0x7f10dc006c90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:48.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.701+0000 7f10e9600640 1 -- 172.21.15.23:0/632408569 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f10d40799d0 con 0x7f10ec1077a0 2024-02-28T16:37:48.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:48 smithi153 ceph-mon[66339]: pgmap v396: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:48.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:48 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2470608365' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T16:37:48.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:48 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:48.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:48 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:37:48.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:48 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:37:48.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:48 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/594434824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T16:37:48.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:48 smithi023 ceph-mon[78509]: pgmap v396: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:48.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:48 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2470608365' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T16:37:48.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:48 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:48.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:48 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:37:48.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:48 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:37:48.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:48 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/594434824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T16:37:48.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.949+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f10ec115130 con 0x7f10ec1077a0 2024-02-28T16:37:48.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.950+0000 7f10e9600640 1 -- 172.21.15.23:0/632408569 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+4901 (secure 0 0 0) 0x7f10d407d090 con 0x7f10ec1077a0 2024-02-28T16:37:48.938 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:48.938 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:04.354468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":179,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:48.938 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 23 2024-02-28T16:37:48.941 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.953+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f10d006d810 msgr2=0x7f10d006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.941 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.953+0000 7f10f2c00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f10d006d810 0x7f10d006fcc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009710 tx=0x7f10dc006c90 comp rx=0 tx=0).stop 2024-02-28T16:37:48.941 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.953+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 msgr2=0x7f10ec1a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:48.941 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.953+0000 7f10f2c00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec1a4000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009230 tx=0x7f10d4004270 comp rx=0 tx=0).stop 2024-02-28T16:37:48.942 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.954+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 shutdown_connections 2024-02-28T16:37:48.942 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.954+0000 7f10f2c00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f10d006d810 0x7f10d006fcc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.942 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.954+0000 7f10f2c00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f10ec1077a0 0x7f10ec1a4000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.942 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.954+0000 7f10f2c00640 1 --2- 172.21.15.23:0/632408569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec06d1d0 0x7f10ec1a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:48.942 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.954+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 >> 172.21.15.23:0/632408569 conn(0x7f10ec06bc20 msgr2=0x7f10ec111bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:48.942 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.954+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 shutdown_connections 2024-02-28T16:37:48.943 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:48.954+0000 7f10f2c00640 1 -- 172.21.15.23:0/632408569 wait complete. 2024-02-28T16:37:48.963 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-28T16:37:49.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 -- 172.21.15.23:0/3493188030 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 msgr2=0x7fda480ff920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 --2- 172.21.15.23:0/3493188030 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda480ff920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fda30009880 tx=0x7fda3002bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 -- 172.21.15.23:0/3493188030 shutdown_connections 2024-02-28T16:37:49.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 --2- 172.21.15.23:0/3493188030 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda480ff920 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 --2- 172.21.15.23:0/3493188030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda481054c0 0x7fda48105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 -- 172.21.15.23:0/3493188030 >> 172.21.15.23:0/3493188030 conn(0x7fda480fafb0 msgr2=0x7fda480fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:49.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 -- 172.21.15.23:0/3493188030 shutdown_connections 2024-02-28T16:37:49.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.197+0000 7fda4d400640 1 -- 172.21.15.23:0/3493188030 wait complete. 2024-02-28T16:37:49.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.198+0000 7fda4d400640 1 Processor -- start 2024-02-28T16:37:49.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda4d400640 1 -- start start 2024-02-28T16:37:49.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda4d400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda481973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:49.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda4d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda481054c0 0x7fda481978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda4d400640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48197f80 con 0x7fda480ff4b0 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda4d400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4819bd50 con 0x7fda481054c0 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda47e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda481973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda47e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda481973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:54020/0 (socket says 172.21.15.23:54020) 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.199+0000 7fda47e00640 1 -- 172.21.15.23:0/2104709861 learned_addr learned my addr 172.21.15.23:0/2104709861 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda47e00640 1 -- 172.21.15.23:0/2104709861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda481054c0 msgr2=0x7fda481978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda47e00640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda481054c0 0x7fda481978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda47e00640 1 -- 172.21.15.23:0/2104709861 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30009560 con 0x7fda480ff4b0 2024-02-28T16:37:49.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda47e00640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda481973b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fda3800cc60 tx=0x7fda3800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:49.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda45600640 1 -- 172.21.15.23:0/2104709861 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda38004b20 con 0x7fda480ff4b0 2024-02-28T16:37:49.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda45600640 1 -- 172.21.15.23:0/2104709861 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda38004c80 con 0x7fda480ff4b0 2024-02-28T16:37:49.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda45600640 1 -- 172.21.15.23:0/2104709861 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda3800f750 con 0x7fda480ff4b0 2024-02-28T16:37:49.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.200+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4819c030 con 0x7fda480ff4b0 2024-02-28T16:37:49.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.201+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4819c590 con 0x7fda480ff4b0 2024-02-28T16:37:49.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.202+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4804e000 con 0x7fda480ff4b0 2024-02-28T16:37:49.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.203+0000 7fda45600640 1 -- 172.21.15.23:0/2104709861 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fda3800f8b0 con 0x7fda480ff4b0 2024-02-28T16:37:49.191 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.204+0000 7fda45600640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fda2c06d810 0x7fda2c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:49.191 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.204+0000 7fda45600640 1 -- 172.21.15.23:0/2104709861 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fda3808d6f0 con 0x7fda480ff4b0 2024-02-28T16:37:49.192 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.204+0000 7fda3f400640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fda2c06d810 0x7fda2c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:49.192 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.205+0000 7fda3f400640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fda2c06d810 0x7fda2c06fcc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda3002efd0 tx=0x7fda30000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:49.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.209+0000 7fda45600640 1 -- 172.21.15.23:0/2104709861 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fda38056e70 con 0x7fda480ff4b0 2024-02-28T16:37:49.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.453+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fda4810c8d0 con 0x7fda480ff4b0 2024-02-28T16:37:49.442 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.455+0000 7fda45600640 1 -- 172.21.15.23:0/2104709861 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4901 (secure 0 0 0) 0x7fda3805a530 con 0x7fda480ff4b0 2024-02-28T16:37:49.443 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:49.443 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:05.482218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi153.senzwp","rank":0,"incarnation":20,"state":"up:active","state_seq":180,"addr":"172.21.15.153:6825/1090050783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":1090050783},{"type":"v1","addr":"172.21.15.153:6825","nonce":1090050783}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:49.443 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 24 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.457+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fda2c06d810 msgr2=0x7fda2c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fda2c06d810 0x7fda2c06fcc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda3002efd0 tx=0x7fda30000bc0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 msgr2=0x7fda481973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda481973b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fda3800cc60 tx=0x7fda3800a620 comp rx=0 tx=0).stop 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 shutdown_connections 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fda2c06d810 0x7fda2c06fcc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda481054c0 0x7fda481978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 --2- 172.21.15.23:0/2104709861 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fda480ff4b0 0x7fda481973b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 >> 172.21.15.23:0/2104709861 conn(0x7fda480fafb0 msgr2=0x7fda480fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 shutdown_connections 2024-02-28T16:37:49.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.458+0000 7fda4d400640 1 -- 172.21.15.23:0/2104709861 wait complete. 2024-02-28T16:37:49.464 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-28T16:37:49.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 -- 172.21.15.23:0/1421098565 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 msgr2=0x7f17a410bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 --2- 172.21.15.23:0/1421098565 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a410bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1798009c20 tx=0x7f179802c1b0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 -- 172.21.15.23:0/1421098565 shutdown_connections 2024-02-28T16:37:49.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 --2- 172.21.15.23:0/1421098565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17a4106090 0x7f17a41064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 --2- 172.21.15.23:0/1421098565 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a410bf30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 -- 172.21.15.23:0/1421098565 >> 172.21.15.23:0/1421098565 conn(0x7f17a4075260 msgr2=0x7f17a4077670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:49.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 -- 172.21.15.23:0/1421098565 shutdown_connections 2024-02-28T16:37:49.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.695+0000 7f17aac00640 1 -- 172.21.15.23:0/1421098565 wait complete. 2024-02-28T16:37:49.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.697+0000 7f17aac00640 1 Processor -- start 2024-02-28T16:37:49.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.697+0000 7f17aac00640 1 -- start start 2024-02-28T16:37:49.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.697+0000 7f17aac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17a4106090 0x7f17a41a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:49.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17aac00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a41a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:49.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17aac00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a419b5e0 con 0x7f17a410bb60 2024-02-28T16:37:49.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17aac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a419b750 con 0x7f17a4106090 2024-02-28T16:37:49.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17a8e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a41a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:49.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17a8e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a41a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43460/0 (socket says 172.21.15.23:43460) 2024-02-28T16:37:49.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17a8e00640 1 -- 172.21.15.23:0/1693263193 learned_addr learned my addr 172.21.15.23:0/1693263193 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:49.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17a9800640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17a4106090 0x7f17a41a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:49.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17a8e00640 1 -- 172.21.15.23:0/1693263193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17a4106090 msgr2=0x7f17a41a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17a8e00640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17a4106090 0x7f17a41a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.698+0000 7f17a8e00640 1 -- 172.21.15.23:0/1693263193 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798009900 con 0x7f17a410bb60 2024-02-28T16:37:49.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.699+0000 7f17a8e00640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a41a1ab0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f179000d6f0 tx=0x7f179000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:49.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.699+0000 7f17a2000640 1 -- 172.21.15.23:0/1693263193 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1790009a30 con 0x7f17a410bb60 2024-02-28T16:37:49.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.699+0000 7f17a2000640 1 -- 172.21.15.23:0/1693263193 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17900054e0 con 0x7f17a410bb60 2024-02-28T16:37:49.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.699+0000 7f17a2000640 1 -- 172.21.15.23:0/1693263193 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1790010460 con 0x7f17a410bb60 2024-02-28T16:37:49.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.699+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a419ba30 con 0x7f17a410bb60 2024-02-28T16:37:49.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.699+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a419bf90 con 0x7f17a410bb60 2024-02-28T16:37:49.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.701+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a404e000 con 0x7f17a410bb60 2024-02-28T16:37:49.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.702+0000 7f17a2000640 1 -- 172.21.15.23:0/1693263193 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1790009b90 con 0x7f17a410bb60 2024-02-28T16:37:49.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.703+0000 7f17a2000640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f178c06d810 0x7f178c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:49.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.703+0000 7f17a2000640 1 -- 172.21.15.23:0/1693263193 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f179008d200 con 0x7f17a410bb60 2024-02-28T16:37:49.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.704+0000 7f17a9800640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f178c06d810 0x7f178c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:49.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.704+0000 7f17a9800640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f178c06d810 0x7f178c06fcc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1798000f80 tx=0x7f1798032fc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:49.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.708+0000 7f17a2000640 1 -- 172.21.15.23:0/1693263193 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1790056860 con 0x7f17a410bb60 2024-02-28T16:37:49.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:49 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/632408569' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T16:37:49.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:49 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2104709861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T16:37:49.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:49 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/632408569' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T16:37:49.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:49 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2104709861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T16:37:49.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.952+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f17a410df10 con 0x7f17a410bb60 2024-02-28T16:37:49.941 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.954+0000 7f17a2000640 1 -- 172.21.15.23:0/1693263193 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+4106 (secure 0 0 0) 0x7f1790059f20 con 0x7f17a410bb60 2024-02-28T16:37:49.942 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:49.942 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:23.774199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:49.942 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 25 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f178c06d810 msgr2=0x7f178c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f178c06d810 0x7f178c06fcc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1798000f80 tx=0x7f1798032fc0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 msgr2=0x7f17a41a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a41a1ab0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f179000d6f0 tx=0x7f179000dbb0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 shutdown_connections 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f178c06d810 0x7f178c06fcc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f17a410bb60 0x7f17a41a1ab0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 --2- 172.21.15.23:0/1693263193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17a4106090 0x7f17a41a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 >> 172.21.15.23:0/1693263193 conn(0x7f17a4075260 msgr2=0x7f17a4076d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 shutdown_connections 2024-02-28T16:37:49.945 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:49.957+0000 7f17aac00640 1 -- 172.21.15.23:0/1693263193 wait complete. 2024-02-28T16:37:49.965 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 -- 172.21.15.23:0/3322802218 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103af0 msgr2=0x7fe338067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 --2- 172.21.15.23:0/3322802218 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103af0 0x7fe338067310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe320009880 tx=0x7fe32002bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 -- 172.21.15.23:0/3322802218 shutdown_connections 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 --2- 172.21.15.23:0/3322802218 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103af0 0x7fe338067310 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 --2- 172.21.15.23:0/3322802218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe338103150 0x7fe338103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 -- 172.21.15.23:0/3322802218 >> 172.21.15.23:0/3322802218 conn(0x7fe3380743d0 msgr2=0x7fe3380747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 -- 172.21.15.23:0/3322802218 shutdown_connections 2024-02-28T16:37:50.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.195+0000 7fe33e200640 1 -- 172.21.15.23:0/3322802218 wait complete. 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.196+0000 7fe33e200640 1 Processor -- start 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.196+0000 7fe33e200640 1 -- start start 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.196+0000 7fe33e200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103150 0x7fe3381a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.196+0000 7fe33e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe338103af0 0x7fe3381a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.196+0000 7fe33e200640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33819b5f0 con 0x7fe338103150 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.196+0000 7fe33e200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33819b760 con 0x7fe338103af0 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.197+0000 7fe33ce00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103150 0x7fe3381a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.197+0000 7fe33ce00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103150 0x7fe3381a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43476/0 (socket says 172.21.15.23:43476) 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.197+0000 7fe33ce00640 1 -- 172.21.15.23:0/3172731989 learned_addr learned my addr 172.21.15.23:0/3172731989 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.197+0000 7fe33ce00640 1 -- 172.21.15.23:0/3172731989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe338103af0 msgr2=0x7fe3381a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.197+0000 7fe33ce00640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe338103af0 0x7fe3381a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.197+0000 7fe33ce00640 1 -- 172.21.15.23:0/3172731989 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320009560 con 0x7fe338103150 2024-02-28T16:37:50.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.197+0000 7fe33ce00640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103150 0x7fe3381a1580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ea00 tx=0x7fe32800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:50.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.198+0000 7fe335600640 1 -- 172.21.15.23:0/3172731989 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32800cd50 con 0x7fe338103150 2024-02-28T16:37:50.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.198+0000 7fe335600640 1 -- 172.21.15.23:0/3172731989 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe328005020 con 0x7fe338103150 2024-02-28T16:37:50.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.198+0000 7fe335600640 1 -- 172.21.15.23:0/3172731989 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3280116a0 con 0x7fe338103150 2024-02-28T16:37:50.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.198+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33819ba40 con 0x7fe338103150 2024-02-28T16:37:50.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.198+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33819bfa0 con 0x7fe338103150 2024-02-28T16:37:50.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.199+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33804e000 con 0x7fe338103150 2024-02-28T16:37:50.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.200+0000 7fe335600640 1 -- 172.21.15.23:0/3172731989 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe328005190 con 0x7fe338103150 2024-02-28T16:37:50.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.201+0000 7fe335600640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe31c06d810 0x7fe31c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:50.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.201+0000 7fe335600640 1 -- 172.21.15.23:0/3172731989 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe32808da20 con 0x7fe338103150 2024-02-28T16:37:50.189 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.201+0000 7fe337e00640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe31c06d810 0x7fe31c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:50.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.202+0000 7fe337e00640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe31c06d810 0x7fe31c06fcc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe32002efd0 tx=0x7fe320000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:50.193 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.206+0000 7fe335600640 1 -- 172.21.15.23:0/3172731989 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe328057080 con 0x7fe338103150 2024-02-28T16:37:50.433 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.445+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fe33819cb00 con 0x7fe338103150 2024-02-28T16:37:50.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.446+0000 7fe335600640 1 -- 172.21.15.23:0/3172731989 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+4117 (secure 0 0 0) 0x7fe32805a740 con 0x7fe338103150 2024-02-28T16:37:50.434 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:50.435 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:23.789705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":0,"incarnation":26,"state":"up:replay","state_seq":2,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:50.435 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 26 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe31c06d810 msgr2=0x7fe31c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe31c06d810 0x7fe31c06fcc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe32002efd0 tx=0x7fe320000bc0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103150 msgr2=0x7fe3381a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103150 0x7fe3381a1580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ea00 tx=0x7fe32800eec0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 shutdown_connections 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe31c06d810 0x7fe31c06fcc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe338103af0 0x7fe3381a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 --2- 172.21.15.23:0/3172731989 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe338103150 0x7fe3381a1580 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 >> 172.21.15.23:0/3172731989 conn(0x7fe3380743d0 msgr2=0x7fe3380fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:50.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 shutdown_connections 2024-02-28T16:37:50.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.449+0000 7fe33e200640 1 -- 172.21.15.23:0/3172731989 wait complete. 2024-02-28T16:37:50.455 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-28T16:37:50.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.694+0000 7f2b21e00640 1 -- 172.21.15.23:0/102823237 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c1078a0 msgr2=0x7f2b1c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.694+0000 7f2b21e00640 1 --2- 172.21.15.23:0/102823237 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c1078a0 0x7f2b1c107c70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009880 tx=0x7f2b0c02bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.694+0000 7f2b21e00640 1 -- 172.21.15.23:0/102823237 shutdown_connections 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.694+0000 7f2b21e00640 1 --2- 172.21.15.23:0/102823237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c101890 0x7f2b1c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.694+0000 7f2b21e00640 1 --2- 172.21.15.23:0/102823237 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c1078a0 0x7f2b1c107c70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.694+0000 7f2b21e00640 1 -- 172.21.15.23:0/102823237 >> 172.21.15.23:0/102823237 conn(0x7f2b1c0fd330 msgr2=0x7f2b1c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.695+0000 7f2b21e00640 1 -- 172.21.15.23:0/102823237 shutdown_connections 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.695+0000 7f2b21e00640 1 -- 172.21.15.23:0/102823237 wait complete. 2024-02-28T16:37:50.683 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.696+0000 7f2b21e00640 1 Processor -- start 2024-02-28T16:37:50.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.696+0000 7f2b21e00640 1 -- start start 2024-02-28T16:37:50.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.696+0000 7f2b21e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c101890 0x7f2b1c1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:50.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.696+0000 7f2b21e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c1078a0 0x7f2b1c197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:50.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b21e00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1982a0 con 0x7f2b1c101890 2024-02-28T16:37:50.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b21e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c19c020 con 0x7f2b1c1078a0 2024-02-28T16:37:50.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b1aa00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c101890 0x7f2b1c1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:50.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b1aa00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c101890 0x7f2b1c1976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43492/0 (socket says 172.21.15.23:43492) 2024-02-28T16:37:50.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b1aa00640 1 -- 172.21.15.23:0/691647288 learned_addr learned my addr 172.21.15.23:0/691647288 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:50.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b1aa00640 1 -- 172.21.15.23:0/691647288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c1078a0 msgr2=0x7f2b1c197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b13e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c1078a0 0x7f2b1c197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:50.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b1aa00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c1078a0 0x7f2b1c197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b1aa00640 1 -- 172.21.15.23:0/691647288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009560 con 0x7f2b1c101890 2024-02-28T16:37:50.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.697+0000 7f2b13e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c1078a0 0x7f2b1c197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:50.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.698+0000 7f2b1aa00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c101890 0x7f2b1c1976d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009230 tx=0x7f2b0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:50.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.698+0000 7f2b20a00640 1 -- 172.21.15.23:0/691647288 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b0c0037c0 con 0x7f2b1c101890 2024-02-28T16:37:50.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.698+0000 7f2b20a00640 1 -- 172.21.15.23:0/691647288 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b0c003de0 con 0x7f2b1c101890 2024-02-28T16:37:50.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.698+0000 7f2b20a00640 1 -- 172.21.15.23:0/691647288 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b0c03e460 con 0x7f2b1c101890 2024-02-28T16:37:50.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.698+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c19c2a0 con 0x7f2b1c101890 2024-02-28T16:37:50.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.698+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c19c880 con 0x7f2b1c101890 2024-02-28T16:37:50.687 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.699+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c04e000 con 0x7f2b1c101890 2024-02-28T16:37:50.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.700+0000 7f2b20a00640 1 -- 172.21.15.23:0/691647288 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2b0c004fd0 con 0x7f2b1c101890 2024-02-28T16:37:50.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.701+0000 7f2b20a00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2b0006d810 0x7f2b0006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:50.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.701+0000 7f2b20a00640 1 -- 172.21.15.23:0/691647288 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f2b0c0affe0 con 0x7f2b1c101890 2024-02-28T16:37:50.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.702+0000 7f2b13e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2b0006d810 0x7f2b0006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:50.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.702+0000 7f2b13e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2b0006d810 0x7f2b0006fcc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b04006fd0 tx=0x7f2b04008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:50.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.706+0000 7f2b20a00640 1 -- 172.21.15.23:0/691647288 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b0c079660 con 0x7f2b1c101890 2024-02-28T16:37:50.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:50 smithi153 ceph-mon[66339]: pgmap v397: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:50.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:50 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1693263193' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T16:37:50.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:50 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3172731989' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T16:37:50.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:50 smithi023 ceph-mon[78509]: pgmap v397: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:50.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:50 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1693263193' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T16:37:50.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:50 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3172731989' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T16:37:50.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.948+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f2b1c109d70 con 0x7f2b1c101890 2024-02-28T16:37:50.937 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.949+0000 7f2b20a00640 1 -- 172.21.15.23:0/691647288 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+4122 (secure 0 0 0) 0x7f2b0c07cd20 con 0x7f2b1c101890 2024-02-28T16:37:50.937 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:50.937 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:32.458993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":183,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:50.937 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 27 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2b0006d810 msgr2=0x7f2b0006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2b0006d810 0x7f2b0006fcc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b04006fd0 tx=0x7f2b04008040 comp rx=0 tx=0).stop 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c101890 msgr2=0x7f2b1c1976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c101890 0x7f2b1c1976d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009230 tx=0x7f2b0c004270 comp rx=0 tx=0).stop 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 shutdown_connections 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f2b0006d810 0x7f2b0006fcc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c1078a0 0x7f2b1c197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 --2- 172.21.15.23:0/691647288 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f2b1c101890 0x7f2b1c1976d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 >> 172.21.15.23:0/691647288 conn(0x7f2b1c0fd330 msgr2=0x7f2b1c0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 shutdown_connections 2024-02-28T16:37:50.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:50.952+0000 7f2b21e00640 1 -- 172.21.15.23:0/691647288 wait complete. 2024-02-28T16:37:50.959 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-28T16:37:51.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 -- 172.21.15.23:0/1917328677 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 msgr2=0x7f8124101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 --2- 172.21.15.23:0/1917328677 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f8124101b20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f810c009880 tx=0x7f810c02bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 -- 172.21.15.23:0/1917328677 shutdown_connections 2024-02-28T16:37:51.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 --2- 172.21.15.23:0/1917328677 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f8124101b20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 --2- 172.21.15.23:0/1917328677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81241076c0 0x7f8124107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 -- 172.21.15.23:0/1917328677 >> 172.21.15.23:0/1917328677 conn(0x7f81240fd1b0 msgr2=0x7f81240ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:51.176 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 -- 172.21.15.23:0/1917328677 shutdown_connections 2024-02-28T16:37:51.177 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.188+0000 7f8123200640 1 -- 172.21.15.23:0/1917328677 wait complete. 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.189+0000 7f8123200640 1 Processor -- start 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.189+0000 7f8123200640 1 -- start start 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.189+0000 7f8123200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f81241973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8123200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81241076c0 0x7f81241978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8123200640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8124197f80 con 0x7f81241016b0 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8123200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812419bd50 con 0x7f81241076c0 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8121e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f81241973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8121e00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f81241973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43516/0 (socket says 172.21.15.23:43516) 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8121e00640 1 -- 172.21.15.23:0/1012636963 learned_addr learned my addr 172.21.15.23:0/1012636963 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:51.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f811be00640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81241076c0 0x7f81241978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:51.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8121e00640 1 -- 172.21.15.23:0/1012636963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81241076c0 msgr2=0x7f81241978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8121e00640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81241076c0 0x7f81241978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.190+0000 7f8121e00640 1 -- 172.21.15.23:0/1012636963 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c009560 con 0x7f81241016b0 2024-02-28T16:37:51.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.191+0000 7f8121e00640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f81241973b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f811400d8d0 tx=0x7f811400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:51.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.191+0000 7f811aa00640 1 -- 172.21.15.23:0/1012636963 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8114009a30 con 0x7f81241016b0 2024-02-28T16:37:51.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.191+0000 7f811aa00640 1 -- 172.21.15.23:0/1012636963 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8114009b90 con 0x7f81241016b0 2024-02-28T16:37:51.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.191+0000 7f811aa00640 1 -- 172.21.15.23:0/1012636963 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f811400f680 con 0x7f81241016b0 2024-02-28T16:37:51.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.191+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812419c030 con 0x7f81241016b0 2024-02-28T16:37:51.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.191+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812419c610 con 0x7f81241016b0 2024-02-28T16:37:51.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.192+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812404e000 con 0x7f81241016b0 2024-02-28T16:37:51.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.193+0000 7f811aa00640 1 -- 172.21.15.23:0/1012636963 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8114009d00 con 0x7f81241016b0 2024-02-28T16:37:51.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.194+0000 7f811aa00640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f810806d810 0x7f810806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:51.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.194+0000 7f811aa00640 1 -- 172.21.15.23:0/1012636963 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f811408d410 con 0x7f81241016b0 2024-02-28T16:37:51.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.195+0000 7f811be00640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f810806d810 0x7f810806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:51.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.195+0000 7f811be00640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f810806d810 0x7f810806fcc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f810c02c8b0 tx=0x7f810c005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:51.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.200+0000 7f811aa00640 1 -- 172.21.15.23:0/1012636963 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8114056af0 con 0x7f81241016b0 2024-02-28T16:37:51.430 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.442+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f812410e8a0 con 0x7f81241016b0 2024-02-28T16:37:51.431 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.443+0000 7f811aa00640 1 -- 172.21.15.23:0/1012636963 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+4119 (secure 0 0 0) 0x7f811405a1b0 con 0x7f81241016b0 2024-02-28T16:37:51.431 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:51.431 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:33.127290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":184,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:51.432 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 28 2024-02-28T16:37:51.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f810806d810 msgr2=0x7f810806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f810806d810 0x7f810806fcc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f810c02c8b0 tx=0x7f810c005fd0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 msgr2=0x7f81241973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f81241973b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f811400d8d0 tx=0x7f811400dd90 comp rx=0 tx=0).stop 2024-02-28T16:37:51.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 shutdown_connections 2024-02-28T16:37:51.434 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f810806d810 0x7f810806fcc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81241076c0 0x7f81241978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 --2- 172.21.15.23:0/1012636963 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f81241016b0 0x7f81241973b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.446+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 >> 172.21.15.23:0/1012636963 conn(0x7f81240fd1b0 msgr2=0x7f81240feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:51.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.447+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 shutdown_connections 2024-02-28T16:37:51.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.447+0000 7f8123200640 1 -- 172.21.15.23:0/1012636963 wait complete. 2024-02-28T16:37:51.452 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-28T16:37:51.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 -- 172.21.15.23:0/2681356947 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a0106090 msgr2=0x7f13a01064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 --2- 172.21.15.23:0/2681356947 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a0106090 0x7f13a01064e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f138c009880 tx=0x7f138c02bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 -- 172.21.15.23:0/2681356947 shutdown_connections 2024-02-28T16:37:51.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 --2- 172.21.15.23:0/2681356947 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a0106090 0x7f13a01064e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 --2- 172.21.15.23:0/2681356947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a010bb60 0x7f13a010bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 -- 172.21.15.23:0/2681356947 >> 172.21.15.23:0/2681356947 conn(0x7f13a0075260 msgr2=0x7f13a0077670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:51.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 -- 172.21.15.23:0/2681356947 shutdown_connections 2024-02-28T16:37:51.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.687+0000 7f139f200640 1 -- 172.21.15.23:0/2681356947 wait complete. 2024-02-28T16:37:51.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.688+0000 7f139f200640 1 Processor -- start 2024-02-28T16:37:51.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.688+0000 7f139f200640 1 -- start start 2024-02-28T16:37:51.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.688+0000 7f139f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0106090 0x7f13a01a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:51.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.688+0000 7f139f200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a010bb60 0x7f13a01a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:51.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.688+0000 7f139f200640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a019b690 con 0x7f13a010bb60 2024-02-28T16:37:51.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.688+0000 7f139f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a019b800 con 0x7f13a0106090 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139d400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a010bb60 0x7f13a01a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139d400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a010bb60 0x7f13a01a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43526/0 (socket says 172.21.15.23:43526) 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139d400640 1 -- 172.21.15.23:0/1794017182 learned_addr learned my addr 172.21.15.23:0/1794017182 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139de00640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0106090 0x7f13a01a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139d400640 1 -- 172.21.15.23:0/1794017182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0106090 msgr2=0x7f13a01a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139d400640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0106090 0x7f13a01a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139d400640 1 -- 172.21.15.23:0/1794017182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c009560 con 0x7f13a010bb60 2024-02-28T16:37:51.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.689+0000 7f139d400640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a010bb60 0x7f13a01a1b60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f138c036040 tx=0x7f138c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:51.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.690+0000 7f1396a00640 1 -- 172.21.15.23:0/1794017182 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138c0035f0 con 0x7f13a010bb60 2024-02-28T16:37:51.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.690+0000 7f1396a00640 1 -- 172.21.15.23:0/1794017182 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f138c003c10 con 0x7f13a010bb60 2024-02-28T16:37:51.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.690+0000 7f1396a00640 1 -- 172.21.15.23:0/1794017182 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138c034440 con 0x7f13a010bb60 2024-02-28T16:37:51.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.690+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a019ba80 con 0x7f13a010bb60 2024-02-28T16:37:51.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.690+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a019bfe0 con 0x7f13a010bb60 2024-02-28T16:37:51.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.691+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a004e000 con 0x7f13a010bb60 2024-02-28T16:37:51.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.692+0000 7f1396a00640 1 -- 172.21.15.23:0/1794017182 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f138c005060 con 0x7f13a010bb60 2024-02-28T16:37:51.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.693+0000 7f1396a00640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f138406d810 0x7f138406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:51.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.693+0000 7f1396a00640 1 -- 172.21.15.23:0/1794017182 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f138c0afa20 con 0x7f13a010bb60 2024-02-28T16:37:51.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.694+0000 7f139de00640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f138406d810 0x7f138406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:51.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.694+0000 7f139de00640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f138406d810 0x7f138406fcc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f13900058c0 tx=0x7f1390005c60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:51.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.698+0000 7f1396a00640 1 -- 172.21.15.23:0/1794017182 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f138c079100 con 0x7f13a010bb60 2024-02-28T16:37:51.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:51 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/691647288' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T16:37:51.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:51.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:51 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1012636963' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T16:37:51.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:51 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/691647288' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T16:37:51.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:51.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:51 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1012636963' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T16:37:51.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.947+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f13a019ccf0 con 0x7f13a010bb60 2024-02-28T16:37:51.936 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.948+0000 7f1396a00640 1 -- 172.21.15.23:0/1794017182 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+4119 (secure 0 0 0) 0x7f13a019ccf0 con 0x7f13a010bb60 2024-02-28T16:37:51.936 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:51.936 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:34.266312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":0,"incarnation":26,"state":"up:active","state_seq":185,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:51.937 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 29 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f138406d810 msgr2=0x7f138406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f138406d810 0x7f138406fcc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f13900058c0 tx=0x7f1390005c60 comp rx=0 tx=0).stop 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a010bb60 msgr2=0x7f13a01a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a010bb60 0x7f13a01a1b60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f138c036040 tx=0x7f138c004270 comp rx=0 tx=0).stop 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 shutdown_connections 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f138406d810 0x7f138406fcc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f13a010bb60 0x7f13a01a1b60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 --2- 172.21.15.23:0/1794017182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0106090 0x7f13a01a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:51.939 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 >> 172.21.15.23:0/1794017182 conn(0x7f13a0075260 msgr2=0x7f13a0076d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:51.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 shutdown_connections 2024-02-28T16:37:51.940 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:51.951+0000 7f139f200640 1 -- 172.21.15.23:0/1794017182 wait complete. 2024-02-28T16:37:51.958 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-28T16:37:52.178 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.190+0000 7f26af200640 1 -- 172.21.15.23:0/3847369286 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 msgr2=0x7f26a8105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.190+0000 7f26af200640 1 --2- 172.21.15.23:0/3847369286 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8105990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f269c009880 tx=0x7f269c02bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.190+0000 7f26af200640 1 -- 172.21.15.23:0/3847369286 shutdown_connections 2024-02-28T16:37:52.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.190+0000 7f26af200640 1 --2- 172.21.15.23:0/3847369286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26a8067310 0x7f26a8067760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.190+0000 7f26af200640 1 --2- 172.21.15.23:0/3847369286 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8105990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.190+0000 7f26af200640 1 -- 172.21.15.23:0/3847369286 >> 172.21.15.23:0/3847369286 conn(0x7f26a80743d0 msgr2=0x7f26a80747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:52.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.191+0000 7f26af200640 1 -- 172.21.15.23:0/3847369286 shutdown_connections 2024-02-28T16:37:52.179 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.191+0000 7f26af200640 1 -- 172.21.15.23:0/3847369286 wait complete. 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.192+0000 7f26af200640 1 Processor -- start 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.192+0000 7f26af200640 1 -- start start 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.192+0000 7f26af200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26a8067310 0x7f26a81951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.192+0000 7f26af200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.192+0000 7f26af200640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8195d10 con 0x7f26a81055c0 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.192+0000 7f26af200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8195e80 con 0x7f26a8067310 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.192+0000 7f26ad400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ad400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43536/0 (socket says 172.21.15.23:43536) 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ad400640 1 -- 172.21.15.23:0/3472964474 learned_addr learned my addr 172.21.15.23:0/3472964474 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ade00640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26a8067310 0x7f26a81951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ad400640 1 -- 172.21.15.23:0/3472964474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26a8067310 msgr2=0x7f26a81951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ad400640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26a8067310 0x7f26a81951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ad400640 1 -- 172.21.15.23:0/3472964474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c009560 con 0x7f26a81055c0 2024-02-28T16:37:52.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ade00640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26a8067310 0x7f26a81951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:52.182 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.193+0000 7f26ad400640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8195710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f269800c8a0 tx=0x7f269800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:52.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.194+0000 7f26a2a00640 1 -- 172.21.15.23:0/3472964474 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2698007b80 con 0x7f26a81055c0 2024-02-28T16:37:52.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.194+0000 7f26a2a00640 1 -- 172.21.15.23:0/3472964474 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2698007ce0 con 0x7f26a81055c0 2024-02-28T16:37:52.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.194+0000 7f26a2a00640 1 -- 172.21.15.23:0/3472964474 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2698018810 con 0x7f26a81055c0 2024-02-28T16:37:52.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.194+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a8199d10 con 0x7f26a81055c0 2024-02-28T16:37:52.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.194+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a819a270 con 0x7f26a81055c0 2024-02-28T16:37:52.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.195+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a804e000 con 0x7f26a81055c0 2024-02-28T16:37:52.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.196+0000 7f26a2a00640 1 -- 172.21.15.23:0/3472964474 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2698018970 con 0x7f26a81055c0 2024-02-28T16:37:52.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.197+0000 7f26a2a00640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f269006d810 0x7f269006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:52.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.198+0000 7f26a2a00640 1 -- 172.21.15.23:0/3472964474 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f269808d700 con 0x7f26a81055c0 2024-02-28T16:37:52.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.198+0000 7f26ade00640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f269006d810 0x7f269006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:52.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.198+0000 7f26ade00640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f269006d810 0x7f269006fcc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f269c036040 tx=0x7f269c005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:52.190 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.202+0000 7f26a2a00640 1 -- 172.21.15.23:0/3472964474 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2698056e80 con 0x7f26a81055c0 2024-02-28T16:37:52.433 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.445+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f26a8107930 con 0x7f26a81055c0 2024-02-28T16:37:52.435 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.447+0000 7f26a2a00640 1 -- 172.21.15.23:0/3472964474 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+4935 (secure 0 0 0) 0x7f269805a540 con 0x7f26a81055c0 2024-02-28T16:37:52.435 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:52.435 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44309,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3004350118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3004350118},{"type":"v1","addr":"172.21.15.153:6825","nonce":3004350118}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:34.266312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi153.dhwpyj","rank":0,"incarnation":26,"state":"up:active","state_seq":185,"addr":"172.21.15.153:6827/3382879257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3382879257},{"type":"v1","addr":"172.21.15.153:6827","nonce":3382879257}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:52.435 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 30 2024-02-28T16:37:52.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f269006d810 msgr2=0x7f269006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f269006d810 0x7f269006fcc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f269c036040 tx=0x7f269c005fd0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 msgr2=0x7f26a8195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8195710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f269800c8a0 tx=0x7f269800cd60 comp rx=0 tx=0).stop 2024-02-28T16:37:52.438 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 shutdown_connections 2024-02-28T16:37:52.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f269006d810 0x7f269006fcc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f26a81055c0 0x7f26a8195710 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 --2- 172.21.15.23:0/3472964474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26a8067310 0x7f26a81951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 >> 172.21.15.23:0/3472964474 conn(0x7f26a80743d0 msgr2=0x7f26a80fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:52.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 shutdown_connections 2024-02-28T16:37:52.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.450+0000 7f26af200640 1 -- 172.21.15.23:0/3472964474 wait complete. 2024-02-28T16:37:52.459 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-28T16:37:52.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:52 smithi023 ceph-mon[78509]: pgmap v398: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:52.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:52 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1794017182' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T16:37:52.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:52 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3472964474' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T16:37:52.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 -- 172.21.15.23:0/2560505531 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0107860 msgr2=0x7f74f0107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2560505531 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0107860 0x7f74f0107c30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009880 tx=0x7f74e402bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 -- 172.21.15.23:0/2560505531 shutdown_connections 2024-02-28T16:37:52.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2560505531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74f0101850 0x7f74f0101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2560505531 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0107860 0x7f74f0107c30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 -- 172.21.15.23:0/2560505531 >> 172.21.15.23:0/2560505531 conn(0x7f74f00fd370 msgr2=0x7f74f00ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:52.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 -- 172.21.15.23:0/2560505531 shutdown_connections 2024-02-28T16:37:52.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.699+0000 7f74f7a00640 1 -- 172.21.15.23:0/2560505531 wait complete. 2024-02-28T16:37:52.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.701+0000 7f74f7a00640 1 Processor -- start 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.701+0000 7f74f7a00640 1 -- start start 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.701+0000 7f74f7a00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0101850 0x7f74f01974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.701+0000 7f74f7a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74f0107860 0x7f74f0197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.701+0000 7f74f7a00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f0198090 con 0x7f74f0101850 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.701+0000 7f74f7a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f019be60 con 0x7f74f0107860 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74f5000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0101850 0x7f74f01974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74f5000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0101850 0x7f74f01974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43546/0 (socket says 172.21.15.23:43546) 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74f5000640 1 -- 172.21.15.23:0/2003271526 learned_addr learned my addr 172.21.15.23:0/2003271526 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74efe00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74f0107860 0x7f74f0197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74f5000640 1 -- 172.21.15.23:0/2003271526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74f0107860 msgr2=0x7f74f0197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.690 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74f5000640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74f0107860 0x7f74f0197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74f5000640 1 -- 172.21.15.23:0/2003271526 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4009560 con 0x7f74f0101850 2024-02-28T16:37:52.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.702+0000 7f74efe00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74f0107860 0x7f74f0197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:52.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.703+0000 7f74f5000640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0101850 0x7f74f01974c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74e402c220 tx=0x7f74e402c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:52.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.703+0000 7f74ed600640 1 -- 172.21.15.23:0/2003271526 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e4004520 con 0x7f74f0101850 2024-02-28T16:37:52.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.703+0000 7f74ed600640 1 -- 172.21.15.23:0/2003271526 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74e4003ab0 con 0x7f74f0101850 2024-02-28T16:37:52.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.703+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f019c0e0 con 0x7f74f0101850 2024-02-28T16:37:52.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.703+0000 7f74ed600640 1 -- 172.21.15.23:0/2003271526 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e4034440 con 0x7f74f0101850 2024-02-28T16:37:52.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.703+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f019c660 con 0x7f74f0101850 2024-02-28T16:37:52.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.704+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f004e000 con 0x7f74f0101850 2024-02-28T16:37:52.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.706+0000 7f74ed600640 1 -- 172.21.15.23:0/2003271526 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f74e4003c20 con 0x7f74f0101850 2024-02-28T16:37:52.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.707+0000 7f74ed600640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f74d806d810 0x7f74d806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:52.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.708+0000 7f74ed600640 1 -- 172.21.15.23:0/2003271526 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f74e40af870 con 0x7f74f0101850 2024-02-28T16:37:52.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.708+0000 7f74efe00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f74d806d810 0x7f74d806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:52.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.709+0000 7f74efe00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f74d806d810 0x7f74d806fcc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74f0198ad0 tx=0x7f74dc005e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:52.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.713+0000 7f74ed600640 1 -- 172.21.15.23:0/2003271526 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f74e4078ff0 con 0x7f74f0101850 2024-02-28T16:37:52.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:52 smithi153 ceph-mon[66339]: pgmap v398: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:52.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:52 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1794017182' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T16:37:52.895 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:52 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3472964474' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T16:37:52.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.959+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f74f0198810 con 0x7f74f0101850 2024-02-28T16:37:52.949 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.961+0000 7f74ed600640 1 -- 172.21.15.23:0/2003271526 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+4140 (secure 0 0 0) 0x7f74e407c6b0 con 0x7f74f0101850 2024-02-28T16:37:52.949 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:52.949 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44309,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3004350118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3004350118},{"type":"v1","addr":"172.21.15.153:6825","nonce":3004350118}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:55.295691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:52.949 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 31 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.963+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f74d806d810 msgr2=0x7f74d806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.963+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f74d806d810 0x7f74d806fcc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74f0198ad0 tx=0x7f74dc005e50 comp rx=0 tx=0).stop 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0101850 msgr2=0x7f74f01974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0101850 0x7f74f01974c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74e402c220 tx=0x7f74e402c7a0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 shutdown_connections 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f74d806d810 0x7f74d806fcc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74f0107860 0x7f74f0197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 --2- 172.21.15.23:0/2003271526 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f74f0101850 0x7f74f01974c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 >> 172.21.15.23:0/2003271526 conn(0x7f74f00fd370 msgr2=0x7f74f00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 shutdown_connections 2024-02-28T16:37:52.952 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:52.964+0000 7f74f7a00640 1 -- 172.21.15.23:0/2003271526 wait complete. 2024-02-28T16:37:52.972 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-28T16:37:53.194 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 -- 172.21.15.23:0/3961882378 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 msgr2=0x7fb2b0107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.194 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3961882378 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b0107c30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009880 tx=0x7fb2a002bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.194 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 -- 172.21.15.23:0/3961882378 shutdown_connections 2024-02-28T16:37:53.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3961882378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b0101850 0x7fb2b0101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3961882378 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b0107c30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 -- 172.21.15.23:0/3961882378 >> 172.21.15.23:0/3961882378 conn(0x7fb2b00fd370 msgr2=0x7fb2b00ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:53.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 -- 172.21.15.23:0/3961882378 shutdown_connections 2024-02-28T16:37:53.195 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.206+0000 7fb2b5600640 1 -- 172.21.15.23:0/3961882378 wait complete. 2024-02-28T16:37:53.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.207+0000 7fb2b5600640 1 Processor -- start 2024-02-28T16:37:53.196 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.207+0000 7fb2b5600640 1 -- start start 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.208+0000 7fb2b5600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b0101850 0x7fb2b01974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.208+0000 7fb2b5600640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b01979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.208+0000 7fb2b5600640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0198070 con 0x7fb2b0107860 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.208+0000 7fb2b5600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b019be40 con 0x7fb2b0101850 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.208+0000 7fb2a6000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b01979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.208+0000 7fb2a6000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b01979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43566/0 (socket says 172.21.15.23:43566) 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.208+0000 7fb2a6000640 1 -- 172.21.15.23:0/3040527355 learned_addr learned my addr 172.21.15.23:0/3040527355 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2aea00640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b0101850 0x7fb2b01974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2a6000640 1 -- 172.21.15.23:0/3040527355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b0101850 msgr2=0x7fb2b01974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2a6000640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b0101850 0x7fb2b01974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2a6000640 1 -- 172.21.15.23:0/3040527355 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0009560 con 0x7fb2b0107860 2024-02-28T16:37:53.197 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2a6000640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b01979e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb29800c810 tx=0x7fb29800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:53.198 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2a7e00640 1 -- 172.21.15.23:0/3040527355 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2980041f0 con 0x7fb2b0107860 2024-02-28T16:37:53.198 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2a7e00640 1 -- 172.21.15.23:0/3040527355 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb298007e70 con 0x7fb2b0107860 2024-02-28T16:37:53.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2a7e00640 1 -- 172.21.15.23:0/3040527355 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2980049d0 con 0x7fb2b0107860 2024-02-28T16:37:53.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.209+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b019c120 con 0x7fb2b0107860 2024-02-28T16:37:53.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.210+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b019c700 con 0x7fb2b0107860 2024-02-28T16:37:53.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.211+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b004e000 con 0x7fb2b0107860 2024-02-28T16:37:53.199 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.212+0000 7fb2a7e00640 1 -- 172.21.15.23:0/3040527355 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb2980079b0 con 0x7fb2b0107860 2024-02-28T16:37:53.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.212+0000 7fb2a7e00640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb29406d810 0x7fb29406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:53.200 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.213+0000 7fb2a7e00640 1 -- 172.21.15.23:0/3040527355 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fb29808d3a0 con 0x7fb2b0107860 2024-02-28T16:37:53.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.213+0000 7fb2aea00640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb29406d810 0x7fb29406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:53.201 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.214+0000 7fb2aea00640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb29406d810 0x7fb29406fcc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0036040 tx=0x7fb2a002cf90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:53.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.218+0000 7fb2a7e00640 1 -- 172.21.15.23:0/3040527355 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb298056ac0 con 0x7fb2b0107860 2024-02-28T16:37:53.445 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.457+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fb2b01987f0 con 0x7fb2b0107860 2024-02-28T16:37:53.446 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.459+0000 7fb2a7e00640 1 -- 172.21.15.23:0/3040527355 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+4185 (secure 0 0 0) 0x7fb29805a180 con 0x7fb2b0107860 2024-02-28T16:37:53.447 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:53.447 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44309,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3004350118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3004350118},{"type":"v1","addr":"172.21.15.153:6825","nonce":3004350118}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:55.309770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34420":{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:53.447 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 32 2024-02-28T16:37:53.449 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.461+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb29406d810 msgr2=0x7fb29406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.461+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb29406d810 0x7fb29406fcc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0036040 tx=0x7fb2a002cf90 comp rx=0 tx=0).stop 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.461+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 msgr2=0x7fb2b01979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.461+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b01979e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb29800c810 tx=0x7fb29800ccd0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.462+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 shutdown_connections 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.462+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fb29406d810 0x7fb29406fcc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.462+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fb2b0107860 0x7fb2b01979e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.462+0000 7fb2b5600640 1 --2- 172.21.15.23:0/3040527355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b0101850 0x7fb2b01974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.462+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 >> 172.21.15.23:0/3040527355 conn(0x7fb2b00fd370 msgr2=0x7fb2b00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.462+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 shutdown_connections 2024-02-28T16:37:53.450 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.462+0000 7fb2b5600640 1 -- 172.21.15.23:0/3040527355 wait complete. 2024-02-28T16:37:53.470 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 -- 172.21.15.23:0/4132450935 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072600 msgr2=0x7fe8c80729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 --2- 172.21.15.23:0/4132450935 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072600 0x7fe8c80729d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009c20 tx=0x7fe8b802c230 comp rx=0 tx=0).stop 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 -- 172.21.15.23:0/4132450935 shutdown_connections 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 --2- 172.21.15.23:0/4132450935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8072f10 0x7fe8c810b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 --2- 172.21.15.23:0/4132450935 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072600 0x7fe8c80729d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 -- 172.21.15.23:0/4132450935 >> 172.21.15.23:0/4132450935 conn(0x7fe8c80fafb0 msgr2=0x7fe8c80fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 -- 172.21.15.23:0/4132450935 shutdown_connections 2024-02-28T16:37:53.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.704+0000 7fe8c7200640 1 -- 172.21.15.23:0/4132450935 wait complete. 2024-02-28T16:37:53.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.705+0000 7fe8c7200640 1 Processor -- start 2024-02-28T16:37:53.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.705+0000 7fe8c7200640 1 -- start start 2024-02-28T16:37:53.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.706+0000 7fe8c7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8072600 0x7fe8c8197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:53.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.706+0000 7fe8c7200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072f10 0x7fe8c81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:53.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.706+0000 7fe8c7200640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8197f40 con 0x7fe8c8072f10 2024-02-28T16:37:53.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.706+0000 7fe8c7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c819bd10 con 0x7fe8c8072600 2024-02-28T16:37:53.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.706+0000 7fe8c5400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072f10 0x7fe8c81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:53.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.706+0000 7fe8c5400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072f10 0x7fe8c81978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43582/0 (socket says 172.21.15.23:43582) 2024-02-28T16:37:53.694 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.706+0000 7fe8c5400640 1 -- 172.21.15.23:0/2423601619 learned_addr learned my addr 172.21.15.23:0/2423601619 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:53.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.707+0000 7fe8c5e00640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8072600 0x7fe8c8197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.707+0000 7fe8c5400640 1 -- 172.21.15.23:0/2423601619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8072600 msgr2=0x7fe8c8197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.707+0000 7fe8c5400640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8072600 0x7fe8c8197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.707+0000 7fe8c5400640 1 -- 172.21.15.23:0/2423601619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b8009900 con 0x7fe8c8072f10 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.707+0000 7fe8c5400640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072f10 0x7fe8c81978b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000d8d0 tx=0x7fe8b000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.708+0000 7fe8bea00640 1 -- 172.21.15.23:0/2423601619 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b000bea0 con 0x7fe8c8072f10 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.708+0000 7fe8bea00640 1 -- 172.21.15.23:0/2423601619 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8b0009c00 con 0x7fe8c8072f10 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.708+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c819bff0 con 0x7fe8c8072f10 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.708+0000 7fe8bea00640 1 -- 172.21.15.23:0/2423601619 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b000f710 con 0x7fe8c8072f10 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.708+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c819c550 con 0x7fe8c8072f10 2024-02-28T16:37:53.696 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.709+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c804e000 con 0x7fe8c8072f10 2024-02-28T16:37:53.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.710+0000 7fe8bea00640 1 -- 172.21.15.23:0/2423601619 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe8b0010460 con 0x7fe8c8072f10 2024-02-28T16:37:53.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.711+0000 7fe8bea00640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe8ac06d810 0x7fe8ac06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:53.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.711+0000 7fe8bea00640 1 -- 172.21.15.23:0/2423601619 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe8b008d310 con 0x7fe8c8072f10 2024-02-28T16:37:53.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.711+0000 7fe8c5e00640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe8ac06d810 0x7fe8ac06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:53.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.712+0000 7fe8c5e00640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe8ac06d810 0x7fe8ac06fcc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006010 tx=0x7fe8b8000f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:53.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.715+0000 7fe8bea00640 1 -- 172.21.15.23:0/2423601619 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe8b00569f0 con 0x7fe8c8072f10 2024-02-28T16:37:53.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:53 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2003271526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T16:37:53.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:53 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3040527355' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T16:37:53.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:53 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2003271526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T16:37:53.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:53 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3040527355' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T16:37:53.943 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.955+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fe8c810e890 con 0x7fe8c8072f10 2024-02-28T16:37:53.944 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.956+0000 7fe8bea00640 1 -- 172.21.15.23:0/2423601619 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+5001 (secure 0 0 0) 0x7fe8b005a0b0 con 0x7fe8c8072f10 2024-02-28T16:37:53.945 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:53.945 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44309,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3004350118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3004350118},{"type":"v1","addr":"172.21.15.153:6825","nonce":3004350118}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44333,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6827/3989995611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3989995611},{"type":"v1","addr":"172.21.15.153:6827","nonce":3989995611}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:32:55.309770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34420":{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:53.945 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 33 2024-02-28T16:37:53.946 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe8ac06d810 msgr2=0x7fe8ac06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe8ac06d810 0x7fe8ac06fcc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006010 tx=0x7fe8b8000f40 comp rx=0 tx=0).stop 2024-02-28T16:37:53.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072f10 msgr2=0x7fe8c81978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:53.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072f10 0x7fe8c81978b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000d8d0 tx=0x7fe8b000dd90 comp rx=0 tx=0).stop 2024-02-28T16:37:53.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 shutdown_connections 2024-02-28T16:37:53.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe8ac06d810 0x7fe8ac06fcc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.947 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe8c8072f10 0x7fe8c81978b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 --2- 172.21.15.23:0/2423601619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8072600 0x7fe8c8197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:53.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.959+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 >> 172.21.15.23:0/2423601619 conn(0x7fe8c80fafb0 msgr2=0x7fe8c8105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:53.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.960+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 shutdown_connections 2024-02-28T16:37:53.948 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:53.960+0000 7fe8c7200640 1 -- 172.21.15.23:0/2423601619 wait complete. 2024-02-28T16:37:53.966 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-28T16:37:54.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 -- 172.21.15.23:0/2556015486 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 msgr2=0x7fbb1c1064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 --2- 172.21.15.23:0/2556015486 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1064e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009880 tx=0x7fbb1002bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 -- 172.21.15.23:0/2556015486 shutdown_connections 2024-02-28T16:37:54.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 --2- 172.21.15.23:0/2556015486 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1064e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 --2- 172.21.15.23:0/2556015486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c10ac40 0x7fbb1c10b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.180 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 -- 172.21.15.23:0/2556015486 >> 172.21.15.23:0/2556015486 conn(0x7fbb1c075490 msgr2=0x7fbb1c0778a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:54.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 -- 172.21.15.23:0/2556015486 shutdown_connections 2024-02-28T16:37:54.181 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.192+0000 7fbb24600640 1 -- 172.21.15.23:0/2556015486 wait complete. 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.193+0000 7fbb24600640 1 Processor -- start 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.193+0000 7fbb24600640 1 -- start start 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.193+0000 7fbb24600640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.193+0000 7fbb24600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c10ac40 0x7fbb1c1a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.193+0000 7fbb24600640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c19b700 con 0x7fbb1c106090 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.193+0000 7fbb24600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c19b870 con 0x7fbb1c10ac40 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43600/0 (socket says 172.21.15.23:43600) 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21c00640 1 -- 172.21.15.23:0/3222180267 learned_addr learned my addr 172.21.15.23:0/3222180267 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21200640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c10ac40 0x7fbb1c1a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21c00640 1 -- 172.21.15.23:0/3222180267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c10ac40 msgr2=0x7fbb1c1a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.183 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21c00640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c10ac40 0x7fbb1c1a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21c00640 1 -- 172.21.15.23:0/3222180267 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10009560 con 0x7fbb1c106090 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.194+0000 7fbb21200640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c10ac40 0x7fbb1c1a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.195+0000 7fbb21c00640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1a1690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800d6f0 tx=0x7fbb0800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.195+0000 7fbb1a000640 1 -- 172.21.15.23:0/3222180267 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb08009a30 con 0x7fbb1c106090 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.195+0000 7fbb1a000640 1 -- 172.21.15.23:0/3222180267 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb080054e0 con 0x7fbb1c106090 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.195+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c19bb50 con 0x7fbb1c106090 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.195+0000 7fbb1a000640 1 -- 172.21.15.23:0/3222180267 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb08010460 con 0x7fbb1c106090 2024-02-28T16:37:54.184 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.195+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c19c130 con 0x7fbb1c106090 2024-02-28T16:37:54.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.196+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c04e000 con 0x7fbb1c106090 2024-02-28T16:37:54.185 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.198+0000 7fbb1a000640 1 -- 172.21.15.23:0/3222180267 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbb08009b90 con 0x7fbb1c106090 2024-02-28T16:37:54.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.199+0000 7fbb1a000640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbb0406d810 0x7fbb0406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:54.186 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.199+0000 7fbb1a000640 1 -- 172.21.15.23:0/3222180267 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbb0808d110 con 0x7fbb1c106090 2024-02-28T16:37:54.187 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.199+0000 7fbb21200640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbb0406d810 0x7fbb0406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:54.188 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.200+0000 7fbb21200640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbb0406d810 0x7fbb0406fcc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb10036040 tx=0x7fbb1002cf90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:54.192 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.204+0000 7fbb1a000640 1 -- 172.21.15.23:0/3222180267 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbb080567f0 con 0x7fbb1c106090 2024-02-28T16:37:54.432 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.445+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fbb1c19cc10 con 0x7fbb1c106090 2024-02-28T16:37:54.433 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.446+0000 7fbb1a000640 1 -- 172.21.15.23:0/3222180267 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+5005 (secure 0 0 0) 0x7fbb08020090 con 0x7fbb1c106090 2024-02-28T16:37:54.434 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:54.434 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44309,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3004350118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3004350118},{"type":"v1","addr":"172.21.15.153:6825","nonce":3004350118}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44333,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6827/3989995611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3989995611},{"type":"v1","addr":"172.21.15.153:6827","nonce":3989995611}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:33:04.089520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34420":{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":24,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:54.434 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 34 2024-02-28T16:37:54.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbb0406d810 msgr2=0x7fbb0406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbb0406d810 0x7fbb0406fcc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb10036040 tx=0x7fbb1002cf90 comp rx=0 tx=0).stop 2024-02-28T16:37:54.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 msgr2=0x7fbb1c1a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.436 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1a1690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800d6f0 tx=0x7fbb0800dbb0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 shutdown_connections 2024-02-28T16:37:54.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbb0406d810 0x7fbb0406fcc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c10ac40 0x7fbb1c1a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 --2- 172.21.15.23:0/3222180267 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbb1c106090 0x7fbb1c1a1690 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.448+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 >> 172.21.15.23:0/3222180267 conn(0x7fbb1c075490 msgr2=0x7fbb1c075f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:54.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.449+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 shutdown_connections 2024-02-28T16:37:54.437 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.449+0000 7fbb24600640 1 -- 172.21.15.23:0/3222180267 wait complete. 2024-02-28T16:37:54.456 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-28T16:37:54.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 -- 172.21.15.23:0/1200635155 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 msgr2=0x7f6e50100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 --2- 172.21.15.23:0/1200635155 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50100c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e440098b0 tx=0x7f6e4402bd70 comp rx=0 tx=0).stop 2024-02-28T16:37:54.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 -- 172.21.15.23:0/1200635155 shutdown_connections 2024-02-28T16:37:54.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 --2- 172.21.15.23:0/1200635155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e50101150 0x7f6e50109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 --2- 172.21.15.23:0/1200635155 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50100c10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 -- 172.21.15.23:0/1200635155 >> 172.21.15.23:0/1200635155 conn(0x7f6e500fa030 msgr2=0x7f6e500fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:54.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 -- 172.21.15.23:0/1200635155 shutdown_connections 2024-02-28T16:37:54.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.684+0000 7f6e57a00640 1 -- 172.21.15.23:0/1200635155 wait complete. 2024-02-28T16:37:54.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.685+0000 7f6e57a00640 1 Processor -- start 2024-02-28T16:37:54.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.685+0000 7f6e57a00640 1 -- start start 2024-02-28T16:37:54.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.686+0000 7f6e57a00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:54.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.686+0000 7f6e57a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e50101150 0x7f6e501958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:54.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.686+0000 7f6e57a00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50195f50 con 0x7f6e50100840 2024-02-28T16:37:54.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.686+0000 7f6e57a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50199cd0 con 0x7f6e50101150 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.686+0000 7f6e55000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.686+0000 7f6e55000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43624/0 (socket says 172.21.15.23:43624) 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.686+0000 7f6e55000640 1 -- 172.21.15.23:0/809286380 learned_addr learned my addr 172.21.15.23:0/809286380 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.687+0000 7f6e4fe00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e50101150 0x7f6e501958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.687+0000 7f6e55000640 1 -- 172.21.15.23:0/809286380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e50101150 msgr2=0x7f6e501958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.687+0000 7f6e55000640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e50101150 0x7f6e501958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.687+0000 7f6e55000640 1 -- 172.21.15.23:0/809286380 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44009560 con 0x7f6e50100840 2024-02-28T16:37:54.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.687+0000 7f6e55000640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50195380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009880 tx=0x7f6e44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:54.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.688+0000 7f6e4d600640 1 -- 172.21.15.23:0/809286380 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e440037c0 con 0x7f6e50100840 2024-02-28T16:37:54.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.688+0000 7f6e4d600640 1 -- 172.21.15.23:0/809286380 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e44003de0 con 0x7f6e50100840 2024-02-28T16:37:54.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.688+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e50199f50 con 0x7f6e50100840 2024-02-28T16:37:54.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.688+0000 7f6e4d600640 1 -- 172.21.15.23:0/809286380 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4403e450 con 0x7f6e50100840 2024-02-28T16:37:54.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.688+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5019a4b0 con 0x7f6e50100840 2024-02-28T16:37:54.677 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.689+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5004e000 con 0x7f6e50100840 2024-02-28T16:37:54.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.691+0000 7f6e4d600640 1 -- 172.21.15.23:0/809286380 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6e44004fd0 con 0x7f6e50100840 2024-02-28T16:37:54.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.692+0000 7f6e4d600640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e3806d810 0x7f6e3806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:54.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.692+0000 7f6e4d600640 1 -- 172.21.15.23:0/809286380 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f6e440b0380 con 0x7f6e50100840 2024-02-28T16:37:54.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.692+0000 7f6e4fe00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e3806d810 0x7f6e3806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:54.680 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.693+0000 7f6e4fe00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e3806d810 0x7f6e3806fcc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c005fd0 tx=0x7f6e3c005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:54.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.698+0000 7f6e4d600640 1 -- 172.21.15.23:0/809286380 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e44079ba0 con 0x7f6e50100840 2024-02-28T16:37:54.830 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:54 smithi023 ceph-mon[78509]: pgmap v399: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:54.830 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:54 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2423601619' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T16:37:54.830 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:54 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3222180267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T16:37:54.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:54 smithi153 ceph-mon[66339]: pgmap v399: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:54.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:54 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2423601619' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T16:37:54.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:54 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3222180267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T16:37:54.930 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.942+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f6e50106cb0 con 0x7f6e50100840 2024-02-28T16:37:54.931 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.943+0000 7f6e4d600640 1 -- 172.21.15.23:0/809286380 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+5002 (secure 0 0 0) 0x7f6e4407d260 con 0x7f6e50100840 2024-02-28T16:37:54.931 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:54.931 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi023.klbbrl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.23:6829/2931963511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6828","nonce":2931963511},{"type":"v1","addr":"172.21.15.23:6829","nonce":2931963511}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":44309,"name":"cephfs.smithi153.senzwp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3004350118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3004350118},{"type":"v1","addr":"172.21.15.153:6825","nonce":3004350118}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44333,"name":"cephfs.smithi153.dhwpyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6827/3989995611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3989995611},{"type":"v1","addr":"172.21.15.153:6827","nonce":3989995611}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:20:08.831226+0000","modified":"2024-02-28T16:33:04.820852+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34420":{"gid":34420,"name":"cephfs.smithi023.pplvdo","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":25,"addr":"172.21.15.23:6827/2111137079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6826","nonce":2111137079},{"type":"v1","addr":"172.21.15.23:6827","nonce":2111137079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:37:54.932 INFO:teuthology.orchestra.run.smithi023.stderr:dumped fsmap epoch 35 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e3806d810 msgr2=0x7f6e3806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e3806d810 0x7f6e3806fcc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c005fd0 tx=0x7f6e3c005e20 comp rx=0 tx=0).stop 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 msgr2=0x7f6e50195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50195380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009880 tx=0x7f6e44004270 comp rx=0 tx=0).stop 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 shutdown_connections 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f6e3806d810 0x7f6e3806fcc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e50101150 0x7f6e501958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 --2- 172.21.15.23:0/809286380 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f6e50100840 0x7f6e50195380 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:54.934 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 >> 172.21.15.23:0/809286380 conn(0x7f6e500fa030 msgr2=0x7f6e50103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:54.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 shutdown_connections 2024-02-28T16:37:54.935 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:54.946+0000 7f6e57a00640 1 -- 172.21.15.23:0/809286380 wait complete. 2024-02-28T16:37:54.951 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-28T16:37:54.964 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-28T16:37:54.964 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:37:54.964 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:37:55.004 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:37:55.004 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:37:55.095 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 -- 172.21.15.23:0/1034486386 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68101870 msgr2=0x7efc68101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 --2- 172.21.15.23:0/1034486386 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68101870 0x7efc68101ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efc58009880 tx=0x7efc5802bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 -- 172.21.15.23:0/1034486386 shutdown_connections 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 --2- 172.21.15.23:0/1034486386 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68101870 0x7efc68101ce0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 --2- 172.21.15.23:0/1034486386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc68107880 0x7efc68107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 -- 172.21.15.23:0/1034486386 >> 172.21.15.23:0/1034486386 conn(0x7efc680fd370 msgr2=0x7efc680ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 -- 172.21.15.23:0/1034486386 shutdown_connections 2024-02-28T16:37:55.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.350+0000 7efc70000640 1 -- 172.21.15.23:0/1034486386 wait complete. 2024-02-28T16:37:55.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.351+0000 7efc70000640 1 Processor -- start 2024-02-28T16:37:55.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.351+0000 7efc70000640 1 -- start start 2024-02-28T16:37:55.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.351+0000 7efc70000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc68101870 0x7efc681973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:55.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.351+0000 7efc70000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68107880 0x7efc68197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:55.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.351+0000 7efc70000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68197fa0 con 0x7efc68107880 2024-02-28T16:37:55.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.351+0000 7efc70000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6819bd70 con 0x7efc68101870 2024-02-28T16:37:55.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68107880 0x7efc68197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68107880 0x7efc68197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43638/0 (socket says 172.21.15.23:43638) 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6cc00640 1 -- 172.21.15.23:0/2672114312 learned_addr learned my addr 172.21.15.23:0/2672114312 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6cc00640 1 -- 172.21.15.23:0/2672114312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc68101870 msgr2=0x7efc681973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6d600640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc68101870 0x7efc681973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6cc00640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc68101870 0x7efc681973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6cc00640 1 -- 172.21.15.23:0/2672114312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009560 con 0x7efc68107880 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.352+0000 7efc6d600640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc68101870 0x7efc681973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:55.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.353+0000 7efc6cc00640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68107880 0x7efc68197910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:55.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.353+0000 7efc66000640 1 -- 172.21.15.23:0/2672114312 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc580037c0 con 0x7efc68107880 2024-02-28T16:37:55.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.353+0000 7efc66000640 1 -- 172.21.15.23:0/2672114312 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc58003de0 con 0x7efc68107880 2024-02-28T16:37:55.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.353+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6819bff0 con 0x7efc68107880 2024-02-28T16:37:55.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.353+0000 7efc66000640 1 -- 172.21.15.23:0/2672114312 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc58034460 con 0x7efc68107880 2024-02-28T16:37:55.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.353+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6819c570 con 0x7efc68107880 2024-02-28T16:37:55.342 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.354+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6804e000 con 0x7efc68107880 2024-02-28T16:37:55.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.355+0000 7efc66000640 1 -- 172.21.15.23:0/2672114312 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7efc58003920 con 0x7efc68107880 2024-02-28T16:37:55.343 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.356+0000 7efc66000640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7efc5006d8d0 0x7efc5006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:55.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.356+0000 7efc66000640 1 -- 172.21.15.23:0/2672114312 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7efc580afa10 con 0x7efc68107880 2024-02-28T16:37:55.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.356+0000 7efc6d600640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7efc5006d8d0 0x7efc5006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:55.344 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.357+0000 7efc6d600640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7efc5006d8d0 0x7efc5006fd80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc681029b0 tx=0x7efc5c005d30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:55.349 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.361+0000 7efc66000640 1 -- 172.21.15.23:0/2672114312 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efc58079250 con 0x7efc68107880 2024-02-28T16:37:55.543 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.555+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc68198720 con 0x7efc68107880 2024-02-28T16:37:55.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.558+0000 7efc66000640 1 -- 172.21.15.23:0/2672114312 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17018 (secure 0 0 0) 0x7efc5807c910 con 0x7efc68107880 2024-02-28T16:37:55.547 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:55.547 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":85,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","created":"2024-02-28T16:11:11.971217+0000","modified":"2024-02-28T16:32:55.295716+0000","last_up_change":"2024-02-28T16:31:16.808610+0000","last_in_change":"2024-02-28T16:18:11.748474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:16:55.847665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:20:07.748175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:20:08.353450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1936c40d-0a71-495b-af57-ea0cb7224068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6803","nonce":4096152307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6805","nonce":4096152307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6809","nonce":4096152307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6807","nonce":4096152307}]},"public_addr":"172.21.15.23:6803/4096152307","cluster_addr":"172.21.15.23:6805/4096152307","heartbeat_back_addr":"172.21.15.23:6809/4096152307","heartbeat_front_addr":"172.21.15.23:6807/4096152307","state":["exists","up"]},{"osd":1,"uuid":"f2211134-0ddf-4faf-8fda-41ff13201231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6811","nonce":1249689655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6813","nonce":1249689655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6817","nonce":1249689655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6815","nonce":1249689655}]},"public_addr":"172.21.15.23:6811/1249689655","cluster_addr":"172.21.15.23:6813/1249689655","heartbeat_back_addr":"172.21.15.23:6817/1249689655","heartbeat_front_addr":"172.21.15.23:6815/1249689655","state":["exists","up"]},{"osd":2,"uuid":"513a900d-c438-4f9a-ad29-c667f5335070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6819","nonce":779926877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6821","nonce":779926877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6825","nonce":779926877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6823","nonce":779926877}]},"public_addr":"172.21.15.23:6819/779926877","cluster_addr":"172.21.15.23:6821/779926877","heartbeat_back_addr":"172.21.15.23:6825/779926877","heartbeat_front_addr":"172.21.15.23:6823/779926877","state":["exists","up"]},{"osd":3,"uuid":"0b9875a7-8961-49db-bee2-40980eeec169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6801","nonce":487138192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6803","nonce":487138192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6807","nonce":487138192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6805","nonce":487138192}]},"public_addr":"172.21.15.153:6801/487138192","cluster_addr":"172.21.15.153:6803/487138192","heartbeat_back_addr":"172.21.15.153:6807/487138192","heartbeat_front_addr":"172.21.15.153:6805/487138192","state":["exists","up"]},{"osd":4,"uuid":"3266acd3-21ec-4c65-bb5d-48d82334bf09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6809","nonce":1758644183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6811","nonce":1758644183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6815","nonce":1758644183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6813","nonce":1758644183}]},"public_addr":"172.21.15.153:6809/1758644183","cluster_addr":"172.21.15.153:6811/1758644183","heartbeat_back_addr":"172.21.15.153:6815/1758644183","heartbeat_front_addr":"172.21.15.153:6813/1758644183","state":["exists","up"]},{"osd":5,"uuid":"82e08ef8-51d2-494b-b140-ac7bd2c5a320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6817","nonce":3414117647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6819","nonce":3414117647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6823","nonce":3414117647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6821","nonce":3414117647}]},"public_addr":"172.21.15.153:6817/3414117647","cluster_addr":"172.21.15.153:6819/3414117647","heartbeat_back_addr":"172.21.15.153:6823/3414117647","heartbeat_front_addr":"172.21.15.153:6821/3414117647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:15:36.785669+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:13.722392+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:51.886029+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:25.675647+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:59.836960+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:34.102730+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6827/3382879257":"2024-02-29T16:32:55.295667+0000","172.21.15.153:6824/1090050783":"2024-02-29T16:32:23.774174+0000","172.21.15.23:6829/869339807":"2024-02-29T16:31:55.013170+0000","172.21.15.23:0/3255127518":"2024-02-29T16:25:51.083342+0000","172.21.15.23:6801/877826779":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/1312665589":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/2047089350":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6828/869339807":"2024-02-29T16:31:55.013170+0000","172.21.15.23:0/222399421":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/3957078359":"2024-02-29T16:23:02.627520+0000","172.21.15.153:0/3506879033":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/2569614083":"2024-02-29T16:11:45.267597+0000","172.21.15.153:6828/1832791633":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6800/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/2855046725":"2024-02-29T16:23:02.627520+0000","172.21.15.153:0/2101473361":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/1357875446":"2024-02-29T16:12:27.412905+0000","172.21.15.153:6826/3382879257":"2024-02-29T16:32:55.295667+0000","172.21.15.153:0/2394523153":"2024-02-29T16:24:26.370048+0000","172.21.15.153:6825/1090050783":"2024-02-29T16:32:23.774174+0000","172.21.15.153:0/3123495442":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6827/1762270035":"2024-02-29T16:20:27.240686+0000","172.21.15.23:6826/1762270035":"2024-02-29T16:20:27.240686+0000","172.21.15.23:6801/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6800/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1385314359":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6800/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.153:0/4210128758":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6801/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1928653257":"2024-02-29T16:25:51.083342+0000","172.21.15.153:0/1731228796":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/2580029340":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/287772389":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/488139137":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/364787592":"2024-02-29T16:23:02.627520+0000","172.21.15.23:0/3255579829":"2024-02-29T16:12:27.412905+0000","172.21.15.153:6829/1832791633":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/4127609829":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/2032489561":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6801/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/3191093495":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6801/3957078359":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6800/877826779":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/1246504563":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/4090647671":"2024-02-29T16:25:51.083342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7efc5006d8d0 msgr2=0x7efc5006fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7efc5006d8d0 0x7efc5006fd80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc681029b0 tx=0x7efc5c005d30 comp rx=0 tx=0).stop 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68107880 msgr2=0x7efc68197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68107880 0x7efc68197910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58004270 comp rx=0 tx=0).stop 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 shutdown_connections 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7efc5006d8d0 0x7efc5006fd80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7efc68107880 0x7efc68197910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 --2- 172.21.15.23:0/2672114312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc68101870 0x7efc681973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 >> 172.21.15.23:0/2672114312 conn(0x7efc680fd370 msgr2=0x7efc680feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 shutdown_connections 2024-02-28T16:37:55.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.561+0000 7efc70000640 1 -- 172.21.15.23:0/2672114312 wait complete. 2024-02-28T16:37:55.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:16:55.847665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:20:07.748175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:20:08.353450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:37:55.567 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:37:55.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 -- 172.21.15.23:0/4160234098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc100300 msgr2=0x7fe2dc1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/4160234098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc100300 0x7fe2dc1006d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009c20 tx=0x7fe2d002c1b0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 -- 172.21.15.23:0/4160234098 shutdown_connections 2024-02-28T16:37:55.783 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/4160234098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2dc067310 0x7fe2dc067780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/4160234098 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc100300 0x7fe2dc1006d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 -- 172.21.15.23:0/4160234098 >> 172.21.15.23:0/4160234098 conn(0x7fe2dc0743d0 msgr2=0x7fe2dc0747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:55.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 -- 172.21.15.23:0/4160234098 shutdown_connections 2024-02-28T16:37:55.784 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.795+0000 7fe2e2c00640 1 -- 172.21.15.23:0/4160234098 wait complete. 2024-02-28T16:37:55.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.796+0000 7fe2e2c00640 1 Processor -- start 2024-02-28T16:37:55.785 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.796+0000 7fe2e2c00640 1 -- start start 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e2c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc067310 0x7fe2dc1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e2c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2dc100300 0x7fe2dc197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e2c00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc197fc0 con 0x7fe2dc067310 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e2c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc19bd90 con 0x7fe2dc100300 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e1800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc067310 0x7fe2dc1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e1800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc067310 0x7fe2dc1973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43654/0 (socket says 172.21.15.23:43654) 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e1800640 1 -- 172.21.15.23:0/3681635002 learned_addr learned my addr 172.21.15.23:0/3681635002 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e1800640 1 -- 172.21.15.23:0/3681635002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2dc100300 msgr2=0x7fe2dc197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e1800640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2dc100300 0x7fe2dc197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.797+0000 7fe2e1800640 1 -- 172.21.15.23:0/3681635002 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009900 con 0x7fe2dc067310 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.798+0000 7fe2e1800640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc067310 0x7fe2dc1973f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0037040 tx=0x7fe2d0032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.798+0000 7fe2da000640 1 -- 172.21.15.23:0/3681635002 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d0034820 con 0x7fe2dc067310 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.798+0000 7fe2da000640 1 -- 172.21.15.23:0/3681635002 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2d0003e30 con 0x7fe2dc067310 2024-02-28T16:37:55.786 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.798+0000 7fe2da000640 1 -- 172.21.15.23:0/3681635002 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d003f440 con 0x7fe2dc067310 2024-02-28T16:37:55.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.798+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc19c010 con 0x7fe2dc067310 2024-02-28T16:37:55.787 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.798+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc19c590 con 0x7fe2dc067310 2024-02-28T16:37:55.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.799+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc04e000 con 0x7fe2dc067310 2024-02-28T16:37:55.788 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.800+0000 7fe2da000640 1 -- 172.21.15.23:0/3681635002 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe2d003b040 con 0x7fe2dc067310 2024-02-28T16:37:55.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.801+0000 7fe2da000640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe2c406d810 0x7fe2c406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:55.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.802+0000 7fe2da000640 1 -- 172.21.15.23:0/3681635002 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe2d00b0370 con 0x7fe2dc067310 2024-02-28T16:37:55.789 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.802+0000 7fe2e0e00640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe2c406d810 0x7fe2c406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:55.790 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.802+0000 7fe2e0e00640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe2c406d810 0x7fe2c406fcc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc198a00 tx=0x7fe2c8006c90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:55.794 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:55.806+0000 7fe2da000640 1 -- 172.21.15.23:0/3681635002 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe2d0079bb0 con 0x7fe2dc067310 2024-02-28T16:37:55.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:55 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/809286380' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-28T16:37:55.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:55 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/2672114312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:37:55.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:55 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/809286380' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-28T16:37:55.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:55 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/2672114312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:37:55.991 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.004+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2dc10eb90 con 0x7fe2dc067310 2024-02-28T16:37:55.992 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.004+0000 7fe2da000640 1 -- 172.21.15.23:0/3681635002 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2d007d270 con 0x7fe2dc067310 2024-02-28T16:37:55.992 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 1 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.006+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe2c406d810 msgr2=0x7fe2c406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.006+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe2c406d810 0x7fe2c406fcc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc198a00 tx=0x7fe2c8006c90 comp rx=0 tx=0).stop 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.006+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc067310 msgr2=0x7fe2dc1973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc067310 0x7fe2dc1973f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0037040 tx=0x7fe2d0032b60 comp rx=0 tx=0).stop 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 shutdown_connections 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe2c406d810 0x7fe2c406fcc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2dc100300 0x7fe2dc197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 --2- 172.21.15.23:0/3681635002 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe2dc067310 0x7fe2dc1973f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 >> 172.21.15.23:0/3681635002 conn(0x7fe2dc0743d0 msgr2=0x7fe2dc0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 shutdown_connections 2024-02-28T16:37:55.995 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.007+0000 7fe2e2c00640 1 -- 172.21.15.23:0/3681635002 wait complete. 2024-02-28T16:37:56.012 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 -- 172.21.15.23:0/2283088107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a80ff4b0 msgr2=0x7f94a80ff920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 --2- 172.21.15.23:0/2283088107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a80ff4b0 0x7f94a80ff920 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9490009880 tx=0x7f949002bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 -- 172.21.15.23:0/2283088107 shutdown_connections 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 --2- 172.21.15.23:0/2283088107 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a80ff4b0 0x7f94a80ff920 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 --2- 172.21.15.23:0/2283088107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a81054c0 0x7f94a8105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 -- 172.21.15.23:0/2283088107 >> 172.21.15.23:0/2283088107 conn(0x7f94a80fafb0 msgr2=0x7f94a80fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 -- 172.21.15.23:0/2283088107 shutdown_connections 2024-02-28T16:37:56.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.217+0000 7f94ada00640 1 -- 172.21.15.23:0/2283088107 wait complete. 2024-02-28T16:37:56.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.218+0000 7f94ada00640 1 Processor -- start 2024-02-28T16:37:56.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.218+0000 7f94ada00640 1 -- start start 2024-02-28T16:37:56.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.218+0000 7f94ada00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a80ff4b0 0x7f94a8195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:56.207 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.218+0000 7f94ada00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a81054c0 0x7f94a81957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.218+0000 7f94ada00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8195e40 con 0x7f94a81054c0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.218+0000 7f94ada00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8199c10 con 0x7f94a80ff4b0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.218+0000 7f949f400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a81054c0 0x7f94a81957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f949f400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a81054c0 0x7f94a81957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43668/0 (socket says 172.21.15.23:43668) 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f949f400640 1 -- 172.21.15.23:0/763008811 learned_addr learned my addr 172.21.15.23:0/763008811 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f949f400640 1 -- 172.21.15.23:0/763008811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a80ff4b0 msgr2=0x7f94a8195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f949f400640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a80ff4b0 0x7f94a8195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f949f400640 1 -- 172.21.15.23:0/763008811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490009560 con 0x7f94a81054c0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f949f400640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a81054c0 0x7f94a81957b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9490036040 tx=0x7f9490004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f94a5600640 1 -- 172.21.15.23:0/763008811 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94900035f0 con 0x7f94a81054c0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f94a5600640 1 -- 172.21.15.23:0/763008811 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9490003c10 con 0x7f94a81054c0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.219+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a8199e90 con 0x7f94a81054c0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.220+0000 7f94a5600640 1 -- 172.21.15.23:0/763008811 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9490034440 con 0x7f94a81054c0 2024-02-28T16:37:56.208 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.220+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a819a3f0 con 0x7f94a81054c0 2024-02-28T16:37:56.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.221+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a804e000 con 0x7f94a81054c0 2024-02-28T16:37:56.209 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.222+0000 7f94a5600640 1 -- 172.21.15.23:0/763008811 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9490005060 con 0x7f94a81054c0 2024-02-28T16:37:56.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.222+0000 7f94a5600640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f948c06d810 0x7f948c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:56.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.223+0000 7f94a5600640 1 -- 172.21.15.23:0/763008811 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f94900afaf0 con 0x7f94a81054c0 2024-02-28T16:37:56.210 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.223+0000 7f94a7e00640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f948c06d810 0x7f948c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:56.211 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.223+0000 7f94a7e00640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f948c06d810 0x7f948c06fcc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9498009710 tx=0x7f9498006c90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:56.215 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.227+0000 7f94a5600640 1 -- 172.21.15.23:0/763008811 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9490079150 con 0x7f94a81054c0 2024-02-28T16:37:56.415 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.427+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f94a81079b0 con 0x7f94a81054c0 2024-02-28T16:37:56.416 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.428+0000 7f94a5600640 1 -- 172.21.15.23:0/763008811 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f949007c810 con 0x7f94a81054c0 2024-02-28T16:37:56.416 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:37:56.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f948c06d810 msgr2=0x7f948c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f948c06d810 0x7f948c06fcc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9498009710 tx=0x7f9498006c90 comp rx=0 tx=0).stop 2024-02-28T16:37:56.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a81054c0 msgr2=0x7f94a81957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a81054c0 0x7f94a81957b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9490036040 tx=0x7f9490004270 comp rx=0 tx=0).stop 2024-02-28T16:37:56.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 shutdown_connections 2024-02-28T16:37:56.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f948c06d810 0x7f948c06fcc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.419 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f94a81054c0 0x7f94a81957b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 --2- 172.21.15.23:0/763008811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a80ff4b0 0x7f94a8195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 >> 172.21.15.23:0/763008811 conn(0x7f94a80fafb0 msgr2=0x7f94a80fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:56.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 shutdown_connections 2024-02-28T16:37:56.420 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.431+0000 7f94ada00640 1 -- 172.21.15.23:0/763008811 wait complete. 2024-02-28T16:37:56.439 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.674+0000 7f27f5800640 1 -- 172.21.15.23:0/2567841456 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f0106090 msgr2=0x7f27f01064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.674+0000 7f27f5800640 1 --2- 172.21.15.23:0/2567841456 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f0106090 0x7f27f01064e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009880 tx=0x7f27dc02bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.675+0000 7f27f5800640 1 -- 172.21.15.23:0/2567841456 shutdown_connections 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.675+0000 7f27f5800640 1 --2- 172.21.15.23:0/2567841456 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f0106090 0x7f27f01064e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.675+0000 7f27f5800640 1 --2- 172.21.15.23:0/2567841456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f010bb60 0x7f27f010bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.675+0000 7f27f5800640 1 -- 172.21.15.23:0/2567841456 >> 172.21.15.23:0/2567841456 conn(0x7f27f0075260 msgr2=0x7f27f0077670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.675+0000 7f27f5800640 1 -- 172.21.15.23:0/2567841456 shutdown_connections 2024-02-28T16:37:56.663 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.675+0000 7f27f5800640 1 -- 172.21.15.23:0/2567841456 wait complete. 2024-02-28T16:37:56.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.676+0000 7f27f5800640 1 Processor -- start 2024-02-28T16:37:56.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.676+0000 7f27f5800640 1 -- start start 2024-02-28T16:37:56.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.676+0000 7f27f5800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f0106090 0x7f27f01a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:56.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.676+0000 7f27f5800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f010bb60 0x7f27f01a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:56.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.676+0000 7f27f5800640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019b690 con 0x7f27f010bb60 2024-02-28T16:37:56.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.676+0000 7f27f5800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019b800 con 0x7f27f0106090 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.676+0000 7f27ef400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f010bb60 0x7f27f01a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.677+0000 7f27ef400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f010bb60 0x7f27f01a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43698/0 (socket says 172.21.15.23:43698) 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.677+0000 7f27ef400640 1 -- 172.21.15.23:0/896372532 learned_addr learned my addr 172.21.15.23:0/896372532 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.677+0000 7f27ef400640 1 -- 172.21.15.23:0/896372532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f0106090 msgr2=0x7f27f01a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.677+0000 7f27efe00640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f0106090 0x7f27f01a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.677+0000 7f27ef400640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f0106090 0x7f27f01a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.677+0000 7f27ef400640 1 -- 172.21.15.23:0/896372532 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc009560 con 0x7f27f010bb60 2024-02-28T16:37:56.666 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.677+0000 7f27ef400640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f010bb60 0x7f27f01a1b60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f27dc036040 tx=0x7f27dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:56.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.678+0000 7f27ecc00640 1 -- 172.21.15.23:0/896372532 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27dc0035f0 con 0x7f27f010bb60 2024-02-28T16:37:56.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.678+0000 7f27ecc00640 1 -- 172.21.15.23:0/896372532 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27dc003c10 con 0x7f27f010bb60 2024-02-28T16:37:56.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.678+0000 7f27ecc00640 1 -- 172.21.15.23:0/896372532 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27dc034440 con 0x7f27f010bb60 2024-02-28T16:37:56.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.678+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f019ba80 con 0x7f27f010bb60 2024-02-28T16:37:56.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.678+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f019bfe0 con 0x7f27f010bb60 2024-02-28T16:37:56.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.679+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f004e000 con 0x7f27f010bb60 2024-02-28T16:37:56.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.680+0000 7f27ecc00640 1 -- 172.21.15.23:0/896372532 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f27dc005060 con 0x7f27f010bb60 2024-02-28T16:37:56.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.681+0000 7f27ecc00640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f27d406d810 0x7f27d406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:56.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.681+0000 7f27ecc00640 1 -- 172.21.15.23:0/896372532 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f27dc0af980 con 0x7f27f010bb60 2024-02-28T16:37:56.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.681+0000 7f27efe00640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f27d406d810 0x7f27d406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:56.669 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.682+0000 7f27efe00640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f27d406d810 0x7f27d406fcc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f27e000a810 tx=0x7f27e0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:56.673 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.686+0000 7f27ecc00640 1 -- 172.21.15.23:0/896372532 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f27dc079100 con 0x7f27f010bb60 2024-02-28T16:37:56.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.886+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f27f019bc10 con 0x7f27f010bb60 2024-02-28T16:37:56.875 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.887+0000 7f27ecc00640 1 -- 172.21.15.23:0/896372532 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f27f019bc10 con 0x7f27f010bb60 2024-02-28T16:37:56.875 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f27d406d810 msgr2=0x7f27d406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f27d406d810 0x7f27d406fcc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f27e000a810 tx=0x7f27e0008040 comp rx=0 tx=0).stop 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f010bb60 msgr2=0x7f27f01a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f010bb60 0x7f27f01a1b60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f27dc036040 tx=0x7f27dc004270 comp rx=0 tx=0).stop 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 shutdown_connections 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f27d406d810 0x7f27d406fcc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f27f010bb60 0x7f27f01a1b60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 --2- 172.21.15.23:0/896372532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f0106090 0x7f27f01a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 >> 172.21.15.23:0/896372532 conn(0x7f27f0075260 msgr2=0x7f27f0076ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:56.878 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 shutdown_connections 2024-02-28T16:37:56.879 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:56.890+0000 7f27f5800640 1 -- 172.21.15.23:0/896372532 wait complete. 2024-02-28T16:37:56.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:56 smithi023 ceph-mon[78509]: pgmap v400: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:56.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:56 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3681635002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:37:56.893 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:56 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/763008811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:37:56.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:56 smithi153 ceph-mon[66339]: pgmap v400: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:56.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:56 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3681635002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:37:56.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:56 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/763008811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:37:56.895 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T16:37:57.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 -- 172.21.15.23:0/2295694216 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0101670 msgr2=0x7fbcf0101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.115 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/2295694216 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0101670 0x7fbcf0101ae0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009880 tx=0x7fbcdc02bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 -- 172.21.15.23:0/2295694216 shutdown_connections 2024-02-28T16:37:57.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/2295694216 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0101670 0x7fbcf0101ae0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/2295694216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0107680 0x7fbcf0107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 -- 172.21.15.23:0/2295694216 >> 172.21.15.23:0/2295694216 conn(0x7fbcf00fd190 msgr2=0x7fbcf00ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:57.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 -- 172.21.15.23:0/2295694216 shutdown_connections 2024-02-28T16:37:57.116 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.127+0000 7fbcf6a00640 1 -- 172.21.15.23:0/2295694216 wait complete. 2024-02-28T16:37:57.117 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.128+0000 7fbcf6a00640 1 Processor -- start 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.128+0000 7fbcf6a00640 1 -- start start 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0101670 0x7fbcf0197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf6a00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0107680 0x7fbcf01978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf6a00640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0197f40 con 0x7fbcf0107680 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf6a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf019bd10 con 0x7fbcf0101670 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf4c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0107680 0x7fbcf01978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf4c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0107680 0x7fbcf01978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43712/0 (socket says 172.21.15.23:43712) 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf4c00640 1 -- 172.21.15.23:0/1020351596 learned_addr learned my addr 172.21.15.23:0/1020351596 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.129+0000 7fbcf5600640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0101670 0x7fbcf0197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcf4c00640 1 -- 172.21.15.23:0/1020351596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0101670 msgr2=0x7fbcf0197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.118 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcf4c00640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0101670 0x7fbcf0197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcf4c00640 1 -- 172.21.15.23:0/1020351596 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009560 con 0x7fbcf0107680 2024-02-28T16:37:57.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcf4c00640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0107680 0x7fbcf01978b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc036040 tx=0x7fbcdc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:57.119 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcee000640 1 -- 172.21.15.23:0/1020351596 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcdc0035f0 con 0x7fbcf0107680 2024-02-28T16:37:57.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcee000640 1 -- 172.21.15.23:0/1020351596 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcdc003c10 con 0x7fbcf0107680 2024-02-28T16:37:57.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcee000640 1 -- 172.21.15.23:0/1020351596 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcdc034440 con 0x7fbcf0107680 2024-02-28T16:37:57.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf019bf90 con 0x7fbcf0107680 2024-02-28T16:37:57.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.130+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf019c570 con 0x7fbcf0107680 2024-02-28T16:37:57.120 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.132+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf004e850 con 0x7fbcf0107680 2024-02-28T16:37:57.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.132+0000 7fbcee000640 1 -- 172.21.15.23:0/1020351596 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbcdc004ff0 con 0x7fbcf0107680 2024-02-28T16:37:57.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.133+0000 7fbcee000640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcd806d860 0x7fbcd806fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:57.121 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.133+0000 7fbcee000640 1 -- 172.21.15.23:0/1020351596 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbcdc0af9d0 con 0x7fbcf0107680 2024-02-28T16:37:57.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.134+0000 7fbcf5600640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcd806d860 0x7fbcd806fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:57.122 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.134+0000 7fbcf5600640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcd806d860 0x7fbcd806fd10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbcf01027b0 tx=0x7fbce4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:57.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.138+0000 7fbcee000640 1 -- 172.21.15.23:0/1020351596 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbcdc0790b0 con 0x7fbcf0107680 2024-02-28T16:37:57.340 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.353+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbcf00008d0 con 0x7fbcf0107680 2024-02-28T16:37:57.341 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.354+0000 7fbcee000640 1 -- 172.21.15.23:0/1020351596 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 45 entries v85) v1 ==== 81+0+2672 (secure 0 0 0) 0x7fbcdc0ade60 con 0x7fbcf0107680 2024-02-28T16:37:57.341 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6827/3382879257 2024-02-29T16:32:55.295667+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6824/1090050783 2024-02-29T16:32:23.774174+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6829/869339807 2024-02-29T16:31:55.013170+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/3255127518 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/877826779 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1312665589 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2047089350 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6828/869339807 2024-02-29T16:31:55.013170+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/222399421 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/3957078359 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/3506879033 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2569614083 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6828/1832791633 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/285090680 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:57.342 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2855046725 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/2101473361 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1357875446 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6826/3382879257 2024-02-29T16:32:55.295667+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/2394523153 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6825/1090050783 2024-02-29T16:32:23.774174+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/3123495442 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6827/1762270035 2024-02-29T16:20:27.240686+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6826/1762270035 2024-02-29T16:20:27.240686+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/3150303808 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/2571222747 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1385314359 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/3150303808 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/4210128758 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/2571222747 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:57.343 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1928653257 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/1731228796 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2580029340 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/287772389 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/488139137 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/364787592 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/3255579829 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6829/1832791633 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/4127609829 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2032489561 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/285090680 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/3191093495 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/3957078359 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/877826779 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1246504563 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.344 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/4090647671 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:57.345 INFO:teuthology.orchestra.run.smithi023.stderr:listed 45 entries 2024-02-28T16:37:57.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.356+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcd806d860 msgr2=0x7fbcd806fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.356+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcd806d860 0x7fbcd806fd10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbcf01027b0 tx=0x7fbce4008040 comp rx=0 tx=0).stop 2024-02-28T16:37:57.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.356+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0107680 msgr2=0x7fbcf01978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.356+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0107680 0x7fbcf01978b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc036040 tx=0x7fbcdc004040 comp rx=0 tx=0).stop 2024-02-28T16:37:57.345 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.357+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 shutdown_connections 2024-02-28T16:37:57.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.357+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fbcd806d860 0x7fbcd806fd10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.357+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fbcf0107680 0x7fbcf01978b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.357+0000 7fbcf6a00640 1 --2- 172.21.15.23:0/1020351596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0101670 0x7fbcf0197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.357+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 >> 172.21.15.23:0/1020351596 conn(0x7fbcf00fd190 msgr2=0x7fbcf00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:57.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.357+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 shutdown_connections 2024-02-28T16:37:57.346 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.357+0000 7fbcf6a00640 1 -- 172.21.15.23:0/1020351596 wait complete. 2024-02-28T16:37:57.364 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-02-28T16:37:57.364 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:37:57.419 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.657+0000 7fc58b200640 1 -- 172.21.15.23:0/2552506562 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 msgr2=0x7fc584067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.657+0000 7fc58b200640 1 --2- 172.21.15.23:0/2552506562 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584067350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc574009880 tx=0x7fc57402bd90 comp rx=0 tx=0).stop 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.658+0000 7fc58b200640 1 -- 172.21.15.23:0/2552506562 shutdown_connections 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.658+0000 7fc58b200640 1 --2- 172.21.15.23:0/2552506562 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584067350 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.658+0000 7fc58b200640 1 --2- 172.21.15.23:0/2552506562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc584105490 0x7fc584105860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.658+0000 7fc58b200640 1 -- 172.21.15.23:0/2552506562 >> 172.21.15.23:0/2552506562 conn(0x7fc584076280 msgr2=0x7fc584076680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.658+0000 7fc58b200640 1 -- 172.21.15.23:0/2552506562 shutdown_connections 2024-02-28T16:37:57.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.658+0000 7fc58b200640 1 -- 172.21.15.23:0/2552506562 wait complete. 2024-02-28T16:37:57.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc58b200640 1 Processor -- start 2024-02-28T16:37:57.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc58b200640 1 -- start start 2024-02-28T16:37:57.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc58b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc584105490 0x7fc5841950c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:57.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc58b200640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:57.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc58b200640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584195c90 con 0x7fc584105da0 2024-02-28T16:37:57.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc58b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584199a60 con 0x7fc584105490 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc589400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc589400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43720/0 (socket says 172.21.15.23:43720) 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.659+0000 7fc589400640 1 -- 172.21.15.23:0/1875371735 learned_addr learned my addr 172.21.15.23:0/1875371735 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.660+0000 7fc589e00640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc584105490 0x7fc5841950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.660+0000 7fc589400640 1 -- 172.21.15.23:0/1875371735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc584105490 msgr2=0x7fc5841950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.660+0000 7fc589400640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc584105490 0x7fc5841950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.660+0000 7fc589400640 1 -- 172.21.15.23:0/1875371735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009560 con 0x7fc584105da0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.660+0000 7fc589e00640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc584105490 0x7fc5841950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.660+0000 7fc589400640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584195600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc574036040 tx=0x7fc57402df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.660+0000 7fc57aa00640 1 -- 172.21.15.23:0/1875371735 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5740035f0 con 0x7fc584105da0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.661+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc584199ce0 con 0x7fc584105da0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.661+0000 7fc57aa00640 1 -- 172.21.15.23:0/1875371735 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc574003c10 con 0x7fc584105da0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.661+0000 7fc57aa00640 1 -- 172.21.15.23:0/1875371735 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc574005660 con 0x7fc584105da0 2024-02-28T16:37:57.649 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.661+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58419a240 con 0x7fc584105da0 2024-02-28T16:37:57.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.662+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58404e850 con 0x7fc584105da0 2024-02-28T16:37:57.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.663+0000 7fc57aa00640 1 -- 172.21.15.23:0/1875371735 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc574004ed0 con 0x7fc584105da0 2024-02-28T16:37:57.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.663+0000 7fc57aa00640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc57006d870 0x7fc57006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:57.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.664+0000 7fc57aa00640 1 -- 172.21.15.23:0/1875371735 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc5740b01d0 con 0x7fc584105da0 2024-02-28T16:37:57.651 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.664+0000 7fc589e00640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc57006d870 0x7fc57006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:57.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.664+0000 7fc589e00640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc57006d870 0x7fc57006fd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc57c005fd0 tx=0x7fc57c0094d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:57.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.671+0000 7fc57aa00640 1 -- 172.21.15.23:0/1875371735 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc5740799f0 con 0x7fc584105da0 2024-02-28T16:37:57.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:57 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/896372532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:37:57.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:57 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1020351596' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:37:57.866 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.878+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc584196410 con 0x7fc584105da0 2024-02-28T16:37:57.868 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.880+0000 7fc57aa00640 1 -- 172.21.15.23:0/1875371735 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17018 (secure 0 0 0) 0x7fc574003d80 con 0x7fc584105da0 2024-02-28T16:37:57.869 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-02-28T16:37:57.869 INFO:teuthology.orchestra.run.smithi023.stdout:{"epoch":85,"fsid":"dea052fa-d653-11ee-95c3-87774f69a715","created":"2024-02-28T16:11:11.971217+0000","modified":"2024-02-28T16:32:55.295716+0000","last_up_change":"2024-02-28T16:31:16.808610+0000","last_in_change":"2024-02-28T16:18:11.748474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:16:55.847665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:20:07.748175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:20:08.353450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1936c40d-0a71-495b-af57-ea0cb7224068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6803","nonce":4096152307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6805","nonce":4096152307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6809","nonce":4096152307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":4096152307},{"type":"v1","addr":"172.21.15.23:6807","nonce":4096152307}]},"public_addr":"172.21.15.23:6803/4096152307","cluster_addr":"172.21.15.23:6805/4096152307","heartbeat_back_addr":"172.21.15.23:6809/4096152307","heartbeat_front_addr":"172.21.15.23:6807/4096152307","state":["exists","up"]},{"osd":1,"uuid":"f2211134-0ddf-4faf-8fda-41ff13201231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6811","nonce":1249689655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6813","nonce":1249689655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6817","nonce":1249689655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":1249689655},{"type":"v1","addr":"172.21.15.23:6815","nonce":1249689655}]},"public_addr":"172.21.15.23:6811/1249689655","cluster_addr":"172.21.15.23:6813/1249689655","heartbeat_back_addr":"172.21.15.23:6817/1249689655","heartbeat_front_addr":"172.21.15.23:6815/1249689655","state":["exists","up"]},{"osd":2,"uuid":"513a900d-c438-4f9a-ad29-c667f5335070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6819","nonce":779926877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6821","nonce":779926877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6825","nonce":779926877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":779926877},{"type":"v1","addr":"172.21.15.23:6823","nonce":779926877}]},"public_addr":"172.21.15.23:6819/779926877","cluster_addr":"172.21.15.23:6821/779926877","heartbeat_back_addr":"172.21.15.23:6825/779926877","heartbeat_front_addr":"172.21.15.23:6823/779926877","state":["exists","up"]},{"osd":3,"uuid":"0b9875a7-8961-49db-bee2-40980eeec169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6801","nonce":487138192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6803","nonce":487138192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6807","nonce":487138192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":487138192},{"type":"v1","addr":"172.21.15.153:6805","nonce":487138192}]},"public_addr":"172.21.15.153:6801/487138192","cluster_addr":"172.21.15.153:6803/487138192","heartbeat_back_addr":"172.21.15.153:6807/487138192","heartbeat_front_addr":"172.21.15.153:6805/487138192","state":["exists","up"]},{"osd":4,"uuid":"3266acd3-21ec-4c65-bb5d-48d82334bf09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6809","nonce":1758644183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6811","nonce":1758644183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6815","nonce":1758644183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1758644183},{"type":"v1","addr":"172.21.15.153:6813","nonce":1758644183}]},"public_addr":"172.21.15.153:6809/1758644183","cluster_addr":"172.21.15.153:6811/1758644183","heartbeat_back_addr":"172.21.15.153:6815/1758644183","heartbeat_front_addr":"172.21.15.153:6813/1758644183","state":["exists","up"]},{"osd":5,"uuid":"82e08ef8-51d2-494b-b140-ac7bd2c5a320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6817","nonce":3414117647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6819","nonce":3414117647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6823","nonce":3414117647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3414117647},{"type":"v1","addr":"172.21.15.153:6821","nonce":3414117647}]},"public_addr":"172.21.15.153:6817/3414117647","cluster_addr":"172.21.15.153:6819/3414117647","heartbeat_back_addr":"172.21.15.153:6823/3414117647","heartbeat_front_addr":"172.21.15.153:6821/3414117647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:15:36.785669+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:13.722392+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:16:51.886029+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:25.675647+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:59.836960+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:34.102730+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6827/3382879257":"2024-02-29T16:32:55.295667+0000","172.21.15.153:6824/1090050783":"2024-02-29T16:32:23.774174+0000","172.21.15.23:6829/869339807":"2024-02-29T16:31:55.013170+0000","172.21.15.23:0/3255127518":"2024-02-29T16:25:51.083342+0000","172.21.15.23:6801/877826779":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/1312665589":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/2047089350":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6828/869339807":"2024-02-29T16:31:55.013170+0000","172.21.15.23:0/222399421":"2024-02-29T16:11:45.267597+0000","172.21.15.23:6800/3957078359":"2024-02-29T16:23:02.627520+0000","172.21.15.153:0/3506879033":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/2569614083":"2024-02-29T16:11:45.267597+0000","172.21.15.153:6828/1832791633":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6800/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/2855046725":"2024-02-29T16:23:02.627520+0000","172.21.15.153:0/2101473361":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/1357875446":"2024-02-29T16:12:27.412905+0000","172.21.15.153:6826/3382879257":"2024-02-29T16:32:55.295667+0000","172.21.15.153:0/2394523153":"2024-02-29T16:24:26.370048+0000","172.21.15.153:6825/1090050783":"2024-02-29T16:32:23.774174+0000","172.21.15.153:0/3123495442":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6827/1762270035":"2024-02-29T16:20:27.240686+0000","172.21.15.23:6826/1762270035":"2024-02-29T16:20:27.240686+0000","172.21.15.23:6801/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.23:6800/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1385314359":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6800/3150303808":"2024-02-29T16:13:55.119374+0000","172.21.15.153:0/4210128758":"2024-02-29T16:24:26.370048+0000","172.21.15.23:6801/2571222747":"2024-02-29T16:12:27.412905+0000","172.21.15.23:0/1928653257":"2024-02-29T16:25:51.083342+0000","172.21.15.153:0/1731228796":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/2580029340":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/287772389":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/488139137":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/364787592":"2024-02-29T16:23:02.627520+0000","172.21.15.23:0/3255579829":"2024-02-29T16:12:27.412905+0000","172.21.15.153:6829/1832791633":"2024-02-29T16:24:26.370048+0000","172.21.15.23:0/4127609829":"2024-02-29T16:13:55.119374+0000","172.21.15.23:0/2032489561":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6801/285090680":"2024-02-29T16:11:45.267597+0000","172.21.15.23:0/3191093495":"2024-02-29T16:12:27.412905+0000","172.21.15.23:6801/3957078359":"2024-02-29T16:23:02.627520+0000","172.21.15.23:6800/877826779":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/1246504563":"2024-02-29T16:25:51.083342+0000","172.21.15.23:0/4090647671":"2024-02-29T16:25:51.083342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.883+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc57006d870 msgr2=0x7fc57006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.883+0000 7fc58b200640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc57006d870 0x7fc57006fd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc57c005fd0 tx=0x7fc57c0094d0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.883+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 msgr2=0x7fc584195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.883+0000 7fc58b200640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584195600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc574036040 tx=0x7fc57402df60 comp rx=0 tx=0).stop 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.884+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 shutdown_connections 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.884+0000 7fc58b200640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fc57006d870 0x7fc57006fd20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.884+0000 7fc58b200640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fc584105da0 0x7fc584195600 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.884+0000 7fc58b200640 1 --2- 172.21.15.23:0/1875371735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc584105490 0x7fc5841950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.884+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 >> 172.21.15.23:0/1875371735 conn(0x7fc584076280 msgr2=0x7fc5840fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.884+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 shutdown_connections 2024-02-28T16:37:57.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:57.884+0000 7fc58b200640 1 -- 172.21.15.23:0/1875371735 wait complete. 2024-02-28T16:37:57.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:16:55.847665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:20:07.748175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:20:08.353450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:37:57.893 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:37:57.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:57 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/896372532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:37:57.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:57 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1020351596' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:37:58.123 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 -- 172.21.15.23:0/2604689945 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3600ff4b0 msgr2=0x7fe3600ff920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.123 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 --2- 172.21.15.23:0/2604689945 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3600ff4b0 0x7fe3600ff920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009880 tx=0x7fe34c02bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.123 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 -- 172.21.15.23:0/2604689945 shutdown_connections 2024-02-28T16:37:58.123 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 --2- 172.21.15.23:0/2604689945 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3600ff4b0 0x7fe3600ff920 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 --2- 172.21.15.23:0/2604689945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3601054c0 0x7fe360105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 -- 172.21.15.23:0/2604689945 >> 172.21.15.23:0/2604689945 conn(0x7fe3600fafb0 msgr2=0x7fe3600fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:58.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 -- 172.21.15.23:0/2604689945 shutdown_connections 2024-02-28T16:37:58.124 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.135+0000 7fe365000640 1 -- 172.21.15.23:0/2604689945 wait complete. 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.136+0000 7fe365000640 1 Processor -- start 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe365000640 1 -- start start 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe365000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3600ff4b0 0x7fe3601951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe365000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3601054c0 0x7fe360195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe365000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360195d30 con 0x7fe3601054c0 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe365000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360195ea0 con 0x7fe3600ff4b0 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe35ea00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3601054c0 0x7fe360195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe35ea00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3601054c0 0x7fe360195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43738/0 (socket says 172.21.15.23:43738) 2024-02-28T16:37:58.125 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.137+0000 7fe35ea00640 1 -- 172.21.15.23:0/3957967874 learned_addr learned my addr 172.21.15.23:0/3957967874 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.138+0000 7fe35f400640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3600ff4b0 0x7fe3601951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.138+0000 7fe35ea00640 1 -- 172.21.15.23:0/3957967874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3600ff4b0 msgr2=0x7fe3601951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.138+0000 7fe35ea00640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3600ff4b0 0x7fe3601951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.138+0000 7fe35ea00640 1 -- 172.21.15.23:0/3957967874 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c009560 con 0x7fe3601054c0 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.138+0000 7fe35f400640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3600ff4b0 0x7fe3601951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.138+0000 7fe35ea00640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3601054c0 0x7fe360195730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009230 tx=0x7fe34c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.138+0000 7fe357e00640 1 -- 172.21.15.23:0/3957967874 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe34c0035f0 con 0x7fe3601054c0 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.139+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe360199cd0 con 0x7fe3601054c0 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.139+0000 7fe357e00640 1 -- 172.21.15.23:0/3957967874 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe34c003c10 con 0x7fe3601054c0 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.139+0000 7fe357e00640 1 -- 172.21.15.23:0/3957967874 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe34c03e460 con 0x7fe3601054c0 2024-02-28T16:37:58.127 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.139+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36019a230 con 0x7fe3601054c0 2024-02-28T16:37:58.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.140+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36004e000 con 0x7fe3601054c0 2024-02-28T16:37:58.128 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.141+0000 7fe357e00640 1 -- 172.21.15.23:0/3957967874 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe34c004fd0 con 0x7fe3601054c0 2024-02-28T16:37:58.129 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.142+0000 7fe357e00640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe34406d810 0x7fe34406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:58.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.142+0000 7fe357e00640 1 -- 172.21.15.23:0/3957967874 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe34c0affb0 con 0x7fe3601054c0 2024-02-28T16:37:58.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.142+0000 7fe35f400640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe34406d810 0x7fe34406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:58.130 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.143+0000 7fe35f400640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe34406d810 0x7fe34406fcc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe35000baa0 tx=0x7fe350005d90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:58.134 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.147+0000 7fe357e00640 1 -- 172.21.15.23:0/3957967874 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe34c0e3d20 con 0x7fe3601054c0 2024-02-28T16:37:58.333 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.345+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe36010c7e0 con 0x7fe3601054c0 2024-02-28T16:37:58.334 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.346+0000 7fe357e00640 1 -- 172.21.15.23:0/3957967874 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe34c079610 con 0x7fe3601054c0 2024-02-28T16:37:58.334 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 1 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe34406d810 msgr2=0x7fe34406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe34406d810 0x7fe34406fcc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe35000baa0 tx=0x7fe350005d90 comp rx=0 tx=0).stop 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3601054c0 msgr2=0x7fe360195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3601054c0 0x7fe360195730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009230 tx=0x7fe34c004040 comp rx=0 tx=0).stop 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 shutdown_connections 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fe34406d810 0x7fe34406fcc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fe3601054c0 0x7fe360195730 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.337 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 --2- 172.21.15.23:0/3957967874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3600ff4b0 0x7fe3601951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 >> 172.21.15.23:0/3957967874 conn(0x7fe3600fafb0 msgr2=0x7fe3600fb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:58.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 shutdown_connections 2024-02-28T16:37:58.338 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.349+0000 7fe365000640 1 -- 172.21.15.23:0/3957967874 wait complete. 2024-02-28T16:37:58.357 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 -- 172.21.15.23:0/3936689620 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c0ff470 msgr2=0x7f931c0ff8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 --2- 172.21.15.23:0/3936689620 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c0ff470 0x7f931c0ff8e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9304009880 tx=0x7f930402bcf0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 -- 172.21.15.23:0/3936689620 shutdown_connections 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 --2- 172.21.15.23:0/3936689620 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c0ff470 0x7f931c0ff8e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 --2- 172.21.15.23:0/3936689620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f931c105480 0x7f931c105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 -- 172.21.15.23:0/3936689620 >> 172.21.15.23:0/3936689620 conn(0x7f931c0faf70 msgr2=0x7f931c0fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 -- 172.21.15.23:0/3936689620 shutdown_connections 2024-02-28T16:37:58.566 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.578+0000 7f9321800640 1 -- 172.21.15.23:0/3936689620 wait complete. 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.579+0000 7f9321800640 1 Processor -- start 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.579+0000 7f9321800640 1 -- start start 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.579+0000 7f9321800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f931c0ff470 0x7f931c197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.579+0000 7f9321800640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c105480 0x7f931c197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.579+0000 7f9321800640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c197fd0 con 0x7f931c105480 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.579+0000 7f9321800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c19bda0 con 0x7f931c0ff470 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931b400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c105480 0x7f931c197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931b400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c105480 0x7f931c197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43752/0 (socket says 172.21.15.23:43752) 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931b400640 1 -- 172.21.15.23:0/288674070 learned_addr learned my addr 172.21.15.23:0/288674070 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931be00640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f931c0ff470 0x7f931c197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931b400640 1 -- 172.21.15.23:0/288674070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f931c0ff470 msgr2=0x7f931c197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.568 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931b400640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f931c0ff470 0x7f931c197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931b400640 1 -- 172.21.15.23:0/288674070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304009560 con 0x7f931c105480 2024-02-28T16:37:58.569 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.580+0000 7f931b400640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c105480 0x7f931c197940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9304036040 tx=0x7f9304004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:58.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.581+0000 7f9318c00640 1 -- 172.21.15.23:0/288674070 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93040035f0 con 0x7f931c105480 2024-02-28T16:37:58.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.581+0000 7f9318c00640 1 -- 172.21.15.23:0/288674070 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9304003c10 con 0x7f931c105480 2024-02-28T16:37:58.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.581+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c19c020 con 0x7f931c105480 2024-02-28T16:37:58.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.581+0000 7f9318c00640 1 -- 172.21.15.23:0/288674070 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9304034440 con 0x7f931c105480 2024-02-28T16:37:58.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.581+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c19c580 con 0x7f931c105480 2024-02-28T16:37:58.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.582+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c04e000 con 0x7f931c105480 2024-02-28T16:37:58.570 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.583+0000 7f9318c00640 1 -- 172.21.15.23:0/288674070 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9304005060 con 0x7f931c105480 2024-02-28T16:37:58.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.584+0000 7f9318c00640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f930006d810 0x7f930006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:58.571 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.584+0000 7f9318c00640 1 -- 172.21.15.23:0/288674070 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f93040afab0 con 0x7f931c105480 2024-02-28T16:37:58.572 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.584+0000 7f931be00640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f930006d810 0x7f930006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:58.573 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.585+0000 7f931be00640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f930006d810 0x7f930006fcc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f930c005c40 tx=0x7f930c00a780 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:58.577 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.589+0000 7f9318c00640 1 -- 172.21.15.23:0/288674070 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9304079150 con 0x7f931c105480 2024-02-28T16:37:58.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:58 smithi023 ceph-mon[78509]: pgmap v401: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:58.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:58 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/1875371735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:37:58.672 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:58 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3957967874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:37:58.778 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.790+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f931c10c710 con 0x7f931c105480 2024-02-28T16:37:58.779 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.791+0000 7f9318c00640 1 -- 172.21.15.23:0/288674070 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f930407c810 con 0x7f931c105480 2024-02-28T16:37:58.779 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f930006d810 msgr2=0x7f930006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f930006d810 0x7f930006fcc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f930c005c40 tx=0x7f930c00a780 comp rx=0 tx=0).stop 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c105480 msgr2=0x7f931c197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c105480 0x7f931c197940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9304036040 tx=0x7f9304004270 comp rx=0 tx=0).stop 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 shutdown_connections 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f930006d810 0x7f930006fcc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f931c105480 0x7f931c197940 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 --2- 172.21.15.23:0/288674070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f931c0ff470 0x7f931c197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 >> 172.21.15.23:0/288674070 conn(0x7f931c0faf70 msgr2=0x7f931c0fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 shutdown_connections 2024-02-28T16:37:58.782 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:58.794+0000 7f9321800640 1 -- 172.21.15.23:0/288674070 wait complete. 2024-02-28T16:37:58.802 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:37:58.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:58 smithi153 ceph-mon[66339]: pgmap v401: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:37:58.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:58 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/1875371735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:37:58.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:58 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3957967874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:37:59.031 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 -- 172.21.15.23:0/2935444422 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c41054c0 msgr2=0x7fa5c4105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 --2- 172.21.15.23:0/2935444422 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c41054c0 0x7fa5c4105890 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009880 tx=0x7fa5b402bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 -- 172.21.15.23:0/2935444422 shutdown_connections 2024-02-28T16:37:59.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 --2- 172.21.15.23:0/2935444422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5c40ff4b0 0x7fa5c40ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 --2- 172.21.15.23:0/2935444422 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c41054c0 0x7fa5c4105890 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 -- 172.21.15.23:0/2935444422 >> 172.21.15.23:0/2935444422 conn(0x7fa5c40fafb0 msgr2=0x7fa5c40fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:59.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 -- 172.21.15.23:0/2935444422 shutdown_connections 2024-02-28T16:37:59.032 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.044+0000 7fa5ca400640 1 -- 172.21.15.23:0/2935444422 wait complete. 2024-02-28T16:37:59.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.045+0000 7fa5ca400640 1 Processor -- start 2024-02-28T16:37:59.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.045+0000 7fa5ca400640 1 -- start start 2024-02-28T16:37:59.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.045+0000 7fa5ca400640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c40ff4b0 0x7fa5c4072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:59.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.045+0000 7fa5ca400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5c41054c0 0x7fa5c4072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:59.033 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.045+0000 7fa5ca400640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4074320 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.045+0000 7fa5ca400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4074460 con 0x7fa5c41054c0 2024-02-28T16:37:59.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.046+0000 7fa5c9000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c40ff4b0 0x7fa5c4072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:59.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.046+0000 7fa5c9000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c40ff4b0 0x7fa5c4072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:43774/0 (socket says 172.21.15.23:43774) 2024-02-28T16:37:59.034 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.046+0000 7fa5c9000640 1 -- 172.21.15.23:0/3624093721 learned_addr learned my addr 172.21.15.23:0/3624093721 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.046+0000 7fa5c9000640 1 -- 172.21.15.23:0/3624093721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5c41054c0 msgr2=0x7fa5c4072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.046+0000 7fa5c9000640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5c41054c0 0x7fa5c4072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.046+0000 7fa5c9000640 1 -- 172.21.15.23:0/3624093721 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4009560 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.046+0000 7fa5c9000640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c40ff4b0 0x7fa5c4072560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009230 tx=0x7fa5b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.047+0000 7fa5c1600640 1 -- 172.21.15.23:0/3624093721 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b40035f0 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.047+0000 7fa5c1600640 1 -- 172.21.15.23:0/3624093721 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5b4003c10 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.047+0000 7fa5c1600640 1 -- 172.21.15.23:0/3624093721 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b4005670 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.047+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c4073040 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.035 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.047+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c41a5af0 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.036 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.048+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c404e000 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.036 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.049+0000 7fa5c1600640 1 -- 172.21.15.23:0/3624093721 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa5b4004dd0 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.037 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.050+0000 7fa5c1600640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa5a806d810 0x7fa5a806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:59.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.050+0000 7fa5c1600640 1 -- 172.21.15.23:0/3624093721 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa5b40af960 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.050+0000 7fa5c3e00640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa5a806d810 0x7fa5a806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:59.038 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.051+0000 7fa5c3e00640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa5a806d810 0x7fa5a806fcc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0005fd0 tx=0x7fa5b0005c70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:59.043 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.055+0000 7fa5c1600640 1 -- 172.21.15.23:0/3624093721 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa5b4079040 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.244 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.256+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa5c4073a90 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.247 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.257+0000 7fa5c1600640 1 -- 172.21.15.23:0/3624093721 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa5c4073a90 con 0x7fa5c40ff4b0 2024-02-28T16:37:59.247 INFO:teuthology.orchestra.run.smithi023.stdout:pg_num: 32 2024-02-28T16:37:59.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.259+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa5a806d810 msgr2=0x7fa5a806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.259+0000 7fa5ca400640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa5a806d810 0x7fa5a806fcc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0005fd0 tx=0x7fa5b0005c70 comp rx=0 tx=0).stop 2024-02-28T16:37:59.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.259+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c40ff4b0 msgr2=0x7fa5c4072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.248 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.259+0000 7fa5ca400640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c40ff4b0 0x7fa5c4072560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009230 tx=0x7fa5b4004040 comp rx=0 tx=0).stop 2024-02-28T16:37:59.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.260+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 shutdown_connections 2024-02-28T16:37:59.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.260+0000 7fa5ca400640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7fa5a806d810 0x7fa5a806fcc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.260+0000 7fa5ca400640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5c41054c0 0x7fa5c4072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.260+0000 7fa5ca400640 1 --2- 172.21.15.23:0/3624093721 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7fa5c40ff4b0 0x7fa5c4072560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.260+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 >> 172.21.15.23:0/3624093721 conn(0x7fa5c40fafb0 msgr2=0x7fa5c40fb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:59.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.260+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 shutdown_connections 2024-02-28T16:37:59.249 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.260+0000 7fa5ca400640 1 -- 172.21.15.23:0/3624093721 wait complete. 2024-02-28T16:37:59.267 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T16:37:59.493 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 -- 172.21.15.23:0/2989366136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c101870 msgr2=0x7f199c101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 --2- 172.21.15.23:0/2989366136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c101870 0x7f199c101ce0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1988009880 tx=0x7f198802bce0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 -- 172.21.15.23:0/2989366136 shutdown_connections 2024-02-28T16:37:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 --2- 172.21.15.23:0/2989366136 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c101870 0x7f199c101ce0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 --2- 172.21.15.23:0/2989366136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f199c107880 0x7f199c107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 -- 172.21.15.23:0/2989366136 >> 172.21.15.23:0/2989366136 conn(0x7f199c0fd370 msgr2=0x7f199c0ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 -- 172.21.15.23:0/2989366136 shutdown_connections 2024-02-28T16:37:59.494 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.505+0000 7f19a4000640 1 -- 172.21.15.23:0/2989366136 wait complete. 2024-02-28T16:37:59.495 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.506+0000 7f19a4000640 1 Processor -- start 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.506+0000 7f19a4000640 1 -- start start 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a4000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f199c101870 0x7f199c197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a4000640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c107880 0x7f199c1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a4000640 1 -- --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c197f40 con 0x7f199c107880 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a4000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19bd10 con 0x7f199c101870 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a0c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c107880 0x7f199c1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a0c00640 1 --2- >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c107880 0x7f199c1978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.23:3300/0 says I am v2:172.21.15.23:33966/0 (socket says 172.21.15.23:33966) 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a0c00640 1 -- 172.21.15.23:0/60485915 learned_addr learned my addr 172.21.15.23:0/60485915 (peer_addr_for_me v2:172.21.15.23:0/0) 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.507+0000 7f19a1600640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f199c101870 0x7f199c197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f19a0c00640 1 -- 172.21.15.23:0/60485915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f199c101870 msgr2=0x7f199c197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f19a0c00640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f199c101870 0x7f199c197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f19a0c00640 1 -- 172.21.15.23:0/60485915 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988009560 con 0x7f199c107880 2024-02-28T16:37:59.496 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f19a0c00640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c107880 0x7f199c1978b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1988000c00 tx=0x7f198802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f199a000640 1 -- 172.21.15.23:0/60485915 <== mon.0 v2:172.21.15.23:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1988004520 con 0x7f199c107880 2024-02-28T16:37:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f199a000640 1 -- 172.21.15.23:0/60485915 <== mon.0 v2:172.21.15.23:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1988003ab0 con 0x7f199c107880 2024-02-28T16:37:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f199a000640 1 -- 172.21.15.23:0/60485915 <== mon.0 v2:172.21.15.23:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1988034440 con 0x7f199c107880 2024-02-28T16:37:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.508+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c19bf90 con 0x7f199c107880 2024-02-28T16:37:59.497 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.509+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c19c510 con 0x7f199c107880 2024-02-28T16:37:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.510+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c04e000 con 0x7f199c107880 2024-02-28T16:37:59.498 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.511+0000 7f199a000640 1 -- 172.21.15.23:0/60485915 <== mon.0 v2:172.21.15.23:3300/0 4 ==== mgrmap(e 38) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1988003c20 con 0x7f199c107880 2024-02-28T16:37:59.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.511+0000 7f199a000640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f198406d8d0 0x7f198406fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:59.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.512+0000 7f199a000640 1 -- 172.21.15.23:0/60485915 <== mon.0 v2:172.21.15.23:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f19880af960 con 0x7f199c107880 2024-02-28T16:37:59.499 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.512+0000 7f19a1600640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f198406d8d0 0x7f198406fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:59.500 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.513+0000 7f19a1600640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f198406d8d0 0x7f198406fd80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1990005c40 tx=0x7f1990005bd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:59.504 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.517+0000 7f199a000640 1 -- 172.21.15.23:0/60485915 <== mon.0 v2:172.21.15.23:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1988079040 con 0x7f199c107880 2024-02-28T16:37:59.721 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.733+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 --> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f199c10ecb0 con 0x7f199c107880 2024-02-28T16:37:59.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.734+0000 7f199a000640 1 -- 172.21.15.23:0/60485915 <== mon.0 v2:172.21.15.23:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 45 entries v85) v1 ==== 81+0+2672 (secure 0 0 0) 0x7f198807c700 con 0x7f199c107880 2024-02-28T16:37:59.722 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6827/3382879257 2024-02-29T16:32:55.295667+0000 2024-02-28T16:37:59.722 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6824/1090050783 2024-02-29T16:32:23.774174+0000 2024-02-28T16:37:59.722 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6829/869339807 2024-02-29T16:31:55.013170+0000 2024-02-28T16:37:59.722 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/3255127518 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.722 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/877826779 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.722 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1312665589 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2047089350 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6828/869339807 2024-02-29T16:31:55.013170+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/222399421 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/3957078359 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/3506879033 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2569614083 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6828/1832791633 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/285090680 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2855046725 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/2101473361 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1357875446 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6826/3382879257 2024-02-29T16:32:55.295667+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/2394523153 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6825/1090050783 2024-02-29T16:32:23.774174+0000 2024-02-28T16:37:59.723 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/3123495442 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6827/1762270035 2024-02-29T16:20:27.240686+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6826/1762270035 2024-02-29T16:20:27.240686+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/3150303808 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/2571222747 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1385314359 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/3150303808 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/4210128758 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/2571222747 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1928653257 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:0/1731228796 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2580029340 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/287772389 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/488139137 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/364787592 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:59.724 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/3255579829 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.153:6829/1832791633 2024-02-29T16:24:26.370048+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/4127609829 2024-02-29T16:13:55.119374+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/2032489561 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/285090680 2024-02-29T16:11:45.267597+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/3191093495 2024-02-29T16:12:27.412905+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6801/3957078359 2024-02-29T16:23:02.627520+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:6800/877826779 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/1246504563 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.725 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23:0/4090647671 2024-02-29T16:25:51.083342+0000 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:listed 45 entries 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f198406d8d0 msgr2=0x7f198406fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f198406d8d0 0x7f198406fd80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1990005c40 tx=0x7f1990005bd0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c107880 msgr2=0x7f199c1978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c107880 0x7f199c1978b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1988000c00 tx=0x7f198802c850 comp rx=0 tx=0).stop 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 shutdown_connections 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:6800/2326856362,v1:172.21.15.23:6801/2326856362] conn(0x7f198406d8d0 0x7f198406fd80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.23:3300/0,v1:172.21.15.23:6789/0] conn(0x7f199c107880 0x7f199c1978b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.726 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 --2- 172.21.15.23:0/60485915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f199c101870 0x7f199c197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:59.727 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 >> 172.21.15.23:0/60485915 conn(0x7f199c0fd370 msgr2=0x7f199c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:59.727 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.737+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 shutdown_connections 2024-02-28T16:37:59.727 INFO:teuthology.orchestra.run.smithi023.stderr:2024-02-28T16:37:59.738+0000 7f19a4000640 1 -- 172.21.15.23:0/60485915 wait complete. 2024-02-28T16:37:59.745 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi023.front.sepia.ceph.com... 2024-02-28T16:37:59.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:37:59.746 DEBUG:teuthology.orchestra.run.smithi023:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-28T16:37:59.846 INFO:teuthology.orchestra.run:waiting for 300 2024-02-28T16:37:59.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:59 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/288674070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:37:59.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:37:59 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/3624093721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:37:59.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:59 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/288674070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:37:59.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:37:59 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/3624093721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:38:00.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:00 smithi153 ceph-mon[66339]: pgmap v402: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:00.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:00 smithi153 ceph-mon[66339]: from='client.? 172.21.15.23:0/60485915' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:38:00.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:00 smithi023 ceph-mon[78509]: pgmap v402: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:00.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:00 smithi023 ceph-mon[78509]: from='client.? 172.21.15.23:0/60485915' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:38:02.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:02 smithi023 ceph-mon[78509]: pgmap v403: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:02.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:02 smithi153 ceph-mon[66339]: pgmap v403: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:04.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:04 smithi153 ceph-mon[66339]: pgmap v404: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:04.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:04 smithi023 ceph-mon[78509]: pgmap v404: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:06.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:06 smithi153 ceph-mon[66339]: pgmap v405: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:06.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:06.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:06 smithi023 ceph-mon[78509]: pgmap v405: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:06.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:08.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:08 smithi153 ceph-mon[66339]: pgmap v406: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:08.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:08 smithi023 ceph-mon[78509]: pgmap v406: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:10.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:10 smithi153 ceph-mon[66339]: pgmap v407: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:10.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:10 smithi023 ceph-mon[78509]: pgmap v407: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:12.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:12 smithi023 ceph-mon[78509]: pgmap v408: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:13.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:12 smithi153 ceph-mon[66339]: pgmap v408: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:14.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:14 smithi023 ceph-mon[78509]: pgmap v409: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:15.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:14 smithi153 ceph-mon[66339]: pgmap v409: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:16.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:16 smithi023 ceph-mon[78509]: pgmap v410: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:17.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:16 smithi153 ceph-mon[66339]: pgmap v410: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:18.946 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:18 smithi153 ceph-mon[66339]: pgmap v411: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:19.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:18 smithi023 ceph-mon[78509]: pgmap v411: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:21.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:20 smithi153 ceph-mon[66339]: pgmap v412: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:21.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:20 smithi023 ceph-mon[78509]: pgmap v412: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:22.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:22.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:23.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:22 smithi153 ceph-mon[66339]: pgmap v413: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:23.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:22 smithi023 ceph-mon[78509]: pgmap v413: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:24.975 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:24 smithi023 ceph-mon[78509]: pgmap v414: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:25.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:24 smithi153 ceph-mon[66339]: pgmap v414: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:27.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:26 smithi153 ceph-mon[66339]: pgmap v415: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:27.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:26 smithi023 ceph-mon[78509]: pgmap v415: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:29.118 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:28 smithi153 ceph-mon[66339]: pgmap v416: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:29.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:28 smithi023 ceph-mon[78509]: pgmap v416: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:31.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:30 smithi153 ceph-mon[66339]: pgmap v417: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:31.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:30 smithi023 ceph-mon[78509]: pgmap v417: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:33.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:32 smithi153 ceph-mon[66339]: pgmap v418: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:33.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:32 smithi023 ceph-mon[78509]: pgmap v418: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:35.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:34 smithi153 ceph-mon[66339]: pgmap v419: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:35.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:34 smithi023 ceph-mon[78509]: pgmap v419: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:37.057 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:36 smithi023 ceph-mon[78509]: pgmap v420: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:37.057 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:37.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:36 smithi153 ceph-mon[66339]: pgmap v420: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:37.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:39.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:38 smithi153 ceph-mon[66339]: pgmap v421: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:39.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:38 smithi023 ceph-mon[78509]: pgmap v421: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:41.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:40 smithi153 ceph-mon[66339]: pgmap v422: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:41.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:40 smithi023 ceph-mon[78509]: pgmap v422: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:43.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:42 smithi153 ceph-mon[66339]: pgmap v423: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:43.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:42 smithi023 ceph-mon[78509]: pgmap v423: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:44.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:44 smithi153 ceph-mon[66339]: pgmap v424: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:45.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:44 smithi023 ceph-mon[78509]: pgmap v424: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:47.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:46 smithi153 ceph-mon[66339]: pgmap v425: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:47.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:46 smithi023 ceph-mon[78509]: pgmap v425: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:49.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:48 smithi153 ceph-mon[66339]: pgmap v426: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:49.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:48 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:49.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:48 smithi023 ceph-mon[78509]: pgmap v426: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:49.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:48 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:51.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:50 smithi153 ceph-mon[66339]: pgmap v427: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:51.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:51.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:38:51.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:50 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:38:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:50 smithi023 ceph-mon[78509]: pgmap v427: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:38:51.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:50 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:38:52.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:52.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:53.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:52 smithi153 ceph-mon[66339]: pgmap v428: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:53.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:52 smithi023 ceph-mon[78509]: pgmap v428: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:55.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:54 smithi153 ceph-mon[66339]: pgmap v429: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:55.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:54 smithi023 ceph-mon[78509]: pgmap v429: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:57.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:56 smithi153 ceph-mon[66339]: pgmap v430: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:57.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:56 smithi023 ceph-mon[78509]: pgmap v430: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:59.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:38:58 smithi153 ceph-mon[66339]: pgmap v431: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:38:59.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:38:58 smithi023 ceph-mon[78509]: pgmap v431: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:01.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:00 smithi153 ceph-mon[66339]: pgmap v432: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:01.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:00 smithi023 ceph-mon[78509]: pgmap v432: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:03.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:02 smithi153 ceph-mon[66339]: pgmap v433: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:03.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:02 smithi023 ceph-mon[78509]: pgmap v433: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:05.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:04 smithi153 ceph-mon[66339]: pgmap v434: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:05.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:04 smithi023 ceph-mon[78509]: pgmap v434: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:07.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:06 smithi153 ceph-mon[66339]: pgmap v435: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:07.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:07.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:06 smithi023 ceph-mon[78509]: pgmap v435: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:07.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:09.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:08 smithi153 ceph-mon[66339]: pgmap v436: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:09.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:08 smithi023 ceph-mon[78509]: pgmap v436: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:11.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:10 smithi153 ceph-mon[66339]: pgmap v437: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:11.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:10 smithi023 ceph-mon[78509]: pgmap v437: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:13.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:12 smithi023 ceph-mon[78509]: pgmap v438: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:13.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:12 smithi153 ceph-mon[66339]: pgmap v438: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:15.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:14 smithi023 ceph-mon[78509]: pgmap v439: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:15.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:14 smithi153 ceph-mon[66339]: pgmap v439: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:17.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:16 smithi023 ceph-mon[78509]: pgmap v440: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:17.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:16 smithi153 ceph-mon[66339]: pgmap v440: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:19.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:18 smithi023 ceph-mon[78509]: pgmap v441: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:19.197 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:18 smithi153 ceph-mon[66339]: pgmap v441: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:21.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:20 smithi153 ceph-mon[66339]: pgmap v442: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:21.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:20 smithi023 ceph-mon[78509]: pgmap v442: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:22.383 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:22.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:23.295 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:22 smithi023 ceph-mon[78509]: pgmap v443: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:23.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:22 smithi153 ceph-mon[66339]: pgmap v443: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:25.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:24 smithi153 ceph-mon[66339]: pgmap v444: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:25.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:24 smithi023 ceph-mon[78509]: pgmap v444: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:27.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:26 smithi153 ceph-mon[66339]: pgmap v445: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:27.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:26 smithi023 ceph-mon[78509]: pgmap v445: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:29.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:28 smithi153 ceph-mon[66339]: pgmap v446: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:29.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:28 smithi023 ceph-mon[78509]: pgmap v446: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:31.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:30 smithi153 ceph-mon[66339]: pgmap v447: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:31.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:30 smithi023 ceph-mon[78509]: pgmap v447: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:33.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:32 smithi153 ceph-mon[66339]: pgmap v448: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:33.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:32 smithi023 ceph-mon[78509]: pgmap v448: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:35.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:35 smithi153 ceph-mon[66339]: pgmap v449: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:35.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:35 smithi023 ceph-mon[78509]: pgmap v449: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:37.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:37 smithi153 ceph-mon[66339]: pgmap v450: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:37.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:37 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:37.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:37 smithi023 ceph-mon[78509]: pgmap v450: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:37.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:37 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:39.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:39 smithi023 ceph-mon[78509]: pgmap v451: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:39.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:39 smithi153 ceph-mon[66339]: pgmap v451: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:41.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:41 smithi153 ceph-mon[66339]: pgmap v452: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:41.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:41 smithi023 ceph-mon[78509]: pgmap v452: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:43.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:43 smithi153 ceph-mon[66339]: pgmap v453: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:43.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:43 smithi023 ceph-mon[78509]: pgmap v453: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:45.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:45 smithi153 ceph-mon[66339]: pgmap v454: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:45.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:45 smithi023 ceph-mon[78509]: pgmap v454: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:47.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:47 smithi153 ceph-mon[66339]: pgmap v455: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:47.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:47 smithi023 ceph-mon[78509]: pgmap v455: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:49.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:49 smithi153 ceph-mon[66339]: pgmap v456: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:49.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:49 smithi023 ceph-mon[78509]: pgmap v456: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:51.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:51 smithi153 ceph-mon[66339]: pgmap v457: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:51.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:51.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:51 smithi023 ceph-mon[78509]: pgmap v457: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:51.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:52.383 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:52.383 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:52.383 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:52.383 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:39:52.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:52.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:52.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:52.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:39:53.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:53 smithi153 ceph-mon[66339]: pgmap v458: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:53.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:53 smithi023 ceph-mon[78509]: pgmap v458: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:55.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:55 smithi153 ceph-mon[66339]: pgmap v459: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:55.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:55 smithi023 ceph-mon[78509]: pgmap v459: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:57.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:57 smithi153 ceph-mon[66339]: pgmap v460: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:57.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:57 smithi023 ceph-mon[78509]: pgmap v460: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:59.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:39:59 smithi153 ceph-mon[66339]: pgmap v461: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:39:59.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:39:59 smithi023 ceph-mon[78509]: pgmap v461: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:00.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:00 smithi153 ceph-mon[66339]: overall HEALTH_OK 2024-02-28T16:40:00.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:00 smithi023 ceph-mon[78509]: overall HEALTH_OK 2024-02-28T16:40:01.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:01 smithi153 ceph-mon[66339]: pgmap v462: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:01.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:01 smithi023 ceph-mon[78509]: pgmap v462: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:03.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:03 smithi153 ceph-mon[66339]: pgmap v463: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:03.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:03 smithi023 ceph-mon[78509]: pgmap v463: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:05.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:05 smithi153 ceph-mon[66339]: pgmap v464: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:05.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:05 smithi023 ceph-mon[78509]: pgmap v464: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:07.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:07 smithi153 ceph-mon[66339]: pgmap v465: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:07.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:07.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:07 smithi023 ceph-mon[78509]: pgmap v465: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:07.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:09.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:09 smithi153 ceph-mon[66339]: pgmap v466: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:09.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:09 smithi023 ceph-mon[78509]: pgmap v466: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:11.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:11 smithi153 ceph-mon[66339]: pgmap v467: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:11.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:11 smithi023 ceph-mon[78509]: pgmap v467: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:13.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:13 smithi023 ceph-mon[78509]: pgmap v468: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:13.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:13 smithi153 ceph-mon[66339]: pgmap v468: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:15.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:15 smithi023 ceph-mon[78509]: pgmap v469: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:15.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:15 smithi153 ceph-mon[66339]: pgmap v469: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:17.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:17 smithi023 ceph-mon[78509]: pgmap v470: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:17.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:17 smithi153 ceph-mon[66339]: pgmap v470: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:19.446 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:19 smithi153 ceph-mon[66339]: pgmap v471: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:19.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:19 smithi023 ceph-mon[78509]: pgmap v471: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:21.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:21 smithi153 ceph-mon[66339]: pgmap v472: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:21.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:21 smithi023 ceph-mon[78509]: pgmap v472: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:22.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:22 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:22.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:22 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:23.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:23 smithi153 ceph-mon[66339]: pgmap v473: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:23.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:23 smithi023 ceph-mon[78509]: pgmap v473: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:25.473 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:25 smithi023 ceph-mon[78509]: pgmap v474: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:25.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:25 smithi153 ceph-mon[66339]: pgmap v474: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:27.502 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:27 smithi153 ceph-mon[66339]: pgmap v475: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:27.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:27 smithi023 ceph-mon[78509]: pgmap v475: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:29.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:29 smithi153 ceph-mon[66339]: pgmap v476: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:29.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:29 smithi023 ceph-mon[78509]: pgmap v476: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:31.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:31 smithi153 ceph-mon[66339]: pgmap v477: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:31.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:31 smithi023 ceph-mon[78509]: pgmap v477: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:33.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:33 smithi153 ceph-mon[66339]: pgmap v478: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:33.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:33 smithi023 ceph-mon[78509]: pgmap v478: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:34.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:34 smithi153 ceph-mon[66339]: pgmap v479: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:34.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:34 smithi023 ceph-mon[78509]: pgmap v479: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:36.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:36 smithi153 ceph-mon[66339]: pgmap v480: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:36.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:36.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:36 smithi023 ceph-mon[78509]: pgmap v480: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:36.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:38.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:38 smithi153 ceph-mon[66339]: pgmap v481: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:38.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:38 smithi023 ceph-mon[78509]: pgmap v481: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:40.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:40 smithi153 ceph-mon[66339]: pgmap v482: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:40.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:40 smithi023 ceph-mon[78509]: pgmap v482: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:42.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:42 smithi023 ceph-mon[78509]: pgmap v483: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:42.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:42 smithi153 ceph-mon[66339]: pgmap v483: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:44.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:44 smithi153 ceph-mon[66339]: pgmap v484: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:44.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:44 smithi023 ceph-mon[78509]: pgmap v484: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:46.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:46 smithi153 ceph-mon[66339]: pgmap v485: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:46.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:46 smithi023 ceph-mon[78509]: pgmap v485: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:48.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:48 smithi153 ceph-mon[66339]: pgmap v486: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:48.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:48 smithi023 ceph-mon[78509]: pgmap v486: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:50.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:50 smithi153 ceph-mon[66339]: pgmap v487: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:50.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:50 smithi023 ceph-mon[78509]: pgmap v487: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:51.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:51.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:52.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:52 smithi023 ceph-mon[78509]: pgmap v488: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:52.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:52 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:40:52.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:52 smithi153 ceph-mon[66339]: pgmap v488: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:52.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:52 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:40:53.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:53 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:40:53.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:53 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:40:53.894 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:53 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:40:53.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:53 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:40:53.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:53 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:40:53.922 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:53 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:40:54.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:54 smithi153 ceph-mon[66339]: pgmap v489: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:54.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:54 smithi023 ceph-mon[78509]: pgmap v489: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:56.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:56 smithi153 ceph-mon[66339]: pgmap v490: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:56.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:56 smithi023 ceph-mon[78509]: pgmap v490: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:58.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:40:58 smithi153 ceph-mon[66339]: pgmap v491: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:40:58.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:40:58 smithi023 ceph-mon[78509]: pgmap v491: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:00.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:00 smithi023 ceph-mon[78509]: pgmap v492: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:01.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:00 smithi153 ceph-mon[66339]: pgmap v492: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:02.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:02 smithi023 ceph-mon[78509]: pgmap v493: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:03.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:02 smithi153 ceph-mon[66339]: pgmap v493: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:04.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:04 smithi023 ceph-mon[78509]: pgmap v494: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:05.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:04 smithi153 ceph-mon[66339]: pgmap v494: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:06.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:06 smithi023 ceph-mon[78509]: pgmap v495: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:06.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:06 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:07.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:06 smithi153 ceph-mon[66339]: pgmap v495: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:07.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:06 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:09.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:08 smithi153 ceph-mon[66339]: pgmap v496: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:09.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:08 smithi023 ceph-mon[78509]: pgmap v496: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:11.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:10 smithi153 ceph-mon[66339]: pgmap v497: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:11.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:10 smithi023 ceph-mon[78509]: pgmap v497: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:13.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:12 smithi153 ceph-mon[66339]: pgmap v498: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:13.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:12 smithi023 ceph-mon[78509]: pgmap v498: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:15.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:14 smithi153 ceph-mon[66339]: pgmap v499: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:15.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:14 smithi023 ceph-mon[78509]: pgmap v499: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:17.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:16 smithi153 ceph-mon[66339]: pgmap v500: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:17.172 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:16 smithi023 ceph-mon[78509]: pgmap v500: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:18.986 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:18 smithi153 ceph-mon[66339]: pgmap v501: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:19.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:18 smithi023 ceph-mon[78509]: pgmap v501: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:21.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:20 smithi153 ceph-mon[66339]: pgmap v502: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:21.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:20 smithi023 ceph-mon[78509]: pgmap v502: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:21.819 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:22.042 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:23.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:22 smithi153 ceph-mon[66339]: pgmap v503: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:23.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:22 smithi023 ceph-mon[78509]: pgmap v503: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:25.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:24 smithi153 ceph-mon[66339]: pgmap v504: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:25.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:24 smithi023 ceph-mon[78509]: pgmap v504: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:27.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:26 smithi153 ceph-mon[66339]: pgmap v505: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:27.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:26 smithi023 ceph-mon[78509]: pgmap v505: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:29.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:28 smithi153 ceph-mon[66339]: pgmap v506: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:29.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:28 smithi023 ceph-mon[78509]: pgmap v506: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:31.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:30 smithi153 ceph-mon[66339]: pgmap v507: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:31.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:30 smithi023 ceph-mon[78509]: pgmap v507: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:33.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:32 smithi153 ceph-mon[66339]: pgmap v508: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:33.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:32 smithi023 ceph-mon[78509]: pgmap v508: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:35.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:34 smithi153 ceph-mon[66339]: pgmap v509: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:35.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:34 smithi023 ceph-mon[78509]: pgmap v509: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:37.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:36 smithi153 ceph-mon[66339]: pgmap v510: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:37.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:37.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:36 smithi023 ceph-mon[78509]: pgmap v510: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:37.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:39.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:38 smithi153 ceph-mon[66339]: pgmap v511: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:39.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:38 smithi023 ceph-mon[78509]: pgmap v511: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:41.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:40 smithi153 ceph-mon[66339]: pgmap v512: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:41.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:40 smithi023 ceph-mon[78509]: pgmap v512: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:43.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:42 smithi153 ceph-mon[66339]: pgmap v513: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:43.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:42 smithi023 ceph-mon[78509]: pgmap v513: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:45.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:44 smithi153 ceph-mon[66339]: pgmap v514: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:45.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:44 smithi023 ceph-mon[78509]: pgmap v514: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:47.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:46 smithi153 ceph-mon[66339]: pgmap v515: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:47.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:46 smithi023 ceph-mon[78509]: pgmap v515: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:49.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:48 smithi153 ceph-mon[66339]: pgmap v516: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:49.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:48 smithi023 ceph-mon[78509]: pgmap v516: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:51.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:50 smithi153 ceph-mon[66339]: pgmap v517: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:51.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:50 smithi023 ceph-mon[78509]: pgmap v517: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:52.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:52.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:53.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:52 smithi153 ceph-mon[66339]: pgmap v518: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:53.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:52 smithi023 ceph-mon[78509]: pgmap v518: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:54.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:53 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:41:54.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:53 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:41:55.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:54 smithi023 ceph-mon[78509]: pgmap v519: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:55.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:54 smithi153 ceph-mon[66339]: pgmap v519: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:56.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:55 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:41:56.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:55 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:41:56.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:55 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:41:56.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:55 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:41:56.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:55 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:41:56.394 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:55 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:41:57.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:57 smithi153 ceph-mon[66339]: pgmap v520: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:57.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:57 smithi023 ceph-mon[78509]: pgmap v520: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:59.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:41:59 smithi153 ceph-mon[66339]: pgmap v521: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:41:59.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:41:59 smithi023 ceph-mon[78509]: pgmap v521: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:01.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:01 smithi153 ceph-mon[66339]: pgmap v522: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:01.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:01 smithi023 ceph-mon[78509]: pgmap v522: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:03.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:03 smithi153 ceph-mon[66339]: pgmap v523: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:03.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:03 smithi023 ceph-mon[78509]: pgmap v523: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:05.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:05 smithi153 ceph-mon[66339]: pgmap v524: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:05.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:05 smithi023 ceph-mon[78509]: pgmap v524: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:07.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:07 smithi153 ceph-mon[66339]: pgmap v525: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:07.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:07 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:07.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:07 smithi023 ceph-mon[78509]: pgmap v525: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:07.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:07 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:08.643 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:08 smithi153 ceph-mon[66339]: pgmap v526: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:08.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:08 smithi023 ceph-mon[78509]: pgmap v526: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:10.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:10 smithi153 ceph-mon[66339]: pgmap v527: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:10.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:10 smithi023 ceph-mon[78509]: pgmap v527: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:12.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:12 smithi023 ceph-mon[78509]: pgmap v528: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:12.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:12 smithi153 ceph-mon[66339]: pgmap v528: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:14.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:14 smithi153 ceph-mon[66339]: pgmap v529: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:14.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:14 smithi023 ceph-mon[78509]: pgmap v529: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:16.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:16 smithi153 ceph-mon[66339]: pgmap v530: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:16.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:16 smithi023 ceph-mon[78509]: pgmap v530: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:18.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:18 smithi153 ceph-mon[66339]: pgmap v531: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:18.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:18 smithi023 ceph-mon[78509]: pgmap v531: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:20.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:20 smithi153 ceph-mon[66339]: pgmap v532: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:20.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:20 smithi023 ceph-mon[78509]: pgmap v532: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:21.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:21 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:21.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:21 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:22.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:22 smithi023 ceph-mon[78509]: pgmap v533: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:22.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:22 smithi153 ceph-mon[66339]: pgmap v533: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:24.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:24 smithi153 ceph-mon[66339]: pgmap v534: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:24.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:24 smithi023 ceph-mon[78509]: pgmap v534: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:26.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:26 smithi153 ceph-mon[66339]: pgmap v535: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:26.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:26 smithi023 ceph-mon[78509]: pgmap v535: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:28.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:28 smithi023 ceph-mon[78509]: pgmap v536: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:29.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:28 smithi153 ceph-mon[66339]: pgmap v536: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:30.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:30 smithi023 ceph-mon[78509]: pgmap v537: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:31.051 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:30 smithi153 ceph-mon[66339]: pgmap v537: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:32.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:32 smithi023 ceph-mon[78509]: pgmap v538: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:33.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:32 smithi153 ceph-mon[66339]: pgmap v538: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:34.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:34 smithi023 ceph-mon[78509]: pgmap v539: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:35.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:34 smithi153 ceph-mon[66339]: pgmap v539: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:36.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:36 smithi023 ceph-mon[78509]: pgmap v540: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:36.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:36 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:37.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:36 smithi153 ceph-mon[66339]: pgmap v540: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:37.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:36 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:39.144 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:38 smithi153 ceph-mon[66339]: pgmap v541: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:39.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:38 smithi023 ceph-mon[78509]: pgmap v541: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:41.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:40 smithi153 ceph-mon[66339]: pgmap v542: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:41.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:40 smithi023 ceph-mon[78509]: pgmap v542: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:43.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:42 smithi153 ceph-mon[66339]: pgmap v543: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:43.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:42 smithi023 ceph-mon[78509]: pgmap v543: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:44.921 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:44 smithi023 ceph-mon[78509]: pgmap v544: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:45.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:44 smithi153 ceph-mon[66339]: pgmap v544: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:46.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:46 smithi153 ceph-mon[66339]: pgmap v545: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:47.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:46 smithi023 ceph-mon[78509]: pgmap v545: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:49.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:48 smithi153 ceph-mon[66339]: pgmap v546: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:49.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:48 smithi023 ceph-mon[78509]: pgmap v546: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:51.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:50 smithi153 ceph-mon[66339]: pgmap v547: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:51.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:50 smithi023 ceph-mon[78509]: pgmap v547: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:51.893 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:51 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:52.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:51 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:53.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:52 smithi153 ceph-mon[66339]: pgmap v548: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:53.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:52 smithi023 ceph-mon[78509]: pgmap v548: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:55.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:54 smithi153 ceph-mon[66339]: pgmap v549: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:55.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:54 smithi023 ceph-mon[78509]: pgmap v549: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:56.072 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:55 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:42:56.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:55 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:42:57.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:56 smithi153 ceph-mon[66339]: pgmap v550: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:57.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:56 smithi023 ceph-mon[78509]: pgmap v550: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:58.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:42:58.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:42:58.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:57 smithi153 ceph-mon[66339]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:42:58.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:42:58.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:42:58.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:57 smithi023 ceph-mon[78509]: from='mgr.34102 172.21.15.23:0/4177249332' entity='mgr.smithi023.bbebnt' 2024-02-28T16:42:58.925 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-02-28T16:42:58.925 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:42:58.927 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-28T16:42:58.949 INFO:tasks.cephadm:Teardown begin 2024-02-28T16:42:58.950 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:42:58.951 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:42:59.060 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:42:59.165 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-28T16:42:59.165 DEBUG:teuthology.orchestra.run.smithi023:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:42:59.227 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:42:59.286 INFO:tasks.cephadm:Stopping all daemons... 2024-02-28T16:42:59.286 INFO:tasks.cephadm.mon.smithi023:Stopping mon.smithi023... 2024-02-28T16:42:59.287 DEBUG:teuthology.orchestra.run.smithi023:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023 2024-02-28T16:42:59.379 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:58 smithi023 ceph-mon[78509]: pgmap v551: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:59.393 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:42:58 smithi153 ceph-mon[66339]: pgmap v551: 65 pgs: 65 active+clean; 209 MiB data, 862 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:42:59.671 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:59 smithi023 systemd[1]: Stopping Ceph mon.smithi023 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:00.421 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[78505]: 2024-02-28T16:42:59.959+0000 7f38c9600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi023 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:00.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:42:59 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023[78505]: 2024-02-28T16:42:59.959+0000 7f38c9600700 -1 mon.smithi023@0(leader) e3 *** Got Signal Terminated *** 2024-02-28T16:43:00.422 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:43:00 smithi023 podman[130699]: 2024-02-28 16:43:00.115026511 +0000 UTC m=+0.321381973 container died b383e5ebc0af2746e23b06806592ba3f44a6aebefcdfde2ff85c55d0d10a7ecd (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:43:00.899 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:43:00 smithi023 podman[130699]: 2024-02-28 16:43:00.727613729 +0000 UTC m=+0.933969187 container cleanup b383e5ebc0af2746e23b06806592ba3f44a6aebefcdfde2ff85c55d0d10a7ecd (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:43:00.899 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:43:00 smithi023 bash[130699]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023 2024-02-28T16:43:01.171 INFO:journalctl@ceph.mon.smithi023.smithi023.stdout:Feb 28 16:43:00 smithi023 podman[130724]: 2024-02-28 16:43:00.912362166 +0000 UTC m=+0.778777036 container remove b383e5ebc0af2746e23b06806592ba3f44a6aebefcdfde2ff85c55d0d10a7ecd (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi023, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True) 2024-02-28T16:43:01.462 DEBUG:teuthology.orchestra.run.smithi023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi023.service' 2024-02-28T16:43:01.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:01.613 INFO:tasks.cephadm.mon.smithi023:Stopped mon.smithi023 2024-02-28T16:43:01.613 INFO:tasks.cephadm.mon.smithi153:Stopping mon.smithi153... 2024-02-28T16:43:01.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi153 2024-02-28T16:43:02.143 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:43:01 smithi153 systemd[1]: Stopping Ceph mon.smithi153 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:02.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:43:02 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153[66335]: 2024-02-28T16:43:02.212+0000 7f3d1b200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi153 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:02.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:43:02 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153[66335]: 2024-02-28T16:43:02.212+0000 7f3d1b200700 -1 mon.smithi153@1(peon) e3 *** Got Signal Terminated *** 2024-02-28T16:43:02.797 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:43:02 smithi153 podman[96708]: 2024-02-28 16:43:02.50017109 +0000 UTC m=+0.441956656 container died 7b3873f5f7b3d142a33e26b60af04d9a2f7f7ffff2732df9cb859a1006d244b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-28T16:43:03.377 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:43:03 smithi153 podman[96708]: 2024-02-28 16:43:03.080589713 +0000 UTC m=+1.022375272 container cleanup 7b3873f5f7b3d142a33e26b60af04d9a2f7f7ffff2732df9cb859a1006d244b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-28T16:43:03.378 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:43:03 smithi153 bash[96708]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153 2024-02-28T16:43:03.627 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Feb 28 16:43:03 smithi153 podman[96722]: 2024-02-28 16:43:03.390568729 +0000 UTC m=+0.875586512 container remove 7b3873f5f7b3d142a33e26b60af04d9a2f7f7ffff2732df9cb859a1006d244b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-mon-smithi153, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222) 2024-02-28T16:43:03.642 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@mon.smithi153.service' 2024-02-28T16:43:03.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:03.787 INFO:tasks.cephadm.mon.smithi153:Stopped mon.smithi153 2024-02-28T16:43:03.787 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-28T16:43:03.788 DEBUG:teuthology.orchestra.run.smithi023:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.0 2024-02-28T16:43:04.171 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:03 smithi023 systemd[1]: Stopping Ceph osd.0 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:04.671 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:04 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[85152]: 2024-02-28T16:43:04.338+0000 7f8d2a000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:04.671 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:04 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[85152]: 2024-02-28T16:43:04.338+0000 7f8d2a000700 -1 osd.0 85 *** Got signal Terminated *** 2024-02-28T16:43:04.672 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:04 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0[85152]: 2024-02-28T16:43:04.338+0000 7f8d2a000700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:43:10.171 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:09 smithi023 podman[130842]: 2024-02-28 16:43:09.821404579 +0000 UTC m=+5.616767012 container died f272a8c2473365141feca85bc4a5b50b5b77fb59d9af1ee9f122a5104791fba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:43:10.620 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:10 smithi023 podman[130842]: 2024-02-28 16:43:10.356749727 +0000 UTC m=+6.152112193 container cleanup f272a8c2473365141feca85bc4a5b50b5b77fb59d9af1ee9f122a5104791fba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-28T16:43:10.620 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:10 smithi023 bash[130842]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0 2024-02-28T16:43:10.920 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:10 smithi023 podman[130863]: 2024-02-28 16:43:10.633115751 +0000 UTC m=+0.797261983 container remove f272a8c2473365141feca85bc4a5b50b5b77fb59d9af1ee9f122a5104791fba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:43:11.767 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:11 smithi023 podman[130951]: 2024-02-28 16:43:11.390061975 +0000 UTC m=+0.035811153 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:43:11.767 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:11 smithi023 podman[130951]: 2024-02-28 16:43:11.500692868 +0000 UTC m=+0.146442103 container create 81987c3cfe0c83a2dd9e2a296fde77e432c6bfa272e4fb63743ce108493e41b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-28T16:43:11.767 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:11 smithi023 podman[130951]: 2024-02-28 16:43:11.779546416 +0000 UTC m=+0.425295678 container init 81987c3cfe0c83a2dd9e2a296fde77e432c6bfa272e4fb63743ce108493e41b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:43:12.172 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:11 smithi023 podman[130951]: 2024-02-28 16:43:11.793329365 +0000 UTC m=+0.439078553 container start 81987c3cfe0c83a2dd9e2a296fde77e432c6bfa272e4fb63743ce108493e41b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:43:12.172 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:11 smithi023 podman[130951]: 2024-02-28 16:43:11.870224061 +0000 UTC m=+0.515973356 container attach 81987c3cfe0c83a2dd9e2a296fde77e432c6bfa272e4fb63743ce108493e41b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222) 2024-02-28T16:43:12.671 INFO:journalctl@ceph.osd.0.smithi023.stdout:Feb 28 16:43:12 smithi023 podman[130951]: 2024-02-28 16:43:12.242855445 +0000 UTC m=+0.888604614 container died 81987c3cfe0c83a2dd9e2a296fde77e432c6bfa272e4fb63743ce108493e41b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222) 2024-02-28T16:43:13.162 DEBUG:teuthology.orchestra.run.smithi023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.0.service' 2024-02-28T16:43:13.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:13.298 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-28T16:43:13.298 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-28T16:43:13.298 DEBUG:teuthology.orchestra.run.smithi023:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.1 2024-02-28T16:43:13.703 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:13 smithi023 systemd[1]: Stopping Ceph osd.1 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:14.171 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:13 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[88516]: 2024-02-28T16:43:13.941+0000 7f9032e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:14.171 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:13 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[88516]: 2024-02-28T16:43:13.941+0000 7f9032e00700 -1 osd.1 85 *** Got signal Terminated *** 2024-02-28T16:43:14.171 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:13 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1[88516]: 2024-02-28T16:43:13.941+0000 7f9032e00700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:43:19.921 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:19 smithi023 podman[131055]: 2024-02-28 16:43:19.55895999 +0000 UTC m=+5.748704276 container died e3ca8579a9f9f9853e2f39411fa1268f28585ff5cd89f23858e7dac0ff5be941 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, ceph=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-28T16:43:20.382 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:20 smithi023 podman[131055]: 2024-02-28 16:43:20.026385395 +0000 UTC m=+6.216129720 container cleanup e3ca8579a9f9f9853e2f39411fa1268f28585ff5cd89f23858e7dac0ff5be941 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-28T16:43:20.382 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:20 smithi023 bash[131055]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1 2024-02-28T16:43:20.671 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:20 smithi023 podman[131075]: 2024-02-28 16:43:20.394489855 +0000 UTC m=+0.827853658 container remove e3ca8579a9f9f9853e2f39411fa1268f28585ff5cd89f23858e7dac0ff5be941 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:43:21.263 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:20 smithi023 podman[131165]: 2024-02-28 16:43:20.882864868 +0000 UTC m=+0.033317814 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:43:21.263 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:21 smithi023 podman[131165]: 2024-02-28 16:43:21.003975673 +0000 UTC m=+0.154428654 container create 30957238132b94725d0cdd8f0ef951562ffd09abefe8fbf534665a431adc4241 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-28T16:43:21.263 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:21 smithi023 podman[131165]: 2024-02-28 16:43:21.274616911 +0000 UTC m=+0.425069936 container init 30957238132b94725d0cdd8f0ef951562ffd09abefe8fbf534665a431adc4241 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-28T16:43:21.671 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:21 smithi023 podman[131165]: 2024-02-28 16:43:21.288178723 +0000 UTC m=+0.438631737 container start 30957238132b94725d0cdd8f0ef951562ffd09abefe8fbf534665a431adc4241 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-02-28T16:43:21.671 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:21 smithi023 podman[131165]: 2024-02-28 16:43:21.406287238 +0000 UTC m=+0.556740226 container attach 30957238132b94725d0cdd8f0ef951562ffd09abefe8fbf534665a431adc4241 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-02-28T16:43:22.002 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:21 smithi023 podman[131165]: 2024-02-28 16:43:21.741850103 +0000 UTC m=+0.892303079 container died 30957238132b94725d0cdd8f0ef951562ffd09abefe8fbf534665a431adc4241 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:43:22.539 DEBUG:teuthology.orchestra.run.smithi023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.1.service' 2024-02-28T16:43:22.639 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:22 smithi023 podman[131190]: 2024-02-28 16:43:22.501346188 +0000 UTC m=+0.740270855 container remove 30957238132b94725d0cdd8f0ef951562ffd09abefe8fbf534665a431adc4241 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True) 2024-02-28T16:43:22.639 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:22 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-28T16:43:22.639 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:22 smithi023 systemd[1]: Stopped Ceph osd.1 for dea052fa-d653-11ee-95c3-87774f69a715. 2024-02-28T16:43:22.640 INFO:journalctl@ceph.osd.1.smithi023.stdout:Feb 28 16:43:22 smithi023 systemd[1]: ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.1.service: Consumed 27.235s CPU time. 2024-02-28T16:43:22.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:22.676 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-28T16:43:22.676 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-28T16:43:22.676 DEBUG:teuthology.orchestra.run.smithi023:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.2 2024-02-28T16:43:22.920 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:22 smithi023 systemd[1]: Stopping Ceph osd.2 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:23.671 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:23 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[91814]: 2024-02-28T16:43:23.320+0000 7f4d96600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:23.671 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:23 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[91814]: 2024-02-28T16:43:23.320+0000 7f4d96600700 -1 osd.2 85 *** Got signal Terminated *** 2024-02-28T16:43:23.671 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:23 smithi023 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2[91814]: 2024-02-28T16:43:23.320+0000 7f4d96600700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:43:29.130 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:28 smithi023 podman[131270]: 2024-02-28 16:43:28.702137838 +0000 UTC m=+5.549714956 container died 04b8de84daf761d643cb513c1eacfff905065509187c0d3af152cbe457fa26df (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-28T16:43:29.421 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:29 smithi023 podman[131270]: 2024-02-28 16:43:29.270876872 +0000 UTC m=+6.118454043 container cleanup 04b8de84daf761d643cb513c1eacfff905065509187c0d3af152cbe457fa26df (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:43:29.421 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:29 smithi023 bash[131270]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2 2024-02-28T16:43:29.924 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:29 smithi023 podman[131289]: 2024-02-28 16:43:29.483707267 +0000 UTC m=+0.764214726 container remove 04b8de84daf761d643cb513c1eacfff905065509187c0d3af152cbe457fa26df (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-02-28T16:43:30.427 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:30 smithi023 podman[131377]: 2024-02-28 16:43:30.209813342 +0000 UTC m=+0.036383123 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:43:30.428 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:30 smithi023 podman[131377]: 2024-02-28 16:43:30.306067744 +0000 UTC m=+0.132637549 container create 1257a6862ec5a65387ff22baa691a64dd138b5f2148921c6e509d8cc7cfd3924 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:43:30.841 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:30 smithi023 podman[131377]: 2024-02-28 16:43:30.543188925 +0000 UTC m=+0.369758737 container init 1257a6862ec5a65387ff22baa691a64dd138b5f2148921c6e509d8cc7cfd3924 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:43:30.841 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:30 smithi023 podman[131377]: 2024-02-28 16:43:30.556042126 +0000 UTC m=+0.382611901 container start 1257a6862ec5a65387ff22baa691a64dd138b5f2148921c6e509d8cc7cfd3924 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2) 2024-02-28T16:43:30.841 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:30 smithi023 podman[131377]: 2024-02-28 16:43:30.64981468 +0000 UTC m=+0.476384462 container attach 1257a6862ec5a65387ff22baa691a64dd138b5f2148921c6e509d8cc7cfd3924 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10) 2024-02-28T16:43:30.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:30 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:30.617+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:31.171 INFO:journalctl@ceph.osd.2.smithi023.stdout:Feb 28 16:43:31 smithi023 podman[131411]: 2024-02-28 16:43:31.077683367 +0000 UTC m=+0.034324646 container died 1257a6862ec5a65387ff22baa691a64dd138b5f2148921c6e509d8cc7cfd3924 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-28T16:43:31.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:31 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:31.069+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:31.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:31 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:31.653+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:31.918 DEBUG:teuthology.orchestra.run.smithi023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.2.service' 2024-02-28T16:43:32.039 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:32.039 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-28T16:43:32.039 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-28T16:43:32.039 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.3 2024-02-28T16:43:32.393 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:32 smithi153 systemd[1]: Stopping Ceph osd.3 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:32.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:32 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:32.024+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:32.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:32 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:32.606+0000 7f7bfb600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:32.894 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:32 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:32.606+0000 7f7bfb600700 -1 osd.3 85 *** Got signal Terminated *** 2024-02-28T16:43:32.894 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:32 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:32.606+0000 7f7bfb600700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:43:32.894 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:32 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:32.667+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:33.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:32 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:32.970+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:33.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:33 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:33.051+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:33.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:33 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:33.622+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:34.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:34 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:34.020+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:34.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:34 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:34.068+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:34.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:34 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:34.643+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:35.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:35 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:35.025+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:35.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:35 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:35.118+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:35.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:35 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:35.671+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:36.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:36 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:36.007+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:36.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:36 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:36.086+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:36.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:36 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:36.630+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:37.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:37 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:37.003+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:37.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:37 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:37.105+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:37.893 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:37 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3[71456]: 2024-02-28T16:43:37.599+0000 7f7bf2800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:06.554450+0000 front 2024-02-28T16:43:06.554382+0000 (oldest deadline 2024-02-28T16:43:30.054133+0000) 2024-02-28T16:43:38.393 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:38 smithi153 podman[96840]: 2024-02-28 16:43:38.092639851 +0000 UTC m=+5.622736722 container died 96b9690273293a345980dbf2f87929404380ddae10a4071f69485a5ccab58d31 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-02-28T16:43:38.394 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:38 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:38.026+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:38.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:38 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:38.124+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:38.813 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:38 smithi153 podman[96840]: 2024-02-28 16:43:38.574889465 +0000 UTC m=+6.104986402 container cleanup 96b9690273293a345980dbf2f87929404380ddae10a4071f69485a5ccab58d31 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-28T16:43:38.813 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:38 smithi153 bash[96840]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3 2024-02-28T16:43:39.141 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:38 smithi153 podman[96862]: 2024-02-28 16:43:38.825851194 +0000 UTC m=+0.715128875 container remove 96b9690273293a345980dbf2f87929404380ddae10a4071f69485a5ccab58d31 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10) 2024-02-28T16:43:39.142 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:39 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:39.003+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:39.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:39 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:39.154+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:39.976 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:39 smithi153 podman[96949]: 2024-02-28 16:43:39.579340034 +0000 UTC m=+0.035613260 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:43:39.976 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:39 smithi153 podman[96949]: 2024-02-28 16:43:39.68499704 +0000 UTC m=+0.141270301 container create 341b2cc6e942662e80f995fd353c760c3a7aa9840aff386867e1b70a3b41b0e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-28T16:43:40.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:40 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:40.129+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:40.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:39 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:39.989+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:40.394 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:39 smithi153 podman[96949]: 2024-02-28 16:43:39.997913757 +0000 UTC m=+0.454187045 container init 341b2cc6e942662e80f995fd353c760c3a7aa9840aff386867e1b70a3b41b0e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-28T16:43:40.394 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:40 smithi153 podman[96949]: 2024-02-28 16:43:40.009540278 +0000 UTC m=+0.465813549 container start 341b2cc6e942662e80f995fd353c760c3a7aa9840aff386867e1b70a3b41b0e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux ) 2024-02-28T16:43:40.394 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:40 smithi153 podman[96949]: 2024-02-28 16:43:40.095922096 +0000 UTC m=+0.552195391 container attach 341b2cc6e942662e80f995fd353c760c3a7aa9840aff386867e1b70a3b41b0e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, RELEASE=main-1fb5d10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-28T16:43:40.764 INFO:journalctl@ceph.osd.3.smithi153.stdout:Feb 28 16:43:40 smithi153 podman[96949]: 2024-02-28 16:43:40.440974096 +0000 UTC m=+0.897247346 container died 341b2cc6e942662e80f995fd353c760c3a7aa9840aff386867e1b70a3b41b0e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:43:41.085 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:41 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:41.021+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:41.130 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.3.service' 2024-02-28T16:43:41.246 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:41.246 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-28T16:43:41.246 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-28T16:43:41.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.4 2024-02-28T16:43:41.371 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:41 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:41.123+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:41.643 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:41 smithi153 systemd[1]: Stopping Ceph osd.4 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:42.143 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:42 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:42.083+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:42.143 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:41 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:41.843+0000 7fcfe4a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:42.144 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:41 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:41.843+0000 7fcfe4a00700 -1 osd.4 85 *** Got signal Terminated *** 2024-02-28T16:43:42.144 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:41 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:41.843+0000 7fcfe4a00700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:43:42.144 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:42 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:42.067+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:43.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:43.124+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:43.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:43 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:43.101+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:44.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:44 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:44.116+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:44.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:44 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:44.163+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:44.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:44 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:44.163+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:45.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:45 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:45.155+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:45.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:45 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:45.155+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:45.394 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:45 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:45.155+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:45.394 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:45 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:45.155+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:18.858908+0000 front 2024-02-28T16:43:18.858749+0000 (oldest deadline 2024-02-28T16:43:44.758453+0000) 2024-02-28T16:43:46.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:46 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:46.166+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:08.956689+0000 front 2024-02-28T16:43:08.956892+0000 (oldest deadline 2024-02-28T16:43:32.456489+0000) 2024-02-28T16:43:46.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:46 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4[74424]: 2024-02-28T16:43:46.166+0000 7fcfe0c00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:18.858908+0000 front 2024-02-28T16:43:18.858749+0000 (oldest deadline 2024-02-28T16:43:44.758453+0000) 2024-02-28T16:43:46.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:46 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:46.124+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:46.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:46 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:46.124+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:47.371 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:47 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:47.084+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:47.371 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:47 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:47.084+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:47.643 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:47 smithi153 podman[97054]: 2024-02-28 16:43:47.384741949 +0000 UTC m=+5.674773214 container died 79f6584de78330cdcf16b4c93ca1a8e9aaad705ae7f7149c3f89c9236f883067 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222) 2024-02-28T16:43:48.006 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:47 smithi153 podman[97054]: 2024-02-28 16:43:47.793243626 +0000 UTC m=+6.083274938 container cleanup 79f6584de78330cdcf16b4c93ca1a8e9aaad705ae7f7149c3f89c9236f883067 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-28T16:43:48.006 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:47 smithi153 bash[97054]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4 2024-02-28T16:43:48.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:48 smithi153 podman[97072]: 2024-02-28 16:43:48.019518262 +0000 UTC m=+0.619071769 container remove 79f6584de78330cdcf16b4c93ca1a8e9aaad705ae7f7149c3f89c9236f883067 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-02-28T16:43:48.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:48 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:48.133+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:48.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:48 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:48.133+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:49.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:49 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:49.109+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:49.127 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:49 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:49.109+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:49.128 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:48 smithi153 podman[97158]: 2024-02-28 16:43:48.791764594 +0000 UTC m=+0.034681333 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:43:49.128 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:48 smithi153 podman[97158]: 2024-02-28 16:43:48.895245925 +0000 UTC m=+0.138162700 container create 8a2ab153216c29f0c348112283197c5cce568193dbe76c1833aba21725d2ff48 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:43:49.128 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:49 smithi153 podman[97158]: 2024-02-28 16:43:49.140492369 +0000 UTC m=+0.383409154 container init 8a2ab153216c29f0c348112283197c5cce568193dbe76c1833aba21725d2ff48 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-02-28T16:43:49.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:49 smithi153 podman[97158]: 2024-02-28 16:43:49.151730815 +0000 UTC m=+0.394647620 container start 8a2ab153216c29f0c348112283197c5cce568193dbe76c1833aba21725d2ff48 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-28T16:43:49.393 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:49 smithi153 podman[97158]: 2024-02-28 16:43:49.289181733 +0000 UTC m=+0.532098548 container attach 8a2ab153216c29f0c348112283197c5cce568193dbe76c1833aba21725d2ff48 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-28T16:43:49.893 INFO:journalctl@ceph.osd.4.smithi153.stdout:Feb 28 16:43:49 smithi153 podman[97158]: 2024-02-28 16:43:49.578166449 +0000 UTC m=+0.821083230 container died 8a2ab153216c29f0c348112283197c5cce568193dbe76c1833aba21725d2ff48 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:43:50.341 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:50 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:50.076+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:50.341 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:50 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:50.076+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:50.396 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.4.service' 2024-02-28T16:43:50.515 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:50.515 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-28T16:43:50.516 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-28T16:43:50.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.5 2024-02-28T16:43:50.893 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:50 smithi153 systemd[1]: Stopping Ceph osd.5 for dea052fa-d653-11ee-95c3-87774f69a715... 2024-02-28T16:43:51.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:51 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:51.119+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:51.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:51 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:51.119+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:51.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:51 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:51.185+0000 7fa126000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:43:51.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:51 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:51.185+0000 7fa126000700 -1 osd.5 85 *** Got signal Terminated *** 2024-02-28T16:43:51.394 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:51 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:51.185+0000 7fa126000700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:43:52.643 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:52 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:52.158+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:52.643 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:52 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:52.158+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:52.644 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:52 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:52.158+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6822 osd.2 since back 2024-02-28T16:43:26.865240+0000 front 2024-02-28T16:43:26.865151+0000 (oldest deadline 2024-02-28T16:43:51.564810+0000) 2024-02-28T16:43:53.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:53 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:53.156+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:53.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:53 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:53.156+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:53.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:53 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:53.156+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6822 osd.2 since back 2024-02-28T16:43:26.865240+0000 front 2024-02-28T16:43:26.865151+0000 (oldest deadline 2024-02-28T16:43:51.564810+0000) 2024-02-28T16:43:54.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:54 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:54.133+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:54.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:54 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:54.133+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:54.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:54 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:54.133+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6822 osd.2 since back 2024-02-28T16:43:26.865240+0000 front 2024-02-28T16:43:26.865151+0000 (oldest deadline 2024-02-28T16:43:51.564810+0000) 2024-02-28T16:43:55.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:55 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:55.141+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:55.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:55 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:55.141+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:55.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:55 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:55.141+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6822 osd.2 since back 2024-02-28T16:43:26.865240+0000 front 2024-02-28T16:43:26.865151+0000 (oldest deadline 2024-02-28T16:43:51.564810+0000) 2024-02-28T16:43:56.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:56 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:56.115+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6806 osd.0 since back 2024-02-28T16:43:05.860788+0000 front 2024-02-28T16:43:05.861313+0000 (oldest deadline 2024-02-28T16:43:30.560825+0000) 2024-02-28T16:43:56.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:56 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:56.115+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6814 osd.1 since back 2024-02-28T16:43:16.963196+0000 front 2024-02-28T16:43:16.963115+0000 (oldest deadline 2024-02-28T16:43:43.363498+0000) 2024-02-28T16:43:56.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:56 smithi153 ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5[77333]: 2024-02-28T16:43:56.115+0000 7fa122200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.23:6822 osd.2 since back 2024-02-28T16:43:26.865240+0000 front 2024-02-28T16:43:26.865151+0000 (oldest deadline 2024-02-28T16:43:51.564810+0000) 2024-02-28T16:43:56.986 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:56 smithi153 podman[97264]: 2024-02-28 16:43:56.678039253 +0000 UTC m=+5.637044572 container died ac551516eb383632eccecdfc1f935e27ebcd647c959704656f580ee5352a942f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:43:57.374 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:57 smithi153 podman[97264]: 2024-02-28 16:43:57.119792388 +0000 UTC m=+6.078797660 container cleanup ac551516eb383632eccecdfc1f935e27ebcd647c959704656f580ee5352a942f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-28T16:43:57.375 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:57 smithi153 bash[97264]: ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5 2024-02-28T16:43:57.643 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:57 smithi153 podman[97296]: 2024-02-28 16:43:57.38748221 +0000 UTC m=+0.692865792 container remove ac551516eb383632eccecdfc1f935e27ebcd647c959704656f580ee5352a942f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD) 2024-02-28T16:43:58.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:58 smithi153 podman[97384]: 2024-02-28 16:43:58.139057524 +0000 UTC m=+0.038074040 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:43:58.393 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:58 smithi153 podman[97384]: 2024-02-28 16:43:58.255054727 +0000 UTC m=+0.154071267 container create f6bc77abc6b70e8f66f4ab33bf1f02bfbc1846ab4cf7a2d141a01f5131754ff1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:43:58.893 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:58 smithi153 podman[97384]: 2024-02-28 16:43:58.51690254 +0000 UTC m=+0.415919086 container init f6bc77abc6b70e8f66f4ab33bf1f02bfbc1846ab4cf7a2d141a01f5131754ff1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-28T16:43:58.894 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:58 smithi153 podman[97384]: 2024-02-28 16:43:58.528452623 +0000 UTC m=+0.427469173 container start f6bc77abc6b70e8f66f4ab33bf1f02bfbc1846ab4cf7a2d141a01f5131754ff1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-28T16:43:58.894 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:58 smithi153 podman[97384]: 2024-02-28 16:43:58.632387851 +0000 UTC m=+0.531404427 container attach f6bc77abc6b70e8f66f4ab33bf1f02bfbc1846ab4cf7a2d141a01f5131754ff1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-28T16:43:59.341 INFO:journalctl@ceph.osd.5.smithi153.stdout:Feb 28 16:43:58 smithi153 podman[97384]: 2024-02-28 16:43:58.974831911 +0000 UTC m=+0.873848474 container died f6bc77abc6b70e8f66f4ab33bf1f02bfbc1846ab4cf7a2d141a01f5131754ff1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-dea052fa-d653-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=) 2024-02-28T16:43:59.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dea052fa-d653-11ee-95c3-87774f69a715@osd.5.service' 2024-02-28T16:43:59.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:43:59.863 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-28T16:43:59.863 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dea052fa-d653-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T16:44:00.158 INFO:teuthology.orchestra.run.smithi023.stdout:Deleting cluster with fsid: dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:44:07.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi023.stderr:ceph-fuse[66945]: fuse finished with error 0 and tester_r 0 2024-02-28T16:44:33.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dea052fa-d653-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T16:44:33.734 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:44:52.874 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:44:52.988 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:44:53.089 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-28T16:44:53.092 DEBUG:teuthology.misc:Transferring archived files from smithi023:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584/remote/smithi023/crash 2024-02-28T16:44:53.093 DEBUG:teuthology.orchestra.run.smithi023:> sudo tar c -f - -C /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/crash -- . 2024-02-28T16:44:53.194 INFO:teuthology.orchestra.run.smithi023.stderr:tar: /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T16:44:53.194 INFO:teuthology.orchestra.run.smithi023.stderr:tar: Error is not recoverable: exiting now 2024-02-28T16:44:53.200 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584/remote/smithi153/crash 2024-02-28T16:44:53.201 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/crash -- . 2024-02-28T16:44:53.299 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/dea052fa-d653-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T16:44:53.299 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2024-02-28T16:44:53.302 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-28T16:44:53.303 DEBUG:teuthology.orchestra.run.smithi023:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-28T16:44:53.412 INFO:tasks.cephadm:Compressing logs... 2024-02-28T16:44:53.412 DEBUG:teuthology.orchestra.run.smithi023:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T16:44:53.416 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T16:44:53.488 INFO:teuthology.orchestra.run.smithi023.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-28T16:44:53.488 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T16:44:53.489 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-02-28T16:44:53.490 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi023.log 2024-02-28T16:44:53.491 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T16:44:53.492 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi023.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mgr.smithi023.bbebnt.log 2024-02-28T16:44:53.494 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mon.smithi023.log 2024-02-28T16:44:53.496 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mgr.smithi023.bbebnt.log: 94.2%gzip -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi023.log.gz -5 2024-02-28T16:44:53.496 INFO:teuthology.orchestra.run.smithi023.stderr: --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.1.log 2024-02-28T16:44:53.497 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mon.smithi023.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi023.pplvdo.log 2024-02-28T16:44:53.499 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi023.klbbrl.log 2024-02-28T16:44:53.504 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi023.pplvdo.log: /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi023.klbbrl.log: 91.4% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T16:44:53.504 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.0.log 2024-02-28T16:44:53.504 INFO:teuthology.orchestra.run.smithi023.stderr: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T16:44:53.504 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T16:44:53.506 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.log 2024-02-28T16:44:53.506 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.2.log 2024-02-28T16:44:53.507 INFO:teuthology.orchestra.run.smithi023.stderr: 85.7% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T16:44:53.511 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T16:44:53.511 INFO:teuthology.orchestra.run.smithi153.stderr:: No such file or directory 2024-02-28T16:44:53.512 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mon.smithi153.log 2024-02-28T16:44:53.513 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi153.log 2024-02-28T16:44:53.514 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mon.smithi153.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi153.dhwpyj.log 2024-02-28T16:44:53.515 INFO:teuthology.orchestra.run.smithi153.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T16:44:53.515 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi153.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T16:44:53.516 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.log: /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T16:44:53.517 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi153.dhwpyj.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.4.log 2024-02-28T16:44:53.518 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.5.log 2024-02-28T16:44:53.518 INFO:teuthology.orchestra.run.smithi153.stderr: 94.2% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi153.log.gz 2024-02-28T16:44:53.519 INFO:teuthology.orchestra.run.smithi023.stderr: 88.6% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T16:44:53.520 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.3.log 2024-02-28T16:44:53.521 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi153.senzwp.log 2024-02-28T16:44:53.521 INFO:teuthology.orchestra.run.smithi153.stderr: 91.5% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T16:44:53.522 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mgr.smithi153.qlkchp.log 2024-02-28T16:44:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi153.senzwp.log: gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T16:44:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mgr.smithi153.qlkchp.log: /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.cephadm.log: 85.7% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T16:44:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.log 2024-02-28T16:44:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T16:44:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.log: /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-volume.log: 88.6% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T16:44:53.537 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-02-28T16:44:53.557 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-volume.log: 91.5% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T16:44:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.log: 91.7% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T16:44:53.588 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mgr.smithi153.qlkchp.log.gz 2024-02-28T16:44:53.992 INFO:teuthology.orchestra.run.smithi023.stderr: 88.2% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mgr.smithi023.bbebnt.log.gz 2024-02-28T16:44:54.072 INFO:teuthology.orchestra.run.smithi153.stderr: 92.5% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mon.smithi153.log.gz 2024-02-28T16:44:55.037 INFO:teuthology.orchestra.run.smithi023.stderr: 90.3% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mon.smithi023.log.gz 2024-02-28T16:44:59.160 INFO:teuthology.orchestra.run.smithi153.stderr: 93.4% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.4.log.gz 2024-02-28T16:44:59.619 INFO:teuthology.orchestra.run.smithi023.stderr: 93.5% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.0.log.gz 2024-02-28T16:44:59.932 INFO:teuthology.orchestra.run.smithi153.stderr: 94.7% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi153.dhwpyj.log.gz 2024-02-28T16:45:00.594 INFO:teuthology.orchestra.run.smithi023.stderr: 93.5% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.2.log.gz 2024-02-28T16:45:01.172 INFO:teuthology.orchestra.run.smithi153.stderr: 93.6% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.5.log.gz 2024-02-28T16:45:01.320 INFO:teuthology.orchestra.run.smithi153.stderr: 94.7% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi153.senzwp.log.gz 2024-02-28T16:45:01.363 INFO:teuthology.orchestra.run.smithi023.stderr: 93.5% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.1.log.gz 2024-02-28T16:45:02.174 INFO:teuthology.orchestra.run.smithi023.stderr: 94.7% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi023.pplvdo.log.gz 2024-02-28T16:45:02.499 INFO:teuthology.orchestra.run.smithi153.stderr: 93.5% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-osd.3.log.gz 2024-02-28T16:45:09.473 INFO:teuthology.orchestra.run.smithi023.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-02-28T16:45:09.619 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-02-28T16:45:09.619 INFO:teuthology.orchestra.run.smithi153.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-02-28T16:45:09.625 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-02-28T16:45:09.625 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m16.155s 2024-02-28T16:45:09.625 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m49.780s 2024-02-28T16:45:09.625 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m3.526s 2024-02-28T16:46:30.076 INFO:teuthology.orchestra.run.smithi023.stderr: 92.8% -- replaced with /var/log/ceph/dea052fa-d653-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi023.klbbrl.log.gz 2024-02-28T16:46:30.080 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-02-28T16:46:30.080 INFO:teuthology.orchestra.run.smithi023.stderr:real 1m36.631s 2024-02-28T16:46:30.080 INFO:teuthology.orchestra.run.smithi023.stderr:user 2m14.431s 2024-02-28T16:46:30.081 INFO:teuthology.orchestra.run.smithi023.stderr:sys 0m9.904s 2024-02-28T16:46:30.082 INFO:tasks.cephadm:Archiving logs... 2024-02-28T16:46:30.082 DEBUG:teuthology.misc:Transferring archived files from smithi023:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584/remote/smithi023/log 2024-02-28T16:46:30.083 DEBUG:teuthology.orchestra.run.smithi023:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T16:46:48.881 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584/remote/smithi153/log 2024-02-28T16:46:48.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T16:46:55.015 INFO:tasks.cephadm:Removing cluster... 2024-02-28T16:46:55.015 DEBUG:teuthology.orchestra.run.smithi023:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dea052fa-d653-11ee-95c3-87774f69a715 --force 2024-02-28T16:46:55.307 INFO:teuthology.orchestra.run.smithi023.stdout:Deleting cluster with fsid: dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:46:56.355 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dea052fa-d653-11ee-95c3-87774f69a715 --force 2024-02-28T16:46:56.641 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: dea052fa-d653-11ee-95c3-87774f69a715 2024-02-28T16:46:57.402 INFO:tasks.cephadm:Removing cephadm ... 2024-02-28T16:46:57.402 DEBUG:teuthology.orchestra.run.smithi023:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T16:46:57.460 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T16:46:57.516 INFO:tasks.cephadm:Teardown complete 2024-02-28T16:46:57.516 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-28T16:46:57.531 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:46:57.532 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-28T16:46:57.532 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T16:46:57.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T16:46:57.695 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-28T16:46:57.706 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-28T16:46:57.707 DEBUG:teuthology.orchestra.run.smithi023:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:46:57.715 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:46:57.767 INFO:teuthology.orchestra.run.smithi023.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:46:57.770 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:46:57.777 INFO:teuthology.orchestra.run.smithi023.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:46:57.777 INFO:teuthology.orchestra.run.smithi023.stdout:=============================================================================== 2024-02-28T16:46:57.777 INFO:teuthology.orchestra.run.smithi023.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +1833us[+1833us] +/- 172ms 2024-02-28T16:46:57.777 INFO:teuthology.orchestra.run.smithi023.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -810us[ -797us] +/- 77ms 2024-02-28T16:46:57.777 INFO:teuthology.orchestra.run.smithi023.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +24us[ +24us] +/- 73ms 2024-02-28T16:46:57.777 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:46:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:46:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-02-28T16:46:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:^- hv01.front.sepia.ceph.com 2 6 377 49 +2205us[+2205us] +/- 172ms 2024-02-28T16:46:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 -447us[ -429us] +/- 77ms 2024-02-28T16:46:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +417us[ +417us] +/- 73ms 2024-02-28T16:46:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:46:57.781 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-28T16:46:57.793 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-28T16:46:57.794 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-28T16:46:57.835 DEBUG:teuthology.orchestra.run.smithi023:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T16:46:58.096 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T16:46:58.333 DEBUG:teuthology.orchestra.run.smithi023:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:46:58.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:46:58.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:46:58.547 INFO:teuthology.orchestra.run.smithi153.stdout:type=AVC msg=audit(1709136036.558:210): avc: denied { checkpoint_restore } for pid=1203 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-02-28T16:46:58.549 DEBUG:teuthology.task.selinux:ubuntu@smithi153.front.sepia.ceph.com has 1 denials 2024-02-28T16:46:58.549 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi153.front.sepia.ceph.com: ['type=AVC msg=audit(1709136036.558:210): avc: denied { checkpoint_restore } for pid=1203 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-02-28T16:46:58.550 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-28T16:46:58.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-28T16:46:58.572 INFO:teuthology.task.internal:Duration was 2783.562990 seconds 2024-02-28T16:46:58.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-28T16:46:58.619 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-28T16:46:58.619 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T16:46:58.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T16:46:58.795 INFO:teuthology.orchestra.run.smithi023.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:46:58.796 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:46:59.265 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-28T16:46:59.265 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi023.front.sepia.ceph.com 2024-02-28T16:46:59.265 DEBUG:teuthology.orchestra.run.smithi023:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T16:46:59.324 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-02-28T16:46:59.325 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T16:46:59.401 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-28T16:46:59.401 DEBUG:teuthology.orchestra.run.smithi023:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T16:46:59.405 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T16:46:59.484 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-28T16:46:59.484 DEBUG:teuthology.orchestra.run.smithi023:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T16:46:59.488 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T16:47:00.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-28T16:47:00.284 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-28T16:47:00.284 DEBUG:teuthology.orchestra.run.smithi023:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T16:47:00.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T16:47:00.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-28T16:47:00.508 DEBUG:teuthology.orchestra.run.smithi023:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:47:00.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:47:00.621 INFO:teuthology.orchestra.run.smithi023.stdout:kernel.core_pattern = core 2024-02-28T16:47:00.624 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-02-28T16:47:00.708 DEBUG:teuthology.orchestra.run.smithi023:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:47:00.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:47:00.766 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:47:00.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:47:00.820 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-28T16:47:00.833 INFO:teuthology.task.internal:Transferring archived files... 2024-02-28T16:47:00.834 DEBUG:teuthology.misc:Transferring archived files from smithi023:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584/remote/smithi023 2024-02-28T16:47:00.834 DEBUG:teuthology.orchestra.run.smithi023:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T16:47:00.966 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584/remote/smithi153 2024-02-28T16:47:00.966 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T16:47:01.074 INFO:teuthology.task.internal:Removing archive directory... 2024-02-28T16:47:01.074 DEBUG:teuthology.orchestra.run.smithi023:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T16:47:01.082 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T16:47:01.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-28T16:47:01.149 INFO:teuthology.task.internal:Not uploading archives. 2024-02-28T16:47:01.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-28T16:47:01.160 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-28T16:47:01.160 DEBUG:teuthology.orchestra.run.smithi023:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T16:47:01.166 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T16:47:01.219 INFO:teuthology.orchestra.run.smithi023.stdout: 395173 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 28 16:47 /home/ubuntu/cephtest 2024-02-28T16:47:01.219 INFO:teuthology.orchestra.run.smithi023.stdout: 812381 4 d--------- 2 ubuntu ubuntu 4096 Feb 28 16:20 /home/ubuntu/cephtest/mnt.0 2024-02-28T16:47:01.219 INFO:teuthology.orchestra.run.smithi023.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-02-28T16:47:01.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:47:01.222 INFO:teuthology.orchestra.run.smithi023.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-28T16:47:01.223 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi023 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-28T16:47:01.224 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-28T16:47:01.237 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-28T16:47:01.250 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:47:01.251 INFO:teuthology.nuke:Checking targets against current locks 2024-02-28T16:47:01.276 DEBUG:teuthology.nuke:shortname: smithi023 2024-02-28T16:47:01.276 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T16:47:01.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:42:38.548639', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKpxpgWMgX0oBaBg2HyrkwXrjJQLH9sk9pEpP2LeeYrmyTbUSJOmeTci4UVX+CmuzmJOi5jcgQ+HwlHs5370yA='} 2024-02-28T16:47:01.302 DEBUG:teuthology.nuke:shortname: smithi153 2024-02-28T16:47:01.302 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T16:47:01.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:42:38.550400', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPIAzTIrAIc9zanZjYmoGU/DVZzidcfZQj5tbZ1QvpAH6YcrQPZPfnlTVWjULEuVIggv/619Rn+82cKCLi/vIog='} 2024-02-28T16:47:01.355 INFO:teuthology.orchestra.console.smithi023:Power off 2024-02-28T16:47:01.356 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T16:47:01.379 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2024-02-28T16:47:01.379 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:47:01.395 INFO:teuthology.orchestra.console.smithi153:Power off 2024-02-28T16:47:01.395 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T16:47:01.407 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-28T16:47:01.420 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-02-28T16:47:01.420 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:47:01.448 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-02-28T16:47:05.409 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:47:05.449 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:47:05.520 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-28T16:47:05.559 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-02-28T16:47:09.524 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:47:09.560 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:47:09.634 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-28T16:47:09.670 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-02-28T16:47:09.736 INFO:teuthology.orchestra.console.smithi023:Power off completed 2024-02-28T16:47:09.771 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-02-28T16:47:09.877 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2783.56298995018 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 host.b-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 owner: scheduled_vshankar@teuthology status: fail success: false 2024-02-28T16:47:09.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:47:09.952 INFO:teuthology.run:FAIL